2024-09-16T07:12:55.185 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T07:12:55.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:12:55.294 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855 branch: wip-athakkar-testing-2024-09-15-1936 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7906855' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-athakkar-testing-2024-09-15-1936 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: client mount timeout: 30 debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 4ef5f0587d1cad82c4295c20951c303dc342ac74 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ef5f0587d1cad82c4295c20951c303dc342ac74 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-15-1936 sha1: 4ef5f0587d1cad82c4295c20951c303dc342ac74 owner: scheduled_khiremat@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6756 sha1: 4ef5f0587d1cad82c4295c20951c303dc342ac74 sleep_before_teardown: 0 subset: 3/4 suite: fs:volumes suite_branch: wip-athakkar-testing-2024-09-15-1936 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ef5f0587d1cad82c4295c20951c303dc342ac74/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ef5f0587d1cad82c4295c20951c303dc342ac74 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE7t/n4M4mZ1GDnIjno1QgYBvHZtyGfEyzEFiajmdxKf/cN+7exzCpkdzWXcAQ4OU6MefLFdA+wI33OgiemUF0U= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAdsF3obaq8tCUUCv/GJ0KZe1I0CZpfPHgwmPeeL/NhKJb+JG7lPQmP6JvGh1ZyMhCIIhxjNBVbpNrgyrUhI1A= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_07:02:54 tube: smithi user: khiremat verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T07:12:55.294 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ef5f0587d1cad82c4295c20951c303dc342ac74/qa; will attempt to use it 2024-09-16T07:12:55.295 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ef5f0587d1cad82c4295c20951c303dc342ac74/qa/tasks 2024-09-16T07:12:55.295 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T07:12:55.297 INFO:teuthology.task.internal:Checking packages... 2024-09-16T07:12:55.319 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4ef5f0587d1cad82c4295c20951c303dc342ac74' 2024-09-16T07:12:55.319 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T07:12:55.319 INFO:teuthology.packaging:ref: None 2024-09-16T07:12:55.319 INFO:teuthology.packaging:tag: None 2024-09-16T07:12:55.319 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-15-1936 2024-09-16T07:12:55.319 INFO:teuthology.packaging:sha1: 4ef5f0587d1cad82c4295c20951c303dc342ac74 2024-09-16T07:12:55.319 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-athakkar-testing-2024-09-15-1936 2024-09-16T07:12:55.460 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:12:55.462 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T07:12:55.469 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T07:12:55.469 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T07:12:55.476 INFO:teuthology.task.internal:Saving configuration 2024-09-16T07:12:55.494 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T07:12:55.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T07:12:55.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:07:20.623231', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHLn79WcjguB1LXjDDKyqoZT+3MRge3wVEhx40icGUIx'} 2024-09-16T07:12:55.541 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:07:20.624980', 'locked_by': 'scheduled_khiremat@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMIyYhpdwQ0kka2U9Y1Q8KVionE9FNyQvFqmhwZwB8O4'} 2024-09-16T07:12:55.541 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T07:12:55.548 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-16T07:12:55.548 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-16T07:12:55.548 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T07:12:55.609 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f007739fac0>, signals=[15]) 2024-09-16T07:12:55.609 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T07:12:55.615 INFO:teuthology.task.internal:Opening connections... 2024-09-16T07:12:55.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:12:55.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:12:55.698 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:12:55.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:12:55.780 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T07:12:55.787 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-09-16T07:12:55.792 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-09-16T07:12:55.792 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-09-16T07:12:55.838 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="22.04" 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=jammy 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T07:12:55.839 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T07:12:55.840 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=jammy 2024-09-16T07:12:55.840 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-09-16T07:12:55.891 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-09-16T07:12:55.897 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-09-16T07:12:55.897 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="22.04" 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=jammy 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T07:12:55.945 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T07:12:55.946 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=jammy 2024-09-16T07:12:55.946 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-09-16T07:12:55.966 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T07:12:55.975 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T07:12:55.981 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T07:12:55.981 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:12:55.984 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:12:55.992 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T07:12:55.998 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T07:12:55.998 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:12:56.032 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:12:56.050 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T07:12:56.106 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T07:12:56.121 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-16T07:12:56.121 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-16T07:12:56.121 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-16T07:12:56.121 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:12:56.122 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:12:56.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:12:56.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-16T07:12:56.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:12:56.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-16T07:12:56.294 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-16T07:12:56.295 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-16T07:12:56.295 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-16T07:12:56.302 INFO:teuthology.orchestra.run.smithi149.stdout:5.15.0-56-generic 2024-09-16T07:12:56.302 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-16T07:12:56.303 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-16T07:12:56.303 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-16T07:12:56.303 DEBUG:teuthology.orchestra.run.smithi149:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-16T07:12:56.312 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-16T07:12:56.312 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-16T07:12:56.313 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-16T07:12:56.319 INFO:teuthology.orchestra.run.smithi114.stdout:5.15.0-56-generic 2024-09-16T07:12:56.319 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-16T07:12:56.320 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-16T07:12:56.320 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-16T07:12:56.320 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-16T07:12:56.362 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-16T07:12:56.388 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-16T07:12:56.502 INFO:teuthology.orchestra.run.smithi149.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-16T07:12:56.502 INFO:teuthology.orchestra.run.smithi149.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-16T07:12:56.502 INFO:teuthology.orchestra.run.smithi149.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-16T07:12:56.503 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 2024-09-16T07:12:56.503 INFO:teuthology.orchestra.run.smithi149.stderr:hint: git config --global init.defaultBranch 2024-09-16T07:12:56.503 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 2024-09-16T07:12:56.503 INFO:teuthology.orchestra.run.smithi149.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-16T07:12:56.503 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-16T07:12:56.503 INFO:teuthology.orchestra.run.smithi149.stderr:hint: 2024-09-16T07:12:56.503 INFO:teuthology.orchestra.run.smithi149.stderr:hint: git branch -m 2024-09-16T07:12:56.504 INFO:teuthology.orchestra.run.smithi149.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-16T07:12:56.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-16T07:12:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-16T07:12:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-16T07:12:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-16T07:12:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-09-16T07:12:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:hint: git config --global init.defaultBranch 2024-09-16T07:12:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-09-16T07:12:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-16T07:12:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-16T07:12:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-09-16T07:12:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:hint: git branch -m 2024-09-16T07:12:56.520 INFO:teuthology.orchestra.run.smithi114.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-16T07:12:56.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-16T07:12:56.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-16T07:12:56.589 DEBUG:teuthology.orchestra.run.smithi149:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-16T07:12:56.640 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-16T07:12:56.645 DEBUG:teuthology.orchestra.run.smithi149:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-16T07:13:20.794 INFO:teuthology.orchestra.run.smithi114.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-16T07:13:20.794 INFO:teuthology.orchestra.run.smithi114.stderr: * [new branch] main -> origin/main 2024-09-16T07:13:20.822 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190312 -> 20190312 2024-09-16T07:13:20.822 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190416 -> 20190416 2024-09-16T07:13:20.823 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190514 -> 20190514 2024-09-16T07:13:20.823 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190618 -> 20190618 2024-09-16T07:13:20.823 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190717 -> 20190717 2024-09-16T07:13:20.823 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190815 -> 20190815 2024-09-16T07:13:20.823 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190923 -> 20190923 2024-09-16T07:13:20.823 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191022 -> 20191022 2024-09-16T07:13:20.823 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191215 -> 20191215 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200122 -> 20200122 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200316 -> 20200316 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200421 -> 20200421 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200519 -> 20200519 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200619 -> 20200619 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200721 -> 20200721 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200817 -> 20200817 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200918 -> 20200918 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201022 -> 20201022 2024-09-16T07:13:20.826 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201118 -> 20201118 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201218 -> 20201218 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210208 -> 20210208 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210315 -> 20210315 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210511 -> 20210511 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210716 -> 20210716 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210818 -> 20210818 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210919 -> 20210919 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211027 -> 20211027 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211216 -> 20211216 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220209 -> 20220209 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220310 -> 20220310 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220411 -> 20220411 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220509 -> 20220509 2024-09-16T07:13:20.827 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220610 -> 20220610 2024-09-16T07:13:20.830 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220708 -> 20220708 2024-09-16T07:13:20.830 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220815 -> 20220815 2024-09-16T07:13:20.830 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220913 -> 20220913 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221012 -> 20221012 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221109 -> 20221109 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221214 -> 20221214 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230117 -> 20230117 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230210 -> 20230210 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230310 -> 20230310 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230404 -> 20230404 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230515 -> 20230515 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230625 -> 20230625 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230804 -> 20230804 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230919 -> 20230919 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231030 -> 20231030 2024-09-16T07:13:20.831 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231111 -> 20231111 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231211 -> 20231211 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240115 -> 20240115 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240220 -> 20240220 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240312 -> 20240312 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240410 -> 20240410 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240513 -> 20240513 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240610 -> 20240610 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240709 -> 20240709 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240811 -> 20240811 2024-09-16T07:13:20.832 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240909 -> 20240909 2024-09-16T07:13:23.938 INFO:teuthology.orchestra.run.smithi149.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-16T07:13:23.939 INFO:teuthology.orchestra.run.smithi149.stderr: * [new branch] main -> origin/main 2024-09-16T07:13:23.975 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190312 -> 20190312 2024-09-16T07:13:23.975 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190416 -> 20190416 2024-09-16T07:13:23.975 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190514 -> 20190514 2024-09-16T07:13:23.975 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190618 -> 20190618 2024-09-16T07:13:23.975 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190717 -> 20190717 2024-09-16T07:13:23.975 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190815 -> 20190815 2024-09-16T07:13:23.976 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20190923 -> 20190923 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20191022 -> 20191022 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20191215 -> 20191215 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200122 -> 20200122 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200316 -> 20200316 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200421 -> 20200421 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200519 -> 20200519 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200619 -> 20200619 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200721 -> 20200721 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200817 -> 20200817 2024-09-16T07:13:23.977 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20200918 -> 20200918 2024-09-16T07:13:23.979 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20201022 -> 20201022 2024-09-16T07:13:23.979 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20201118 -> 20201118 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20201218 -> 20201218 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210208 -> 20210208 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210315 -> 20210315 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210511 -> 20210511 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210716 -> 20210716 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210818 -> 20210818 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20210919 -> 20210919 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20211027 -> 20211027 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20211216 -> 20211216 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220209 -> 20220209 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220310 -> 20220310 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220411 -> 20220411 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220509 -> 20220509 2024-09-16T07:13:23.980 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220610 -> 20220610 2024-09-16T07:13:23.981 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220708 -> 20220708 2024-09-16T07:13:23.981 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220815 -> 20220815 2024-09-16T07:13:23.981 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20220913 -> 20220913 2024-09-16T07:13:23.983 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20221012 -> 20221012 2024-09-16T07:13:23.983 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20221109 -> 20221109 2024-09-16T07:13:23.983 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20221214 -> 20221214 2024-09-16T07:13:23.983 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230117 -> 20230117 2024-09-16T07:13:23.983 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230210 -> 20230210 2024-09-16T07:13:23.983 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230310 -> 20230310 2024-09-16T07:13:23.983 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230404 -> 20230404 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230515 -> 20230515 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230625 -> 20230625 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230804 -> 20230804 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20230919 -> 20230919 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20231030 -> 20231030 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20231111 -> 20231111 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20231211 -> 20231211 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240115 -> 20240115 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240220 -> 20240220 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240312 -> 20240312 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240410 -> 20240410 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240513 -> 20240513 2024-09-16T07:13:23.984 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240610 -> 20240610 2024-09-16T07:13:23.985 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240709 -> 20240709 2024-09-16T07:13:23.985 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240811 -> 20240811 2024-09-16T07:13:23.985 INFO:teuthology.orchestra.run.smithi149.stderr: * [new tag] 20240909 -> 20240909 2024-09-16T07:13:25.404 INFO:teuthology.orchestra.run.smithi114.stderr:Updating files: 44% (1559/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2080/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2437/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2905/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-16T07:13:25.408 INFO:teuthology.orchestra.run.smithi114.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-16T07:13:25.431 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-16T07:13:25.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-16T07:13:25.587 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-16T07:13:25.587 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-16T07:13:25.589 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-09-16T07:13:26.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16 07:13:26 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-16T07:13:26.579 INFO:teuthology.orchestra.run.smithi114.stderr:FINISHED --2024-09-16 07:13:26-- 2024-09-16T07:13:26.579 INFO:teuthology.orchestra.run.smithi114.stderr:Total wall clock time: 1.0s 2024-09-16T07:13:26.580 INFO:teuthology.orchestra.run.smithi114.stderr:Downloaded: 1 files, 43M in 0.8s (51.8 MB/s) 2024-09-16T07:13:26.584 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-16T07:13:26.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo dpkg -i /tmp/linux-image.deb 2024-09-16T07:13:26.852 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-16T07:13:28.621 INFO:teuthology.orchestra.run.smithi149.stderr:Updating files: 32% (1153/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2069/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2432/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2902/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-16T07:13:28.626 INFO:teuthology.orchestra.run.smithi149.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-16T07:13:28.648 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-16T07:13:28.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-16T07:13:28.790 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-16T07:13:28.790 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-16T07:13:28.793 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-09-16T07:13:28.817 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-16T07:13:28.821 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-16T07:13:28.920 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-16T07:13:29.806 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16 07:13:30 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-16T07:13:29.806 INFO:teuthology.orchestra.run.smithi149.stderr:FINISHED --2024-09-16 07:13:30-- 2024-09-16T07:13:29.806 INFO:teuthology.orchestra.run.smithi149.stderr:Total wall clock time: 1.0s 2024-09-16T07:13:29.806 INFO:teuthology.orchestra.run.smithi149.stderr:Downloaded: 1 files, 43M in 0.8s (52.0 MB/s) 2024-09-16T07:13:29.810 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-16T07:13:29.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo dpkg -i /tmp/linux-image.deb 2024-09-16T07:13:30.110 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-16T07:13:32.135 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-16T07:13:32.141 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-16T07:13:32.288 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-16T07:13:32.803 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-16T07:13:32.903 INFO:teuthology.orchestra.run.smithi114.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:36.086 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-16T07:13:36.185 INFO:teuthology.orchestra.run.smithi149.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:55.963 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-09-16T07:13:55.983 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T07:13:56.008 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-09-16T07:13:56.300 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:56.631 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T07:13:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T07:13:56.702 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T07:13:56.707 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T07:13:56.842 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T07:13:56.842 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T07:13:56.842 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T07:13:56.872 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-09-16T07:13:57.053 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-deb -c /tmp/linux-image.deb 2024-09-16T07:13:57.061 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-16T07:13:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-16T07:13:57.062 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:57.076 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:57.077 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-16T07:13:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-16T07:13:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-16T07:13:57.098 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-16T07:13:57.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-16T07:13:57.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-16T07:13:57.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-16T07:13:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-16T07:13:57.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-16T07:13:57.180 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-16T07:13:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-16T07:13:57.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-16T07:13:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-16T07:13:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-16T07:13:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-16T07:13:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-16T07:13:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-16T07:13:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-16T07:13:57.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-16T07:13:57.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-16T07:13:57.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-16T07:13:57.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-16T07:13:57.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-16T07:13:57.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-16T07:13:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-16T07:13:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-16T07:13:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-16T07:13:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-16T07:13:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-16T07:13:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-16T07:13:57.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-16T07:13:57.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-16T07:13:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-16T07:13:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-16T07:13:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-16T07:13:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-16T07:13:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-16T07:13:57.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-16T07:13:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-16T07:13:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-16T07:13:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-16T07:13:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-16T07:13:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-16T07:13:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-16T07:13:57.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-16T07:13:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-16T07:13:57.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-16T07:13:57.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-16T07:13:57.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-16T07:13:57.198 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-16T07:13:57.199 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-16T07:13:57.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-16T07:13:57.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-16T07:13:57.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-16T07:13:57.203 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-16T07:13:57.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-16T07:13:57.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-16T07:13:57.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-16T07:13:57.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-16T07:13:57.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-16T07:13:57.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-16T07:13:57.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-16T07:13:57.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-16T07:13:57.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-16T07:13:57.213 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-16T07:13:57.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-16T07:13:57.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-16T07:13:57.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-16T07:13:57.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-16T07:13:57.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-16T07:13:57.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-16T07:13:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-16T07:13:57.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-16T07:13:57.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-16T07:13:57.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-16T07:13:57.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-16T07:13:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-16T07:13:57.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-16T07:13:57.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-16T07:13:57.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-16T07:13:57.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-16T07:13:57.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-16T07:13:57.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-16T07:13:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-16T07:13:57.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-16T07:13:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-16T07:13:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-16T07:13:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-16T07:13:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-16T07:13:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-16T07:13:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-16T07:13:57.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-16T07:13:57.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-16T07:13:57.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-16T07:13:57.238 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-16T07:13:57.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-16T07:13:57.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-16T07:13:57.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-16T07:13:57.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-16T07:13:57.243 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-16T07:13:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-16T07:13:57.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-16T07:13:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-16T07:13:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-16T07:13:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-16T07:13:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-16T07:13:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-16T07:13:57.246 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-16T07:13:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-16T07:13:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-16T07:13:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-16T07:13:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-16T07:13:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-16T07:13:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-16T07:13:57.247 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-16T07:13:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-16T07:13:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-16T07:13:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-16T07:13:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-16T07:13:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-16T07:13:57.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-16T07:13:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-16T07:13:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-16T07:13:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-16T07:13:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-16T07:13:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-16T07:13:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-16T07:13:57.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-16T07:13:57.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-16T07:13:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-16T07:13:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-16T07:13:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-16T07:13:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-16T07:13:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-16T07:13:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-16T07:13:57.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-16T07:13:57.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-16T07:13:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-16T07:13:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-16T07:13:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-16T07:13:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-16T07:13:57.253 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-16T07:13:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-16T07:13:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-16T07:13:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-16T07:13:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-16T07:13:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-16T07:13:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-16T07:13:57.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-16T07:13:57.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-16T07:13:57.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-16T07:13:57.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-16T07:13:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-16T07:13:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-16T07:13:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-16T07:13:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-16T07:13:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-16T07:13:57.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-16T07:13:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-16T07:13:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-16T07:13:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-16T07:13:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-16T07:13:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-16T07:13:57.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-16T07:13:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-16T07:13:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-16T07:13:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-16T07:13:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-16T07:13:57.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-16T07:13:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-16T07:13:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-16T07:13:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-16T07:13:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-16T07:13:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-16T07:13:57.261 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-16T07:13:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-16T07:13:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-16T07:13:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-16T07:13:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-16T07:13:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-16T07:13:57.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-16T07:13:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-16T07:13:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-16T07:13:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-16T07:13:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-16T07:13:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-16T07:13:57.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-16T07:13:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-16T07:13:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-16T07:13:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-16T07:13:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-16T07:13:57.264 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-16T07:13:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-16T07:13:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-16T07:13:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-16T07:13:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-16T07:13:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-16T07:13:57.265 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-16T07:13:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-16T07:13:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-16T07:13:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-16T07:13:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-16T07:13:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-16T07:13:57.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-16T07:13:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-16T07:13:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-16T07:13:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-16T07:13:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-16T07:13:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-16T07:13:57.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-16T07:13:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-16T07:13:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-16T07:13:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-16T07:13:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-16T07:13:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-16T07:13:57.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-16T07:13:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-16T07:13:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-16T07:13:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-16T07:13:57.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-16T07:13:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-16T07:13:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-16T07:13:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-16T07:13:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-16T07:13:57.403 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-16T07:13:57.404 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-16T07:13:57.405 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-16T07:13:57.406 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-16T07:13:57.407 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-16T07:13:57.408 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-16T07:13:57.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-16T07:13:57.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-16T07:13:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-16T07:13:57.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-16T07:13:57.413 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-16T07:13:57.414 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-16T07:13:57.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-16T07:13:57.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-16T07:13:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-16T07:13:57.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-16T07:13:57.419 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-16T07:13:57.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-16T07:13:57.421 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-16T07:13:57.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-16T07:13:57.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-16T07:13:57.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-16T07:13:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-16T07:13:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-16T07:13:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-16T07:13:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-16T07:13:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-16T07:13:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-16T07:13:57.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-16T07:13:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-16T07:13:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-16T07:13:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-16T07:13:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-16T07:13:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-16T07:13:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-16T07:13:57.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-16T07:13:57.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-16T07:13:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-16T07:13:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-16T07:13:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-16T07:13:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-16T07:13:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-16T07:13:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-16T07:13:57.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-16T07:13:57.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-16T07:13:57.430 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-16T07:13:57.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-16T07:13:57.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-16T07:13:57.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-16T07:13:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-16T07:13:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-16T07:13:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-16T07:13:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-16T07:13:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-16T07:13:57.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-16T07:13:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-16T07:13:57.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-16T07:13:57.437 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-16T07:13:57.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-16T07:13:57.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-16T07:13:57.440 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-16T07:13:57.441 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-16T07:13:57.442 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-16T07:13:57.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-16T07:13:57.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-16T07:13:57.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-16T07:13:57.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-16T07:13:57.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-16T07:13:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-16T07:13:57.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-16T07:13:57.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-16T07:13:57.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-16T07:13:57.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-16T07:13:57.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-16T07:13:57.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-16T07:13:57.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-16T07:13:57.456 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-16T07:13:57.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-16T07:13:57.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-16T07:13:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-16T07:13:57.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-16T07:13:57.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-16T07:13:57.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-16T07:13:57.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-16T07:13:57.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-16T07:13:57.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-16T07:13:57.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-16T07:13:57.467 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-16T07:13:57.468 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-16T07:13:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-16T07:13:57.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-16T07:13:57.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-16T07:13:57.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-16T07:13:57.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-16T07:13:57.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-16T07:13:57.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-16T07:13:57.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-16T07:13:57.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-16T07:13:57.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-16T07:13:57.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-16T07:13:57.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-16T07:13:57.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-16T07:13:57.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-16T07:13:57.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-16T07:13:57.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-16T07:13:57.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-16T07:13:57.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-16T07:13:57.472 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-16T07:13:57.472 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-16T07:13:57.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-16T07:13:57.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-16T07:13:57.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-16T07:13:57.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-16T07:13:57.474 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-16T07:13:57.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-16T07:13:57.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-16T07:13:57.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-16T07:13:57.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-16T07:13:57.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-16T07:13:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-16T07:13:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-16T07:13:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-16T07:13:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-16T07:13:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-16T07:13:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-16T07:13:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-16T07:13:57.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-16T07:13:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-16T07:13:57.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-16T07:13:57.479 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-16T07:13:57.480 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-16T07:13:57.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-16T07:13:57.481 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-16T07:13:57.481 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-16T07:13:57.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-16T07:13:57.481 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-16T07:13:57.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-16T07:13:57.483 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-16T07:13:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-16T07:13:57.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-16T07:13:57.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-16T07:13:57.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-16T07:13:57.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-16T07:13:57.488 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-16T07:13:57.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-16T07:13:57.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-16T07:13:57.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-16T07:13:57.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-16T07:13:57.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-16T07:13:57.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-16T07:13:57.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-16T07:13:57.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-16T07:13:57.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-16T07:13:57.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-16T07:13:57.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-16T07:13:57.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-16T07:13:57.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-16T07:13:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-16T07:13:57.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-16T07:13:57.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-16T07:13:57.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-16T07:13:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-16T07:13:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-16T07:13:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-16T07:13:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-16T07:13:57.496 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-16T07:13:57.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-16T07:13:57.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-16T07:13:57.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-16T07:13:57.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-16T07:13:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-16T07:13:57.502 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-16T07:13:57.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-16T07:13:57.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-16T07:13:57.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-16T07:13:57.506 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-16T07:13:57.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-16T07:13:57.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-16T07:13:57.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-16T07:13:57.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-16T07:13:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-16T07:13:57.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-16T07:13:57.513 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-16T07:13:57.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-16T07:13:57.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-16T07:13:57.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-16T07:13:57.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-16T07:13:57.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-16T07:13:57.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-16T07:13:57.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-16T07:13:57.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-16T07:13:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-16T07:13:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-16T07:13:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-16T07:13:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-16T07:13:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-16T07:13:57.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-16T07:13:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-16T07:13:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-16T07:13:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-16T07:13:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-16T07:13:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-16T07:13:57.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-16T07:13:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-16T07:13:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-16T07:13:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-16T07:13:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-16T07:13:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-16T07:13:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-16T07:13:57.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-16T07:13:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-16T07:13:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-16T07:13:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-16T07:13:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-16T07:13:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-16T07:13:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-16T07:13:57.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-16T07:13:57.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-16T07:13:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-16T07:13:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-16T07:13:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-16T07:13:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-16T07:13:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-16T07:13:57.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-16T07:13:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-16T07:13:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-16T07:13:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-16T07:13:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-16T07:13:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-16T07:13:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-16T07:13:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-16T07:13:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-16T07:13:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-16T07:13:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-16T07:13:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-16T07:13:57.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-16T07:13:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-16T07:13:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-16T07:13:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-16T07:13:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-16T07:13:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-16T07:13:57.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-16T07:13:57.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-16T07:13:57.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-16T07:13:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-16T07:13:57.534 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-16T07:13:57.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-16T07:13:57.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-16T07:13:57.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-16T07:13:57.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-16T07:13:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-16T07:13:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-16T07:13:57.541 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-16T07:13:57.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-16T07:13:57.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-16T07:13:57.544 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-16T07:13:57.549 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:57.550 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:57.550 DEBUG:teuthology.orchestra.run.smithi114:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-16T07:13:57.557 INFO:teuthology.orchestra.run.smithi114.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-16T07:13:57.557 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-16T07:13:57.557 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-16T07:13:57.557 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-16T07:13:57.558 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:57.558 DEBUG:teuthology.orchestra.run.smithi114:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-16T07:13:57.599 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-09-16T07:13:58.006 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-09-16T07:13:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T07:13:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-09-16T07:13:58.231 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:58.236 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:13:58.470 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T07:13:58.475 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T07:13:58.512 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T07:13:58.517 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T07:13:58.645 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T07:13:58.645 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T07:13:58.645 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T07:13:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-09-16T07:13:59.755 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub' 2024-09-16T07:13:59.766 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T07:13:59.793 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-16T07:14:00.119 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:00.135 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:00.468 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T07:14:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T07:14:00.546 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T07:14:00.552 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T07:14:00.695 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T07:14:00.696 INFO:teuthology.orchestra.run.smithi149.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T07:14:00.696 INFO:teuthology.orchestra.run.smithi149.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T07:14:00.728 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-16T07:14:00.946 DEBUG:teuthology.orchestra.run.smithi149:> dpkg-deb -c /tmp/linux-image.deb 2024-09-16T07:14:00.995 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-16T07:14:00.995 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-16T07:14:00.995 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:01.014 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:01.014 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:01.034 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-16T07:14:01.034 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-16T07:14:01.034 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-16T07:14:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-16T07:14:01.036 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-16T07:14:01.038 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-16T07:14:01.039 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-16T07:14:01.039 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-16T07:14:01.039 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-16T07:14:01.039 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-16T07:14:01.039 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-16T07:14:01.039 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-16T07:14:01.039 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-16T07:14:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-16T07:14:01.059 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-16T07:14:01.060 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-16T07:14:01.061 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-16T07:14:01.062 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-16T07:14:01.063 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-16T07:14:01.064 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-16T07:14:01.065 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-16T07:14:01.066 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-16T07:14:01.067 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-16T07:14:01.068 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-16T07:14:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-16T07:14:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-16T07:14:01.071 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-16T07:14:01.072 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-16T07:14:01.073 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-16T07:14:01.074 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-16T07:14:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-16T07:14:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-16T07:14:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-16T07:14:01.123 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-16T07:14:01.124 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-16T07:14:01.125 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-16T07:14:01.126 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-16T07:14:01.127 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-16T07:14:01.128 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-16T07:14:01.129 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-16T07:14:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-16T07:14:01.131 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-16T07:14:01.132 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-16T07:14:01.133 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-16T07:14:01.134 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-16T07:14:01.135 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-16T07:14:01.136 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-16T07:14:01.137 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-16T07:14:01.138 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-16T07:14:01.139 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-16T07:14:01.140 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-16T07:14:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-16T07:14:01.142 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-16T07:14:01.143 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-16T07:14:01.144 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-16T07:14:01.145 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-16T07:14:01.146 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-16T07:14:01.147 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-16T07:14:01.148 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-16T07:14:01.149 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-16T07:14:01.150 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-16T07:14:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-16T07:14:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-16T07:14:01.151 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-16T07:14:01.152 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-16T07:14:01.153 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-16T07:14:01.154 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-16T07:14:01.155 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-16T07:14:01.156 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-16T07:14:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-16T07:14:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-16T07:14:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-16T07:14:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-16T07:14:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-16T07:14:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-16T07:14:01.157 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-16T07:14:01.158 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-16T07:14:01.159 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-16T07:14:01.160 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-16T07:14:01.161 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-16T07:14:01.162 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-16T07:14:01.163 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-16T07:14:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-16T07:14:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-16T07:14:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-16T07:14:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-16T07:14:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-16T07:14:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-16T07:14:01.164 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-16T07:14:01.165 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-16T07:14:01.166 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-16T07:14:01.167 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-16T07:14:01.168 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-16T07:14:01.169 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-16T07:14:01.170 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-16T07:14:01.171 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-16T07:14:01.172 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-16T07:14:01.173 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-16T07:14:01.174 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-16T07:14:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-16T07:14:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-16T07:14:01.175 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-16T07:14:01.262 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-16T07:14:01.263 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-16T07:14:01.264 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-16T07:14:01.265 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-16T07:14:01.266 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-16T07:14:01.266 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-16T07:14:01.266 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-16T07:14:01.266 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-16T07:14:01.266 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-16T07:14:01.266 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-16T07:14:01.267 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-16T07:14:01.268 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-16T07:14:01.269 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-16T07:14:01.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-16T07:14:01.271 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-16T07:14:01.272 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-16T07:14:01.273 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-16T07:14:01.274 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-16T07:14:01.275 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-16T07:14:01.276 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-16T07:14:01.277 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-16T07:14:01.278 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-16T07:14:01.279 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-16T07:14:01.280 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-16T07:14:01.281 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-16T07:14:01.282 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-16T07:14:01.283 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-16T07:14:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-16T07:14:01.285 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-16T07:14:01.286 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-16T07:14:01.287 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-16T07:14:01.288 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-16T07:14:01.289 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-16T07:14:01.290 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-16T07:14:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-16T07:14:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-16T07:14:01.293 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-16T07:14:01.294 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-16T07:14:01.295 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-16T07:14:01.296 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-16T07:14:01.297 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-16T07:14:01.298 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-16T07:14:01.299 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-16T07:14:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-16T07:14:01.301 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-16T07:14:01.302 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-16T07:14:01.303 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-16T07:14:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-16T07:14:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-16T07:14:01.306 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-16T07:14:01.307 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-16T07:14:01.308 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-16T07:14:01.309 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-16T07:14:01.310 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-16T07:14:01.311 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-16T07:14:01.312 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-16T07:14:01.313 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-16T07:14:01.313 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-16T07:14:01.313 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-16T07:14:01.313 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-16T07:14:01.313 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-16T07:14:01.313 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-16T07:14:01.313 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-16T07:14:01.316 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-16T07:14:01.316 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-16T07:14:01.316 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-16T07:14:01.316 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-16T07:14:01.316 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-16T07:14:01.316 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-16T07:14:01.316 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-16T07:14:01.317 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-16T07:14:01.318 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-16T07:14:01.319 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-16T07:14:01.320 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-16T07:14:01.321 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-16T07:14:01.322 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-16T07:14:01.323 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-16T07:14:01.324 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-16T07:14:01.325 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-16T07:14:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-16T07:14:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-16T07:14:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-16T07:14:01.329 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-16T07:14:01.330 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-16T07:14:01.331 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-16T07:14:01.332 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-16T07:14:01.333 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-16T07:14:01.334 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-16T07:14:01.335 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-16T07:14:01.336 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-16T07:14:01.336 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-16T07:14:01.336 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-16T07:14:01.378 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-16T07:14:01.379 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-16T07:14:01.380 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-16T07:14:01.381 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-16T07:14:01.382 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-16T07:14:01.383 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-16T07:14:01.384 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-16T07:14:01.385 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-16T07:14:01.386 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-16T07:14:01.387 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-16T07:14:01.388 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-16T07:14:01.389 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-16T07:14:01.390 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-16T07:14:01.391 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-16T07:14:01.392 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-16T07:14:01.393 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-16T07:14:01.394 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-16T07:14:01.395 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-16T07:14:01.396 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-16T07:14:01.397 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-16T07:14:01.398 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-16T07:14:01.399 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-16T07:14:01.400 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-16T07:14:01.401 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-16T07:14:01.402 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-16T07:14:01.403 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-16T07:14:01.404 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-16T07:14:01.405 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-16T07:14:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-16T07:14:01.407 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-16T07:14:01.408 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-16T07:14:01.409 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-16T07:14:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-16T07:14:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-16T07:14:01.412 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-16T07:14:01.413 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-16T07:14:01.414 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-16T07:14:01.415 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-16T07:14:01.416 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-16T07:14:01.417 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-16T07:14:01.418 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-16T07:14:01.419 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-16T07:14:01.420 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-16T07:14:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-16T07:14:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-16T07:14:01.423 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-16T07:14:01.423 INFO:teuthology.orchestra.run.smithi149.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-16T07:14:01.423 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-16T07:14:01.423 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-16T07:14:01.427 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:01.427 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:01.427 DEBUG:teuthology.orchestra.run.smithi149:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-16T07:14:01.434 INFO:teuthology.orchestra.run.smithi149.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-16T07:14:01.434 INFO:teuthology.orchestra.run.smithi149.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-16T07:14:01.434 INFO:teuthology.orchestra.run.smithi149.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-16T07:14:01.435 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-16T07:14:01.435 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:01.435 DEBUG:teuthology.orchestra.run.smithi149:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-16T07:14:01.478 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi149.front.sepia.ceph.com to complete... 2024-09-16T07:14:01.885 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub' 2024-09-16T07:14:01.886 INFO:teuthology.orchestra.run.smithi149.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T07:14:01.895 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-09-16T07:14:02.113 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:02.120 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:14:02.371 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T07:14:02.377 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T07:14:02.417 INFO:teuthology.orchestra.run.smithi149.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T07:14:02.422 INFO:teuthology.orchestra.run.smithi149.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T07:14:02.578 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T07:14:02.578 INFO:teuthology.orchestra.run.smithi149.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T07:14:02.579 INFO:teuthology.orchestra.run.smithi149.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T07:14:02.596 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-09-16T07:14:29.791 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-16T07:14:29.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T07:14:29.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:14:33.753 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-16T07:14:33.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-16T07:14:33.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:15:04.382 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-16T07:15:08.221 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-16T07:15:13.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T07:15:13.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:15:17.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-16T07:15:17.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:15:31.777 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-16T07:15:35.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-16T07:15:43.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T07:15:43.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:15:44.194 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-16T07:15:45.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T07:15:45.327 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-16T07:15:45.327 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-16T07:15:45.335 INFO:teuthology.orchestra.run.smithi114.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:15:45.335 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:15:45.335 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:15:45.335 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T07:15:46.336 DEBUG:teuthology.parallel:result is None 2024-09-16T07:15:47.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-16T07:15:47.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:15:49.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-09-16T07:16:04.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-16T07:16:04.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:16:04.910 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-16T07:16:05.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-16T07:16:05.589 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-16T07:16:05.589 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-09-16T07:16:05.639 INFO:teuthology.orchestra.run.smithi149.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:16:05.639 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-16T07:16:05.639 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:16:05.639 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T07:16:06.642 DEBUG:teuthology.parallel:result is None 2024-09-16T07:16:06.668 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T07:16:06.677 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T07:16:06.677 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:16:06.681 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:16:06.689 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T07:16:06.697 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T07:16:06.743 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T07:16:06.743 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:16:06.747 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:16:06.768 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T07:16:06.774 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T07:16:06.774 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:16:06.809 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:16:06.894 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:16:06.915 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:16:06.926 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:16:06.979 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:16:06.981 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T07:16:06.991 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T07:16:06.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:16:06.995 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:16:07.015 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T07:16:07.025 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T07:16:07.025 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:16:07.057 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:16:07.067 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:16:07.114 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:16:07.166 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:16:07.166 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:16:07.236 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:16:07.245 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:16:07.296 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:16:07.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:16:07.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-09-16T07:16:07.379 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-09-16T07:16:07.505 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T07:16:07.512 INFO:teuthology.task.internal:Starting timer... 2024-09-16T07:16:07.512 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T07:16:07.522 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T07:16:07.545 DEBUG:teuthology.task.selinux:Excluding smithi114: OS 'ubuntu' does not support SELinux 2024-09-16T07:16:07.545 DEBUG:teuthology.task.selinux:Excluding smithi149: OS 'ubuntu' does not support SELinux 2024-09-16T07:16:07.545 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T07:16:07.545 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T07:16:07.545 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T07:16:07.545 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T07:16:07.553 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T07:16:07.556 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T07:16:07.708 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T07:16:07.719 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T07:16:07.720 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T07:24:23.643 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2024-09-16T07:24:23.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T07:24:23.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:24:23.734 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-16T07:24:23.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T07:24:23.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-16T07:24:23.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:24:23.927 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-09-16T07:24:24.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-09-16T07:24:24.060 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T07:24:24.071 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T07:24:24.072 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:24:24.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:24:24.076 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:24:24.076 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:24:24.113 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T07:24:24.113 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Command line: ntpd -gq 2024-09-16T07:24:24.113 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: ---------------------------------------------------- 2024-09-16T07:24:24.113 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T07:24:24.113 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T07:24:24.113 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: corporation. Support and training for ntp-4 are 2024-09-16T07:24:24.114 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: available at https://www.nwtime.org/support 2024-09-16T07:24:24.114 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: ---------------------------------------------------- 2024-09-16T07:24:24.114 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: proto: precision = 0.041 usec (-24) 2024-09-16T07:24:24.114 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: basedate set to 2022-02-04 2024-09-16T07:24:24.114 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: gps base set to 2022-02-06 (week 2196) 2024-09-16T07:24:24.115 INFO:teuthology.orchestra.run.smithi114.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T07:24:24.115 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T07:24:24.115 INFO:teuthology.orchestra.run.smithi114.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T07:24:24.116 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T07:24:24.116 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T07:24:24.116 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T07:24:24.117 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T07:24:24.117 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Listen normally on 3 enp3s0f1 172.21.15.114:123 2024-09-16T07:24:24.117 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Listen normally on 4 lo [::1]:123 2024-09-16T07:24:24.117 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb63%5]:123 2024-09-16T07:24:24.117 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:24 ntpd[18462]: Listening on routing socket on fd #22 for interface updates 2024-09-16T07:24:24.146 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T07:24:24.146 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Command line: ntpd -gq 2024-09-16T07:24:24.146 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: ---------------------------------------------------- 2024-09-16T07:24:24.146 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T07:24:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T07:24:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: corporation. Support and training for ntp-4 are 2024-09-16T07:24:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: available at https://www.nwtime.org/support 2024-09-16T07:24:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: ---------------------------------------------------- 2024-09-16T07:24:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: proto: precision = 0.042 usec (-24) 2024-09-16T07:24:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: basedate set to 2022-02-04 2024-09-16T07:24:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: gps base set to 2022-02-06 (week 2196) 2024-09-16T07:24:24.148 INFO:teuthology.orchestra.run.smithi149.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T07:24:24.148 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T07:24:24.148 INFO:teuthology.orchestra.run.smithi149.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T07:24:24.149 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T07:24:24.149 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T07:24:24.149 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T07:24:24.150 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T07:24:24.150 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Listen normally on 3 enp3s0f1 172.21.15.149:123 2024-09-16T07:24:24.150 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Listen normally on 4 lo [::1]:123 2024-09-16T07:24:24.150 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d57%5]:123 2024-09-16T07:24:24.150 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:24 ntpd[18468]: Listening on routing socket on fd #22 for interface updates 2024-09-16T07:24:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:25.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:25.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:25.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:25.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:25 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:26.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:26.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:26.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:26 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:27.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:27 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:27.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:27 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:27.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:27 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:27.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:27 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:27.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:27 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:27.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:27 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:28.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:28.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:28 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:28.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:28.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:28 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:29.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:29.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:29 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:29.146 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:29 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:29.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:29 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:29.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:29 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:29.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:29 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:29.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:29 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:29.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:29 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:30.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:30.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:30 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:30.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:30.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:30.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:30.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:30 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:31.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:31 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:31.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:31 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:31.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:31 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:31.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:31 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:31.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:31 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:31.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:31 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stdout:16 Sep 07:24:31 ntpd[18468]: ntpd: time slew +0.004674 s 2024-09-16T07:24:31.147 INFO:teuthology.orchestra.run.smithi149.stdout:ntpd: time slew +0.004674s 2024-09-16T07:24:31.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T07:24:31.148 INFO:teuthology.orchestra.run.smithi149.stderr:16 Sep 07:24:31 ntpd[18468]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T07:24:31.240 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T07:24:31.240 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2024-09-16T07:24:31.241 INFO:teuthology.orchestra.run.smithi149.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:31.241 INFO:teuthology.orchestra.run.smithi149.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:31.241 INFO:teuthology.orchestra.run.smithi149.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:31.241 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:32.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:32.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:32.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:32.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:32.114 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T07:24:32.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T07:24:32.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T07:24:32.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T07:24:32.115 INFO:teuthology.orchestra.run.smithi114.stdout:16 Sep 07:24:32 ntpd[18462]: ntpd: time slew -0.001767 s 2024-09-16T07:24:32.115 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew -0.001767s 2024-09-16T07:24:32.115 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T07:24:32.116 INFO:teuthology.orchestra.run.smithi114.stderr:16 Sep 07:24:32 ntpd[18462]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T07:24:32.210 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T07:24:32.210 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-09-16T07:24:32.211 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:32.211 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:32.211 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:32.211 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T07:24:32.212 INFO:teuthology.run_tasks:Running task install... 2024-09-16T07:24:32.220 DEBUG:teuthology.task.install:project ceph 2024-09-16T07:24:32.220 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74'}} 2024-09-16T07:24:32.220 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74'} 2024-09-16T07:24:32.221 INFO:teuthology.task.install:Using flavor: default 2024-09-16T07:24:32.229 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T07:24:32.229 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-16T07:24:32.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-key list | grep Ceph 2024-09-16T07:24:32.230 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-key list | grep Ceph 2024-09-16T07:24:32.335 INFO:teuthology.orchestra.run.smithi149.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T07:24:32.353 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T07:24:32.390 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T07:24:32.390 INFO:teuthology.orchestra.run.smithi149.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T07:24:32.390 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-16T07:24:32.390 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-16T07:24:32.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ef5f0587d1cad82c4295c20951c303dc342ac74 2024-09-16T07:24:32.404 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T07:24:32.404 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T07:24:32.405 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-16T07:24:32.405 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-16T07:24:32.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ef5f0587d1cad82c4295c20951c303dc342ac74 2024-09-16T07:24:32.535 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default/ 2024-09-16T07:24:32.535 INFO:teuthology.task.install.deb:Package version is 19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:24:32.541 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default/ 2024-09-16T07:24:32.541 INFO:teuthology.task.install.deb:Package version is 19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:24:32.715 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:24:32.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T07:24:32.718 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:24:32.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T07:24:32.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo apt-get update 2024-09-16T07:24:32.738 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-09-16T07:24:32.921 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T07:24:32.921 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T07:24:32.927 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T07:24:32.944 INFO:teuthology.orchestra.run.smithi149.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T07:24:32.969 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T07:24:32.970 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T07:24:32.990 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-16T07:24:32.991 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-16T07:24:33.012 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T07:24:33.013 INFO:teuthology.orchestra.run.smithi149.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T07:24:33.034 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-16T07:24:33.034 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-16T07:24:33.055 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T07:24:33.055 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T07:24:33.066 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-16T07:24:33.076 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-16T07:24:33.118 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T07:24:33.200 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T07:24:33.516 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 29.3 kB in 1s (53.0 kB/s) 2024-09-16T07:24:33.650 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 29.3 kB in 1s (42.5 kB/s) 2024-09-16T07:24:34.563 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2024-09-16T07:24:34.577 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4938-g4ef5f058-1jammy cephadm=19.3.0-4938-g4ef5f058-1jammy ceph-mds=19.3.0-4938-g4ef5f058-1jammy ceph-mgr=19.3.0-4938-g4ef5f058-1jammy ceph-common=19.3.0-4938-g4ef5f058-1jammy ceph-fuse=19.3.0-4938-g4ef5f058-1jammy ceph-test=19.3.0-4938-g4ef5f058-1jammy ceph-volume=19.3.0-4938-g4ef5f058-1jammy radosgw=19.3.0-4938-g4ef5f058-1jammy python3-rados=19.3.0-4938-g4ef5f058-1jammy python3-rgw=19.3.0-4938-g4ef5f058-1jammy python3-cephfs=19.3.0-4938-g4ef5f058-1jammy python3-rbd=19.3.0-4938-g4ef5f058-1jammy libcephfs2=19.3.0-4938-g4ef5f058-1jammy libcephfs-dev=19.3.0-4938-g4ef5f058-1jammy librados2=19.3.0-4938-g4ef5f058-1jammy librbd1=19.3.0-4938-g4ef5f058-1jammy rbd-fuse=19.3.0-4938-g4ef5f058-1jammy python3-cephfs=19.3.0-4938-g4ef5f058-1jammy cephfs-shell=19.3.0-4938-g4ef5f058-1jammy cephfs-top=19.3.0-4938-g4ef5f058-1jammy cephfs-mirror=19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:24:34.654 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2024-09-16T07:24:34.697 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-16T07:24:34.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4938-g4ef5f058-1jammy cephadm=19.3.0-4938-g4ef5f058-1jammy ceph-mds=19.3.0-4938-g4ef5f058-1jammy ceph-mgr=19.3.0-4938-g4ef5f058-1jammy ceph-common=19.3.0-4938-g4ef5f058-1jammy ceph-fuse=19.3.0-4938-g4ef5f058-1jammy ceph-test=19.3.0-4938-g4ef5f058-1jammy ceph-volume=19.3.0-4938-g4ef5f058-1jammy radosgw=19.3.0-4938-g4ef5f058-1jammy python3-rados=19.3.0-4938-g4ef5f058-1jammy python3-rgw=19.3.0-4938-g4ef5f058-1jammy python3-cephfs=19.3.0-4938-g4ef5f058-1jammy python3-rbd=19.3.0-4938-g4ef5f058-1jammy libcephfs2=19.3.0-4938-g4ef5f058-1jammy libcephfs-dev=19.3.0-4938-g4ef5f058-1jammy librados2=19.3.0-4938-g4ef5f058-1jammy librbd1=19.3.0-4938-g4ef5f058-1jammy rbd-fuse=19.3.0-4938-g4ef5f058-1jammy python3-cephfs=19.3.0-4938-g4ef5f058-1jammy cephfs-shell=19.3.0-4938-g4ef5f058-1jammy cephfs-top=19.3.0-4938-g4ef5f058-1jammy cephfs-mirror=19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:24:34.788 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-16T07:24:34.840 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2024-09-16T07:24:34.840 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2024-09-16T07:24:34.979 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-16T07:24:34.979 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-16T07:24:35.030 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T07:24:35.031 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T07:24:35.031 INFO:teuthology.orchestra.run.smithi149.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T07:24:35.031 INFO:teuthology.orchestra.run.smithi149.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T07:24:35.031 INFO:teuthology.orchestra.run.smithi149.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T07:24:35.031 INFO:teuthology.orchestra.run.smithi149.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T07:24:35.032 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T07:24:35.032 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2024-09-16T07:24:35.032 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T07:24:35.032 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T07:24:35.034 INFO:teuthology.orchestra.run.smithi149.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-16T07:24:35.034 INFO:teuthology.orchestra.run.smithi149.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-16T07:24:35.034 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-16T07:24:35.034 INFO:teuthology.orchestra.run.smithi149.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-16T07:24:35.034 INFO:teuthology.orchestra.run.smithi149.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-16T07:24:35.034 INFO:teuthology.orchestra.run.smithi149.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T07:24:35.034 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-16T07:24:35.036 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T07:24:35.037 INFO:teuthology.orchestra.run.smithi149.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T07:24:35.038 INFO:teuthology.orchestra.run.smithi149.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T07:24:35.038 INFO:teuthology.orchestra.run.smithi149.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T07:24:35.038 INFO:teuthology.orchestra.run.smithi149.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T07:24:35.038 INFO:teuthology.orchestra.run.smithi149.stdout:Recommended packages: 2024-09-16T07:24:35.038 INFO:teuthology.orchestra.run.smithi149.stdout: btrfs-tools 2024-09-16T07:24:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T07:24:35.168 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T07:24:35.168 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T07:24:35.168 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T07:24:35.168 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T07:24:35.169 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T07:24:35.169 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T07:24:35.169 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-09-16T07:24:35.169 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T07:24:35.170 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T07:24:35.170 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-16T07:24:35.170 INFO:teuthology.orchestra.run.smithi114.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-16T07:24:35.170 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-16T07:24:35.171 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-16T07:24:35.172 INFO:teuthology.orchestra.run.smithi114.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2024-09-16T07:24:35.173 INFO:teuthology.orchestra.run.smithi114.stdout: btrfs-tools 2024-09-16T07:24:35.190 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2024-09-16T07:24:35.191 INFO:teuthology.orchestra.run.smithi149.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T07:24:35.191 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T07:24:35.191 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-16T07:24:35.193 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-16T07:24:35.193 INFO:teuthology.orchestra.run.smithi149.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-16T07:24:35.193 INFO:teuthology.orchestra.run.smithi149.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-16T07:24:35.193 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-16T07:24:35.193 INFO:teuthology.orchestra.run.smithi149.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-16T07:24:35.193 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-16T07:24:35.193 INFO:teuthology.orchestra.run.smithi149.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-16T07:24:35.194 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-16T07:24:35.195 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T07:24:35.195 INFO:teuthology.orchestra.run.smithi149.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T07:24:35.195 INFO:teuthology.orchestra.run.smithi149.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T07:24:35.195 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T07:24:35.195 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-16T07:24:35.195 INFO:teuthology.orchestra.run.smithi149.stdout: socat unzip xmlstarlet zip 2024-09-16T07:24:35.261 INFO:teuthology.orchestra.run.smithi149.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-16T07:24:35.262 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 244 MB of archives. 2024-09-16T07:24:35.262 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 910 MB of additional disk space will be used. 2024-09-16T07:24:35.262 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-16T07:24:35.279 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T07:24:35.289 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-16T07:24:35.326 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-09-16T07:24:35.326 INFO:teuthology.orchestra.run.smithi114.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T07:24:35.326 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T07:24:35.326 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T07:24:35.328 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-16T07:24:35.329 INFO:teuthology.orchestra.run.smithi114.stdout: socat unzip xmlstarlet zip 2024-09-16T07:24:35.331 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T07:24:35.344 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4938-g4ef5f058-1jammy [3,634 kB] 2024-09-16T07:24:35.352 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T07:24:35.355 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T07:24:35.366 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T07:24:35.396 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-16T07:24:35.396 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 244 MB of archives. 2024-09-16T07:24:35.396 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 910 MB of additional disk space will be used. 2024-09-16T07:24:35.396 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-16T07:24:35.404 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T07:24:35.406 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T07:24:35.414 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T07:24:35.414 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T07:24:35.417 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-16T07:24:35.418 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T07:24:35.418 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T07:24:35.423 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-16T07:24:35.424 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T07:24:35.426 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T07:24:35.428 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T07:24:35.429 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T07:24:35.441 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T07:24:35.444 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T07:24:35.445 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T07:24:35.446 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T07:24:35.446 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T07:24:35.458 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T07:24:35.459 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T07:24:35.459 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T07:24:35.459 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T07:24:35.459 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T07:24:35.465 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T07:24:35.475 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T07:24:35.475 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T07:24:35.476 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T07:24:35.478 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T07:24:35.478 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T07:24:35.486 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T07:24:35.488 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T07:24:35.492 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T07:24:35.492 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T07:24:35.493 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T07:24:35.494 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T07:24:35.494 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T07:24:35.499 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T07:24:35.509 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T07:24:35.509 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T07:24:35.510 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T07:24:35.514 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T07:24:35.514 INFO:teuthology.orchestra.run.smithi149.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T07:24:35.526 INFO:teuthology.orchestra.run.smithi149.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T07:24:35.526 INFO:teuthology.orchestra.run.smithi149.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T07:24:35.528 INFO:teuthology.orchestra.run.smithi149.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T07:24:35.529 INFO:teuthology.orchestra.run.smithi149.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T07:24:35.530 INFO:teuthology.orchestra.run.smithi149.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T07:24:35.537 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T07:24:35.539 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T07:24:35.543 INFO:teuthology.orchestra.run.smithi149.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T07:24:35.544 INFO:teuthology.orchestra.run.smithi149.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T07:24:35.546 INFO:teuthology.orchestra.run.smithi149.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T07:24:35.547 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T07:24:35.547 INFO:teuthology.orchestra.run.smithi149.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T07:24:35.547 INFO:teuthology.orchestra.run.smithi149.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T07:24:35.549 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-16T07:24:35.550 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T07:24:35.550 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T07:24:35.556 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-16T07:24:35.558 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-16T07:24:35.560 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-16T07:24:35.560 INFO:teuthology.orchestra.run.smithi149.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T07:24:35.561 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-16T07:24:35.566 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4938-g4ef5f058-1jammy [3,634 kB] 2024-09-16T07:24:35.574 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-16T07:24:35.575 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-16T07:24:35.577 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-16T07:24:35.579 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T07:24:35.579 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T07:24:35.591 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T07:24:35.591 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T07:24:35.592 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T07:24:35.592 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T07:24:35.593 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T07:24:35.604 INFO:teuthology.orchestra.run.smithi149.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T07:24:35.605 INFO:teuthology.orchestra.run.smithi149.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T07:24:35.606 INFO:teuthology.orchestra.run.smithi149.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T07:24:35.607 INFO:teuthology.orchestra.run.smithi149.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T07:24:35.608 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T07:24:35.609 INFO:teuthology.orchestra.run.smithi149.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T07:24:35.610 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T07:24:35.610 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T07:24:35.611 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T07:24:35.611 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T07:24:35.625 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T07:24:35.626 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T07:24:35.626 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T07:24:35.627 INFO:teuthology.orchestra.run.smithi149.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T07:24:35.627 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T07:24:35.627 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T07:24:35.629 INFO:teuthology.orchestra.run.smithi149.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T07:24:35.629 INFO:teuthology.orchestra.run.smithi149.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T07:24:35.649 INFO:teuthology.orchestra.run.smithi149.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T07:24:35.649 INFO:teuthology.orchestra.run.smithi149.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T07:24:35.649 INFO:teuthology.orchestra.run.smithi149.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T07:24:35.650 INFO:teuthology.orchestra.run.smithi149.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T07:24:35.650 INFO:teuthology.orchestra.run.smithi149.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T07:24:35.650 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T07:24:35.650 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T07:24:35.650 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T07:24:35.651 INFO:teuthology.orchestra.run.smithi149.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T07:24:35.653 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T07:24:35.653 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T07:24:35.657 INFO:teuthology.orchestra.run.smithi149.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T07:24:35.658 INFO:teuthology.orchestra.run.smithi149.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T07:24:35.661 INFO:teuthology.orchestra.run.smithi149.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T07:24:35.665 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T07:24:35.665 INFO:teuthology.orchestra.run.smithi114.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T07:24:35.666 INFO:teuthology.orchestra.run.smithi114.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T07:24:35.668 INFO:teuthology.orchestra.run.smithi114.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T07:24:35.669 INFO:teuthology.orchestra.run.smithi114.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T07:24:35.674 INFO:teuthology.orchestra.run.smithi149.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T07:24:35.681 INFO:teuthology.orchestra.run.smithi114.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T07:24:35.682 INFO:teuthology.orchestra.run.smithi114.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T07:24:35.684 INFO:teuthology.orchestra.run.smithi114.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T07:24:35.685 INFO:teuthology.orchestra.run.smithi114.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T07:24:35.685 INFO:teuthology.orchestra.run.smithi114.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T07:24:35.699 INFO:teuthology.orchestra.run.smithi114.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T07:24:35.718 INFO:teuthology.orchestra.run.smithi149.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T07:24:35.719 INFO:teuthology.orchestra.run.smithi149.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T07:24:35.743 INFO:teuthology.orchestra.run.smithi114.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T07:24:35.744 INFO:teuthology.orchestra.run.smithi114.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T07:24:35.746 INFO:teuthology.orchestra.run.smithi114.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T07:24:35.746 INFO:teuthology.orchestra.run.smithi114.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T07:24:35.747 INFO:teuthology.orchestra.run.smithi114.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T07:24:35.765 INFO:teuthology.orchestra.run.smithi114.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T07:24:35.767 INFO:teuthology.orchestra.run.smithi114.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T07:24:35.768 INFO:teuthology.orchestra.run.smithi114.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T07:24:35.771 INFO:teuthology.orchestra.run.smithi149.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T07:24:35.774 INFO:teuthology.orchestra.run.smithi149.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-16T07:24:35.774 INFO:teuthology.orchestra.run.smithi149.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T07:24:35.775 INFO:teuthology.orchestra.run.smithi149.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T07:24:35.776 INFO:teuthology.orchestra.run.smithi149.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T07:24:35.781 INFO:teuthology.orchestra.run.smithi149.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T07:24:35.781 INFO:teuthology.orchestra.run.smithi149.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T07:24:35.784 INFO:teuthology.orchestra.run.smithi114.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T07:24:35.784 INFO:teuthology.orchestra.run.smithi114.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T07:24:35.785 INFO:teuthology.orchestra.run.smithi149.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T07:24:35.785 INFO:teuthology.orchestra.run.smithi149.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T07:24:35.786 INFO:teuthology.orchestra.run.smithi114.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T07:24:35.786 INFO:teuthology.orchestra.run.smithi114.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T07:24:35.786 INFO:teuthology.orchestra.run.smithi114.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T07:24:35.787 INFO:teuthology.orchestra.run.smithi114.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T07:24:35.790 INFO:teuthology.orchestra.run.smithi149.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T07:24:35.796 INFO:teuthology.orchestra.run.smithi114.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T07:24:35.797 INFO:teuthology.orchestra.run.smithi114.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T07:24:35.800 INFO:teuthology.orchestra.run.smithi114.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T07:24:35.807 INFO:teuthology.orchestra.run.smithi149.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T07:24:35.809 INFO:teuthology.orchestra.run.smithi149.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T07:24:35.810 INFO:teuthology.orchestra.run.smithi149.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T07:24:35.814 INFO:teuthology.orchestra.run.smithi114.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T07:24:35.815 INFO:teuthology.orchestra.run.smithi114.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T07:24:35.816 INFO:teuthology.orchestra.run.smithi114.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T07:24:35.816 INFO:teuthology.orchestra.run.smithi149.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T07:24:35.817 INFO:teuthology.orchestra.run.smithi149.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T07:24:35.817 INFO:teuthology.orchestra.run.smithi149.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T07:24:35.819 INFO:teuthology.orchestra.run.smithi114.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T07:24:35.819 INFO:teuthology.orchestra.run.smithi149.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T07:24:35.820 INFO:teuthology.orchestra.run.smithi149.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T07:24:35.822 INFO:teuthology.orchestra.run.smithi114.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-16T07:24:35.822 INFO:teuthology.orchestra.run.smithi114.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-16T07:24:35.823 INFO:teuthology.orchestra.run.smithi114.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-16T07:24:35.831 INFO:teuthology.orchestra.run.smithi114.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T07:24:35.835 INFO:teuthology.orchestra.run.smithi114.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-16T07:24:35.836 INFO:teuthology.orchestra.run.smithi114.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T07:24:35.848 INFO:teuthology.orchestra.run.smithi114.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T07:24:35.849 INFO:teuthology.orchestra.run.smithi114.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T07:24:35.852 INFO:teuthology.orchestra.run.smithi114.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T07:24:35.853 INFO:teuthology.orchestra.run.smithi114.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T07:24:35.853 INFO:teuthology.orchestra.run.smithi114.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T07:24:35.853 INFO:teuthology.orchestra.run.smithi114.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T07:24:35.860 INFO:teuthology.orchestra.run.smithi114.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T07:24:35.865 INFO:teuthology.orchestra.run.smithi114.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T07:24:35.866 INFO:teuthology.orchestra.run.smithi114.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T07:24:35.868 INFO:teuthology.orchestra.run.smithi114.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T07:24:35.882 INFO:teuthology.orchestra.run.smithi114.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T07:24:35.956 INFO:teuthology.orchestra.run.smithi114.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4938-g4ef5f058-1jammy [3,334 kB] 2024-09-16T07:24:36.100 INFO:teuthology.orchestra.run.smithi114.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4938-g4ef5f058-1jammy [722 kB] 2024-09-16T07:24:36.153 INFO:teuthology.orchestra.run.smithi114.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4938-g4ef5f058-1jammy [357 kB] 2024-09-16T07:24:36.160 INFO:teuthology.orchestra.run.smithi114.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4938-g4ef5f058-1jammy [32.8 kB] 2024-09-16T07:24:36.161 INFO:teuthology.orchestra.run.smithi114.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4938-g4ef5f058-1jammy [180 kB] 2024-09-16T07:24:36.164 INFO:teuthology.orchestra.run.smithi114.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4938-g4ef5f058-1jammy [72.8 kB] 2024-09-16T07:24:36.207 INFO:teuthology.orchestra.run.smithi114.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4938-g4ef5f058-1jammy [338 kB] 2024-09-16T07:24:36.212 INFO:teuthology.orchestra.run.smithi114.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4938-g4ef5f058-1jammy [7,966 kB] 2024-09-16T07:24:36.323 INFO:teuthology.orchestra.run.smithi149.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4938-g4ef5f058-1jammy [3,334 kB] 2024-09-16T07:24:36.560 INFO:teuthology.orchestra.run.smithi114.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4938-g4ef5f058-1jammy [112 kB] 2024-09-16T07:24:36.571 INFO:teuthology.orchestra.run.smithi114.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4938-g4ef5f058-1jammy [473 kB] 2024-09-16T07:24:36.579 INFO:teuthology.orchestra.run.smithi114.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4938-g4ef5f058-1jammy [28.2 MB] 2024-09-16T07:24:36.749 INFO:teuthology.orchestra.run.smithi149.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4938-g4ef5f058-1jammy [722 kB] 2024-09-16T07:24:36.873 INFO:teuthology.orchestra.run.smithi149.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4938-g4ef5f058-1jammy [357 kB] 2024-09-16T07:24:36.949 INFO:teuthology.orchestra.run.smithi149.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4938-g4ef5f058-1jammy [32.8 kB] 2024-09-16T07:24:36.950 INFO:teuthology.orchestra.run.smithi149.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4938-g4ef5f058-1jammy [180 kB] 2024-09-16T07:24:36.953 INFO:teuthology.orchestra.run.smithi149.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4938-g4ef5f058-1jammy [72.8 kB] 2024-09-16T07:24:36.954 INFO:teuthology.orchestra.run.smithi149.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4938-g4ef5f058-1jammy [338 kB] 2024-09-16T07:24:37.007 INFO:teuthology.orchestra.run.smithi149.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4938-g4ef5f058-1jammy [7,966 kB] 2024-09-16T07:24:37.412 INFO:teuthology.orchestra.run.smithi114.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4938-g4ef5f058-1jammy [5,206 kB] 2024-09-16T07:24:37.533 INFO:teuthology.orchestra.run.smithi114.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4938-g4ef5f058-1jammy [252 kB] 2024-09-16T07:24:37.537 INFO:teuthology.orchestra.run.smithi149.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4938-g4ef5f058-1jammy [112 kB] 2024-09-16T07:24:37.538 INFO:teuthology.orchestra.run.smithi149.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4938-g4ef5f058-1jammy [473 kB] 2024-09-16T07:24:37.545 INFO:teuthology.orchestra.run.smithi149.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4938-g4ef5f058-1jammy [28.2 MB] 2024-09-16T07:24:37.551 INFO:teuthology.orchestra.run.smithi114.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4938-g4ef5f058-1jammy [124 kB] 2024-09-16T07:24:37.553 INFO:teuthology.orchestra.run.smithi114.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4938-g4ef5f058-1jammy [1,562 kB] 2024-09-16T07:24:37.589 INFO:teuthology.orchestra.run.smithi114.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4938-g4ef5f058-1jammy [6,309 kB] 2024-09-16T07:24:37.755 INFO:teuthology.orchestra.run.smithi114.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4938-g4ef5f058-1jammy [23.1 MB] 2024-09-16T07:24:38.456 INFO:teuthology.orchestra.run.smithi114.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4938-g4ef5f058-1jammy [14.1 kB] 2024-09-16T07:24:38.457 INFO:teuthology.orchestra.run.smithi114.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4938-g4ef5f058-1jammy [880 kB] 2024-09-16T07:24:38.500 INFO:teuthology.orchestra.run.smithi114.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4938-g4ef5f058-1jammy [2,454 kB] 2024-09-16T07:24:38.566 INFO:teuthology.orchestra.run.smithi149.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4938-g4ef5f058-1jammy [5,206 kB] 2024-09-16T07:24:38.578 INFO:teuthology.orchestra.run.smithi114.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4938-g4ef5f058-1jammy [813 kB] 2024-09-16T07:24:38.593 INFO:teuthology.orchestra.run.smithi114.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4938-g4ef5f058-1jammy [160 kB] 2024-09-16T07:24:38.630 INFO:teuthology.orchestra.run.smithi114.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4938-g4ef5f058-1jammy [61.5 MB] 2024-09-16T07:24:38.735 INFO:teuthology.orchestra.run.smithi149.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4938-g4ef5f058-1jammy [252 kB] 2024-09-16T07:24:38.743 INFO:teuthology.orchestra.run.smithi149.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4938-g4ef5f058-1jammy [124 kB] 2024-09-16T07:24:38.745 INFO:teuthology.orchestra.run.smithi149.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4938-g4ef5f058-1jammy [1,562 kB] 2024-09-16T07:24:38.772 INFO:teuthology.orchestra.run.smithi149.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4938-g4ef5f058-1jammy [6,309 kB] 2024-09-16T07:24:38.969 INFO:teuthology.orchestra.run.smithi149.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4938-g4ef5f058-1jammy [23.1 MB] 2024-09-16T07:24:39.543 INFO:teuthology.orchestra.run.smithi149.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4938-g4ef5f058-1jammy [14.1 kB] 2024-09-16T07:24:39.543 INFO:teuthology.orchestra.run.smithi149.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4938-g4ef5f058-1jammy [880 kB] 2024-09-16T07:24:39.550 INFO:teuthology.orchestra.run.smithi149.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4938-g4ef5f058-1jammy [2,454 kB] 2024-09-16T07:24:39.615 INFO:teuthology.orchestra.run.smithi149.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4938-g4ef5f058-1jammy [813 kB] 2024-09-16T07:24:39.628 INFO:teuthology.orchestra.run.smithi149.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4938-g4ef5f058-1jammy [160 kB] 2024-09-16T07:24:39.629 INFO:teuthology.orchestra.run.smithi149.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4938-g4ef5f058-1jammy [61.5 MB] 2024-09-16T07:24:41.211 INFO:teuthology.orchestra.run.smithi149.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4938-g4ef5f058-1jammy [8,625 kB] 2024-09-16T07:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4938-g4ef5f058-1jammy [14.2 kB] 2024-09-16T07:24:41.415 INFO:teuthology.orchestra.run.smithi149.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4938-g4ef5f058-1jammy [48.5 MB] 2024-09-16T07:24:41.451 INFO:teuthology.orchestra.run.smithi114.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4938-g4ef5f058-1jammy [8,625 kB] 2024-09-16T07:24:41.898 INFO:teuthology.orchestra.run.smithi114.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4938-g4ef5f058-1jammy [14.2 kB] 2024-09-16T07:24:41.898 INFO:teuthology.orchestra.run.smithi114.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4938-g4ef5f058-1jammy [48.5 MB] 2024-09-16T07:24:42.635 INFO:teuthology.orchestra.run.smithi149.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4938-g4ef5f058-1jammy [130 kB] 2024-09-16T07:24:42.636 INFO:teuthology.orchestra.run.smithi149.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4938-g4ef5f058-1jammy [233 kB] 2024-09-16T07:24:42.645 INFO:teuthology.orchestra.run.smithi149.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4938-g4ef5f058-1jammy [33.9 kB] 2024-09-16T07:24:42.645 INFO:teuthology.orchestra.run.smithi149.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4938-g4ef5f058-1jammy [23.4 kB] 2024-09-16T07:24:42.645 INFO:teuthology.orchestra.run.smithi149.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4938-g4ef5f058-1jammy [39.0 kB] 2024-09-16T07:24:42.646 INFO:teuthology.orchestra.run.smithi149.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4938-g4ef5f058-1jammy [15.8 MB] 2024-09-16T07:24:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4938-g4ef5f058-1jammy [91.3 kB] 2024-09-16T07:24:43.435 INFO:teuthology.orchestra.run.smithi114.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4938-g4ef5f058-1jammy [130 kB] 2024-09-16T07:24:43.436 INFO:teuthology.orchestra.run.smithi114.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4938-g4ef5f058-1jammy [233 kB] 2024-09-16T07:24:43.438 INFO:teuthology.orchestra.run.smithi114.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4938-g4ef5f058-1jammy [33.9 kB] 2024-09-16T07:24:43.439 INFO:teuthology.orchestra.run.smithi114.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4938-g4ef5f058-1jammy [23.4 kB] 2024-09-16T07:24:43.439 INFO:teuthology.orchestra.run.smithi114.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4938-g4ef5f058-1jammy [39.0 kB] 2024-09-16T07:24:43.440 INFO:teuthology.orchestra.run.smithi114.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4938-g4ef5f058-1jammy [15.8 MB] 2024-09-16T07:24:43.692 INFO:teuthology.orchestra.run.smithi114.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-15-1936/4ef5f0587d1cad82c4295c20951c303dc342ac74/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4938-g4ef5f058-1jammy [91.3 kB] 2024-09-16T07:24:43.715 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 244 MB in 8s (31.1 MB/s) 2024-09-16T07:24:43.859 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-16T07:24:43.926 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-16T07:24:43.929 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-16T07:24:43.974 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-16T07:24:44.277 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T07:24:44.291 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T07:24:44.335 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T07:24:44.360 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 244 MB in 8s (29.2 MB/s) 2024-09-16T07:24:44.504 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-16T07:24:44.569 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-16T07:24:44.572 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-16T07:24:44.611 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-16T07:24:44.671 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cmd2. 2024-09-16T07:24:44.685 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-16T07:24:44.730 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-16T07:24:44.947 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T07:24:44.961 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T07:24:45.005 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T07:24:45.074 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T07:24:45.088 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T07:24:45.174 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T07:24:45.333 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cmd2. 2024-09-16T07:24:45.347 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-16T07:24:45.391 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-16T07:24:45.561 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T07:24:45.575 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T07:24:45.619 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T07:24:45.753 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T07:24:45.767 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T07:24:45.853 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T07:24:46.207 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T07:24:46.222 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T07:24:46.265 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T07:24:46.272 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T07:24:46.288 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T07:24:46.322 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T07:24:46.568 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T07:24:46.582 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T07:24:46.655 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T07:24:46.709 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T07:24:46.724 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T07:24:46.776 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:24:47.054 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T07:24:47.070 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T07:24:47.124 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:24:47.170 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T07:24:47.185 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T07:24:47.229 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:24:47.549 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T07:24:47.565 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T07:24:47.582 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T07:24:47.596 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T07:24:47.607 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:24:47.631 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:24:47.927 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T07:24:47.945 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T07:24:47.968 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T07:24:47.977 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:24:47.982 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T07:24:48.026 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T07:24:48.297 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T07:24:48.312 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T07:24:48.354 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librados2. 2024-09-16T07:24:48.355 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T07:24:48.369 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../010-librados2_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:48.413 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librados2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:48.699 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librados2. 2024-09-16T07:24:48.714 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../010-librados2_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:48.758 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librados2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:48.857 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libnbd0. 2024-09-16T07:24:48.871 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-16T07:24:48.932 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-16T07:24:49.210 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librbd1. 2024-09-16T07:24:49.210 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libnbd0. 2024-09-16T07:24:49.224 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../012-librbd1_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:49.225 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-16T07:24:49.261 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-16T07:24:49.267 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librbd1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:49.538 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librbd1. 2024-09-16T07:24:49.552 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../012-librbd1_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:49.597 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librbd1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:49.704 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T07:24:49.718 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:49.762 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:50.032 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T07:24:50.039 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rados. 2024-09-16T07:24:50.047 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:50.053 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:50.091 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:50.097 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rados (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:50.385 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rados. 2024-09-16T07:24:50.392 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T07:24:50.400 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:50.404 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:24:50.434 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-argparse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:50.443 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rados (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:50.653 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T07:24:50.665 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:50.703 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cephfs (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:50.763 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T07:24:50.778 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:24:50.830 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-argparse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:51.014 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T07:24:51.027 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:24:51.048 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T07:24:51.063 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:51.107 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cephfs (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:51.114 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:51.443 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T07:24:51.458 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:24:51.467 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T07:24:51.479 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T07:24:51.501 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:51.517 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T07:24:51.795 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T07:24:51.807 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:51.829 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T07:24:51.844 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T07:24:51.844 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rbd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:51.895 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T07:24:52.164 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T07:24:52.176 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T07:24:52.214 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T07:24:52.398 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T07:24:52.413 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:52.457 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rbd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:52.508 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T07:24:52.521 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T07:24:52.558 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T07:24:52.751 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T07:24:52.766 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T07:24:52.817 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T07:24:52.861 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T07:24:52.876 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T07:24:52.919 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T07:24:53.095 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-16T07:24:53.110 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-16T07:24:53.153 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T07:24:53.264 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua5.1. 2024-09-16T07:24:53.277 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T07:24:53.323 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T07:24:53.473 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-16T07:24:53.488 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-16T07:24:53.531 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T07:24:53.608 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua-any. 2024-09-16T07:24:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-16T07:24:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T07:24:53.843 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua5.1. 2024-09-16T07:24:53.857 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-16T07:24:53.901 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-16T07:24:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package zip. 2024-09-16T07:24:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-16T07:24:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T07:24:54.204 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-any. 2024-09-16T07:24:54.218 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-16T07:24:54.262 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-16T07:24:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package unzip. 2024-09-16T07:24:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T07:24:54.347 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T07:24:54.523 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package zip. 2024-09-16T07:24:54.538 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-16T07:24:54.615 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking zip (3.0-12build2) ... 2024-09-16T07:24:54.734 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package luarocks. 2024-09-16T07:24:54.748 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T07:24:54.851 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T07:24:54.918 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package unzip. 2024-09-16T07:24:54.932 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-16T07:24:54.976 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-16T07:24:55.242 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package librgw2. 2024-09-16T07:24:55.255 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../028-librgw2_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:55.300 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking librgw2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:55.363 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package luarocks. 2024-09-16T07:24:55.378 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-16T07:24:55.413 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-16T07:24:55.811 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T07:24:55.825 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:55.837 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librgw2. 2024-09-16T07:24:55.851 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../028-librgw2_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:55.869 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librgw2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:56.222 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T07:24:56.237 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T07:24:56.281 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T07:24:56.439 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T07:24:56.454 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:56.700 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T07:24:56.713 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:56.758 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libradosstriper1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:56.834 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T07:24:56.849 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T07:24:56.892 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T07:24:57.203 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-common. 2024-09-16T07:24:57.217 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:57.261 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:57.303 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T07:24:57.318 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:57.362 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libradosstriper1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-common. 2024-09-16T07:24:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:57.865 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:58.466 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-base. 2024-09-16T07:24:58.481 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:58.533 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-base (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:59.028 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-base. 2024-09-16T07:24:59.037 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T07:24:59.044 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:24:59.050 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T07:24:59.095 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T07:24:59.104 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-base (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:24:59.415 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T07:24:59.428 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T07:24:59.473 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T07:24:59.724 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T07:24:59.738 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T07:24:59.768 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T07:24:59.781 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T07:24:59.791 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T07:24:59.809 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T07:25:00.135 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T07:25:00.149 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T07:25:00.154 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T07:25:00.167 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T07:25:00.193 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T07:25:00.212 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T07:25:00.515 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T07:25:00.515 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T07:25:00.525 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T07:25:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T07:25:00.565 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T07:25:00.573 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T07:25:00.851 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T07:25:00.863 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T07:25:00.901 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T07:25:00.909 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T07:25:00.918 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T07:25:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T07:25:01.187 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-portend. 2024-09-16T07:25:01.200 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-16T07:25:01.245 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T07:25:01.287 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T07:25:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T07:25:01.337 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T07:25:01.573 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T07:25:01.584 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T07:25:01.615 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T07:25:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T07:25:01.631 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T07:25:01.681 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T07:25:01.934 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T07:25:01.946 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T07:25:01.984 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T07:25:02.009 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-portend. 2024-09-16T07:25:02.021 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-16T07:25:02.059 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T07:25:02.356 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T07:25:02.362 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T07:25:02.368 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T07:25:02.373 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T07:25:02.406 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T07:25:02.412 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T07:25:02.717 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T07:25:02.729 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T07:25:02.731 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T07:25:02.742 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T07:25:02.773 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T07:25:02.792 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T07:25:03.062 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T07:25:03.073 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T07:25:03.103 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T07:25:03.143 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T07:25:03.154 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T07:25:03.193 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T07:25:03.406 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-mako. 2024-09-16T07:25:03.418 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T07:25:03.456 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T07:25:03.554 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T07:25:03.569 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T07:25:03.630 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T07:25:03.818 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T07:25:03.830 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T07:25:03.868 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T07:25:04.016 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T07:25:04.028 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T07:25:04.074 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T07:25:04.170 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T07:25:04.182 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T07:25:04.254 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T07:25:04.451 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-mako. 2024-09-16T07:25:04.464 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T07:25:04.510 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T07:25:04.531 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webob. 2024-09-16T07:25:04.543 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T07:25:04.573 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T07:25:04.876 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T07:25:04.888 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T07:25:04.921 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T07:25:04.928 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T07:25:04.934 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T07:25:04.971 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T07:25:05.254 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T07:25:05.266 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T07:25:05.299 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T07:25:05.303 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T07:25:05.312 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T07:25:05.357 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T07:25:05.590 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-paste. 2024-09-16T07:25:05.602 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T07:25:05.639 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T07:25:05.735 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webob. 2024-09-16T07:25:05.747 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T07:25:05.793 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T07:25:05.976 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T07:25:05.988 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T07:25:06.026 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T07:25:06.213 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T07:25:06.225 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T07:25:06.274 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T07:25:06.328 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T07:25:06.340 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T07:25:06.378 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T07:25:06.681 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T07:25:06.693 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T07:25:06.731 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T07:25:06.774 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T07:25:06.787 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T07:25:06.833 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T07:25:07.084 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T07:25:07.096 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T07:25:07.134 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T07:25:07.160 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-paste. 2024-09-16T07:25:07.173 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T07:25:07.235 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T07:25:07.530 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T07:25:07.542 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T07:25:07.588 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T07:25:07.916 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T07:25:07.928 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T07:25:07.966 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T07:25:08.181 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T07:25:08.193 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T07:25:08.230 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T07:25:08.567 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-idna. 2024-09-16T07:25:08.579 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T07:25:08.616 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T07:25:08.928 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T07:25:08.940 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T07:25:08.977 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T07:25:09.036 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T07:25:09.048 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T07:25:09.086 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T07:25:09.339 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-requests. 2024-09-16T07:25:09.351 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T07:25:09.389 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T07:25:09.422 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T07:25:09.435 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T07:25:09.464 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T07:25:09.701 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T07:25:09.712 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T07:25:09.750 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T07:25:09.818 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T07:25:09.830 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T07:25:09.860 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T07:25:10.070 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T07:25:10.081 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:10.111 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:10.188 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-idna. 2024-09-16T07:25:10.200 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T07:25:10.237 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T07:25:10.483 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T07:25:10.496 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:10.533 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:10.599 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T07:25:10.611 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T07:25:10.649 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T07:25:10.844 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T07:25:10.855 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T07:25:10.893 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T07:25:10.969 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests. 2024-09-16T07:25:10.976 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T07:25:11.018 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T07:25:11.163 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T07:25:11.175 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T07:25:11.213 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T07:25:11.346 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T07:25:11.354 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T07:25:11.396 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T07:25:11.591 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T07:25:11.606 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:11.649 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:11.682 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T07:25:11.690 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:11.732 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:12.095 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T07:25:12.102 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:12.137 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:12.244 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T07:25:12.258 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:12.302 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mon (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:12.690 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T07:25:12.698 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T07:25:12.740 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T07:25:12.856 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T07:25:12.869 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:12.914 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-osd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:13.067 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T07:25:13.075 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T07:25:13.117 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T07:25:13.421 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T07:25:13.428 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:13.470 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:13.676 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph. 2024-09-16T07:25:13.689 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../069-ceph_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:13.734 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:13.857 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T07:25:13.864 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:13.907 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mon (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:14.053 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T07:25:14.066 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:14.102 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:14.481 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T07:25:14.493 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:14.510 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T07:25:14.520 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:14.530 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mds (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:14.560 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-osd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:14.892 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephadm. 2024-09-16T07:25:14.904 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../072-cephadm_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:14.941 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:15.286 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T07:25:15.300 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T07:25:15.321 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph. 2024-09-16T07:25:15.330 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../069-ceph_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:15.344 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T07:25:15.371 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:15.630 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T07:25:15.640 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T07:25:15.642 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T07:25:15.649 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:15.688 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T07:25:15.690 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:16.077 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T07:25:16.085 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:16.126 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mds (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:16.538 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephadm. 2024-09-16T07:25:16.549 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../072-cephadm_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:16.588 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:16.726 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-babel. 2024-09-16T07:25:16.739 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T07:25:16.776 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T07:25:16.866 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T07:25:16.874 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T07:25:16.915 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T07:25:17.079 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T07:25:17.091 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T07:25:17.129 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T07:25:17.260 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T07:25:17.269 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T07:25:17.309 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T07:25:17.499 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T07:25:17.511 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:17.548 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:17.894 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T07:25:17.906 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T07:25:17.977 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T07:25:18.263 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-routes. 2024-09-16T07:25:18.275 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T07:25:18.313 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T07:25:18.356 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-babel. 2024-09-16T07:25:18.363 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T07:25:18.406 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T07:25:18.674 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T07:25:18.687 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:18.700 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T07:25:18.708 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T07:25:18.724 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:18.742 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T07:25:19.137 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T07:25:19.144 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:19.186 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:19.540 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T07:25:19.548 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T07:25:19.590 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T07:25:19.851 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-routes. 2024-09-16T07:25:19.862 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T07:25:19.892 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T07:25:20.237 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T07:25:20.247 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:20.278 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:20.987 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T07:25:21.001 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T07:25:21.070 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T07:25:21.524 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T07:25:21.537 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T07:25:21.651 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T07:25:22.238 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T07:25:22.252 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T07:25:22.296 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T07:25:22.525 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T07:25:22.535 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T07:25:22.575 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T07:25:22.599 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T07:25:22.613 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T07:25:22.657 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T07:25:23.112 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T07:25:23.121 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T07:25:23.238 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T07:25:23.374 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T07:25:23.387 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:23.432 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:23.609 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T07:25:23.618 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T07:25:23.692 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T07:25:23.995 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T07:25:24.004 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T07:25:24.045 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T07:25:24.377 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T07:25:24.391 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T07:25:24.435 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T07:25:24.695 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T07:25:24.704 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:24.738 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T07:25:24.745 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:24.752 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T07:25:24.814 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T07:25:25.133 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T07:25:25.147 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T07:25:25.191 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T07:25:25.502 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T07:25:25.516 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-16T07:25:25.585 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T07:25:25.698 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T07:25:25.709 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T07:25:25.748 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T07:25:25.906 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T07:25:25.919 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T07:25:25.972 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T07:25:26.026 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T07:25:26.037 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T07:25:26.067 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T07:25:26.309 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T07:25:26.322 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T07:25:26.359 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T07:25:26.404 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T07:25:26.414 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T07:25:26.454 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T07:25:26.628 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T07:25:26.642 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T07:25:26.686 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T07:25:26.798 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T07:25:26.809 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-16T07:25:26.848 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T07:25:27.040 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T07:25:27.053 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T07:25:27.098 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T07:25:27.127 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T07:25:27.137 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T07:25:27.168 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T07:25:27.480 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T07:25:27.490 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T07:25:27.530 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T07:25:27.895 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T07:25:27.908 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:27.944 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:28.074 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T07:25:28.085 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T07:25:28.124 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T07:25:28.264 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T07:25:28.277 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T07:25:28.330 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T07:25:28.644 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T07:25:28.655 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T07:25:28.694 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T07:25:28.834 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T07:25:28.847 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T07:25:28.892 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T07:25:29.153 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package jq. 2024-09-16T07:25:29.167 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T07:25:29.203 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T07:25:29.333 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T07:25:29.342 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:29.382 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:29.447 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package socat. 2024-09-16T07:25:29.461 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T07:25:29.505 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T07:25:29.727 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T07:25:29.736 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T07:25:29.775 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T07:25:29.776 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T07:25:29.789 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T07:25:29.833 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T07:25:30.088 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T07:25:30.098 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T07:25:30.138 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T07:25:30.221 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-test. 2024-09-16T07:25:30.234 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:30.279 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-test (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:30.407 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package jq. 2024-09-16T07:25:30.418 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T07:25:30.457 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T07:25:30.685 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package socat. 2024-09-16T07:25:30.696 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T07:25:30.735 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T07:25:31.055 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T07:25:31.065 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T07:25:31.104 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T07:25:31.450 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-test. 2024-09-16T07:25:31.460 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:31.500 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-test (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:32.133 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T07:25:32.147 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:32.183 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ceph-volume (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:32.562 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-16T07:25:32.575 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:32.628 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-mirror (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:32.915 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-colorama. 2024-09-16T07:25:32.928 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-16T07:25:32.973 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-16T07:25:33.234 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-shell. 2024-09-16T07:25:33.248 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:33.317 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-shell (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:33.513 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T07:25:33.523 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:33.562 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-volume (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:33.569 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package cephfs-top. 2024-09-16T07:25:33.584 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:33.627 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking cephfs-top (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:33.872 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T07:25:33.886 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:33.921 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libcephfs-dev (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:33.950 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-16T07:25:33.960 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:34.000 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-mirror (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:34.233 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T07:25:34.248 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T07:25:34.291 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T07:25:34.302 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-colorama. 2024-09-16T07:25:34.313 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-16T07:25:34.352 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-16T07:25:34.620 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T07:25:34.635 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T07:25:34.638 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-shell. 2024-09-16T07:25:34.649 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:34.678 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T07:25:34.688 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-shell (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:34.924 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-top. 2024-09-16T07:25:34.934 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4938-g4ef5f058-1jammy_all.deb ... 2024-09-16T07:25:34.974 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-top (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:35.066 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T07:25:35.081 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T07:25:35.124 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T07:25:35.260 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T07:25:35.270 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:35.309 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs-dev (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:35.562 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package pkg-config. 2024-09-16T07:25:35.576 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T07:25:35.587 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-16T07:25:35.598 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-16T07:25:35.620 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T07:25:35.654 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T07:25:35.882 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T07:25:35.896 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T07:25:35.931 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T07:25:35.983 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-16T07:25:35.994 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-16T07:25:36.033 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-16T07:25:36.368 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T07:25:36.381 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T07:25:36.418 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T07:25:36.454 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T07:25:36.464 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T07:25:36.503 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T07:25:36.704 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T07:25:36.720 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T07:25:36.762 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T07:25:36.950 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pkg-config. 2024-09-16T07:25:36.960 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-16T07:25:37.000 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T07:25:37.099 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T07:25:37.113 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T07:25:37.157 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T07:25:37.253 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T07:25:37.263 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T07:25:37.302 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T07:25:37.693 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T07:25:37.709 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T07:25:37.730 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T07:25:37.740 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T07:25:37.751 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T07:25:37.780 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T07:25:38.095 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-py. 2024-09-16T07:25:38.108 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T07:25:38.110 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-16T07:25:38.119 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T07:25:38.153 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T07:25:38.158 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T07:25:38.487 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T07:25:38.496 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T07:25:38.507 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T07:25:38.522 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T07:25:38.536 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T07:25:38.565 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T07:25:38.939 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T07:25:38.950 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T07:25:38.969 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T07:25:38.983 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T07:25:38.997 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T07:25:39.019 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T07:25:39.330 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-toml. 2024-09-16T07:25:39.344 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-16T07:25:39.388 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T07:25:39.419 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-py. 2024-09-16T07:25:39.430 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-16T07:25:39.477 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T07:25:39.693 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T07:25:39.707 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T07:25:39.751 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T07:25:39.797 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T07:25:39.811 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T07:25:39.889 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T07:25:40.113 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T07:25:40.127 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T07:25:40.171 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T07:25:40.318 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T07:25:40.329 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T07:25:40.368 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T07:25:40.424 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T07:25:40.438 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T07:25:40.482 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T07:25:40.670 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-toml. 2024-09-16T07:25:40.682 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-16T07:25:40.720 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T07:25:41.023 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T07:25:41.034 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T07:25:41.106 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T07:25:41.161 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package radosgw. 2024-09-16T07:25:41.175 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../123-radosgw_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:41.210 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking radosgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:41.460 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T07:25:41.471 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T07:25:41.509 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T07:25:41.787 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T07:25:41.799 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T07:25:41.837 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T07:25:41.855 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T07:25:41.871 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:41.913 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking rbd-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:42.232 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T07:25:42.502 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T07:25:42.582 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package radosgw. 2024-09-16T07:25:42.593 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../123-radosgw_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:42.628 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T07:25:42.632 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking radosgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:42.916 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T07:25:43.312 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T07:25:43.602 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T07:25:43.614 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4938-g4ef5f058-1jammy_amd64.deb ... 2024-09-16T07:25:43.652 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking rbd-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:43.935 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T07:25:43.944 INFO:teuthology.orchestra.run.smithi149.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T07:25:44.008 INFO:teuthology.orchestra.run.smithi149.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-16T07:25:44.046 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:44.216 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T07:25:44.366 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T07:25:44.574 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user cephadm....done 2024-09-16T07:25:44.631 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T07:25:44.728 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T07:25:45.004 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T07:25:45.049 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T07:25:45.263 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T07:25:45.373 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T07:25:45.624 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T07:25:45.737 INFO:teuthology.orchestra.run.smithi114.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T07:25:45.751 INFO:teuthology.orchestra.run.smithi114.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-16T07:25:45.794 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:45.892 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T07:25:45.993 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T07:25:46.311 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T07:25:46.312 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user cephadm....done 2024-09-16T07:25:46.441 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T07:25:46.768 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T07:25:46.847 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T07:25:47.019 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T07:25:47.115 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-16T07:25:47.145 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T07:25:47.391 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T07:25:47.396 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T07:25:47.664 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T07:25:47.667 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T07:25:47.790 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T07:25:47.961 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T07:25:48.100 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T07:25:48.212 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T07:25:48.477 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T07:25:48.496 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T07:25:48.753 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-16T07:25:48.764 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-argparse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:49.021 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T07:25:49.031 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T07:25:49.157 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-16T07:25:49.292 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T07:25:49.297 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-16T07:25:49.393 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-16T07:25:49.566 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T07:25:49.660 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T07:25:49.778 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T07:25:49.825 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T07:25:50.037 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T07:25:50.102 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T07:25:50.378 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-argparse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:50.467 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T07:25:50.493 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T07:25:50.557 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T07:25:50.629 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T07:25:50.708 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T07:25:50.754 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-16T07:25:50.881 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-16T07:25:51.031 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-16T07:25:51.059 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T07:25:51.161 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T07:25:51.299 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-16T07:25:51.425 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T07:25:51.428 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T07:25:51.693 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-16T07:25:51.696 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T07:25:52.014 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T07:25:52.079 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-16T07:25:52.107 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-16T07:25:52.165 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T07:25:52.205 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T07:25:52.330 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T07:25:52.698 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T07:25:52.849 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T07:25:52.858 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T07:25:53.126 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T07:25:53.127 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T07:25:53.235 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T07:25:53.362 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T07:25:53.435 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T07:25:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T07:25:53.736 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up zip (3.0-12build2) ... 2024-09-16T07:25:53.846 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T07:25:54.080 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T07:25:54.340 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T07:25:54.555 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T07:25:54.741 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T07:25:54.824 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T07:25:54.950 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T07:25:55.035 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-16T07:25:55.076 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T07:25:55.352 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T07:25:55.410 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T07:25:55.704 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T07:25:55.787 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T07:25:55.963 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T07:25:56.030 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T07:25:56.089 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:56.415 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T07:25:56.440 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T07:25:56.716 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-16T07:25:56.783 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T07:25:57.042 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T07:25:57.402 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T07:25:57.694 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T07:25:57.795 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:25:57.997 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T07:25:58.105 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T07:25:58.448 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T07:25:58.545 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:25:58.683 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T07:25:58.959 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T07:25:59.060 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T07:25:59.177 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T07:25:59.495 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T07:25:59.687 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-16T07:25:59.763 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T07:25:59.972 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:26:00.048 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:26:00.106 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T07:26:00.173 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T07:26:00.374 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T07:26:00.483 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T07:26:00.525 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T07:26:00.659 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T07:26:00.768 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T07:26:00.969 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T07:26:01.035 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T07:26:01.262 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T07:26:01.328 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T07:26:01.521 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:26:01.588 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T07:26:01.672 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T07:26:01.864 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T07:26:01.982 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T07:26:01.989 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T07:26:02.250 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T07:26:02.282 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T07:26:02.408 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T07:26:02.518 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T07:26:02.710 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T07:26:02.794 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T07:26:03.028 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T07:26:03.045 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T07:26:03.287 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T07:26:03.313 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T07:26:03.413 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T07:26:03.455 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T07:26:03.538 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T07:26:03.627 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T07:26:03.740 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T07:26:03.866 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T07:26:03.890 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T07:26:03.991 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T07:26:04.267 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T07:26:04.377 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T07:26:04.593 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T07:26:04.669 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T07:26:04.770 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T07:26:04.836 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-16T07:26:04.954 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-16T07:26:05.029 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:26:05.071 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T07:26:05.180 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T07:26:05.193 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T07:26:05.440 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T07:26:05.506 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T07:26:05.565 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T07:26:05.860 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T07:26:05.967 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T07:26:06.236 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T07:26:06.243 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-16T07:26:06.336 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T07:26:06.378 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T07:26:06.605 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T07:26:06.629 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T07:26:06.755 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T07:26:06.881 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T07:26:07.089 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T07:26:07.149 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T07:26:07.399 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T07:26:07.567 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T07:26:07.794 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T07:26:07.860 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T07:26:07.895 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T07:26:08.146 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T07:26:08.246 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T07:26:08.372 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librados2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:08.439 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T07:26:08.498 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:08.607 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T07:26:08.707 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T07:26:08.927 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:09.053 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libradosstriper1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:09.092 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T07:26:09.179 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T07:26:09.394 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T07:26:09.472 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librbd1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:09.598 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-modules-core (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:09.724 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:09.737 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T07:26:09.880 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librados2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:09.942 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T07:26:09.942 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T07:26:10.023 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:10.149 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-16T07:26:10.527 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libcephfs-dev (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:10.652 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libradosstriper1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:10.685 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rados (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:10.762 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T07:26:10.836 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up librgw2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:10.962 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-top (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:11.039 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librbd1 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:11.088 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T07:26:11.165 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-modules-core (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:11.290 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:11.499 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T07:26:11.499 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T07:26:12.142 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs-dev (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.301 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rados (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.367 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rbd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.427 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librgw2 (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.492 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up rbd-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.537 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-top (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.602 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-rgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.646 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T07:26:12.711 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up python3-cephfs (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.820 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-shell (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:12.971 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:13.566 INFO:teuthology.orchestra.run.smithi149.stdout:Adding group ceph....done 2024-09-16T07:26:13.940 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rbd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:14.000 INFO:teuthology.orchestra.run.smithi149.stdout:Adding system user ceph....done 2024-09-16T07:26:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up rbd-fuse (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:14.153 INFO:teuthology.orchestra.run.smithi149.stdout:Setting system user ceph properties....done 2024-09-16T07:26:14.167 INFO:teuthology.orchestra.run.smithi149.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T07:26:14.193 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:14.294 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cephfs (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:14.308 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T07:26:14.404 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-shell (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:14.554 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-common (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:14.706 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T07:26:15.152 INFO:teuthology.orchestra.run.smithi114.stdout:Adding group ceph....done 2024-09-16T07:26:15.372 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up cephfs-mirror (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:15.526 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user ceph....done 2024-09-16T07:26:15.580 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-16T07:26:15.580 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-16T07:26:15.711 INFO:teuthology.orchestra.run.smithi114.stdout:Setting system user ceph properties....done 2024-09-16T07:26:15.733 INFO:teuthology.orchestra.run.smithi114.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T07:26:15.879 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T07:26:16.207 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-test (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:16.307 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T07:26:16.333 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up radosgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:16.861 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:26:16.861 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:26:17.215 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-mirror (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:17.430 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-16T07:26:17.431 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-16T07:26:17.527 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-base (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:17.877 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T07:26:18.049 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-test (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:18.175 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up radosgw (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:18.512 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mds (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:18.732 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:26:18.732 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:26:18.933 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T07:26:18.933 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T07:26:19.526 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:19.765 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T07:26:19.765 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T07:26:19.823 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-base (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:20.188 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T07:26:20.377 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-osd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:20.819 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T07:26:20.819 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T07:26:20.842 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mds (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:21.081 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T07:26:21.082 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T07:26:21.429 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:21.563 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:21.710 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:21.722 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mon (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:21.914 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T07:26:21.915 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T07:26:21.930 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T07:26:21.931 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T07:26:22.557 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:22.595 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-osd (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:22.674 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:22.784 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-mgr-dashboard (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:22.904 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T07:26:22.904 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T07:26:22.927 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ceph-volume (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:23.288 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T07:26:23.396 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T07:26:23.548 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T07:26:23.564 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:23.689 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:23.832 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mon (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:24.046 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T07:26:24.046 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T07:26:24.675 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-cephadm (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:24.818 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:24.869 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T07:26:24.919 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-dashboard (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:25.062 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-volume (19.3.0-4938-g4ef5f058-1jammy) ... 2024-09-16T07:26:25.448 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T07:26:25.549 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T07:26:25.615 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T07:26:25.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-16T07:26:25.696 INFO:teuthology.orchestra.run.smithi149.stdout:Reading package lists... 2024-09-16T07:26:25.700 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T07:26:25.884 INFO:teuthology.orchestra.run.smithi149.stdout:Building dependency tree... 2024-09-16T07:26:25.884 INFO:teuthology.orchestra.run.smithi149.stdout:Reading state information... 2024-09-16T07:26:26.072 INFO:teuthology.orchestra.run.smithi149.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-16T07:26:26.072 INFO:teuthology.orchestra.run.smithi149.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-16T07:26:26.072 INFO:teuthology.orchestra.run.smithi149.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-16T07:26:26.072 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T07:26:26.072 INFO:teuthology.orchestra.run.smithi149.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T07:26:26.073 INFO:teuthology.orchestra.run.smithi149.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T07:26:26.073 INFO:teuthology.orchestra.run.smithi149.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T07:26:26.073 INFO:teuthology.orchestra.run.smithi149.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T07:26:26.074 INFO:teuthology.orchestra.run.smithi149.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T07:26:26.074 INFO:teuthology.orchestra.run.smithi149.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T07:26:26.074 INFO:teuthology.orchestra.run.smithi149.stdout:The following additional packages will be installed: 2024-09-16T07:26:26.074 INFO:teuthology.orchestra.run.smithi149.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-16T07:26:26.074 INFO:teuthology.orchestra.run.smithi149.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-16T07:26:26.075 INFO:teuthology.orchestra.run.smithi149.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-16T07:26:26.075 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-16T07:26:26.075 INFO:teuthology.orchestra.run.smithi149.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-16T07:26:26.076 INFO:teuthology.orchestra.run.smithi149.stdout:Suggested packages: 2024-09-16T07:26:26.076 INFO:teuthology.orchestra.run.smithi149.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-16T07:26:26.076 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-16T07:26:26.076 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-16T07:26:26.134 INFO:teuthology.orchestra.run.smithi149.stdout:The following NEW packages will be installed: 2024-09-16T07:26:26.134 INFO:teuthology.orchestra.run.smithi149.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-16T07:26:26.134 INFO:teuthology.orchestra.run.smithi149.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-16T07:26:26.136 INFO:teuthology.orchestra.run.smithi149.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-16T07:26:26.136 INFO:teuthology.orchestra.run.smithi149.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-16T07:26:26.136 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-16T07:26:26.136 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-16T07:26:26.136 INFO:teuthology.orchestra.run.smithi149.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-16T07:26:26.137 INFO:teuthology.orchestra.run.smithi149.stdout:The following packages will be upgraded: 2024-09-16T07:26:26.138 INFO:teuthology.orchestra.run.smithi149.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-16T07:26:26.194 INFO:teuthology.orchestra.run.smithi149.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-16T07:26:26.194 INFO:teuthology.orchestra.run.smithi149.stdout:Need to get 55.8 MB of archives. 2024-09-16T07:26:26.194 INFO:teuthology.orchestra.run.smithi149.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-16T07:26:26.194 INFO:teuthology.orchestra.run.smithi149.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-16T07:26:26.328 INFO:teuthology.orchestra.run.smithi149.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-16T07:26:26.332 INFO:teuthology.orchestra.run.smithi149.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-16T07:26:26.359 INFO:teuthology.orchestra.run.smithi149.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-16T07:26:26.360 INFO:teuthology.orchestra.run.smithi149.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-16T07:26:26.360 INFO:teuthology.orchestra.run.smithi149.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-16T07:26:26.367 INFO:teuthology.orchestra.run.smithi149.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-16T07:26:26.369 INFO:teuthology.orchestra.run.smithi149.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-16T07:26:26.370 INFO:teuthology.orchestra.run.smithi149.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-16T07:26:26.371 INFO:teuthology.orchestra.run.smithi149.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-16T07:26:26.372 INFO:teuthology.orchestra.run.smithi149.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-16T07:26:26.373 INFO:teuthology.orchestra.run.smithi149.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-16T07:26:26.381 INFO:teuthology.orchestra.run.smithi149.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-16T07:26:26.381 INFO:teuthology.orchestra.run.smithi149.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-16T07:26:26.382 INFO:teuthology.orchestra.run.smithi149.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-16T07:26:26.398 INFO:teuthology.orchestra.run.smithi149.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-16T07:26:26.607 INFO:teuthology.orchestra.run.smithi149.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-16T07:26:26.609 INFO:teuthology.orchestra.run.smithi149.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-16T07:26:26.609 INFO:teuthology.orchestra.run.smithi149.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-16T07:26:26.612 INFO:teuthology.orchestra.run.smithi149.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-16T07:26:26.613 INFO:teuthology.orchestra.run.smithi149.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-16T07:26:26.617 INFO:teuthology.orchestra.run.smithi149.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-16T07:26:26.619 INFO:teuthology.orchestra.run.smithi149.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-16T07:26:26.625 INFO:teuthology.orchestra.run.smithi149.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-16T07:26:26.626 INFO:teuthology.orchestra.run.smithi149.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-16T07:26:26.646 INFO:teuthology.orchestra.run.smithi149.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-16T07:26:26.647 INFO:teuthology.orchestra.run.smithi149.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-16T07:26:26.656 INFO:teuthology.orchestra.run.smithi149.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-16T07:26:26.676 INFO:teuthology.orchestra.run.smithi149.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-16T07:26:26.680 INFO:teuthology.orchestra.run.smithi149.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-16T07:26:26.681 INFO:teuthology.orchestra.run.smithi149.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-16T07:26:26.681 INFO:teuthology.orchestra.run.smithi149.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-16T07:26:26.681 INFO:teuthology.orchestra.run.smithi149.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-16T07:26:26.693 INFO:teuthology.orchestra.run.smithi149.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-16T07:26:26.694 INFO:teuthology.orchestra.run.smithi149.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-16T07:26:26.827 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T07:26:26.839 INFO:teuthology.orchestra.run.smithi149.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-16T07:26:26.840 INFO:teuthology.orchestra.run.smithi149.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-16T07:26:26.840 INFO:teuthology.orchestra.run.smithi149.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-16T07:26:26.840 INFO:teuthology.orchestra.run.smithi149.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-16T07:26:26.840 INFO:teuthology.orchestra.run.smithi149.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-16T07:26:26.841 INFO:teuthology.orchestra.run.smithi149.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-16T07:26:26.853 INFO:teuthology.orchestra.run.smithi149.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-16T07:26:26.854 INFO:teuthology.orchestra.run.smithi149.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-16T07:26:27.238 INFO:teuthology.orchestra.run.smithi149.stdout:Preconfiguring packages ... 2024-09-16T07:26:27.411 INFO:teuthology.orchestra.run.smithi149.stdout:Fetched 55.8 MB in 1s (78.7 MB/s) 2024-09-16T07:26:27.562 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T07:26:27.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-16T07:26:27.642 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-16T07:26:27.714 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143290 files and directories currently installed.) 2024-09-16T07:26:27.718 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-16T07:26:27.825 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-16T07:26:27.826 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-16T07:26:27.858 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-16T07:26:28.010 INFO:teuthology.orchestra.run.smithi114.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-16T07:26:28.011 INFO:teuthology.orchestra.run.smithi114.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-16T07:26:28.011 INFO:teuthology.orchestra.run.smithi114.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-16T07:26:28.011 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T07:26:28.011 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T07:26:28.011 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T07:26:28.011 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T07:26:28.012 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T07:26:28.012 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T07:26:28.012 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T07:26:28.013 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-09-16T07:26:28.013 INFO:teuthology.orchestra.run.smithi114.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-16T07:26:28.013 INFO:teuthology.orchestra.run.smithi114.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-16T07:26:28.013 INFO:teuthology.orchestra.run.smithi114.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-16T07:26:28.013 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-16T07:26:28.013 INFO:teuthology.orchestra.run.smithi114.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-16T07:26:28.014 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-09-16T07:26:28.014 INFO:teuthology.orchestra.run.smithi114.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-16T07:26:28.015 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-16T07:26:28.015 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-16T07:26:28.071 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-09-16T07:26:28.071 INFO:teuthology.orchestra.run.smithi114.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-16T07:26:28.071 INFO:teuthology.orchestra.run.smithi114.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-16T07:26:28.072 INFO:teuthology.orchestra.run.smithi114.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-16T07:26:28.072 INFO:teuthology.orchestra.run.smithi114.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-16T07:26:28.072 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-16T07:26:28.072 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-16T07:26:28.072 INFO:teuthology.orchestra.run.smithi114.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-16T07:26:28.074 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2024-09-16T07:26:28.074 INFO:teuthology.orchestra.run.smithi114.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-16T07:26:28.259 INFO:teuthology.orchestra.run.smithi114.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-16T07:26:28.259 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 55.8 MB of archives. 2024-09-16T07:26:28.260 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-16T07:26:28.260 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-16T07:26:28.500 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-16T07:26:28.879 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-16T07:26:28.895 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-16T07:26:29.018 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-16T07:26:29.019 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-16T07:26:29.020 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-16T07:26:29.043 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-16T07:26:29.044 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-16T07:26:29.048 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-16T07:26:29.050 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-16T07:26:29.051 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-16T07:26:29.053 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-16T07:26:29.125 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-16T07:26:29.125 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-16T07:26:29.125 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-16T07:26:29.203 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-16T07:26:29.639 INFO:teuthology.orchestra.run.smithi149.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-16T07:26:29.882 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-16T07:26:29.884 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-16T07:26:29.885 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-16T07:26:29.887 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-16T07:26:29.888 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-16T07:26:29.892 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-16T07:26:29.894 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-16T07:26:29.901 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-16T07:26:29.901 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-16T07:26:29.905 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package flex. 2024-09-16T07:26:29.974 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143290 files and directories currently installed.) 2024-09-16T07:26:29.978 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-16T07:26:29.979 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-16T07:26:29.985 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-16T07:26:30.028 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-16T07:26:30.033 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-16T07:26:30.071 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-16T07:26:30.110 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-16T07:26:30.110 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-16T07:26:30.111 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-16T07:26:30.112 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-16T07:26:30.135 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-16T07:26:30.137 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-16T07:26:30.591 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-16T07:26:30.624 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-16T07:26:30.624 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-16T07:26:30.624 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-16T07:26:30.625 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-16T07:26:30.625 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-16T07:26:30.625 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-16T07:26:30.641 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-16T07:26:30.642 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-16T07:26:30.760 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-16T07:26:31.023 INFO:teuthology.orchestra.run.smithi114.stdout:Preconfiguring packages ... 2024-09-16T07:26:31.168 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 55.8 MB in 3s (21.8 MB/s) 2024-09-16T07:26:31.251 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-16T07:26:31.462 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143290 files and directories currently installed.) 2024-09-16T07:26:31.466 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-16T07:26:31.608 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-16T07:26:31.772 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143363 files and directories currently installed.) 2024-09-16T07:26:31.777 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-16T07:26:31.917 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-16T07:26:32.267 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-16T07:26:32.313 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-16T07:26:32.440 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-16T07:26:32.781 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-16T07:26:33.140 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package bison. 2024-09-16T07:26:33.219 INFO:teuthology.orchestra.run.smithi149.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143363 files and directories currently installed.) 2024-09-16T07:26:33.223 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-16T07:26:33.268 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-16T07:26:33.326 INFO:teuthology.orchestra.run.smithi114.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-16T07:26:33.605 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package flex. 2024-09-16T07:26:33.612 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-16T07:26:33.628 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-16T07:26:33.662 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-16T07:26:33.675 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143290 files and directories currently installed.) 2024-09-16T07:26:33.679 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-16T07:26:33.728 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-16T07:26:34.024 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package dump. 2024-09-16T07:26:34.040 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-16T07:26:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking dump (0.4b47-3) ... 2024-09-16T07:26:34.256 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-16T07:26:34.353 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package indent. 2024-09-16T07:26:34.369 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:34.403 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-16T07:26:34.434 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-16T07:26:34.622 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-16T07:26:34.638 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-16T07:26:34.680 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-16T07:26:34.824 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-16T07:26:35.017 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-16T07:26:35.034 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-16T07:26:35.076 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-16T07:26:35.312 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-16T07:26:35.328 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-16T07:26:35.362 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-16T07:26:35.381 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143363 files and directories currently installed.) 2024-09-16T07:26:35.385 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-16T07:26:35.508 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-16T07:26:35.732 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-16T07:26:35.748 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-16T07:26:35.790 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-16T07:26:35.929 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-16T07:26:36.018 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-16T07:26:36.034 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-16T07:26:36.039 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-16T07:26:36.076 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-16T07:26:36.346 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libjson-perl. 2024-09-16T07:26:36.355 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-16T07:26:36.362 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-16T07:26:36.396 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-16T07:26:36.683 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-16T07:26:36.698 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-16T07:26:36.700 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package bison. 2024-09-16T07:26:36.740 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-16T07:26:36.772 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143363 files and directories currently installed.) 2024-09-16T07:26:36.776 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-16T07:26:36.811 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-16T07:26:37.271 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-16T07:26:37.285 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-16T07:26:37.329 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-16T07:26:37.690 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package dump. 2024-09-16T07:26:37.705 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-16T07:26:37.748 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking dump (0.4b47-3) ... 2024-09-16T07:26:38.019 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package indent. 2024-09-16T07:26:38.034 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:38.069 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-16T07:26:38.077 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-16T07:26:38.093 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-16T07:26:38.135 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:26:38.346 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-16T07:26:38.362 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-16T07:26:38.405 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-16T07:26:38.421 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-16T07:26:38.497 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:26:38.734 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-16T07:26:38.750 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-16T07:26:38.807 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-16T07:26:38.817 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-16T07:26:38.824 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-16T07:26:38.866 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:26:39.061 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-16T07:26:39.077 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-16T07:26:39.111 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-16T07:26:39.227 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-16T07:26:39.244 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-16T07:26:39.285 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-16T07:26:39.465 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-16T07:26:39.481 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-16T07:26:39.523 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-16T07:26:39.613 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-16T07:26:39.630 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-16T07:26:39.671 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-16T07:26:39.775 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-16T07:26:39.791 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-16T07:26:39.834 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-16T07:26:40.033 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-16T07:26:40.050 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:40.091 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:40.111 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjson-perl. 2024-09-16T07:26:40.128 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-16T07:26:40.170 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-16T07:26:40.403 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-16T07:26:40.419 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:40.461 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:26:40.465 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-16T07:26:40.481 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-16T07:26:40.523 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-16T07:26:40.781 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-16T07:26:40.797 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:40.838 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:26:41.066 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-16T07:26:41.083 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-16T07:26:41.124 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-16T07:26:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-16T07:26:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-16T07:26:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-16T07:26:41.859 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-16T07:26:41.875 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-16T07:26:41.917 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:26:42.015 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package modemmanager. 2024-09-16T07:26:42.031 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-16T07:26:42.107 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:26:42.211 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-16T07:26:42.228 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-16T07:26:42.395 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:26:42.713 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager. 2024-09-16T07:26:42.730 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-16T07:26:42.748 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-16T07:26:42.764 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-16T07:26:42.779 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-16T07:26:42.806 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:26:43.142 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-16T07:26:43.158 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-16T07:26:43.200 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-16T07:26:43.421 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package ppp. 2024-09-16T07:26:43.437 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-16T07:26:43.503 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-16T07:26:43.520 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-16T07:26:43.561 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-16T07:26:43.792 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-16T07:26:43.906 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-16T07:26:43.922 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:43.964 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:44.092 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package pptp-linux. 2024-09-16T07:26:44.108 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-16T07:26:44.151 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-16T07:26:44.293 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-16T07:26:44.308 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:44.351 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:26:44.387 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-16T07:26:44.402 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-16T07:26:44.437 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-16T07:26:44.653 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-16T07:26:44.669 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:44.703 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:26:44.740 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-16T07:26:44.755 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-16T07:26:44.799 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-client-common (238) ... 2024-09-16T07:26:44.956 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-16T07:26:44.972 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-16T07:26:45.014 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-16T07:26:45.102 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-16T07:26:45.118 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:45.160 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:45.560 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-16T07:26:45.575 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-16T07:26:45.609 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-16T07:26:45.749 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-common. 2024-09-16T07:26:45.764 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-16T07:26:45.823 INFO:teuthology.orchestra.run.smithi149.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-16T07:26:45.855 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-common (238) ... 2024-09-16T07:26:45.963 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package modemmanager. 2024-09-16T07:26:45.978 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-16T07:26:46.021 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:26:46.306 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-14. 2024-09-16T07:26:46.321 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:46.358 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:46.619 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager. 2024-09-16T07:26:46.635 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-16T07:26:46.685 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-16T07:26:47.268 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ppp. 2024-09-16T07:26:47.284 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-16T07:26:47.568 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql. 2024-09-16T07:26:47.583 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-16T07:26:47.618 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql (14+238) ... 2024-09-16T07:26:47.626 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-16T07:26:47.895 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-client. 2024-09-16T07:26:47.910 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-16T07:26:47.948 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pptp-linux. 2024-09-16T07:26:47.953 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-client (14+238) ... 2024-09-16T07:26:47.962 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-16T07:26:48.006 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-16T07:26:48.197 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-16T07:26:48.213 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-16T07:26:48.255 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-16T07:26:48.284 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-16T07:26:48.298 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-16T07:26:48.342 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-16T07:26:48.609 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package tcl8.6. 2024-09-16T07:26:48.625 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-16T07:26:48.653 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-16T07:26:48.668 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-16T07:26:48.691 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-16T07:26:48.703 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-common (238) ... 2024-09-16T07:26:48.977 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package tcl. 2024-09-16T07:26:48.993 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-16T07:26:49.007 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-16T07:26:49.022 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:49.040 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-16T07:26:49.066 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:49.372 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package wpasupplicant. 2024-09-16T07:26:49.388 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-16T07:26:49.430 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-16T07:26:49.661 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-common. 2024-09-16T07:26:49.677 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-16T07:26:49.738 INFO:teuthology.orchestra.run.smithi114.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-16T07:26:49.769 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-common (238) ... 2024-09-16T07:26:50.185 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-14. 2024-09-16T07:26:50.201 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-16T07:26:50.238 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:50.309 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-16T07:26:50.326 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-16T07:26:50.368 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-16T07:26:50.712 INFO:teuthology.orchestra.run.smithi149.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-16T07:26:50.729 INFO:teuthology.orchestra.run.smithi149.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-16T07:26:50.778 INFO:teuthology.orchestra.run.smithi149.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-16T07:26:51.080 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-client-common (238) ... 2024-09-16T07:26:51.285 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-16T07:26:51.330 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql. 2024-09-16T07:26:51.345 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-16T07:26:51.388 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql (14+238) ... 2024-09-16T07:26:51.394 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-16T07:26:51.563 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-16T07:26:51.815 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-16T07:26:51.941 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:51.982 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client. 2024-09-16T07:26:51.997 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-16T07:26:52.032 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client (14+238) ... 2024-09-16T07:26:52.226 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-16T07:26:52.242 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-16T07:26:52.276 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-16T07:26:52.620 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package tcl8.6. 2024-09-16T07:26:52.635 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-16T07:26:52.679 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-16T07:26:52.894 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-16T07:26:52.989 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package tcl. 2024-09-16T07:26:53.006 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-16T07:26:53.012 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-16T07:26:53.052 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-16T07:26:53.365 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-16T07:26:53.365 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-16T07:26:53.375 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package wpasupplicant. 2024-09-16T07:26:53.391 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-16T07:26:53.434 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-16T07:26:53.805 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-16T07:26:53.821 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-16T07:26:53.863 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-16T07:26:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-16T07:26:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-16T07:26:54.275 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-16T07:26:54.291 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-16T07:26:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-16T07:26:54.341 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-16T07:26:54.419 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-16T07:26:54.570 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-16T07:26:54.626 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-common (238) ... 2024-09-16T07:26:54.805 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-16T07:26:54.889 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-16T07:26:54.932 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-16T07:26:55.015 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-16T07:26:55.073 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-16T07:26:55.124 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:55.225 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-16T07:26:55.351 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-16T07:26:55.468 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:26:55.754 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-16T07:26:55.880 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up dump (0.4b47-3) ... 2024-09-16T07:26:55.992 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-16T07:26:56.056 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:26:56.166 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-16T07:26:56.284 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-16T07:26:56.410 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-16T07:26:56.421 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-16T07:26:56.536 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-16T07:26:56.557 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-16T07:26:56.625 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-16T07:26:56.729 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-16T07:26:56.855 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-16T07:26:56.885 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-16T07:26:56.886 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-16T07:26:57.031 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-16T07:26:57.149 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:26:57.250 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-16T07:26:57.443 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-client (14+238) ... 2024-09-16T07:26:57.569 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-16T07:26:57.569 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-16T07:26:57.862 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-16T07:26:57.970 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-16T07:26:58.097 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-16T07:26:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:26:58.119 INFO:teuthology.orchestra.run.smithi149.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-16T07:26:58.119 INFO:teuthology.orchestra.run.smithi149.stdout:which means they are currently configured by ifupdown: 2024-09-16T07:26:58.119 INFO:teuthology.orchestra.run.smithi149.stdout:- enp3s0f1 2024-09-16T07:26:58.119 INFO:teuthology.orchestra.run.smithi149.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-16T07:26:58.119 INFO:teuthology.orchestra.run.smithi149.stdout:remove their configuration from /etc/network/interfaces. 2024-09-16T07:26:58.119 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:26:58.223 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-16T07:26:58.251 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-16T07:26:58.349 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-16T07:26:58.500 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-16T07:26:58.642 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-16T07:26:58.665 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-16T07:26:59.057 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-16T07:26:59.306 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-16T07:26:59.432 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up dump (0.4b47-3) ... 2024-09-16T07:26:59.527 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-16T07:26:59.617 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:26:59.738 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:26:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-16T07:26:59.886 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-16T07:26:59.898 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-16T07:27:00.011 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-16T07:27:00.015 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-16T07:27:00.121 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-16T07:27:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-16T07:27:00.289 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-16T07:27:00.415 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-16T07:27:00.584 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-common (238) ... 2024-09-16T07:27:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-16T07:27:00.718 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:27:00.893 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-16T07:27:01.061 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client (14+238) ... 2024-09-16T07:27:01.187 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-16T07:27:01.565 INFO:teuthology.orchestra.run.smithi149.stdout:Adding user postgres to group ssl-cert 2024-09-16T07:27:01.768 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-16T07:27:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:which means they are currently configured by ifupdown: 2024-09-16T07:27:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:- enp3s0f1 2024-09-16T07:27:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-16T07:27:01.769 INFO:teuthology.orchestra.run.smithi114.stdout:remove their configuration from /etc/network/interfaces. 2024-09-16T07:27:01.769 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:01.815 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:01.816 INFO:teuthology.orchestra.run.smithi149.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-16T07:27:01.901 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-16T07:27:02.079 INFO:teuthology.orchestra.run.smithi149.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-16T07:27:02.079 INFO:teuthology.orchestra.run.smithi149.stdout:Removing obsolete dictionary files: 2024-09-16T07:27:02.304 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-16T07:27:02.717 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-16T07:27:02.758 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-16T07:27:03.210 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:27:03.399 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-16T07:27:03.525 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-16T07:27:03.550 INFO:teuthology.orchestra.run.smithi149.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-16T07:27:03.570 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-16T07:27:03.615 INFO:teuthology.orchestra.run.smithi149.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout:This user must also own the server process. 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout:The database cluster will be initialized with locale "en_US". 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout:The default text search configuration will be set to "english". 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout:Data page checksums are disabled. 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:03.616 INFO:teuthology.orchestra.run.smithi149.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-16T07:27:03.617 INFO:teuthology.orchestra.run.smithi149.stdout:creating subdirectories ... ok 2024-09-16T07:27:03.617 INFO:teuthology.orchestra.run.smithi149.stdout:selecting dynamic shared memory implementation ... posix 2024-09-16T07:27:03.640 INFO:teuthology.orchestra.run.smithi149.stdout:selecting default max_connections ... 100 2024-09-16T07:27:03.642 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-16T07:27:03.674 INFO:teuthology.orchestra.run.smithi149.stdout:selecting default shared_buffers ... 128MB 2024-09-16T07:27:03.687 INFO:teuthology.orchestra.run.smithi149.stdout:selecting default time zone ... Etc/UTC 2024-09-16T07:27:03.688 INFO:teuthology.orchestra.run.smithi149.stdout:creating configuration files ... ok 2024-09-16T07:27:03.802 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-common (238) ... 2024-09-16T07:27:03.848 INFO:teuthology.orchestra.run.smithi149.stdout:running bootstrap script ... ok 2024-09-16T07:27:04.479 INFO:teuthology.orchestra.run.smithi149.stdout:performing post-bootstrap initialization ... ok 2024-09-16T07:27:04.723 INFO:teuthology.orchestra.run.smithi114.stdout:Adding user postgres to group ssl-cert 2024-09-16T07:27:04.977 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:04.977 INFO:teuthology.orchestra.run.smithi114.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-16T07:27:05.047 INFO:teuthology.orchestra.run.smithi149.stdout:syncing data to disk ... ok 2024-09-16T07:27:05.238 INFO:teuthology.orchestra.run.smithi114.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-16T07:27:05.238 INFO:teuthology.orchestra.run.smithi114.stdout:Removing obsolete dictionary files: 2024-09-16T07:27:05.571 INFO:teuthology.orchestra.run.smithi149.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-16T07:27:05.997 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-16T07:27:06.487 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-16T07:27:06.841 INFO:teuthology.orchestra.run.smithi114.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-16T07:27:06.865 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout:This user must also own the server process. 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout:The database cluster will be initialized with locale "en_US". 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout:The default text search configuration will be set to "english". 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout:Data page checksums are disabled. 2024-09-16T07:27:06.922 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:06.923 INFO:teuthology.orchestra.run.smithi114.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-16T07:27:06.923 INFO:teuthology.orchestra.run.smithi114.stdout:creating subdirectories ... ok 2024-09-16T07:27:06.923 INFO:teuthology.orchestra.run.smithi114.stdout:selecting dynamic shared memory implementation ... posix 2024-09-16T07:27:06.946 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default max_connections ... 100 2024-09-16T07:27:06.980 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default shared_buffers ... 128MB 2024-09-16T07:27:06.993 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default time zone ... Etc/UTC 2024-09-16T07:27:06.994 INFO:teuthology.orchestra.run.smithi114.stdout:creating configuration files ... ok 2024-09-16T07:27:07.157 INFO:teuthology.orchestra.run.smithi114.stdout:running bootstrap script ... ok 2024-09-16T07:27:07.768 INFO:teuthology.orchestra.run.smithi114.stdout:performing post-bootstrap initialization ... ok 2024-09-16T07:27:08.301 INFO:teuthology.orchestra.run.smithi114.stdout:syncing data to disk ... ok 2024-09-16T07:27:08.626 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:27:08.752 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-16T07:27:08.840 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-16T07:27:08.887 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up postgresql (14+238) ... 2024-09-16T07:27:09.013 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:27:09.139 INFO:teuthology.orchestra.run.smithi149.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:27:09.433 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-16T07:27:09.433 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-16T07:27:10.191 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T07:27:10.284 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-16T07:27:10.594 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T07:27:10.787 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T07:27:11.794 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:27:11.921 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-16T07:27:12.072 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql (14+238) ... 2024-09-16T07:27:12.173 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-16T07:27:12.174 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-16T07:27:12.274 INFO:teuthology.orchestra.run.smithi149.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T07:27:12.274 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-16T07:27:12.512 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-16T07:27:12.512 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-16T07:27:12.823 INFO:teuthology.orchestra.run.smithi149.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T07:27:12.832 DEBUG:teuthology.parallel:result is None 2024-09-16T07:27:13.293 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-16T07:27:13.385 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-16T07:27:13.679 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T07:27:13.823 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T07:27:15.283 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-16T07:27:15.392 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-16T07:27:15.939 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T07:27:15.946 DEBUG:teuthology.parallel:result is None 2024-09-16T07:27:15.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ef5f0587d1cad82c4295c20951c303dc342ac74 2024-09-16T07:27:16.094 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-query -W -f '${Version}' ceph 2024-09-16T07:27:16.116 INFO:teuthology.orchestra.run.smithi114.stdout:19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:27:16.116 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:27:16.117 INFO:teuthology.task.install:The correct ceph version 19.3.0-4938-g4ef5f058-1jammy is installed. 2024-09-16T07:27:16.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4ef5f0587d1cad82c4295c20951c303dc342ac74 2024-09-16T07:27:16.259 DEBUG:teuthology.orchestra.run.smithi149:> dpkg-query -W -f '${Version}' ceph 2024-09-16T07:27:16.283 INFO:teuthology.orchestra.run.smithi149.stdout:19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:27:16.283 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4938-g4ef5f058-1jammy 2024-09-16T07:27:16.283 INFO:teuthology.task.install:The correct ceph version 19.3.0-4938-g4ef5f058-1jammy is installed. 2024-09-16T07:27:16.285 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T07:27:16.286 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:16.286 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:27:16.306 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:16.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:27:16.346 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T07:27:16.347 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:16.347 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:27:16.368 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:27:16.432 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:16.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:27:16.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:27:16.513 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T07:27:16.514 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:16.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:27:16.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:27:16.596 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:16.596 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:27:16.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:27:16.681 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T07:27:16.681 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:16.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:27:16.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:27:16.760 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:16.760 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:27:16.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:27:16.841 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T07:27:16.934 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T07:27:16.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-09-16T07:27:16.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2024-09-16T07:27:16.957 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T07:27:16.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:27:16.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:27:17.021 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T07:27:17.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:27:17.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:27:17.092 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-16T07:27:17.092 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-16T07:27:17.092 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-16T07:27:17.092 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:17.093 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T07:27:17.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T07:27:17.207 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:17.207 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T07:27:17.216 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T07:27:17.312 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T07:27:17.312 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T07:27:17.312 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855', 'branch': 'wip-athakkar-testing-2024-09-15-1936', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7906855', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-athakkar-testing-2024-09-15-1936'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-athakkar-testing-2024-09-15-1936', 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74'}}, 'owner': 'scheduled_khiremat@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6756, 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74', 'sleep_before_teardown': 0, 'subset': '3/4', 'suite': 'fs:volumes', 'suite_branch': 'wip-athakkar-testing-2024-09-15-1936', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ef5f0587d1cad82c4295c20951c303dc342ac74/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE7t/n4M4mZ1GDnIjno1QgYBvHZtyGfEyzEFiajmdxKf/cN+7exzCpkdzWXcAQ4OU6MefLFdA+wI33OgiemUF0U=', 'smithi149.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAdsF3obaq8tCUUCv/GJ0KZe1I0CZpfPHgwmPeeL/NhKJb+JG7lPQmP6JvGh1ZyMhCIIhxjNBVbpNrgyrUhI1A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4ef5f0587d1cad82c4295c20951c303dc342ac74', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_07:02:54', 'tube': 'smithi', 'user': 'khiremat', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T07:27:17.313 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:27:17.315 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:27:17.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:27:17.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:27:17.385 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:17.385 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:27:17.430 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:27:17.430 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-09-16T07:27:17.482 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:27:17.482 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:17.482 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-09-16T07:27:17.482 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:17.482 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 07:20:37.875436897 +0000 2024-09-16T07:27:17.482 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 07:20:37.607439290 +0000 2024-09-16T07:27:17.483 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 07:20:37.607439290 +0000 2024-09-16T07:27:17.483 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 07:20:37.607439290 +0000 2024-09-16T07:27:17.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:27:17.543 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:27:17.543 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:27:17.543 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000406141 s, 1.3 MB/s 2024-09-16T07:27:17.545 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:27:17.595 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 07:20:38.455431716 +0000 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 07:20:38.199434002 +0000 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 07:20:38.199434002 +0000 2024-09-16T07:27:17.646 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 07:20:38.199434002 +0000 2024-09-16T07:27:17.646 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:27:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:27:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:27:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000633565 s, 808 kB/s 2024-09-16T07:27:17.710 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:27:17.764 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-09-16T07:27:17.814 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:27:17.814 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:17.814 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 933 Links: 1 2024-09-16T07:27:17.814 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:17.814 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 07:20:39.019426678 +0000 2024-09-16T07:27:17.814 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 07:20:38.759429000 +0000 2024-09-16T07:27:17.815 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 07:20:38.759429000 +0000 2024-09-16T07:27:17.815 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 07:20:38.759429000 +0000 2024-09-16T07:27:17.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:27:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:27:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:27:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000388531 s, 1.3 MB/s 2024-09-16T07:27:17.877 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:27:17.928 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 948 Links: 1 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 07:20:39.627421247 +0000 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 07:20:39.335423856 +0000 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 07:20:39.335423856 +0000 2024-09-16T07:27:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 07:20:39.335423856 +0000 2024-09-16T07:27:17.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:27:18.043 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:27:18.043 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:27:18.044 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000376211 s, 1.4 MB/s 2024-09-16T07:27:18.046 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:27:18.100 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:18.101 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:18.101 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:27:18.110 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:27:18.110 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-09-16T07:27:18.165 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:27:18.166 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:18.166 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 884 Links: 1 2024-09-16T07:27:18.166 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:18.166 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-16 07:20:39.860556273 +0000 2024-09-16T07:27:18.166 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-16 07:20:39.600558595 +0000 2024-09-16T07:27:18.166 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-16 07:20:39.600558595 +0000 2024-09-16T07:27:18.166 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-16 07:20:39.600558595 +0000 2024-09-16T07:27:18.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:27:18.228 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-16T07:27:18.229 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-16T07:27:18.229 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000401489 s, 1.3 MB/s 2024-09-16T07:27:18.231 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:27:18.288 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-16 07:20:40.140553773 +0000 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-16 07:20:40.136553808 +0000 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-16 07:20:40.136553808 +0000 2024-09-16T07:27:18.338 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-16 07:20:40.136553808 +0000 2024-09-16T07:27:18.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:27:18.400 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-16T07:27:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-16T07:27:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000369691 s, 1.4 MB/s 2024-09-16T07:27:18.403 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:27:18.456 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 915 Links: 1 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-16 07:20:41.012545984 +0000 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-16 07:20:40.732548484 +0000 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-16 07:20:40.732548484 +0000 2024-09-16T07:27:18.510 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-16 07:20:40.732548484 +0000 2024-09-16T07:27:18.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:27:18.576 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-16T07:27:18.576 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-16T07:27:18.576 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000382355 s, 1.3 MB/s 2024-09-16T07:27:18.578 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:27:18.631 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 934 Links: 1 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-09-16 07:20:41.588540838 +0000 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-09-16 07:20:41.344543018 +0000 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-09-16 07:20:41.344543018 +0000 2024-09-16T07:27:18.686 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-09-16 07:20:41.344543018 +0000 2024-09-16T07:27:18.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:27:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-09-16T07:27:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-09-16T07:27:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000408697 s, 1.3 MB/s 2024-09-16T07:27:18.750 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:27:18.804 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:18.804 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T07:27:18.804 INFO:tasks.ceph:Generating config... 2024-09-16T07:27:18.805 INFO:tasks.ceph:[client] pid file = 2024-09-16T07:27:18.806 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T07:27:18.806 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-16T07:27:18.806 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-16T07:27:18.806 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-16T07:27:18.806 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-16T07:27:18.806 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T07:27:18.807 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T07:27:18.807 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T07:27:18.808 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T07:27:18.853 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T07:27:18.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T07:27:18.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:27:18.976 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]')] 2024-09-16T07:27:18.977 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-16T07:27:18.978 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:18.978 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:27:19.025 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:19.113 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:19.113 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264 2024-09-16T07:27:19.113 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = quincy 2024-09-16T07:27:19.113 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2024-09-16T07:27:19.113 INFO:teuthology.orchestra.run.smithi114.stdout:fsid c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2024-09-16T07:27:19.115345+0000 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:created 2024-09-16T07:27:19.115345+0000 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 17 (quincy) 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2024-09-16T07:27:19.114 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-16T07:27:19.116 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:27:19.124 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264... 2024-09-16T07:27:19.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:27:19.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:27:19.207 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-09-16T07:27:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-09-16T07:27:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:27:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-09-16T07:27:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-09-16T07:27:19.207 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:27:19.208 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:27:19.209 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-09-16T07:27:19.210 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.211 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-09-16T07:27:19.212 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-09-16T07:27:19.213 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-16T07:27:19.214 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 30 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: debug finisher = 20 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-09-16T07:27:19.215 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:27:19.216 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:27:19.217 INFO:teuthology.orchestra.run.smithi114.stdout: mon down mkfs grace = 300 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-09-16T07:27:19.218 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-09-16T07:27:19.219 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-09-16T07:27:19.219 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-09-16T07:27:19.219 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-09-16T07:27:19.219 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-09-16T07:27:19.219 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2024-09-16T07:27:19.219 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2024-09-16T07:27:19.220 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2024-09-16T07:27:19.221 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.222 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.114,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.223 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug trim objects = true 2024-09-16T07:27:19.224 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.225 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: bdev async discard = True 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: bdev enable discard = True 2024-09-16T07:27:19.226 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore allocator = bitmap 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 1/20 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 1/20 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 4/10 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2024-09-16T07:27:19.227 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 30 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: debug finisher = 20 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.228 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:27:19.229 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: mon down mkfs grace = 300 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2024-09-16T07:27:19.230 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-09-16T07:27:19.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-09-16T07:27:19.233 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T07:27:19.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T07:27:19.335 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T07:27:19.335 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:19.335 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T07:27:19.343 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:19.343 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T07:27:19.393 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:27:19.393 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:19.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:27:19.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:27:19.464 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:19.464 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:19.517 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:27:19.517 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:19.517 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:27:19.517 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:27:19.551 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:19.551 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:19.605 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T07:27:19.606 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T07:27:19.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T07:27:19.660 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T07:27:19.665 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:27:19.724 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:27:19.742 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T07:27:19.742 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T07:27:19.797 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T07:27:19.801 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-16T07:27:19.821 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T07:27:19.919 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T07:27:19.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-16T07:27:19.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T07:27:20.003 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T07:27:20.007 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-16T07:27:20.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T07:27:20.125 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T07:27:20.130 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-16T07:27:20.150 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T07:27:20.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T07:27:20.192 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T07:27:20.209 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-16T07:27:20.290 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-16T07:27:20.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T07:27:20.350 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T07:27:20.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-16T07:27:20.454 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-16T07:27:20.471 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T07:27:20.471 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T07:27:20.471 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T07:27:20.490 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:20.490 INFO:tasks.ceph:role: osd.0 2024-09-16T07:27:20.490 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:27:20.490 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:27:20.559 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:20.560 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:20.958 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-16T07:27:20.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-16T07:27:20.961 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T07:27:21.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T07:27:21.065 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:21.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:21.066 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T07:27:21.132 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:21.132 INFO:tasks.ceph:role: osd.1 2024-09-16T07:27:21.132 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:27:21.132 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:27:21.204 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:21.204 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:21.205 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:21.205 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:21.205 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:21.612 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-16T07:27:21.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-16T07:27:21.614 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T07:27:21.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T07:27:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:21.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:21.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T07:27:21.811 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:21.812 INFO:tasks.ceph:role: osd.2 2024-09-16T07:27:21.812 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:27:21.812 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T07:27:21.879 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:21.880 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:21.880 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:21.880 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:21.880 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:22.297 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-16T07:27:22.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-16T07:27:22.300 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T07:27:22.428 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T07:27:22.445 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:22.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:22.446 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T07:27:22.509 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:22.509 INFO:tasks.ceph:role: osd.3 2024-09-16T07:27:22.509 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:27:22.509 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:22.577 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:22.943 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-16T07:27:22.946 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-16T07:27:22.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-16T07:27:23.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T07:27:23.078 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:23.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:23.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:23.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:23.207+0000 7f1a8ce707c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T07:27:23.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:23.207+0000 7f1a8ce707c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T07:27:23.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:23.207+0000 7f1a8ce707c0 -1 bdev(0x55bf313a9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:23.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:23.207+0000 7f1a8ce707c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T07:27:26.428 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T07:27:26.448 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:26.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:26.539+0000 7f8d5797c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T07:27:26.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:26.539+0000 7f8d5797c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T07:27:26.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:26.539+0000 7f8d5797c7c0 -1 bdev(0x556bd0187800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:26.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:26.539+0000 7f8d5797c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T07:27:29.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T07:27:29.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:29.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:29.915+0000 7f6c9e0c17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T07:27:29.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:29.919+0000 7f6c9e0c17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T07:27:29.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:29.919+0000 7f6c9e0c17c0 -1 bdev(0x561691633800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:29.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:29.919+0000 7f6c9e0c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T07:27:33.136 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T07:27:33.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:33.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:33.247+0000 7f6bfc9da7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T07:27:33.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:33.247+0000 7f6bfc9da7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T07:27:33.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:33.247+0000 7f6bfc9da7c0 -1 bdev(0x559200a13800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:33.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:33.247+0000 7f6bfc9da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T07:27:36.738 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T07:27:36.757 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T07:27:36.779 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:36.779 INFO:tasks.ceph:role: osd.4 2024-09-16T07:27:36.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:27:36.780 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:36.850 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:37.245 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-16T07:27:37.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-16T07:27:37.248 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-16T07:27:37.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T07:27:37.356 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:37.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:37.357 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T07:27:37.421 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:37.421 INFO:tasks.ceph:role: osd.5 2024-09-16T07:27:37.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:27:37.421 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:37.490 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:37.895 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-16T07:27:37.898 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-16T07:27:37.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-16T07:27:38.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T07:27:38.033 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:38.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:38.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-16T07:27:38.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:38.097 INFO:tasks.ceph:role: osd.6 2024-09-16T07:27:38.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:27:38.097 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T07:27:38.168 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:38.168 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:38.169 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:38.169 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:38.169 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:38.169 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:38.169 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:38.169 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:38.174 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:38.174 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:38.580 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-16T07:27:38.585 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-16T07:27:38.585 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-16T07:27:38.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-16T07:27:38.719 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:38.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:38.721 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-16T07:27:38.781 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T07:27:38.781 INFO:tasks.ceph:role: osd.7 2024-09-16T07:27:38.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:27:38.781 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:27:38.848 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:27:39.213 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2024-09-16T07:27:39.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2024-09-16T07:27:39.216 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-16T07:27:39.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-16T07:27:39.349 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T07:27:39.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:27:39.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:39.476 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:39.479+0000 7f326b2957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T07:27:39.478 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:39.483+0000 7f326b2957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T07:27:39.478 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:39.483+0000 7f326b2957c0 -1 bdev(0x5644c3cf5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:39.479 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:39.483+0000 7f326b2957c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T07:27:42.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T07:27:42.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:42.816 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:42.819+0000 7f75bde267c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T07:27:42.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:42.819+0000 7f75bde267c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T07:27:42.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:42.819+0000 7f75bde267c0 -1 bdev(0x55ab109b3800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:42.817 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:42.819+0000 7f75bde267c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T07:27:46.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T07:27:46.084 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:46.176 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:46.179+0000 7f30dbd3c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-16T07:27:46.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:46.179+0000 7f30dbd3c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-16T07:27:46.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:46.179+0000 7f30dbd3c7c0 -1 bdev(0x557c8c62d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:46.177 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:46.183+0000 7f30dbd3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-16T07:27:47.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:27:47.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:27:49.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-16T07:27:49.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:49.530 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:49.535+0000 7ff0b26b47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-16T07:27:49.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:49.535+0000 7ff0b26b47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-16T07:27:49.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:49.535+0000 7ff0b26b47c0 -1 bdev(0x55fdccb07800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-16T07:27:49.531 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:49.535+0000 7ff0b26b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-16T07:27:52.732 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-16T07:27:52.752 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T07:27:52.752 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:52.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-16T07:27:52.774 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:52.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-16T07:27:52.837 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:52.837 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-16T07:27:52.901 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:52.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T07:27:52.965 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:52.965 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T07:27:53.024 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:53.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T07:27:53.088 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:53.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T07:27:53.152 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T07:27:53.174 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-16T07:27:53.237 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-16T07:27:53.301 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.302 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T07:27:53.369 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T07:27:53.433 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-16T07:27:53.497 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.497 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-16T07:27:53.560 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:53.561 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T07:27:53.569 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:53.569 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-16T07:27:53.621 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.621 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T07:27:53.630 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:53.630 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-16T07:27:53.685 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T07:27:53.685 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T07:27:53.688 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T07:27:53.733 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q== 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA== 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag== 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ== 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ== 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A== 2024-09-16T07:27:53.734 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A== 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg== 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw== 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw== 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w== 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ== 2024-09-16T07:27:53.735 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew== 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ== 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ== 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw== 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2024-09-16T07:27:53.736 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw== 2024-09-16T07:27:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2024-09-16T07:27:53.748 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q== 2024-09-16T07:27:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2024-09-16T07:27:53.748 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA== 2024-09-16T07:27:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2024-09-16T07:27:53.748 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag== 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ== 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ== 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A== 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A== 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg== 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw== 2024-09-16T07:27:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw== 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w== 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ== 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew== 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ== 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ== 2024-09-16T07:27:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2024-09-16T07:27:53.751 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw== 2024-09-16T07:27:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2024-09-16T07:27:53.751 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw== 2024-09-16T07:27:53.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:27:53.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:27:53.855 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:53.859 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:53.917 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:53.921 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:53.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:53.981 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.037 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.090 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.150 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.203 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:27:54.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:27:54.261 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:54.264 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:54.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:54.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T07:27:54.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.441 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:27:54.608 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.728 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.790 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:27:54.847 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T07:27:54.848 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T07:27:54.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:27:54.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T07:27:55.000 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-16T07:27:55.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:27:55.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-16T07:27:55.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-16T07:27:55.208 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:27:55.315 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-16T07:27:55.334 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:55.338 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:27:55.387 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T07:27:55.388 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T07:27:55.388 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T07:27:55.391 INFO:tasks.ceph.mon.a:Started 2024-09-16T07:27:55.391 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-16T07:27:55.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-16T07:27:55.428 INFO:tasks.ceph.mon.b:Started 2024-09-16T07:27:55.428 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-16T07:27:55.428 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-16T07:27:55.431 INFO:tasks.ceph.mon.c:Started 2024-09-16T07:27:55.431 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T07:27:55.431 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-16T07:27:55.432 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-16T07:27:55.435 INFO:tasks.ceph.mgr.y:Started 2024-09-16T07:27:55.435 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T07:27:55.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T07:27:55.438 INFO:tasks.ceph.mgr.x:Started 2024-09-16T07:27:55.438 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-16T07:27:55.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-16T07:27:55.441 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-16T07:27:55.441 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-16T07:27:55.492 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-16T07:27:55.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-16T07:27:55.541 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-16T07:27:55.541 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-16T07:27:55.593 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-16T07:27:55.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-16T07:27:55.644 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-16T07:27:55.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-16T07:27:55.692 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-16T07:27:55.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-16T07:27:55.741 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-16T07:27:55.742 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-16T07:27:55.797 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-16T07:27:55.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-16T07:27:55.849 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-16T07:27:55.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-16T07:27:55.905 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-16T07:27:55.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-16T07:27:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.946+0000 7f6931000640 1 -- 172.21.15.114:0/307133571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c14f770 msgr2=0x7f692c0c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.946+0000 7f6931000640 1 --2- 172.21.15.114:0/307133571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c14f770 0x7f692c0c98e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f691c01d500 tx=0x7f6910005840 comp rx=0 tx=0).stop 2024-09-16T07:27:55.949 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-16T07:27:55.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-16T07:27:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.946+0000 7f6931000640 1 -- 172.21.15.114:0/307133571 shutdown_connections 2024-09-16T07:27:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.946+0000 7f6931000640 1 --2- 172.21.15.114:0/307133571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0b4ef0 0x7f692c0b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.946+0000 7f6931000640 1 --2- 172.21.15.114:0/307133571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c0c8110 0x7f692c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.946+0000 7f6931000640 1 --2- 172.21.15.114:0/307133571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c14f770 0x7f692c0c98e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.946+0000 7f6931000640 1 -- 172.21.15.114:0/307133571 >> 172.21.15.114:0/307133571 conn(0x7f692c0b2060 msgr2=0x7f692c0d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:55.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.954+0000 7f6931000640 1 -- 172.21.15.114:0/307133571 shutdown_connections 2024-09-16T07:27:55.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.954+0000 7f6931000640 1 -- 172.21.15.114:0/307133571 wait complete. 2024-09-16T07:27:55.957 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-16T07:27:55.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-16T07:27:55.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.954+0000 7f8a21200640 1 -- 172.21.15.114:0/3227443788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 msgr2=0x7f8a1c073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:55.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.954+0000 7f8a21200640 1 --2- 172.21.15.114:0/3227443788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 0x7f8a1c073b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009900 tx=0x7f8a0c01c890 comp rx=0 tx=0).stop 2024-09-16T07:27:55.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.958+0000 7f8a21200640 1 -- 172.21.15.114:0/3227443788 shutdown_connections 2024-09-16T07:27:55.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.958+0000 7f8a21200640 1 --2- 172.21.15.114:0/3227443788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 0x7f8a1c073b20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:55.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.958+0000 7f8a21200640 1 -- 172.21.15.114:0/3227443788 >> 172.21.15.114:0/3227443788 conn(0x7f8a1c06ecd0 msgr2=0x7f8a1c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:55.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.958+0000 7f8a21200640 1 -- 172.21.15.114:0/3227443788 shutdown_connections 2024-09-16T07:27:55.964 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-16T07:27:55.964 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-16T07:27:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.958+0000 7f8a21200640 1 -- 172.21.15.114:0/3227443788 wait complete. 2024-09-16T07:27:55.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 Processor -- start 2024-09-16T07:27:55.974 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-16T07:27:55.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 -- start start 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a1c0b31c0 0x7f8a1c141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 0x7f8a1c144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a1c151160 0x7f8a1c1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c1684b0 con 0x7f8a1c151160 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c06adb0 con 0x7f8a1c150d80 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a21200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1c168630 con 0x7f8a1c0b31c0 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a1a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a1c151160 0x7f8a1c1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a1a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a1c151160 0x7f8a1c1449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56990/0 (socket says 172.21.15.114:56990) 2024-09-16T07:27:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a1a800640 1 -- 172.21.15.114:0/67178768 learned_addr learned my addr 172.21.15.114:0/67178768 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.970+0000 7f8a19400640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 0x7f8a1c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a1a800640 1 -- 172.21.15.114:0/67178768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a1c0b31c0 msgr2=0x7f8a1c141360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:27:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a1a800640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a1c0b31c0 0x7f8a1c141360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:55.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a1a800640 1 -- 172.21.15.114:0/67178768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 msgr2=0x7f8a1c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a1a800640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 0x7f8a1c144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a1a800640 1 -- 172.21.15.114:0/67178768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c1fd4d0 con 0x7f8a1c151160 2024-09-16T07:27:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a1a800640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a1c151160 0x7f8a1c1449d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c7a0 tx=0x7f8a1400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14003b80 con 0x7f8a1c151160 2024-09-16T07:27:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f8a14003e10 con 0x7f8a1c151160 2024-09-16T07:27:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400aa90 con 0x7f8a1c151160 2024-09-16T07:27:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a21200640 1 -- 172.21.15.114:0/67178768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1c141b50 con 0x7f8a1c151160 2024-09-16T07:27:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.974+0000 7f8a21200640 1 -- 172.21.15.114:0/67178768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1c142110 con 0x7f8a1c151160 2024-09-16T07:27:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.978+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a1400ac30 con 0x7f8a1c151160 2024-09-16T07:27:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.978+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a14012a10 con 0x7f8a1c151160 2024-09-16T07:27:55.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.978+0000 7f8a21200640 1 -- 172.21.15.114:0/67178768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1c142310 con 0x7f8a1c151160 2024-09-16T07:27:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:55.982+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8a1c142310 con 0x7f8a1c151160 2024-09-16T07:27:55.990 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-16T07:27:55.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-16T07:27:56.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.018+0000 7f184f200640 1 -- 172.21.15.114:0/3669716034 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1820005320 con 0x7f18480ddf90 2024-09-16T07:27:56.026 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-16T07:27:56.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-16T07:27:56.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.026+0000 7f1846000640 1 -- 172.21.15.114:0/3669716034 <== mon.2 v2:172.21.15.149:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1840023b90 con 0x7f18480ddf90 2024-09-16T07:27:56.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.026+0000 7f1846000640 1 -- 172.21.15.114:0/3669716034 <== mon.2 v2:172.21.15.149:3301/0 12 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f1840024430 con 0x7f18480ddf90 2024-09-16T07:27:56.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.026+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a14012c10 con 0x7f8a1c151160 2024-09-16T07:27:56.036 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-16T07:27:56.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.030+0000 7f184f200640 1 -- 172.21.15.114:0/3669716034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18480ddf90 msgr2=0x7f184816f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.030+0000 7f184f200640 1 --2- 172.21.15.114:0/3669716034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18480ddf90 0x7f184816f170 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1840003f30 tx=0x7f184000ba80 comp rx=0 tx=0).stop 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.030+0000 7f184f200640 1 -- 172.21.15.114:0/3669716034 shutdown_connections 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.030+0000 7f184f200640 1 --2- 172.21.15.114:0/3669716034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18480da450 0x7f184816f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.030+0000 7f184f200640 1 --2- 172.21.15.114:0/3669716034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18480ddf90 0x7f184816f170 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.030+0000 7f184f200640 1 --2- 172.21.15.114:0/3669716034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1834003ab0 0x7f18480e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.030+0000 7f184f200640 1 -- 172.21.15.114:0/3669716034 >> 172.21.15.114:0/3669716034 conn(0x7f184803a3e0 msgr2=0x7f18480e5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.034+0000 7f184f200640 1 -- 172.21.15.114:0/3669716034 shutdown_connections 2024-09-16T07:27:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.034+0000 7f184f200640 1 -- 172.21.15.114:0/3669716034 wait complete. 2024-09-16T07:27:56.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.042+0000 7f60fd000640 1 -- 172.21.15.114:0/3807877928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815e9f0 msgr2=0x7f60f80ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.042+0000 7f60fd000640 1 --2- 172.21.15.114:0/3807877928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815e9f0 0x7f60f80ca050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009870 tx=0x7f60f001c860 comp rx=0 tx=0).stop 2024-09-16T07:27:56.050 DEBUG:tasks.ceph:set 18 configs 2024-09-16T07:27:56.050 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.050 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.050 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.051 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.051 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.050+0000 7f60fd000640 1 -- 172.21.15.114:0/3807877928 shutdown_connections 2024-09-16T07:27:56.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.050+0000 7f60fd000640 1 --2- 172.21.15.114:0/3807877928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815e9f0 0x7f60f80ca050 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.050+0000 7f60fd000640 1 -- 172.21.15.114:0/3807877928 >> 172.21.15.114:0/3807877928 conn(0x7f60f80cfa00 msgr2=0x7f60f80cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.054+0000 7f60fd000640 1 -- 172.21.15.114:0/3807877928 shutdown_connections 2024-09-16T07:27:56.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.054+0000 7f60fd000640 1 -- 172.21.15.114:0/3807877928 wait complete. 2024-09-16T07:27:56.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.054+0000 7f60fd000640 1 Processor -- start 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.058+0000 7f60fd000640 1 -- start start 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60fd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f815e9f0 0x7f60f8149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f815e9f0 0x7f60f8149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f815e9f0 0x7f60f8149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57004/0 (socket says 172.21.15.114:57004) 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f7400640 1 -- 172.21.15.114:0/1947191263 learned_addr learned my addr 172.21.15.114:0/1947191263 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60fd000640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60f815edd0 0x7f60f80b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60fd000640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815f1f0 0x7f60f8073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f60f816c4d0 con 0x7f60f815e9f0 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60f816c350 con 0x7f60f815edd0 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60f816c650 con 0x7f60f815f1f0 2024-09-16T07:27:56.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f6a00640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60f815edd0 0x7f60f80b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f7e00640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815f1f0 0x7f60f8073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f6a00640 1 -- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815f1f0 msgr2=0x7f60f8073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f6a00640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815f1f0 0x7f60f8073330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f6a00640 1 -- 172.21.15.114:0/1947191263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f815e9f0 msgr2=0x7f60f8149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f6a00640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f815e9f0 0x7f60f8149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f6a00640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f815cae0 con 0x7f60f815edd0 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f7e00640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815f1f0 0x7f60f8073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:56.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.062+0000 7f60f6a00640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60f815edd0 0x7f60f80b0d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009fd0 tx=0x7f60e000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.066+0000 7f60ef400640 1 -- 172.21.15.114:0/1947191263 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0015020 con 0x7f60f815edd0 2024-09-16T07:27:56.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.066+0000 7f60ef400640 1 -- 172.21.15.114:0/1947191263 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60e0011920 con 0x7f60f815edd0 2024-09-16T07:27:56.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.066+0000 7f60ef400640 1 -- 172.21.15.114:0/1947191263 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0011d50 con 0x7f60f815edd0 2024-09-16T07:27:56.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.066+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f815f710 con 0x7f60f815edd0 2024-09-16T07:27:56.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.066+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f8157da0 con 0x7f60f815edd0 2024-09-16T07:27:56.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.066+0000 7f60ef400640 1 -- 172.21.15.114:0/1947191263 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60e0018020 con 0x7f60f815edd0 2024-09-16T07:27:56.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.066+0000 7f60ef400640 1 -- 172.21.15.114:0/1947191263 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f60e0019a20 con 0x7f60f815edd0 2024-09-16T07:27:56.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.070+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f80ca050 con 0x7f60f815edd0 2024-09-16T07:27:56.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.070+0000 7f60ef400640 1 -- 172.21.15.114:0/1947191263 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f60e00193b0 con 0x7f60f815edd0 2024-09-16T07:27:56.114 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.222+0000 7f8a21200640 1 -- 172.21.15.114:0/67178768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f8a1c073b20 con 0x7f8a1c151160 2024-09-16T07:27:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.222+0000 7f8641000640 1 -- 172.21.15.114:0/1901791640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 msgr2=0x7f863c0cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.222+0000 7f8641000640 1 --2- 172.21.15.114:0/1901791640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 0x7f863c0cf430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f862c009900 tx=0x7f862c01c790 comp rx=0 tx=0).stop 2024-09-16T07:27:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.222+0000 7f8641000640 1 -- 172.21.15.114:0/1901791640 shutdown_connections 2024-09-16T07:27:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.222+0000 7f8641000640 1 --2- 172.21.15.114:0/1901791640 >> v2:172.21.15.114:3300/0 conn(0x7f863c0cd5d0 0x7f863c073e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.222+0000 7f8641000640 1 --2- 172.21.15.114:0/1901791640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 0x7f863c0cf430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.222+0000 7f8641000640 1 -- 172.21.15.114:0/1901791640 >> 172.21.15.114:0/1901791640 conn(0x7f863c0cfa00 msgr2=0x7f863c0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.226+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f60f80d0630 con 0x7f60f815edd0 2024-09-16T07:27:56.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.230+0000 7f8641000640 1 -- 172.21.15.114:0/1901791640 shutdown_connections 2024-09-16T07:27:56.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.230+0000 7f8a12000640 1 -- 172.21.15.114:0/67178768 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f8a14012dc0 con 0x7f8a1c151160 2024-09-16T07:27:56.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.234+0000 7f8641000640 1 -- 172.21.15.114:0/1901791640 wait complete. 2024-09-16T07:27:56.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.242+0000 7f8a07400640 1 -- 172.21.15.114:0/67178768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a1c151160 msgr2=0x7f8a1c1449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.242+0000 7f8a07400640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a1c151160 0x7f8a1c1449d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c7a0 tx=0x7f8a1400cc60 comp rx=0 tx=0).stop 2024-09-16T07:27:56.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8a07400640 1 -- 172.21.15.114:0/67178768 shutdown_connections 2024-09-16T07:27:56.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8a07400640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a1c151160 0x7f8a1c1449d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8a07400640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1c150d80 0x7f8a1c144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8a07400640 1 --2- 172.21.15.114:0/67178768 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a1c0b31c0 0x7f8a1c141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8a07400640 1 -- 172.21.15.114:0/67178768 >> 172.21.15.114:0/67178768 conn(0x7f8a1c06ecd0 msgr2=0x7f8a1c153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8641000640 1 Processor -- start 2024-09-16T07:27:56.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8a07400640 1 -- 172.21.15.114:0/67178768 shutdown_connections 2024-09-16T07:27:56.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8a07400640 1 -- 172.21.15.114:0/67178768 wait complete. 2024-09-16T07:27:56.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8641000640 1 -- start start 2024-09-16T07:27:56.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8641000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0cd5d0 0x7f863c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f8641000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c0cd9f0 0x7f863c0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f863b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0cd5d0 0x7f863c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.246+0000 7f863b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0cd5d0 0x7f863c153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57024/0 (socket says 172.21.15.114:57024) 2024-09-16T07:27:56.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863b400640 1 -- 172.21.15.114:0/3485805502 learned_addr learned my addr 172.21.15.114:0/3485805502 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f8641000640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 0x7f863c0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863aa00640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c0cd9f0 0x7f863c0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f863c074700 con 0x7f863c0cd5d0 2024-09-16T07:27:56.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f863c074580 con 0x7f863c0cd9f0 2024-09-16T07:27:56.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f60ef400640 1 -- 172.21.15.114:0/1947191263 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f60e0019c70 con 0x7f60f815edd0 2024-09-16T07:27:56.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863be00640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 0x7f863c0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f863c15f1a0 con 0x7f863c15e300 2024-09-16T07:27:56.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863aa00640 1 -- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 msgr2=0x7f863c0c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863aa00640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 0x7f863c0c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863aa00640 1 -- 172.21.15.114:0/3485805502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0cd5d0 msgr2=0x7f863c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863aa00640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0cd5d0 0x7f863c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863aa00640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c154410 con 0x7f863c0cd9f0 2024-09-16T07:27:56.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.250+0000 7f863aa00640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c0cd9f0 0x7f863c0c7150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f862800c940 tx=0x7f862800ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.258+0000 7f8633400640 1 -- 172.21.15.114:0/3485805502 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628007bb0 con 0x7f863c0cd9f0 2024-09-16T07:27:56.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.258+0000 7f8633400640 1 -- 172.21.15.114:0/3485805502 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8628007e40 con 0x7f863c0cd9f0 2024-09-16T07:27:56.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.258+0000 7f8633400640 1 -- 172.21.15.114:0/3485805502 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862800f6b0 con 0x7f863c0cd9f0 2024-09-16T07:27:56.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.258+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c1f4f30 con 0x7f863c0cd9f0 2024-09-16T07:27:56.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.258+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c1f54f0 con 0x7f863c0cd9f0 2024-09-16T07:27:56.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.258+0000 7f8633400640 1 -- 172.21.15.114:0/3485805502 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f862800f850 con 0x7f863c0cd9f0 2024-09-16T07:27:56.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.258+0000 7f8633400640 1 -- 172.21.15.114:0/3485805502 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f86280213f0 con 0x7f863c0cd9f0 2024-09-16T07:27:56.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863c15f730 con 0x7f863c0cd9f0 2024-09-16T07:27:56.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60f815edd0 msgr2=0x7f60f80b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60f815edd0 0x7f60f80b0d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009fd0 tx=0x7f60e000b870 comp rx=0 tx=0).stop 2024-09-16T07:27:56.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 shutdown_connections 2024-09-16T07:27:56.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60f815f1f0 0x7f60f8073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60f815edd0 0x7f60f80b0d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 --2- 172.21.15.114:0/1947191263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60f815e9f0 0x7f60f8149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 >> 172.21.15.114:0/1947191263 conn(0x7f60f80cfa00 msgr2=0x7f60f815c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 shutdown_connections 2024-09-16T07:27:56.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f60fd000640 1 -- 172.21.15.114:0/1947191263 wait complete. 2024-09-16T07:27:56.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.262+0000 7f8633400640 1 -- 172.21.15.114:0/3485805502 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8628026020 con 0x7f863c0cd9f0 2024-09-16T07:27:56.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.294+0000 7f17ad000640 1 -- 172.21.15.114:0/4191794523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f178c004810 msgr2=0x7f178c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.294+0000 7f17ad000640 1 --2- 172.21.15.114:0/4191794523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f178c004810 0x7f178c004c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f17a80cf6c0 tx=0x7f17a001d450 comp rx=0 tx=0).stop 2024-09-16T07:27:56.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.298+0000 7f17a7e00640 1 -- 172.21.15.114:0/4191794523 reap_dead start 2024-09-16T07:27:56.302 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.298+0000 7f17ad000640 1 -- 172.21.15.114:0/4191794523 shutdown_connections 2024-09-16T07:27:56.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.298+0000 7f17ad000640 1 -- 172.21.15.114:0/4191794523 >> 172.21.15.114:0/4191794523 conn(0x7f17a80cfa00 msgr2=0x7f17a80cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.302+0000 7f17ad000640 1 -- 172.21.15.114:0/4191794523 shutdown_connections 2024-09-16T07:27:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.302+0000 7f17ad000640 1 -- 172.21.15.114:0/4191794523 wait complete. 2024-09-16T07:27:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.302+0000 7f17ad000640 1 Processor -- start 2024-09-16T07:27:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.306+0000 7f17ad000640 1 -- start start 2024-09-16T07:27:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f7ca2a00640 1 -- 172.21.15.114:0/485930425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0cb140 msgr2=0x7f7c9c0ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f7ca2a00640 1 --2- 172.21.15.114:0/485930425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0cb140 0x7f7c9c0ca080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009900 tx=0x7f7c8801c8d0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17ad000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f178c004810 0x7f17a81efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17ad000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a81f10d0 0x7f17a815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17ad000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a815cb70 0x7f17a81588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17ad000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17a80ae080 con 0x7f17a81f10d0 2024-09-16T07:27:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17ad000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f17a80cd890 con 0x7f178c004810 2024-09-16T07:27:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17ad000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f17a80ae200 con 0x7f17a815cb70 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a81f10d0 0x7f17a815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a81f10d0 0x7f17a815c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57066/0 (socket says 172.21.15.114:57066) 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 -- 172.21.15.114:0/1702333454 learned_addr learned my addr 172.21.15.114:0/1702333454 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a7e00640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a815cb70 0x7f17a81588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 -- 172.21.15.114:0/1702333454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a815cb70 msgr2=0x7f17a81588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a815cb70 0x7f17a81588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 -- 172.21.15.114:0/1702333454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f178c004810 msgr2=0x7f17a81efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f178c004810 0x7f17a81efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 -- 172.21.15.114:0/1702333454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a81f0280 con 0x7f17a81f10d0 2024-09-16T07:27:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.314+0000 7f17a6a00640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a81f10d0 0x7f17a815c630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f17a001d280 tx=0x7f17a00ab980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f7ca2a00640 1 -- 172.21.15.114:0/485930425 shutdown_connections 2024-09-16T07:27:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f7ca2a00640 1 --2- 172.21.15.114:0/485930425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0ca5c0 0x7f7c9c06f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f7ca2a00640 1 --2- 172.21.15.114:0/485930425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0cb140 0x7f7c9c0ca080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f7ca2a00640 1 -- 172.21.15.114:0/485930425 >> 172.21.15.114:0/485930425 conn(0x7f7c9c0b1600 msgr2=0x7f7c9c0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f179f400640 1 -- 172.21.15.114:0/1702333454 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a00abb70 con 0x7f17a81f10d0 2024-09-16T07:27:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f179f400640 1 -- 172.21.15.114:0/1702333454 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17a00abe00 con 0x7f17a81f10d0 2024-09-16T07:27:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f179f400640 1 -- 172.21.15.114:0/1702333454 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a00bf6e0 con 0x7f17a81f10d0 2024-09-16T07:27:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f7ca2a00640 1 -- 172.21.15.114:0/485930425 shutdown_connections 2024-09-16T07:27:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.318+0000 7f7ca2a00640 1 -- 172.21.15.114:0/485930425 wait complete. 2024-09-16T07:27:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.322+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a80c86b0 con 0x7f17a81f10d0 2024-09-16T07:27:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.322+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a80c6ee0 con 0x7f17a81f10d0 2024-09-16T07:27:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.322+0000 7f179f400640 1 -- 172.21.15.114:0/1702333454 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f17a00bfc10 con 0x7f17a81f10d0 2024-09-16T07:27:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.322+0000 7f179f400640 1 -- 172.21.15.114:0/1702333454 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f17a00b6de0 con 0x7f17a81f10d0 2024-09-16T07:27:56.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.322+0000 7f7ca2a00640 1 Processor -- start 2024-09-16T07:27:56.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca2a00640 1 -- start start 2024-09-16T07:27:56.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c9c072c80 0x7f7c9c154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0ca5c0 0x7f7c9c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0cb140 0x7f7c9c15ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7c9b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0ca5c0 0x7f7c9c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca2a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c167ea0 con 0x7f7c9c0ca5c0 2024-09-16T07:27:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca2a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c167d20 con 0x7f7c9c072c80 2024-09-16T07:27:56.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a8074af0 con 0x7f17a81f10d0 2024-09-16T07:27:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.330+0000 7f179f400640 1 -- 172.21.15.114:0/1702333454 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f17a00c4060 con 0x7f17a81f10d0 2024-09-16T07:27:56.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca2a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c168020 con 0x7f7c9c0cb140 2024-09-16T07:27:56.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0cb140 0x7f7c9c15ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0cb140 0x7f7c9c15ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:59978/0 (socket says 172.21.15.114:59978) 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca0a00640 1 -- 172.21.15.114:0/3320109654 learned_addr learned my addr 172.21.15.114:0/3320109654 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7c9be00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c9c072c80 0x7f7c9c154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca0a00640 1 -- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c9c072c80 msgr2=0x7f7c9c154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca0a00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c9c072c80 0x7f7c9c154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7ca0a00640 1 -- 172.21.15.114:0/3320109654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0ca5c0 msgr2=0x7f7c9c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.326+0000 7f7c9b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0ca5c0 0x7f7c9c15c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57072/0 (socket says 172.21.15.114:57072) 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7ca0a00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0ca5c0 0x7f7c9c15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7ca0a00640 1 -- 172.21.15.114:0/3320109654 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c0b5550 con 0x7f7c9c0cb140 2024-09-16T07:27:56.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7c9b400640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0ca5c0 0x7f7c9c15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:27:56.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7ca0a00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0cb140 0x7f7c9c15ce50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00c440 tx=0x7f7c8c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7c93e00640 1 -- 172.21.15.114:0/3320109654 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c017070 con 0x7f7c9c0cb140 2024-09-16T07:27:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7c93e00640 1 -- 172.21.15.114:0/3320109654 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c8c003600 con 0x7f7c9c0cb140 2024-09-16T07:27:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7c93e00640 1 -- 172.21.15.114:0/3320109654 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c003a50 con 0x7f7c9c0cb140 2024-09-16T07:27:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c0c6890 con 0x7f7c9c0cb140 2024-09-16T07:27:56.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.334+0000 7f7c93e00640 1 -- 172.21.15.114:0/3320109654 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c8c003bf0 con 0x7f7c9c0cb140 2024-09-16T07:27:56.341 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.342+0000 7fa0a2000640 1 -- 172.21.15.114:0/927784167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c0ae4d0 msgr2=0x7fa09c0ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.342+0000 7fa0a2000640 1 --2- 172.21.15.114:0/927784167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c0ae4d0 0x7fa09c0ae960 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa094009900 tx=0x7fa09401c900 comp rx=0 tx=0).stop 2024-09-16T07:27:56.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.346+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c0c65b0 con 0x7f7c9c0cb140 2024-09-16T07:27:56.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.346+0000 7f7c93e00640 1 -- 172.21.15.114:0/3320109654 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c8c0067a0 con 0x7f7c9c0cb140 2024-09-16T07:27:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.350+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c155190 con 0x7f7c9c0cb140 2024-09-16T07:27:56.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.350+0000 7fa0a2000640 1 -- 172.21.15.114:0/927784167 shutdown_connections 2024-09-16T07:27:56.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.350+0000 7fa0a2000640 1 --2- 172.21.15.114:0/927784167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c0ae4d0 0x7fa09c0ae960 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.350+0000 7fa0a2000640 1 --2- 172.21.15.114:0/927784167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0cd5d0 0x7fa09c0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.350+0000 7fa0a2000640 1 -- 172.21.15.114:0/927784167 >> 172.21.15.114:0/927784167 conn(0x7fa09c0cfa00 msgr2=0x7fa09c0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.350+0000 7fa0a2000640 1 -- 172.21.15.114:0/927784167 shutdown_connections 2024-09-16T07:27:56.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.350+0000 7fa0a2000640 1 -- 172.21.15.114:0/927784167 wait complete. 2024-09-16T07:27:56.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.358+0000 7f7c93e00640 1 -- 172.21.15.114:0/3320109654 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7c8c021020 con 0x7f7c9c0cb140 2024-09-16T07:27:56.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.362+0000 7fa0a2000640 1 Processor -- start 2024-09-16T07:27:56.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.366+0000 7fa0a2000640 1 -- start start 2024-09-16T07:27:56.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cb6c00640 1 -- 172.21.15.114:0/1567380445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c98004810 msgr2=0x7f9c98004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cafe00640 1 -- 172.21.15.114:0/1567380445 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c006bc0 con 0x7f9c98004810 2024-09-16T07:27:56.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cb6c00640 1 --2- 172.21.15.114:0/1567380445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c98004810 0x7f9c98004c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c006fa0 tx=0x7f9c9c01cf40 comp rx=0 tx=0).stop 2024-09-16T07:27:56.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cb6c00640 1 -- 172.21.15.114:0/1567380445 shutdown_connections 2024-09-16T07:27:56.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cb6c00640 1 --2- 172.21.15.114:0/1567380445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c98004810 0x7f9c98004c90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cb6c00640 1 -- 172.21.15.114:0/1567380445 >> 172.21.15.114:0/1567380445 conn(0x7f9cb009d0c0 msgr2=0x7f9cb00d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cb6c00640 1 -- 172.21.15.114:0/1567380445 shutdown_connections 2024-09-16T07:27:56.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.370+0000 7f9cb6c00640 1 -- 172.21.15.114:0/1567380445 wait complete. 2024-09-16T07:27:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 Processor -- start 2024-09-16T07:27:56.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 -- start start 2024-09-16T07:27:56.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 -- 172.21.15.114:0/3449878412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440aecd0 msgr2=0x7fe14406f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 --2- 172.21.15.114:0/3449878412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440aecd0 0x7fe14406f410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00afd0 tx=0x7fe13c01d460 comp rx=0 tx=0).stop 2024-09-16T07:27:56.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 -- 172.21.15.114:0/3449878412 shutdown_connections 2024-09-16T07:27:56.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 --2- 172.21.15.114:0/3449878412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440aecd0 0x7fe14406f410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 --2- 172.21.15.114:0/3449878412 >> v2:172.21.15.114:3300/0 conn(0x7fe1440cd5d0 0x7fe144072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 -- 172.21.15.114:0/3449878412 >> 172.21.15.114:0/3449878412 conn(0x7fe1440cfa00 msgr2=0x7fe1440cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 -- 172.21.15.114:0/3449878412 shutdown_connections 2024-09-16T07:27:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0ae4d0 0x7fa09c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa09c0cd5d0 0x7fa09c14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c15eeb0 0x7fa09c0b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0ae4d0 0x7fa09c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0ae4d0 0x7fa09c14d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:60030/0 (socket says 172.21.15.114:60030) 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a2000640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c16fa20 con 0x7fa09c0cd5d0 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a0c00640 1 -- 172.21.15.114:0/3458772227 learned_addr learned my addr 172.21.15.114:0/3458772227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a2000640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c16f8a0 con 0x7fa09c15eeb0 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a2000640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa09c16fba0 con 0x7fa09c0ae4d0 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa09be00640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa09c0cd5d0 0x7fa09c14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a1600640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c15eeb0 0x7fa09c0b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a1600640 1 -- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0ae4d0 msgr2=0x7fa09c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a1600640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0ae4d0 0x7fa09c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a1600640 1 -- 172.21.15.114:0/3458772227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa09c0cd5d0 msgr2=0x7fa09c14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a1600640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa09c0cd5d0 0x7fa09c14cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a1600640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c0b2890 con 0x7fa09c15eeb0 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c98004810 0x7f9cb0153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb0155e50 0x7f9cb01530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb016d950 0x7f9cb016ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb015de70 con 0x7f9cb0155e50 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb015dcf0 con 0x7f9cb016d950 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb015dff0 con 0x7f9c98004810 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c98004810 0x7f9cb0153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c98004810 0x7f9cb0153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:60046/0 (socket says 172.21.15.114:60046) 2024-09-16T07:27:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb5800640 1 -- 172.21.15.114:0/1267802054 learned_addr learned my addr 172.21.15.114:0/1267802054 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa09be00640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa09c0cd5d0 0x7fa09c14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:56.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fa0a0c00640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0ae4d0 0x7fa09c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:27:56.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fa0a1600640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c15eeb0 0x7fa09c0b4870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0940ac000 tx=0x7fa0940a5810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7f9cb6200640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb016d950 0x7f9cb016ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fb232e00640 1 -- 172.21.15.114:0/2223525896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2140053d0 msgr2=0x7fb21400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fb232e00640 1 --2- 172.21.15.114:0/2223525896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2140053d0 0x7fb21400b9d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb21800c2e0 tx=0x7fb21801f7b0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fa098c00640 1 -- 172.21.15.114:0/3458772227 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0940043c0 con 0x7fa09c15eeb0 2024-09-16T07:27:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fa098c00640 1 -- 172.21.15.114:0/3458772227 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0940c3040 con 0x7fa09c15eeb0 2024-09-16T07:27:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fa098c00640 1 -- 172.21.15.114:0/3458772227 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094005270 con 0x7fa09c15eeb0 2024-09-16T07:27:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fa0a2000640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c0c8b90 con 0x7fa09c15eeb0 2024-09-16T07:27:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fa0a2000640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c0b2b50 con 0x7fa09c15eeb0 2024-09-16T07:27:56.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6200640 1 -- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c98004810 msgr2=0x7f9cb0153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6200640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c98004810 0x7f9cb0153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6200640 1 -- 172.21.15.114:0/1267802054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb0155e50 msgr2=0x7f9cb01530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6200640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb0155e50 0x7f9cb01530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6200640 1 -- 172.21.15.114:0/1267802054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb00cbd50 con 0x7f9cb016d950 2024-09-16T07:27:56.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb5800640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c98004810 0x7f9cb0153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6200640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb016d950 0x7f9cb016ddd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0074320 tx=0x7f9ca400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cad600640 1 -- 172.21.15.114:0/1267802054 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4005480 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cad600640 1 -- 172.21.15.114:0/1267802054 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ca4003600 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cad600640 1 -- 172.21.15.114:0/1267802054 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4003a50 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6c00640 1 -- 172.21.15.114:0/1267802054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb016cb90 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cb6c00640 1 -- 172.21.15.114:0/1267802054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb016d150 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cad600640 1 -- 172.21.15.114:0/1267802054 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ca4011070 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7f9cad600640 1 -- 172.21.15.114:0/1267802054 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9ca401d730 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7f9ca2a00640 1 -- 172.21.15.114:0/1267802054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb015e4e0 con 0x7f9cb016d950 2024-09-16T07:27:56.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.374+0000 7fe149c00640 1 -- 172.21.15.114:0/3449878412 wait complete. 2024-09-16T07:27:56.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.378+0000 7fe149c00640 1 Processor -- start 2024-09-16T07:27:56.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fb232e00640 1 -- 172.21.15.114:0/2223525896 shutdown_connections 2024-09-16T07:27:56.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fb232e00640 1 --2- 172.21.15.114:0/2223525896 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2140053d0 0x7fb21400b9d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fb232e00640 1 -- 172.21.15.114:0/2223525896 >> 172.21.15.114:0/2223525896 conn(0x7fb2240545a0 msgr2=0x7fb2240549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fb232e00640 1 -- 172.21.15.114:0/2223525896 shutdown_connections 2024-09-16T07:27:56.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fb232e00640 1 -- 172.21.15.114:0/2223525896 wait complete. 2024-09-16T07:27:56.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fa092000640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c0ae960 con 0x7fa09c15eeb0 2024-09-16T07:27:56.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fe149c00640 1 -- start start 2024-09-16T07:27:56.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fa098c00640 1 -- 172.21.15.114:0/3458772227 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0940cf070 con 0x7fa09c15eeb0 2024-09-16T07:27:56.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.382+0000 7fa098c00640 1 -- 172.21.15.114:0/3458772227 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa094004a30 con 0x7fa09c15eeb0 2024-09-16T07:27:56.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7f9cad600640 1 -- 172.21.15.114:0/1267802054 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9cb00b5620 con 0x7f9cb016d950 2024-09-16T07:27:56.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1440aecd0 0x7fe1440b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fb232e00640 1 Processor -- start 2024-09-16T07:27:56.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440ca050 0x7fe14415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1440cd5d0 0x7fe1440c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fa098c00640 1 -- 172.21.15.114:0/3458772227 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa0940164f0 con 0x7fa09c15eeb0 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1440cd5d0 0x7fe1440c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1440cd5d0 0x7fe1440c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:38648/0 (socket says 172.21.15.114:38648) 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149200640 1 -- 172.21.15.114:0/3227289796 learned_addr learned my addr 172.21.15.114:0/3227289796 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149c00640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe144169520 con 0x7fe1440aecd0 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe143400640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440ca050 0x7fe14415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149c00640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1441693a0 con 0x7fe1440cd5d0 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe143e00640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1440aecd0 0x7fe1440b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.386+0000 7fe149c00640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1441696a0 con 0x7fe1440ca050 2024-09-16T07:27:56.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fe149200640 1 -- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440ca050 msgr2=0x7fe14415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fe149200640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440ca050 0x7fe14415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fe149200640 1 -- 172.21.15.114:0/3227289796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1440aecd0 msgr2=0x7fe1440b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fe149200640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1440aecd0 0x7fe1440b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fe149200640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1440c7a20 con 0x7fe1440cd5d0 2024-09-16T07:27:56.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fe149200640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1440cd5d0 0x7fe1440c74e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007320 tx=0x7fe13c003830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 -- 172.21.15.114:0/2477320639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772015eeb0 msgr2=0x7f77200cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 --2- 172.21.15.114:0/2477320639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772015eeb0 0x7f77200cd9b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77200c3330 tx=0x7f771001c900 comp rx=0 tx=0).stop 2024-09-16T07:27:56.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fe143400640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440ca050 0x7fe14415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:27:56.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 -- 172.21.15.114:0/2477320639 shutdown_connections 2024-09-16T07:27:56.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 --2- 172.21.15.114:0/2477320639 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200ae4d0 0x7f77200ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 --2- 172.21.15.114:0/2477320639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772015eeb0 0x7f77200cd9b0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77200c3330 tx=0x7f771001c900 comp rx=0 tx=0).stop 2024-09-16T07:27:56.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 --2- 172.21.15.114:0/2477320639 >> v2:172.21.15.114:3300/0 conn(0x7f77200cd5d0 0x7f77200ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 -- 172.21.15.114:0/2477320639 >> 172.21.15.114:0/2477320639 conn(0x7f77200cfa00 msgr2=0x7f77200cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb232e00640 1 -- start start 2024-09-16T07:27:56.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb232e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140053d0 0x7fb22417e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb232e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb224050f60 0x7fb2240513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb232e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb224028a50 0x7fb224028ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 -- 172.21.15.114:0/2477320639 shutdown_connections 2024-09-16T07:27:56.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7f7725800640 1 -- 172.21.15.114:0/2477320639 wait complete. 2024-09-16T07:27:56.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb22b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb224050f60 0x7fb2240513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb22b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb224050f60 0x7fb2240513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:60072/0 (socket says 172.21.15.114:60072) 2024-09-16T07:27:56.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb22be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140053d0 0x7fb22417e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb22be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140053d0 0x7fb22417e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57144/0 (socket says 172.21.15.114:57144) 2024-09-16T07:27:56.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.390+0000 7fb22b400640 1 -- 172.21.15.114:0/2288999991 learned_addr learned my addr 172.21.15.114:0/2288999991 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb232e00640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb22401d5e0 con 0x7fb2140053d0 2024-09-16T07:27:56.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fe13be00640 1 -- 172.21.15.114:0/3227289796 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c0b1070 con 0x7fe1440cd5d0 2024-09-16T07:27:56.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fe13be00640 1 -- 172.21.15.114:0/3227289796 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe13c005030 con 0x7fe1440cd5d0 2024-09-16T07:27:56.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fe13be00640 1 -- 172.21.15.114:0/3227289796 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c005440 con 0x7fe1440cd5d0 2024-09-16T07:27:56.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fe149c00640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1440c7cc0 con 0x7fe1440cd5d0 2024-09-16T07:27:56.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fe149c00640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1440c8280 con 0x7fe1440cd5d0 2024-09-16T07:27:56.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb232e00640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb22401d460 con 0x7fb224028a50 2024-09-16T07:27:56.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb232e00640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb22401d760 con 0x7fb224050f60 2024-09-16T07:27:56.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb230e00640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb224028a50 0x7fb224028ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb230e00640 1 -- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb224050f60 msgr2=0x7fb2240513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb230e00640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb224050f60 0x7fb2240513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb230e00640 1 -- 172.21.15.114:0/2288999991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140053d0 msgr2=0x7fb22417e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb230e00640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140053d0 0x7fb22417e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb230e00640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2240520e0 con 0x7fb224028a50 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb230e00640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb224028a50 0x7fb224028ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb22400b150 tx=0x7fb218001cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb21fe00640 1 -- 172.21.15.114:0/2288999991 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218006080 con 0x7fb224028a50 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb21fe00640 1 -- 172.21.15.114:0/2288999991 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb218006420 con 0x7fb224028a50 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb21fe00640 1 -- 172.21.15.114:0/2288999991 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218003860 con 0x7fb224028a50 2024-09-16T07:27:56.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb232e00640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2241809a0 con 0x7fb224028a50 2024-09-16T07:27:56.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.394+0000 7fb232e00640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb224052380 con 0x7fb224028a50 2024-09-16T07:27:56.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.398+0000 7fe13be00640 1 -- 172.21.15.114:0/3227289796 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe13c0b5030 con 0x7fe1440cd5d0 2024-09-16T07:27:56.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.398+0000 7fe13be00640 1 -- 172.21.15.114:0/3227289796 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe13c00a410 con 0x7fe1440cd5d0 2024-09-16T07:27:56.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.398+0000 7fb21fe00640 1 -- 172.21.15.114:0/2288999991 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb2180b6040 con 0x7fb224028a50 2024-09-16T07:27:56.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.398+0000 7fb21fe00640 1 -- 172.21.15.114:0/2288999991 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb2180b9770 con 0x7fb224028a50 2024-09-16T07:27:56.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.398+0000 7fe139600640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1440b0600 con 0x7fe1440cd5d0 2024-09-16T07:27:56.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.398+0000 7fb21d600640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2240361e0 con 0x7fb224028a50 2024-09-16T07:27:56.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.398+0000 7f7725800640 1 Processor -- start 2024-09-16T07:27:56.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.402+0000 7fb21fe00640 1 -- 172.21.15.114:0/2288999991 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb2180d8860 con 0x7fb224028a50 2024-09-16T07:27:56.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.406+0000 7fe13be00640 1 -- 172.21.15.114:0/3227289796 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe13c0170e0 con 0x7fe1440cd5d0 2024-09-16T07:27:56.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7725800640 1 -- start start 2024-09-16T07:27:56.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7725800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77200ae4d0 0x7f7720074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7725800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200cd5d0 0x7f772014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7725800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772014bc40 0x7f772016c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7725800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7720154770 con 0x7f77200ae4d0 2024-09-16T07:27:56.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7725800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f77201545f0 con 0x7f772014bc40 2024-09-16T07:27:56.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7725800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f77201548f0 con 0x7f77200cd5d0 2024-09-16T07:27:56.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200cd5d0 0x7f772014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200cd5d0 0x7f772014b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:60074/0 (socket says 172.21.15.114:60074) 2024-09-16T07:27:56.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 -- 172.21.15.114:0/2267629727 learned_addr learned my addr 172.21.15.114:0/2267629727 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f7724e00640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772014bc40 0x7f772016c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 -- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772014bc40 msgr2=0x7f772016c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772014bc40 0x7f772016c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 -- 172.21.15.114:0/2267629727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77200ae4d0 msgr2=0x7f7720074140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77200ae4d0 0x7f7720074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 -- 172.21.15.114:0/2267629727 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77200748e0 con 0x7f77200cd5d0 2024-09-16T07:27:56.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.410+0000 7f771f400640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200cd5d0 0x7f772014b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f771001a530 tx=0x7f77100a5580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.414+0000 7f7717e00640 1 -- 172.21.15.114:0/2267629727 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77100b2040 con 0x7f77200cd5d0 2024-09-16T07:27:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.414+0000 7f7717e00640 1 -- 172.21.15.114:0/2267629727 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77100041b0 con 0x7f77200cd5d0 2024-09-16T07:27:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.414+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77201fd7e0 con 0x7f77200cd5d0 2024-09-16T07:27:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.414+0000 7f7717e00640 1 -- 172.21.15.114:0/2267629727 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710003600 con 0x7f77200cd5d0 2024-09-16T07:27:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.414+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77201fcd00 con 0x7f77200cd5d0 2024-09-16T07:27:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.414+0000 7f7717e00640 1 -- 172.21.15.114:0/2267629727 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f77100bf020 con 0x7f77200cd5d0 2024-09-16T07:27:56.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.414+0000 7f7717e00640 1 -- 172.21.15.114:0/2267629727 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f77100a5d50 con 0x7f77200cd5d0 2024-09-16T07:27:56.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.418+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77200cd9b0 con 0x7f77200cd5d0 2024-09-16T07:27:56.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.422+0000 7f7717e00640 1 -- 172.21.15.114:0/2267629727 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f77100c6020 con 0x7f77200cd5d0 2024-09-16T07:27:56.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.426+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f863c0cae40 con 0x7f863c0cd9f0 2024-09-16T07:27:56.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.442+0000 7f8633400640 1 -- 172.21.15.114:0/3485805502 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f8628014030 con 0x7f863c0cd9f0 2024-09-16T07:27:56.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c0cd9f0 msgr2=0x7f863c0c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f8641000640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c0cd9f0 0x7f863c0c7150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f862800c940 tx=0x7f862800ce00 comp rx=0 tx=0).stop 2024-09-16T07:27:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 shutdown_connections 2024-09-16T07:27:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f8641000640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15e300 0x7f863c0c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f8641000640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c0cd9f0 0x7f863c0c7150 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f8641000640 1 --2- 172.21.15.114:0/3485805502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0cd5d0 0x7f863c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 >> 172.21.15.114:0/3485805502 conn(0x7f863c0cfa00 msgr2=0x7f863c0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f7f71c00640 1 -- 172.21.15.114:0/3121260457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 msgr2=0x7f7f6c154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f7f71c00640 1 --2- 172.21.15.114:0/3121260457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c154c80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009900 tx=0x7f7f5c01c820 comp rx=0 tx=0).stop 2024-09-16T07:27:56.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f7f71c00640 1 -- 172.21.15.114:0/3121260457 shutdown_connections 2024-09-16T07:27:56.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f7f71c00640 1 --2- 172.21.15.114:0/3121260457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c154c80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f7f71c00640 1 --2- 172.21.15.114:0/3121260457 >> v2:172.21.15.114:3300/0 conn(0x7f7f6c15ed10 0x7f7f6c15e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.446+0000 7f7f71c00640 1 -- 172.21.15.114:0/3121260457 >> 172.21.15.114:0/3121260457 conn(0x7f7f6c0b1600 msgr2=0x7f7f6c0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.454+0000 7f7f71c00640 1 -- 172.21.15.114:0/3121260457 shutdown_connections 2024-09-16T07:27:56.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.454+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 shutdown_connections 2024-09-16T07:27:56.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.454+0000 7f7f71c00640 1 -- 172.21.15.114:0/3121260457 wait complete. 2024-09-16T07:27:56.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.454+0000 7f7f71c00640 1 Processor -- start 2024-09-16T07:27:56.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.454+0000 7f8641000640 1 -- 172.21.15.114:0/3485805502 wait complete. 2024-09-16T07:27:56.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.458+0000 7f7f71c00640 1 -- start start 2024-09-16T07:27:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f71c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f6c06e6e0 0x7f7f6c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f71c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f71c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f6c15ed10 0x7f7f6c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f71c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c15fd10 con 0x7f7f6c06e6e0 2024-09-16T07:27:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f71c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c15fb90 con 0x7f7f6c15ed10 2024-09-16T07:27:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f71c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6c15fe90 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f6c06e6e0 0x7f7f6c152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f6c15ed10 0x7f7f6c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c0ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:60104/0 (socket says 172.21.15.114:60104) 2024-09-16T07:27:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 -- 172.21.15.114:0/3768599761 learned_addr learned my addr 172.21.15.114:0/3768599761 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 -- 172.21.15.114:0/3768599761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f6c15ed10 msgr2=0x7f7f6c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 --2- 172.21.15.114:0/3768599761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f6c15ed10 0x7f7f6c0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 -- 172.21.15.114:0/3768599761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f6c06e6e0 msgr2=0x7f7f6c152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 --2- 172.21.15.114:0/3768599761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f6c06e6e0 0x7f7f6c152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 -- 172.21.15.114:0/3768599761 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c0caf10 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.462+0000 7f7f6a000640 1 --2- 172.21.15.114:0/3768599761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c0ca060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009850 tx=0x7f7f5c0a56f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.466+0000 7f7f62a00640 1 -- 172.21.15.114:0/3768599761 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0b2040 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.466+0000 7f7f62a00640 1 -- 172.21.15.114:0/3768599761 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f5c0044b0 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.466+0000 7f7f71c00640 1 -- 172.21.15.114:0/3768599761 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c0cc450 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.466+0000 7f7f62a00640 1 -- 172.21.15.114:0/3768599761 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0b2040 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.466+0000 7f7f71c00640 1 -- 172.21.15.114:0/3768599761 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c0cac30 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.470+0000 7f7f57e00640 1 -- 172.21.15.114:0/3768599761 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6c15e230 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.474+0000 7f7f62a00640 1 -- 172.21.15.114:0/3768599761 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f5c0053c0 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.474+0000 7f7f62a00640 1 -- 172.21.15.114:0/3768599761 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7f5c004d20 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.478+0000 7f7f62a00640 1 -- 172.21.15.114:0/3768599761 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7f5c0bd060 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.478+0000 7f7106e00640 1 -- 172.21.15.114:0/551677834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71000cd5d0 msgr2=0x7f71000ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.478+0000 7f7106e00640 1 --2- 172.21.15.114:0/551677834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71000cd5d0 0x7f71000ca050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009930 tx=0x7f70ec01c920 comp rx=0 tx=0).stop 2024-09-16T07:27:56.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.482+0000 7f7106e00640 1 -- 172.21.15.114:0/551677834 shutdown_connections 2024-09-16T07:27:56.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.482+0000 7f7106e00640 1 --2- 172.21.15.114:0/551677834 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71000cd5d0 0x7f71000ca050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.482+0000 7f7106e00640 1 -- 172.21.15.114:0/551677834 >> 172.21.15.114:0/551677834 conn(0x7f71000cfa00 msgr2=0x7f71000cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.482+0000 7f7106e00640 1 -- 172.21.15.114:0/551677834 shutdown_connections 2024-09-16T07:27:56.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.482+0000 7f7106e00640 1 -- 172.21.15.114:0/551677834 wait complete. 2024-09-16T07:27:56.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.482+0000 7f7106e00640 1 Processor -- start 2024-09-16T07:27:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.490+0000 7f7106e00640 1 -- start start 2024-09-16T07:27:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.490+0000 7f7106e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71000ae4d0 0x7f710014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.490+0000 7f7106e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71000cd5d0 0x7f71001ff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.494+0000 7f7105a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71000ae4d0 0x7f710014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.494+0000 7f7105a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71000ae4d0 0x7f710014f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:38682/0 (socket says 172.21.15.114:38682) 2024-09-16T07:27:56.497 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.494+0000 7f7105000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71000cd5d0 0x7f71001ff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.494+0000 7f7105000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71000cd5d0 0x7f71001ff6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57188/0 (socket says 172.21.15.114:57188) 2024-09-16T07:27:56.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7105a00640 1 -- 172.21.15.114:0/3713861327 learned_addr learned my addr 172.21.15.114:0/3713861327 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7106e00640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f710015eeb0 0x7f71001ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7100170750 con 0x7f71000cd5d0 2024-09-16T07:27:56.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7fd691400640 1 -- 172.21.15.114:0/3736430744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c0cf300 msgr2=0x7fd68c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7fd691400640 1 --2- 172.21.15.114:0/3736430744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c0cf300 0x7fd68c06ede0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd684009960 tx=0x7fd68401e9d0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7fd691400640 1 -- 172.21.15.114:0/3736430744 shutdown_connections 2024-09-16T07:27:56.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7fd691400640 1 --2- 172.21.15.114:0/3736430744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c0cf300 0x7fd68c06ede0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7fd691400640 1 --2- 172.21.15.114:0/3736430744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c0cc5f0 0x7fd68c06e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7fd691400640 1 -- 172.21.15.114:0/3736430744 >> 172.21.15.114:0/3736430744 conn(0x7fd68c0b18f0 msgr2=0x7fd68c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71001705d0 con 0x7f71000ae4d0 2024-09-16T07:27:56.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71001708d0 con 0x7f710015eeb0 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7105000640 1 -- 172.21.15.114:0/3713861327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f710015eeb0 msgr2=0x7f71001ffc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7105000640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f710015eeb0 0x7f71001ffc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7105000640 1 -- 172.21.15.114:0/3713861327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71000ae4d0 msgr2=0x7f710014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7105000640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71000ae4d0 0x7f710014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7105000640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7100151f20 con 0x7f71000cd5d0 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7105000640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71000cd5d0 0x7f71001ff6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f70f800bd20 tx=0x7f70f800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f70fd600640 1 -- 172.21.15.114:0/3713861327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8019070 con 0x7f71000cd5d0 2024-09-16T07:27:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.502+0000 7fd691400640 1 -- 172.21.15.114:0/3736430744 shutdown_connections 2024-09-16T07:27:56.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f70fd600640 1 -- 172.21.15.114:0/3713861327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70f8014440 con 0x7f71000cd5d0 2024-09-16T07:27:56.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f70fd600640 1 -- 172.21.15.114:0/3713861327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f80148f0 con 0x7f71000cd5d0 2024-09-16T07:27:56.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7100152200 con 0x7f71000cd5d0 2024-09-16T07:27:56.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71000c2b70 con 0x7f71000cd5d0 2024-09-16T07:27:56.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f70fd600640 1 -- 172.21.15.114:0/3713861327 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f70f801c070 con 0x7f71000cd5d0 2024-09-16T07:27:56.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.498+0000 7f70fd600640 1 -- 172.21.15.114:0/3713861327 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f70f801d6f0 con 0x7f71000cd5d0 2024-09-16T07:27:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.502+0000 7fd691400640 1 -- 172.21.15.114:0/3736430744 wait complete. 2024-09-16T07:27:56.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.502+0000 7fd691400640 1 Processor -- start 2024-09-16T07:27:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.502+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71000c2e90 con 0x7f71000cd5d0 2024-09-16T07:27:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd691400640 1 -- start start 2024-09-16T07:27:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd691400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c070420 0x7fd68c15f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd691400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0cf300 0x7fd68c164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd691400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c204980 0x7fd68c09d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd691400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0ce500 con 0x7fd68c070420 2024-09-16T07:27:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd691400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0ce380 con 0x7fd68c0cf300 2024-09-16T07:27:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd691400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0ce680 con 0x7fd68c204980 2024-09-16T07:27:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd68b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c204980 0x7fd68c09d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd68b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c204980 0x7fd68c09d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:60124/0 (socket says 172.21.15.114:60124) 2024-09-16T07:27:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd68b200640 1 -- 172.21.15.114:0/1863777807 learned_addr learned my addr 172.21.15.114:0/1863777807 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd689e00640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0cf300 0x7fd68c164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f17a80d0630 con 0x7f17a81f10d0 2024-09-16T07:27:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd68b200640 1 -- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0cf300 msgr2=0x7fd68c164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd68b200640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0cf300 0x7fd68c164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7fd68b200640 1 -- 172.21.15.114:0/1863777807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c070420 msgr2=0x7fd68c15f980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T07:27:56.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.510+0000 7f70fd600640 1 -- 172.21.15.114:0/3713861327 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f70f8014ae0 con 0x7f71000cd5d0 2024-09-16T07:27:56.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd68a800640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c070420 0x7fd68c15f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd68b200640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c070420 0x7fd68c15f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd68b200640 1 -- 172.21.15.114:0/1863777807 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c161f00 con 0x7fd68c204980 2024-09-16T07:27:56.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd689e00640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0cf300 0x7fd68c164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:56.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd68a800640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c070420 0x7fd68c15f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:27:56.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd68b200640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c204980 0x7fd68c09d220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6840098b0 tx=0x7fd6840a7f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd682a00640 1 -- 172.21.15.114:0/1863777807 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840bd070 con 0x7fd68c204980 2024-09-16T07:27:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd682a00640 1 -- 172.21.15.114:0/1863777807 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd684004320 con 0x7fd68c204980 2024-09-16T07:27:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd682a00640 1 -- 172.21.15.114:0/1863777807 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6840b4070 con 0x7fd68c204980 2024-09-16T07:27:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c204ed0 con 0x7fd68c204980 2024-09-16T07:27:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd682a00640 1 -- 172.21.15.114:0/1863777807 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd684003860 con 0x7fd68c204980 2024-09-16T07:27:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c205490 con 0x7fd68c204980 2024-09-16T07:27:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd682a00640 1 -- 172.21.15.114:0/1863777807 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd6840a7930 con 0x7fd68c204980 2024-09-16T07:27:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.514+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd68c1620d0 con 0x7fd68c204980 2024-09-16T07:27:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.518+0000 7f179f400640 1 -- 172.21.15.114:0/1702333454 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f17a00a8070 con 0x7f17a81f10d0 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a81f10d0 msgr2=0x7f17a815c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a81f10d0 0x7f17a815c630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f17a001d280 tx=0x7f17a00ab980 comp rx=0 tx=0).stop 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 shutdown_connections 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17a815cb70 0x7f17a81588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17a81f10d0 0x7f17a815c630 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 --2- 172.21.15.114:0/1702333454 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f178c004810 0x7f17a81efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 >> 172.21.15.114:0/1702333454 conn(0x7f17a80cfa00 msgr2=0x7f17a8160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 shutdown_connections 2024-09-16T07:27:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7f17ad000640 1 -- 172.21.15.114:0/1702333454 wait complete. 2024-09-16T07:27:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.526+0000 7fd682a00640 1 -- 172.21.15.114:0/1863777807 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd6840c7020 con 0x7fd68c204980 2024-09-16T07:27:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.542+0000 7f9ca2a00640 1 -- 172.21.15.114:0/1267802054 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f9cb008d540 con 0x7f9cb016d950 2024-09-16T07:27:56.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.550+0000 7fb21d600640 1 -- 172.21.15.114:0/2288999991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb22400a1d0 con 0x7fb224028a50 2024-09-16T07:27:56.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.550+0000 7f9cad600640 1 -- 172.21.15.114:0/1267802054 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f9ca4003bf0 con 0x7f9cb016d950 2024-09-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.554+0000 7f9ca2a00640 1 -- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb016d950 msgr2=0x7f9cb016ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.554+0000 7f9ca2a00640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb016d950 0x7f9cb016ddd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0074320 tx=0x7f9ca400c820 comp rx=0 tx=0).stop 2024-09-16T07:27:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.554+0000 7fe139600640 1 -- 172.21.15.114:0/3227289796 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fe1440751c0 con 0x7fe1440cd5d0 2024-09-16T07:27:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.554+0000 7f9ca2a00640 1 -- 172.21.15.114:0/1267802054 shutdown_connections 2024-09-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7f9ca2a00640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cb016d950 0x7f9cb016ddd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7f9ca2a00640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cb0155e50 0x7f9cb01530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7f9ca2a00640 1 --2- 172.21.15.114:0/1267802054 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c98004810 0x7f9cb0153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7f9ca2a00640 1 -- 172.21.15.114:0/1267802054 >> 172.21.15.114:0/1267802054 conn(0x7f9cb009d0c0 msgr2=0x7f9cb0159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7f9ca2a00640 1 -- 172.21.15.114:0/1267802054 shutdown_connections 2024-09-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7fa092000640 1 -- 172.21.15.114:0/3458772227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa09c0cba00 con 0x7fa09c15eeb0 2024-09-16T07:27:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7f9ca2a00640 1 -- 172.21.15.114:0/1267802054 wait complete. 2024-09-16T07:27:56.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.558+0000 7fb21fe00640 1 -- 172.21.15.114:0/2288999991 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7fb2180c6020 con 0x7fb224028a50 2024-09-16T07:27:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7c9c074320 con 0x7f7c9c0cb140 2024-09-16T07:27:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 -- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb224028a50 msgr2=0x7fb224028ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb224028a50 0x7fb224028ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb22400b150 tx=0x7fb218001cd0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fe13be00640 1 -- 172.21.15.114:0/3227289796 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v13)=0 v13) ==== 119+0+0 (secure 0 0 0) 0x7fe13c008b30 con 0x7fe1440cd5d0 2024-09-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 -- 172.21.15.114:0/2288999991 shutdown_connections 2024-09-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb224028a50 0x7fb224028ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb224050f60 0x7fb2240513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 --2- 172.21.15.114:0/2288999991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140053d0 0x7fb22417e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 -- 172.21.15.114:0/2288999991 >> 172.21.15.114:0/2288999991 conn(0x7fb2240545a0 msgr2=0x7fb224006d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 -- 172.21.15.114:0/2288999991 shutdown_connections 2024-09-16T07:27:56.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.566+0000 7fb21d600640 1 -- 172.21.15.114:0/2288999991 wait complete. 2024-09-16T07:27:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 -- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1440cd5d0 msgr2=0x7fe1440c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1440cd5d0 0x7fe1440c74e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe13c007320 tx=0x7fe13c003830 comp rx=0 tx=0).stop 2024-09-16T07:27:56.571 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 -- 172.21.15.114:0/3227289796 shutdown_connections 2024-09-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1440cd5d0 0x7fe1440c74e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1440ca050 0x7fe14415cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 --2- 172.21.15.114:0/3227289796 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1440aecd0 0x7fe1440b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 -- 172.21.15.114:0/3227289796 >> 172.21.15.114:0/3227289796 conn(0x7fe1440cfa00 msgr2=0x7fe1441644d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 -- 172.21.15.114:0/3227289796 shutdown_connections 2024-09-16T07:27:56.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fe139600640 1 -- 172.21.15.114:0/3227289796 wait complete. 2024-09-16T07:27:56.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.570+0000 7fa098c00640 1 -- 172.21.15.114:0/3458772227 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7fa094005410 con 0x7fa09c15eeb0 2024-09-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.578+0000 7fa092000640 1 -- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c15eeb0 msgr2=0x7fa09c0b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.578+0000 7fa092000640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c15eeb0 0x7fa09c0b4870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0940ac000 tx=0x7fa0940a5810 comp rx=0 tx=0).stop 2024-09-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.582+0000 7fa092000640 1 -- 172.21.15.114:0/3458772227 shutdown_connections 2024-09-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.582+0000 7fa092000640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09c15eeb0 0x7fa09c0b4870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.582+0000 7fa092000640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa09c0cd5d0 0x7fa09c14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.582+0000 7fa092000640 1 --2- 172.21.15.114:0/3458772227 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa09c0ae4d0 0x7fa09c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.582+0000 7fa092000640 1 -- 172.21.15.114:0/3458772227 >> 172.21.15.114:0/3458772227 conn(0x7fa09c0cfa00 msgr2=0x7fa09c0cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.582+0000 7fa092000640 1 -- 172.21.15.114:0/3458772227 shutdown_connections 2024-09-16T07:27:56.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.582+0000 7fa092000640 1 -- 172.21.15.114:0/3458772227 wait complete. 2024-09-16T07:27:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.586+0000 7f7c93e00640 1 -- 172.21.15.114:0/3320109654 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f7c8c006c00 con 0x7f7c9c0cb140 2024-09-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0cb140 msgr2=0x7f7c9c15ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0cb140 0x7f7c9c15ce50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00c440 tx=0x7f7c8c00c900 comp rx=0 tx=0).stop 2024-09-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 shutdown_connections 2024-09-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7c9c0cb140 0x7f7c9c15ce50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c9c0ca5c0 0x7f7c9c15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 --2- 172.21.15.114:0/3320109654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c9c072c80 0x7f7c9c154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 >> 172.21.15.114:0/3320109654 conn(0x7f7c9c0b1600 msgr2=0x7f7c9c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 shutdown_connections 2024-09-16T07:27:56.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.594+0000 7f7ca2a00640 1 -- 172.21.15.114:0/3320109654 wait complete. 2024-09-16T07:27:56.607 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.634+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f77200cba00 con 0x7f77200cd5d0 2024-09-16T07:27:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.634+0000 7f7f57e00640 1 -- 172.21.15.114:0/3768599761 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f7f6c154f80 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.638+0000 7f7717e00640 1 -- 172.21.15.114:0/2267629727 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f77100164f0 con 0x7f77200cd5d0 2024-09-16T07:27:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200cd5d0 msgr2=0x7f772014b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200cd5d0 0x7f772014b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f771001a530 tx=0x7f77100a5580 comp rx=0 tx=0).stop 2024-09-16T07:27:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 shutdown_connections 2024-09-16T07:27:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f772014bc40 0x7f772016c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f77200cd5d0 0x7f772014b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 --2- 172.21.15.114:0/2267629727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77200ae4d0 0x7f7720074140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 >> 172.21.15.114:0/2267629727 conn(0x7f77200cfa00 msgr2=0x7f772006ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 shutdown_connections 2024-09-16T07:27:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7725800640 1 -- 172.21.15.114:0/2267629727 wait complete. 2024-09-16T07:27:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f62a00640 1 -- 172.21.15.114:0/3768599761 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f7f5c0164d0 con 0x7f7f6c06ffd0 2024-09-16T07:27:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 -- 172.21.15.114:0/3768599761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 msgr2=0x7f7f6c0ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 --2- 172.21.15.114:0/3768599761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c0ca060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009850 tx=0x7f7f5c0a56f0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 -- 172.21.15.114:0/3768599761 shutdown_connections 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 --2- 172.21.15.114:0/3768599761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f6c15ed10 0x7f7f6c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 --2- 172.21.15.114:0/3768599761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f6c06ffd0 0x7f7f6c0ca060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 --2- 172.21.15.114:0/3768599761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f6c06e6e0 0x7f7f6c152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 -- 172.21.15.114:0/3768599761 >> 172.21.15.114:0/3768599761 conn(0x7f7f6c0b1600 msgr2=0x7f7f6c0af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 -- 172.21.15.114:0/3768599761 shutdown_connections 2024-09-16T07:27:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.642+0000 7f7f57e00640 1 -- 172.21.15.114:0/3768599761 wait complete. 2024-09-16T07:27:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.646+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7100070440 con 0x7f71000cd5d0 2024-09-16T07:27:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f70fd600640 1 -- 172.21.15.114:0/3713861327 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v18)=0 v18) ==== 125+0+0 (secure 0 0 0) 0x7f70f8014d20 con 0x7f71000cd5d0 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71000cd5d0 msgr2=0x7f71001ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f7106e00640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71000cd5d0 0x7f71001ff6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f70f800bd20 tx=0x7f70f800be10 comp rx=0 tx=0).stop 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 shutdown_connections 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f7106e00640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f710015eeb0 0x7f71001ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f7106e00640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71000cd5d0 0x7f71001ff6e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f7106e00640 1 --2- 172.21.15.114:0/3713861327 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71000ae4d0 0x7f710014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.650+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 >> 172.21.15.114:0/3713861327 conn(0x7f71000cfa00 msgr2=0x7f71000b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.654+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 shutdown_connections 2024-09-16T07:27:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.654+0000 7f7106e00640 1 -- 172.21.15.114:0/3713861327 wait complete. 2024-09-16T07:27:56.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.670+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fd68c0ceb30 con 0x7fd68c204980 2024-09-16T07:27:56.675 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.675 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.675 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.675 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.675 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.678 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.678 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi114') 2024-09-16T07:27:56.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.674+0000 7fd682a00640 1 -- 172.21.15.114:0/1863777807 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fd6840186e0 con 0x7fd68c204980 2024-09-16T07:27:56.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c204980 msgr2=0x7fd68c09d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c204980 0x7fd68c09d220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6840098b0 tx=0x7fd6840a7f80 comp rx=0 tx=0).stop 2024-09-16T07:27:56.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 shutdown_connections 2024-09-16T07:27:56.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd68c204980 0x7fd68c09d220 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd68c0cf300 0x7fd68c164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 --2- 172.21.15.114:0/1863777807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd68c070420 0x7fd68c15f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 >> 172.21.15.114:0/1863777807 conn(0x7fd68c0b18f0 msgr2=0x7fd68c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 shutdown_connections 2024-09-16T07:27:56.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.678+0000 7fd691400640 1 -- 172.21.15.114:0/1863777807 wait complete. 2024-09-16T07:27:56.700 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T07:27:56.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T07:27:56.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.878+0000 7ff512e00640 1 -- 172.21.15.114:0/3596725362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f0004030 msgr2=0x7ff4f0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.878+0000 7ff512e00640 1 --2- 172.21.15.114:0/3596725362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f0004030 0x7ff4f0004810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009b60 tx=0x7ff4f401d2b0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.878+0000 7ff510e00640 1 -- 172.21.15.114:0/3596725362 reap_dead start 2024-09-16T07:27:56.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- 172.21.15.114:0/3596725362 shutdown_connections 2024-09-16T07:27:56.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- 172.21.15.114:0/3596725362 >> 172.21.15.114:0/3596725362 conn(0x7ff50c0d1e90 msgr2=0x7ff50c0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- 172.21.15.114:0/3596725362 shutdown_connections 2024-09-16T07:27:56.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- 172.21.15.114:0/3596725362 wait complete. 2024-09-16T07:27:56.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 Processor -- start 2024-09-16T07:27:56.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- start start 2024-09-16T07:27:56.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f0004030 0x7ff50c0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50c1f6a40 0x7ff50c09f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c09fbf0 0x7ff50c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:56.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0b0ed0 con 0x7ff50c1f6a40 2024-09-16T07:27:56.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0b0d50 con 0x7ff50c09fbf0 2024-09-16T07:27:56.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff512e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c0af200 con 0x7ff4f0004030 2024-09-16T07:27:56.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50c1f6a40 0x7ff50c09f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50c1f6a40 0x7ff50c09f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57194/0 (socket says 172.21.15.114:57194) 2024-09-16T07:27:56.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 -- 172.21.15.114:0/1957157258 learned_addr learned my addr 172.21.15.114:0/1957157258 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:56.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff510e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c09fbf0 0x7ff50c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff50be00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f0004030 0x7ff50c0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:56.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 -- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f0004030 msgr2=0x7ff50c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f0004030 0x7ff50c0cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 -- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c09fbf0 msgr2=0x7ff50c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c09fbf0 0x7ff50c0ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 -- 172.21.15.114:0/1957157258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c15d670 con 0x7ff50c1f6a40 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.882+0000 7ff503e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50c1f6a40 0x7ff50c09f6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff4f401d0e0 tx=0x7ff4f4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff508c00640 1 -- 172.21.15.114:0/1957157258 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40b2070 con 0x7ff50c1f6a40 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff508c00640 1 -- 172.21.15.114:0/1957157258 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4f40b3040 con 0x7ff50c1f6a40 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff508c00640 1 -- 172.21.15.114:0/1957157258 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40adc60 con 0x7ff50c1f6a40 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c0c9ac0 con 0x7ff50c1f6a40 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c1f6240 con 0x7ff50c1f6a40 2024-09-16T07:27:56.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff508c00640 1 -- 172.21.15.114:0/1957157258 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4f40be020 con 0x7ff50c1f6a40 2024-09-16T07:27:56.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff508c00640 1 -- 172.21.15.114:0/1957157258 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff4f40b7580 con 0x7ff50c1f6a40 2024-09-16T07:27:56.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c0b15e0 con 0x7ff50c1f6a40 2024-09-16T07:27:56.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.886+0000 7ff508c00640 1 -- 172.21.15.114:0/1957157258 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff4f40c5020 con 0x7ff50c1f6a40 2024-09-16T07:27:56.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.950+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff50c0b4870 con 0x7ff50c1f6a40 2024-09-16T07:27:56.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff508c00640 1 -- 172.21.15.114:0/1957157258 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff50c15d670 con 0x7ff50c1f6a40 2024-09-16T07:27:56.954 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50c1f6a40 msgr2=0x7ff50c09f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50c1f6a40 0x7ff50c09f6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff4f401d0e0 tx=0x7ff4f4005640 comp rx=0 tx=0).stop 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 shutdown_connections 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c09fbf0 0x7ff50c0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff50c1f6a40 0x7ff50c09f6b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 --2- 172.21.15.114:0/1957157258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff4f0004030 0x7ff50c0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 >> 172.21.15.114:0/1957157258 conn(0x7ff50c0d1e90 msgr2=0x7ff50c0b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 shutdown_connections 2024-09-16T07:27:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:56.954+0000 7ff512e00640 1 -- 172.21.15.114:0/1957157258 wait complete. 2024-09-16T07:27:56.974 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T07:27:56.974 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T07:27:56.974 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:56.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T07:27:56.993 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:56.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T07:27:57.056 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:57.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T07:27:57.117 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:27:57.117 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T07:27:57.176 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:57.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T07:27:57.196 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:57.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T07:27:57.258 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:57.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-16T07:27:57.321 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:27:57.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-16T07:27:57.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 2880b670-b794-44d2-a093-a6bb1fb302c9 0 2024-09-16T07:27:57.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 -- 172.21.15.149:0/1564459273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 msgr2=0x7f2d1c0d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 --2- 172.21.15.149:0/1564459273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0d0da0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009870 tx=0x7f2d0c01c710 comp rx=0 tx=0).stop 2024-09-16T07:27:57.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 -- 172.21.15.149:0/1564459273 shutdown_connections 2024-09-16T07:27:57.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 --2- 172.21.15.149:0/1564459273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0d0da0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 -- 172.21.15.149:0/1564459273 >> 172.21.15.149:0/1564459273 conn(0x7f2d1c0d1e90 msgr2=0x7f2d1c0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:57.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 -- 172.21.15.149:0/1564459273 shutdown_connections 2024-09-16T07:27:57.566 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 -- 172.21.15.149:0/1564459273 wait complete. 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 Processor -- start 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.566+0000 7f2d20a00640 1 -- start start 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d1c0d1990 0x7f2d1c14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1c161a50 0x7f2d1c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c16c920 con 0x7f2d1c0d1990 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c16c7a0 con 0x7f2d1c161a50 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1c16caa0 con 0x7f2d1c0ce970 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:46950/0 (socket says 172.21.15.149:46950) 2024-09-16T07:27:57.569 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 -- 172.21.15.149:0/3762749271 learned_addr learned my addr 172.21.15.149:0/3762749271 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d1a800640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1c161a50 0x7f2d1c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19400640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d1c0d1990 0x7f2d1c14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 -- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1c161a50 msgr2=0x7f2d1c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1c161a50 0x7f2d1c0b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 -- 172.21.15.149:0/3762749271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d1c0d1990 msgr2=0x7f2d1c14b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d1c0d1990 0x7f2d1c14b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 -- 172.21.15.149:0/3762749271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c0b4f10 con 0x7f2d1c0ce970 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d1a800640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1c161a50 0x7f2d1c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d19e00640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0b04e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c000c10 tx=0x7f2d0c0a5740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d12000640 1 -- 172.21.15.149:0/3762749271 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0b2040 con 0x7f2d1c0ce970 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d12000640 1 -- 172.21.15.149:0/3762749271 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d0c0043c0 con 0x7f2d1c0ce970 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d12000640 1 -- 172.21.15.149:0/3762749271 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c003860 con 0x7f2d1c0ce970 2024-09-16T07:27:57.570 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c0b51f0 con 0x7f2d1c0ce970 2024-09-16T07:27:57.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c0b57b0 con 0x7f2d1c0ce970 2024-09-16T07:27:57.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d12000640 1 -- 172.21.15.149:0/3762749271 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d0c003a00 con 0x7f2d1c0ce970 2024-09-16T07:27:57.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d12000640 1 -- 172.21.15.149:0/3762749271 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2d0c0add00 con 0x7f2d1c0ce970 2024-09-16T07:27:57.571 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.570+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1c0b59f0 con 0x7f2d1c0ce970 2024-09-16T07:27:57.572 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.574+0000 7f2d12000640 1 -- 172.21.15.149:0/3762749271 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2d0c016450 con 0x7f2d1c0ce970 2024-09-16T07:27:57.654 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.654+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2880b670-b794-44d2-a093-a6bb1fb302c9", "id": 0} v 0) -- 0x7f2d1c0d0da0 con 0x7f2d1c0ce970 2024-09-16T07:27:57.658 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.658+0000 7f2d12000640 1 -- 172.21.15.149:0/3762749271 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2880b670-b794-44d2-a093-a6bb1fb302c9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2d0c003de0 con 0x7f2d1c0ce970 2024-09-16T07:27:57.658 INFO:teuthology.orchestra.run.smithi149.stdout:0 2024-09-16T07:27:57.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 msgr2=0x7f2d1c0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0b04e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c000c10 tx=0x7f2d0c0a5740 comp rx=0 tx=0).stop 2024-09-16T07:27:57.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 shutdown_connections 2024-09-16T07:27:57.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d1c161a50 0x7f2d1c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.659 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d1c0d1990 0x7f2d1c14b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 --2- 172.21.15.149:0/3762749271 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d1c0ce970 0x7f2d1c0b04e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 >> 172.21.15.149:0/3762749271 conn(0x7f2d1c0d1e90 msgr2=0x7f2d1c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:57.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 shutdown_connections 2024-09-16T07:27:57.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.662+0000 7f2d20a00640 1 -- 172.21.15.149:0/3762749271 wait complete. 2024-09-16T07:27:57.680 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new d2cd9d03-5dff-48f7-945e-3608aabf9e9e 1 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 -- 172.21.15.149:0/1938789720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 msgr2=0x7f1aac0d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 --2- 172.21.15.149:0/1938789720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac0d0530 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1aac071cc0 tx=0x7f1aa401cd80 comp rx=0 tx=0).stop 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 -- 172.21.15.149:0/1938789720 shutdown_connections 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 --2- 172.21.15.149:0/1938789720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac0d0530 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 --2- 172.21.15.149:0/1938789720 >> v2:172.21.15.114:3300/0 conn(0x7f1aac151960 0x7f1aac151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 -- 172.21.15.149:0/1938789720 >> 172.21.15.149:0/1938789720 conn(0x7f1aac0d0da0 msgr2=0x7f1aac0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 -- 172.21.15.149:0/1938789720 shutdown_connections 2024-09-16T07:27:57.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 -- 172.21.15.149:0/1938789720 wait complete. 2024-09-16T07:27:57.826 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 Processor -- start 2024-09-16T07:27:57.826 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.826+0000 7f1ab1c00640 1 -- start start 2024-09-16T07:27:57.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1aac070720 0x7f1aac149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:57.827 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac1fb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac151960 0x7f1aac15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac0cc510 con 0x7f1aac151960 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac15c130 con 0x7f1aac0d00a0 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1aac0cc690 con 0x7f1aac070720 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac1fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1aac070720 0x7f1aac149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac1fb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49432/0 (socket says 172.21.15.149:49432) 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaa000640 1 -- 172.21.15.149:0/3682802230 learned_addr learned my addr 172.21.15.149:0/3682802230 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aab400640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac151960 0x7f1aac15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaaa00640 1 -- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 msgr2=0x7f1aac1fb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaaa00640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac1fb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.828 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaaa00640 1 -- 172.21.15.149:0/3682802230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac151960 msgr2=0x7f1aac15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.829 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaaa00640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac151960 0x7f1aac15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.829 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaaa00640 1 -- 172.21.15.149:0/3682802230 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac0b6260 con 0x7f1aac070720 2024-09-16T07:27:57.829 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaa000640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac1fb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aaaa00640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1aac070720 0x7f1aac149890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00e9f0 tx=0x7f1a9c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aa2a00640 1 -- 172.21.15.149:0/3682802230 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00ccc0 con 0x7f1aac070720 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aa2a00640 1 -- 172.21.15.149:0/3682802230 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a9c010430 con 0x7f1aac070720 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aa2a00640 1 -- 172.21.15.149:0/3682802230 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c010860 con 0x7f1aac070720 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac0b5f80 con 0x7f1aac070720 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac14c4a0 con 0x7f1aac070720 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aa2a00640 1 -- 172.21.15.149:0/3682802230 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a9c010a00 con 0x7f1aac070720 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1aa2a00640 1 -- 172.21.15.149:0/3682802230 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1a9c0217a0 con 0x7f1aac070720 2024-09-16T07:27:57.830 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.830+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac0d0530 con 0x7f1aac070720 2024-09-16T07:27:57.833 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.834+0000 7f1aa2a00640 1 -- 172.21.15.149:0/3682802230 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1a9c018d30 con 0x7f1aac070720 2024-09-16T07:27:57.903 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.906+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d2cd9d03-5dff-48f7-945e-3608aabf9e9e", "id": 1} v 0) -- 0x7f1aac0b6d20 con 0x7f1aac070720 2024-09-16T07:27:57.909 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1aa2a00640 1 -- 172.21.15.149:0/3682802230 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2cd9d03-5dff-48f7-945e-3608aabf9e9e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1a9c0219a0 con 0x7f1aac070720 2024-09-16T07:27:57.910 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:27:57.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1aac070720 msgr2=0x7f1aac149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:57.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1aac070720 0x7f1aac149890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00e9f0 tx=0x7f1a9c00eeb0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.911 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 shutdown_connections 2024-09-16T07:27:57.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac151960 0x7f1aac15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1aac0d00a0 0x7f1aac1fb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 --2- 172.21.15.149:0/3682802230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1aac070720 0x7f1aac149890 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:57.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 >> 172.21.15.149:0/3682802230 conn(0x7f1aac0d0da0 msgr2=0x7f1aac06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:57.912 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 shutdown_connections 2024-09-16T07:27:57.913 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:57.910+0000 7f1ab1c00640 1 -- 172.21.15.149:0/3682802230 wait complete. 2024-09-16T07:27:57.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new d51d2492-9ac7-4c22-bf2e-86ae787c87aa 2 2024-09-16T07:27:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 -- 172.21.15.149:0/4176265355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 msgr2=0x7fba14073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 --2- 172.21.15.149:0/4176265355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba14073070 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fba140d15a0 tx=0x7fba0801c800 comp rx=0 tx=0).stop 2024-09-16T07:27:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 -- 172.21.15.149:0/4176265355 shutdown_connections 2024-09-16T07:27:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 --2- 172.21.15.149:0/4176265355 >> v2:172.21.15.114:3300/0 conn(0x7fba1415b000 0x7fba140735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 --2- 172.21.15.149:0/4176265355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba14073070 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 -- 172.21.15.149:0/4176265355 >> 172.21.15.149:0/4176265355 conn(0x7fba140d04f0 msgr2=0x7fba140d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 -- 172.21.15.149:0/4176265355 shutdown_connections 2024-09-16T07:27:58.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.074+0000 7fba1be00640 1 -- 172.21.15.149:0/4176265355 wait complete. 2024-09-16T07:27:58.073 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.078+0000 7fba1be00640 1 Processor -- start 2024-09-16T07:27:58.074 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.078+0000 7fba1be00640 1 -- start start 2024-09-16T07:27:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba140af810 0x7fba1414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba140b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba1415b000 0x7fba140b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fba141684b0 con 0x7fba1415b000 2024-09-16T07:27:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba14168330 con 0x7fba1415ac20 2024-09-16T07:27:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fba14168630 con 0x7fba140af810 2024-09-16T07:27:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba19400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba140af810 0x7fba1414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba140b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba140b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49448/0 (socket says 172.21.15.149:49448) 2024-09-16T07:27:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba19400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba140af810 0x7fba1414f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:46968/0 (socket says 172.21.15.149:46968) 2024-09-16T07:27:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 -- 172.21.15.149:0/3919310734 learned_addr learned my addr 172.21.15.149:0/3919310734 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba19e00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba1415b000 0x7fba140b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 -- 172.21.15.149:0/3919310734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba140af810 msgr2=0x7fba1414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba140af810 0x7fba1414f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 -- 172.21.15.149:0/3919310734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba1415b000 msgr2=0x7fba140b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba1415b000 0x7fba140b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 -- 172.21.15.149:0/3919310734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1414ff80 con 0x7fba1415ac20 2024-09-16T07:27:58.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba19e00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba1415b000 0x7fba140b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:58.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba18a00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba140b5ee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba0000e820 tx=0x7fba0000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:58.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba11600640 1 -- 172.21.15.149:0/3919310734 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0000ccc0 con 0x7fba1415ac20 2024-09-16T07:27:58.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba11600640 1 -- 172.21.15.149:0/3919310734 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba0000ce80 con 0x7fba1415ac20 2024-09-16T07:27:58.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba14150260 con 0x7fba1415ac20 2024-09-16T07:27:58.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba11600640 1 -- 172.21.15.149:0/3919310734 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00005280 con 0x7fba1415ac20 2024-09-16T07:27:58.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba14150540 con 0x7fba1415ac20 2024-09-16T07:27:58.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba11600640 1 -- 172.21.15.149:0/3919310734 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba000047b0 con 0x7fba1415ac20 2024-09-16T07:27:58.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba11600640 1 -- 172.21.15.149:0/3919310734 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fba00004aa0 con 0x7fba1415ac20 2024-09-16T07:27:58.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.082+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1415e950 con 0x7fba1415ac20 2024-09-16T07:27:58.084 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.086+0000 7fba11600640 1 -- 172.21.15.149:0/3919310734 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fba00004dc0 con 0x7fba1415ac20 2024-09-16T07:27:58.149 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.154+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d51d2492-9ac7-4c22-bf2e-86ae787c87aa", "id": 2} v 0) -- 0x7fba140c3d60 con 0x7fba1415ac20 2024-09-16T07:27:58.155 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba11600640 1 -- 172.21.15.149:0/3919310734 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d51d2492-9ac7-4c22-bf2e-86ae787c87aa", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fba00021bc0 con 0x7fba1415ac20 2024-09-16T07:27:58.155 INFO:teuthology.orchestra.run.smithi149.stdout:2 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 msgr2=0x7fba140b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba140b5ee0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba0000e820 tx=0x7fba0000ece0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 shutdown_connections 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba1415b000 0x7fba140b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba1415ac20 0x7fba140b5ee0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 --2- 172.21.15.149:0/3919310734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba140af810 0x7fba1414f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 >> 172.21.15.149:0/3919310734 conn(0x7fba140d04f0 msgr2=0x7fba14154700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 shutdown_connections 2024-09-16T07:27:58.157 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.162+0000 7fba1be00640 1 -- 172.21.15.149:0/3919310734 wait complete. 2024-09-16T07:27:58.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new cd275489-3f01-4bb2-82df-f578dca217ae 3 2024-09-16T07:27:58.317 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 -- 172.21.15.149:0/1968043255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac14156590 msgr2=0x7fac14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 --2- 172.21.15.149:0/1968043255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac14156590 0x7fac14068960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fac140d03d0 tx=0x7fac0801c8c0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 -- 172.21.15.149:0/1968043255 shutdown_connections 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 --2- 172.21.15.149:0/1968043255 >> v2:172.21.15.114:3300/0 conn(0x7fac1406d330 0x7fac140b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 --2- 172.21.15.149:0/1968043255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac14156590 0x7fac14068960 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 -- 172.21.15.149:0/1968043255 >> 172.21.15.149:0/1968043255 conn(0x7fac140d04f0 msgr2=0x7fac140d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 -- 172.21.15.149:0/1968043255 shutdown_connections 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.322+0000 7fac1ba00640 1 -- 172.21.15.149:0/1968043255 wait complete. 2024-09-16T07:27:58.318 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 Processor -- start 2024-09-16T07:27:58.319 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 -- start start 2024-09-16T07:27:58.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1406d330 0x7fac14149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.320 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac14070770 0x7fac1414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac14156590 0x7fac140ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fac1415fed0 con 0x7fac14156590 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac1415fd50 con 0x7fac1406d330 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fac14160050 con 0x7fac14070770 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1406d330 0x7fac14149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac13e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac14070770 0x7fac1414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac14156590 0x7fac140ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1406d330 0x7fac14149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49458/0 (socket says 172.21.15.149:49458) 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 -- 172.21.15.149:0/3170498466 learned_addr learned my addr 172.21.15.149:0/3170498466 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 -- 172.21.15.149:0/3170498466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac14070770 msgr2=0x7fac1414f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 --2- 172.21.15.149:0/3170498466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac14070770 0x7fac1414f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 -- 172.21.15.149:0/3170498466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac14156590 msgr2=0x7fac140ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.321 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 --2- 172.21.15.149:0/3170498466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac14156590 0x7fac140ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.322 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 -- 172.21.15.149:0/3170498466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac140ce1f0 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac19000640 1 --2- 172.21.15.149:0/3170498466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1406d330 0x7fac14149070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac080b0040 tx=0x7fac08005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac10c00640 1 -- 172.21.15.149:0/3170498466 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac080b2040 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac10c00640 1 -- 172.21.15.149:0/3170498466 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac08004330 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac140d00a0 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac10c00640 1 -- 172.21.15.149:0/3170498466 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08005280 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1414dad0 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac10c00640 1 -- 172.21.15.149:0/3170498466 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac08004a60 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac10c00640 1 -- 172.21.15.149:0/3170498466 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fac08003600 con 0x7fac1406d330 2024-09-16T07:27:58.323 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.326+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac140b5380 con 0x7fac1406d330 2024-09-16T07:27:58.324 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.330+0000 7fac10c00640 1 -- 172.21.15.149:0/3170498466 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fac080164b0 con 0x7fac1406d330 2024-09-16T07:27:58.393 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.398+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd275489-3f01-4bb2-82df-f578dca217ae", "id": 3} v 0) -- 0x7fac140afa20 con 0x7fac1406d330 2024-09-16T07:27:58.400 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac10c00640 1 -- 172.21.15.149:0/3170498466 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd275489-3f01-4bb2-82df-f578dca217ae", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fac08004d50 con 0x7fac1406d330 2024-09-16T07:27:58.400 INFO:teuthology.orchestra.run.smithi149.stdout:3 2024-09-16T07:27:58.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1406d330 msgr2=0x7fac14149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 --2- 172.21.15.149:0/3170498466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1406d330 0x7fac14149070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac080b0040 tx=0x7fac08005e70 comp rx=0 tx=0).stop 2024-09-16T07:27:58.401 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 shutdown_connections 2024-09-16T07:27:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 --2- 172.21.15.149:0/3170498466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac14156590 0x7fac140ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 --2- 172.21.15.149:0/3170498466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac14070770 0x7fac1414f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 --2- 172.21.15.149:0/3170498466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1406d330 0x7fac14149070 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 >> 172.21.15.149:0/3170498466 conn(0x7fac140d04f0 msgr2=0x7fac1406fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 shutdown_connections 2024-09-16T07:27:58.402 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.406+0000 7fac1ba00640 1 -- 172.21.15.149:0/3170498466 wait complete. 2024-09-16T07:27:58.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 5f588931-d5de-48ef-9830-7ae234100023 4 2024-09-16T07:27:58.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2568261483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0aecd0 msgr2=0x7fd3dc06f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 --2- 172.21.15.149:0/2568261483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0aecd0 0x7fd3dc06f410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009bc0 tx=0x7fd3d401cb10 comp rx=0 tx=0).stop 2024-09-16T07:27:58.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2568261483 shutdown_connections 2024-09-16T07:27:58.589 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 --2- 172.21.15.149:0/2568261483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0aecd0 0x7fd3dc06f410 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 --2- 172.21.15.149:0/2568261483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0ca050 0x7fd3dc072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2568261483 >> 172.21.15.149:0/2568261483 conn(0x7fd3dc0cfa00 msgr2=0x7fd3dc0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2568261483 shutdown_connections 2024-09-16T07:27:58.590 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.593+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2568261483 wait complete. 2024-09-16T07:27:58.592 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.597+0000 7fd3e1c00640 1 Processor -- start 2024-09-16T07:27:58.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.597+0000 7fd3e1c00640 1 -- start start 2024-09-16T07:27:58.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3e1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0aecd0 0x7fd3dc0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3e1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0ca050 0x7fd3dc0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3e1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0cd5d0 0x7fd3dc1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3e1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc169530 con 0x7fd3dc0aecd0 2024-09-16T07:27:58.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3e1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc1693b0 con 0x7fd3dc0ca050 2024-09-16T07:27:58.595 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3e1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc1696b0 con 0x7fd3dc0cd5d0 2024-09-16T07:27:58.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0ca050 0x7fd3dc0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0ca050 0x7fd3dc0b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49476/0 (socket says 172.21.15.149:49476) 2024-09-16T07:27:58.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 -- 172.21.15.149:0/2311750880 learned_addr learned my addr 172.21.15.149:0/2311750880 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:58.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3dbe00640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0aecd0 0x7fd3dc0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 -- 172.21.15.149:0/2311750880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0cd5d0 msgr2=0x7fd3dc1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.596 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0cd5d0 0x7fd3dc1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 -- 172.21.15.149:0/2311750880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0aecd0 msgr2=0x7fd3dc0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0aecd0 0x7fd3dc0c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 -- 172.21.15.149:0/2311750880 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc153dd0 con 0x7fd3dc0ca050 2024-09-16T07:27:58.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3dbe00640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0aecd0 0x7fd3dc0c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:58.597 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3db400640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0ca050 0x7fd3dc0b5380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c430 tx=0x7fd3c800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:58.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3d3e00640 1 -- 172.21.15.149:0/2311750880 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8017070 con 0x7fd3dc0ca050 2024-09-16T07:27:58.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3d3e00640 1 -- 172.21.15.149:0/2311750880 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3c80053c0 con 0x7fd3dc0ca050 2024-09-16T07:27:58.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.601+0000 7fd3d3e00640 1 -- 172.21.15.149:0/2311750880 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8003860 con 0x7fd3dc0ca050 2024-09-16T07:27:58.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.605+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc154830 con 0x7fd3dc0ca050 2024-09-16T07:27:58.599 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.605+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc158020 con 0x7fd3dc0ca050 2024-09-16T07:27:58.600 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.605+0000 7fd3d3e00640 1 -- 172.21.15.149:0/2311750880 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3c801a070 con 0x7fd3dc0ca050 2024-09-16T07:27:58.600 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.605+0000 7fd3d3e00640 1 -- 172.21.15.149:0/2311750880 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd3c8011590 con 0x7fd3dc0ca050 2024-09-16T07:27:58.601 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.605+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc06f410 con 0x7fd3dc0ca050 2024-09-16T07:27:58.604 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.609+0000 7fd3d3e00640 1 -- 172.21.15.149:0/2311750880 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd3c8021070 con 0x7fd3dc0ca050 2024-09-16T07:27:58.672 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.677+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f588931-d5de-48ef-9830-7ae234100023", "id": 4} v 0) -- 0x7fd3dc155cb0 con 0x7fd3dc0ca050 2024-09-16T07:27:58.679 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3d3e00640 1 -- 172.21.15.149:0/2311750880 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f588931-d5de-48ef-9830-7ae234100023", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd3c8011790 con 0x7fd3dc0ca050 2024-09-16T07:27:58.679 INFO:teuthology.orchestra.run.smithi149.stdout:4 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0ca050 msgr2=0x7fd3dc0b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0ca050 0x7fd3dc0b5380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c430 tx=0x7fd3c800c830 comp rx=0 tx=0).stop 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 shutdown_connections 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3dc0cd5d0 0x7fd3dc1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3dc0ca050 0x7fd3dc0b5380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 --2- 172.21.15.149:0/2311750880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3dc0aecd0 0x7fd3dc0c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 >> 172.21.15.149:0/2311750880 conn(0x7fd3dc0cfa00 msgr2=0x7fd3dc0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 shutdown_connections 2024-09-16T07:27:58.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.685+0000 7fd3e1c00640 1 -- 172.21.15.149:0/2311750880 wait complete. 2024-09-16T07:27:58.698 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 65d74ded-7c7f-4b19-a592-1a3722364c54 5 2024-09-16T07:27:58.841 INFO:tasks.ceph.mgr.x.smithi149.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T07:27:58.841 INFO:tasks.ceph.mgr.x.smithi149.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T07:27:58.841 INFO:tasks.ceph.mgr.x.smithi149.stderr: from numpy import show_config as show_numpy_config 2024-09-16T07:27:58.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 -- 172.21.15.149:0/3109334718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c15e2a0 msgr2=0x7f495c073070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 --2- 172.21.15.149:0/3109334718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c15e2a0 0x7f495c073070 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f494c009900 tx=0x7f494c01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 -- 172.21.15.149:0/3109334718 shutdown_connections 2024-09-16T07:27:58.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 --2- 172.21.15.149:0/3109334718 >> v2:172.21.15.114:3300/0 conn(0x7f495c0c7100 0x7f495c0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.842 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 --2- 172.21.15.149:0/3109334718 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c15e2a0 0x7f495c073070 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 -- 172.21.15.149:0/3109334718 >> 172.21.15.149:0/3109334718 conn(0x7f495c0d04f0 msgr2=0x7f495c0d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 -- 172.21.15.149:0/3109334718 shutdown_connections 2024-09-16T07:27:58.843 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.845+0000 7f4961400640 1 -- 172.21.15.149:0/3109334718 wait complete. 2024-09-16T07:27:58.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 Processor -- start 2024-09-16T07:27:58.844 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 -- start start 2024-09-16T07:27:58.846 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f495c0af810 0x7f495c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c0c7100 0x7f495c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495c15e2a0 0x7f495c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f495c168330 con 0x7f495c15e2a0 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1681b0 con 0x7f495c0af810 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f495c1684b0 con 0x7f495c0c7100 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f495a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f495c0af810 0x7f495c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c0c7100 0x7f495c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c0c7100 0x7f495c14ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:47016/0 (socket says 172.21.15.149:47016) 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 -- 172.21.15.149:0/2447652071 learned_addr learned my addr 172.21.15.149:0/2447652071 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f495b200640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495c15e2a0 0x7f495c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 -- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f495c0af810 msgr2=0x7f495c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.847 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f495c0af810 0x7f495c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 -- 172.21.15.149:0/2447652071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495c15e2a0 msgr2=0x7f495c1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495c15e2a0 0x7f495c1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 -- 172.21.15.149:0/2447652071 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c0ca490 con 0x7f495c0c7100 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f495a800640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f495c0af810 0x7f495c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4953e00640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c0c7100 0x7f495c14ea60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f494400c480 tx=0x7f494400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4952a00640 1 -- 172.21.15.149:0/2447652071 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49440052d0 con 0x7f495c0c7100 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4952a00640 1 -- 172.21.15.149:0/2447652071 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4944005470 con 0x7f495c0c7100 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c0ca1b0 con 0x7f495c0c7100 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4952a00640 1 -- 172.21.15.149:0/2447652071 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4944012870 con 0x7f495c0c7100 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c14fba0 con 0x7f495c0c7100 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.849+0000 7f4952a00640 1 -- 172.21.15.149:0/2447652071 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4944012a10 con 0x7f495c0c7100 2024-09-16T07:27:58.848 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.853+0000 7f4952a00640 1 -- 172.21.15.149:0/2447652071 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4944003b80 con 0x7f495c0c7100 2024-09-16T07:27:58.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.853+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c15c7d0 con 0x7f495c0c7100 2024-09-16T07:27:58.849 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.853+0000 7f4952a00640 1 -- 172.21.15.149:0/2447652071 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4944003600 con 0x7f495c0c7100 2024-09-16T07:27:58.917 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.921+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "65d74ded-7c7f-4b19-a592-1a3722364c54", "id": 5} v 0) -- 0x7f495c15e950 con 0x7f495c0c7100 2024-09-16T07:27:58.925 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4952a00640 1 -- 172.21.15.149:0/2447652071 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65d74ded-7c7f-4b19-a592-1a3722364c54", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f49440038b0 con 0x7f495c0c7100 2024-09-16T07:27:58.925 INFO:teuthology.orchestra.run.smithi149.stdout:5 2024-09-16T07:27:58.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c0c7100 msgr2=0x7f495c14ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:58.926 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c0c7100 0x7f495c14ea60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f494400c480 tx=0x7f494400c940 comp rx=0 tx=0).stop 2024-09-16T07:27:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 shutdown_connections 2024-09-16T07:27:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f495c15e2a0 0x7f495c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f495c0c7100 0x7f495c14ea60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 --2- 172.21.15.149:0/2447652071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f495c0af810 0x7f495c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 >> 172.21.15.149:0/2447652071 conn(0x7f495c0d04f0 msgr2=0x7f495c0b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 shutdown_connections 2024-09-16T07:27:58.927 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:58.929+0000 7f4961400640 1 -- 172.21.15.149:0/2447652071 wait complete. 2024-09-16T07:27:58.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 122fe90e-b355-49fd-9a88-dd335ff28bc8 6 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 -- 172.21.15.149:0/3612599518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d04d0 msgr2=0x7fc5340af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 --2- 172.21.15.149:0/3612599518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d04d0 0x7fc5340af200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009c80 tx=0x7fc52c01f5a0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 -- 172.21.15.149:0/3612599518 shutdown_connections 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 --2- 172.21.15.149:0/3612599518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d04d0 0x7fc5340af200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 --2- 172.21.15.149:0/3612599518 >> v2:172.21.15.149:3300/0 conn(0x7fc5340d00f0 0x7fc5340b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 -- 172.21.15.149:0/3612599518 >> 172.21.15.149:0/3612599518 conn(0x7fc5340d1e90 msgr2=0x7fc5340d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 -- 172.21.15.149:0/3612599518 shutdown_connections 2024-09-16T07:27:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 -- 172.21.15.149:0/3612599518 wait complete. 2024-09-16T07:27:59.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 Processor -- start 2024-09-16T07:27:59.086 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.089+0000 7fc53c200640 1 -- start start 2024-09-16T07:27:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5340d00f0 0x7fc5340c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5340d04d0 0x7fc534151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d29b0 0x7fc534152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc5340b0ed0 con 0x7fc5340d04d0 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5340b0d50 con 0x7fc5340d00f0 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5340af740 con 0x7fc5340d29b0 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc539800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5340d00f0 0x7fc5340c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d29b0 0x7fc534152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d29b0 0x7fc534152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:47032/0 (socket says 172.21.15.149:47032) 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53a200640 1 -- 172.21.15.149:0/2784023947 learned_addr learned my addr 172.21.15.149:0/2784023947 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc538e00640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5340d04d0 0x7fc534151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc539800640 1 -- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d29b0 msgr2=0x7fc534152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc539800640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d29b0 0x7fc534152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc539800640 1 -- 172.21.15.149:0/2784023947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5340d04d0 msgr2=0x7fc534151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc539800640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5340d04d0 0x7fc534151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc539800640 1 -- 172.21.15.149:0/2784023947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5341f8110 con 0x7fc5340d00f0 2024-09-16T07:27:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53a200640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d29b0 0x7fc534152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc539800640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5340d00f0 0x7fc5340c7ff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e9f0 tx=0x7fc52800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc531600640 1 -- 172.21.15.149:0/2784023947 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52800ccc0 con 0x7fc5340d00f0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc531600640 1 -- 172.21.15.149:0/2784023947 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc528010430 con 0x7fc5340d00f0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5341f83f0 con 0x7fc5340d00f0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc531600640 1 -- 172.21.15.149:0/2784023947 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528010860 con 0x7fc5340d00f0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5341f89b0 con 0x7fc5340d00f0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc531600640 1 -- 172.21.15.149:0/2784023947 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc528010a00 con 0x7fc5340d00f0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc531600640 1 -- 172.21.15.149:0/2784023947 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc528018d30 con 0x7fc5340d00f0 2024-09-16T07:27:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.093+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5340af200 con 0x7fc5340d00f0 2024-09-16T07:27:59.092 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.097+0000 7fc531600640 1 -- 172.21.15.149:0/2784023947 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc528018420 con 0x7fc5340d00f0 2024-09-16T07:27:59.180 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.185+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "122fe90e-b355-49fd-9a88-dd335ff28bc8", "id": 6} v 0) -- 0x7fc53406aca0 con 0x7fc5340d00f0 2024-09-16T07:27:59.186 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc531600640 1 -- 172.21.15.149:0/2784023947 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "122fe90e-b355-49fd-9a88-dd335ff28bc8", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc528018600 con 0x7fc5340d00f0 2024-09-16T07:27:59.187 INFO:teuthology.orchestra.run.smithi149.stdout:6 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5340d00f0 msgr2=0x7fc5340c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5340d00f0 0x7fc5340c7ff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc52800e9f0 tx=0x7fc52800eeb0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 shutdown_connections 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5340d29b0 0x7fc534152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5340d04d0 0x7fc534151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 --2- 172.21.15.149:0/2784023947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5340d00f0 0x7fc5340c7ff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 >> 172.21.15.149:0/2784023947 conn(0x7fc5340d1e90 msgr2=0x7fc5340b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:59.188 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 shutdown_connections 2024-09-16T07:27:59.189 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.193+0000 7fc53c200640 1 -- 172.21.15.149:0/2784023947 wait complete. 2024-09-16T07:27:59.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c 7 2024-09-16T07:27:59.276 INFO:tasks.ceph.mgr.y.smithi114.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T07:27:59.276 INFO:tasks.ceph.mgr.y.smithi114.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T07:27:59.276 INFO:tasks.ceph.mgr.y.smithi114.stderr: from numpy import show_config as show_numpy_config 2024-09-16T07:27:59.348 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 -- 172.21.15.149:0/4247896490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074470 msgr2=0x7efc500b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 --2- 172.21.15.149:0/4247896490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074470 0x7efc500b3a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efc4000a950 tx=0x7efc4001dae0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 -- 172.21.15.149:0/4247896490 shutdown_connections 2024-09-16T07:27:59.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 --2- 172.21.15.149:0/4247896490 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074850 0x7efc500b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 --2- 172.21.15.149:0/4247896490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074470 0x7efc500b3a40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 -- 172.21.15.149:0/4247896490 >> 172.21.15.149:0/4247896490 conn(0x7efc500b1ce0 msgr2=0x7efc500b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:59.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 -- 172.21.15.149:0/4247896490 shutdown_connections 2024-09-16T07:27:59.349 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 -- 172.21.15.149:0/4247896490 wait complete. 2024-09-16T07:27:59.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 Processor -- start 2024-09-16T07:27:59.350 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.353+0000 7efc57000640 1 -- start start 2024-09-16T07:27:59.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5006ffc0 0x7efc501f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.352 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074470 0x7efc50145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074850 0x7efc50147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efc50073fa0 con 0x7efc50074850 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc50073e20 con 0x7efc5006ffc0 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efc50167010 con 0x7efc50074470 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074470 0x7efc50145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5006ffc0 0x7efc501f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074470 0x7efc50145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:47050/0 (socket says 172.21.15.149:47050) 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4f400640 1 -- 172.21.15.149:0/2999913258 learned_addr learned my addr 172.21.15.149:0/2999913258 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc55000640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074850 0x7efc50147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4fe00640 1 -- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074470 msgr2=0x7efc50145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4fe00640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074470 0x7efc50145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4fe00640 1 -- 172.21.15.149:0/2999913258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074850 msgr2=0x7efc50147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.353 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4fe00640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074850 0x7efc50147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4fe00640 1 -- 172.21.15.149:0/2999913258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc501f8560 con 0x7efc5006ffc0 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4f400640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074470 0x7efc50145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc4fe00640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5006ffc0 0x7efc501f7ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc400ad000 tx=0x7efc40003b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc47e00640 1 -- 172.21.15.149:0/2999913258 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc400b3040 con 0x7efc5006ffc0 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc47e00640 1 -- 172.21.15.149:0/2999913258 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc40003d60 con 0x7efc5006ffc0 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc47e00640 1 -- 172.21.15.149:0/2999913258 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40005ca0 con 0x7efc5006ffc0 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc501f8840 con 0x7efc5006ffc0 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501f8e00 con 0x7efc5006ffc0 2024-09-16T07:27:59.354 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc47e00640 1 -- 172.21.15.149:0/2999913258 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc400be060 con 0x7efc5006ffc0 2024-09-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc47e00640 1 -- 172.21.15.149:0/2999913258 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7efc400b7460 con 0x7efc5006ffc0 2024-09-16T07:27:59.355 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.357+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc50070450 con 0x7efc5006ffc0 2024-09-16T07:27:59.356 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.361+0000 7efc47e00640 1 -- 172.21.15.149:0/2999913258 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efc40017760 con 0x7efc5006ffc0 2024-09-16T07:27:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.429+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c", "id": 7} v 0) -- 0x7efc500cfe10 con 0x7efc5006ffc0 2024-09-16T07:27:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.433+0000 7efc47e00640 1 -- 172.21.15.149:0/2999913258 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7efc400046d0 con 0x7efc5006ffc0 2024-09-16T07:27:59.430 INFO:teuthology.orchestra.run.smithi149.stdout:7 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5006ffc0 msgr2=0x7efc501f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5006ffc0 0x7efc501f7ed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc400ad000 tx=0x7efc40003b70 comp rx=0 tx=0).stop 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 shutdown_connections 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc50074850 0x7efc50147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc50074470 0x7efc50145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 --2- 172.21.15.149:0/2999913258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5006ffc0 0x7efc501f7ed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 >> 172.21.15.149:0/2999913258 conn(0x7efc500b1ce0 msgr2=0x7efc5014f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 shutdown_connections 2024-09-16T07:27:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:27:59.437+0000 7efc57000640 1 -- 172.21.15.149:0/2999913258 wait complete. 2024-09-16T07:27:59.451 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:27:59.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T07:27:59.454 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:27:59.454 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:27:59.454 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T07:27:59.457 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:27:59.457 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:27:59.457 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T07:27:59.460 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:27:59.460 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T07:27:59.460 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T07:27:59.464 INFO:tasks.ceph.osd.3:Started 2024-09-16T07:27:59.464 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T07:27:59.464 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T07:27:59.468 INFO:tasks.ceph.osd.4:Started 2024-09-16T07:27:59.468 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T07:27:59.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T07:27:59.472 INFO:tasks.ceph.osd.5:Started 2024-09-16T07:27:59.473 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-16T07:27:59.473 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-16T07:27:59.477 INFO:tasks.ceph.osd.6:Started 2024-09-16T07:27:59.477 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-16T07:27:59.477 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-16T07:27:59.484 INFO:tasks.ceph.osd.7:Started 2024-09-16T07:27:59.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:27:59.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 -- 172.21.15.114:0/3570555097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f8074a50 msgr2=0x7f56f80ad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 --2- 172.21.15.114:0/3570555097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f8074a50 0x7f56f80ad000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009bc0 tx=0x7f56f001cba0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 -- 172.21.15.114:0/3570555097 shutdown_connections 2024-09-16T07:27:59.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 --2- 172.21.15.114:0/3570555097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f8074a50 0x7f56f80ad000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 --2- 172.21.15.114:0/3570555097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56f815f4f0 0x7f56f80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 -- 172.21.15.114:0/3570555097 >> 172.21.15.114:0/3570555097 conn(0x7f56f8073490 msgr2=0x7f56f80d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:59.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 -- 172.21.15.114:0/3570555097 shutdown_connections 2024-09-16T07:27:59.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 -- 172.21.15.114:0/3570555097 wait complete. 2024-09-16T07:27:59.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 Processor -- start 2024-09-16T07:27:59.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.658+0000 7f56fe400640 1 -- start start 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56f8074a50 0x7f56f815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f815f110 0x7f56f81527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56f815f4f0 0x7f56f8152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81684c0 con 0x7f56f815f110 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8168340 con 0x7f56f8074a50 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f56f8168640 con 0x7f56f815f4f0 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f815f110 0x7f56f81527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f815f110 0x7f56f81527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57258/0 (socket says 172.21.15.114:57258) 2024-09-16T07:27:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56f8074a50 0x7f56f815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 -- 172.21.15.114:0/2850267520 learned_addr learned my addr 172.21.15.114:0/2850267520 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:27:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fda00640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56f815f4f0 0x7f56f8152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:27:59.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 -- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56f815f4f0 msgr2=0x7f56f8152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56f815f4f0 0x7f56f8152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 -- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56f8074a50 msgr2=0x7f56f815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56f8074a50 0x7f56f815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 -- 172.21.15.114:0/2850267520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f815af50 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fd000640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56f8074a50 0x7f56f815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f7e00640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f815f110 0x7f56f81527a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56e400e770 tx=0x7f56e400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f4c00640 1 -- 172.21.15.114:0/2850267520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e400ccc0 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f4c00640 1 -- 172.21.15.114:0/2850267520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56e400ce60 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f4c00640 1 -- 172.21.15.114:0/2850267520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4004280 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f81f8e40 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f81fbb30 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f4c00640 1 -- 172.21.15.114:0/2850267520 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56e4004b80 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56f4c00640 1 -- 172.21.15.114:0/2850267520 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f56e4004420 con 0x7f56f815f110 2024-09-16T07:27:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.662+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f81fb640 con 0x7f56f815f110 2024-09-16T07:27:59.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.666+0000 7f56f4c00640 1 -- 172.21.15.114:0/2850267520 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f56e4004e70 con 0x7f56f815f110 2024-09-16T07:27:59.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56f80ad000 con 0x7f56f815f110 2024-09-16T07:27:59.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56f4c00640 1 -- 172.21.15.114:0/2850267520 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f56e4005050 con 0x7f56f815f110 2024-09-16T07:27:59.729 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:27:59.730 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:27:59.427807+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f815f110 msgr2=0x7f56f81527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f815f110 0x7f56f81527a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56e400e770 tx=0x7f56e400ec30 comp rx=0 tx=0).stop 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 shutdown_connections 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f56f815f4f0 0x7f56f8152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56f815f110 0x7f56f81527a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 --2- 172.21.15.114:0/2850267520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56f8074a50 0x7f56f815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 >> 172.21.15.114:0/2850267520 conn(0x7f56f8073490 msgr2=0x7f56f80ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 shutdown_connections 2024-09-16T07:27:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:27:59.726+0000 7f56fe400640 1 -- 172.21.15.114:0/2850267520 wait complete. 2024-09-16T07:27:59.750 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T07:27:59.750 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T07:28:00.556 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:00.689 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 -- 172.21.15.114:0/1471097695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc0cca90 msgr2=0x7ff2dc0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:00.690 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 --2- 172.21.15.114:0/1471097695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc0cca90 0x7ff2dc0cce70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009840 tx=0x7ff2cc01c820 comp rx=0 tx=0).stop 2024-09-16T07:28:00.690 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 -- 172.21.15.114:0/1471097695 shutdown_connections 2024-09-16T07:28:00.690 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 --2- 172.21.15.114:0/1471097695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2dc0704c0 0x7ff2dc073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:00.690 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 --2- 172.21.15.114:0/1471097695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc0cca90 0x7ff2dc0cce70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:00.690 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 -- 172.21.15.114:0/1471097695 >> 172.21.15.114:0/1471097695 conn(0x7ff2dc0d0c80 msgr2=0x7ff2dc0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:00.690 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 -- 172.21.15.114:0/1471097695 shutdown_connections 2024-09-16T07:28:00.690 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.686+0000 7ff2e2200640 1 -- 172.21.15.114:0/1471097695 wait complete. 2024-09-16T07:28:00.691 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 Processor -- start 2024-09-16T07:28:00.691 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 -- start start 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc070080 0x7ff2dc152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2dc0cca90 0x7ff2dc0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2dc15bfc0 0x7ff2dc14ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc169090 con 0x7ff2dc0cca90 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc159ca0 con 0x7ff2dc070080 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc169210 con 0x7ff2dc15bfc0 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2daa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2dc0cca90 0x7ff2dc0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2daa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2dc0cca90 0x7ff2dc0ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57268/0 (socket says 172.21.15.114:57268) 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2daa00640 1 -- 172.21.15.114:0/849958296 learned_addr learned my addr 172.21.15.114:0/849958296 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2db400640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc070080 0x7ff2dc152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:00.693 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2dbe00640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2dc15bfc0 0x7ff2dc14ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:00.694 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2db400640 1 -- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2dc15bfc0 msgr2=0x7ff2dc14ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:00.694 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2db400640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2dc15bfc0 0x7ff2dc14ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:00.694 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2db400640 1 -- 172.21.15.114:0/849958296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2dc0cca90 msgr2=0x7ff2dc0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:00.694 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2db400640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2dc0cca90 0x7ff2dc0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:00.694 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2db400640 1 -- 172.21.15.114:0/849958296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc1650b0 con 0x7ff2dc070080 2024-09-16T07:28:00.694 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2db400640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc070080 0x7ff2dc152e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0ac000 tx=0x7ff2cc0a5670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2d3400640 1 -- 172.21.15.114:0/849958296 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0bc070 con 0x7ff2dc070080 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2d3400640 1 -- 172.21.15.114:0/849958296 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2cc0043b0 con 0x7ff2dc070080 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2d3400640 1 -- 172.21.15.114:0/849958296 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0b2040 con 0x7ff2dc070080 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc1fb610 con 0x7ff2dc070080 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc1fbbd0 con 0x7ff2dc070080 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2d3400640 1 -- 172.21.15.114:0/849958296 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2cc003860 con 0x7ff2dc070080 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.690+0000 7ff2d3400640 1 -- 172.21.15.114:0/849958296 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff2cc0adc50 con 0x7ff2dc070080 2024-09-16T07:28:00.695 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.694+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2dc073630 con 0x7ff2dc070080 2024-09-16T07:28:00.698 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.698+0000 7ff2d3400640 1 -- 172.21.15.114:0/849958296 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff2cc0d7860 con 0x7ff2dc070080 2024-09-16T07:28:00.758 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2dc153da0 con 0x7ff2dc070080 2024-09-16T07:28:00.759 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2d3400640 1 -- 172.21.15.114:0/849958296 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff2cc0c5030 con 0x7ff2dc070080 2024-09-16T07:28:00.759 INFO:teuthology.misc.health.smithi114.stdout: 2024-09-16T07:28:00.759 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:27:59.427807+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:00.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc070080 msgr2=0x7ff2dc152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:00.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc070080 0x7ff2dc152e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0ac000 tx=0x7ff2cc0a5670 comp rx=0 tx=0).stop 2024-09-16T07:28:00.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 shutdown_connections 2024-09-16T07:28:00.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff2dc15bfc0 0x7ff2dc14ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:00.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2dc0cca90 0x7ff2dc0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:00.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 --2- 172.21.15.114:0/849958296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2dc070080 0x7ff2dc152e30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:00.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 >> 172.21.15.114:0/849958296 conn(0x7ff2dc0d0c80 msgr2=0x7ff2dc157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:00.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 shutdown_connections 2024-09-16T07:28:00.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:00.758+0000 7ff2e2200640 1 -- 172.21.15.114:0/849958296 wait complete. 2024-09-16T07:28:00.776 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-16T07:28:00.951 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-16T07:28:00.950+0000 7fc1675437c0 -1 Falling back to public interface 2024-09-16T07:28:00.999 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-16T07:28:00.998+0000 7ff6c3b967c0 -1 Falling back to public interface 2024-09-16T07:28:01.140 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-16T07:28:01.145+0000 7f70975d67c0 -1 Falling back to public interface 2024-09-16T07:28:01.157 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-16T07:28:01.161+0000 7f2cb16287c0 -1 Falling back to public interface 2024-09-16T07:28:01.157 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-16T07:28:01.161+0000 7f36dc5437c0 -1 Falling back to public interface 2024-09-16T07:28:01.168 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-16T07:28:01.173+0000 7f716f5a97c0 -1 Falling back to public interface 2024-09-16T07:28:01.179 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-16T07:28:01.178+0000 7f3a7122b7c0 -1 Falling back to public interface 2024-09-16T07:28:01.456 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-16T07:28:01.454+0000 7f63acab27c0 -1 Falling back to public interface 2024-09-16T07:28:01.996 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:28:02.001+0000 7f1853e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-16T07:28:01.997 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:28:02.001+0000 7f1853e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-16T07:28:05.102 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-16T07:28:05.098+0000 7fc1675437c0 -1 osd.2 0 log_to_monitors true 2024-09-16T07:28:05.398 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-16T07:28:05.394+0000 7ff6c3b967c0 -1 osd.0 0 log_to_monitors true 2024-09-16T07:28:05.404 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-16T07:28:05.408+0000 7f716f5a97c0 -1 osd.6 0 log_to_monitors true 2024-09-16T07:28:05.466 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-16T07:28:05.468+0000 7f2cb16287c0 -1 osd.4 0 log_to_monitors true 2024-09-16T07:28:05.631 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-16T07:28:05.632+0000 7f70975d67c0 -1 osd.5 0 log_to_monitors true 2024-09-16T07:28:05.635 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-16T07:28:05.634+0000 7f3a7122b7c0 -1 osd.1 0 log_to_monitors true 2024-09-16T07:28:05.738 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-16T07:28:05.740+0000 7f36dc5437c0 -1 osd.7 0 log_to_monitors true 2024-09-16T07:28:05.859 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-16T07:28:05.858+0000 7f63acab27c0 -1 osd.3 0 log_to_monitors true 2024-09-16T07:28:07.230 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-16T07:28:07.226+0000 7fc162e00640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T07:28:07.409 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-16T07:28:07.406+0000 7fc158400640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:07.584 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:07.754 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 -- 172.21.15.114:0/4095756691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 msgr2=0x7fbfd80ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:07.754 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 --2- 172.21.15.114:0/4095756691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 0x7fbfd80ce740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009bc0 tx=0x7fbfd001cba0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.754 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 -- 172.21.15.114:0/4095756691 shutdown_connections 2024-09-16T07:28:07.754 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 --2- 172.21.15.114:0/4095756691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 0x7fbfd80ce740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.754 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 --2- 172.21.15.114:0/4095756691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfd815bfa0 0x7fbfd80cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.755 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 -- 172.21.15.114:0/4095756691 >> 172.21.15.114:0/4095756691 conn(0x7fbfd80d1d30 msgr2=0x7fbfd80d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:07.755 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 -- 172.21.15.114:0/4095756691 shutdown_connections 2024-09-16T07:28:07.755 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.750+0000 7fbfdd400640 1 -- 172.21.15.114:0/4095756691 wait complete. 2024-09-16T07:28:07.756 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 Processor -- start 2024-09-16T07:28:07.756 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 -- start start 2024-09-16T07:28:07.758 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 0x7fbfd80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:07.758 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfd80cfe40 0x7fbfd80b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:07.758 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfd81fbe10 0x7fbfd815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:07.758 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8169690 con 0x7fbfd80c5f90 2024-09-16T07:28:07.758 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8169510 con 0x7fbfd81fbe10 2024-09-16T07:28:07.759 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfdd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd8169810 con 0x7fbfd80cfe40 2024-09-16T07:28:07.759 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.754+0000 7fbfd6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 0x7fbfd80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:07.759 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 0x7fbfd80cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33476/0 (socket says 172.21.15.114:33476) 2024-09-16T07:28:07.759 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd6800640 1 -- 172.21.15.114:0/1721075680 learned_addr learned my addr 172.21.15.114:0/1721075680 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd7200640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfd81fbe10 0x7fbfd815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd5e00640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfd80cfe40 0x7fbfd80b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd5e00640 1 -- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfd81fbe10 msgr2=0x7fbfd815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd5e00640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfd81fbe10 0x7fbfd815eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd5e00640 1 -- 172.21.15.114:0/1721075680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 msgr2=0x7fbfd80cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd5e00640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 0x7fbfd80cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd5e00640 1 -- 172.21.15.114:0/1721075680 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd81f87f0 con 0x7fbfd80cfe40 2024-09-16T07:28:07.760 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd7200640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfd81fbe10 0x7fbfd815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:07.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfd5e00640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfd80cfe40 0x7fbfd80b5cb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80c5580 tx=0x7fbfc400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:07.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfcea00640 1 -- 172.21.15.114:0/1721075680 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40068a0 con 0x7fbfd80cfe40 2024-09-16T07:28:07.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfcea00640 1 -- 172.21.15.114:0/1721075680 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfc4006b30 con 0x7fbfd80cfe40 2024-09-16T07:28:07.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfcea00640 1 -- 172.21.15.114:0/1721075680 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4007020 con 0x7fbfd80cfe40 2024-09-16T07:28:07.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd81fc2f0 con 0x7fbfd80cfe40 2024-09-16T07:28:07.761 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd81fc8b0 con 0x7fbfd80cfe40 2024-09-16T07:28:07.762 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.758+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd81f89c0 con 0x7fbfd80cfe40 2024-09-16T07:28:07.763 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.762+0000 7fbfcea00640 1 -- 172.21.15.114:0/1721075680 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 4) ==== 97024+0+0 (secure 0 0 0) 0x7fbfc4019020 con 0x7fbfd80cfe40 2024-09-16T07:28:07.764 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.762+0000 7fbfcea00640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfb8072e30 0x7fbfb80752f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:07.765 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.762+0000 7fbfcea00640 1 -- 172.21.15.114:0/1721075680 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7fbfc4092310 con 0x7fbfd80cfe40 2024-09-16T07:28:07.765 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.762+0000 7fbfd6800640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfb8072e30 0x7fbfb80752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:07.765 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.762+0000 7fbfd6800640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfb8072e30 0x7fbfb80752f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009c00 tx=0x7fbfc8005f40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:07.773 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.770+0000 7fbfcea00640 1 -- 172.21.15.114:0/1721075680 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbfd81f89c0 con 0x7fbfd80cfe40 2024-09-16T07:28:07.981 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.978+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfd80ce0d0 con 0x7fbfd80cfe40 2024-09-16T07:28:07.982 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.978+0000 7fbfcea00640 1 -- 172.21.15.114:0/1721075680 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7fbfc4020020 con 0x7fbfd80cfe40 2024-09-16T07:28:07.982 INFO:teuthology.misc.health.smithi114.stdout: 2024-09-16T07:28:07.982 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":13,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:07.162735+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:07.984 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfb8072e30 msgr2=0x7fbfb80752f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:07.984 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfb8072e30 0x7fbfb80752f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8009c00 tx=0x7fbfc8005f40 comp rx=0 tx=0).stop 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfd80cfe40 msgr2=0x7fbfd80b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfd80cfe40 0x7fbfd80b5cb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80c5580 tx=0x7fbfc400c820 comp rx=0 tx=0).stop 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 shutdown_connections 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfb8072e30 0x7fbfb80752f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfd81fbe10 0x7fbfd815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfd80cfe40 0x7fbfd80b5cb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 --2- 172.21.15.114:0/1721075680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfd80c5f90 0x7fbfd80cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 >> 172.21.15.114:0/1721075680 conn(0x7fbfd80d1d30 msgr2=0x7fbfd815b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 shutdown_connections 2024-09-16T07:28:07.985 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:07.982+0000 7fbfdd400640 1 -- 172.21.15.114:0/1721075680 wait complete. 2024-09-16T07:28:08.006 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-16T07:28:08.954 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-16T07:28:08.950+0000 7f63a7a00640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T07:28:08.960 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-16T07:28:08.958+0000 7ff6bf400640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T07:28:08.984 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-16T07:28:08.982+0000 7f639da00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:08.999 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-16T07:28:08.998+0000 7ff6b4a00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:09.054 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-16T07:28:09.050+0000 7f3a6b600640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T07:28:09.080 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-16T07:28:09.078+0000 7f3a61600640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:09.376 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-16T07:28:09.376+0000 7f2cac400640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T07:28:09.412 INFO:tasks.ceph.osd.4.smithi149.stderr:2024-09-16T07:28:09.416+0000 7f2ca2400640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:09.435 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-16T07:28:09.436+0000 7f716a400640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T07:28:09.486 INFO:tasks.ceph.osd.6.smithi149.stderr:2024-09-16T07:28:09.488+0000 7f7160400640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:09.486 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-16T07:28:09.488+0000 7f36d7e00640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T07:28:09.501 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-16T07:28:09.504+0000 7f7092400640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T07:28:09.529 INFO:tasks.ceph.osd.7.smithi149.stderr:2024-09-16T07:28:09.532+0000 7f36cd400640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:09.537 INFO:tasks.ceph.osd.5.smithi149.stderr:2024-09-16T07:28:09.540+0000 7f7088400640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T07:28:14.813 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:14.955 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- 172.21.15.114:0/1891662004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 msgr2=0x7f9c5415bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:14.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 --2- 172.21.15.114:0/1891662004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c5415bd60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c540c35e0 tx=0x7f9c4801c720 comp rx=0 tx=0).stop 2024-09-16T07:28:14.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- 172.21.15.114:0/1891662004 shutdown_connections 2024-09-16T07:28:14.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 --2- 172.21.15.114:0/1891662004 >> v2:172.21.15.149:3300/0 conn(0x7f9c540b1560 0x7f9c540b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:14.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 --2- 172.21.15.114:0/1891662004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c5415bd60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:14.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- 172.21.15.114:0/1891662004 >> 172.21.15.114:0/1891662004 conn(0x7f9c540cc560 msgr2=0x7f9c540cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:14.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- 172.21.15.114:0/1891662004 shutdown_connections 2024-09-16T07:28:14.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- 172.21.15.114:0/1891662004 wait complete. 2024-09-16T07:28:14.957 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 Processor -- start 2024-09-16T07:28:14.957 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- start start 2024-09-16T07:28:14.959 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5406fd90 0x7f9c540cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:14.959 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c540b1560 0x7f9c540c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c540c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c54073920 con 0x7f9c5415b980 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c540737a0 con 0x7f9c5406fd90 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9c54073aa0 con 0x7f9c540b1560 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c540c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c540c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50252/0 (socket says 172.21.15.114:50252) 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 -- 172.21.15.114:0/2679965422 learned_addr learned my addr 172.21.15.114:0/2679965422 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c59c00640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5406fd90 0x7f9c540cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c59200640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c540b1560 0x7f9c540c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:14.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 -- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c540b1560 msgr2=0x7f9c540c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c540b1560 0x7f9c540c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 -- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5406fd90 msgr2=0x7f9c540cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5406fd90 0x7f9c540cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.953+0000 7f9c5a600640 1 -- 172.21.15.114:0/2679965422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c540c4810 con 0x7f9c5415b980 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c5a600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c540c6120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00eab0 tx=0x7f9c4c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c51600640 1 -- 172.21.15.114:0/2679965422 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00ce40 con 0x7f9c5415b980 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c51600640 1 -- 172.21.15.114:0/2679965422 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c4c004b30 con 0x7f9c5415b980 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c540b2e80 con 0x7f9c5415b980 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c51600640 1 -- 172.21.15.114:0/2679965422 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c005020 con 0x7f9c5415b980 2024-09-16T07:28:14.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c540b3440 con 0x7f9c5415b980 2024-09-16T07:28:14.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c540b19f0 con 0x7f9c5415b980 2024-09-16T07:28:14.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.957+0000 7f9c51600640 1 -- 172.21.15.114:0/2679965422 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f9c4c0051c0 con 0x7f9c5415b980 2024-09-16T07:28:14.963 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.961+0000 7f9c51600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9c34072ef0 0x7f9c340753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:14.963 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.961+0000 7f9c51600640 1 -- 172.21.15.114:0/2679965422 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f9c4c094540 con 0x7f9c5415b980 2024-09-16T07:28:14.963 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.961+0000 7f9c59c00640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9c34072ef0 0x7f9c340753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:14.964 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.961+0000 7f9c59c00640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9c34072ef0 0x7f9c340753b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c480af000 tx=0x7f9c4801af60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:14.968 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:14.965+0000 7f9c51600640 1 -- 172.21.15.114:0/2679965422 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9c4c05f480 con 0x7f9c5415b980 2024-09-16T07:28:15.137 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.133+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c54069800 con 0x7f9c5415b980 2024-09-16T07:28:15.138 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.133+0000 7f9c51600640 1 -- 172.21.15.114:0/2679965422 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12944 (secure 0 0 0) 0x7f9c4c063eb0 con 0x7f9c5415b980 2024-09-16T07:28:15.138 INFO:teuthology.misc.health.smithi114.stdout: 2024-09-16T07:28:15.138 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":18,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:13.397589+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9c34072ef0 msgr2=0x7f9c340753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9c34072ef0 0x7f9c340753b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c480af000 tx=0x7f9c4801af60 comp rx=0 tx=0).stop 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 msgr2=0x7f9c540c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c540c6120 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00eab0 tx=0x7f9c4c00ef70 comp rx=0 tx=0).stop 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 shutdown_connections 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9c34072ef0 0x7f9c340753b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c5415b980 0x7f9c540c6120 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.140 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c540b1560 0x7f9c540c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.141 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 --2- 172.21.15.114:0/2679965422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c5406fd90 0x7f9c540cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.141 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 >> 172.21.15.114:0/2679965422 conn(0x7f9c540cc560 msgr2=0x7f9c540cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:15.141 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 shutdown_connections 2024-09-16T07:28:15.141 INFO:teuthology.misc.health.smithi114.stderr:2024-09-16T07:28:15.137+0000 7f9c5c600640 1 -- 172.21.15.114:0/2679965422 wait complete. 2024-09-16T07:28:15.158 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-16T07:28:15.158 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T07:28:15.158 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:28:15.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:28:15.162 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:28:15.162 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:28:15.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:28:15.165 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:28:15.165 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:28:15.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:28:15.169 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:28:15.169 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:28:15.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:28:15.172 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:28:15.173 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-16T07:28:15.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:15.256 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:28:15.257 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:28:15.284 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:28:15.285 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:28:15.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 -- 172.21.15.114:0/817217060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c071030 msgr2=0x7f646c0714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 --2- 172.21.15.114:0/817217060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c071030 0x7f646c0714a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6464009bf0 tx=0x7f646401cb70 comp rx=0 tx=0).stop 2024-09-16T07:28:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 -- 172.21.15.114:0/817217060 shutdown_connections 2024-09-16T07:28:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 --2- 172.21.15.114:0/817217060 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c071030 0x7f646c0714a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 --2- 172.21.15.114:0/817217060 >> v2:172.21.15.149:3300/0 conn(0x7f646c0737c0 0x7f646c15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 -- 172.21.15.114:0/817217060 >> 172.21.15.114:0/817217060 conn(0x7f646c0d0c90 msgr2=0x7f646c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 -- 172.21.15.114:0/817217060 shutdown_connections 2024-09-16T07:28:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 -- 172.21.15.114:0/817217060 wait complete. 2024-09-16T07:28:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 Processor -- start 2024-09-16T07:28:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 -- start start 2024-09-16T07:28:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.321+0000 7f6471a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c06cc20 0x7f646c0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f646c071030 0x7f646c155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f646c0737c0 0x7f646c1fae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f646c168f60 con 0x7f646c071030 2024-09-16T07:28:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f646c168de0 con 0x7f646c0737c0 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f646c1690e0 con 0x7f646c06cc20 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f646c071030 0x7f646c155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f646c071030 0x7f646c155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50272/0 (socket says 172.21.15.114:50272) 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 -- 172.21.15.114:0/3511867085 learned_addr learned my addr 172.21.15.114:0/3511867085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646b400640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f646c0737c0 0x7f646c1fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646aa00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c06cc20 0x7f646c0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 -- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c06cc20 msgr2=0x7f646c0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c06cc20 0x7f646c0b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 -- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f646c0737c0 msgr2=0x7f646c1fae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f646c0737c0 0x7f646c1fae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 -- 172.21.15.114:0/3511867085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c1f7800 con 0x7f646c071030 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646b400640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f646c0737c0 0x7f646c1fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f646a000640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f646c071030 0x7f646c155210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f645800e7d0 tx=0x7f645800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6462a00640 1 -- 172.21.15.114:0/3511867085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645800ccc0 con 0x7f646c071030 2024-09-16T07:28:15.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6462a00640 1 -- 172.21.15.114:0/3511867085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6458010430 con 0x7f646c071030 2024-09-16T07:28:15.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f646c166900 con 0x7f646c071030 2024-09-16T07:28:15.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6462a00640 1 -- 172.21.15.114:0/3511867085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458010860 con 0x7f646c071030 2024-09-16T07:28:15.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f646c0b64c0 con 0x7f646c071030 2024-09-16T07:28:15.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646c0714a0 con 0x7f646c071030 2024-09-16T07:28:15.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.325+0000 7f6462a00640 1 -- 172.21.15.114:0/3511867085 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6458010a00 con 0x7f646c071030 2024-09-16T07:28:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.329+0000 7f6462a00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f644c072ec0 0x7f644c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.329+0000 7f6462a00640 1 -- 172.21.15.114:0/3511867085 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6458094540 con 0x7f646c071030 2024-09-16T07:28:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.329+0000 7f646aa00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f644c072ec0 0x7f644c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.329+0000 7f646aa00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f644c072ec0 0x7f644c075380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f645c0016e0 tx=0x7f645c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:15.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.333+0000 7f6462a00640 1 -- 172.21.15.114:0/3511867085 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f645805fad0 con 0x7f646c071030 2024-09-16T07:28:15.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f646c0b6c10 con 0x7f646c071030 2024-09-16T07:28:15.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6462a00640 1 -- 172.21.15.114:0/3511867085 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f645805f3d0 con 0x7f646c071030 2024-09-16T07:28:15.540 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:15.540 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"btime":"2024-09-16T07:28:15:270090+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T07:28:15.540 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2024-09-16T07:28:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f644c072ec0 msgr2=0x7f644c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f644c072ec0 0x7f644c075380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f645c0016e0 tx=0x7f645c009040 comp rx=0 tx=0).stop 2024-09-16T07:28:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f646c071030 msgr2=0x7f646c155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f646c071030 0x7f646c155210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f645800e7d0 tx=0x7f645800ec90 comp rx=0 tx=0).stop 2024-09-16T07:28:15.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 shutdown_connections 2024-09-16T07:28:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f644c072ec0 0x7f644c075380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f646c0737c0 0x7f646c1fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f646c071030 0x7f646c155210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 --2- 172.21.15.114:0/3511867085 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f646c06cc20 0x7f646c0b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 >> 172.21.15.114:0/3511867085 conn(0x7f646c0d0c90 msgr2=0x7f646c15abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 shutdown_connections 2024-09-16T07:28:15.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:15.537+0000 7f6471a00640 1 -- 172.21.15.114:0/3511867085 wait complete. 2024-09-16T07:28:17.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:28:17.415 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:28:17.561 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 -- 172.21.15.114:0/410599099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c15bea0 msgr2=0x7fd43c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 --2- 172.21.15.114:0/410599099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c15bea0 0x7fd43c0ce670 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0cc3a0 tx=0x7fd42c01c770 comp rx=0 tx=0).stop 2024-09-16T07:28:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 -- 172.21.15.114:0/410599099 shutdown_connections 2024-09-16T07:28:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 --2- 172.21.15.114:0/410599099 >> v2:172.21.15.149:3300/0 conn(0x7fd43c0d28e0 0x7fd43c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 --2- 172.21.15.114:0/410599099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c15bea0 0x7fd43c0ce670 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 -- 172.21.15.114:0/410599099 >> 172.21.15.114:0/410599099 conn(0x7fd43c0d1dc0 msgr2=0x7fd43c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 -- 172.21.15.114:0/410599099 shutdown_connections 2024-09-16T07:28:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 -- 172.21.15.114:0/410599099 wait complete. 2024-09-16T07:28:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 Processor -- start 2024-09-16T07:28:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.709+0000 7fd441600640 1 -- start start 2024-09-16T07:28:17.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c0cdb30 0x7fd43c0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c0d28e0 0x7fd43c159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c15bea0 0x7fd43c0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c168fc0 con 0x7fd43c0d28e0 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c168e40 con 0x7fd43c0cdb30 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c169140 con 0x7fd43c15bea0 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c0d28e0 0x7fd43c159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c0d28e0 0x7fd43c159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50300/0 (socket says 172.21.15.114:50300) 2024-09-16T07:28:17.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 -- 172.21.15.114:0/4111165968 learned_addr learned my addr 172.21.15.114:0/4111165968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd43b400640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c15bea0 0x7fd43c0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd43aa00640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c0cdb30 0x7fd43c0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 -- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c15bea0 msgr2=0x7fd43c0c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c15bea0 0x7fd43c0c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 -- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c0cdb30 msgr2=0x7fd43c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c0cdb30 0x7fd43c0b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 -- 172.21.15.114:0/4111165968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c0b34b0 con 0x7fd43c0d28e0 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd43aa00640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c0cdb30 0x7fd43c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd432000640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c0d28e0 0x7fd43c159430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c490 tx=0x7fd42400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd433400640 1 -- 172.21.15.114:0/4111165968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424016020 con 0x7fd43c0d28e0 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd433400640 1 -- 172.21.15.114:0/4111165968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd424012940 con 0x7fd43c0d28e0 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c0b1b50 con 0x7fd43c0d28e0 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd433400640 1 -- 172.21.15.114:0/4111165968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424012d90 con 0x7fd43c0d28e0 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c0b2110 con 0x7fd43c0d28e0 2024-09-16T07:28:17.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.713+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43c0cc9d0 con 0x7fd43c0d28e0 2024-09-16T07:28:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.717+0000 7fd433400640 1 -- 172.21.15.114:0/4111165968 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fd424019020 con 0x7fd43c0d28e0 2024-09-16T07:28:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.717+0000 7fd433400640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd418072ec0 0x7fd418075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.717+0000 7fd433400640 1 -- 172.21.15.114:0/4111165968 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fd424093790 con 0x7fd43c0d28e0 2024-09-16T07:28:17.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.717+0000 7fd43aa00640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd418072ec0 0x7fd418075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:17.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.717+0000 7fd43aa00640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd418072ec0 0x7fd418075380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0af000 tx=0x7fd42c01afb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:17.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.721+0000 7fd433400640 1 -- 172.21.15.114:0/4111165968 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd424020030 con 0x7fd43c0d28e0 2024-09-16T07:28:17.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.921+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd43c0b3970 con 0x7fd43c0d28e0 2024-09-16T07:28:17.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.921+0000 7fd433400640 1 -- 172.21.15.114:0/4111165968 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7fd42405ede0 con 0x7fd43c0d28e0 2024-09-16T07:28:17.927 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:17.927 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"btime":"2024-09-16T07:28:16:271605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T07:28:17.927 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2024-09-16T07:28:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd418072ec0 msgr2=0x7fd418075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd418072ec0 0x7fd418075380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0af000 tx=0x7fd42c01afb0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c0d28e0 msgr2=0x7fd43c159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c0d28e0 0x7fd43c159430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c490 tx=0x7fd42400c950 comp rx=0 tx=0).stop 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 shutdown_connections 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd418072ec0 0x7fd418075380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd43c15bea0 0x7fd43c0c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd43c0d28e0 0x7fd43c159430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 --2- 172.21.15.114:0/4111165968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd43c0cdb30 0x7fd43c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 >> 172.21.15.114:0/4111165968 conn(0x7fd43c0d1dc0 msgr2=0x7fd43c0b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 shutdown_connections 2024-09-16T07:28:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:17.925+0000 7fd441600640 1 -- 172.21.15.114:0/4111165968 wait complete. 2024-09-16T07:28:17.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:28:18.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 -- 172.21.15.114:0/1747306234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481617b0 msgr2=0x7f4d480d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/1747306234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481617b0 0x7f4d480d0a80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d4806a160 tx=0x7f4d3001c890 comp rx=0 tx=0).stop 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 -- 172.21.15.114:0/1747306234 shutdown_connections 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/1747306234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481617b0 0x7f4d480d0a80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/1747306234 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d480d0fc0 0x7f4d480d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/1747306234 >> v2:172.21.15.149:3300/0 conn(0x7f4d481613d0 0x7f4d480d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 -- 172.21.15.114:0/1747306234 >> 172.21.15.114:0/1747306234 conn(0x7f4d480d3e00 msgr2=0x7f4d480d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 -- 172.21.15.114:0/1747306234 shutdown_connections 2024-09-16T07:28:18.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.085+0000 7f4d4ca00640 1 -- 172.21.15.114:0/1747306234 wait complete. 2024-09-16T07:28:18.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 Processor -- start 2024-09-16T07:28:18.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 -- start start 2024-09-16T07:28:18.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d480d0fc0 0x7f4d48151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481613d0 0x7f4d48150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d481617b0 0x7f4d480cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480b70e0 con 0x7f4d481613d0 2024-09-16T07:28:18.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480b6f60 con 0x7f4d481617b0 2024-09-16T07:28:18.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d480b7260 con 0x7f4d480d0fc0 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481613d0 0x7f4d48150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481613d0 0x7f4d48150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50326/0 (socket says 172.21.15.114:50326) 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 -- 172.21.15.114:0/3992477867 learned_addr learned my addr 172.21.15.114:0/3992477867 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d47400640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d480d0fc0 0x7f4d48151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d47e00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d481617b0 0x7f4d480cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 -- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d480d0fc0 msgr2=0x7f4d48151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d480d0fc0 0x7f4d48151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 -- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d481617b0 msgr2=0x7f4d480cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d481617b0 0x7f4d480cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 -- 172.21.15.114:0/3992477867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d480cdab0 con 0x7f4d481613d0 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d47400640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d480d0fc0 0x7f4d48151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3ea00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481613d0 0x7f4d48150080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d300b0040 tx=0x7f4d30005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:18.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3fe00640 1 -- 172.21.15.114:0/3992477867 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d300b2040 con 0x7f4d481613d0 2024-09-16T07:28:18.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3fe00640 1 -- 172.21.15.114:0/3992477867 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d30004240 con 0x7f4d481613d0 2024-09-16T07:28:18.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d480cdd90 con 0x7f4d481613d0 2024-09-16T07:28:18.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d3fe00640 1 -- 172.21.15.114:0/3992477867 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30005030 con 0x7f4d481613d0 2024-09-16T07:28:18.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d48151050 con 0x7f4d481613d0 2024-09-16T07:28:18.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.089+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d480caff0 con 0x7f4d481613d0 2024-09-16T07:28:18.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.093+0000 7f4d3fe00640 1 -- 172.21.15.114:0/3992477867 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f4d300051d0 con 0x7f4d481613d0 2024-09-16T07:28:18.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.093+0000 7f4d3fe00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d24072ef0 0x7f4d240753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.093+0000 7f4d3fe00640 1 -- 172.21.15.114:0/3992477867 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f4d3012d540 con 0x7f4d481613d0 2024-09-16T07:28:18.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.093+0000 7f4d47400640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d24072ef0 0x7f4d240753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:18.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.093+0000 7f4d47400640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d24072ef0 0x7f4d240753b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800bc70 tx=0x7f4d3800b2c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:18.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.097+0000 7f4d3fe00640 1 -- 172.21.15.114:0/3992477867 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4d300164b0 con 0x7f4d481613d0 2024-09-16T07:28:18.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.265+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4d480d19d0 con 0x7f4d481613d0 2024-09-16T07:28:18.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.265+0000 7f4d3fe00640 1 -- 172.21.15.114:0/3992477867 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f4d300f8ad0 con 0x7f4d481613d0 2024-09-16T07:28:18.271 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:18.271 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:28:18.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:28:18.271 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:28:18.271 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:28:18.271 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:28:18.271 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:28:18.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d24072ef0 msgr2=0x7f4d240753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d24072ef0 0x7f4d240753b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800bc70 tx=0x7f4d3800b2c0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481613d0 msgr2=0x7f4d48150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481613d0 0x7f4d48150080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d300b0040 tx=0x7f4d30005e90 comp rx=0 tx=0).stop 2024-09-16T07:28:18.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 shutdown_connections 2024-09-16T07:28:18.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d24072ef0 0x7f4d240753b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d481617b0 0x7f4d480cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d481613d0 0x7f4d48150080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 --2- 172.21.15.114:0/3992477867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d480d0fc0 0x7f4d48151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 >> 172.21.15.114:0/3992477867 conn(0x7f4d480d3e00 msgr2=0x7f4d480b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:18.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 shutdown_connections 2024-09-16T07:28:18.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.269+0000 7f4d4ca00640 1 -- 172.21.15.114:0/3992477867 wait complete. 2024-09-16T07:28:18.291 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:28:18.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:28:18.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.433+0000 7fce4ee00640 1 -- 172.21.15.114:0/1322475538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce2c004810 msgr2=0x7fce2c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.433+0000 7fce4ee00640 1 --2- 172.21.15.114:0/1322475538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce2c004810 0x7fce2c004c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce34009b60 tx=0x7fce3401d270 comp rx=0 tx=0).stop 2024-09-16T07:28:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.433+0000 7fce4ee00640 1 -- 172.21.15.114:0/1322475538 shutdown_connections 2024-09-16T07:28:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.433+0000 7fce4ee00640 1 --2- 172.21.15.114:0/1322475538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce2c004810 0x7fce2c004c90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.433+0000 7fce4ee00640 1 -- 172.21.15.114:0/1322475538 >> 172.21.15.114:0/1322475538 conn(0x7fce480d1dc0 msgr2=0x7fce480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.433+0000 7fce4ee00640 1 -- 172.21.15.114:0/1322475538 shutdown_connections 2024-09-16T07:28:18.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.433+0000 7fce4ee00640 1 -- 172.21.15.114:0/1322475538 wait complete. 2024-09-16T07:28:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 Processor -- start 2024-09-16T07:28:18.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 -- start start 2024-09-16T07:28:18.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce2c004810 0x7fce48155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce480c9780 0x7fce480c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce480cb4a0 0x7fce480cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce480cffc0 con 0x7fce480cb4a0 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce480cfe40 con 0x7fce480c9780 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce480d0140 con 0x7fce2c004810 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce480cb4a0 0x7fce480cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce480cb4a0 0x7fce480cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50352/0 (socket says 172.21.15.114:50352) 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 -- 172.21.15.114:0/874166294 learned_addr learned my addr 172.21.15.114:0/874166294 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 -- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce2c004810 msgr2=0x7fce48155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce2c004810 0x7fce48155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 -- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce480c9780 msgr2=0x7fce480c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce480c9780 0x7fce480c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 -- 172.21.15.114:0/874166294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce481f8320 con 0x7fce480cb4a0 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ce00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce480cb4a0 0x7fce480cb920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce480b0d90 tx=0x7fce4000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:18.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce3fe00640 1 -- 172.21.15.114:0/874166294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40003b80 con 0x7fce480cb4a0 2024-09-16T07:28:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce3fe00640 1 -- 172.21.15.114:0/874166294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce40003e10 con 0x7fce480cb4a0 2024-09-16T07:28:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce481f8600 con 0x7fce480cb4a0 2024-09-16T07:28:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce3fe00640 1 -- 172.21.15.114:0/874166294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4000b9e0 con 0x7fce480cb4a0 2024-09-16T07:28:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce481f8bc0 con 0x7fce480cb4a0 2024-09-16T07:28:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.437+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce481f8fa0 con 0x7fce480cb4a0 2024-09-16T07:28:18.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.441+0000 7fce3fe00640 1 -- 172.21.15.114:0/874166294 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fce4000bb80 con 0x7fce480cb4a0 2024-09-16T07:28:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.441+0000 7fce3fe00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce28072ef0 0x7fce280753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.441+0000 7fce3fe00640 1 -- 172.21.15.114:0/874166294 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fce40093e40 con 0x7fce480cb4a0 2024-09-16T07:28:18.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.441+0000 7fce47e00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce28072ef0 0x7fce280753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:18.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.441+0000 7fce47e00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce28072ef0 0x7fce280753b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce38000f70 tx=0x7fce38000ee0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:18.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.445+0000 7fce3fe00640 1 -- 172.21.15.114:0/874166294 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fce481f8fa0 con 0x7fce480cb4a0 2024-09-16T07:28:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:18.609+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fce480d06a0 con 0x7fce480cb4a0 2024-09-16T07:28:19.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.425+0000 7fce3fe00640 1 -- 172.21.15.114:0/874166294 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fce4005f340 con 0x7fce480cb4a0 2024-09-16T07:28:19.430 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:28:19.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce28072ef0 msgr2=0x7fce280753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:19.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce28072ef0 0x7fce280753b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce38000f70 tx=0x7fce38000ee0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce480cb4a0 msgr2=0x7fce480cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:19.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce480cb4a0 0x7fce480cb920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fce480b0d90 tx=0x7fce4000db50 comp rx=0 tx=0).stop 2024-09-16T07:28:19.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 shutdown_connections 2024-09-16T07:28:19.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce28072ef0 0x7fce280753b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce480cb4a0 0x7fce480cb920 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce480c9780 0x7fce480c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 --2- 172.21.15.114:0/874166294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce2c004810 0x7fce48155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 >> 172.21.15.114:0/874166294 conn(0x7fce480d1dc0 msgr2=0x7fce48070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:19.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 shutdown_connections 2024-09-16T07:28:19.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.429+0000 7fce4ee00640 1 -- 172.21.15.114:0/874166294 wait complete. 2024-09-16T07:28:19.462 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:28:19.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 -- 172.21.15.114:0/3802365425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 msgr2=0x7f55600acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:19.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 --2- 172.21.15.114:0/3802365425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55600acd40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5560070d30 tx=0x7f554801c7a0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 -- 172.21.15.114:0/3802365425 shutdown_connections 2024-09-16T07:28:19.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 --2- 172.21.15.114:0/3802365425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55600acd40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 --2- 172.21.15.114:0/3802365425 >> v2:172.21.15.149:3300/0 conn(0x7f55600cc620 0x7f55600b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 --2- 172.21.15.114:0/3802365425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f556006f8b0 0x7f556015dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 -- 172.21.15.114:0/3802365425 >> 172.21.15.114:0/3802365425 conn(0x7f55600b18f0 msgr2=0x7f55600b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:19.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 -- 172.21.15.114:0/3802365425 shutdown_connections 2024-09-16T07:28:19.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 -- 172.21.15.114:0/3802365425 wait complete. 2024-09-16T07:28:19.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 Processor -- start 2024-09-16T07:28:19.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.609+0000 7f5567200640 1 -- start start 2024-09-16T07:28:19.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556006f8b0 0x7f55601f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:19.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55600cc620 0x7f5560155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:19.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55601fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:19.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f55601672a0 con 0x7f55600cd100 2024-09-16T07:28:19.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5560167120 con 0x7f556006f8b0 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5560167420 con 0x7f55600cc620 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55601fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55601fb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50370/0 (socket says 172.21.15.114:50370) 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 -- 172.21.15.114:0/3707200209 learned_addr learned my addr 172.21.15.114:0/3707200209 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f555fe00640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556006f8b0 0x7f55601f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5557400640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55600cc620 0x7f5560155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 -- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55600cc620 msgr2=0x7f5560155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55600cc620 0x7f5560155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 -- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556006f8b0 msgr2=0x7f55601f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556006f8b0 0x7f55601f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 -- 172.21.15.114:0/3707200209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55601fbe60 con 0x7f55600cd100 2024-09-16T07:28:19.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5565200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55601fb3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f555800d750 tx=0x7f555800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:19.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f555cc00640 1 -- 172.21.15.114:0/3707200209 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558017070 con 0x7f55600cd100 2024-09-16T07:28:19.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f555cc00640 1 -- 172.21.15.114:0/3707200209 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5558009d20 con 0x7f55600cd100 2024-09-16T07:28:19.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55601fc140 con 0x7f55600cd100 2024-09-16T07:28:19.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f555cc00640 1 -- 172.21.15.114:0/3707200209 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555800de60 con 0x7f55600cd100 2024-09-16T07:28:19.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55601f7da0 con 0x7f55600cd100 2024-09-16T07:28:19.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.613+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5560069410 con 0x7f55600cd100 2024-09-16T07:28:19.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.617+0000 7f555cc00640 1 -- 172.21.15.114:0/3707200209 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5558005280 con 0x7f55600cd100 2024-09-16T07:28:19.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.617+0000 7f555cc00640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f553c072ec0 0x7f553c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:19.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.617+0000 7f555cc00640 1 -- 172.21.15.114:0/3707200209 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f5558093c30 con 0x7f55600cd100 2024-09-16T07:28:19.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.617+0000 7f555fe00640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f553c072ec0 0x7f553c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:19.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.617+0000 7f555fe00640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f553c072ec0 0x7f553c075380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5550009f00 tx=0x7f5550009650 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:19.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.621+0000 7f555cc00640 1 -- 172.21.15.114:0/3707200209 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f555805ea00 con 0x7f55600cd100 2024-09-16T07:28:19.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:19.789+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f55601f8540 con 0x7f55600cd100 2024-09-16T07:28:20.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.429+0000 7f555cc00640 1 -- 172.21.15.114:0/3707200209 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f5558063430 con 0x7f55600cd100 2024-09-16T07:28:20.434 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:28:20.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f553c072ec0 msgr2=0x7f553c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:20.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f553c072ec0 0x7f553c075380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5550009f00 tx=0x7f5550009650 comp rx=0 tx=0).stop 2024-09-16T07:28:20.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 msgr2=0x7f55601fb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:20.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55601fb3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f555800d750 tx=0x7f555800dc10 comp rx=0 tx=0).stop 2024-09-16T07:28:20.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 shutdown_connections 2024-09-16T07:28:20.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f553c072ec0 0x7f553c075380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:20.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55600cd100 0x7f55601fb3e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:20.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f55600cc620 0x7f5560155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:20.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 --2- 172.21.15.114:0/3707200209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556006f8b0 0x7f55601f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:20.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 >> 172.21.15.114:0/3707200209 conn(0x7f55600b18f0 msgr2=0x7f55600ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:20.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 shutdown_connections 2024-09-16T07:28:20.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.433+0000 7f5567200640 1 -- 172.21.15.114:0/3707200209 wait complete. 2024-09-16T07:28:20.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:28:20.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.613+0000 7f8cad800640 1 -- 172.21.15.114:0/1032981762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c8c004810 msgr2=0x7f8c8c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:20.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.613+0000 7f8cad800640 1 --2- 172.21.15.114:0/1032981762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c8c004810 0x7f8c8c004c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000c470 tx=0x7f8c9001cf40 comp rx=0 tx=0).stop 2024-09-16T07:28:20.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.613+0000 7f8ca7400640 1 -- 172.21.15.114:0/1032981762 reap_dead start 2024-09-16T07:28:20.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.613+0000 7f8cad800640 1 -- 172.21.15.114:0/1032981762 shutdown_connections 2024-09-16T07:28:20.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.613+0000 7f8cad800640 1 -- 172.21.15.114:0/1032981762 >> 172.21.15.114:0/1032981762 conn(0x7f8ca80d1da0 msgr2=0x7f8ca80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:20.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.613+0000 7f8cad800640 1 -- 172.21.15.114:0/1032981762 shutdown_connections 2024-09-16T07:28:20.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.613+0000 7f8cad800640 1 -- 172.21.15.114:0/1032981762 wait complete. 2024-09-16T07:28:20.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 Processor -- start 2024-09-16T07:28:20.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 -- start start 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c8c004810 0x7f8ca80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ca81f5330 0x7f8ca815f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca81f7ea0 0x7f8ca81f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca80ce870 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca80ce6f0 con 0x7f8c8c004810 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca81f58a0 con 0x7f8ca81f5330 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca81f7ea0 0x7f8ca81f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca81f7ea0 0x7f8ca81f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50384/0 (socket says 172.21.15.114:50384) 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 -- 172.21.15.114:0/1211118938 learned_addr learned my addr 172.21.15.114:0/1211118938 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:20.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca6a00640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c8c004810 0x7f8ca80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8c9fe00640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ca81f5330 0x7f8ca815f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 -- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ca81f5330 msgr2=0x7f8ca815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ca81f5330 0x7f8ca815f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 -- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c8c004810 msgr2=0x7f8ca80c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c8c004810 0x7f8ca80c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 -- 172.21.15.114:0/1211118938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca80ca760 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8ca7400640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca81f7ea0 0x7f8ca81f8350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80743f0 tx=0x7f8ca000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:20.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8c9ea00640 1 -- 172.21.15.114:0/1211118938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0004d30 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8c9ea00640 1 -- 172.21.15.114:0/1211118938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca0003980 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca815f740 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8c9ea00640 1 -- 172.21.15.114:0/1211118938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0003dd0 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.617+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca815cc20 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.621+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca80cea20 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.621+0000 7f8c9ea00640 1 -- 172.21.15.114:0/1211118938 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f8ca0020020 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.621+0000 7f8c9ea00640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c84072ec0 0x7f8c84075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.621+0000 7f8c9ea00640 1 -- 172.21.15.114:0/1211118938 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f8ca0095620 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.621+0000 7f8ca6a00640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c84072ec0 0x7f8c84075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:20.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.625+0000 7f8ca6a00640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c84072ec0 0x7f8c84075380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8159ba0 tx=0x7f8c980091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:20.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.625+0000 7f8c9ea00640 1 -- 172.21.15.114:0/1211118938 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8ca0027070 con 0x7f8ca81f7ea0 2024-09-16T07:28:20.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:20.829+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8ca80b7690 con 0x7f8ca81f7ea0 2024-09-16T07:28:21.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8c9ea00640 1 -- 172.21.15.114:0/1211118938 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8ca00609c0 con 0x7f8ca81f7ea0 2024-09-16T07:28:21.464 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c84072ec0 msgr2=0x7f8c84075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c84072ec0 0x7f8c84075380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8159ba0 tx=0x7f8c980091e0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca81f7ea0 msgr2=0x7f8ca81f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca81f7ea0 0x7f8ca81f8350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80743f0 tx=0x7f8ca000f790 comp rx=0 tx=0).stop 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 shutdown_connections 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c84072ec0 0x7f8c84075380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca81f7ea0 0x7f8ca81f8350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ca81f5330 0x7f8ca815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 --2- 172.21.15.114:0/1211118938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c8c004810 0x7f8ca80c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.461+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 >> 172.21.15.114:0/1211118938 conn(0x7f8ca80d1da0 msgr2=0x7f8ca80b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:21.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.465+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 shutdown_connections 2024-09-16T07:28:21.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.465+0000 7f8cad800640 1 -- 172.21.15.114:0/1211118938 wait complete. 2024-09-16T07:28:21.508 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 -- 172.21.15.114:0/3331339136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c0703d0 msgr2=0x7fd32c0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 --2- 172.21.15.114:0/3331339136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c0703d0 0x7fd32c0b42a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd314009900 tx=0x7fd31401c7f0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 -- 172.21.15.114:0/3331339136 shutdown_connections 2024-09-16T07:28:21.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 --2- 172.21.15.114:0/3331339136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c0703d0 0x7fd32c0b42a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 --2- 172.21.15.114:0/3331339136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c15a4d0 0x7fd32c15ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 -- 172.21.15.114:0/3331339136 >> 172.21.15.114:0/3331339136 conn(0x7fd32c0b18f0 msgr2=0x7fd32c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:21.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 -- 172.21.15.114:0/3331339136 shutdown_connections 2024-09-16T07:28:21.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.645+0000 7fd332a00640 1 -- 172.21.15.114:0/3331339136 wait complete. 2024-09-16T07:28:21.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 Processor -- start 2024-09-16T07:28:21.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 -- start start 2024-09-16T07:28:21.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c0703d0 0x7fd32c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:21.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c0b47e0 0x7fd32c153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:21.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c15a4d0 0x7fd32c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:21.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0cce00 con 0x7fd32c15a4d0 2024-09-16T07:28:21.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0ccc80 con 0x7fd32c0703d0 2024-09-16T07:28:21.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c0ccf80 con 0x7fd32c0b47e0 2024-09-16T07:28:21.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c15a4d0 0x7fd32c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:21.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c15a4d0 0x7fd32c0aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50404/0 (socket says 172.21.15.114:50404) 2024-09-16T07:28:21.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 -- 172.21.15.114:0/3622789822 learned_addr learned my addr 172.21.15.114:0/3622789822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:21.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd32be00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c0703d0 0x7fd32c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:21.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd323e00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c0b47e0 0x7fd32c153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:21.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 -- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c0b47e0 msgr2=0x7fd32c153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c0b47e0 0x7fd32c153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 -- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c0703d0 msgr2=0x7fd32c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c0703d0 0x7fd32c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 -- 172.21.15.114:0/3622789822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c158250 con 0x7fd32c15a4d0 2024-09-16T07:28:21.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd330a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c15a4d0 0x7fd32c0aef30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c730 tx=0x7fd32400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd328c00640 1 -- 172.21.15.114:0/3622789822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324003db0 con 0x7fd32c15a4d0 2024-09-16T07:28:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd328c00640 1 -- 172.21.15.114:0/3622789822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd32400ce40 con 0x7fd32c15a4d0 2024-09-16T07:28:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd328c00640 1 -- 172.21.15.114:0/3622789822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240052d0 con 0x7fd32c15a4d0 2024-09-16T07:28:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c158530 con 0x7fd32c15a4d0 2024-09-16T07:28:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.649+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c15bfa0 con 0x7fd32c15a4d0 2024-09-16T07:28:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.653+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c069410 con 0x7fd32c15a4d0 2024-09-16T07:28:21.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.653+0000 7fd328c00640 1 -- 172.21.15.114:0/3622789822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fd324005470 con 0x7fd32c15a4d0 2024-09-16T07:28:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.653+0000 7fd328c00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd308072ec0 0x7fd308075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.653+0000 7fd328c00640 1 -- 172.21.15.114:0/3622789822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd324093b80 con 0x7fd32c15a4d0 2024-09-16T07:28:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.653+0000 7fd32be00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd308072ec0 0x7fd308075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:21.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.653+0000 7fd32be00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd308072ec0 0x7fd308075380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00abb0 tx=0x7fd31c010040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:21.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.657+0000 7fd328c00640 1 -- 172.21.15.114:0/3622789822 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd32405e6e0 con 0x7fd32c15a4d0 2024-09-16T07:28:21.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.825+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd32c0b42a0 con 0x7fd32c15a4d0 2024-09-16T07:28:21.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd328c00640 1 -- 172.21.15.114:0/3622789822 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16726 (secure 0 0 0) 0x7fd324063110 con 0x7fd32c15a4d0 2024-09-16T07:28:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:21.832 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:20.836473+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd308072ec0 msgr2=0x7fd308075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd308072ec0 0x7fd308075380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00abb0 tx=0x7fd31c010040 comp rx=0 tx=0).stop 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c15a4d0 msgr2=0x7fd32c0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c15a4d0 0x7fd32c0aef30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd32400c730 tx=0x7fd32400cbf0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 shutdown_connections 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd308072ec0 0x7fd308075380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd32c15a4d0 0x7fd32c0aef30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd32c0b47e0 0x7fd32c153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 --2- 172.21.15.114:0/3622789822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd32c0703d0 0x7fd32c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 >> 172.21.15.114:0/3622789822 conn(0x7fd32c0b18f0 msgr2=0x7fd32c0af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:21.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 shutdown_connections 2024-09-16T07:28:21.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.829+0000 7fd332a00640 1 -- 172.21.15.114:0/3622789822 wait complete. 2024-09-16T07:28:21.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:21.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 -- 172.21.15.114:0/1438128058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158240 msgr2=0x7feccc15ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 --2- 172.21.15.114:0/1438128058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158240 0x7feccc15ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feccc073750 tx=0x7fecbc01c890 comp rx=0 tx=0).stop 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 -- 172.21.15.114:0/1438128058 shutdown_connections 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 --2- 172.21.15.114:0/1438128058 >> v2:172.21.15.149:3300/0 conn(0x7feccc161f70 0x7feccc0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 --2- 172.21.15.114:0/1438128058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feccc158620 0x7feccc161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 --2- 172.21.15.114:0/1438128058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158240 0x7feccc15ede0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 -- 172.21.15.114:0/1438128058 >> 172.21.15.114:0/1438128058 conn(0x7feccc0d0c90 msgr2=0x7feccc0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 -- 172.21.15.114:0/1438128058 shutdown_connections 2024-09-16T07:28:21.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 -- 172.21.15.114:0/1438128058 wait complete. 2024-09-16T07:28:21.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.989+0000 7fecd2c00640 1 Processor -- start 2024-09-16T07:28:21.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 -- start start 2024-09-16T07:28:21.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feccc158240 0x7feccc157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158620 0x7feccc0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feccc161f70 0x7feccc155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feccc0ce860 con 0x7feccc158620 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feccc0ce9e0 con 0x7feccc158240 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feccc0ceb60 con 0x7feccc161f70 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158620 0x7feccc0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158620 0x7feccc0aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50430/0 (socket says 172.21.15.114:50430) 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 -- 172.21.15.114:0/2242687873 learned_addr learned my addr 172.21.15.114:0/2242687873 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd0c00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feccc161f70 0x7feccc155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccbe00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feccc158240 0x7feccc157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 -- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feccc161f70 msgr2=0x7feccc155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feccc161f70 0x7feccc155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 -- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feccc158240 msgr2=0x7feccc157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:21.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feccc158240 0x7feccc157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:21.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 -- 172.21.15.114:0/2242687873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc156130 con 0x7feccc158620 2024-09-16T07:28:21.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7feccb400640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158620 0x7feccc0aff50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fecb800d750 tx=0x7fecb800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:21.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecc3e00640 1 -- 172.21.15.114:0/2242687873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8017070 con 0x7feccc158620 2024-09-16T07:28:21.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecc3e00640 1 -- 172.21.15.114:0/2242687873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecb8009d20 con 0x7feccc158620 2024-09-16T07:28:21.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecc3e00640 1 -- 172.21.15.114:0/2242687873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb800de60 con 0x7feccc158620 2024-09-16T07:28:21.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc156d30 con 0x7feccc158620 2024-09-16T07:28:21.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc156fd0 con 0x7feccc158620 2024-09-16T07:28:21.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.993+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc0cf0f0 con 0x7feccc158620 2024-09-16T07:28:21.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.997+0000 7fecc3e00640 1 -- 172.21.15.114:0/2242687873 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fecb8005280 con 0x7feccc158620 2024-09-16T07:28:22.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.997+0000 7fecc3e00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fecac072ec0 0x7fecac075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:22.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.997+0000 7fecc3e00640 1 -- 172.21.15.114:0/2242687873 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fecb8093fa0 con 0x7feccc158620 2024-09-16T07:28:22.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.997+0000 7feccbe00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fecac072ec0 0x7fecac075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:22.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:21.997+0000 7feccbe00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fecac072ec0 0x7fecac075380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0af000 tx=0x7fecbc01b0d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:22.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.001+0000 7fecc3e00640 1 -- 172.21.15.114:0/2242687873 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fecb805eb10 con 0x7feccc158620 2024-09-16T07:28:22.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.165+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feccc070800 con 0x7feccc158620 2024-09-16T07:28:22.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecc3e00640 1 -- 172.21.15.114:0/2242687873 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16726 (secure 0 0 0) 0x7fecb8063540 con 0x7feccc158620 2024-09-16T07:28:22.172 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:22.172 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":21,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:20.836473+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:22.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fecac072ec0 msgr2=0x7fecac075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:22.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fecac072ec0 0x7fecac075380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0af000 tx=0x7fecbc01b0d0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158620 msgr2=0x7feccc0aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158620 0x7feccc0aff50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fecb800d750 tx=0x7fecb800dc10 comp rx=0 tx=0).stop 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 shutdown_connections 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fecac072ec0 0x7fecac075380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feccc161f70 0x7feccc155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feccc158620 0x7feccc0aff50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 --2- 172.21.15.114:0/2242687873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feccc158240 0x7feccc157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 >> 172.21.15.114:0/2242687873 conn(0x7feccc0d0c90 msgr2=0x7feccc0cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 shutdown_connections 2024-09-16T07:28:22.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.169+0000 7fecd2c00640 1 -- 172.21.15.114:0/2242687873 wait complete. 2024-09-16T07:28:22.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:28:22.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 -- 172.21.15.114:0/3151220255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 msgr2=0x7f3acc161bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:22.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3151220255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc161bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3acc074d80 tx=0x7f3ac001c770 comp rx=0 tx=0).stop 2024-09-16T07:28:22.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 -- 172.21.15.114:0/3151220255 shutdown_connections 2024-09-16T07:28:22.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3151220255 >> v2:172.21.15.149:3300/0 conn(0x7f3acc1617a0 0x7f3acc162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3151220255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc161bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 -- 172.21.15.114:0/3151220255 >> 172.21.15.114:0/3151220255 conn(0x7f3acc0d1dd0 msgr2=0x7f3acc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:22.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 -- 172.21.15.114:0/3151220255 shutdown_connections 2024-09-16T07:28:22.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.333+0000 7f3ad4200640 1 -- 172.21.15.114:0/3151220255 wait complete. 2024-09-16T07:28:22.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 Processor -- start 2024-09-16T07:28:22.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 -- start start 2024-09-16T07:28:22.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc0b3190 0x7f3acc1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:22.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:22.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc1617a0 0x7f3acc071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:22.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc16b480 con 0x7f3acc1613c0 2024-09-16T07:28:22.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc16b300 con 0x7f3acc1617a0 2024-09-16T07:28:22.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3acc16b600 con 0x7f3acc0b3190 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc071990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50458/0 (socket says 172.21.15.114:50458) 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 -- 172.21.15.114:0/3335381058 learned_addr learned my addr 172.21.15.114:0/3335381058 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad1800640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc0b3190 0x7f3acc1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad2200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc1617a0 0x7f3acc071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 -- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc0b3190 msgr2=0x7f3acc1498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc0b3190 0x7f3acc1498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 -- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc1617a0 msgr2=0x7f3acc071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc1617a0 0x7f3acc071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 -- 172.21.15.114:0/3335381058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc1fb060 con 0x7f3acc1613c0 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad2200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc1617a0 0x7f3acc071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad0e00640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc071990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800d980 tx=0x7f3ab800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ac9600640 1 -- 172.21.15.114:0/3335381058 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8017070 con 0x7f3acc1613c0 2024-09-16T07:28:22.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ac9600640 1 -- 172.21.15.114:0/3335381058 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ab8009d20 con 0x7f3acc1613c0 2024-09-16T07:28:22.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ac9600640 1 -- 172.21.15.114:0/3335381058 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8004280 con 0x7f3acc1613c0 2024-09-16T07:28:22.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3acc1fbde0 con 0x7f3acc1613c0 2024-09-16T07:28:22.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3acc1fb5e0 con 0x7f3acc1613c0 2024-09-16T07:28:22.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.337+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3acc06dd30 con 0x7f3acc1613c0 2024-09-16T07:28:22.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.341+0000 7f3ac9600640 1 -- 172.21.15.114:0/3335381058 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f3ab8005020 con 0x7f3acc1613c0 2024-09-16T07:28:22.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.341+0000 7f3ac9600640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3aac072ec0 0x7f3aac075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:22.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.341+0000 7f3ac9600640 1 -- 172.21.15.114:0/3335381058 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3ab8093ef0 con 0x7f3acc1613c0 2024-09-16T07:28:22.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.341+0000 7f3ad1800640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3aac072ec0 0x7f3aac075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:22.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.341+0000 7f3ad1800640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3aac072ec0 0x7f3aac075380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00af000 tx=0x7f3ac001afb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:22.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.345+0000 7f3ac9600640 1 -- 172.21.15.114:0/3335381058 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3ab8020030 con 0x7f3acc1613c0 2024-09-16T07:28:22.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:22.549+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3acc0d2460 con 0x7f3acc1613c0 2024-09-16T07:28:23.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.469+0000 7f3ac9600640 1 -- 172.21.15.114:0/3335381058 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f3ab805f130 con 0x7f3acc1613c0 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3aac072ec0 msgr2=0x7f3aac075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3aac072ec0 0x7f3aac075380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00af000 tx=0x7f3ac001afb0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 msgr2=0x7f3acc071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc071990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800d980 tx=0x7f3ab800de40 comp rx=0 tx=0).stop 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 shutdown_connections 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3aac072ec0 0x7f3aac075380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc1617a0 0x7f3acc071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3acc1613c0 0x7f3acc071990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 --2- 172.21.15.114:0/3335381058 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3acc0b3190 0x7f3acc1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 >> 172.21.15.114:0/3335381058 conn(0x7f3acc0d1dd0 msgr2=0x7f3acc0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 shutdown_connections 2024-09-16T07:28:23.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.473+0000 7f3ad4200640 1 -- 172.21.15.114:0/3335381058 wait complete. 2024-09-16T07:28:23.500 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:28:23.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:28:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- 172.21.15.114:0/3041811595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500d22c0 msgr2=0x7f21500cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 --2- 172.21.15.114:0/3041811595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500d22c0 0x7f21500cc620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21500cf780 tx=0x7f214801cd80 comp rx=0 tx=0).stop 2024-09-16T07:28:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- 172.21.15.114:0/3041811595 shutdown_connections 2024-09-16T07:28:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 --2- 172.21.15.114:0/3041811595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500d22c0 0x7f21500cc620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 --2- 172.21.15.114:0/3041811595 >> v2:172.21.15.149:3300/0 conn(0x7f215015bd40 0x7f21500d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- 172.21.15.114:0/3041811595 >> 172.21.15.114:0/3041811595 conn(0x7f215009aa10 msgr2=0x7f215009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- 172.21.15.114:0/3041811595 shutdown_connections 2024-09-16T07:28:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- 172.21.15.114:0/3041811595 wait complete. 2024-09-16T07:28:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 Processor -- start 2024-09-16T07:28:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- start start 2024-09-16T07:28:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500b0d10 0x7f215014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21500d22c0 0x7f21501562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215015bd40 0x7f21501567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2150168bf0 con 0x7f21500b0d10 2024-09-16T07:28:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2150168a70 con 0x7f215015bd40 2024-09-16T07:28:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.645+0000 7f2156a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2150168d70 con 0x7f21500d22c0 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500b0d10 0x7f215014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500b0d10 0x7f215014b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50482/0 (socket says 172.21.15.114:50482) 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 -- 172.21.15.114:0/3689566778 learned_addr learned my addr 172.21.15.114:0/3689566778 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2156000640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215015bd40 0x7f21501567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2154c00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21500d22c0 0x7f21501562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 -- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21500d22c0 msgr2=0x7f21501562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21500d22c0 0x7f21501562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 -- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215015bd40 msgr2=0x7f21501567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215015bd40 0x7f21501567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 -- 172.21.15.114:0/3689566778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215014b8e0 con 0x7f21500b0d10 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2156000640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215015bd40 0x7f21501567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2155600640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500b0d10 0x7f215014b3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f214400ca20 tx=0x7f214400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f214d600640 1 -- 172.21.15.114:0/3689566778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144007c70 con 0x7f21500b0d10 2024-09-16T07:28:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f214d600640 1 -- 172.21.15.114:0/3689566778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f214400f450 con 0x7f21500b0d10 2024-09-16T07:28:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2150158970 con 0x7f21500b0d10 2024-09-16T07:28:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f214d600640 1 -- 172.21.15.114:0/3689566778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214400f8a0 con 0x7f21500b0d10 2024-09-16T07:28:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2150158f30 con 0x7f21500b0d10 2024-09-16T07:28:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21500cc620 con 0x7f21500b0d10 2024-09-16T07:28:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f214d600640 1 -- 172.21.15.114:0/3689566778 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f214400fa40 con 0x7f21500b0d10 2024-09-16T07:28:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.649+0000 7f214d600640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2130072ec0 0x7f2130075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.653+0000 7f214d600640 1 -- 172.21.15.114:0/3689566778 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2144094650 con 0x7f21500b0d10 2024-09-16T07:28:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.653+0000 7f2154c00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2130072ec0 0x7f2130075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.653+0000 7f2154c00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2130072ec0 0x7f2130075380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21501faf00 tx=0x7f213c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:23.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.653+0000 7f214d600640 1 -- 172.21.15.114:0/3689566778 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2144014030 con 0x7f21500b0d10 2024-09-16T07:28:23.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:23.857+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f21500cc1b0 con 0x7f21500b0d10 2024-09-16T07:28:24.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f214d600640 1 -- 172.21.15.114:0/3689566778 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f214405f800 con 0x7f21500b0d10 2024-09-16T07:28:24.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2130072ec0 msgr2=0x7f2130075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:24.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2130072ec0 0x7f2130075380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21501faf00 tx=0x7f213c009040 comp rx=0 tx=0).stop 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500b0d10 msgr2=0x7f215014b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500b0d10 0x7f215014b3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f214400ca20 tx=0x7f214400cee0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 shutdown_connections 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2130072ec0 0x7f2130075380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f215015bd40 0x7f21501567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21500d22c0 0x7f21501562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 --2- 172.21.15.114:0/3689566778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21500b0d10 0x7f215014b3a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 >> 172.21.15.114:0/3689566778 conn(0x7f215009aa10 msgr2=0x7f21500cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 shutdown_connections 2024-09-16T07:28:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.473+0000 7f2156a00640 1 -- 172.21.15.114:0/3689566778 wait complete. 2024-09-16T07:28:24.502 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:28:24.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:24.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 -- 172.21.15.114:0/1767629395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f00cffc0 msgr2=0x7f66f0073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:24.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 --2- 172.21.15.114:0/1767629395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f00cffc0 0x7f66f0073ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009840 tx=0x7f66d801c7f0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 -- 172.21.15.114:0/1767629395 shutdown_connections 2024-09-16T07:28:24.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 --2- 172.21.15.114:0/1767629395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f00cffc0 0x7f66f0073ed0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 -- 172.21.15.114:0/1767629395 >> 172.21.15.114:0/1767629395 conn(0x7f66f00d0c90 msgr2=0x7f66f00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:24.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 -- 172.21.15.114:0/1767629395 shutdown_connections 2024-09-16T07:28:24.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 -- 172.21.15.114:0/1767629395 wait complete. 2024-09-16T07:28:24.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 Processor -- start 2024-09-16T07:28:24.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.645+0000 7f66f6000640 1 -- start start 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66f006f9a0 0x7f66f014f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66f00cffc0 0x7f66f0151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f015af60 0x7f66f00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f66f0169560 con 0x7f66f015af60 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f66f0070b60 con 0x7f66f00cffc0 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f66f01696e0 con 0x7f66f006f9a0 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f015af60 0x7f66f00b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:24.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f015af60 0x7f66f00b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57360/0 (socket says 172.21.15.114:57360) 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 -- 172.21.15.114:0/1887332892 learned_addr learned my addr 172.21.15.114:0/1887332892 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66ef400640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66f006f9a0 0x7f66f014f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66e6a00640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66f00cffc0 0x7f66f0151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 -- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66f006f9a0 msgr2=0x7f66f014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66f006f9a0 0x7f66f014f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 -- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66f00cffc0 msgr2=0x7f66f0151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66f00cffc0 0x7f66f0151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 -- 172.21.15.114:0/1887332892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f00b5ac0 con 0x7f66f015af60 2024-09-16T07:28:24.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66ef400640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66f006f9a0 0x7f66f014f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66e6a00640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66f00cffc0 0x7f66f0151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66efe00640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f015af60 0x7f66f00b4f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c770 tx=0x7f66e800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66e7e00640 1 -- 172.21.15.114:0/1887332892 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8017070 con 0x7f66f015af60 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66e7e00640 1 -- 172.21.15.114:0/1887332892 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e8005070 con 0x7f66f015af60 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66e7e00640 1 -- 172.21.15.114:0/1887332892 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e80054c0 con 0x7f66f015af60 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f00b5da0 con 0x7f66f015af60 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f00ae680 con 0x7f66f015af60 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.649+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f006fe30 con 0x7f66f015af60 2024-09-16T07:28:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.653+0000 7f66e7e00640 1 -- 172.21.15.114:0/1887332892 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f66e801a070 con 0x7f66f015af60 2024-09-16T07:28:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.653+0000 7f66e7e00640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f66cc072ec0 0x7f66cc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.653+0000 7f66e7e00640 1 -- 172.21.15.114:0/1887332892 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f66e8093510 con 0x7f66f015af60 2024-09-16T07:28:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.653+0000 7f66ef400640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f66cc072ec0 0x7f66cc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:24.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.653+0000 7f66ef400640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f66cc072ec0 0x7f66cc075380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66e000a830 tx=0x7f66e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:24.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.657+0000 7f66e7e00640 1 -- 172.21.15.114:0/1887332892 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f66e805e750 con 0x7f66f015af60 2024-09-16T07:28:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.857+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66f01553b0 con 0x7f66f015af60 2024-09-16T07:28:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.857+0000 7f66e7e00640 1 -- 172.21.15.114:0/1887332892 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f66e8065e20 con 0x7f66f015af60 2024-09-16T07:28:24.863 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:24.863 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f66cc072ec0 msgr2=0x7f66cc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f66cc072ec0 0x7f66cc075380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66e000a830 tx=0x7f66e0008040 comp rx=0 tx=0).stop 2024-09-16T07:28:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f015af60 msgr2=0x7f66f00b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f015af60 0x7f66f00b4f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c770 tx=0x7f66e800cc30 comp rx=0 tx=0).stop 2024-09-16T07:28:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 shutdown_connections 2024-09-16T07:28:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f66cc072ec0 0x7f66cc075380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66f015af60 0x7f66f00b4f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66f00cffc0 0x7f66f0151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 --2- 172.21.15.114:0/1887332892 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f66f006f9a0 0x7f66f014f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 >> 172.21.15.114:0/1887332892 conn(0x7f66f00d0c90 msgr2=0x7f66f0159570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 shutdown_connections 2024-09-16T07:28:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:24.861+0000 7f66f6000640 1 -- 172.21.15.114:0/1887332892 wait complete. 2024-09-16T07:28:24.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 -- 172.21.15.114:0/625521696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 msgr2=0x7f3f400734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 --2- 172.21.15.114:0/625521696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f400734b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3f40069eb0 tx=0x7f3f3801ccc0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 -- 172.21.15.114:0/625521696 shutdown_connections 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 --2- 172.21.15.114:0/625521696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f400734b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 --2- 172.21.15.114:0/625521696 >> v2:172.21.15.149:3300/0 conn(0x7f3f400cf160 0x7f3f40072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 -- 172.21.15.114:0/625521696 >> 172.21.15.114:0/625521696 conn(0x7f3f400b2060 msgr2=0x7f3f400b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 -- 172.21.15.114:0/625521696 shutdown_connections 2024-09-16T07:28:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 -- 172.21.15.114:0/625521696 wait complete. 2024-09-16T07:28:25.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 Processor -- start 2024-09-16T07:28:25.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.025+0000 7f3f46400640 1 -- start start 2024-09-16T07:28:25.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f401f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f400cf160 0x7f3f400aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f4015a3e0 0x7f3f4006ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400cc770 con 0x7f3f400ce200 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400cc5f0 con 0x7f3f4015a3e0 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3f400cc8f0 con 0x7f3f400cf160 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f401f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f401f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57380/0 (socket says 172.21.15.114:57380) 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 -- 172.21.15.114:0/2388928881 learned_addr learned my addr 172.21.15.114:0/2388928881 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3ea00640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f400cf160 0x7f3f400aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3fe00640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f4015a3e0 0x7f3f4006ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 -- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f400cf160 msgr2=0x7f3f400aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f400cf160 0x7f3f400aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 -- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f4015a3e0 msgr2=0x7f3f4006ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f4015a3e0 0x7f3f4006ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 -- 172.21.15.114:0/2388928881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f400af2a0 con 0x7f3f400ce200 2024-09-16T07:28:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3ea00640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f400cf160 0x7f3f400aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3fe00640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f4015a3e0 0x7f3f4006ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f3f400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f401f84b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c500 tx=0x7f3f3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f37400640 1 -- 172.21.15.114:0/2388928881 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30017070 con 0x7f3f400ce200 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f37400640 1 -- 172.21.15.114:0/2388928881 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f300053c0 con 0x7f3f400ce200 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f37400640 1 -- 172.21.15.114:0/2388928881 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30012890 con 0x7f3f400ce200 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f400af580 con 0x7f3f400ce200 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f400afb40 con 0x7f3f400ce200 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4006f090 con 0x7f3f400ce200 2024-09-16T07:28:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.029+0000 7f3f37400640 1 -- 172.21.15.114:0/2388928881 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f3f3001a070 con 0x7f3f400ce200 2024-09-16T07:28:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.033+0000 7f3f37400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3f20072ec0 0x7f3f20075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.033+0000 7f3f37400640 1 -- 172.21.15.114:0/2388928881 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3f300931a0 con 0x7f3f400ce200 2024-09-16T07:28:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.033+0000 7f3f3ea00640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3f20072ec0 0x7f3f20075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.033+0000 7f3f3ea00640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3f20072ec0 0x7f3f20075380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005fd0 tx=0x7f3f2c005e60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:25.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.037+0000 7f3f37400640 1 -- 172.21.15.114:0/2388928881 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3f3005e360 con 0x7f3f400ce200 2024-09-16T07:28:25.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.205+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f40156620 con 0x7f3f400ce200 2024-09-16T07:28:25.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.205+0000 7f3f37400640 1 -- 172.21.15.114:0/2388928881 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16713 (secure 0 0 0) 0x7f3f3005dc60 con 0x7f3f400ce200 2024-09-16T07:28:25.209 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:25.209 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:22.454295+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.205+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3f20072ec0 msgr2=0x7f3f20075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.205+0000 7f3f46400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3f20072ec0 0x7f3f20075380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c005fd0 tx=0x7f3f2c005e60 comp rx=0 tx=0).stop 2024-09-16T07:28:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.205+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 msgr2=0x7f3f401f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.205+0000 7f3f46400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f401f84b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c500 tx=0x7f3f3000c9c0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 shutdown_connections 2024-09-16T07:28:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3f20072ec0 0x7f3f20075380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f4015a3e0 0x7f3f4006ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f400cf160 0x7f3f400aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 --2- 172.21.15.114:0/2388928881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f400ce200 0x7f3f401f84b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 >> 172.21.15.114:0/2388928881 conn(0x7f3f400b2060 msgr2=0x7f3f400b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 shutdown_connections 2024-09-16T07:28:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.209+0000 7f3f46400640 1 -- 172.21.15.114:0/2388928881 wait complete. 2024-09-16T07:28:25.231 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:28:25.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:28:25.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 -- 172.21.15.114:0/351031432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 msgr2=0x7fdfbc0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 --2- 172.21.15.114:0/351031432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 0x7fdfbc0ce670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009840 tx=0x7fdfb001c820 comp rx=0 tx=0).stop 2024-09-16T07:28:25.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 -- 172.21.15.114:0/351031432 shutdown_connections 2024-09-16T07:28:25.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 --2- 172.21.15.114:0/351031432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0d28e0 0x7fdfbc0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 --2- 172.21.15.114:0/351031432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 0x7fdfbc0ce670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 -- 172.21.15.114:0/351031432 >> 172.21.15.114:0/351031432 conn(0x7fdfbc0d1dc0 msgr2=0x7fdfbc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:25.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 -- 172.21.15.114:0/351031432 shutdown_connections 2024-09-16T07:28:25.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 -- 172.21.15.114:0/351031432 wait complete. 2024-09-16T07:28:25.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 Processor -- start 2024-09-16T07:28:25.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.369+0000 7fdfc4800640 1 -- start start 2024-09-16T07:28:25.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0cdb30 0x7fdfbc0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0d28e0 0x7fdfbc165f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 0x7fdfbc1fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc168fc0 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc168e40 con 0x7fdfbc15bea0 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc169140 con 0x7fdfbc0cdb30 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0d28e0 0x7fdfbc165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0d28e0 0x7fdfbc165f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57388/0 (socket says 172.21.15.114:57388) 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 -- 172.21.15.114:0/3743733940 learned_addr learned my addr 172.21.15.114:0/3743733940 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0cdb30 0x7fdfbc0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc2800640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 0x7fdfbc1fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 -- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0cdb30 msgr2=0x7fdfbc0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0cdb30 0x7fdfbc0b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 -- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 msgr2=0x7fdfbc1fbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 0x7fdfbc1fbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 -- 172.21.15.114:0/3743733940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc0b1610 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0cdb30 0x7fdfbc0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc1400640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0d28e0 0x7fdfbc165f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c400 tx=0x7fdfac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfb6000640 1 -- 172.21.15.114:0/3743733940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac017070 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfb6000640 1 -- 172.21.15.114:0/3743733940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfac0053c0 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc0b18f0 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfb6000640 1 -- 172.21.15.114:0/3743733940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac003880 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc0b1eb0 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc0cc9d0 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.373+0000 7fdfb6000640 1 -- 172.21.15.114:0/3743733940 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fdfac01a070 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.377+0000 7fdfb6000640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdfa0072ec0 0x7fdfa0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.377+0000 7fdfb6000640 1 -- 172.21.15.114:0/3743733940 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdfac0930f0 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.377+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdfa0072ec0 0x7fdfa0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.377+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdfa0072ec0 0x7fdfa0075380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00af000 tx=0x7fdfb001b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:25.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.381+0000 7fdfb6000640 1 -- 172.21.15.114:0/3743733940 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdfac001130 con 0x7fdfbc0d28e0 2024-09-16T07:28:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.549+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfbc0b4e20 con 0x7fdfa0072ec0 2024-09-16T07:28:25.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.553+0000 7fdfb6000640 1 -- 172.21.15.114:0/3743733940 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240839 (secure 0 0 0) 0x7fdfbc0b4e20 con 0x7fdfa0072ec0 2024-09-16T07:28:25.561 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:25.563 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdfa0072ec0 msgr2=0x7fdfa0075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdfa0072ec0 0x7fdfa0075380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00af000 tx=0x7fdfb001b060 comp rx=0 tx=0).stop 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0d28e0 msgr2=0x7fdfbc165f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0d28e0 0x7fdfbc165f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00c400 tx=0x7fdfac00c8c0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 shutdown_connections 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdfa0072ec0 0x7fdfa0075380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc15bea0 0x7fdfbc1fbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0d28e0 0x7fdfbc165f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 --2- 172.21.15.114:0/3743733940 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0cdb30 0x7fdfbc0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 >> 172.21.15.114:0/3743733940 conn(0x7fdfbc0d1dc0 msgr2=0x7fdfbc155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 shutdown_connections 2024-09-16T07:28:25.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.557+0000 7fdfc4800640 1 -- 172.21.15.114:0/3743733940 wait complete. 2024-09-16T07:28:25.580 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-16T07:28:24.994742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":2600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":2662400,"data_stored":1638107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.558381"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548812+0000","last_change":"2024-09-16T07:28:21.473706+0000","last_active":"2024-09-16T07:28:22.548812+0000","last_peered":"2024-09-16T07:28:22.548812+0000","last_clean":"2024-09-16T07:28:22.548812+0000","last_became_active":"2024-09-16T07:28:21.472045+0000","last_became_peered":"2024-09-16T07:28:21.472045+0000","last_unstale":"2024-09-16T07:28:22.548812+0000","last_undegraded":"2024-09-16T07:28:22.548812+0000","last_fullsized":"2024-09-16T07:28:22.548812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:20.884169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548289+0000","last_change":"2024-09-16T07:28:21.463979+0000","last_active":"2024-09-16T07:28:22.548289+0000","last_peered":"2024-09-16T07:28:22.548289+0000","last_clean":"2024-09-16T07:28:22.548289+0000","last_became_active":"2024-09-16T07:28:21.463670+0000","last_became_peered":"2024-09-16T07:28:21.463670+0000","last_unstale":"2024-09-16T07:28:22.548289+0000","last_undegraded":"2024-09-16T07:28:22.548289+0000","last_fullsized":"2024-09-16T07:28:22.548289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:19.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437962+0000","last_change":"2024-09-16T07:28:19.437962+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437962+0000","last_undegraded":"2024-09-16T07:28:19.437962+0000","last_fullsized":"2024-09-16T07:28:19.437962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442205+0000","last_change":"2024-09-16T07:28:19.442205+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442205+0000","last_undegraded":"2024-09-16T07:28:19.442205+0000","last_fullsized":"2024-09-16T07:28:19.442205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437871+0000","last_change":"2024-09-16T07:28:19.437871+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437871+0000","last_undegraded":"2024-09-16T07:28:19.437871+0000","last_fullsized":"2024-09-16T07:28:19.437871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438708+0000","last_change":"2024-09-16T07:28:19.438708+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438708+0000","last_undegraded":"2024-09-16T07:28:19.438708+0000","last_fullsized":"2024-09-16T07:28:19.438708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.443260+0000","last_change":"2024-09-16T07:28:19.443260+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.443260+0000","last_undegraded":"2024-09-16T07:28:19.443260+0000","last_fullsized":"2024-09-16T07:28:19.443260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.439411+0000","last_change":"2024-09-16T07:28:19.439411+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.439411+0000","last_undegraded":"2024-09-16T07:28:19.439411+0000","last_fullsized":"2024-09-16T07:28:19.439411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442352+0000","last_change":"2024-09-16T07:28:19.442352+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442352+0000","last_undegraded":"2024-09-16T07:28:19.442352+0000","last_fullsized":"2024-09-16T07:28:19.442352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442157+0000","last_change":"2024-09-16T07:28:19.442157+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442157+0000","last_undegraded":"2024-09-16T07:28:19.442157+0000","last_fullsized":"2024-09-16T07:28:19.442157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438717+0000","last_change":"2024-09-16T07:28:19.438717+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438717+0000","last_undegraded":"2024-09-16T07:28:19.438717+0000","last_fullsized":"2024-09-16T07:28:19.438717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.440421+0000","last_change":"2024-09-16T07:28:19.440421+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.440421+0000","last_undegraded":"2024-09-16T07:28:19.440421+0000","last_fullsized":"2024-09-16T07:28:19.440421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442175+0000","last_change":"2024-09-16T07:28:19.442175+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442175+0000","last_undegraded":"2024-09-16T07:28:19.442175+0000","last_fullsized":"2024-09-16T07:28:19.442175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548130+0000","last_change":"2024-09-16T07:28:20.457548+0000","last_active":"2024-09-16T07:28:22.548130+0000","last_peered":"2024-09-16T07:28:22.548130+0000","last_clean":"2024-09-16T07:28:22.548130+0000","last_became_active":"2024-09-16T07:28:20.457151+0000","last_became_peered":"2024-09-16T07:28:20.457151+0000","last_unstale":"2024-09-16T07:28:22.548130+0000","last_undegraded":"2024-09-16T07:28:22.548130+0000","last_fullsized":"2024-09-16T07:28:22.548130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:48.914037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438652+0000","last_change":"2024-09-16T07:28:19.438652+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438652+0000","last_undegraded":"2024-09-16T07:28:19.438652+0000","last_fullsized":"2024-09-16T07:28:19.438652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548720+0000","last_change":"2024-09-16T07:28:20.450706+0000","last_active":"2024-09-16T07:28:22.548720+0000","last_peered":"2024-09-16T07:28:22.548720+0000","last_clean":"2024-09-16T07:28:22.548720+0000","last_became_active":"2024-09-16T07:28:20.450379+0000","last_became_peered":"2024-09-16T07:28:20.450379+0000","last_unstale":"2024-09-16T07:28:22.548720+0000","last_undegraded":"2024-09-16T07:28:22.548720+0000","last_fullsized":"2024-09-16T07:28:22.548720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:37.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.441539+0000","last_change":"2024-09-16T07:28:19.441539+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.441539+0000","last_undegraded":"2024-09-16T07:28:19.441539+0000","last_fullsized":"2024-09-16T07:28:19.441539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548601+0000","last_change":"2024-09-16T07:28:20.465122+0000","last_active":"2024-09-16T07:28:22.548601+0000","last_peered":"2024-09-16T07:28:22.548601+0000","last_clean":"2024-09-16T07:28:22.548601+0000","last_became_active":"2024-09-16T07:28:20.464580+0000","last_became_peered":"2024-09-16T07:28:20.464580+0000","last_unstale":"2024-09-16T07:28:22.548601+0000","last_undegraded":"2024-09-16T07:28:22.548601+0000","last_fullsized":"2024-09-16T07:28:22.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:50.567918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T07:28:19.446977+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:28:19.446977+0000","last_peered":"2024-09-16T07:28:19.446977+0000","last_clean":"2024-09-16T07:28:19.446977+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:28:19.446977+0000","last_undegraded":"2024-09-16T07:28:19.446977+0000","last_fullsized":"2024-09-16T07:28:19.446977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438812+0000","last_change":"2024-09-16T07:28:19.438812+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438812+0000","last_undegraded":"2024-09-16T07:28:19.438812+0000","last_fullsized":"2024-09-16T07:28:19.438812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445196+0000","last_change":"2024-09-16T07:28:19.445196+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445196+0000","last_undegraded":"2024-09-16T07:28:19.445196+0000","last_fullsized":"2024-09-16T07:28:19.445196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548390+0000","last_change":"2024-09-16T07:28:20.453271+0000","last_active":"2024-09-16T07:28:22.548390+0000","last_peered":"2024-09-16T07:28:22.548390+0000","last_clean":"2024-09-16T07:28:22.548390+0000","last_became_active":"2024-09-16T07:28:20.452985+0000","last_became_peered":"2024-09-16T07:28:20.452985+0000","last_unstale":"2024-09-16T07:28:22.548390+0000","last_undegraded":"2024-09-16T07:28:22.548390+0000","last_fullsized":"2024-09-16T07:28:22.548390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:08.366019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438699+0000","last_change":"2024-09-16T07:28:19.438699+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438699+0000","last_undegraded":"2024-09-16T07:28:19.438699+0000","last_fullsized":"2024-09-16T07:28:19.438699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.441780+0000","last_change":"2024-09-16T07:28:19.441780+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.441780+0000","last_undegraded":"2024-09-16T07:28:19.441780+0000","last_fullsized":"2024-09-16T07:28:19.441780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445442+0000","last_change":"2024-09-16T07:28:19.445442+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445442+0000","last_undegraded":"2024-09-16T07:28:19.445442+0000","last_fullsized":"2024-09-16T07:28:19.445442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442798+0000","last_change":"2024-09-16T07:28:19.442798+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442798+0000","last_undegraded":"2024-09-16T07:28:19.442798+0000","last_fullsized":"2024-09-16T07:28:19.442798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442406+0000","last_change":"2024-09-16T07:28:19.442406+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442406+0000","last_undegraded":"2024-09-16T07:28:19.442406+0000","last_fullsized":"2024-09-16T07:28:19.442406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.446050+0000","last_change":"2024-09-16T07:28:19.446050+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.446050+0000","last_undegraded":"2024-09-16T07:28:19.446050+0000","last_fullsized":"2024-09-16T07:28:19.446050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.443079+0000","last_change":"2024-09-16T07:28:19.443079+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.443079+0000","last_undegraded":"2024-09-16T07:28:19.443079+0000","last_fullsized":"2024-09-16T07:28:19.443079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442350+0000","last_change":"2024-09-16T07:28:19.442350+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442350+0000","last_undegraded":"2024-09-16T07:28:19.442350+0000","last_fullsized":"2024-09-16T07:28:19.442350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445390+0000","last_change":"2024-09-16T07:28:19.445390+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445390+0000","last_undegraded":"2024-09-16T07:28:19.445390+0000","last_fullsized":"2024-09-16T07:28:19.445390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445360+0000","last_change":"2024-09-16T07:28:19.445360+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445360+0000","last_undegraded":"2024-09-16T07:28:19.445360+0000","last_fullsized":"2024-09-16T07:28:19.445360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.446416+0000","last_change":"2024-09-16T07:28:19.446416+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.446416+0000","last_undegraded":"2024-09-16T07:28:19.446416+0000","last_fullsized":"2024-09-16T07:28:19.446416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437930+0000","last_change":"2024-09-16T07:28:19.437930+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437930+0000","last_undegraded":"2024-09-16T07:28:19.437930+0000","last_fullsized":"2024-09-16T07:28:19.437930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438830+0000","last_change":"2024-09-16T07:28:19.438830+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438830+0000","last_undegraded":"2024-09-16T07:28:19.438830+0000","last_fullsized":"2024-09-16T07:28:19.438830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":647302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":765952,"data_stored":641485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:28:25.586 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:28:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- 172.21.15.114:0/3244060384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 msgr2=0x7f7e7c0af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 --2- 172.21.15.114:0/3244060384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c0af0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009bc0 tx=0x7f7e7401cba0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- 172.21.15.114:0/3244060384 shutdown_connections 2024-09-16T07:28:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 --2- 172.21.15.114:0/3244060384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c0af0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- 172.21.15.114:0/3244060384 >> 172.21.15.114:0/3244060384 conn(0x7f7e7c0d1dc0 msgr2=0x7f7e7c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- 172.21.15.114:0/3244060384 shutdown_connections 2024-09-16T07:28:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- 172.21.15.114:0/3244060384 wait complete. 2024-09-16T07:28:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 Processor -- start 2024-09-16T07:28:25.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- start start 2024-09-16T07:28:25.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7c0ced80 0x7f7e7c0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e7c15bea0 0x7f7e7c0c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c16a8a0 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c16a720 con 0x7f7e7c0ced80 2024-09-16T07:28:25.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e80e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c16aa20 con 0x7f7e7c15bea0 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.761+0000 7f7e79e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57406/0 (socket says 172.21.15.114:57406) 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 -- 172.21.15.114:0/784994521 learned_addr learned my addr 172.21.15.114:0/784994521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e71400640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7c0ced80 0x7f7e7c0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e7a800640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e7c15bea0 0x7f7e7c0c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 -- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e7c15bea0 msgr2=0x7f7e7c0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e7c15bea0 0x7f7e7c0c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 -- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7c0ced80 msgr2=0x7f7e7c0b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7c0ced80 0x7f7e7c0b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 -- 172.21.15.114:0/784994521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c159db0 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e71400640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7c0ced80 0x7f7e7c0b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e7a800640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e7c15bea0 0x7f7e7c0c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e79e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c14f3b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c420 tx=0x7f7e6c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e72a00640 1 -- 172.21.15.114:0/784994521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c017070 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e72a00640 1 -- 172.21.15.114:0/784994521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e6c0053c0 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c15a090 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e72a00640 1 -- 172.21.15.114:0/784994521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c003860 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c14f8f0 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7c0ce670 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.765+0000 7f7e72a00640 1 -- 172.21.15.114:0/784994521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f7e6c01a070 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.769+0000 7f7e72a00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e58072ec0 0x7f7e58075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.769+0000 7f7e72a00640 1 -- 172.21.15.114:0/784994521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7e6c0931b0 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.769+0000 7f7e71400640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e58072ec0 0x7f7e58075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.769+0000 7f7e71400640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e58072ec0 0x7f7e58075380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0b4870 tx=0x7f7e64009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.773+0000 7f7e72a00640 1 -- 172.21.15.114:0/784994521 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7e6c05e3f0 con 0x7f7e7c0cdb30 2024-09-16T07:28:25.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.937+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e7c0724d0 con 0x7f7e58072ec0 2024-09-16T07:28:25.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e72a00640 1 -- 172.21.15.114:0/784994521 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240839 (secure 0 0 0) 0x7f7e7c0724d0 con 0x7f7e58072ec0 2024-09-16T07:28:25.949 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:25.951 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e58072ec0 msgr2=0x7f7e58075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e58072ec0 0x7f7e58075380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0b4870 tx=0x7f7e64009040 comp rx=0 tx=0).stop 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 msgr2=0x7f7e7c14f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c14f3b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c420 tx=0x7f7e6c00c8e0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 shutdown_connections 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e58072ec0 0x7f7e58075380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e7c15bea0 0x7f7e7c0c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7c0ced80 0x7f7e7c0b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 --2- 172.21.15.114:0/784994521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e7c0cdb30 0x7f7e7c14f3b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.945+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 >> 172.21.15.114:0/784994521 conn(0x7f7e7c0d1dc0 msgr2=0x7f7e7c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.949+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 shutdown_connections 2024-09-16T07:28:25.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:25.949+0000 7f7e80e00640 1 -- 172.21.15.114:0/784994521 wait complete. 2024-09-16T07:28:25.969 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-16T07:28:24.994742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":2600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":2662400,"data_stored":1638107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.558381"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548812+0000","last_change":"2024-09-16T07:28:21.473706+0000","last_active":"2024-09-16T07:28:22.548812+0000","last_peered":"2024-09-16T07:28:22.548812+0000","last_clean":"2024-09-16T07:28:22.548812+0000","last_became_active":"2024-09-16T07:28:21.472045+0000","last_became_peered":"2024-09-16T07:28:21.472045+0000","last_unstale":"2024-09-16T07:28:22.548812+0000","last_undegraded":"2024-09-16T07:28:22.548812+0000","last_fullsized":"2024-09-16T07:28:22.548812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:20.884169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548289+0000","last_change":"2024-09-16T07:28:21.463979+0000","last_active":"2024-09-16T07:28:22.548289+0000","last_peered":"2024-09-16T07:28:22.548289+0000","last_clean":"2024-09-16T07:28:22.548289+0000","last_became_active":"2024-09-16T07:28:21.463670+0000","last_became_peered":"2024-09-16T07:28:21.463670+0000","last_unstale":"2024-09-16T07:28:22.548289+0000","last_undegraded":"2024-09-16T07:28:22.548289+0000","last_fullsized":"2024-09-16T07:28:22.548289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:19.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437962+0000","last_change":"2024-09-16T07:28:19.437962+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437962+0000","last_undegraded":"2024-09-16T07:28:19.437962+0000","last_fullsized":"2024-09-16T07:28:19.437962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442205+0000","last_change":"2024-09-16T07:28:19.442205+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442205+0000","last_undegraded":"2024-09-16T07:28:19.442205+0000","last_fullsized":"2024-09-16T07:28:19.442205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437871+0000","last_change":"2024-09-16T07:28:19.437871+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437871+0000","last_undegraded":"2024-09-16T07:28:19.437871+0000","last_fullsized":"2024-09-16T07:28:19.437871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438708+0000","last_change":"2024-09-16T07:28:19.438708+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438708+0000","last_undegraded":"2024-09-16T07:28:19.438708+0000","last_fullsized":"2024-09-16T07:28:19.438708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.443260+0000","last_change":"2024-09-16T07:28:19.443260+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.443260+0000","last_undegraded":"2024-09-16T07:28:19.443260+0000","last_fullsized":"2024-09-16T07:28:19.443260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.439411+0000","last_change":"2024-09-16T07:28:19.439411+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.439411+0000","last_undegraded":"2024-09-16T07:28:19.439411+0000","last_fullsized":"2024-09-16T07:28:19.439411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442352+0000","last_change":"2024-09-16T07:28:19.442352+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442352+0000","last_undegraded":"2024-09-16T07:28:19.442352+0000","last_fullsized":"2024-09-16T07:28:19.442352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442157+0000","last_change":"2024-09-16T07:28:19.442157+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442157+0000","last_undegraded":"2024-09-16T07:28:19.442157+0000","last_fullsized":"2024-09-16T07:28:19.442157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438717+0000","last_change":"2024-09-16T07:28:19.438717+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438717+0000","last_undegraded":"2024-09-16T07:28:19.438717+0000","last_fullsized":"2024-09-16T07:28:19.438717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.440421+0000","last_change":"2024-09-16T07:28:19.440421+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.440421+0000","last_undegraded":"2024-09-16T07:28:19.440421+0000","last_fullsized":"2024-09-16T07:28:19.440421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442175+0000","last_change":"2024-09-16T07:28:19.442175+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442175+0000","last_undegraded":"2024-09-16T07:28:19.442175+0000","last_fullsized":"2024-09-16T07:28:19.442175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548130+0000","last_change":"2024-09-16T07:28:20.457548+0000","last_active":"2024-09-16T07:28:22.548130+0000","last_peered":"2024-09-16T07:28:22.548130+0000","last_clean":"2024-09-16T07:28:22.548130+0000","last_became_active":"2024-09-16T07:28:20.457151+0000","last_became_peered":"2024-09-16T07:28:20.457151+0000","last_unstale":"2024-09-16T07:28:22.548130+0000","last_undegraded":"2024-09-16T07:28:22.548130+0000","last_fullsized":"2024-09-16T07:28:22.548130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:48.914037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438652+0000","last_change":"2024-09-16T07:28:19.438652+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438652+0000","last_undegraded":"2024-09-16T07:28:19.438652+0000","last_fullsized":"2024-09-16T07:28:19.438652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548720+0000","last_change":"2024-09-16T07:28:20.450706+0000","last_active":"2024-09-16T07:28:22.548720+0000","last_peered":"2024-09-16T07:28:22.548720+0000","last_clean":"2024-09-16T07:28:22.548720+0000","last_became_active":"2024-09-16T07:28:20.450379+0000","last_became_peered":"2024-09-16T07:28:20.450379+0000","last_unstale":"2024-09-16T07:28:22.548720+0000","last_undegraded":"2024-09-16T07:28:22.548720+0000","last_fullsized":"2024-09-16T07:28:22.548720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:37.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.441539+0000","last_change":"2024-09-16T07:28:19.441539+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.441539+0000","last_undegraded":"2024-09-16T07:28:19.441539+0000","last_fullsized":"2024-09-16T07:28:19.441539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548601+0000","last_change":"2024-09-16T07:28:20.465122+0000","last_active":"2024-09-16T07:28:22.548601+0000","last_peered":"2024-09-16T07:28:22.548601+0000","last_clean":"2024-09-16T07:28:22.548601+0000","last_became_active":"2024-09-16T07:28:20.464580+0000","last_became_peered":"2024-09-16T07:28:20.464580+0000","last_unstale":"2024-09-16T07:28:22.548601+0000","last_undegraded":"2024-09-16T07:28:22.548601+0000","last_fullsized":"2024-09-16T07:28:22.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:50.567918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T07:28:19.446977+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:28:19.446977+0000","last_peered":"2024-09-16T07:28:19.446977+0000","last_clean":"2024-09-16T07:28:19.446977+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:28:19.446977+0000","last_undegraded":"2024-09-16T07:28:19.446977+0000","last_fullsized":"2024-09-16T07:28:19.446977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438812+0000","last_change":"2024-09-16T07:28:19.438812+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438812+0000","last_undegraded":"2024-09-16T07:28:19.438812+0000","last_fullsized":"2024-09-16T07:28:19.438812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445196+0000","last_change":"2024-09-16T07:28:19.445196+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445196+0000","last_undegraded":"2024-09-16T07:28:19.445196+0000","last_fullsized":"2024-09-16T07:28:19.445196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548390+0000","last_change":"2024-09-16T07:28:20.453271+0000","last_active":"2024-09-16T07:28:22.548390+0000","last_peered":"2024-09-16T07:28:22.548390+0000","last_clean":"2024-09-16T07:28:22.548390+0000","last_became_active":"2024-09-16T07:28:20.452985+0000","last_became_peered":"2024-09-16T07:28:20.452985+0000","last_unstale":"2024-09-16T07:28:22.548390+0000","last_undegraded":"2024-09-16T07:28:22.548390+0000","last_fullsized":"2024-09-16T07:28:22.548390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:08.366019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438699+0000","last_change":"2024-09-16T07:28:19.438699+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438699+0000","last_undegraded":"2024-09-16T07:28:19.438699+0000","last_fullsized":"2024-09-16T07:28:19.438699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.441780+0000","last_change":"2024-09-16T07:28:19.441780+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.441780+0000","last_undegraded":"2024-09-16T07:28:19.441780+0000","last_fullsized":"2024-09-16T07:28:19.441780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445442+0000","last_change":"2024-09-16T07:28:19.445442+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445442+0000","last_undegraded":"2024-09-16T07:28:19.445442+0000","last_fullsized":"2024-09-16T07:28:19.445442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442798+0000","last_change":"2024-09-16T07:28:19.442798+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442798+0000","last_undegraded":"2024-09-16T07:28:19.442798+0000","last_fullsized":"2024-09-16T07:28:19.442798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442406+0000","last_change":"2024-09-16T07:28:19.442406+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442406+0000","last_undegraded":"2024-09-16T07:28:19.442406+0000","last_fullsized":"2024-09-16T07:28:19.442406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.446050+0000","last_change":"2024-09-16T07:28:19.446050+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.446050+0000","last_undegraded":"2024-09-16T07:28:19.446050+0000","last_fullsized":"2024-09-16T07:28:19.446050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.443079+0000","last_change":"2024-09-16T07:28:19.443079+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.443079+0000","last_undegraded":"2024-09-16T07:28:19.443079+0000","last_fullsized":"2024-09-16T07:28:19.443079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442350+0000","last_change":"2024-09-16T07:28:19.442350+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442350+0000","last_undegraded":"2024-09-16T07:28:19.442350+0000","last_fullsized":"2024-09-16T07:28:19.442350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445390+0000","last_change":"2024-09-16T07:28:19.445390+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445390+0000","last_undegraded":"2024-09-16T07:28:19.445390+0000","last_fullsized":"2024-09-16T07:28:19.445390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445360+0000","last_change":"2024-09-16T07:28:19.445360+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445360+0000","last_undegraded":"2024-09-16T07:28:19.445360+0000","last_fullsized":"2024-09-16T07:28:19.445360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.446416+0000","last_change":"2024-09-16T07:28:19.446416+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.446416+0000","last_undegraded":"2024-09-16T07:28:19.446416+0000","last_fullsized":"2024-09-16T07:28:19.446416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437930+0000","last_change":"2024-09-16T07:28:19.437930+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437930+0000","last_undegraded":"2024-09-16T07:28:19.437930+0000","last_fullsized":"2024-09-16T07:28:19.437930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438830+0000","last_change":"2024-09-16T07:28:19.438830+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438830+0000","last_undegraded":"2024-09-16T07:28:19.438830+0000","last_fullsized":"2024-09-16T07:28:19.438830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":647302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":765952,"data_stored":641485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:28:25.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 -- 172.21.15.114:0/346335880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 msgr2=0x7fd4080b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 --2- 172.21.15.114:0/346335880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd4080b0130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd400009840 tx=0x7fd40001c6d0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 -- 172.21.15.114:0/346335880 shutdown_connections 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 --2- 172.21.15.114:0/346335880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd4080b0130 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 --2- 172.21.15.114:0/346335880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd40815f490 0x7fd4080b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 -- 172.21.15.114:0/346335880 >> 172.21.15.114:0/346335880 conn(0x7fd4080d1e30 msgr2=0x7fd4080d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 -- 172.21.15.114:0/346335880 shutdown_connections 2024-09-16T07:28:26.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.145+0000 7fd40de00640 1 -- 172.21.15.114:0/346335880 wait complete. 2024-09-16T07:28:26.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 Processor -- start 2024-09-16T07:28:26.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 -- start start 2024-09-16T07:28:26.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd40806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4080b2e80 0x7fd408153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40815f490 0x7fd4081585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd408168e00 con 0x7fd4080afca0 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd408168c80 con 0x7fd40815f490 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd408168f80 con 0x7fd4080b2e80 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd40806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd40806f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57416/0 (socket says 172.21.15.114:57416) 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 -- 172.21.15.114:0/1420492640 learned_addr learned my addr 172.21.15.114:0/1420492640 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd3fe000640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4080b2e80 0x7fd408153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd407400640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40815f490 0x7fd4081585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 -- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4080b2e80 msgr2=0x7fd408153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4080b2e80 0x7fd408153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 -- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40815f490 msgr2=0x7fd4081585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40815f490 0x7fd4081585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 -- 172.21.15.114:0/1420492640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd408151610 con 0x7fd4080afca0 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd407400640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40815f490 0x7fd4081585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd406a00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd40806f2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800dac0 tx=0x7fd3f800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd3ffe00640 1 -- 172.21.15.114:0/1420492640 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8017070 con 0x7fd4080afca0 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd3ffe00640 1 -- 172.21.15.114:0/1420492640 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3f8004b30 con 0x7fd4080afca0 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4081518b0 con 0x7fd4080afca0 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd3ffe00640 1 -- 172.21.15.114:0/1420492640 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8005020 con 0x7fd4080afca0 2024-09-16T07:28:26.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.149+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd408151e70 con 0x7fd4080afca0 2024-09-16T07:28:26.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.153+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4080b0130 con 0x7fd4080afca0 2024-09-16T07:28:26.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.153+0000 7fd3ffe00640 1 -- 172.21.15.114:0/1420492640 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fd3f80051c0 con 0x7fd4080afca0 2024-09-16T07:28:26.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.153+0000 7fd3ffe00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd3e4072ec0 0x7fd3e4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.153+0000 7fd3ffe00640 1 -- 172.21.15.114:0/1420492640 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd3f8094360 con 0x7fd4080afca0 2024-09-16T07:28:26.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.153+0000 7fd3fe000640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd3e4072ec0 0x7fd3e4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.153+0000 7fd3fe000640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd3e4072ec0 0x7fd3e4075380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4081fa950 tx=0x7fd3f0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:26.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.157+0000 7fd3ffe00640 1 -- 172.21.15.114:0/1420492640 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd3f8020070 con 0x7fd4080afca0 2024-09-16T07:28:26.281 INFO:tasks.ceph.mds.b.smithi149.stderr:2024-09-16T07:28:26.282+0000 7fb9bc800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:28:26.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.325+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd408070da0 con 0x7fd3e4072ec0 2024-09-16T07:28:26.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.329+0000 7fd3ffe00640 1 -- 172.21.15.114:0/1420492640 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240839 (secure 0 0 0) 0x7fd408070da0 con 0x7fd3e4072ec0 2024-09-16T07:28:26.335 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:26.336 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:28:26.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd3e4072ec0 msgr2=0x7fd3e4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd3e4072ec0 0x7fd3e4075380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4081fa950 tx=0x7fd3f0009040 comp rx=0 tx=0).stop 2024-09-16T07:28:26.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 msgr2=0x7fd40806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd40806f2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800dac0 tx=0x7fd3f800df80 comp rx=0 tx=0).stop 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 shutdown_connections 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd3e4072ec0 0x7fd3e4075380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40815f490 0x7fd4081585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4080b2e80 0x7fd408153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 --2- 172.21.15.114:0/1420492640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4080afca0 0x7fd40806f2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 >> 172.21.15.114:0/1420492640 conn(0x7fd4080d1e30 msgr2=0x7fd4080d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 shutdown_connections 2024-09-16T07:28:26.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.333+0000 7fd40de00640 1 -- 172.21.15.114:0/1420492640 wait complete. 2024-09-16T07:28:26.355 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-16T07:28:24.994742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":2600,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":2662400,"data_stored":1638107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.558381"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548812+0000","last_change":"2024-09-16T07:28:21.473706+0000","last_active":"2024-09-16T07:28:22.548812+0000","last_peered":"2024-09-16T07:28:22.548812+0000","last_clean":"2024-09-16T07:28:22.548812+0000","last_became_active":"2024-09-16T07:28:21.472045+0000","last_became_peered":"2024-09-16T07:28:21.472045+0000","last_unstale":"2024-09-16T07:28:22.548812+0000","last_undegraded":"2024-09-16T07:28:22.548812+0000","last_fullsized":"2024-09-16T07:28:22.548812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:20.884169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548289+0000","last_change":"2024-09-16T07:28:21.463979+0000","last_active":"2024-09-16T07:28:22.548289+0000","last_peered":"2024-09-16T07:28:22.548289+0000","last_clean":"2024-09-16T07:28:22.548289+0000","last_became_active":"2024-09-16T07:28:21.463670+0000","last_became_peered":"2024-09-16T07:28:21.463670+0000","last_unstale":"2024-09-16T07:28:22.548289+0000","last_undegraded":"2024-09-16T07:28:22.548289+0000","last_fullsized":"2024-09-16T07:28:22.548289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:19.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437962+0000","last_change":"2024-09-16T07:28:19.437962+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437962+0000","last_undegraded":"2024-09-16T07:28:19.437962+0000","last_fullsized":"2024-09-16T07:28:19.437962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442205+0000","last_change":"2024-09-16T07:28:19.442205+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442205+0000","last_undegraded":"2024-09-16T07:28:19.442205+0000","last_fullsized":"2024-09-16T07:28:19.442205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437871+0000","last_change":"2024-09-16T07:28:19.437871+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437871+0000","last_undegraded":"2024-09-16T07:28:19.437871+0000","last_fullsized":"2024-09-16T07:28:19.437871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438708+0000","last_change":"2024-09-16T07:28:19.438708+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438708+0000","last_undegraded":"2024-09-16T07:28:19.438708+0000","last_fullsized":"2024-09-16T07:28:19.438708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.443260+0000","last_change":"2024-09-16T07:28:19.443260+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.443260+0000","last_undegraded":"2024-09-16T07:28:19.443260+0000","last_fullsized":"2024-09-16T07:28:19.443260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.439411+0000","last_change":"2024-09-16T07:28:19.439411+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.439411+0000","last_undegraded":"2024-09-16T07:28:19.439411+0000","last_fullsized":"2024-09-16T07:28:19.439411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442352+0000","last_change":"2024-09-16T07:28:19.442352+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442352+0000","last_undegraded":"2024-09-16T07:28:19.442352+0000","last_fullsized":"2024-09-16T07:28:19.442352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442157+0000","last_change":"2024-09-16T07:28:19.442157+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442157+0000","last_undegraded":"2024-09-16T07:28:19.442157+0000","last_fullsized":"2024-09-16T07:28:19.442157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438717+0000","last_change":"2024-09-16T07:28:19.438717+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438717+0000","last_undegraded":"2024-09-16T07:28:19.438717+0000","last_fullsized":"2024-09-16T07:28:19.438717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.440421+0000","last_change":"2024-09-16T07:28:19.440421+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.440421+0000","last_undegraded":"2024-09-16T07:28:19.440421+0000","last_fullsized":"2024-09-16T07:28:19.440421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442175+0000","last_change":"2024-09-16T07:28:19.442175+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442175+0000","last_undegraded":"2024-09-16T07:28:19.442175+0000","last_fullsized":"2024-09-16T07:28:19.442175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548130+0000","last_change":"2024-09-16T07:28:20.457548+0000","last_active":"2024-09-16T07:28:22.548130+0000","last_peered":"2024-09-16T07:28:22.548130+0000","last_clean":"2024-09-16T07:28:22.548130+0000","last_became_active":"2024-09-16T07:28:20.457151+0000","last_became_peered":"2024-09-16T07:28:20.457151+0000","last_unstale":"2024-09-16T07:28:22.548130+0000","last_undegraded":"2024-09-16T07:28:22.548130+0000","last_fullsized":"2024-09-16T07:28:22.548130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:48.914037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438652+0000","last_change":"2024-09-16T07:28:19.438652+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438652+0000","last_undegraded":"2024-09-16T07:28:19.438652+0000","last_fullsized":"2024-09-16T07:28:19.438652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548720+0000","last_change":"2024-09-16T07:28:20.450706+0000","last_active":"2024-09-16T07:28:22.548720+0000","last_peered":"2024-09-16T07:28:22.548720+0000","last_clean":"2024-09-16T07:28:22.548720+0000","last_became_active":"2024-09-16T07:28:20.450379+0000","last_became_peered":"2024-09-16T07:28:20.450379+0000","last_unstale":"2024-09-16T07:28:22.548720+0000","last_undegraded":"2024-09-16T07:28:22.548720+0000","last_fullsized":"2024-09-16T07:28:22.548720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:37.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.441539+0000","last_change":"2024-09-16T07:28:19.441539+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.441539+0000","last_undegraded":"2024-09-16T07:28:19.441539+0000","last_fullsized":"2024-09-16T07:28:19.441539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548601+0000","last_change":"2024-09-16T07:28:20.465122+0000","last_active":"2024-09-16T07:28:22.548601+0000","last_peered":"2024-09-16T07:28:22.548601+0000","last_clean":"2024-09-16T07:28:22.548601+0000","last_became_active":"2024-09-16T07:28:20.464580+0000","last_became_peered":"2024-09-16T07:28:20.464580+0000","last_unstale":"2024-09-16T07:28:22.548601+0000","last_undegraded":"2024-09-16T07:28:22.548601+0000","last_fullsized":"2024-09-16T07:28:22.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:50.567918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T07:28:19.446977+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:28:19.446977+0000","last_peered":"2024-09-16T07:28:19.446977+0000","last_clean":"2024-09-16T07:28:19.446977+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:28:19.446977+0000","last_undegraded":"2024-09-16T07:28:19.446977+0000","last_fullsized":"2024-09-16T07:28:19.446977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438812+0000","last_change":"2024-09-16T07:28:19.438812+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438812+0000","last_undegraded":"2024-09-16T07:28:19.438812+0000","last_fullsized":"2024-09-16T07:28:19.438812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445196+0000","last_change":"2024-09-16T07:28:19.445196+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445196+0000","last_undegraded":"2024-09-16T07:28:19.445196+0000","last_fullsized":"2024-09-16T07:28:19.445196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548390+0000","last_change":"2024-09-16T07:28:20.453271+0000","last_active":"2024-09-16T07:28:22.548390+0000","last_peered":"2024-09-16T07:28:22.548390+0000","last_clean":"2024-09-16T07:28:22.548390+0000","last_became_active":"2024-09-16T07:28:20.452985+0000","last_became_peered":"2024-09-16T07:28:20.452985+0000","last_unstale":"2024-09-16T07:28:22.548390+0000","last_undegraded":"2024-09-16T07:28:22.548390+0000","last_fullsized":"2024-09-16T07:28:22.548390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:08.366019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438699+0000","last_change":"2024-09-16T07:28:19.438699+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438699+0000","last_undegraded":"2024-09-16T07:28:19.438699+0000","last_fullsized":"2024-09-16T07:28:19.438699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.441780+0000","last_change":"2024-09-16T07:28:19.441780+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.441780+0000","last_undegraded":"2024-09-16T07:28:19.441780+0000","last_fullsized":"2024-09-16T07:28:19.441780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445442+0000","last_change":"2024-09-16T07:28:19.445442+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445442+0000","last_undegraded":"2024-09-16T07:28:19.445442+0000","last_fullsized":"2024-09-16T07:28:19.445442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442798+0000","last_change":"2024-09-16T07:28:19.442798+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442798+0000","last_undegraded":"2024-09-16T07:28:19.442798+0000","last_fullsized":"2024-09-16T07:28:19.442798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442406+0000","last_change":"2024-09-16T07:28:19.442406+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442406+0000","last_undegraded":"2024-09-16T07:28:19.442406+0000","last_fullsized":"2024-09-16T07:28:19.442406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.446050+0000","last_change":"2024-09-16T07:28:19.446050+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.446050+0000","last_undegraded":"2024-09-16T07:28:19.446050+0000","last_fullsized":"2024-09-16T07:28:19.446050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.443079+0000","last_change":"2024-09-16T07:28:19.443079+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.443079+0000","last_undegraded":"2024-09-16T07:28:19.443079+0000","last_fullsized":"2024-09-16T07:28:19.443079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.442350+0000","last_change":"2024-09-16T07:28:19.442350+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.442350+0000","last_undegraded":"2024-09-16T07:28:19.442350+0000","last_fullsized":"2024-09-16T07:28:19.442350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445390+0000","last_change":"2024-09-16T07:28:19.445390+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445390+0000","last_undegraded":"2024-09-16T07:28:19.445390+0000","last_fullsized":"2024-09-16T07:28:19.445390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.445360+0000","last_change":"2024-09-16T07:28:19.445360+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.445360+0000","last_undegraded":"2024-09-16T07:28:19.445360+0000","last_fullsized":"2024-09-16T07:28:19.445360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.446416+0000","last_change":"2024-09-16T07:28:19.446416+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.446416+0000","last_undegraded":"2024-09-16T07:28:19.446416+0000","last_fullsized":"2024-09-16T07:28:19.446416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.437930+0000","last_change":"2024-09-16T07:28:19.437930+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.437930+0000","last_undegraded":"2024-09-16T07:28:19.437930+0000","last_fullsized":"2024-09-16T07:28:19.437930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:28:20.431125+0000","last_change":"2024-09-16T07:28:20.431125+0000","last_active":"2024-09-16T07:28:20.431125+0000","last_peered":"2024-09-16T07:28:20.431125+0000","last_clean":"2024-09-16T07:28:20.431125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:20.431125+0000","last_undegraded":"2024-09-16T07:28:20.431125+0000","last_fullsized":"2024-09-16T07:28:20.431125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-16T07:28:19.438830+0000","last_change":"2024-09-16T07:28:19.438830+0000","last_active":"2024-09-16T07:28:19.425157+0000","last_peered":"2024-09-16T07:28:19.425157+0000","last_clean":"2024-09-16T07:28:19.425157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:28:19.438830+0000","last_undegraded":"2024-09-16T07:28:19.438830+0000","last_fullsized":"2024-09-16T07:28:19.438830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":647302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":172032,"data_stored":51117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":765952,"data_stored":641485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:28:26.359 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-16T07:28:26.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.359 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-16T07:28:26.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-16T07:28:26.360 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-16T07:28:26.361 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-16T07:28:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.437962+0000', 'last_change': '2024-09-16T07:28:19.437962+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.437962+0000', 'last_undegraded': '2024-09-16T07:28:19.437962+0000', 'last_fullsized': '2024-09-16T07:28:19.437962+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-16T07:28:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.442205+0000', 'last_change': '2024-09-16T07:28:19.442205+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.442205+0000', 'last_undegraded': '2024-09-16T07:28:19.442205+0000', 'last_fullsized': '2024-09-16T07:28:19.442205+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.437871+0000', 'last_change': '2024-09-16T07:28:19.437871+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.437871+0000', 'last_undegraded': '2024-09-16T07:28:19.437871+0000', 'last_fullsized': '2024-09-16T07:28:19.437871+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.438708+0000', 'last_change': '2024-09-16T07:28:19.438708+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.438708+0000', 'last_undegraded': '2024-09-16T07:28:19.438708+0000', 'last_fullsized': '2024-09-16T07:28:19.438708+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.443260+0000', 'last_change': '2024-09-16T07:28:19.443260+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.443260+0000', 'last_undegraded': '2024-09-16T07:28:19.443260+0000', 'last_fullsized': '2024-09-16T07:28:19.443260+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:28:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.439411+0000', 'last_change': '2024-09-16T07:28:19.439411+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.439411+0000', 'last_undegraded': '2024-09-16T07:28:19.439411+0000', 'last_fullsized': '2024-09-16T07:28:19.439411+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.442352+0000', 'last_change': '2024-09-16T07:28:19.442352+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.442352+0000', 'last_undegraded': '2024-09-16T07:28:19.442352+0000', 'last_fullsized': '2024-09-16T07:28:19.442352+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:28:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.442157+0000', 'last_change': '2024-09-16T07:28:19.442157+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.442157+0000', 'last_undegraded': '2024-09-16T07:28:19.442157+0000', 'last_fullsized': '2024-09-16T07:28:19.442157+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.438717+0000', 'last_change': '2024-09-16T07:28:19.438717+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.438717+0000', 'last_undegraded': '2024-09-16T07:28:19.438717+0000', 'last_fullsized': '2024-09-16T07:28:19.438717+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-16T07:28:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.440421+0000', 'last_change': '2024-09-16T07:28:19.440421+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.440421+0000', 'last_undegraded': '2024-09-16T07:28:19.440421+0000', 'last_fullsized': '2024-09-16T07:28:19.440421+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.442175+0000', 'last_change': '2024-09-16T07:28:19.442175+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.442175+0000', 'last_undegraded': '2024-09-16T07:28:19.442175+0000', 'last_fullsized': '2024-09-16T07:28:19.442175+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.438652+0000', 'last_change': '2024-09-16T07:28:19.438652+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.438652+0000', 'last_undegraded': '2024-09-16T07:28:19.438652+0000', 'last_fullsized': '2024-09-16T07:28:19.438652+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:28:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.441539+0000', 'last_change': '2024-09-16T07:28:19.441539+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.441539+0000', 'last_undegraded': '2024-09-16T07:28:19.441539+0000', 'last_fullsized': '2024-09-16T07:28:19.441539+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-16T07:28:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.438812+0000', 'last_change': '2024-09-16T07:28:19.438812+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.438812+0000', 'last_undegraded': '2024-09-16T07:28:19.438812+0000', 'last_fullsized': '2024-09-16T07:28:19.438812+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.445196+0000', 'last_change': '2024-09-16T07:28:19.445196+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.445196+0000', 'last_undegraded': '2024-09-16T07:28:19.445196+0000', 'last_fullsized': '2024-09-16T07:28:19.445196+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.438699+0000', 'last_change': '2024-09-16T07:28:19.438699+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.438699+0000', 'last_undegraded': '2024-09-16T07:28:19.438699+0000', 'last_fullsized': '2024-09-16T07:28:19.438699+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-16T07:28:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.441780+0000', 'last_change': '2024-09-16T07:28:19.441780+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.441780+0000', 'last_undegraded': '2024-09-16T07:28:19.441780+0000', 'last_fullsized': '2024-09-16T07:28:19.441780+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.445442+0000', 'last_change': '2024-09-16T07:28:19.445442+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.445442+0000', 'last_undegraded': '2024-09-16T07:28:19.445442+0000', 'last_fullsized': '2024-09-16T07:28:19.445442+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.442798+0000', 'last_change': '2024-09-16T07:28:19.442798+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.442798+0000', 'last_undegraded': '2024-09-16T07:28:19.442798+0000', 'last_fullsized': '2024-09-16T07:28:19.442798+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:28:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.442406+0000', 'last_change': '2024-09-16T07:28:19.442406+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.442406+0000', 'last_undegraded': '2024-09-16T07:28:19.442406+0000', 'last_fullsized': '2024-09-16T07:28:19.442406+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.446050+0000', 'last_change': '2024-09-16T07:28:19.446050+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.446050+0000', 'last_undegraded': '2024-09-16T07:28:19.446050+0000', 'last_fullsized': '2024-09-16T07:28:19.446050+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-16T07:28:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.443079+0000', 'last_change': '2024-09-16T07:28:19.443079+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.443079+0000', 'last_undegraded': '2024-09-16T07:28:19.443079+0000', 'last_fullsized': '2024-09-16T07:28:19.443079+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.442350+0000', 'last_change': '2024-09-16T07:28:19.442350+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.442350+0000', 'last_undegraded': '2024-09-16T07:28:19.442350+0000', 'last_fullsized': '2024-09-16T07:28:19.442350+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.445390+0000', 'last_change': '2024-09-16T07:28:19.445390+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.445390+0000', 'last_undegraded': '2024-09-16T07:28:19.445390+0000', 'last_fullsized': '2024-09-16T07:28:19.445390+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-16T07:28:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.445360+0000', 'last_change': '2024-09-16T07:28:19.445360+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.445360+0000', 'last_undegraded': '2024-09-16T07:28:19.445360+0000', 'last_fullsized': '2024-09-16T07:28:19.445360+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.446416+0000', 'last_change': '2024-09-16T07:28:19.446416+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.446416+0000', 'last_undegraded': '2024-09-16T07:28:19.446416+0000', 'last_fullsized': '2024-09-16T07:28:19.446416+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-16T07:28:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.437930+0000', 'last_change': '2024-09-16T07:28:19.437930+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.437930+0000', 'last_undegraded': '2024-09-16T07:28:19.437930+0000', 'last_fullsized': '2024-09-16T07:28:19.437930+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:28:26.376 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-16T07:28:26.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:28:20.431125+0000', 'last_change': '2024-09-16T07:28:20.431125+0000', 'last_active': '2024-09-16T07:28:20.431125+0000', 'last_peered': '2024-09-16T07:28:20.431125+0000', 'last_clean': '2024-09-16T07:28:20.431125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:20.431125+0000', 'last_undegraded': '2024-09-16T07:28:20.431125+0000', 'last_fullsized': '2024-09-16T07:28:20.431125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:20.431125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:28:26.376 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-16T07:28:26.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:28:19.438830+0000', 'last_change': '2024-09-16T07:28:19.438830+0000', 'last_active': '2024-09-16T07:28:19.425157+0000', 'last_peered': '2024-09-16T07:28:19.425157+0000', 'last_clean': '2024-09-16T07:28:19.425157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:28:19.438830+0000', 'last_undegraded': '2024-09-16T07:28:19.438830+0000', 'last_fullsized': '2024-09-16T07:28:19.438830+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'last_clean_scrub_stamp': '2024-09-16T07:28:19.425157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:28:26.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:28:26.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- 172.21.15.114:0/593162704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22a4003a60 msgr2=0x7f22a4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 --2- 172.21.15.114:0/593162704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22a4003a60 0x7f22a4003e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009ee0 tx=0x7f22b001d5f0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- 172.21.15.114:0/593162704 shutdown_connections 2024-09-16T07:28:26.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 --2- 172.21.15.114:0/593162704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22a4003a60 0x7f22a4003e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- 172.21.15.114:0/593162704 >> 172.21.15.114:0/593162704 conn(0x7f22bc0d1da0 msgr2=0x7f22bc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:26.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- 172.21.15.114:0/593162704 shutdown_connections 2024-09-16T07:28:26.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- 172.21.15.114:0/593162704 wait complete. 2024-09-16T07:28:26.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 Processor -- start 2024-09-16T07:28:26.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- start start 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a4003a60 0x7f22bc1f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22bc0c7240 0x7f22bc0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22bc0c7e00 0x7f22bc0b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0ced00 con 0x7f22a4003a60 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0ceb80 con 0x7f22bc0c7240 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c4400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0cee80 con 0x7f22bc0c7e00 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a4003a60 0x7f22bc1f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a4003a60 0x7f22bc1f3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57438/0 (socket says 172.21.15.114:57438) 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.537+0000 7f22c1a00640 1 -- 172.21.15.114:0/3153913431 learned_addr learned my addr 172.21.15.114:0/3153913431 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c2400640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22bc0c7e00 0x7f22bc0b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c1000640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22bc0c7240 0x7f22bc0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c1a00640 1 -- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22bc0c7e00 msgr2=0x7f22bc0b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c1a00640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22bc0c7e00 0x7f22bc0b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c1a00640 1 -- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22bc0c7240 msgr2=0x7f22bc0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c1a00640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22bc0c7240 0x7f22bc0b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c1a00640 1 -- 172.21.15.114:0/3153913431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc0b4d70 con 0x7f22a4003a60 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c1a00640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a4003a60 0x7f22bc1f3820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009ee0 tx=0x7f22b0009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22b9600640 1 -- 172.21.15.114:0/3153913431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00ad030 con 0x7f22a4003a60 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22b9600640 1 -- 172.21.15.114:0/3153913431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22b0003c70 con 0x7f22a4003a60 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22b9600640 1 -- 172.21.15.114:0/3153913431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00a7ae0 con 0x7f22a4003a60 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc0b5050 con 0x7f22a4003a60 2024-09-16T07:28:26.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc0b5610 con 0x7f22a4003a60 2024-09-16T07:28:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc0cf3e0 con 0x7f22a4003a60 2024-09-16T07:28:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22b9600640 1 -- 172.21.15.114:0/3153913431 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f22b00b0070 con 0x7f22a4003a60 2024-09-16T07:28:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22b9600640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f229c072ef0 0x7f229c0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.541+0000 7f22b9600640 1 -- 172.21.15.114:0/3153913431 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f22b012ec60 con 0x7f22a4003a60 2024-09-16T07:28:26.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.545+0000 7f22c1000640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f229c072ef0 0x7f229c0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.545+0000 7f22c1000640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f229c072ef0 0x7f229c0753b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0b07c0 tx=0x7f22a8006b80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:26.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.545+0000 7f22b9600640 1 -- 172.21.15.114:0/3153913431 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f22b0017300 con 0x7f22a4003a60 2024-09-16T07:28:26.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.773+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f22bc0c8570 con 0x7f22a4003a60 2024-09-16T07:28:26.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.773+0000 7f22b9600640 1 -- 172.21.15.114:0/3153913431 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1210 (secure 0 0 0) 0x7f22b00f9e10 con 0x7f22a4003a60 2024-09-16T07:28:26.778 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:26.778 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":31,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":62},{"state_name":"creating+peering","count":28},{"state_name":"active+clean","count":7}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590368,"bytes_used":224337920,"bytes_avail":772869775360,"bytes_total":773094113280,"unknown_pgs_ratio":0.63917523622512817,"inactive_pgs_ratio":0.28865978121757507,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4378}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T07:27:55.717770+0000","services":{}},"progress_events":{}} 2024-09-16T07:28:26.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f229c072ef0 msgr2=0x7f229c0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f229c072ef0 0x7f229c0753b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0b07c0 tx=0x7f22a8006b80 comp rx=0 tx=0).stop 2024-09-16T07:28:26.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a4003a60 msgr2=0x7f22bc1f3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a4003a60 0x7f22bc1f3820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009ee0 tx=0x7f22b0009200 comp rx=0 tx=0).stop 2024-09-16T07:28:26.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 shutdown_connections 2024-09-16T07:28:26.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f229c072ef0 0x7f229c0753b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22bc0c7e00 0x7f22bc0b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22bc0c7240 0x7f22bc0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 --2- 172.21.15.114:0/3153913431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a4003a60 0x7f22bc1f3820 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 >> 172.21.15.114:0/3153913431 conn(0x7f22bc0d1da0 msgr2=0x7f22bc071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:26.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 shutdown_connections 2024-09-16T07:28:26.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.777+0000 7f22c4400640 1 -- 172.21.15.114:0/3153913431 wait complete. 2024-09-16T07:28:26.799 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:28:26.799 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- 172.21.15.114:0/3969515266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 msgr2=0x7f8d400cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 --2- 172.21.15.114:0/3969515266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d400cc940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d400d0f60 tx=0x7f8d2c01c7a0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- 172.21.15.114:0/3969515266 shutdown_connections 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 --2- 172.21.15.114:0/3969515266 >> v2:172.21.15.149:3300/0 conn(0x7f8d4015c130 0x7f8d400cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 --2- 172.21.15.114:0/3969515266 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d400cc940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- 172.21.15.114:0/3969515266 >> 172.21.15.114:0/3969515266 conn(0x7f8d400d1ea0 msgr2=0x7f8d400d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- 172.21.15.114:0/3969515266 shutdown_connections 2024-09-16T07:28:26.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- 172.21.15.114:0/3969515266 wait complete. 2024-09-16T07:28:26.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 Processor -- start 2024-09-16T07:28:26.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- start start 2024-09-16T07:28:26.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d4006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4015bd50 0x7f8d400b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d4015c130 0x7f8d401f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40169570 con 0x7f8d400cecf0 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401693f0 con 0x7f8d4015bd50 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d48000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8d401696f0 con 0x7f8d4015c130 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d4006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d4006dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57456/0 (socket says 172.21.15.114:57456) 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 -- 172.21.15.114:0/2699853087 learned_addr learned my addr 172.21.15.114:0/2699853087 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d44c00640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4015bd50 0x7f8d400b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d46000640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d4015c130 0x7f8d401f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 -- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d4015c130 msgr2=0x7f8d401f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d4015c130 0x7f8d401f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 -- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4015bd50 msgr2=0x7f8d400b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:26.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4015bd50 0x7f8d400b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:26.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d45600640 1 -- 172.21.15.114:0/2699853087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d401f9160 con 0x7f8d400cecf0 2024-09-16T07:28:26.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.937+0000 7f8d44c00640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4015bd50 0x7f8d400b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:26.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d45600640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d4006dd30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400c500 tx=0x7f8d3400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:26.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d3d600640 1 -- 172.21.15.114:0/2699853087 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34017070 con 0x7f8d400cecf0 2024-09-16T07:28:26.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d3d600640 1 -- 172.21.15.114:0/2699853087 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d340053c0 con 0x7f8d400cecf0 2024-09-16T07:28:26.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d3d600640 1 -- 172.21.15.114:0/2699853087 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34012890 con 0x7f8d400cecf0 2024-09-16T07:28:26.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4006e410 con 0x7f8d400cecf0 2024-09-16T07:28:26.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4006e9d0 con 0x7f8d400cecf0 2024-09-16T07:28:26.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d400ce5e0 con 0x7f8d400cecf0 2024-09-16T07:28:26.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d3d600640 1 -- 172.21.15.114:0/2699853087 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f8d3401a070 con 0x7f8d400cecf0 2024-09-16T07:28:26.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.941+0000 7f8d3d600640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d20072ec0 0x7f8d20075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:26.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.945+0000 7f8d3d600640 1 -- 172.21.15.114:0/2699853087 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8d340931c0 con 0x7f8d400cecf0 2024-09-16T07:28:26.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.945+0000 7f8d44c00640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d20072ec0 0x7f8d20075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:26.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.945+0000 7f8d44c00640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d20072ec0 0x7f8d20075380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0af000 tx=0x7f8d2c01afe0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:26.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:26.949+0000 7f8d3d600640 1 -- 172.21.15.114:0/2699853087 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8d3405e380 con 0x7f8d400cecf0 2024-09-16T07:28:27.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.113+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d400cfc30 con 0x7f8d20072ec0 2024-09-16T07:28:27.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.117+0000 7f8d3d600640 1 -- 172.21.15.114:0/2699853087 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f8d400cfc30 con 0x7f8d20072ec0 2024-09-16T07:28:27.123 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:27.125 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d20072ec0 msgr2=0x7f8d20075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d20072ec0 0x7f8d20075380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0af000 tx=0x7f8d2c01afe0 comp rx=0 tx=0).stop 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 msgr2=0x7f8d4006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d4006dd30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400c500 tx=0x7f8d3400c9c0 comp rx=0 tx=0).stop 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 shutdown_connections 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d20072ec0 0x7f8d20075380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d4015c130 0x7f8d401f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:27.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d4015bd50 0x7f8d400b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:27.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 --2- 172.21.15.114:0/2699853087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d400cecf0 0x7f8d4006dd30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:27.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 >> 172.21.15.114:0/2699853087 conn(0x7f8d400d1ea0 msgr2=0x7f8d4015a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:27.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 shutdown_connections 2024-09-16T07:28:27.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:27.121+0000 7f8d48000640 1 -- 172.21.15.114:0/2699853087 wait complete. 2024-09-16T07:28:27.143 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-16T07:28:26.995439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.555060"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468764+0000","last_change":"2024-09-16T07:28:21.494577+0000","last_active":"2024-09-16T07:28:22.468764+0000","last_peered":"2024-09-16T07:28:22.468764+0000","last_clean":"2024-09-16T07:28:22.468764+0000","last_became_active":"2024-09-16T07:28:21.493934+0000","last_became_peered":"2024-09-16T07:28:21.493934+0000","last_unstale":"2024-09-16T07:28:22.468764+0000","last_undegraded":"2024-09-16T07:28:22.468764+0000","last_fullsized":"2024-09-16T07:28:22.468764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:23:14.503112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496746+0000","last_change":"2024-09-16T07:28:21.477637+0000","last_active":"2024-09-16T07:28:22.496746+0000","last_peered":"2024-09-16T07:28:22.496746+0000","last_clean":"2024-09-16T07:28:22.496746+0000","last_became_active":"2024-09-16T07:28:21.477003+0000","last_became_peered":"2024-09-16T07:28:21.477003+0000","last_unstale":"2024-09-16T07:28:22.496746+0000","last_undegraded":"2024-09-16T07:28:22.496746+0000","last_fullsized":"2024-09-16T07:28:22.496746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549155+0000","last_change":"2024-09-16T07:28:21.481637+0000","last_active":"2024-09-16T07:28:22.549155+0000","last_peered":"2024-09-16T07:28:22.549155+0000","last_clean":"2024-09-16T07:28:22.549155+0000","last_became_active":"2024-09-16T07:28:21.481332+0000","last_became_peered":"2024-09-16T07:28:21.481332+0000","last_unstale":"2024-09-16T07:28:22.549155+0000","last_undegraded":"2024-09-16T07:28:22.549155+0000","last_fullsized":"2024-09-16T07:28:22.549155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467466+0000","last_change":"2024-09-16T07:28:21.487204+0000","last_active":"2024-09-16T07:28:22.467466+0000","last_peered":"2024-09-16T07:28:22.467466+0000","last_clean":"2024-09-16T07:28:22.467466+0000","last_became_active":"2024-09-16T07:28:21.486943+0000","last_became_peered":"2024-09-16T07:28:21.486943+0000","last_unstale":"2024-09-16T07:28:22.467466+0000","last_undegraded":"2024-09-16T07:28:22.467466+0000","last_fullsized":"2024-09-16T07:28:22.467466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467523+0000","last_change":"2024-09-16T07:28:21.484353+0000","last_active":"2024-09-16T07:28:22.467523+0000","last_peered":"2024-09-16T07:28:22.467523+0000","last_clean":"2024-09-16T07:28:22.467523+0000","last_became_active":"2024-09-16T07:28:21.484096+0000","last_became_peered":"2024-09-16T07:28:21.484096+0000","last_unstale":"2024-09-16T07:28:22.467523+0000","last_undegraded":"2024-09-16T07:28:22.467523+0000","last_fullsized":"2024-09-16T07:28:22.467523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:00.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467515+0000","last_change":"2024-09-16T07:28:21.496054+0000","last_active":"2024-09-16T07:28:22.467515+0000","last_peered":"2024-09-16T07:28:22.467515+0000","last_clean":"2024-09-16T07:28:22.467515+0000","last_became_active":"2024-09-16T07:28:21.495720+0000","last_became_peered":"2024-09-16T07:28:21.495720+0000","last_unstale":"2024-09-16T07:28:22.467515+0000","last_undegraded":"2024-09-16T07:28:22.467515+0000","last_fullsized":"2024-09-16T07:28:22.467515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467387+0000","last_change":"2024-09-16T07:28:21.486935+0000","last_active":"2024-09-16T07:28:22.467387+0000","last_peered":"2024-09-16T07:28:22.467387+0000","last_clean":"2024-09-16T07:28:22.467387+0000","last_became_active":"2024-09-16T07:28:21.486668+0000","last_became_peered":"2024-09-16T07:28:21.486668+0000","last_unstale":"2024-09-16T07:28:22.467387+0000","last_undegraded":"2024-09-16T07:28:22.467387+0000","last_fullsized":"2024-09-16T07:28:22.467387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:26.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464347+0000","last_change":"2024-09-16T07:28:21.488749+0000","last_active":"2024-09-16T07:28:22.464347+0000","last_peered":"2024-09-16T07:28:22.464347+0000","last_clean":"2024-09-16T07:28:22.464347+0000","last_became_active":"2024-09-16T07:28:21.488344+0000","last_became_peered":"2024-09-16T07:28:21.488344+0000","last_unstale":"2024-09-16T07:28:22.464347+0000","last_undegraded":"2024-09-16T07:28:22.464347+0000","last_fullsized":"2024-09-16T07:28:22.464347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468674+0000","last_change":"2024-09-16T07:28:21.494268+0000","last_active":"2024-09-16T07:28:22.468674+0000","last_peered":"2024-09-16T07:28:22.468674+0000","last_clean":"2024-09-16T07:28:22.468674+0000","last_became_active":"2024-09-16T07:28:21.493475+0000","last_became_peered":"2024-09-16T07:28:21.493475+0000","last_unstale":"2024-09-16T07:28:22.468674+0000","last_undegraded":"2024-09-16T07:28:22.468674+0000","last_fullsized":"2024-09-16T07:28:22.468674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:12:34.391720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503097+0000","last_change":"2024-09-16T07:28:21.483444+0000","last_active":"2024-09-16T07:28:22.503097+0000","last_peered":"2024-09-16T07:28:22.503097+0000","last_clean":"2024-09-16T07:28:22.503097+0000","last_became_active":"2024-09-16T07:28:21.477957+0000","last_became_peered":"2024-09-16T07:28:21.477957+0000","last_unstale":"2024-09-16T07:28:22.503097+0000","last_undegraded":"2024-09-16T07:28:22.503097+0000","last_fullsized":"2024-09-16T07:28:22.503097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502910+0000","last_change":"2024-09-16T07:28:21.489623+0000","last_active":"2024-09-16T07:28:22.502910+0000","last_peered":"2024-09-16T07:28:22.502910+0000","last_clean":"2024-09-16T07:28:22.502910+0000","last_became_active":"2024-09-16T07:28:21.489309+0000","last_became_peered":"2024-09-16T07:28:21.489309+0000","last_unstale":"2024-09-16T07:28:22.502910+0000","last_undegraded":"2024-09-16T07:28:22.502910+0000","last_fullsized":"2024-09-16T07:28:22.502910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551994+0000","last_change":"2024-09-16T07:28:21.478068+0000","last_active":"2024-09-16T07:28:22.551994+0000","last_peered":"2024-09-16T07:28:22.551994+0000","last_clean":"2024-09-16T07:28:22.551994+0000","last_became_active":"2024-09-16T07:28:21.477672+0000","last_became_peered":"2024-09-16T07:28:21.477672+0000","last_unstale":"2024-09-16T07:28:22.551994+0000","last_undegraded":"2024-09-16T07:28:22.551994+0000","last_fullsized":"2024-09-16T07:28:22.551994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:54.933972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464732+0000","last_change":"2024-09-16T07:28:21.476271+0000","last_active":"2024-09-16T07:28:22.464732+0000","last_peered":"2024-09-16T07:28:22.464732+0000","last_clean":"2024-09-16T07:28:22.464732+0000","last_became_active":"2024-09-16T07:28:21.475852+0000","last_became_peered":"2024-09-16T07:28:21.475852+0000","last_unstale":"2024-09-16T07:28:22.464732+0000","last_undegraded":"2024-09-16T07:28:22.464732+0000","last_fullsized":"2024-09-16T07:28:22.464732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548912+0000","last_change":"2024-09-16T07:28:21.478669+0000","last_active":"2024-09-16T07:28:22.548912+0000","last_peered":"2024-09-16T07:28:22.548912+0000","last_clean":"2024-09-16T07:28:22.548912+0000","last_became_active":"2024-09-16T07:28:21.478365+0000","last_became_peered":"2024-09-16T07:28:21.478365+0000","last_unstale":"2024-09-16T07:28:22.548912+0000","last_undegraded":"2024-09-16T07:28:22.548912+0000","last_fullsized":"2024-09-16T07:28:22.548912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:29.836351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496252+0000","last_change":"2024-09-16T07:28:21.464672+0000","last_active":"2024-09-16T07:28:22.496252+0000","last_peered":"2024-09-16T07:28:22.496252+0000","last_clean":"2024-09-16T07:28:22.496252+0000","last_became_active":"2024-09-16T07:28:21.464371+0000","last_became_peered":"2024-09-16T07:28:21.464371+0000","last_unstale":"2024-09-16T07:28:22.496252+0000","last_undegraded":"2024-09-16T07:28:22.496252+0000","last_fullsized":"2024-09-16T07:28:22.496252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467116+0000","last_change":"2024-09-16T07:28:21.495723+0000","last_active":"2024-09-16T07:28:22.467116+0000","last_peered":"2024-09-16T07:28:22.467116+0000","last_clean":"2024-09-16T07:28:22.467116+0000","last_became_active":"2024-09-16T07:28:21.495360+0000","last_became_peered":"2024-09-16T07:28:21.495360+0000","last_unstale":"2024-09-16T07:28:22.467116+0000","last_undegraded":"2024-09-16T07:28:22.467116+0000","last_fullsized":"2024-09-16T07:28:22.467116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467869+0000","last_change":"2024-09-16T07:28:21.487979+0000","last_active":"2024-09-16T07:28:22.467869+0000","last_peered":"2024-09-16T07:28:22.467869+0000","last_clean":"2024-09-16T07:28:22.467869+0000","last_became_active":"2024-09-16T07:28:21.487716+0000","last_became_peered":"2024-09-16T07:28:21.487716+0000","last_unstale":"2024-09-16T07:28:22.467869+0000","last_undegraded":"2024-09-16T07:28:22.467869+0000","last_fullsized":"2024-09-16T07:28:22.467869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548812+0000","last_change":"2024-09-16T07:28:21.473706+0000","last_active":"2024-09-16T07:28:22.548812+0000","last_peered":"2024-09-16T07:28:22.548812+0000","last_clean":"2024-09-16T07:28:22.548812+0000","last_became_active":"2024-09-16T07:28:21.472045+0000","last_became_peered":"2024-09-16T07:28:21.472045+0000","last_unstale":"2024-09-16T07:28:22.548812+0000","last_undegraded":"2024-09-16T07:28:22.548812+0000","last_fullsized":"2024-09-16T07:28:22.548812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:20.884169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468434+0000","last_change":"2024-09-16T07:28:21.483475+0000","last_active":"2024-09-16T07:28:22.468434+0000","last_peered":"2024-09-16T07:28:22.468434+0000","last_clean":"2024-09-16T07:28:22.468434+0000","last_became_active":"2024-09-16T07:28:21.483089+0000","last_became_peered":"2024-09-16T07:28:21.483089+0000","last_unstale":"2024-09-16T07:28:22.468434+0000","last_undegraded":"2024-09-16T07:28:22.468434+0000","last_fullsized":"2024-09-16T07:28:22.468434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:06.838109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502819+0000","last_change":"2024-09-16T07:28:21.484778+0000","last_active":"2024-09-16T07:28:22.502819+0000","last_peered":"2024-09-16T07:28:22.502819+0000","last_clean":"2024-09-16T07:28:22.502819+0000","last_became_active":"2024-09-16T07:28:21.484204+0000","last_became_peered":"2024-09-16T07:28:21.484204+0000","last_unstale":"2024-09-16T07:28:22.502819+0000","last_undegraded":"2024-09-16T07:28:22.502819+0000","last_fullsized":"2024-09-16T07:28:22.502819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549143+0000","last_change":"2024-09-16T07:28:21.483859+0000","last_active":"2024-09-16T07:28:22.549143+0000","last_peered":"2024-09-16T07:28:22.549143+0000","last_clean":"2024-09-16T07:28:22.549143+0000","last_became_active":"2024-09-16T07:28:21.483553+0000","last_became_peered":"2024-09-16T07:28:21.483553+0000","last_unstale":"2024-09-16T07:28:22.549143+0000","last_undegraded":"2024-09-16T07:28:22.549143+0000","last_fullsized":"2024-09-16T07:28:22.549143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:02.888442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467718+0000","last_change":"2024-09-16T07:28:21.489323+0000","last_active":"2024-09-16T07:28:22.467718+0000","last_peered":"2024-09-16T07:28:22.467718+0000","last_clean":"2024-09-16T07:28:22.467718+0000","last_became_active":"2024-09-16T07:28:21.489030+0000","last_became_peered":"2024-09-16T07:28:21.489030+0000","last_unstale":"2024-09-16T07:28:22.467718+0000","last_undegraded":"2024-09-16T07:28:22.467718+0000","last_fullsized":"2024-09-16T07:28:22.467718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464446+0000","last_change":"2024-09-16T07:28:21.486749+0000","last_active":"2024-09-16T07:28:22.464446+0000","last_peered":"2024-09-16T07:28:22.464446+0000","last_clean":"2024-09-16T07:28:22.464446+0000","last_became_active":"2024-09-16T07:28:21.486460+0000","last_became_peered":"2024-09-16T07:28:21.486460+0000","last_unstale":"2024-09-16T07:28:22.464446+0000","last_undegraded":"2024-09-16T07:28:22.464446+0000","last_fullsized":"2024-09-16T07:28:22.464446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467149+0000","last_change":"2024-09-16T07:28:21.489962+0000","last_active":"2024-09-16T07:28:22.467149+0000","last_peered":"2024-09-16T07:28:22.467149+0000","last_clean":"2024-09-16T07:28:22.467149+0000","last_became_active":"2024-09-16T07:28:21.489700+0000","last_became_peered":"2024-09-16T07:28:21.489700+0000","last_unstale":"2024-09-16T07:28:22.467149+0000","last_undegraded":"2024-09-16T07:28:22.467149+0000","last_fullsized":"2024-09-16T07:28:22.467149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465167+0000","last_change":"2024-09-16T07:28:21.475734+0000","last_active":"2024-09-16T07:28:22.465167+0000","last_peered":"2024-09-16T07:28:22.465167+0000","last_clean":"2024-09-16T07:28:22.465167+0000","last_became_active":"2024-09-16T07:28:21.474927+0000","last_became_peered":"2024-09-16T07:28:21.474927+0000","last_unstale":"2024-09-16T07:28:22.465167+0000","last_undegraded":"2024-09-16T07:28:22.465167+0000","last_fullsized":"2024-09-16T07:28:22.465167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503167+0000","last_change":"2024-09-16T07:28:21.491054+0000","last_active":"2024-09-16T07:28:22.503167+0000","last_peered":"2024-09-16T07:28:22.503167+0000","last_clean":"2024-09-16T07:28:22.503167+0000","last_became_active":"2024-09-16T07:28:21.490686+0000","last_became_peered":"2024-09-16T07:28:21.490686+0000","last_unstale":"2024-09-16T07:28:22.503167+0000","last_undegraded":"2024-09-16T07:28:22.503167+0000","last_fullsized":"2024-09-16T07:28:22.503167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496663+0000","last_change":"2024-09-16T07:28:21.473001+0000","last_active":"2024-09-16T07:28:22.496663+0000","last_peered":"2024-09-16T07:28:22.496663+0000","last_clean":"2024-09-16T07:28:22.496663+0000","last_became_active":"2024-09-16T07:28:21.472729+0000","last_became_peered":"2024-09-16T07:28:21.472729+0000","last_unstale":"2024-09-16T07:28:22.496663+0000","last_undegraded":"2024-09-16T07:28:22.496663+0000","last_fullsized":"2024-09-16T07:28:22.496663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464910+0000","last_change":"2024-09-16T07:28:21.475995+0000","last_active":"2024-09-16T07:28:22.464910+0000","last_peered":"2024-09-16T07:28:22.464910+0000","last_clean":"2024-09-16T07:28:22.464910+0000","last_became_active":"2024-09-16T07:28:21.475693+0000","last_became_peered":"2024-09-16T07:28:21.475693+0000","last_unstale":"2024-09-16T07:28:22.464910+0000","last_undegraded":"2024-09-16T07:28:22.464910+0000","last_fullsized":"2024-09-16T07:28:22.464910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549102+0000","last_change":"2024-09-16T07:28:21.480473+0000","last_active":"2024-09-16T07:28:22.549102+0000","last_peered":"2024-09-16T07:28:22.549102+0000","last_clean":"2024-09-16T07:28:22.549102+0000","last_became_active":"2024-09-16T07:28:21.480165+0000","last_became_peered":"2024-09-16T07:28:21.480165+0000","last_unstale":"2024-09-16T07:28:22.549102+0000","last_undegraded":"2024-09-16T07:28:22.549102+0000","last_fullsized":"2024-09-16T07:28:22.549102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:37.071702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467933+0000","last_change":"2024-09-16T07:28:21.500956+0000","last_active":"2024-09-16T07:28:22.467933+0000","last_peered":"2024-09-16T07:28:22.467933+0000","last_clean":"2024-09-16T07:28:22.467933+0000","last_became_active":"2024-09-16T07:28:21.500678+0000","last_became_peered":"2024-09-16T07:28:21.500678+0000","last_unstale":"2024-09-16T07:28:22.467933+0000","last_undegraded":"2024-09-16T07:28:22.467933+0000","last_fullsized":"2024-09-16T07:28:22.467933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:19:59.668925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548289+0000","last_change":"2024-09-16T07:28:21.463979+0000","last_active":"2024-09-16T07:28:22.548289+0000","last_peered":"2024-09-16T07:28:22.548289+0000","last_clean":"2024-09-16T07:28:22.548289+0000","last_became_active":"2024-09-16T07:28:21.463670+0000","last_became_peered":"2024-09-16T07:28:21.463670+0000","last_unstale":"2024-09-16T07:28:22.548289+0000","last_undegraded":"2024-09-16T07:28:22.548289+0000","last_fullsized":"2024-09-16T07:28:22.548289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:19.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502645+0000","last_change":"2024-09-16T07:28:21.484394+0000","last_active":"2024-09-16T07:28:22.502645+0000","last_peered":"2024-09-16T07:28:22.502645+0000","last_clean":"2024-09-16T07:28:22.502645+0000","last_became_active":"2024-09-16T07:28:21.484000+0000","last_became_peered":"2024-09-16T07:28:21.484000+0000","last_unstale":"2024-09-16T07:28:22.502645+0000","last_undegraded":"2024-09-16T07:28:22.502645+0000","last_fullsized":"2024-09-16T07:28:22.502645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551777+0000","last_change":"2024-09-16T07:28:21.488398+0000","last_active":"2024-09-16T07:28:22.551777+0000","last_peered":"2024-09-16T07:28:22.551777+0000","last_clean":"2024-09-16T07:28:22.551777+0000","last_became_active":"2024-09-16T07:28:21.488082+0000","last_became_peered":"2024-09-16T07:28:21.488082+0000","last_unstale":"2024-09-16T07:28:22.551777+0000","last_undegraded":"2024-09-16T07:28:22.551777+0000","last_fullsized":"2024-09-16T07:28:22.551777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:56.278436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464818+0000","last_change":"2024-09-16T07:28:20.460754+0000","last_active":"2024-09-16T07:28:22.464818+0000","last_peered":"2024-09-16T07:28:22.464818+0000","last_clean":"2024-09-16T07:28:22.464818+0000","last_became_active":"2024-09-16T07:28:20.460452+0000","last_became_peered":"2024-09-16T07:28:20.460452+0000","last_unstale":"2024-09-16T07:28:22.464818+0000","last_undegraded":"2024-09-16T07:28:22.464818+0000","last_fullsized":"2024-09-16T07:28:22.464818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:33.769857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549314+0000","last_change":"2024-09-16T07:28:21.494146+0000","last_active":"2024-09-16T07:28:22.549314+0000","last_peered":"2024-09-16T07:28:22.549314+0000","last_clean":"2024-09-16T07:28:22.549314+0000","last_became_active":"2024-09-16T07:28:21.493871+0000","last_became_peered":"2024-09-16T07:28:21.493871+0000","last_unstale":"2024-09-16T07:28:22.549314+0000","last_undegraded":"2024-09-16T07:28:22.549314+0000","last_fullsized":"2024-09-16T07:28:22.549314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502498+0000","last_change":"2024-09-16T07:28:20.459159+0000","last_active":"2024-09-16T07:28:22.502498+0000","last_peered":"2024-09-16T07:28:22.502498+0000","last_clean":"2024-09-16T07:28:22.502498+0000","last_became_active":"2024-09-16T07:28:20.456616+0000","last_became_peered":"2024-09-16T07:28:20.456616+0000","last_unstale":"2024-09-16T07:28:22.502498+0000","last_undegraded":"2024-09-16T07:28:22.502498+0000","last_fullsized":"2024-09-16T07:28:22.502498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464412+0000","last_change":"2024-09-16T07:28:20.462946+0000","last_active":"2024-09-16T07:28:22.464412+0000","last_peered":"2024-09-16T07:28:22.464412+0000","last_clean":"2024-09-16T07:28:22.464412+0000","last_became_active":"2024-09-16T07:28:20.462684+0000","last_became_peered":"2024-09-16T07:28:20.462684+0000","last_unstale":"2024-09-16T07:28:22.464412+0000","last_undegraded":"2024-09-16T07:28:22.464412+0000","last_fullsized":"2024-09-16T07:28:22.464412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:52.266984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464445+0000","last_change":"2024-09-16T07:28:21.476488+0000","last_active":"2024-09-16T07:28:22.464445+0000","last_peered":"2024-09-16T07:28:22.464445+0000","last_clean":"2024-09-16T07:28:22.464445+0000","last_became_active":"2024-09-16T07:28:21.475830+0000","last_became_peered":"2024-09-16T07:28:21.475830+0000","last_unstale":"2024-09-16T07:28:22.464445+0000","last_undegraded":"2024-09-16T07:28:22.464445+0000","last_fullsized":"2024-09-16T07:28:22.464445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467181+0000","last_change":"2024-09-16T07:28:20.466562+0000","last_active":"2024-09-16T07:28:22.467181+0000","last_peered":"2024-09-16T07:28:22.467181+0000","last_clean":"2024-09-16T07:28:22.467181+0000","last_became_active":"2024-09-16T07:28:20.465752+0000","last_became_peered":"2024-09-16T07:28:20.465752+0000","last_unstale":"2024-09-16T07:28:22.467181+0000","last_undegraded":"2024-09-16T07:28:22.467181+0000","last_fullsized":"2024-09-16T07:28:22.467181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496248+0000","last_change":"2024-09-16T07:28:21.469784+0000","last_active":"2024-09-16T07:28:22.496248+0000","last_peered":"2024-09-16T07:28:22.496248+0000","last_clean":"2024-09-16T07:28:22.496248+0000","last_became_active":"2024-09-16T07:28:21.469633+0000","last_became_peered":"2024-09-16T07:28:21.469633+0000","last_unstale":"2024-09-16T07:28:22.496248+0000","last_undegraded":"2024-09-16T07:28:22.496248+0000","last_fullsized":"2024-09-16T07:28:22.496248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503022+0000","last_change":"2024-09-16T07:28:20.463652+0000","last_active":"2024-09-16T07:28:22.503022+0000","last_peered":"2024-09-16T07:28:22.503022+0000","last_clean":"2024-09-16T07:28:22.503022+0000","last_became_active":"2024-09-16T07:28:20.463379+0000","last_became_peered":"2024-09-16T07:28:20.463379+0000","last_unstale":"2024-09-16T07:28:22.503022+0000","last_undegraded":"2024-09-16T07:28:22.503022+0000","last_fullsized":"2024-09-16T07:28:22.503022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468195+0000","last_change":"2024-09-16T07:28:21.500436+0000","last_active":"2024-09-16T07:28:22.468195+0000","last_peered":"2024-09-16T07:28:22.468195+0000","last_clean":"2024-09-16T07:28:22.468195+0000","last_became_active":"2024-09-16T07:28:21.500187+0000","last_became_peered":"2024-09-16T07:28:21.500187+0000","last_unstale":"2024-09-16T07:28:22.468195+0000","last_undegraded":"2024-09-16T07:28:22.468195+0000","last_fullsized":"2024-09-16T07:28:22.468195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:50:23.478685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468098+0000","last_change":"2024-09-16T07:28:20.472210+0000","last_active":"2024-09-16T07:28:22.468098+0000","last_peered":"2024-09-16T07:28:22.468098+0000","last_clean":"2024-09-16T07:28:22.468098+0000","last_became_active":"2024-09-16T07:28:20.471902+0000","last_became_peered":"2024-09-16T07:28:20.471902+0000","last_unstale":"2024-09-16T07:28:22.468098+0000","last_undegraded":"2024-09-16T07:28:22.468098+0000","last_fullsized":"2024-09-16T07:28:22.468098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549390+0000","last_change":"2024-09-16T07:28:21.489089+0000","last_active":"2024-09-16T07:28:22.549390+0000","last_peered":"2024-09-16T07:28:22.549390+0000","last_clean":"2024-09-16T07:28:22.549390+0000","last_became_active":"2024-09-16T07:28:21.488554+0000","last_became_peered":"2024-09-16T07:28:21.488554+0000","last_unstale":"2024-09-16T07:28:22.549390+0000","last_undegraded":"2024-09-16T07:28:22.549390+0000","last_fullsized":"2024-09-16T07:28:22.549390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:03.502755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496514+0000","last_change":"2024-09-16T07:28:20.461734+0000","last_active":"2024-09-16T07:28:22.496514+0000","last_peered":"2024-09-16T07:28:22.496514+0000","last_clean":"2024-09-16T07:28:22.496514+0000","last_became_active":"2024-09-16T07:28:20.461508+0000","last_became_peered":"2024-09-16T07:28:20.461508+0000","last_unstale":"2024-09-16T07:28:22.496514+0000","last_undegraded":"2024-09-16T07:28:22.496514+0000","last_fullsized":"2024-09-16T07:28:22.496514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:48.563809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.552021+0000","last_change":"2024-09-16T07:28:21.482206+0000","last_active":"2024-09-16T07:28:22.552021+0000","last_peered":"2024-09-16T07:28:22.552021+0000","last_clean":"2024-09-16T07:28:22.552021+0000","last_became_active":"2024-09-16T07:28:21.481551+0000","last_became_peered":"2024-09-16T07:28:21.481551+0000","last_unstale":"2024-09-16T07:28:22.552021+0000","last_undegraded":"2024-09-16T07:28:22.552021+0000","last_fullsized":"2024-09-16T07:28:22.552021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:39.225323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502717+0000","last_change":"2024-09-16T07:28:20.469828+0000","last_active":"2024-09-16T07:28:22.502717+0000","last_peered":"2024-09-16T07:28:22.502717+0000","last_clean":"2024-09-16T07:28:22.502717+0000","last_became_active":"2024-09-16T07:28:20.469327+0000","last_became_peered":"2024-09-16T07:28:20.469327+0000","last_unstale":"2024-09-16T07:28:22.502717+0000","last_undegraded":"2024-09-16T07:28:22.502717+0000","last_fullsized":"2024-09-16T07:28:22.502717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467227+0000","last_change":"2024-09-16T07:28:21.484091+0000","last_active":"2024-09-16T07:28:22.467227+0000","last_peered":"2024-09-16T07:28:22.467227+0000","last_clean":"2024-09-16T07:28:22.467227+0000","last_became_active":"2024-09-16T07:28:21.483783+0000","last_became_peered":"2024-09-16T07:28:21.483783+0000","last_unstale":"2024-09-16T07:28:22.467227+0000","last_undegraded":"2024-09-16T07:28:22.467227+0000","last_fullsized":"2024-09-16T07:28:22.467227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:07.182120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549218+0000","last_change":"2024-09-16T07:28:20.451995+0000","last_active":"2024-09-16T07:28:22.549218+0000","last_peered":"2024-09-16T07:28:22.549218+0000","last_clean":"2024-09-16T07:28:22.549218+0000","last_became_active":"2024-09-16T07:28:20.451740+0000","last_became_peered":"2024-09-16T07:28:20.451740+0000","last_unstale":"2024-09-16T07:28:22.549218+0000","last_undegraded":"2024-09-16T07:28:22.549218+0000","last_fullsized":"2024-09-16T07:28:22.549218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:50.421459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548952+0000","last_change":"2024-09-16T07:28:21.478652+0000","last_active":"2024-09-16T07:28:22.548952+0000","last_peered":"2024-09-16T07:28:22.548952+0000","last_clean":"2024-09-16T07:28:22.548952+0000","last_became_active":"2024-09-16T07:28:21.478073+0000","last_became_peered":"2024-09-16T07:28:21.478073+0000","last_unstale":"2024-09-16T07:28:22.548952+0000","last_undegraded":"2024-09-16T07:28:22.548952+0000","last_fullsized":"2024-09-16T07:28:22.548952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:19:21.305531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467810+0000","last_change":"2024-09-16T07:28:20.467427+0000","last_active":"2024-09-16T07:28:22.467810+0000","last_peered":"2024-09-16T07:28:22.467810+0000","last_clean":"2024-09-16T07:28:22.467810+0000","last_became_active":"2024-09-16T07:28:20.467214+0000","last_became_peered":"2024-09-16T07:28:20.467214+0000","last_unstale":"2024-09-16T07:28:22.467810+0000","last_undegraded":"2024-09-16T07:28:22.467810+0000","last_fullsized":"2024-09-16T07:28:22.467810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467633+0000","last_change":"2024-09-16T07:28:21.480102+0000","last_active":"2024-09-16T07:28:22.467633+0000","last_peered":"2024-09-16T07:28:22.467633+0000","last_clean":"2024-09-16T07:28:22.467633+0000","last_became_active":"2024-09-16T07:28:21.479792+0000","last_became_peered":"2024-09-16T07:28:21.479792+0000","last_unstale":"2024-09-16T07:28:22.467633+0000","last_undegraded":"2024-09-16T07:28:22.467633+0000","last_fullsized":"2024-09-16T07:28:22.467633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:01.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502453+0000","last_change":"2024-09-16T07:28:20.458181+0000","last_active":"2024-09-16T07:28:22.502453+0000","last_peered":"2024-09-16T07:28:22.502453+0000","last_clean":"2024-09-16T07:28:22.502453+0000","last_became_active":"2024-09-16T07:28:20.456385+0000","last_became_peered":"2024-09-16T07:28:20.456385+0000","last_unstale":"2024-09-16T07:28:22.502453+0000","last_undegraded":"2024-09-16T07:28:22.502453+0000","last_fullsized":"2024-09-16T07:28:22.502453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502619+0000","last_change":"2024-09-16T07:28:21.482950+0000","last_active":"2024-09-16T07:28:22.502619+0000","last_peered":"2024-09-16T07:28:22.502619+0000","last_clean":"2024-09-16T07:28:22.502619+0000","last_became_active":"2024-09-16T07:28:21.482427+0000","last_became_peered":"2024-09-16T07:28:21.482427+0000","last_unstale":"2024-09-16T07:28:22.502619+0000","last_undegraded":"2024-09-16T07:28:22.502619+0000","last_fullsized":"2024-09-16T07:28:22.502619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548130+0000","last_change":"2024-09-16T07:28:20.457548+0000","last_active":"2024-09-16T07:28:22.548130+0000","last_peered":"2024-09-16T07:28:22.548130+0000","last_clean":"2024-09-16T07:28:22.548130+0000","last_became_active":"2024-09-16T07:28:20.457151+0000","last_became_peered":"2024-09-16T07:28:20.457151+0000","last_unstale":"2024-09-16T07:28:22.548130+0000","last_undegraded":"2024-09-16T07:28:22.548130+0000","last_fullsized":"2024-09-16T07:28:22.548130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:48.914037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467591+0000","last_change":"2024-09-16T07:28:21.491418+0000","last_active":"2024-09-16T07:28:22.467591+0000","last_peered":"2024-09-16T07:28:22.467591+0000","last_clean":"2024-09-16T07:28:22.467591+0000","last_became_active":"2024-09-16T07:28:21.491157+0000","last_became_peered":"2024-09-16T07:28:21.491157+0000","last_unstale":"2024-09-16T07:28:22.467591+0000","last_undegraded":"2024-09-16T07:28:22.467591+0000","last_fullsized":"2024-09-16T07:28:22.467591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551843+0000","last_change":"2024-09-16T07:28:20.458574+0000","last_active":"2024-09-16T07:28:22.551843+0000","last_peered":"2024-09-16T07:28:22.551843+0000","last_clean":"2024-09-16T07:28:22.551843+0000","last_became_active":"2024-09-16T07:28:20.458268+0000","last_became_peered":"2024-09-16T07:28:20.458268+0000","last_unstale":"2024-09-16T07:28:22.551843+0000","last_undegraded":"2024-09-16T07:28:22.551843+0000","last_fullsized":"2024-09-16T07:28:22.551843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:46:58.633211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468568+0000","last_change":"2024-09-16T07:28:21.492507+0000","last_active":"2024-09-16T07:28:22.468568+0000","last_peered":"2024-09-16T07:28:22.468568+0000","last_clean":"2024-09-16T07:28:22.468568+0000","last_became_active":"2024-09-16T07:28:21.492267+0000","last_became_peered":"2024-09-16T07:28:21.492267+0000","last_unstale":"2024-09-16T07:28:22.468568+0000","last_undegraded":"2024-09-16T07:28:22.468568+0000","last_fullsized":"2024-09-16T07:28:22.468568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:02.918148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548720+0000","last_change":"2024-09-16T07:28:20.450706+0000","last_active":"2024-09-16T07:28:22.548720+0000","last_peered":"2024-09-16T07:28:22.548720+0000","last_clean":"2024-09-16T07:28:22.548720+0000","last_became_active":"2024-09-16T07:28:20.450379+0000","last_became_peered":"2024-09-16T07:28:20.450379+0000","last_unstale":"2024-09-16T07:28:22.548720+0000","last_undegraded":"2024-09-16T07:28:22.548720+0000","last_fullsized":"2024-09-16T07:28:22.548720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:37.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468790+0000","last_change":"2024-09-16T07:28:21.480183+0000","last_active":"2024-09-16T07:28:22.468790+0000","last_peered":"2024-09-16T07:28:22.468790+0000","last_clean":"2024-09-16T07:28:22.468790+0000","last_became_active":"2024-09-16T07:28:21.479807+0000","last_became_peered":"2024-09-16T07:28:21.479807+0000","last_unstale":"2024-09-16T07:28:22.468790+0000","last_undegraded":"2024-09-16T07:28:22.468790+0000","last_fullsized":"2024-09-16T07:28:22.468790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:35.281982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496622+0000","last_change":"2024-09-16T07:28:20.456101+0000","last_active":"2024-09-16T07:28:22.496622+0000","last_peered":"2024-09-16T07:28:22.496622+0000","last_clean":"2024-09-16T07:28:22.496622+0000","last_became_active":"2024-09-16T07:28:20.453929+0000","last_became_peered":"2024-09-16T07:28:20.453929+0000","last_unstale":"2024-09-16T07:28:22.496622+0000","last_undegraded":"2024-09-16T07:28:22.496622+0000","last_fullsized":"2024-09-16T07:28:22.496622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:53.936877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467874+0000","last_change":"2024-09-16T07:28:21.499515+0000","last_active":"2024-09-16T07:28:22.467874+0000","last_peered":"2024-09-16T07:28:22.467874+0000","last_clean":"2024-09-16T07:28:22.467874+0000","last_became_active":"2024-09-16T07:28:21.490747+0000","last_became_peered":"2024-09-16T07:28:21.490747+0000","last_unstale":"2024-09-16T07:28:22.467874+0000","last_undegraded":"2024-09-16T07:28:22.467874+0000","last_fullsized":"2024-09-16T07:28:22.467874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:32.209796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548601+0000","last_change":"2024-09-16T07:28:20.465122+0000","last_active":"2024-09-16T07:28:22.548601+0000","last_peered":"2024-09-16T07:28:22.548601+0000","last_clean":"2024-09-16T07:28:22.548601+0000","last_became_active":"2024-09-16T07:28:20.464580+0000","last_became_peered":"2024-09-16T07:28:20.464580+0000","last_unstale":"2024-09-16T07:28:22.548601+0000","last_undegraded":"2024-09-16T07:28:22.548601+0000","last_fullsized":"2024-09-16T07:28:22.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:50.567918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467440+0000","last_change":"2024-09-16T07:28:21.488112+0000","last_active":"2024-09-16T07:28:22.467440+0000","last_peered":"2024-09-16T07:28:22.467440+0000","last_clean":"2024-09-16T07:28:22.467440+0000","last_became_active":"2024-09-16T07:28:21.487902+0000","last_became_peered":"2024-09-16T07:28:21.487902+0000","last_unstale":"2024-09-16T07:28:22.467440+0000","last_undegraded":"2024-09-16T07:28:22.467440+0000","last_fullsized":"2024-09-16T07:28:22.467440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:27.706301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467313+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:28:22.467313+0000","last_peered":"2024-09-16T07:28:22.467313+0000","last_clean":"2024-09-16T07:28:22.467313+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:28:22.467313+0000","last_undegraded":"2024-09-16T07:28:22.467313+0000","last_fullsized":"2024-09-16T07:28:22.467313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.466990+0000","last_change":"2024-09-16T07:28:20.460935+0000","last_active":"2024-09-16T07:28:22.466990+0000","last_peered":"2024-09-16T07:28:22.466990+0000","last_clean":"2024-09-16T07:28:22.466990+0000","last_became_active":"2024-09-16T07:28:20.460629+0000","last_became_peered":"2024-09-16T07:28:20.460629+0000","last_unstale":"2024-09-16T07:28:22.466990+0000","last_undegraded":"2024-09-16T07:28:22.466990+0000","last_fullsized":"2024-09-16T07:28:22.466990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464687+0000","last_change":"2024-09-16T07:28:21.488741+0000","last_active":"2024-09-16T07:28:22.464687+0000","last_peered":"2024-09-16T07:28:22.464687+0000","last_clean":"2024-09-16T07:28:22.464687+0000","last_became_active":"2024-09-16T07:28:21.488257+0000","last_became_peered":"2024-09-16T07:28:21.488257+0000","last_unstale":"2024-09-16T07:28:22.464687+0000","last_undegraded":"2024-09-16T07:28:22.464687+0000","last_fullsized":"2024-09-16T07:28:22.464687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467205+0000","last_change":"2024-09-16T07:28:20.467488+0000","last_active":"2024-09-16T07:28:22.467205+0000","last_peered":"2024-09-16T07:28:22.467205+0000","last_clean":"2024-09-16T07:28:22.467205+0000","last_became_active":"2024-09-16T07:28:20.466897+0000","last_became_peered":"2024-09-16T07:28:20.466897+0000","last_unstale":"2024-09-16T07:28:22.467205+0000","last_undegraded":"2024-09-16T07:28:22.467205+0000","last_fullsized":"2024-09-16T07:28:22.467205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548576+0000","last_change":"2024-09-16T07:28:21.494039+0000","last_active":"2024-09-16T07:28:22.548576+0000","last_peered":"2024-09-16T07:28:22.548576+0000","last_clean":"2024-09-16T07:28:22.548576+0000","last_became_active":"2024-09-16T07:28:21.493705+0000","last_became_peered":"2024-09-16T07:28:21.493705+0000","last_unstale":"2024-09-16T07:28:22.548576+0000","last_undegraded":"2024-09-16T07:28:22.548576+0000","last_fullsized":"2024-09-16T07:28:22.548576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:06:41.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548390+0000","last_change":"2024-09-16T07:28:20.453271+0000","last_active":"2024-09-16T07:28:22.548390+0000","last_peered":"2024-09-16T07:28:22.548390+0000","last_clean":"2024-09-16T07:28:22.548390+0000","last_became_active":"2024-09-16T07:28:20.452985+0000","last_became_peered":"2024-09-16T07:28:20.452985+0000","last_unstale":"2024-09-16T07:28:22.548390+0000","last_undegraded":"2024-09-16T07:28:22.548390+0000","last_fullsized":"2024-09-16T07:28:22.548390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:08.366019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496234+0000","last_change":"2024-09-16T07:28:21.464203+0000","last_active":"2024-09-16T07:28:22.496234+0000","last_peered":"2024-09-16T07:28:22.496234+0000","last_clean":"2024-09-16T07:28:22.496234+0000","last_became_active":"2024-09-16T07:28:21.463943+0000","last_became_peered":"2024-09-16T07:28:21.463943+0000","last_unstale":"2024-09-16T07:28:22.496234+0000","last_undegraded":"2024-09-16T07:28:22.496234+0000","last_fullsized":"2024-09-16T07:28:22.496234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:10.337642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467921+0000","last_change":"2024-09-16T07:28:20.459755+0000","last_active":"2024-09-16T07:28:22.467921+0000","last_peered":"2024-09-16T07:28:22.467921+0000","last_clean":"2024-09-16T07:28:22.467921+0000","last_became_active":"2024-09-16T07:28:20.459383+0000","last_became_peered":"2024-09-16T07:28:20.459383+0000","last_unstale":"2024-09-16T07:28:22.467921+0000","last_undegraded":"2024-09-16T07:28:22.467921+0000","last_fullsized":"2024-09-16T07:28:22.467921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551881+0000","last_change":"2024-09-16T07:28:21.490524+0000","last_active":"2024-09-16T07:28:22.551881+0000","last_peered":"2024-09-16T07:28:22.551881+0000","last_clean":"2024-09-16T07:28:22.551881+0000","last_became_active":"2024-09-16T07:28:21.490245+0000","last_became_peered":"2024-09-16T07:28:21.490245+0000","last_unstale":"2024-09-16T07:28:22.551881+0000","last_undegraded":"2024-09-16T07:28:22.551881+0000","last_fullsized":"2024-09-16T07:28:22.551881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.777612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496506+0000","last_change":"2024-09-16T07:28:20.460535+0000","last_active":"2024-09-16T07:28:22.496506+0000","last_peered":"2024-09-16T07:28:22.496506+0000","last_clean":"2024-09-16T07:28:22.496506+0000","last_became_active":"2024-09-16T07:28:20.456847+0000","last_became_peered":"2024-09-16T07:28:20.456847+0000","last_unstale":"2024-09-16T07:28:22.496506+0000","last_undegraded":"2024-09-16T07:28:22.496506+0000","last_fullsized":"2024-09-16T07:28:22.496506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:09:04.534477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468312+0000","last_change":"2024-09-16T07:28:21.485772+0000","last_active":"2024-09-16T07:28:22.468312+0000","last_peered":"2024-09-16T07:28:22.468312+0000","last_clean":"2024-09-16T07:28:22.468312+0000","last_became_active":"2024-09-16T07:28:21.485344+0000","last_became_peered":"2024-09-16T07:28:21.485344+0000","last_unstale":"2024-09-16T07:28:22.468312+0000","last_undegraded":"2024-09-16T07:28:22.468312+0000","last_fullsized":"2024-09-16T07:28:22.468312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:45.375465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468364+0000","last_change":"2024-09-16T07:28:20.470503+0000","last_active":"2024-09-16T07:28:22.468364+0000","last_peered":"2024-09-16T07:28:22.468364+0000","last_clean":"2024-09-16T07:28:22.468364+0000","last_became_active":"2024-09-16T07:28:20.470225+0000","last_became_peered":"2024-09-16T07:28:20.470225+0000","last_unstale":"2024-09-16T07:28:22.468364+0000","last_undegraded":"2024-09-16T07:28:22.468364+0000","last_fullsized":"2024-09-16T07:28:22.468364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:38.219355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496796+0000","last_change":"2024-09-16T07:28:21.463398+0000","last_active":"2024-09-16T07:28:22.496796+0000","last_peered":"2024-09-16T07:28:22.496796+0000","last_clean":"2024-09-16T07:28:22.496796+0000","last_became_active":"2024-09-16T07:28:21.463066+0000","last_became_peered":"2024-09-16T07:28:21.463066+0000","last_unstale":"2024-09-16T07:28:22.496796+0000","last_undegraded":"2024-09-16T07:28:22.496796+0000","last_fullsized":"2024-09-16T07:28:22.496796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496604+0000","last_change":"2024-09-16T07:28:20.469212+0000","last_active":"2024-09-16T07:28:22.496604+0000","last_peered":"2024-09-16T07:28:22.496604+0000","last_clean":"2024-09-16T07:28:22.496604+0000","last_became_active":"2024-09-16T07:28:20.468969+0000","last_became_peered":"2024-09-16T07:28:20.468969+0000","last_unstale":"2024-09-16T07:28:22.496604+0000","last_undegraded":"2024-09-16T07:28:22.496604+0000","last_fullsized":"2024-09-16T07:28:22.496604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:10.096462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465338+0000","last_change":"2024-09-16T07:28:21.480569+0000","last_active":"2024-09-16T07:28:22.465338+0000","last_peered":"2024-09-16T07:28:22.465338+0000","last_clean":"2024-09-16T07:28:22.465338+0000","last_became_active":"2024-09-16T07:28:21.480272+0000","last_became_peered":"2024-09-16T07:28:21.480272+0000","last_unstale":"2024-09-16T07:28:22.465338+0000","last_undegraded":"2024-09-16T07:28:22.465338+0000","last_fullsized":"2024-09-16T07:28:22.465338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503045+0000","last_change":"2024-09-16T07:28:20.472754+0000","last_active":"2024-09-16T07:28:22.503045+0000","last_peered":"2024-09-16T07:28:22.503045+0000","last_clean":"2024-09-16T07:28:22.503045+0000","last_became_active":"2024-09-16T07:28:20.472465+0000","last_became_peered":"2024-09-16T07:28:20.472465+0000","last_unstale":"2024-09-16T07:28:22.503045+0000","last_undegraded":"2024-09-16T07:28:22.503045+0000","last_fullsized":"2024-09-16T07:28:22.503045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549298+0000","last_change":"2024-09-16T07:28:21.478910+0000","last_active":"2024-09-16T07:28:22.549298+0000","last_peered":"2024-09-16T07:28:22.549298+0000","last_clean":"2024-09-16T07:28:22.549298+0000","last_became_active":"2024-09-16T07:28:21.478515+0000","last_became_peered":"2024-09-16T07:28:21.478515+0000","last_unstale":"2024-09-16T07:28:22.549298+0000","last_undegraded":"2024-09-16T07:28:22.549298+0000","last_fullsized":"2024-09-16T07:28:22.549298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:44.297339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467103+0000","last_change":"2024-09-16T07:28:20.459234+0000","last_active":"2024-09-16T07:28:22.467103+0000","last_peered":"2024-09-16T07:28:22.467103+0000","last_clean":"2024-09-16T07:28:22.467103+0000","last_became_active":"2024-09-16T07:28:20.459002+0000","last_became_peered":"2024-09-16T07:28:20.459002+0000","last_unstale":"2024-09-16T07:28:22.467103+0000","last_undegraded":"2024-09-16T07:28:22.467103+0000","last_fullsized":"2024-09-16T07:28:22.467103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551768+0000","last_change":"2024-09-16T07:28:21.493498+0000","last_active":"2024-09-16T07:28:22.551768+0000","last_peered":"2024-09-16T07:28:22.551768+0000","last_clean":"2024-09-16T07:28:22.551768+0000","last_became_active":"2024-09-16T07:28:21.491830+0000","last_became_peered":"2024-09-16T07:28:21.491830+0000","last_unstale":"2024-09-16T07:28:22.551768+0000","last_undegraded":"2024-09-16T07:28:22.551768+0000","last_fullsized":"2024-09-16T07:28:22.551768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:49.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496318+0000","last_change":"2024-09-16T07:28:20.461750+0000","last_active":"2024-09-16T07:28:22.496318+0000","last_peered":"2024-09-16T07:28:22.496318+0000","last_clean":"2024-09-16T07:28:22.496318+0000","last_became_active":"2024-09-16T07:28:20.460989+0000","last_became_peered":"2024-09-16T07:28:20.460989+0000","last_unstale":"2024-09-16T07:28:22.496318+0000","last_undegraded":"2024-09-16T07:28:22.496318+0000","last_fullsized":"2024-09-16T07:28:22.496318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:31.404291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464583+0000","last_change":"2024-09-16T07:28:21.469832+0000","last_active":"2024-09-16T07:28:22.464583+0000","last_peered":"2024-09-16T07:28:22.464583+0000","last_clean":"2024-09-16T07:28:22.464583+0000","last_became_active":"2024-09-16T07:28:21.469570+0000","last_became_peered":"2024-09-16T07:28:21.469570+0000","last_unstale":"2024-09-16T07:28:22.464583+0000","last_undegraded":"2024-09-16T07:28:22.464583+0000","last_fullsized":"2024-09-16T07:28:22.464583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496456+0000","last_change":"2024-09-16T07:28:20.461709+0000","last_active":"2024-09-16T07:28:22.496456+0000","last_peered":"2024-09-16T07:28:22.496456+0000","last_clean":"2024-09-16T07:28:22.496456+0000","last_became_active":"2024-09-16T07:28:20.461478+0000","last_became_peered":"2024-09-16T07:28:20.461478+0000","last_unstale":"2024-09-16T07:28:22.496456+0000","last_undegraded":"2024-09-16T07:28:22.496456+0000","last_fullsized":"2024-09-16T07:28:22.496456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:27:11.719843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465235+0000","last_change":"2024-09-16T07:28:21.481588+0000","last_active":"2024-09-16T07:28:22.465235+0000","last_peered":"2024-09-16T07:28:22.465235+0000","last_clean":"2024-09-16T07:28:22.465235+0000","last_became_active":"2024-09-16T07:28:21.481312+0000","last_became_peered":"2024-09-16T07:28:21.481312+0000","last_unstale":"2024-09-16T07:28:22.465235+0000","last_undegraded":"2024-09-16T07:28:22.465235+0000","last_fullsized":"2024-09-16T07:28:22.465235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467664+0000","last_change":"2024-09-16T07:28:20.474381+0000","last_active":"2024-09-16T07:28:22.467664+0000","last_peered":"2024-09-16T07:28:22.467664+0000","last_clean":"2024-09-16T07:28:22.467664+0000","last_became_active":"2024-09-16T07:28:20.474113+0000","last_became_peered":"2024-09-16T07:28:20.474113+0000","last_unstale":"2024-09-16T07:28:22.467664+0000","last_undegraded":"2024-09-16T07:28:22.467664+0000","last_fullsized":"2024-09-16T07:28:22.467664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:13.771645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502639+0000","last_change":"2024-09-16T07:28:21.483733+0000","last_active":"2024-09-16T07:28:22.502639+0000","last_peered":"2024-09-16T07:28:22.502639+0000","last_clean":"2024-09-16T07:28:22.502639+0000","last_became_active":"2024-09-16T07:28:21.483452+0000","last_became_peered":"2024-09-16T07:28:21.483452+0000","last_unstale":"2024-09-16T07:28:22.502639+0000","last_undegraded":"2024-09-16T07:28:22.502639+0000","last_fullsized":"2024-09-16T07:28:22.502639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467989+0000","last_change":"2024-09-16T07:28:21.502241+0000","last_active":"2024-09-16T07:28:22.467989+0000","last_peered":"2024-09-16T07:28:22.467989+0000","last_clean":"2024-09-16T07:28:22.467989+0000","last_became_active":"2024-09-16T07:28:21.500368+0000","last_became_peered":"2024-09-16T07:28:21.500368+0000","last_unstale":"2024-09-16T07:28:22.467989+0000","last_undegraded":"2024-09-16T07:28:22.467989+0000","last_fullsized":"2024-09-16T07:28:22.467989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.521033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468050+0000","last_change":"2024-09-16T07:28:20.466726+0000","last_active":"2024-09-16T07:28:22.468050+0000","last_peered":"2024-09-16T07:28:22.468050+0000","last_clean":"2024-09-16T07:28:22.468050+0000","last_became_active":"2024-09-16T07:28:20.466535+0000","last_became_peered":"2024-09-16T07:28:20.466535+0000","last_unstale":"2024-09-16T07:28:22.468050+0000","last_undegraded":"2024-09-16T07:28:22.468050+0000","last_fullsized":"2024-09-16T07:28:22.468050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467654+0000","last_change":"2024-09-16T07:28:21.499780+0000","last_active":"2024-09-16T07:28:22.467654+0000","last_peered":"2024-09-16T07:28:22.467654+0000","last_clean":"2024-09-16T07:28:22.467654+0000","last_became_active":"2024-09-16T07:28:21.499225+0000","last_became_peered":"2024-09-16T07:28:21.499225+0000","last_unstale":"2024-09-16T07:28:22.467654+0000","last_undegraded":"2024-09-16T07:28:22.467654+0000","last_fullsized":"2024-09-16T07:28:22.467654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468251+0000","last_change":"2024-09-16T07:28:20.472973+0000","last_active":"2024-09-16T07:28:22.468251+0000","last_peered":"2024-09-16T07:28:22.468251+0000","last_clean":"2024-09-16T07:28:22.468251+0000","last_became_active":"2024-09-16T07:28:20.472643+0000","last_became_peered":"2024-09-16T07:28:20.472643+0000","last_unstale":"2024-09-16T07:28:22.468251+0000","last_undegraded":"2024-09-16T07:28:22.468251+0000","last_fullsized":"2024-09-16T07:28:22.468251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:53.928004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549340+0000","last_change":"2024-09-16T07:28:21.488803+0000","last_active":"2024-09-16T07:28:22.549340+0000","last_peered":"2024-09-16T07:28:22.549340+0000","last_clean":"2024-09-16T07:28:22.549340+0000","last_became_active":"2024-09-16T07:28:21.488204+0000","last_became_peered":"2024-09-16T07:28:21.488204+0000","last_unstale":"2024-09-16T07:28:22.549340+0000","last_undegraded":"2024-09-16T07:28:22.549340+0000","last_fullsized":"2024-09-16T07:28:22.549340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:38.599962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465112+0000","last_change":"2024-09-16T07:28:20.465546+0000","last_active":"2024-09-16T07:28:22.465112+0000","last_peered":"2024-09-16T07:28:22.465112+0000","last_clean":"2024-09-16T07:28:22.465112+0000","last_became_active":"2024-09-16T07:28:20.465269+0000","last_became_peered":"2024-09-16T07:28:20.465269+0000","last_unstale":"2024-09-16T07:28:22.465112+0000","last_undegraded":"2024-09-16T07:28:22.465112+0000","last_fullsized":"2024-09-16T07:28:22.465112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465103+0000","last_change":"2024-09-16T07:28:21.475942+0000","last_active":"2024-09-16T07:28:22.465103+0000","last_peered":"2024-09-16T07:28:22.465103+0000","last_clean":"2024-09-16T07:28:22.465103+0000","last_became_active":"2024-09-16T07:28:21.475610+0000","last_became_peered":"2024-09-16T07:28:21.475610+0000","last_unstale":"2024-09-16T07:28:22.465103+0000","last_undegraded":"2024-09-16T07:28:22.465103+0000","last_fullsized":"2024-09-16T07:28:22.465103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549378+0000","last_change":"2024-09-16T07:28:20.455173+0000","last_active":"2024-09-16T07:28:22.549378+0000","last_peered":"2024-09-16T07:28:22.549378+0000","last_clean":"2024-09-16T07:28:22.549378+0000","last_became_active":"2024-09-16T07:28:20.454889+0000","last_became_peered":"2024-09-16T07:28:20.454889+0000","last_unstale":"2024-09-16T07:28:22.549378+0000","last_undegraded":"2024-09-16T07:28:22.549378+0000","last_fullsized":"2024-09-16T07:28:22.549378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:53.808988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:28:30.148 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:28:30.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.297+0000 7f6290000640 1 -- 172.21.15.114:0/4091481062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6270003a40 msgr2=0x7f6270003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.297+0000 7f6290000640 1 --2- 172.21.15.114:0/4091481062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6270003a40 0x7f6270003e60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f627c0016f0 tx=0x7f627c01c6f0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.297+0000 7f628e000640 1 -- 172.21.15.114:0/4091481062 reap_dead start 2024-09-16T07:28:30.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.297+0000 7f6290000640 1 -- 172.21.15.114:0/4091481062 shutdown_connections 2024-09-16T07:28:30.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.297+0000 7f6290000640 1 -- 172.21.15.114:0/4091481062 >> 172.21.15.114:0/4091481062 conn(0x7f62880d0cd0 msgr2=0x7f62880d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:30.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.297+0000 7f6290000640 1 -- 172.21.15.114:0/4091481062 shutdown_connections 2024-09-16T07:28:30.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.297+0000 7f6290000640 1 -- 172.21.15.114:0/4091481062 wait complete. 2024-09-16T07:28:30.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 Processor -- start 2024-09-16T07:28:30.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 -- start start 2024-09-16T07:28:30.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6270003a40 0x7f62881f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6288164370 0x7f62881fb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6288150f10 0x7f62881607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6288166ff0 con 0x7f6288150f10 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6288166e70 con 0x7f6288164370 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6288167170 con 0x7f6270003a40 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628d600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6270003a40 0x7f62881f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6288150f10 0x7f62881607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6288164370 0x7f62881fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6288150f10 0x7f62881607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57468/0 (socket says 172.21.15.114:57468) 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 -- 172.21.15.114:0/3446622933 learned_addr learned my addr 172.21.15.114:0/3446622933 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 -- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6270003a40 msgr2=0x7f62881f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6270003a40 0x7f62881f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 -- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6288164370 msgr2=0x7f62881fb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6288164370 0x7f62881fb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 -- 172.21.15.114:0/3446622933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62881fbc30 con 0x7f6288150f10 2024-09-16T07:28:30.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f628e000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6288150f10 0x7f62881607c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62880b3920 tx=0x7f628000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:30.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6285600640 1 -- 172.21.15.114:0/3446622933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280015070 con 0x7f6288150f10 2024-09-16T07:28:30.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6285600640 1 -- 172.21.15.114:0/3446622933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f628000cd30 con 0x7f6288150f10 2024-09-16T07:28:30.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6285600640 1 -- 172.21.15.114:0/3446622933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280001ac0 con 0x7f6288150f10 2024-09-16T07:28:30.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.301+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62881fbf10 con 0x7f6288150f10 2024-09-16T07:28:30.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.305+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62880b40a0 con 0x7f6288150f10 2024-09-16T07:28:30.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.305+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62880b42a0 con 0x7f6288150f10 2024-09-16T07:28:30.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.305+0000 7f6285600640 1 -- 172.21.15.114:0/3446622933 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6280018070 con 0x7f6288150f10 2024-09-16T07:28:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.305+0000 7f6285600640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6268072ec0 0x7f6268075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.305+0000 7f6285600640 1 -- 172.21.15.114:0/3446622933 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6280094300 con 0x7f6288150f10 2024-09-16T07:28:30.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.305+0000 7f628d600640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6268072ec0 0x7f6268075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.309+0000 7f628d600640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6268072ec0 0x7f6268075380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f627c0016c0 tx=0x7f627c0194e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:30.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.309+0000 7f6285600640 1 -- 172.21.15.114:0/3446622933 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f62880b42a0 con 0x7f6288150f10 2024-09-16T07:28:30.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.473+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6288164130 con 0x7f6268072ec0 2024-09-16T07:28:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.481+0000 7f6285600640 1 -- 172.21.15.114:0/3446622933 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f627c006130 con 0x7f6268072ec0 2024-09-16T07:28:30.486 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:30.488 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:28:30.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6268072ec0 msgr2=0x7f6268075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6268072ec0 0x7f6268075380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f627c0016c0 tx=0x7f627c0194e0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6288150f10 msgr2=0x7f62881607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6288150f10 0x7f62881607c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62880b3920 tx=0x7f628000ed70 comp rx=0 tx=0).stop 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 shutdown_connections 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6268072ec0 0x7f6268075380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6288150f10 0x7f62881607c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6288164370 0x7f62881fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 --2- 172.21.15.114:0/3446622933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6270003a40 0x7f62881f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 >> 172.21.15.114:0/3446622933 conn(0x7f62880d0cd0 msgr2=0x7f62880cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 shutdown_connections 2024-09-16T07:28:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.485+0000 7f6290000640 1 -- 172.21.15.114:0/3446622933 wait complete. 2024-09-16T07:28:30.508 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T07:28:28.996080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002153"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468764+0000","last_change":"2024-09-16T07:28:21.494577+0000","last_active":"2024-09-16T07:28:22.468764+0000","last_peered":"2024-09-16T07:28:22.468764+0000","last_clean":"2024-09-16T07:28:22.468764+0000","last_became_active":"2024-09-16T07:28:21.493934+0000","last_became_peered":"2024-09-16T07:28:21.493934+0000","last_unstale":"2024-09-16T07:28:22.468764+0000","last_undegraded":"2024-09-16T07:28:22.468764+0000","last_fullsized":"2024-09-16T07:28:22.468764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:23:14.503112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496746+0000","last_change":"2024-09-16T07:28:21.477637+0000","last_active":"2024-09-16T07:28:22.496746+0000","last_peered":"2024-09-16T07:28:22.496746+0000","last_clean":"2024-09-16T07:28:22.496746+0000","last_became_active":"2024-09-16T07:28:21.477003+0000","last_became_peered":"2024-09-16T07:28:21.477003+0000","last_unstale":"2024-09-16T07:28:22.496746+0000","last_undegraded":"2024-09-16T07:28:22.496746+0000","last_fullsized":"2024-09-16T07:28:22.496746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549155+0000","last_change":"2024-09-16T07:28:21.481637+0000","last_active":"2024-09-16T07:28:22.549155+0000","last_peered":"2024-09-16T07:28:22.549155+0000","last_clean":"2024-09-16T07:28:22.549155+0000","last_became_active":"2024-09-16T07:28:21.481332+0000","last_became_peered":"2024-09-16T07:28:21.481332+0000","last_unstale":"2024-09-16T07:28:22.549155+0000","last_undegraded":"2024-09-16T07:28:22.549155+0000","last_fullsized":"2024-09-16T07:28:22.549155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467466+0000","last_change":"2024-09-16T07:28:21.487204+0000","last_active":"2024-09-16T07:28:22.467466+0000","last_peered":"2024-09-16T07:28:22.467466+0000","last_clean":"2024-09-16T07:28:22.467466+0000","last_became_active":"2024-09-16T07:28:21.486943+0000","last_became_peered":"2024-09-16T07:28:21.486943+0000","last_unstale":"2024-09-16T07:28:22.467466+0000","last_undegraded":"2024-09-16T07:28:22.467466+0000","last_fullsized":"2024-09-16T07:28:22.467466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467523+0000","last_change":"2024-09-16T07:28:21.484353+0000","last_active":"2024-09-16T07:28:22.467523+0000","last_peered":"2024-09-16T07:28:22.467523+0000","last_clean":"2024-09-16T07:28:22.467523+0000","last_became_active":"2024-09-16T07:28:21.484096+0000","last_became_peered":"2024-09-16T07:28:21.484096+0000","last_unstale":"2024-09-16T07:28:22.467523+0000","last_undegraded":"2024-09-16T07:28:22.467523+0000","last_fullsized":"2024-09-16T07:28:22.467523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:00.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467515+0000","last_change":"2024-09-16T07:28:21.496054+0000","last_active":"2024-09-16T07:28:22.467515+0000","last_peered":"2024-09-16T07:28:22.467515+0000","last_clean":"2024-09-16T07:28:22.467515+0000","last_became_active":"2024-09-16T07:28:21.495720+0000","last_became_peered":"2024-09-16T07:28:21.495720+0000","last_unstale":"2024-09-16T07:28:22.467515+0000","last_undegraded":"2024-09-16T07:28:22.467515+0000","last_fullsized":"2024-09-16T07:28:22.467515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467387+0000","last_change":"2024-09-16T07:28:21.486935+0000","last_active":"2024-09-16T07:28:22.467387+0000","last_peered":"2024-09-16T07:28:22.467387+0000","last_clean":"2024-09-16T07:28:22.467387+0000","last_became_active":"2024-09-16T07:28:21.486668+0000","last_became_peered":"2024-09-16T07:28:21.486668+0000","last_unstale":"2024-09-16T07:28:22.467387+0000","last_undegraded":"2024-09-16T07:28:22.467387+0000","last_fullsized":"2024-09-16T07:28:22.467387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:26.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464347+0000","last_change":"2024-09-16T07:28:21.488749+0000","last_active":"2024-09-16T07:28:22.464347+0000","last_peered":"2024-09-16T07:28:22.464347+0000","last_clean":"2024-09-16T07:28:22.464347+0000","last_became_active":"2024-09-16T07:28:21.488344+0000","last_became_peered":"2024-09-16T07:28:21.488344+0000","last_unstale":"2024-09-16T07:28:22.464347+0000","last_undegraded":"2024-09-16T07:28:22.464347+0000","last_fullsized":"2024-09-16T07:28:22.464347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468674+0000","last_change":"2024-09-16T07:28:21.494268+0000","last_active":"2024-09-16T07:28:22.468674+0000","last_peered":"2024-09-16T07:28:22.468674+0000","last_clean":"2024-09-16T07:28:22.468674+0000","last_became_active":"2024-09-16T07:28:21.493475+0000","last_became_peered":"2024-09-16T07:28:21.493475+0000","last_unstale":"2024-09-16T07:28:22.468674+0000","last_undegraded":"2024-09-16T07:28:22.468674+0000","last_fullsized":"2024-09-16T07:28:22.468674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:12:34.391720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503097+0000","last_change":"2024-09-16T07:28:21.483444+0000","last_active":"2024-09-16T07:28:22.503097+0000","last_peered":"2024-09-16T07:28:22.503097+0000","last_clean":"2024-09-16T07:28:22.503097+0000","last_became_active":"2024-09-16T07:28:21.477957+0000","last_became_peered":"2024-09-16T07:28:21.477957+0000","last_unstale":"2024-09-16T07:28:22.503097+0000","last_undegraded":"2024-09-16T07:28:22.503097+0000","last_fullsized":"2024-09-16T07:28:22.503097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502910+0000","last_change":"2024-09-16T07:28:21.489623+0000","last_active":"2024-09-16T07:28:22.502910+0000","last_peered":"2024-09-16T07:28:22.502910+0000","last_clean":"2024-09-16T07:28:22.502910+0000","last_became_active":"2024-09-16T07:28:21.489309+0000","last_became_peered":"2024-09-16T07:28:21.489309+0000","last_unstale":"2024-09-16T07:28:22.502910+0000","last_undegraded":"2024-09-16T07:28:22.502910+0000","last_fullsized":"2024-09-16T07:28:22.502910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551994+0000","last_change":"2024-09-16T07:28:21.478068+0000","last_active":"2024-09-16T07:28:22.551994+0000","last_peered":"2024-09-16T07:28:22.551994+0000","last_clean":"2024-09-16T07:28:22.551994+0000","last_became_active":"2024-09-16T07:28:21.477672+0000","last_became_peered":"2024-09-16T07:28:21.477672+0000","last_unstale":"2024-09-16T07:28:22.551994+0000","last_undegraded":"2024-09-16T07:28:22.551994+0000","last_fullsized":"2024-09-16T07:28:22.551994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:54.933972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464732+0000","last_change":"2024-09-16T07:28:21.476271+0000","last_active":"2024-09-16T07:28:22.464732+0000","last_peered":"2024-09-16T07:28:22.464732+0000","last_clean":"2024-09-16T07:28:22.464732+0000","last_became_active":"2024-09-16T07:28:21.475852+0000","last_became_peered":"2024-09-16T07:28:21.475852+0000","last_unstale":"2024-09-16T07:28:22.464732+0000","last_undegraded":"2024-09-16T07:28:22.464732+0000","last_fullsized":"2024-09-16T07:28:22.464732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548912+0000","last_change":"2024-09-16T07:28:21.478669+0000","last_active":"2024-09-16T07:28:22.548912+0000","last_peered":"2024-09-16T07:28:22.548912+0000","last_clean":"2024-09-16T07:28:22.548912+0000","last_became_active":"2024-09-16T07:28:21.478365+0000","last_became_peered":"2024-09-16T07:28:21.478365+0000","last_unstale":"2024-09-16T07:28:22.548912+0000","last_undegraded":"2024-09-16T07:28:22.548912+0000","last_fullsized":"2024-09-16T07:28:22.548912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:29.836351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496252+0000","last_change":"2024-09-16T07:28:21.464672+0000","last_active":"2024-09-16T07:28:22.496252+0000","last_peered":"2024-09-16T07:28:22.496252+0000","last_clean":"2024-09-16T07:28:22.496252+0000","last_became_active":"2024-09-16T07:28:21.464371+0000","last_became_peered":"2024-09-16T07:28:21.464371+0000","last_unstale":"2024-09-16T07:28:22.496252+0000","last_undegraded":"2024-09-16T07:28:22.496252+0000","last_fullsized":"2024-09-16T07:28:22.496252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467116+0000","last_change":"2024-09-16T07:28:21.495723+0000","last_active":"2024-09-16T07:28:22.467116+0000","last_peered":"2024-09-16T07:28:22.467116+0000","last_clean":"2024-09-16T07:28:22.467116+0000","last_became_active":"2024-09-16T07:28:21.495360+0000","last_became_peered":"2024-09-16T07:28:21.495360+0000","last_unstale":"2024-09-16T07:28:22.467116+0000","last_undegraded":"2024-09-16T07:28:22.467116+0000","last_fullsized":"2024-09-16T07:28:22.467116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467869+0000","last_change":"2024-09-16T07:28:21.487979+0000","last_active":"2024-09-16T07:28:22.467869+0000","last_peered":"2024-09-16T07:28:22.467869+0000","last_clean":"2024-09-16T07:28:22.467869+0000","last_became_active":"2024-09-16T07:28:21.487716+0000","last_became_peered":"2024-09-16T07:28:21.487716+0000","last_unstale":"2024-09-16T07:28:22.467869+0000","last_undegraded":"2024-09-16T07:28:22.467869+0000","last_fullsized":"2024-09-16T07:28:22.467869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548812+0000","last_change":"2024-09-16T07:28:21.473706+0000","last_active":"2024-09-16T07:28:22.548812+0000","last_peered":"2024-09-16T07:28:22.548812+0000","last_clean":"2024-09-16T07:28:22.548812+0000","last_became_active":"2024-09-16T07:28:21.472045+0000","last_became_peered":"2024-09-16T07:28:21.472045+0000","last_unstale":"2024-09-16T07:28:22.548812+0000","last_undegraded":"2024-09-16T07:28:22.548812+0000","last_fullsized":"2024-09-16T07:28:22.548812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:20.884169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468434+0000","last_change":"2024-09-16T07:28:21.483475+0000","last_active":"2024-09-16T07:28:22.468434+0000","last_peered":"2024-09-16T07:28:22.468434+0000","last_clean":"2024-09-16T07:28:22.468434+0000","last_became_active":"2024-09-16T07:28:21.483089+0000","last_became_peered":"2024-09-16T07:28:21.483089+0000","last_unstale":"2024-09-16T07:28:22.468434+0000","last_undegraded":"2024-09-16T07:28:22.468434+0000","last_fullsized":"2024-09-16T07:28:22.468434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:06.838109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502819+0000","last_change":"2024-09-16T07:28:21.484778+0000","last_active":"2024-09-16T07:28:22.502819+0000","last_peered":"2024-09-16T07:28:22.502819+0000","last_clean":"2024-09-16T07:28:22.502819+0000","last_became_active":"2024-09-16T07:28:21.484204+0000","last_became_peered":"2024-09-16T07:28:21.484204+0000","last_unstale":"2024-09-16T07:28:22.502819+0000","last_undegraded":"2024-09-16T07:28:22.502819+0000","last_fullsized":"2024-09-16T07:28:22.502819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549143+0000","last_change":"2024-09-16T07:28:21.483859+0000","last_active":"2024-09-16T07:28:22.549143+0000","last_peered":"2024-09-16T07:28:22.549143+0000","last_clean":"2024-09-16T07:28:22.549143+0000","last_became_active":"2024-09-16T07:28:21.483553+0000","last_became_peered":"2024-09-16T07:28:21.483553+0000","last_unstale":"2024-09-16T07:28:22.549143+0000","last_undegraded":"2024-09-16T07:28:22.549143+0000","last_fullsized":"2024-09-16T07:28:22.549143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:02.888442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467718+0000","last_change":"2024-09-16T07:28:21.489323+0000","last_active":"2024-09-16T07:28:22.467718+0000","last_peered":"2024-09-16T07:28:22.467718+0000","last_clean":"2024-09-16T07:28:22.467718+0000","last_became_active":"2024-09-16T07:28:21.489030+0000","last_became_peered":"2024-09-16T07:28:21.489030+0000","last_unstale":"2024-09-16T07:28:22.467718+0000","last_undegraded":"2024-09-16T07:28:22.467718+0000","last_fullsized":"2024-09-16T07:28:22.467718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464446+0000","last_change":"2024-09-16T07:28:21.486749+0000","last_active":"2024-09-16T07:28:22.464446+0000","last_peered":"2024-09-16T07:28:22.464446+0000","last_clean":"2024-09-16T07:28:22.464446+0000","last_became_active":"2024-09-16T07:28:21.486460+0000","last_became_peered":"2024-09-16T07:28:21.486460+0000","last_unstale":"2024-09-16T07:28:22.464446+0000","last_undegraded":"2024-09-16T07:28:22.464446+0000","last_fullsized":"2024-09-16T07:28:22.464446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467149+0000","last_change":"2024-09-16T07:28:21.489962+0000","last_active":"2024-09-16T07:28:22.467149+0000","last_peered":"2024-09-16T07:28:22.467149+0000","last_clean":"2024-09-16T07:28:22.467149+0000","last_became_active":"2024-09-16T07:28:21.489700+0000","last_became_peered":"2024-09-16T07:28:21.489700+0000","last_unstale":"2024-09-16T07:28:22.467149+0000","last_undegraded":"2024-09-16T07:28:22.467149+0000","last_fullsized":"2024-09-16T07:28:22.467149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465167+0000","last_change":"2024-09-16T07:28:21.475734+0000","last_active":"2024-09-16T07:28:22.465167+0000","last_peered":"2024-09-16T07:28:22.465167+0000","last_clean":"2024-09-16T07:28:22.465167+0000","last_became_active":"2024-09-16T07:28:21.474927+0000","last_became_peered":"2024-09-16T07:28:21.474927+0000","last_unstale":"2024-09-16T07:28:22.465167+0000","last_undegraded":"2024-09-16T07:28:22.465167+0000","last_fullsized":"2024-09-16T07:28:22.465167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503167+0000","last_change":"2024-09-16T07:28:21.491054+0000","last_active":"2024-09-16T07:28:22.503167+0000","last_peered":"2024-09-16T07:28:22.503167+0000","last_clean":"2024-09-16T07:28:22.503167+0000","last_became_active":"2024-09-16T07:28:21.490686+0000","last_became_peered":"2024-09-16T07:28:21.490686+0000","last_unstale":"2024-09-16T07:28:22.503167+0000","last_undegraded":"2024-09-16T07:28:22.503167+0000","last_fullsized":"2024-09-16T07:28:22.503167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496663+0000","last_change":"2024-09-16T07:28:21.473001+0000","last_active":"2024-09-16T07:28:22.496663+0000","last_peered":"2024-09-16T07:28:22.496663+0000","last_clean":"2024-09-16T07:28:22.496663+0000","last_became_active":"2024-09-16T07:28:21.472729+0000","last_became_peered":"2024-09-16T07:28:21.472729+0000","last_unstale":"2024-09-16T07:28:22.496663+0000","last_undegraded":"2024-09-16T07:28:22.496663+0000","last_fullsized":"2024-09-16T07:28:22.496663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464910+0000","last_change":"2024-09-16T07:28:21.475995+0000","last_active":"2024-09-16T07:28:22.464910+0000","last_peered":"2024-09-16T07:28:22.464910+0000","last_clean":"2024-09-16T07:28:22.464910+0000","last_became_active":"2024-09-16T07:28:21.475693+0000","last_became_peered":"2024-09-16T07:28:21.475693+0000","last_unstale":"2024-09-16T07:28:22.464910+0000","last_undegraded":"2024-09-16T07:28:22.464910+0000","last_fullsized":"2024-09-16T07:28:22.464910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549102+0000","last_change":"2024-09-16T07:28:21.480473+0000","last_active":"2024-09-16T07:28:22.549102+0000","last_peered":"2024-09-16T07:28:22.549102+0000","last_clean":"2024-09-16T07:28:22.549102+0000","last_became_active":"2024-09-16T07:28:21.480165+0000","last_became_peered":"2024-09-16T07:28:21.480165+0000","last_unstale":"2024-09-16T07:28:22.549102+0000","last_undegraded":"2024-09-16T07:28:22.549102+0000","last_fullsized":"2024-09-16T07:28:22.549102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:37.071702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467933+0000","last_change":"2024-09-16T07:28:21.500956+0000","last_active":"2024-09-16T07:28:22.467933+0000","last_peered":"2024-09-16T07:28:22.467933+0000","last_clean":"2024-09-16T07:28:22.467933+0000","last_became_active":"2024-09-16T07:28:21.500678+0000","last_became_peered":"2024-09-16T07:28:21.500678+0000","last_unstale":"2024-09-16T07:28:22.467933+0000","last_undegraded":"2024-09-16T07:28:22.467933+0000","last_fullsized":"2024-09-16T07:28:22.467933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:19:59.668925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548289+0000","last_change":"2024-09-16T07:28:21.463979+0000","last_active":"2024-09-16T07:28:22.548289+0000","last_peered":"2024-09-16T07:28:22.548289+0000","last_clean":"2024-09-16T07:28:22.548289+0000","last_became_active":"2024-09-16T07:28:21.463670+0000","last_became_peered":"2024-09-16T07:28:21.463670+0000","last_unstale":"2024-09-16T07:28:22.548289+0000","last_undegraded":"2024-09-16T07:28:22.548289+0000","last_fullsized":"2024-09-16T07:28:22.548289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:19.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502645+0000","last_change":"2024-09-16T07:28:21.484394+0000","last_active":"2024-09-16T07:28:22.502645+0000","last_peered":"2024-09-16T07:28:22.502645+0000","last_clean":"2024-09-16T07:28:22.502645+0000","last_became_active":"2024-09-16T07:28:21.484000+0000","last_became_peered":"2024-09-16T07:28:21.484000+0000","last_unstale":"2024-09-16T07:28:22.502645+0000","last_undegraded":"2024-09-16T07:28:22.502645+0000","last_fullsized":"2024-09-16T07:28:22.502645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551777+0000","last_change":"2024-09-16T07:28:21.488398+0000","last_active":"2024-09-16T07:28:22.551777+0000","last_peered":"2024-09-16T07:28:22.551777+0000","last_clean":"2024-09-16T07:28:22.551777+0000","last_became_active":"2024-09-16T07:28:21.488082+0000","last_became_peered":"2024-09-16T07:28:21.488082+0000","last_unstale":"2024-09-16T07:28:22.551777+0000","last_undegraded":"2024-09-16T07:28:22.551777+0000","last_fullsized":"2024-09-16T07:28:22.551777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:56.278436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464818+0000","last_change":"2024-09-16T07:28:20.460754+0000","last_active":"2024-09-16T07:28:22.464818+0000","last_peered":"2024-09-16T07:28:22.464818+0000","last_clean":"2024-09-16T07:28:22.464818+0000","last_became_active":"2024-09-16T07:28:20.460452+0000","last_became_peered":"2024-09-16T07:28:20.460452+0000","last_unstale":"2024-09-16T07:28:22.464818+0000","last_undegraded":"2024-09-16T07:28:22.464818+0000","last_fullsized":"2024-09-16T07:28:22.464818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:33.769857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549314+0000","last_change":"2024-09-16T07:28:21.494146+0000","last_active":"2024-09-16T07:28:22.549314+0000","last_peered":"2024-09-16T07:28:22.549314+0000","last_clean":"2024-09-16T07:28:22.549314+0000","last_became_active":"2024-09-16T07:28:21.493871+0000","last_became_peered":"2024-09-16T07:28:21.493871+0000","last_unstale":"2024-09-16T07:28:22.549314+0000","last_undegraded":"2024-09-16T07:28:22.549314+0000","last_fullsized":"2024-09-16T07:28:22.549314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502498+0000","last_change":"2024-09-16T07:28:20.459159+0000","last_active":"2024-09-16T07:28:22.502498+0000","last_peered":"2024-09-16T07:28:22.502498+0000","last_clean":"2024-09-16T07:28:22.502498+0000","last_became_active":"2024-09-16T07:28:20.456616+0000","last_became_peered":"2024-09-16T07:28:20.456616+0000","last_unstale":"2024-09-16T07:28:22.502498+0000","last_undegraded":"2024-09-16T07:28:22.502498+0000","last_fullsized":"2024-09-16T07:28:22.502498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464412+0000","last_change":"2024-09-16T07:28:20.462946+0000","last_active":"2024-09-16T07:28:22.464412+0000","last_peered":"2024-09-16T07:28:22.464412+0000","last_clean":"2024-09-16T07:28:22.464412+0000","last_became_active":"2024-09-16T07:28:20.462684+0000","last_became_peered":"2024-09-16T07:28:20.462684+0000","last_unstale":"2024-09-16T07:28:22.464412+0000","last_undegraded":"2024-09-16T07:28:22.464412+0000","last_fullsized":"2024-09-16T07:28:22.464412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:52.266984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464445+0000","last_change":"2024-09-16T07:28:21.476488+0000","last_active":"2024-09-16T07:28:22.464445+0000","last_peered":"2024-09-16T07:28:22.464445+0000","last_clean":"2024-09-16T07:28:22.464445+0000","last_became_active":"2024-09-16T07:28:21.475830+0000","last_became_peered":"2024-09-16T07:28:21.475830+0000","last_unstale":"2024-09-16T07:28:22.464445+0000","last_undegraded":"2024-09-16T07:28:22.464445+0000","last_fullsized":"2024-09-16T07:28:22.464445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467181+0000","last_change":"2024-09-16T07:28:20.466562+0000","last_active":"2024-09-16T07:28:22.467181+0000","last_peered":"2024-09-16T07:28:22.467181+0000","last_clean":"2024-09-16T07:28:22.467181+0000","last_became_active":"2024-09-16T07:28:20.465752+0000","last_became_peered":"2024-09-16T07:28:20.465752+0000","last_unstale":"2024-09-16T07:28:22.467181+0000","last_undegraded":"2024-09-16T07:28:22.467181+0000","last_fullsized":"2024-09-16T07:28:22.467181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496248+0000","last_change":"2024-09-16T07:28:21.469784+0000","last_active":"2024-09-16T07:28:22.496248+0000","last_peered":"2024-09-16T07:28:22.496248+0000","last_clean":"2024-09-16T07:28:22.496248+0000","last_became_active":"2024-09-16T07:28:21.469633+0000","last_became_peered":"2024-09-16T07:28:21.469633+0000","last_unstale":"2024-09-16T07:28:22.496248+0000","last_undegraded":"2024-09-16T07:28:22.496248+0000","last_fullsized":"2024-09-16T07:28:22.496248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503022+0000","last_change":"2024-09-16T07:28:20.463652+0000","last_active":"2024-09-16T07:28:22.503022+0000","last_peered":"2024-09-16T07:28:22.503022+0000","last_clean":"2024-09-16T07:28:22.503022+0000","last_became_active":"2024-09-16T07:28:20.463379+0000","last_became_peered":"2024-09-16T07:28:20.463379+0000","last_unstale":"2024-09-16T07:28:22.503022+0000","last_undegraded":"2024-09-16T07:28:22.503022+0000","last_fullsized":"2024-09-16T07:28:22.503022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468195+0000","last_change":"2024-09-16T07:28:21.500436+0000","last_active":"2024-09-16T07:28:22.468195+0000","last_peered":"2024-09-16T07:28:22.468195+0000","last_clean":"2024-09-16T07:28:22.468195+0000","last_became_active":"2024-09-16T07:28:21.500187+0000","last_became_peered":"2024-09-16T07:28:21.500187+0000","last_unstale":"2024-09-16T07:28:22.468195+0000","last_undegraded":"2024-09-16T07:28:22.468195+0000","last_fullsized":"2024-09-16T07:28:22.468195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:50:23.478685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468098+0000","last_change":"2024-09-16T07:28:20.472210+0000","last_active":"2024-09-16T07:28:22.468098+0000","last_peered":"2024-09-16T07:28:22.468098+0000","last_clean":"2024-09-16T07:28:22.468098+0000","last_became_active":"2024-09-16T07:28:20.471902+0000","last_became_peered":"2024-09-16T07:28:20.471902+0000","last_unstale":"2024-09-16T07:28:22.468098+0000","last_undegraded":"2024-09-16T07:28:22.468098+0000","last_fullsized":"2024-09-16T07:28:22.468098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549390+0000","last_change":"2024-09-16T07:28:21.489089+0000","last_active":"2024-09-16T07:28:22.549390+0000","last_peered":"2024-09-16T07:28:22.549390+0000","last_clean":"2024-09-16T07:28:22.549390+0000","last_became_active":"2024-09-16T07:28:21.488554+0000","last_became_peered":"2024-09-16T07:28:21.488554+0000","last_unstale":"2024-09-16T07:28:22.549390+0000","last_undegraded":"2024-09-16T07:28:22.549390+0000","last_fullsized":"2024-09-16T07:28:22.549390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:03.502755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496514+0000","last_change":"2024-09-16T07:28:20.461734+0000","last_active":"2024-09-16T07:28:22.496514+0000","last_peered":"2024-09-16T07:28:22.496514+0000","last_clean":"2024-09-16T07:28:22.496514+0000","last_became_active":"2024-09-16T07:28:20.461508+0000","last_became_peered":"2024-09-16T07:28:20.461508+0000","last_unstale":"2024-09-16T07:28:22.496514+0000","last_undegraded":"2024-09-16T07:28:22.496514+0000","last_fullsized":"2024-09-16T07:28:22.496514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:48.563809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.552021+0000","last_change":"2024-09-16T07:28:21.482206+0000","last_active":"2024-09-16T07:28:22.552021+0000","last_peered":"2024-09-16T07:28:22.552021+0000","last_clean":"2024-09-16T07:28:22.552021+0000","last_became_active":"2024-09-16T07:28:21.481551+0000","last_became_peered":"2024-09-16T07:28:21.481551+0000","last_unstale":"2024-09-16T07:28:22.552021+0000","last_undegraded":"2024-09-16T07:28:22.552021+0000","last_fullsized":"2024-09-16T07:28:22.552021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:39.225323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502717+0000","last_change":"2024-09-16T07:28:20.469828+0000","last_active":"2024-09-16T07:28:22.502717+0000","last_peered":"2024-09-16T07:28:22.502717+0000","last_clean":"2024-09-16T07:28:22.502717+0000","last_became_active":"2024-09-16T07:28:20.469327+0000","last_became_peered":"2024-09-16T07:28:20.469327+0000","last_unstale":"2024-09-16T07:28:22.502717+0000","last_undegraded":"2024-09-16T07:28:22.502717+0000","last_fullsized":"2024-09-16T07:28:22.502717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467227+0000","last_change":"2024-09-16T07:28:21.484091+0000","last_active":"2024-09-16T07:28:22.467227+0000","last_peered":"2024-09-16T07:28:22.467227+0000","last_clean":"2024-09-16T07:28:22.467227+0000","last_became_active":"2024-09-16T07:28:21.483783+0000","last_became_peered":"2024-09-16T07:28:21.483783+0000","last_unstale":"2024-09-16T07:28:22.467227+0000","last_undegraded":"2024-09-16T07:28:22.467227+0000","last_fullsized":"2024-09-16T07:28:22.467227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:07.182120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549218+0000","last_change":"2024-09-16T07:28:20.451995+0000","last_active":"2024-09-16T07:28:22.549218+0000","last_peered":"2024-09-16T07:28:22.549218+0000","last_clean":"2024-09-16T07:28:22.549218+0000","last_became_active":"2024-09-16T07:28:20.451740+0000","last_became_peered":"2024-09-16T07:28:20.451740+0000","last_unstale":"2024-09-16T07:28:22.549218+0000","last_undegraded":"2024-09-16T07:28:22.549218+0000","last_fullsized":"2024-09-16T07:28:22.549218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:50.421459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548952+0000","last_change":"2024-09-16T07:28:21.478652+0000","last_active":"2024-09-16T07:28:22.548952+0000","last_peered":"2024-09-16T07:28:22.548952+0000","last_clean":"2024-09-16T07:28:22.548952+0000","last_became_active":"2024-09-16T07:28:21.478073+0000","last_became_peered":"2024-09-16T07:28:21.478073+0000","last_unstale":"2024-09-16T07:28:22.548952+0000","last_undegraded":"2024-09-16T07:28:22.548952+0000","last_fullsized":"2024-09-16T07:28:22.548952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:19:21.305531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467810+0000","last_change":"2024-09-16T07:28:20.467427+0000","last_active":"2024-09-16T07:28:22.467810+0000","last_peered":"2024-09-16T07:28:22.467810+0000","last_clean":"2024-09-16T07:28:22.467810+0000","last_became_active":"2024-09-16T07:28:20.467214+0000","last_became_peered":"2024-09-16T07:28:20.467214+0000","last_unstale":"2024-09-16T07:28:22.467810+0000","last_undegraded":"2024-09-16T07:28:22.467810+0000","last_fullsized":"2024-09-16T07:28:22.467810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467633+0000","last_change":"2024-09-16T07:28:21.480102+0000","last_active":"2024-09-16T07:28:22.467633+0000","last_peered":"2024-09-16T07:28:22.467633+0000","last_clean":"2024-09-16T07:28:22.467633+0000","last_became_active":"2024-09-16T07:28:21.479792+0000","last_became_peered":"2024-09-16T07:28:21.479792+0000","last_unstale":"2024-09-16T07:28:22.467633+0000","last_undegraded":"2024-09-16T07:28:22.467633+0000","last_fullsized":"2024-09-16T07:28:22.467633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:01.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502453+0000","last_change":"2024-09-16T07:28:20.458181+0000","last_active":"2024-09-16T07:28:22.502453+0000","last_peered":"2024-09-16T07:28:22.502453+0000","last_clean":"2024-09-16T07:28:22.502453+0000","last_became_active":"2024-09-16T07:28:20.456385+0000","last_became_peered":"2024-09-16T07:28:20.456385+0000","last_unstale":"2024-09-16T07:28:22.502453+0000","last_undegraded":"2024-09-16T07:28:22.502453+0000","last_fullsized":"2024-09-16T07:28:22.502453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502619+0000","last_change":"2024-09-16T07:28:21.482950+0000","last_active":"2024-09-16T07:28:22.502619+0000","last_peered":"2024-09-16T07:28:22.502619+0000","last_clean":"2024-09-16T07:28:22.502619+0000","last_became_active":"2024-09-16T07:28:21.482427+0000","last_became_peered":"2024-09-16T07:28:21.482427+0000","last_unstale":"2024-09-16T07:28:22.502619+0000","last_undegraded":"2024-09-16T07:28:22.502619+0000","last_fullsized":"2024-09-16T07:28:22.502619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548130+0000","last_change":"2024-09-16T07:28:20.457548+0000","last_active":"2024-09-16T07:28:22.548130+0000","last_peered":"2024-09-16T07:28:22.548130+0000","last_clean":"2024-09-16T07:28:22.548130+0000","last_became_active":"2024-09-16T07:28:20.457151+0000","last_became_peered":"2024-09-16T07:28:20.457151+0000","last_unstale":"2024-09-16T07:28:22.548130+0000","last_undegraded":"2024-09-16T07:28:22.548130+0000","last_fullsized":"2024-09-16T07:28:22.548130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:48.914037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467591+0000","last_change":"2024-09-16T07:28:21.491418+0000","last_active":"2024-09-16T07:28:22.467591+0000","last_peered":"2024-09-16T07:28:22.467591+0000","last_clean":"2024-09-16T07:28:22.467591+0000","last_became_active":"2024-09-16T07:28:21.491157+0000","last_became_peered":"2024-09-16T07:28:21.491157+0000","last_unstale":"2024-09-16T07:28:22.467591+0000","last_undegraded":"2024-09-16T07:28:22.467591+0000","last_fullsized":"2024-09-16T07:28:22.467591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551843+0000","last_change":"2024-09-16T07:28:20.458574+0000","last_active":"2024-09-16T07:28:22.551843+0000","last_peered":"2024-09-16T07:28:22.551843+0000","last_clean":"2024-09-16T07:28:22.551843+0000","last_became_active":"2024-09-16T07:28:20.458268+0000","last_became_peered":"2024-09-16T07:28:20.458268+0000","last_unstale":"2024-09-16T07:28:22.551843+0000","last_undegraded":"2024-09-16T07:28:22.551843+0000","last_fullsized":"2024-09-16T07:28:22.551843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:46:58.633211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468568+0000","last_change":"2024-09-16T07:28:21.492507+0000","last_active":"2024-09-16T07:28:22.468568+0000","last_peered":"2024-09-16T07:28:22.468568+0000","last_clean":"2024-09-16T07:28:22.468568+0000","last_became_active":"2024-09-16T07:28:21.492267+0000","last_became_peered":"2024-09-16T07:28:21.492267+0000","last_unstale":"2024-09-16T07:28:22.468568+0000","last_undegraded":"2024-09-16T07:28:22.468568+0000","last_fullsized":"2024-09-16T07:28:22.468568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:02.918148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548720+0000","last_change":"2024-09-16T07:28:20.450706+0000","last_active":"2024-09-16T07:28:22.548720+0000","last_peered":"2024-09-16T07:28:22.548720+0000","last_clean":"2024-09-16T07:28:22.548720+0000","last_became_active":"2024-09-16T07:28:20.450379+0000","last_became_peered":"2024-09-16T07:28:20.450379+0000","last_unstale":"2024-09-16T07:28:22.548720+0000","last_undegraded":"2024-09-16T07:28:22.548720+0000","last_fullsized":"2024-09-16T07:28:22.548720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:37.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468790+0000","last_change":"2024-09-16T07:28:21.480183+0000","last_active":"2024-09-16T07:28:22.468790+0000","last_peered":"2024-09-16T07:28:22.468790+0000","last_clean":"2024-09-16T07:28:22.468790+0000","last_became_active":"2024-09-16T07:28:21.479807+0000","last_became_peered":"2024-09-16T07:28:21.479807+0000","last_unstale":"2024-09-16T07:28:22.468790+0000","last_undegraded":"2024-09-16T07:28:22.468790+0000","last_fullsized":"2024-09-16T07:28:22.468790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:35.281982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496622+0000","last_change":"2024-09-16T07:28:20.456101+0000","last_active":"2024-09-16T07:28:22.496622+0000","last_peered":"2024-09-16T07:28:22.496622+0000","last_clean":"2024-09-16T07:28:22.496622+0000","last_became_active":"2024-09-16T07:28:20.453929+0000","last_became_peered":"2024-09-16T07:28:20.453929+0000","last_unstale":"2024-09-16T07:28:22.496622+0000","last_undegraded":"2024-09-16T07:28:22.496622+0000","last_fullsized":"2024-09-16T07:28:22.496622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:53.936877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467874+0000","last_change":"2024-09-16T07:28:21.499515+0000","last_active":"2024-09-16T07:28:22.467874+0000","last_peered":"2024-09-16T07:28:22.467874+0000","last_clean":"2024-09-16T07:28:22.467874+0000","last_became_active":"2024-09-16T07:28:21.490747+0000","last_became_peered":"2024-09-16T07:28:21.490747+0000","last_unstale":"2024-09-16T07:28:22.467874+0000","last_undegraded":"2024-09-16T07:28:22.467874+0000","last_fullsized":"2024-09-16T07:28:22.467874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:32.209796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548601+0000","last_change":"2024-09-16T07:28:20.465122+0000","last_active":"2024-09-16T07:28:22.548601+0000","last_peered":"2024-09-16T07:28:22.548601+0000","last_clean":"2024-09-16T07:28:22.548601+0000","last_became_active":"2024-09-16T07:28:20.464580+0000","last_became_peered":"2024-09-16T07:28:20.464580+0000","last_unstale":"2024-09-16T07:28:22.548601+0000","last_undegraded":"2024-09-16T07:28:22.548601+0000","last_fullsized":"2024-09-16T07:28:22.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:50.567918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467440+0000","last_change":"2024-09-16T07:28:21.488112+0000","last_active":"2024-09-16T07:28:22.467440+0000","last_peered":"2024-09-16T07:28:22.467440+0000","last_clean":"2024-09-16T07:28:22.467440+0000","last_became_active":"2024-09-16T07:28:21.487902+0000","last_became_peered":"2024-09-16T07:28:21.487902+0000","last_unstale":"2024-09-16T07:28:22.467440+0000","last_undegraded":"2024-09-16T07:28:22.467440+0000","last_fullsized":"2024-09-16T07:28:22.467440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:27.706301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467313+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:28:22.467313+0000","last_peered":"2024-09-16T07:28:22.467313+0000","last_clean":"2024-09-16T07:28:22.467313+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:28:22.467313+0000","last_undegraded":"2024-09-16T07:28:22.467313+0000","last_fullsized":"2024-09-16T07:28:22.467313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.466990+0000","last_change":"2024-09-16T07:28:20.460935+0000","last_active":"2024-09-16T07:28:22.466990+0000","last_peered":"2024-09-16T07:28:22.466990+0000","last_clean":"2024-09-16T07:28:22.466990+0000","last_became_active":"2024-09-16T07:28:20.460629+0000","last_became_peered":"2024-09-16T07:28:20.460629+0000","last_unstale":"2024-09-16T07:28:22.466990+0000","last_undegraded":"2024-09-16T07:28:22.466990+0000","last_fullsized":"2024-09-16T07:28:22.466990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464687+0000","last_change":"2024-09-16T07:28:21.488741+0000","last_active":"2024-09-16T07:28:22.464687+0000","last_peered":"2024-09-16T07:28:22.464687+0000","last_clean":"2024-09-16T07:28:22.464687+0000","last_became_active":"2024-09-16T07:28:21.488257+0000","last_became_peered":"2024-09-16T07:28:21.488257+0000","last_unstale":"2024-09-16T07:28:22.464687+0000","last_undegraded":"2024-09-16T07:28:22.464687+0000","last_fullsized":"2024-09-16T07:28:22.464687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467205+0000","last_change":"2024-09-16T07:28:20.467488+0000","last_active":"2024-09-16T07:28:22.467205+0000","last_peered":"2024-09-16T07:28:22.467205+0000","last_clean":"2024-09-16T07:28:22.467205+0000","last_became_active":"2024-09-16T07:28:20.466897+0000","last_became_peered":"2024-09-16T07:28:20.466897+0000","last_unstale":"2024-09-16T07:28:22.467205+0000","last_undegraded":"2024-09-16T07:28:22.467205+0000","last_fullsized":"2024-09-16T07:28:22.467205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548576+0000","last_change":"2024-09-16T07:28:21.494039+0000","last_active":"2024-09-16T07:28:22.548576+0000","last_peered":"2024-09-16T07:28:22.548576+0000","last_clean":"2024-09-16T07:28:22.548576+0000","last_became_active":"2024-09-16T07:28:21.493705+0000","last_became_peered":"2024-09-16T07:28:21.493705+0000","last_unstale":"2024-09-16T07:28:22.548576+0000","last_undegraded":"2024-09-16T07:28:22.548576+0000","last_fullsized":"2024-09-16T07:28:22.548576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:06:41.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548390+0000","last_change":"2024-09-16T07:28:20.453271+0000","last_active":"2024-09-16T07:28:22.548390+0000","last_peered":"2024-09-16T07:28:22.548390+0000","last_clean":"2024-09-16T07:28:22.548390+0000","last_became_active":"2024-09-16T07:28:20.452985+0000","last_became_peered":"2024-09-16T07:28:20.452985+0000","last_unstale":"2024-09-16T07:28:22.548390+0000","last_undegraded":"2024-09-16T07:28:22.548390+0000","last_fullsized":"2024-09-16T07:28:22.548390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:08.366019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496234+0000","last_change":"2024-09-16T07:28:21.464203+0000","last_active":"2024-09-16T07:28:22.496234+0000","last_peered":"2024-09-16T07:28:22.496234+0000","last_clean":"2024-09-16T07:28:22.496234+0000","last_became_active":"2024-09-16T07:28:21.463943+0000","last_became_peered":"2024-09-16T07:28:21.463943+0000","last_unstale":"2024-09-16T07:28:22.496234+0000","last_undegraded":"2024-09-16T07:28:22.496234+0000","last_fullsized":"2024-09-16T07:28:22.496234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:10.337642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467921+0000","last_change":"2024-09-16T07:28:20.459755+0000","last_active":"2024-09-16T07:28:22.467921+0000","last_peered":"2024-09-16T07:28:22.467921+0000","last_clean":"2024-09-16T07:28:22.467921+0000","last_became_active":"2024-09-16T07:28:20.459383+0000","last_became_peered":"2024-09-16T07:28:20.459383+0000","last_unstale":"2024-09-16T07:28:22.467921+0000","last_undegraded":"2024-09-16T07:28:22.467921+0000","last_fullsized":"2024-09-16T07:28:22.467921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551881+0000","last_change":"2024-09-16T07:28:21.490524+0000","last_active":"2024-09-16T07:28:22.551881+0000","last_peered":"2024-09-16T07:28:22.551881+0000","last_clean":"2024-09-16T07:28:22.551881+0000","last_became_active":"2024-09-16T07:28:21.490245+0000","last_became_peered":"2024-09-16T07:28:21.490245+0000","last_unstale":"2024-09-16T07:28:22.551881+0000","last_undegraded":"2024-09-16T07:28:22.551881+0000","last_fullsized":"2024-09-16T07:28:22.551881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.777612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496506+0000","last_change":"2024-09-16T07:28:20.460535+0000","last_active":"2024-09-16T07:28:22.496506+0000","last_peered":"2024-09-16T07:28:22.496506+0000","last_clean":"2024-09-16T07:28:22.496506+0000","last_became_active":"2024-09-16T07:28:20.456847+0000","last_became_peered":"2024-09-16T07:28:20.456847+0000","last_unstale":"2024-09-16T07:28:22.496506+0000","last_undegraded":"2024-09-16T07:28:22.496506+0000","last_fullsized":"2024-09-16T07:28:22.496506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:09:04.534477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468312+0000","last_change":"2024-09-16T07:28:21.485772+0000","last_active":"2024-09-16T07:28:22.468312+0000","last_peered":"2024-09-16T07:28:22.468312+0000","last_clean":"2024-09-16T07:28:22.468312+0000","last_became_active":"2024-09-16T07:28:21.485344+0000","last_became_peered":"2024-09-16T07:28:21.485344+0000","last_unstale":"2024-09-16T07:28:22.468312+0000","last_undegraded":"2024-09-16T07:28:22.468312+0000","last_fullsized":"2024-09-16T07:28:22.468312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:45.375465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468364+0000","last_change":"2024-09-16T07:28:20.470503+0000","last_active":"2024-09-16T07:28:22.468364+0000","last_peered":"2024-09-16T07:28:22.468364+0000","last_clean":"2024-09-16T07:28:22.468364+0000","last_became_active":"2024-09-16T07:28:20.470225+0000","last_became_peered":"2024-09-16T07:28:20.470225+0000","last_unstale":"2024-09-16T07:28:22.468364+0000","last_undegraded":"2024-09-16T07:28:22.468364+0000","last_fullsized":"2024-09-16T07:28:22.468364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:38.219355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496796+0000","last_change":"2024-09-16T07:28:21.463398+0000","last_active":"2024-09-16T07:28:22.496796+0000","last_peered":"2024-09-16T07:28:22.496796+0000","last_clean":"2024-09-16T07:28:22.496796+0000","last_became_active":"2024-09-16T07:28:21.463066+0000","last_became_peered":"2024-09-16T07:28:21.463066+0000","last_unstale":"2024-09-16T07:28:22.496796+0000","last_undegraded":"2024-09-16T07:28:22.496796+0000","last_fullsized":"2024-09-16T07:28:22.496796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496604+0000","last_change":"2024-09-16T07:28:20.469212+0000","last_active":"2024-09-16T07:28:22.496604+0000","last_peered":"2024-09-16T07:28:22.496604+0000","last_clean":"2024-09-16T07:28:22.496604+0000","last_became_active":"2024-09-16T07:28:20.468969+0000","last_became_peered":"2024-09-16T07:28:20.468969+0000","last_unstale":"2024-09-16T07:28:22.496604+0000","last_undegraded":"2024-09-16T07:28:22.496604+0000","last_fullsized":"2024-09-16T07:28:22.496604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:10.096462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465338+0000","last_change":"2024-09-16T07:28:21.480569+0000","last_active":"2024-09-16T07:28:22.465338+0000","last_peered":"2024-09-16T07:28:22.465338+0000","last_clean":"2024-09-16T07:28:22.465338+0000","last_became_active":"2024-09-16T07:28:21.480272+0000","last_became_peered":"2024-09-16T07:28:21.480272+0000","last_unstale":"2024-09-16T07:28:22.465338+0000","last_undegraded":"2024-09-16T07:28:22.465338+0000","last_fullsized":"2024-09-16T07:28:22.465338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503045+0000","last_change":"2024-09-16T07:28:20.472754+0000","last_active":"2024-09-16T07:28:22.503045+0000","last_peered":"2024-09-16T07:28:22.503045+0000","last_clean":"2024-09-16T07:28:22.503045+0000","last_became_active":"2024-09-16T07:28:20.472465+0000","last_became_peered":"2024-09-16T07:28:20.472465+0000","last_unstale":"2024-09-16T07:28:22.503045+0000","last_undegraded":"2024-09-16T07:28:22.503045+0000","last_fullsized":"2024-09-16T07:28:22.503045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549298+0000","last_change":"2024-09-16T07:28:21.478910+0000","last_active":"2024-09-16T07:28:22.549298+0000","last_peered":"2024-09-16T07:28:22.549298+0000","last_clean":"2024-09-16T07:28:22.549298+0000","last_became_active":"2024-09-16T07:28:21.478515+0000","last_became_peered":"2024-09-16T07:28:21.478515+0000","last_unstale":"2024-09-16T07:28:22.549298+0000","last_undegraded":"2024-09-16T07:28:22.549298+0000","last_fullsized":"2024-09-16T07:28:22.549298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:44.297339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467103+0000","last_change":"2024-09-16T07:28:20.459234+0000","last_active":"2024-09-16T07:28:22.467103+0000","last_peered":"2024-09-16T07:28:22.467103+0000","last_clean":"2024-09-16T07:28:22.467103+0000","last_became_active":"2024-09-16T07:28:20.459002+0000","last_became_peered":"2024-09-16T07:28:20.459002+0000","last_unstale":"2024-09-16T07:28:22.467103+0000","last_undegraded":"2024-09-16T07:28:22.467103+0000","last_fullsized":"2024-09-16T07:28:22.467103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551768+0000","last_change":"2024-09-16T07:28:21.493498+0000","last_active":"2024-09-16T07:28:22.551768+0000","last_peered":"2024-09-16T07:28:22.551768+0000","last_clean":"2024-09-16T07:28:22.551768+0000","last_became_active":"2024-09-16T07:28:21.491830+0000","last_became_peered":"2024-09-16T07:28:21.491830+0000","last_unstale":"2024-09-16T07:28:22.551768+0000","last_undegraded":"2024-09-16T07:28:22.551768+0000","last_fullsized":"2024-09-16T07:28:22.551768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:49.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496318+0000","last_change":"2024-09-16T07:28:20.461750+0000","last_active":"2024-09-16T07:28:22.496318+0000","last_peered":"2024-09-16T07:28:22.496318+0000","last_clean":"2024-09-16T07:28:22.496318+0000","last_became_active":"2024-09-16T07:28:20.460989+0000","last_became_peered":"2024-09-16T07:28:20.460989+0000","last_unstale":"2024-09-16T07:28:22.496318+0000","last_undegraded":"2024-09-16T07:28:22.496318+0000","last_fullsized":"2024-09-16T07:28:22.496318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:31.404291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464583+0000","last_change":"2024-09-16T07:28:21.469832+0000","last_active":"2024-09-16T07:28:22.464583+0000","last_peered":"2024-09-16T07:28:22.464583+0000","last_clean":"2024-09-16T07:28:22.464583+0000","last_became_active":"2024-09-16T07:28:21.469570+0000","last_became_peered":"2024-09-16T07:28:21.469570+0000","last_unstale":"2024-09-16T07:28:22.464583+0000","last_undegraded":"2024-09-16T07:28:22.464583+0000","last_fullsized":"2024-09-16T07:28:22.464583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496456+0000","last_change":"2024-09-16T07:28:20.461709+0000","last_active":"2024-09-16T07:28:22.496456+0000","last_peered":"2024-09-16T07:28:22.496456+0000","last_clean":"2024-09-16T07:28:22.496456+0000","last_became_active":"2024-09-16T07:28:20.461478+0000","last_became_peered":"2024-09-16T07:28:20.461478+0000","last_unstale":"2024-09-16T07:28:22.496456+0000","last_undegraded":"2024-09-16T07:28:22.496456+0000","last_fullsized":"2024-09-16T07:28:22.496456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:27:11.719843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465235+0000","last_change":"2024-09-16T07:28:21.481588+0000","last_active":"2024-09-16T07:28:22.465235+0000","last_peered":"2024-09-16T07:28:22.465235+0000","last_clean":"2024-09-16T07:28:22.465235+0000","last_became_active":"2024-09-16T07:28:21.481312+0000","last_became_peered":"2024-09-16T07:28:21.481312+0000","last_unstale":"2024-09-16T07:28:22.465235+0000","last_undegraded":"2024-09-16T07:28:22.465235+0000","last_fullsized":"2024-09-16T07:28:22.465235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467664+0000","last_change":"2024-09-16T07:28:20.474381+0000","last_active":"2024-09-16T07:28:22.467664+0000","last_peered":"2024-09-16T07:28:22.467664+0000","last_clean":"2024-09-16T07:28:22.467664+0000","last_became_active":"2024-09-16T07:28:20.474113+0000","last_became_peered":"2024-09-16T07:28:20.474113+0000","last_unstale":"2024-09-16T07:28:22.467664+0000","last_undegraded":"2024-09-16T07:28:22.467664+0000","last_fullsized":"2024-09-16T07:28:22.467664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:13.771645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502639+0000","last_change":"2024-09-16T07:28:21.483733+0000","last_active":"2024-09-16T07:28:22.502639+0000","last_peered":"2024-09-16T07:28:22.502639+0000","last_clean":"2024-09-16T07:28:22.502639+0000","last_became_active":"2024-09-16T07:28:21.483452+0000","last_became_peered":"2024-09-16T07:28:21.483452+0000","last_unstale":"2024-09-16T07:28:22.502639+0000","last_undegraded":"2024-09-16T07:28:22.502639+0000","last_fullsized":"2024-09-16T07:28:22.502639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467989+0000","last_change":"2024-09-16T07:28:21.502241+0000","last_active":"2024-09-16T07:28:22.467989+0000","last_peered":"2024-09-16T07:28:22.467989+0000","last_clean":"2024-09-16T07:28:22.467989+0000","last_became_active":"2024-09-16T07:28:21.500368+0000","last_became_peered":"2024-09-16T07:28:21.500368+0000","last_unstale":"2024-09-16T07:28:22.467989+0000","last_undegraded":"2024-09-16T07:28:22.467989+0000","last_fullsized":"2024-09-16T07:28:22.467989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.521033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468050+0000","last_change":"2024-09-16T07:28:20.466726+0000","last_active":"2024-09-16T07:28:22.468050+0000","last_peered":"2024-09-16T07:28:22.468050+0000","last_clean":"2024-09-16T07:28:22.468050+0000","last_became_active":"2024-09-16T07:28:20.466535+0000","last_became_peered":"2024-09-16T07:28:20.466535+0000","last_unstale":"2024-09-16T07:28:22.468050+0000","last_undegraded":"2024-09-16T07:28:22.468050+0000","last_fullsized":"2024-09-16T07:28:22.468050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467654+0000","last_change":"2024-09-16T07:28:21.499780+0000","last_active":"2024-09-16T07:28:22.467654+0000","last_peered":"2024-09-16T07:28:22.467654+0000","last_clean":"2024-09-16T07:28:22.467654+0000","last_became_active":"2024-09-16T07:28:21.499225+0000","last_became_peered":"2024-09-16T07:28:21.499225+0000","last_unstale":"2024-09-16T07:28:22.467654+0000","last_undegraded":"2024-09-16T07:28:22.467654+0000","last_fullsized":"2024-09-16T07:28:22.467654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468251+0000","last_change":"2024-09-16T07:28:20.472973+0000","last_active":"2024-09-16T07:28:22.468251+0000","last_peered":"2024-09-16T07:28:22.468251+0000","last_clean":"2024-09-16T07:28:22.468251+0000","last_became_active":"2024-09-16T07:28:20.472643+0000","last_became_peered":"2024-09-16T07:28:20.472643+0000","last_unstale":"2024-09-16T07:28:22.468251+0000","last_undegraded":"2024-09-16T07:28:22.468251+0000","last_fullsized":"2024-09-16T07:28:22.468251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:53.928004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549340+0000","last_change":"2024-09-16T07:28:21.488803+0000","last_active":"2024-09-16T07:28:22.549340+0000","last_peered":"2024-09-16T07:28:22.549340+0000","last_clean":"2024-09-16T07:28:22.549340+0000","last_became_active":"2024-09-16T07:28:21.488204+0000","last_became_peered":"2024-09-16T07:28:21.488204+0000","last_unstale":"2024-09-16T07:28:22.549340+0000","last_undegraded":"2024-09-16T07:28:22.549340+0000","last_fullsized":"2024-09-16T07:28:22.549340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:38.599962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465112+0000","last_change":"2024-09-16T07:28:20.465546+0000","last_active":"2024-09-16T07:28:22.465112+0000","last_peered":"2024-09-16T07:28:22.465112+0000","last_clean":"2024-09-16T07:28:22.465112+0000","last_became_active":"2024-09-16T07:28:20.465269+0000","last_became_peered":"2024-09-16T07:28:20.465269+0000","last_unstale":"2024-09-16T07:28:22.465112+0000","last_undegraded":"2024-09-16T07:28:22.465112+0000","last_fullsized":"2024-09-16T07:28:22.465112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465103+0000","last_change":"2024-09-16T07:28:21.475942+0000","last_active":"2024-09-16T07:28:22.465103+0000","last_peered":"2024-09-16T07:28:22.465103+0000","last_clean":"2024-09-16T07:28:22.465103+0000","last_became_active":"2024-09-16T07:28:21.475610+0000","last_became_peered":"2024-09-16T07:28:21.475610+0000","last_unstale":"2024-09-16T07:28:22.465103+0000","last_undegraded":"2024-09-16T07:28:22.465103+0000","last_fullsized":"2024-09-16T07:28:22.465103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549378+0000","last_change":"2024-09-16T07:28:20.455173+0000","last_active":"2024-09-16T07:28:22.549378+0000","last_peered":"2024-09-16T07:28:22.549378+0000","last_clean":"2024-09-16T07:28:22.549378+0000","last_became_active":"2024-09-16T07:28:20.454889+0000","last_became_peered":"2024-09-16T07:28:20.454889+0000","last_unstale":"2024-09-16T07:28:22.549378+0000","last_undegraded":"2024-09-16T07:28:22.549378+0000","last_fullsized":"2024-09-16T07:28:22.549378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:53.808988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:28:30.512 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:28:30.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T07:28:30.513 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T07:28:30.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 -- 172.21.15.114:0/854066605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 msgr2=0x7f76fc06f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 --2- 172.21.15.114:0/854066605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc06f9a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009bc0 tx=0x7f76f401cb70 comp rx=0 tx=0).stop 2024-09-16T07:28:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 -- 172.21.15.114:0/854066605 shutdown_connections 2024-09-16T07:28:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 --2- 172.21.15.114:0/854066605 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc06f9a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 --2- 172.21.15.114:0/854066605 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76fc15af60 0x7f76fc0cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 -- 172.21.15.114:0/854066605 >> 172.21.15.114:0/854066605 conn(0x7f76fc0d0c90 msgr2=0x7f76fc0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 -- 172.21.15.114:0/854066605 shutdown_connections 2024-09-16T07:28:30.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 -- 172.21.15.114:0/854066605 wait complete. 2024-09-16T07:28:30.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 Processor -- start 2024-09-16T07:28:30.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.689+0000 7f7702c00640 1 -- start start 2024-09-16T07:28:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76fc0737c0 0x7f76fc1fb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76fc15af60 0x7f76fc0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc167ab0 con 0x7f76fc074330 2024-09-16T07:28:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76fc167930 con 0x7f76fc0737c0 2024-09-16T07:28:30.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76fc167c30 con 0x7f76fc15af60 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc1569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57478/0 (socket says 172.21.15.114:57478) 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 -- 172.21.15.114:0/1007205417 learned_addr learned my addr 172.21.15.114:0/1007205417 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76fbe00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76fc0737c0 0x7f76fc1fb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7700c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76fc15af60 0x7f76fc0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 -- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76fc15af60 msgr2=0x7f76fc0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76fc15af60 0x7f76fc0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 -- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76fc0737c0 msgr2=0x7f76fc1fb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76fc0737c0 0x7f76fc1fb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 -- 172.21.15.114:0/1007205417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc1fb680 con 0x7f76fc074330 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76fbe00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76fc0737c0 0x7f76fc1fb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7700c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76fc15af60 0x7f76fc0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:30.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f3400640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc1569d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76e400c430 tx=0x7f76e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f8c00640 1 -- 172.21.15.114:0/1007205417 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011790 con 0x7f76fc074330 2024-09-16T07:28:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f8c00640 1 -- 172.21.15.114:0/1007205417 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76e4017070 con 0x7f76fc074330 2024-09-16T07:28:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f8c00640 1 -- 172.21.15.114:0/1007205417 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4011cc0 con 0x7f76fc074330 2024-09-16T07:28:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76fc0b0c60 con 0x7f76fc074330 2024-09-16T07:28:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76fc0b1220 con 0x7f76fc074330 2024-09-16T07:28:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76fc06f9a0 con 0x7f76fc074330 2024-09-16T07:28:30.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.693+0000 7f76f8c00640 1 -- 172.21.15.114:0/1007205417 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f76e401c460 con 0x7f76fc074330 2024-09-16T07:28:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.697+0000 7f76f8c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d8072ec0 0x7f76d8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.697+0000 7f76f8c00640 1 -- 172.21.15.114:0/1007205417 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f76e4093c90 con 0x7f76fc074330 2024-09-16T07:28:30.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.697+0000 7f76fbe00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d8072ec0 0x7f76d8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.697+0000 7f76fbe00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d8072ec0 0x7f76d8075380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76ec005fd0 tx=0x7f76ec005d00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.701+0000 7f76f8c00640 1 -- 172.21.15.114:0/1007205417 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f76fc1fb680 con 0x7f76fc074330 2024-09-16T07:28:30.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f76fc069940 con 0x7f76fc074330 2024-09-16T07:28:30.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f76f8c00640 1 -- 172.21.15.114:0/1007205417 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f76e405ee40 con 0x7f76fc074330 2024-09-16T07:28:30.872 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d8072ec0 msgr2=0x7f76d8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d8072ec0 0x7f76d8075380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76ec005fd0 tx=0x7f76ec005d00 comp rx=0 tx=0).stop 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 msgr2=0x7f76fc1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc1569d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76e400c430 tx=0x7f76e400c8f0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 shutdown_connections 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d8072ec0 0x7f76d8075380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76fc15af60 0x7f76fc0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76fc074330 0x7f76fc1569d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 --2- 172.21.15.114:0/1007205417 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76fc0737c0 0x7f76fc1fb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 >> 172.21.15.114:0/1007205417 conn(0x7f76fc0d0c90 msgr2=0x7f76fc073c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:30.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 shutdown_connections 2024-09-16T07:28:30.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:30.869+0000 7f7702c00640 1 -- 172.21.15.114:0/1007205417 wait complete. 2024-09-16T07:28:30.895 INFO:teuthology.orchestra.run.smithi114.stdout:[{"version":27,"timestamp":"2024-09-16T07:28:09.504424+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"3954.307388"}]}] 2024-09-16T07:28:30.895 INFO:tasks.ceph_manager:config epoch is 27 2024-09-16T07:28:30.895 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T07:28:30.895 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T07:28:30.895 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T07:28:31.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 -- 172.21.15.114:0/3077555582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f684815bea0 msgr2=0x7f68480ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 --2- 172.21.15.114:0/3077555582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f684815bea0 0x7f68480ce670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6848073d10 tx=0x7f683801c830 comp rx=0 tx=0).stop 2024-09-16T07:28:31.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 -- 172.21.15.114:0/3077555582 shutdown_connections 2024-09-16T07:28:31.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 --2- 172.21.15.114:0/3077555582 >> v2:172.21.15.149:3300/0 conn(0x7f68480cdb30 0x7f68480cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 --2- 172.21.15.114:0/3077555582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f684815bea0 0x7f68480ce670 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 -- 172.21.15.114:0/3077555582 >> 172.21.15.114:0/3077555582 conn(0x7f68480d1dc0 msgr2=0x7f68480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:31.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 -- 172.21.15.114:0/3077555582 shutdown_connections 2024-09-16T07:28:31.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 -- 172.21.15.114:0/3077555582 wait complete. 2024-09-16T07:28:31.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 Processor -- start 2024-09-16T07:28:31.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.033+0000 7f684e400640 1 -- start start 2024-09-16T07:28:31.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68480cdb30 0x7f68480cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68480d28e0 0x7f68480b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f684815bea0 0x7f6848155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6848168f10 con 0x7f68480d28e0 2024-09-16T07:28:31.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6848168d90 con 0x7f68480cdb30 2024-09-16T07:28:31.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6848169090 con 0x7f684815bea0 2024-09-16T07:28:31.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68480d28e0 0x7f68480b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68480d28e0 0x7f68480b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57496/0 (socket says 172.21.15.114:57496) 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 -- 172.21.15.114:0/165073314 learned_addr learned my addr 172.21.15.114:0/165073314 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6847400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68480cdb30 0x7f68480cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6847e00640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f684815bea0 0x7f6848155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 -- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f684815bea0 msgr2=0x7f6848155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f684815bea0 0x7f6848155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 -- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68480cdb30 msgr2=0x7f68480cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68480cdb30 0x7f68480cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 -- 172.21.15.114:0/165073314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6848156400 con 0x7f68480d28e0 2024-09-16T07:28:31.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6847400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68480cdb30 0x7f68480cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:31.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f6846a00640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68480d28e0 0x7f68480b0d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f683400d980 tx=0x7f683400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:31.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f683f400640 1 -- 172.21.15.114:0/165073314 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834017070 con 0x7f68480d28e0 2024-09-16T07:28:31.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f683f400640 1 -- 172.21.15.114:0/165073314 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6834009d60 con 0x7f68480d28e0 2024-09-16T07:28:31.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6848158090 con 0x7f68480d28e0 2024-09-16T07:28:31.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f683f400640 1 -- 172.21.15.114:0/165073314 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834005280 con 0x7f68480d28e0 2024-09-16T07:28:31.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6848158650 con 0x7f68480d28e0 2024-09-16T07:28:31.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6848157eb0 con 0x7f68480d28e0 2024-09-16T07:28:31.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.037+0000 7f683f400640 1 -- 172.21.15.114:0/165073314 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6834005420 con 0x7f68480d28e0 2024-09-16T07:28:31.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.041+0000 7f683f400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6828072ec0 0x7f6828075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.041+0000 7f683f400640 1 -- 172.21.15.114:0/165073314 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f68340940b0 con 0x7f68480d28e0 2024-09-16T07:28:31.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.041+0000 7f6847400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6828072ec0 0x7f6828075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.041+0000 7f6847400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6828072ec0 0x7f6828075380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68380af000 tx=0x7f683801b070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:31.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.045+0000 7f683f400640 1 -- 172.21.15.114:0/165073314 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6848157eb0 con 0x7f68480d28e0 2024-09-16T07:28:31.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.249+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f68480cc9d0 con 0x7f68480d28e0 2024-09-16T07:28:31.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.253+0000 7f683f400640 1 -- 172.21.15.114:0/165073314 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186085 (secure 0 0 0) 0x7f683405f260 con 0x7f68480d28e0 2024-09-16T07:28:31.259 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6828072ec0 msgr2=0x7f6828075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6828072ec0 0x7f6828075380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68380af000 tx=0x7f683801b070 comp rx=0 tx=0).stop 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68480d28e0 msgr2=0x7f68480b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68480d28e0 0x7f68480b0d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f683400d980 tx=0x7f683400de40 comp rx=0 tx=0).stop 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 shutdown_connections 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6828072ec0 0x7f6828075380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f684815bea0 0x7f6848155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68480d28e0 0x7f68480b0d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 --2- 172.21.15.114:0/165073314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68480cdb30 0x7f68480cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 >> 172.21.15.114:0/165073314 conn(0x7f68480d1dc0 msgr2=0x7f6848071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 shutdown_connections 2024-09-16T07:28:31.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.257+0000 7f684e400640 1 -- 172.21.15.114:0/165073314 wait complete. 2024-09-16T07:28:31.280 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":921426846},{"type":"v1","addr":"172.21.15.149:6801","nonce":921426846}]},"active_addr":"172.21.15.149:6801/921426846","active_change":"2024-09-16T07:28:00.978069+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":4119429621}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":582884511}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":2751300545}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":780559649}]}]} 2024-09-16T07:28:31.284 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T07:28:31.284 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T07:28:31.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.421+0000 7fa4aea00640 1 -- 172.21.15.114:0/1828714442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a815c1c0 msgr2=0x7fa4a8071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.421+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1828714442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a815c1c0 0x7fa4a8071740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009bf0 tx=0x7fa4a001cba0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.421+0000 7fa4aea00640 1 -- 172.21.15.114:0/1828714442 shutdown_connections 2024-09-16T07:28:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.421+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1828714442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a815c1c0 0x7fa4a8071740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.421+0000 7fa4aea00640 1 -- 172.21.15.114:0/1828714442 >> 172.21.15.114:0/1828714442 conn(0x7fa4a80d0c90 msgr2=0x7fa4a80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.421+0000 7fa4aea00640 1 -- 172.21.15.114:0/1828714442 shutdown_connections 2024-09-16T07:28:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.421+0000 7fa4aea00640 1 -- 172.21.15.114:0/1828714442 wait complete. 2024-09-16T07:28:31.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 Processor -- start 2024-09-16T07:28:31.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 -- start start 2024-09-16T07:28:31.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a806cc20 0x7fa4a81559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a80737c0 0x7fa4a80c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a815c1c0 0x7fa4a80c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a816a900 con 0x7fa4a80737c0 2024-09-16T07:28:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a816a780 con 0x7fa4a815c1c0 2024-09-16T07:28:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a816aa80 con 0x7fa4a806cc20 2024-09-16T07:28:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a80737c0 0x7fa4a80c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a80737c0 0x7fa4a80c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57512/0 (socket says 172.21.15.114:57512) 2024-09-16T07:28:31.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 -- 172.21.15.114:0/1227600220 learned_addr learned my addr 172.21.15.114:0/1227600220 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:31.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4a7e00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a806cc20 0x7fa4a81559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aca00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a815c1c0 0x7fa4a80c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 -- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a806cc20 msgr2=0x7fa4a81559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a806cc20 0x7fa4a81559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 -- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a815c1c0 msgr2=0x7fa4a80c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a815c1c0 0x7fa4a80c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 -- 172.21.15.114:0/1227600220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80c6480 con 0x7fa4a80737c0 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa49f400640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a80737c0 0x7fa4a80c58b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c500 tx=0x7fa49000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4a4c00640 1 -- 172.21.15.114:0/1227600220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490018070 con 0x7fa4a80737c0 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4a4c00640 1 -- 172.21.15.114:0/1227600220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa490003600 con 0x7fa4a80737c0 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4a4c00640 1 -- 172.21.15.114:0/1227600220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490003ad0 con 0x7fa4a80737c0 2024-09-16T07:28:31.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a80c6760 con 0x7fa4a80737c0 2024-09-16T07:28:31.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.425+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a80d0730 con 0x7fa4a80737c0 2024-09-16T07:28:31.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.429+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a806d000 con 0x7fa4a80737c0 2024-09-16T07:28:31.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.429+0000 7fa4a4c00640 1 -- 172.21.15.114:0/1227600220 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fa49001b070 con 0x7fa4a80737c0 2024-09-16T07:28:31.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.429+0000 7fa4a4c00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa484072ef0 0x7fa4840753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.429+0000 7fa4a4c00640 1 -- 172.21.15.114:0/1227600220 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa490093150 con 0x7fa4a80737c0 2024-09-16T07:28:31.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.429+0000 7fa4a7e00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa484072ef0 0x7fa4840753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.433+0000 7fa4a7e00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa484072ef0 0x7fa4840753b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa498007fd0 tx=0x7fa498007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:31.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.433+0000 7fa4a4c00640 1 -- 172.21.15.114:0/1227600220 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa490003c70 con 0x7fa4a80737c0 2024-09-16T07:28:31.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.605+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4a80b6c10 con 0x7fa4a80737c0 2024-09-16T07:28:31.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.605+0000 7fa4a4c00640 1 -- 172.21.15.114:0/1227600220 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16713 (secure 0 0 0) 0x7fa49005dd80 con 0x7fa4a80737c0 2024-09-16T07:28:31.610 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:31.610 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:22.454295+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa484072ef0 msgr2=0x7fa4840753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa484072ef0 0x7fa4840753b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa498007fd0 tx=0x7fa498007e40 comp rx=0 tx=0).stop 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a80737c0 msgr2=0x7fa4a80c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a80737c0 0x7fa4a80c58b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c500 tx=0x7fa49000c9c0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 shutdown_connections 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa484072ef0 0x7fa4840753b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a815c1c0 0x7fa4a80c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a80737c0 0x7fa4a80c58b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 --2- 172.21.15.114:0/1227600220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a806cc20 0x7fa4a81559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 >> 172.21.15.114:0/1227600220 conn(0x7fa4a80d0c90 msgr2=0x7fa4a80a0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:31.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 shutdown_connections 2024-09-16T07:28:31.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.609+0000 7fa4aea00640 1 -- 172.21.15.114:0/1227600220 wait complete. 2024-09-16T07:28:31.631 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T07:28:31.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 -- 172.21.15.114:0/116527122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1140072c90 msgr2=0x7f114015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 --2- 172.21.15.114:0/116527122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1140072c90 0x7f114015c9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11400aea80 tx=0x7f112801c870 comp rx=0 tx=0).stop 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 -- 172.21.15.114:0/116527122 shutdown_connections 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 --2- 172.21.15.114:0/116527122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1140072c90 0x7f114015c9c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 --2- 172.21.15.114:0/116527122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11400744c0 0x7f1140074930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 --2- 172.21.15.114:0/116527122 >> v2:172.21.15.149:3300/0 conn(0x7f114015c5e0 0x7f114006ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 -- 172.21.15.114:0/116527122 >> 172.21.15.114:0/116527122 conn(0x7f11400b1c20 msgr2=0x7f11400b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 -- 172.21.15.114:0/116527122 shutdown_connections 2024-09-16T07:28:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 -- 172.21.15.114:0/116527122 wait complete. 2024-09-16T07:28:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 Processor -- start 2024-09-16T07:28:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.769+0000 7f1146000640 1 -- start start 2024-09-16T07:28:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1140072c90 0x7f1140153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11400744c0 0x7f114015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114015c5e0 0x7f114014bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1140152260 con 0x7f114015c5e0 2024-09-16T07:28:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11400af900 con 0x7f1140072c90 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11401523e0 con 0x7f11400744c0 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114015c5e0 0x7f114014bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114015c5e0 0x7f114014bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57528/0 (socket says 172.21.15.114:57528) 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 -- 172.21.15.114:0/1589998523 learned_addr learned my addr 172.21.15.114:0/1589998523 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113f400640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1140072c90 0x7f1140153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1136a00640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11400744c0 0x7f114015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 -- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11400744c0 msgr2=0x7f114015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11400744c0 0x7f114015b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 -- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1140072c90 msgr2=0x7f1140153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1140072c90 0x7f1140153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 -- 172.21.15.114:0/1589998523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11401fb970 con 0x7f114015c5e0 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1136a00640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11400744c0 0x7f114015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f113fe00640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114015c5e0 0x7f114014bb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f113800ea50 tx=0x7f113800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1137e00640 1 -- 172.21.15.114:0/1589998523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113800cdc0 con 0x7f114015c5e0 2024-09-16T07:28:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1137e00640 1 -- 172.21.15.114:0/1589998523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1138004c40 con 0x7f114015c5e0 2024-09-16T07:28:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1137e00640 1 -- 172.21.15.114:0/1589998523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138005280 con 0x7f114015c5e0 2024-09-16T07:28:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1140153160 con 0x7f114015c5e0 2024-09-16T07:28:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1140153400 con 0x7f114015c5e0 2024-09-16T07:28:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1140074930 con 0x7f114015c5e0 2024-09-16T07:28:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.773+0000 7f1137e00640 1 -- 172.21.15.114:0/1589998523 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1138005420 con 0x7f114015c5e0 2024-09-16T07:28:31.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.777+0000 7f1137e00640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f111c072ec0 0x7f111c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:31.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.777+0000 7f1137e00640 1 -- 172.21.15.114:0/1589998523 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1138094790 con 0x7f114015c5e0 2024-09-16T07:28:31.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.777+0000 7f113f400640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f111c072ec0 0x7f111c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.777+0000 7f113f400640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f111c072ec0 0x7f111c075380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11400b26e0 tx=0x7f113000b2e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.781+0000 7f1137e00640 1 -- 172.21.15.114:0/1589998523 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1138016030 con 0x7f114015c5e0 2024-09-16T07:28:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.949+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f114006a330 con 0x7f114015c5e0 2024-09-16T07:28:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1137e00640 1 -- 172.21.15.114:0/1589998523 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16713 (secure 0 0 0) 0x7f113805f380 con 0x7f114015c5e0 2024-09-16T07:28:31.955 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:31.956 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:22.454295+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:31.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f111c072ec0 msgr2=0x7f111c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f111c072ec0 0x7f111c075380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11400b26e0 tx=0x7f113000b2e0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114015c5e0 msgr2=0x7f114014bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114015c5e0 0x7f114014bb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f113800ea50 tx=0x7f113800ef10 comp rx=0 tx=0).stop 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 shutdown_connections 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f111c072ec0 0x7f111c075380 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114015c5e0 0x7f114014bb60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11400744c0 0x7f114015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 --2- 172.21.15.114:0/1589998523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1140072c90 0x7f1140153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 >> 172.21.15.114:0/1589998523 conn(0x7f11400b1c20 msgr2=0x7f114006fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 shutdown_connections 2024-09-16T07:28:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:31.953+0000 7f1146000640 1 -- 172.21.15.114:0/1589998523 wait complete. 2024-09-16T07:28:31.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T07:28:31.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T07:28:31.977 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T07:28:31.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T07:28:31.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T07:28:31.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T07:28:31.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-16T07:28:31.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-16T07:28:32.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 -- 172.21.15.114:0/3174074855 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 msgr2=0x7f8e7c039b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 --2- 172.21.15.114:0/3174074855 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 0x7f8e7c039b50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c04f400 tx=0x7f8e7001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 -- 172.21.15.114:0/3174074855 shutdown_connections 2024-09-16T07:28:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 --2- 172.21.15.114:0/3174074855 >> v2:172.21.15.114:3300/0 conn(0x7f8e7c03a090 0x7f8e7c006630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 --2- 172.21.15.114:0/3174074855 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 0x7f8e7c039b50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 --2- 172.21.15.114:0/3174074855 >> v2:172.21.15.149:3300/0 conn(0x7f8e7c0df090 0x7f8e7c034550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 -- 172.21.15.114:0/3174074855 >> 172.21.15.114:0/3174074855 conn(0x7f8e7c01e010 msgr2=0x7f8e7c054e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 -- 172.21.15.114:0/3174074855 shutdown_connections 2024-09-16T07:28:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.225+0000 7f8e83e00640 1 -- 172.21.15.114:0/3174074855 wait complete. 2024-09-16T07:28:32.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 Processor -- start 2024-09-16T07:28:32.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 -- start start 2024-09-16T07:28:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff3ec200640 1 -- 172.21.15.114:0/2208482485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3cc004810 msgr2=0x7ff3cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff3ec200640 1 --2- 172.21.15.114:0/2208482485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3cc004810 0x7ff3cc004c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800bb10 tx=0x7ff3d801cda0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff3ec200640 1 -- 172.21.15.114:0/2208482485 shutdown_connections 2024-09-16T07:28:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff3ec200640 1 --2- 172.21.15.114:0/2208482485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3cc004810 0x7ff3cc004c90 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800bb10 tx=0x7ff3d801cda0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff3ec200640 1 -- 172.21.15.114:0/2208482485 >> 172.21.15.114:0/2208482485 conn(0x7ff3e40cfff0 msgr2=0x7ff3e40d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0cda00640 1 -- 172.21.15.114:0/2533404540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80c7890 msgr2=0x7ff0c80d26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0c6a00640 1 -- 172.21.15.114:0/2533404540 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00b2070 con 0x7ff0c80c7890 2024-09-16T07:28:32.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0cda00640 1 --2- 172.21.15.114:0/2533404540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80c7890 0x7ff0c80d26e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009c80 tx=0x7ff0c001cda0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 0x7f8e7c17add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e7c03a090 0x7f8e7c17b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0df090 0x7f8e7c17ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c0073c0 con 0x7f8e7c0df090 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c007240 con 0x7f8e7c03a090 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7c0531d0 con 0x7f8e7c036220 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 0x7f8e7c17add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 0x7f8e7c17add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53386/0 (socket says 172.21.15.114:53386) 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82a00640 1 -- 172.21.15.114:0/2087821687 learned_addr learned my addr 172.21.15.114:0/2087821687 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82000640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e7c03a090 0x7f8e7c17b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e83400640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0df090 0x7f8e7c17ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82000640 1 -- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 msgr2=0x7f8e7c17add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82000640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 0x7f8e7c17add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82000640 1 -- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0df090 msgr2=0x7f8e7c17ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82000640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e7c0df090 0x7f8e7c17ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82000640 1 -- 172.21.15.114:0/2087821687 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c0d5f90 con 0x7f8e7c03a090 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82a00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e7c036220 0x7f8e7c17add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff3ec200640 1 -- 172.21.15.114:0/2208482485 shutdown_connections 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0cda00640 1 -- 172.21.15.114:0/2533404540 shutdown_connections 2024-09-16T07:28:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0cda00640 1 --2- 172.21.15.114:0/2533404540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80c7890 0x7ff0c80d26e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0cda00640 1 -- 172.21.15.114:0/2533404540 >> 172.21.15.114:0/2533404540 conn(0x7ff0c80d3dd0 msgr2=0x7ff0c80d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7f8e82000640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e7c03a090 0x7f8e7c17b500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c007d60 tx=0x7f8e70005a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0cda00640 1 -- 172.21.15.114:0/2533404540 shutdown_connections 2024-09-16T07:28:32.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff0cda00640 1 -- 172.21.15.114:0/2533404540 wait complete. 2024-09-16T07:28:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.229+0000 7ff3ec200640 1 -- 172.21.15.114:0/2208482485 wait complete. 2024-09-16T07:28:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.233+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700ac070 con 0x7f8e7c03a090 2024-09-16T07:28:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.233+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e700043e0 con 0x7f8e7c03a090 2024-09-16T07:28:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.233+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700a6b90 con 0x7f8e7c03a090 2024-09-16T07:28:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.233+0000 7ff3ec200640 1 Processor -- start 2024-09-16T07:28:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.233+0000 7ff3ec200640 1 -- start start 2024-09-16T07:28:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.233+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c0d6270 con 0x7f8e7c03a090 2024-09-16T07:28:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.233+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c0d6830 con 0x7f8e7c03a090 2024-09-16T07:28:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e7c0d6c10 con 0x7f8e7c03a090 2024-09-16T07:28:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 Processor -- start 2024-09-16T07:28:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3ec200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3e41f8a40 0x7ff3e40ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 -- start start 2024-09-16T07:28:32.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3ec200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3e40ae530 0x7ff3e40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f6cdf200640 1 -- 172.21.15.114:0/2412948528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 msgr2=0x7f6ce00cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f6cdf200640 1 --2- 172.21.15.114:0/2412948528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 0x7f6ce00cbe60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097f0 tx=0x7f6ccc01c600 comp rx=0 tx=0).stop 2024-09-16T07:28:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3ec200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3e41529a0 0x7ff3e40c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3ec200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40cf850 con 0x7ff3e41f8a40 2024-09-16T07:28:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3ec200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e40cf130 con 0x7ff3e41529a0 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3ec200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e40cf9d0 con 0x7ff3e40ae530 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3e41f8a40 0x7ff3e40ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3e41f8a40 0x7ff3e40ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57604/0 (socket says 172.21.15.114:57604) 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 -- 172.21.15.114:0/2853692434 learned_addr learned my addr 172.21.15.114:0/2853692434 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e8e00640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3e40ae530 0x7ff3e40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f6cdf200640 1 -- 172.21.15.114:0/2412948528 shutdown_connections 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f6cdf200640 1 --2- 172.21.15.114:0/2412948528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 0x7f6ce00cbe60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f6cdf200640 1 -- 172.21.15.114:0/2412948528 >> 172.21.15.114:0/2412948528 conn(0x7f6ce00b1600 msgr2=0x7f6ce00b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3ea200640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3e41529a0 0x7ff3e40c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f6cdf200640 1 -- 172.21.15.114:0/2412948528 shutdown_connections 2024-09-16T07:28:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7f6cdf200640 1 -- 172.21.15.114:0/2412948528 wait complete. 2024-09-16T07:28:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80b5380 0x7ff0c8154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0c80b5ab0 0x7ff0c815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c80c7890 0x7ff0c80c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c8170350 con 0x7ff0c80b5ab0 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c81701d0 con 0x7ff0c80b5380 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cda00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c81704d0 con 0x7ff0c80c7890 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 -- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3e40ae530 msgr2=0x7ff3e40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3e40ae530 0x7ff3e40c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 -- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3e41529a0 msgr2=0x7ff3e40c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3e41529a0 0x7ff3e40c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff3e9800640 1 -- 172.21.15.114:0/2853692434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e40c46d0 con 0x7ff3e41f8a40 2024-09-16T07:28:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c80c7890 0x7ff0c80c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c80c7890 0x7ff0c80c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53430/0 (socket says 172.21.15.114:53430) 2024-09-16T07:28:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.237+0000 7ff0cd000640 1 -- 172.21.15.114:0/923941913 learned_addr learned my addr 172.21.15.114:0/923941913 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f8e700af070 con 0x7f8e7c03a090 2024-09-16T07:28:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0c7e00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80b5380 0x7ff0c8154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff3e9800640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3e41f8a40 0x7ff3e40ace20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0001250 tx=0x7ff3d0003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 Processor -- start 2024-09-16T07:28:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0015070 con 0x7ff3e41f8a40 2024-09-16T07:28:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0c7e00640 1 -- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c80c7890 msgr2=0x7ff0c80c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0c7e00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0c80c7890 0x7ff0c80c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0c7e00640 1 -- 172.21.15.114:0/923941913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0c80b5ab0 msgr2=0x7ff0c815c420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T07:28:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0c7e00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0c80b5ab0 0x7ff0c815c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0c7e00640 1 -- 172.21.15.114:0/923941913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c8155130 con 0x7ff0c80b5380 2024-09-16T07:28:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 -- start start 2024-09-16T07:28:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e40ad490 con 0x7ff3e41f8a40 2024-09-16T07:28:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e40ada50 con 0x7ff3e41f8a40 2024-09-16T07:28:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0c7e00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80b5380 0x7ff0c8154bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b3c0 tx=0x7ff0b800b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e7aa00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e64072f90 0x7f8e64075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8011830 con 0x7ff0c80b5380 2024-09-16T07:28:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c815f390 con 0x7ff0c80b5380 2024-09-16T07:28:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c815f950 con 0x7ff0c80b5380 2024-09-16T07:28:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8e7012e070 con 0x7f8e7c03a090 2024-09-16T07:28:32.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0b8016070 con 0x7ff0c80b5380 2024-09-16T07:28:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8011830 con 0x7ff0c80b5380 2024-09-16T07:28:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e82a00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e64072f90 0x7f8e64075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e7aa00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f8e6407b1b0 0x7f8e6407d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 --> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e700b4ec0 con 0x7f8e6407b1b0 2024-09-16T07:28:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8e7012e460 con 0x7f8e7c03a090 2024-09-16T07:28:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 0x7f6ce0150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce00cc440 0x7f6ce014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce015bbc0 0x7f6ce00c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce016a120 con 0x7f6ce00cc440 2024-09-16T07:28:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce0169fa0 con 0x7f6ce015bbc0 2024-09-16T07:28:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce016a2a0 con 0x7f6ce00aedb0 2024-09-16T07:28:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3d000f9a0 con 0x7ff3e41f8a40 2024-09-16T07:28:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000fdb0 con 0x7ff3e41f8a40 2024-09-16T07:28:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e83400640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f8e6407b1b0 0x7f8e6407d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3c0001040 con 0x7ff3e41f8a40 2024-09-16T07:28:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 0x7f6ce0150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 0x7f6ce0150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53442/0 (socket says 172.21.15.114:53442) 2024-09-16T07:28:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f6cdde00640 1 -- 172.21.15.114:0/919682444 learned_addr learned my addr 172.21.15.114:0/919682444 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.241+0000 7f8e82a00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e64072f90 0x7f8e64075450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0d5ec0 tx=0x7f8e74008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0a0001040 con 0x7ff0c80b5380 2024-09-16T07:28:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdd400640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce00cc440 0x7f6ce014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cde800640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce015bbc0 0x7f6ce00c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdde00640 1 -- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce015bbc0 msgr2=0x7f6ce00c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdde00640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce015bbc0 0x7f6ce00c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdde00640 1 -- 172.21.15.114:0/919682444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce00cc440 msgr2=0x7f6ce014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdde00640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ce00cc440 0x7f6ce014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f8e83400640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f8e6407b1b0 0x7f8e6407d5d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdde00640 1 -- 172.21.15.114:0/919682444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce00748a0 con 0x7f6ce00aedb0 2024-09-16T07:28:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdde00640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 0x7f6ce0150960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c750 tx=0x7f6cd800cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cde800640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ce015bbc0 0x7f6ce00c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 -- 172.21.15.114:0/3950545023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cd80af120 msgr2=0x7f9cd806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 --2- 172.21.15.114:0/3950545023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cd80af120 0x7f9cd806e960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009900 tx=0x7f9cc801f110 comp rx=0 tx=0).stop 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 -- 172.21.15.114:0/3950545023 shutdown_connections 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 --2- 172.21.15.114:0/3950545023 >> v2:172.21.15.114:3300/0 conn(0x7f9cd80707b0 0x7f9cd8072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 --2- 172.21.15.114:0/3950545023 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cd80af120 0x7f9cd806e960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 -- 172.21.15.114:0/3950545023 >> 172.21.15.114:0/3950545023 conn(0x7f9cd80cfa30 msgr2=0x7f9cd80cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 -- 172.21.15.114:0/3950545023 shutdown_connections 2024-09-16T07:28:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 -- 172.21.15.114:0/3950545023 wait complete. 2024-09-16T07:28:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f148b200640 1 -- 172.21.15.114:0/3745521185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470003a60 msgr2=0x7f1470003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f148b200640 1 --2- 172.21.15.114:0/3745521185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470003a60 0x7f1470003e80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f147c006fc0 tx=0x7f147c01cf60 comp rx=0 tx=0).stop 2024-09-16T07:28:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8017070 con 0x7f6ce00aedb0 2024-09-16T07:28:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cd8005070 con 0x7f6ce00aedb0 2024-09-16T07:28:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800ce60 con 0x7f6ce00aedb0 2024-09-16T07:28:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7fc213e00640 1 -- 172.21.15.114:0/1871773030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc214146ed0 msgr2=0x7fc1f80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7fc213e00640 1 --2- 172.21.15.114:0/1871773030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc214146ed0 0x7fc1f80051d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc204009b30 tx=0x7fc20401d290 comp rx=0 tx=0).stop 2024-09-16T07:28:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 -- 172.21.15.114:0/4170729409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a200ce7a0 msgr2=0x7f1a200c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 --2- 172.21.15.114:0/4170729409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a200ce7a0 0x7f1a200c52d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a20076400 tx=0x7f1a1401c890 comp rx=0 tx=0).stop 2024-09-16T07:28:32.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7fc213400640 1 -- 172.21.15.114:0/1871773030 reap_dead start 2024-09-16T07:28:32.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 Processor -- start 2024-09-16T07:28:32.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 -- 172.21.15.114:0/4170729409 shutdown_connections 2024-09-16T07:28:32.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 --2- 172.21.15.114:0/4170729409 >> v2:172.21.15.114:3300/0 conn(0x7f1a200ceb80 0x7f1a2006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 --2- 172.21.15.114:0/4170729409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a200ce7a0 0x7f1a200c52d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 -- 172.21.15.114:0/4170729409 >> 172.21.15.114:0/4170729409 conn(0x7f1a200b2060 msgr2=0x7f1a200b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7fc213e00640 1 -- 172.21.15.114:0/1871773030 shutdown_connections 2024-09-16T07:28:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7fc213e00640 1 -- 172.21.15.114:0/1871773030 >> 172.21.15.114:0/1871773030 conn(0x7fc2140b1600 msgr2=0x7fc2140b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 -- 172.21.15.114:0/4170729409 shutdown_connections 2024-09-16T07:28:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== osd.0 v2:172.21.15.114:6808/1983213765 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e700b4ec0 con 0x7f8e6407b1b0 2024-09-16T07:28:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce014ef60 con 0x7f6ce00aedb0 2024-09-16T07:28:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce00c7910 con 0x7f6ce00aedb0 2024-09-16T07:28:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff0b8011a30 con 0x7ff0c80b5380 2024-09-16T07:28:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0bfe00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff0a80730f0 0x7ff0a80755b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff0b8093370 con 0x7ff0c80b5380 2024-09-16T07:28:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f148b200640 1 -- 172.21.15.114:0/3745521185 shutdown_connections 2024-09-16T07:28:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f148b200640 1 --2- 172.21.15.114:0/3745521185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470003a60 0x7f1470003e80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f148b200640 1 -- 172.21.15.114:0/3745521185 >> 172.21.15.114:0/3745521185 conn(0x7f148c06dd30 msgr2=0x7f148c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ce01543e0 con 0x7f6ce00aedb0 2024-09-16T07:28:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0c7400640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff0a80730f0 0x7ff0a80755b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0bfe00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7ff0a807b290 0x7ff0a807d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 --> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0a807dd60 con 0x7ff0a807b290 2024-09-16T07:28:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff0b809a050 con 0x7ff0c80b5380 2024-09-16T07:28:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f9cd7200640 1 -- start start 2024-09-16T07:28:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7f1a27600640 1 -- 172.21.15.114:0/4170729409 wait complete. 2024-09-16T07:28:32.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff3d0025440 con 0x7ff3e41f8a40 2024-09-16T07:28:32.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cd80707b0 0x7f9cd8158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cd80af120 0x7f9cd80aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd80ca950 0x7f9cd80add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8073a60 con 0x7f9cd80707b0 2024-09-16T07:28:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd80738e0 con 0x7f9cd80ca950 2024-09-16T07:28:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd815eb30 con 0x7f9cd80af120 2024-09-16T07:28:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd80ca950 0x7f9cd80add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd80ca950 0x7f9cd80add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:58534/0 (socket says 172.21.15.114:58534) 2024-09-16T07:28:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 -- 172.21.15.114:0/4042930217 learned_addr learned my addr 172.21.15.114:0/4042930217 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd5400640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cd80af120 0x7f9cd80aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0cd000640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7ff0a807b290 0x7ff0a807d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.245+0000 7fc213e00640 1 -- 172.21.15.114:0/1871773030 shutdown_connections 2024-09-16T07:28:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7ff0c7400640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff0a80730f0 0x7ff0a80755b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4007fd0 tx=0x7ff0b40079a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f148b200640 1 -- 172.21.15.114:0/3745521185 shutdown_connections 2024-09-16T07:28:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f148b200640 1 -- 172.21.15.114:0/3745521185 wait complete. 2024-09-16T07:28:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 -- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cd80af120 msgr2=0x7f9cd80aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cd80af120 0x7f9cd80aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 -- 172.21.15.114:0/4042930217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cd80707b0 msgr2=0x7f9cd8158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9cd80707b0 0x7f9cd8158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 -- 172.21.15.114:0/4042930217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd80ab820 con 0x7f9cd80ca950 2024-09-16T07:28:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7fc213e00640 1 -- 172.21.15.114:0/1871773030 wait complete. 2024-09-16T07:28:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd6800640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd80ca950 0x7f9cd80add20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000da10 tx=0x7f9cd000ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0017070 con 0x7f9cd80ca950 2024-09-16T07:28:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cd0010460 con 0x7f9cd80ca950 2024-09-16T07:28:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000be60 con 0x7f9cd80ca950 2024-09-16T07:28:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 -- 172.21.15.114:0/4042930217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd80ad240 con 0x7f9cd80ca950 2024-09-16T07:28:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f9cd7200640 1 -- 172.21.15.114:0/4042930217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd80ad800 con 0x7f9cd80ca950 2024-09-16T07:28:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f1a27600640 1 Processor -- start 2024-09-16T07:28:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.249+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6cd801a070 con 0x7f6ce00aedb0 2024-09-16T07:28:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9cac001040 con 0x7f9cd80ca950 2024-09-16T07:28:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 Processor -- start 2024-09-16T07:28:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff0cd000640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7ff0a807b290 0x7ff0a807d6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cd6000640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cc0072f10 0x7f6cc00753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6cd80933e0 con 0x7f6ce00aedb0 2024-09-16T07:28:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cd6000640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f6cc007b130 0x7f6cc007d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 --> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cd801de80 con 0x7f6cc007b130 2024-09-16T07:28:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6cd809a050 con 0x7f6ce00aedb0 2024-09-16T07:28:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 -- start start 2024-09-16T07:28:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 Processor -- start 2024-09-16T07:28:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cde800640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f6cc007b130 0x7f6cc007d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3e1600640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff3c4072ef0 0x7ff3c40753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff3d0094f90 con 0x7ff3e41f8a40 2024-09-16T07:28:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3e8e00640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff3c4072ef0 0x7ff3c40753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3e1600640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7ff3c407b170 0x7ff3c407d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 --> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3c407dc40 con 0x7ff3c407b170 2024-09-16T07:28:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff3d0095380 con 0x7ff3e41f8a40 2024-09-16T07:28:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cdd400640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cc0072f10 0x7f6cc00753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc214146ed0 0x7fc21413c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2140c5a00 0x7fc2140b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2140b0ba0 0x7fc2140a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140cdc40 con 0x7fc214146ed0 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141626a0 con 0x7fc2140b0ba0 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc213e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc2140cddc0 con 0x7fc2140c5a00 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f1a27600640 1 -- start start 2024-09-16T07:28:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3ea200640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7ff3c407b170 0x7ff3c407d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff3e8e00640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff3c4072ef0 0x7ff3c40753b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80b0000 tx=0x7ff3d8019b40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== osd.2 v2:172.21.15.114:6800/667480582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0a807dd60 con 0x7ff0a807b290 2024-09-16T07:28:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f9cd00108b0 con 0x7f9cd80ca950 2024-09-16T07:28:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2140c5a00 0x7fc2140b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2140c5a00 0x7fc2140b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53466/0 (socket says 172.21.15.114:53466) 2024-09-16T07:28:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 -- 172.21.15.114:0/1831954685 learned_addr learned my addr 172.21.15.114:0/1831954685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 -- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2140b0ba0 msgr2=0x7fc2140a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2140b0ba0 0x7fc2140a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 -- 172.21.15.114:0/1831954685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc214146ed0 msgr2=0x7fc21413c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc214146ed0 0x7fc21413c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 -- start start 2024-09-16T07:28:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 -- 172.21.15.114:0/1831954685 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2140c41c0 con 0x7fc2140c5a00 2024-09-16T07:28:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cde800640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f6cc007b130 0x7f6cc007d550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f6cdd400640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cc0072f10 0x7f6cc00753d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0ae000 tx=0x7f6ccc00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1470003a60 0x7f148c142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f148c14d2a0 0x7f148c0d0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7fc212000640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2140c5a00 0x7fc2140b0660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00fb90 tx=0x7fc20c00e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f1a27600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a20071720 0x7f1a200b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a27600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a200ce7a0 0x7f1a20152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a20071720 0x7f1a200b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a27600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a200ceb80 0x7f1a20153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a27600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2016b2f0 con 0x7f1a200ce7a0 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a27600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2016b170 con 0x7f1a200ceb80 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a27600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2016b470 con 0x7f1a20071720 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a20071720 0x7f1a200b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53478/0 (socket says 172.21.15.114:53478) 2024-09-16T07:28:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 -- 172.21.15.114:0/1784350479 learned_addr learned my addr 172.21.15.114:0/1784350479 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a25600640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a200ceb80 0x7f1a20153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f148c143c30 0x7f148c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f148c0b4890 con 0x7f1470003a60 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f148c071320 con 0x7f148c14d2a0 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.253+0000 7f148b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f148c0b4a10 con 0x7f148c143c30 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f148a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f148c143c30 0x7f148c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f148c14d2a0 0x7f148c0d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f148c14d2a0 0x7f148c0d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:58552/0 (socket says 172.21.15.114:58552) 2024-09-16T07:28:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 -- 172.21.15.114:0/3027298756 learned_addr learned my addr 172.21.15.114:0/3027298756 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7ff3ea200640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7ff3c407b170 0x7ff3c407d590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== osd.1 v2:172.21.15.114:6816/2092597227 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3c407dc40 con 0x7ff3c407b170 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cce000640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9cb8072ec0 0x7f9cb8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9cd0094660 con 0x7f9cd80ca950 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cce000640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f9cb807b060 0x7f9cb807d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 --> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cb807db30 con 0x7f9cb807b060 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9cd0094af0 con 0x7f9cd80ca950 2024-09-16T07:28:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cd5e00640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9cb8072ec0 0x7f9cb8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cd5400640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f9cb807b060 0x7f9cb807d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== osd.4 v2:172.21.15.149:6811/263951499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cd801de80 con 0x7f6cc007b130 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c011640 con 0x7fc2140c5a00 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc20c00fe90 con 0x7fc2140c5a00 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c011b70 con 0x7fc2140c5a00 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2140c44a0 con 0x7fc2140c5a00 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2140c4a60 con 0x7fc2140c5a00 2024-09-16T07:28:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2140c3f70 con 0x7fc2140c5a00 2024-09-16T07:28:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 -- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a200ceb80 msgr2=0x7f1a20153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a200ceb80 0x7f1a20153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 -- 172.21.15.114:0/1784350479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a200ce7a0 msgr2=0x7f1a20152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a200ce7a0 0x7f1a20152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 -- 172.21.15.114:0/1784350479 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a201551a0 con 0x7f1a20071720 2024-09-16T07:28:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a24c00640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a20071720 0x7f1a200b5700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a1401af40 tx=0x7f1a14004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 -- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f148c143c30 msgr2=0x7f148c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f148c143c30 0x7f148c0d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 -- 172.21.15.114:0/3027298756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1470003a60 msgr2=0x7f148c142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1470003a60 0x7f148c142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 -- 172.21.15.114:0/3027298756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c14da10 con 0x7f148c14d2a0 2024-09-16T07:28:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a140ba020 con 0x7f1a20071720 2024-09-16T07:28:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a14005030 con 0x7f1a20071720 2024-09-16T07:28:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a140b2040 con 0x7f1a20071720 2024-09-16T07:28:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a27600640 1 -- 172.21.15.114:0/1784350479 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a20155480 con 0x7f1a20071720 2024-09-16T07:28:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1483e00640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f148c14d2a0 0x7f148c0d0060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f147400d780 tx=0x7f147400dc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1a27600640 1 -- 172.21.15.114:0/1784350479 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a20155a40 con 0x7f1a20071720 2024-09-16T07:28:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cd5e00640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9cb8072ec0 0x7f9cb8075380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000f70 tx=0x7f9cc40079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474009c30 con 0x7f148c14d2a0 2024-09-16T07:28:32.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f147400de90 con 0x7f148c14d2a0 2024-09-16T07:28:32.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f9cd5400640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f9cb807b060 0x7f9cb807d480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.257+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c14d730 con 0x7f148c14d2a0 2024-09-16T07:28:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c147da0 con 0x7f148c14d2a0 2024-09-16T07:28:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fc20c019030 con 0x7fc2140c5a00 2024-09-16T07:28:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474009c30 con 0x7f148c14d2a0 2024-09-16T07:28:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f148c0b3af0 con 0x7f148c14d2a0 2024-09-16T07:28:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== osd.3 v2:172.21.15.114:6824/4272931554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cb807db30 con 0x7f9cb807b060 2024-09-16T07:28:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc20aa00640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc1f4072f10 0x7fc1f40753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc20c094b60 con 0x7fc2140c5a00 2024-09-16T07:28:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc20aa00640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fc1f407b110 0x7fc1f407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 --> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1f407dbe0 con 0x7fc1f407b110 2024-09-16T07:28:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc20c05bee0 con 0x7fc2140c5a00 2024-09-16T07:28:32.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1a140bd070 con 0x7f1a20071720 2024-09-16T07:28:32.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc212a00640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc1f4072f10 0x7fc1f40753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7f1a27600640 1 -- 172.21.15.114:0/1784350479 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19fc001040 con 0x7f1a20071720 2024-09-16T07:28:32.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.261+0000 7fc213400640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fc1f407b110 0x7fc1f407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a1cc00640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1a00072ec0 0x7f1a00075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1a1412d520 con 0x7f1a20071720 2024-09-16T07:28:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a1fe00640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1a00072ec0 0x7f1a00075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a1cc00640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7f1a0007b0c0 0x7f1a0007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 --> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a0007db90 con 0x7f1a0007b0c0 2024-09-16T07:28:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1474010460 con 0x7f148c14d2a0 2024-09-16T07:28:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7fc213400640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fc1f407b110 0x7fc1f407d530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7fc212a00640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc1f4072f10 0x7fc1f40753d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc200000c10 tx=0x7fc200006b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1a140f46b0 con 0x7f1a20071720 2024-09-16T07:28:32.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a1fe00640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1a00072ec0 0x7f1a00075380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a200b2f70 tx=0x7f1a0c006c50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1482000640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f14680732c0 0x7f1468075780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== osd.5 v2:172.21.15.149:6802/2815936045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1f407dbe0 con 0x7fc1f407b110 2024-09-16T07:28:32.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a25600640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7f1a0007b0c0 0x7f1a0007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1474009a30 con 0x7f148c14d2a0 2024-09-16T07:28:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1482000640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f146807b460 0x7f146807d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 --> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f146807df30 con 0x7f146807b460 2024-09-16T07:28:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1474094390 con 0x7f148c14d2a0 2024-09-16T07:28:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1489e00640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f14680732c0 0x7f1468075780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f148a800640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f146807b460 0x7f146807d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.265+0000 7f1a25600640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7f1a0007b0c0 0x7f1a0007d4e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.269+0000 7f148a800640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f146807b460 0x7f146807d880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.269+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== osd.6 v2:172.21.15.149:6826/1750215732 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a0007db90 con 0x7f1a0007b0c0 2024-09-16T07:28:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.269+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== osd.7 v2:172.21.15.149:6810/1130358838 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f146807df30 con 0x7f146807b460 2024-09-16T07:28:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.273+0000 7f1489e00640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f14680732c0 0x7f1468075780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f147c0ac000 tx=0x7f147c0b1040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.273+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 --> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e7c006630 con 0x7f8e6407b1b0 2024-09-16T07:28:32.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e7aa00640 1 -- 172.21.15.114:0/2087821687 <== osd.0 v2:172.21.15.114:6808/1983213765 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8e7c006630 con 0x7f8e6407b1b0 2024-09-16T07:28:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f8e6407b1b0 msgr2=0x7f8e6407d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f8e6407b1b0 0x7f8e6407d5d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e64072f90 msgr2=0x7f8e64075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e64072f90 0x7f8e64075450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0d5ec0 tx=0x7f8e74008040 comp rx=0 tx=0).stop 2024-09-16T07:28:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e7c03a090 msgr2=0x7f8e7c17b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 --2- 172.21.15.114:0/2087821687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e7c03a090 0x7f8e7c17b500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c007d60 tx=0x7f8e70005a50 comp rx=0 tx=0).stop 2024-09-16T07:28:32.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83400640 1 -- 172.21.15.114:0/2087821687 reap_dead start 2024-09-16T07:28:32.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 shutdown_connections 2024-09-16T07:28:32.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.277+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 >> 172.21.15.114:0/2087821687 conn(0x7f8e7c01e010 msgr2=0x7f8e7c032400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.281+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 shutdown_connections 2024-09-16T07:28:32.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.281+0000 7f8e83e00640 1 -- 172.21.15.114:0/2087821687 wait complete. 2024-09-16T07:28:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 --> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0a0002de0 con 0x7ff0a807b290 2024-09-16T07:28:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0bfe00640 1 -- 172.21.15.114:0/923941913 <== osd.2 v2:172.21.15.114:6800/667480582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0a0002de0 con 0x7ff0a807b290 2024-09-16T07:28:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7ff0a807b290 msgr2=0x7ff0a807d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7ff0a807b290 0x7ff0a807d6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff0a80730f0 msgr2=0x7ff0a80755b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff0a80730f0 0x7ff0a80755b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4007fd0 tx=0x7ff0b40079a0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80b5380 msgr2=0x7ff0c8154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 --2- 172.21.15.114:0/923941913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0c80b5380 0x7ff0c8154bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0b800b3c0 tx=0x7ff0b800b880 comp rx=0 tx=0).stop 2024-09-16T07:28:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cd000640 1 -- 172.21.15.114:0/923941913 reap_dead start 2024-09-16T07:28:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 shutdown_connections 2024-09-16T07:28:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.285+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 >> 172.21.15.114:0/923941913 conn(0x7ff0c80d3dd0 msgr2=0x7ff0c806db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.289+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 shutdown_connections 2024-09-16T07:28:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.289+0000 7ff0cda00640 1 -- 172.21.15.114:0/923941913 wait complete. 2024-09-16T07:28:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.289+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 --> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff3c0002de0 con 0x7ff3c407b170 2024-09-16T07:28:32.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.289+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 --> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ce0154100 con 0x7f6cc007b130 2024-09-16T07:28:32.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.289+0000 7f6cd6000640 1 -- 172.21.15.114:0/919682444 <== osd.4 v2:172.21.15.149:6811/263951499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ce0154100 con 0x7f6cc007b130 2024-09-16T07:28:32.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 --> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9cac002de0 con 0x7f9cb807b060 2024-09-16T07:28:32.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7ff3e1600640 1 -- 172.21.15.114:0/2853692434 <== osd.1 v2:172.21.15.114:6816/2092597227 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff3c0002de0 con 0x7ff3c407b170 2024-09-16T07:28:32.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cce000640 1 -- 172.21.15.114:0/4042930217 <== osd.3 v2:172.21.15.114:6824/4272931554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9cac002de0 con 0x7f9cb807b060 2024-09-16T07:28:32.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f6cc007b130 msgr2=0x7f6cc007d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f6cc007b130 0x7f6cc007d550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f9cb807b060 msgr2=0x7f9cb807d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f9cb807b060 0x7f9cb807d480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9cb8072ec0 msgr2=0x7f9cb8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9cb8072ec0 0x7f9cb8075380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000f70 tx=0x7f9cc40079c0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd80ca950 msgr2=0x7f9cd80add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 --2- 172.21.15.114:0/4042930217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cd80ca950 0x7f9cd80add20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000da10 tx=0x7f9cd000ded0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cd6800640 1 -- 172.21.15.114:0/4042930217 reap_dead start 2024-09-16T07:28:32.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cc0072f10 msgr2=0x7f6cc00753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cc0072f10 0x7f6cc00753d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0ae000 tx=0x7f6ccc00b040 comp rx=0 tx=0).stop 2024-09-16T07:28:32.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 msgr2=0x7f6ce0150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 --2- 172.21.15.114:0/919682444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ce00aedb0 0x7f6ce0150960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c750 tx=0x7f6cd800cc10 comp rx=0 tx=0).stop 2024-09-16T07:28:32.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 shutdown_connections 2024-09-16T07:28:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 >> 172.21.15.114:0/4042930217 conn(0x7f9cd80cfa30 msgr2=0x7f9cd815dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cde800640 1 -- 172.21.15.114:0/919682444 reap_dead start 2024-09-16T07:28:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 shutdown_connections 2024-09-16T07:28:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 >> 172.21.15.114:0/919682444 conn(0x7f6ce00b1600 msgr2=0x7f6ce00b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 shutdown_connections 2024-09-16T07:28:32.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 shutdown_connections 2024-09-16T07:28:32.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f9cc3400640 1 -- 172.21.15.114:0/4042930217 wait complete. 2024-09-16T07:28:32.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7ff3c407b170 msgr2=0x7ff3c407d590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7ff3ec200640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7ff3c407b170 0x7ff3c407d590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff3c4072ef0 msgr2=0x7ff3c40753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7ff3ec200640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff3c4072ef0 0x7ff3c40753b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80b0000 tx=0x7ff3d8019b40 comp rx=0 tx=0).stop 2024-09-16T07:28:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7f6cdf200640 1 -- 172.21.15.114:0/919682444 wait complete. 2024-09-16T07:28:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.293+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3e41f8a40 msgr2=0x7ff3e40ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7ff3ec200640 1 --2- 172.21.15.114:0/2853692434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3e41f8a40 0x7ff3e40ace20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0001250 tx=0x7ff3d0003a90 comp rx=0 tx=0).stop 2024-09-16T07:28:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7ff3ea200640 1 -- 172.21.15.114:0/2853692434 reap_dead start 2024-09-16T07:28:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 --> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc214161840 con 0x7fc1f407b110 2024-09-16T07:28:32.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 shutdown_connections 2024-09-16T07:28:32.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 >> 172.21.15.114:0/2853692434 conn(0x7ff3e40cfff0 msgr2=0x7ff3e4070030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 shutdown_connections 2024-09-16T07:28:32.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7ff3ec200640 1 -- 172.21.15.114:0/2853692434 wait complete. 2024-09-16T07:28:32.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 --> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f148c1507f0 con 0x7f146807b460 2024-09-16T07:28:32.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc20aa00640 1 -- 172.21.15.114:0/1831954685 <== osd.5 v2:172.21.15.149:6802/2815936045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc214161840 con 0x7fc1f407b110 2024-09-16T07:28:32.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fc1f407b110 msgr2=0x7fc1f407d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fc1f407b110 0x7fc1f407d530 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f1482000640 1 -- 172.21.15.114:0/3027298756 <== osd.7 v2:172.21.15.149:6810/1130358838 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f148c1507f0 con 0x7f146807b460 2024-09-16T07:28:32.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc1f4072f10 msgr2=0x7fc1f40753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc1f4072f10 0x7fc1f40753d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc200000c10 tx=0x7fc200006b60 comp rx=0 tx=0).stop 2024-09-16T07:28:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2140c5a00 msgr2=0x7fc2140b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 --2- 172.21.15.114:0/1831954685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2140c5a00 0x7fc2140b0660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00fb90 tx=0x7fc20c00e6c0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213400640 1 -- 172.21.15.114:0/1831954685 reap_dead start 2024-09-16T07:28:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f146807b460 msgr2=0x7f146807d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148b200640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f146807b460 0x7f146807d880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 shutdown_connections 2024-09-16T07:28:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 >> 172.21.15.114:0/1831954685 conn(0x7fc2140b1600 msgr2=0x7fc214153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f14680732c0 msgr2=0x7f1468075780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148b200640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f14680732c0 0x7f1468075780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f147c0ac000 tx=0x7f147c0b1040 comp rx=0 tx=0).stop 2024-09-16T07:28:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f148c14d2a0 msgr2=0x7f148c0d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148b200640 1 --2- 172.21.15.114:0/3027298756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f148c14d2a0 0x7f148c0d0060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f147400d780 tx=0x7f147400dc40 comp rx=0 tx=0).stop 2024-09-16T07:28:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.297+0000 7f148a800640 1 -- 172.21.15.114:0/3027298756 reap_dead start 2024-09-16T07:28:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 shutdown_connections 2024-09-16T07:28:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 shutdown_connections 2024-09-16T07:28:32.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 >> 172.21.15.114:0/3027298756 conn(0x7f148c06dd30 msgr2=0x7f148c14fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7fc213e00640 1 -- 172.21.15.114:0/1831954685 wait complete. 2024-09-16T07:28:32.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a27600640 1 -- 172.21.15.114:0/1784350479 --> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f19fc002de0 con 0x7f1a0007b0c0 2024-09-16T07:28:32.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 shutdown_connections 2024-09-16T07:28:32.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f148b200640 1 -- 172.21.15.114:0/3027298756 wait complete. 2024-09-16T07:28:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a1cc00640 1 -- 172.21.15.114:0/1784350479 <== osd.6 v2:172.21.15.149:6826/1750215732 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f19fc002de0 con 0x7f1a0007b0c0 2024-09-16T07:28:32.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 -- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7f1a0007b0c0 msgr2=0x7f1a0007d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7f1a0007b0c0 0x7f1a0007d4e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 -- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1a00072ec0 msgr2=0x7f1a00075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1a00072ec0 0x7f1a00075380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a200b2f70 tx=0x7f1a0c006c50 comp rx=0 tx=0).stop 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 -- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a20071720 msgr2=0x7f1a200b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 --2- 172.21.15.114:0/1784350479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a20071720 0x7f1a200b5700 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a1401af40 tx=0x7f1a14004040 comp rx=0 tx=0).stop 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a25600640 1 -- 172.21.15.114:0/1784350479 reap_dead start 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 -- 172.21.15.114:0/1784350479 shutdown_connections 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 -- 172.21.15.114:0/1784350479 >> 172.21.15.114:0/1784350479 conn(0x7f1a200b2060 msgr2=0x7f1a20158140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.301+0000 7f1a12000640 1 -- 172.21.15.114:0/1784350479 shutdown_connections 2024-09-16T07:28:32.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.305+0000 7f1a12000640 1 -- 172.21.15.114:0/1784350479 wait complete. 2024-09-16T07:28:32.319 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-09-16T07:28:32.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:28:32.333 INFO:teuthology.orchestra.run.smithi114.stdout:60129542151 2024-09-16T07:28:32.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:28:32.343 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:32.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T07:28:32.344 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:32.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T07:28:32.347 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-09-16T07:28:32.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:28:32.348 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:32.349 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T07:28:32.350 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-09-16T07:28:32.351 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T07:28:32.355 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-09-16T07:28:32.355 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T07:28:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.557+0000 7f8cd6400640 1 -- 172.21.15.114:0/694985185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 msgr2=0x7f8cb400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.557+0000 7f8ccf400640 1 -- 172.21.15.114:0/694985185 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc004710 con 0x7f8cb4005240 2024-09-16T07:28:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.557+0000 7f8cd6400640 1 --2- 172.21.15.114:0/694985185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cb400b9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc006fc0 tx=0x7f8cbc01cef0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.557+0000 7f1953e00640 1 -- 172.21.15.114:0/593870749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19380043a0 msgr2=0x7f1938004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.557+0000 7f1953e00640 1 --2- 172.21.15.114:0/593870749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19380043a0 0x7f1938004850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19400098a0 tx=0x7f194001c6a0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f1953e00640 1 -- 172.21.15.114:0/593870749 shutdown_connections 2024-09-16T07:28:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f1953e00640 1 --2- 172.21.15.114:0/593870749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19380043a0 0x7f1938004850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f1953e00640 1 -- 172.21.15.114:0/593870749 >> 172.21.15.114:0/593870749 conn(0x7f19540b1600 msgr2=0x7f19540b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f8cd6400640 1 -- 172.21.15.114:0/694985185 shutdown_connections 2024-09-16T07:28:32.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f8cd6400640 1 --2- 172.21.15.114:0/694985185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cb400b9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f8cd6400640 1 -- 172.21.15.114:0/694985185 >> 172.21.15.114:0/694985185 conn(0x7f8cd00b1600 msgr2=0x7f8cd00b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f8cd6400640 1 -- 172.21.15.114:0/694985185 shutdown_connections 2024-09-16T07:28:32.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f8cd6400640 1 -- 172.21.15.114:0/694985185 wait complete. 2024-09-16T07:28:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f1953e00640 1 -- 172.21.15.114:0/593870749 shutdown_connections 2024-09-16T07:28:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f1953e00640 1 -- 172.21.15.114:0/593870749 wait complete. 2024-09-16T07:28:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f9524a00640 1 -- 172.21.15.114:0/3648028936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2440 msgr2=0x7f95200d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.561+0000 7f9524a00640 1 --2- 172.21.15.114:0/3648028936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2440 0x7f95200d2880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f950c009840 tx=0x7f950c01c840 comp rx=0 tx=0).stop 2024-09-16T07:28:32.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 Processor -- start 2024-09-16T07:28:32.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f9524a00640 1 -- 172.21.15.114:0/3648028936 shutdown_connections 2024-09-16T07:28:32.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 -- start start 2024-09-16T07:28:32.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 Processor -- start 2024-09-16T07:28:32.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f9524a00640 1 --2- 172.21.15.114:0/3648028936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2440 0x7f95200d2880 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 -- start start 2024-09-16T07:28:32.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f9524a00640 1 --2- 172.21.15.114:0/3648028936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2060 0x7f95200cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f9524a00640 1 -- 172.21.15.114:0/3648028936 >> 172.21.15.114:0/3648028936 conn(0x7f95200d3fe0 msgr2=0x7f95200d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f9524a00640 1 -- 172.21.15.114:0/3648028936 shutdown_connections 2024-09-16T07:28:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f9524a00640 1 -- 172.21.15.114:0/3648028936 wait complete. 2024-09-16T07:28:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19380043a0 0x7f195415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19541e9870 0x7f195415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cd00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1952a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19380043a0 0x7f195415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00c57f0 0x7f8cd01467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19540c6b00 0x7f19540c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd00cf9f0 0x7f8cd00cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0072800 con 0x7f8cd00cf9f0 2024-09-16T07:28:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f19540cd600 con 0x7f19380043a0 2024-09-16T07:28:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd0072680 con 0x7f8cb4005240 2024-09-16T07:28:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1952000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19541e9870 0x7f195415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1952000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19541e9870 0x7f195415c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53520/0 (socket says 172.21.15.114:53520) 2024-09-16T07:28:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1952000640 1 -- 172.21.15.114:0/705861051 learned_addr learned my addr 172.21.15.114:0/705861051 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 -- 172.21.15.114:0/705861051 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19540ca2e0 con 0x7f19540c6b00 2024-09-16T07:28:32.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f1953e00640 1 -- 172.21.15.114:0/705861051 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f19540cd780 con 0x7f19541e9870 2024-09-16T07:28:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.565+0000 7f8cd6400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd0072980 con 0x7f8cd00c57f0 2024-09-16T07:28:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cd00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8ccfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00c57f0 0x7f8cd01467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cd00ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:58636/0 (socket says 172.21.15.114:58636) 2024-09-16T07:28:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 -- 172.21.15.114:0/1739097953 learned_addr learned my addr 172.21.15.114:0/1739097953 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5a00640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd00cf9f0 0x7f8cd00cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f9524a00640 1 Processor -- start 2024-09-16T07:28:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1952000640 1 -- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19540c6b00 msgr2=0x7f19540c6f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:28:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1952000640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19540c6b00 0x7f19540c6f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1952000640 1 -- 172.21.15.114:0/705861051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19380043a0 msgr2=0x7f195415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1952000640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19380043a0 0x7f195415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1952000640 1 -- 172.21.15.114:0/705861051 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1954204820 con 0x7f19541e9870 2024-09-16T07:28:32.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1952000640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19541e9870 0x7f195415c0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f194001cb80 tx=0x7f1940005610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 -- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00c57f0 msgr2=0x7f8cd01467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00c57f0 0x7f8cd01467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 -- 172.21.15.114:0/1739097953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd00cf9f0 msgr2=0x7f8cd00cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd00cf9f0 0x7f8cd00cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 -- 172.21.15.114:0/1739097953 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd016b7b0 con 0x7f8cb4005240 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5a00640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd00cf9f0 0x7f8cd00cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f9524a00640 1 -- start start 2024-09-16T07:28:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f194aa00640 1 -- 172.21.15.114:0/705861051 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400ac050 con 0x7f19541e9870 2024-09-16T07:28:32.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cd5000640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cd00ccae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8003fc0 tx=0x7f8cc8001c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1953e00640 1 -- 172.21.15.114:0/705861051 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19541e8d90 con 0x7f19541e9870 2024-09-16T07:28:32.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f1953e00640 1 -- 172.21.15.114:0/705861051 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1954203aa0 con 0x7f19541e9870 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f194aa00640 1 -- 172.21.15.114:0/705861051 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19400a68a0 con 0x7f19541e9870 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f194aa00640 1 -- 172.21.15.114:0/705861051 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400a6cd0 con 0x7f19541e9870 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19280052a0 con 0x7f19541e9870 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cccc00640 1 -- 172.21.15.114:0/1739097953 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8015070 con 0x7f8cb4005240 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cccc00640 1 -- 172.21.15.114:0/1739097953 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cc800f960 con 0x7f8cb4005240 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.569+0000 7f8cccc00640 1 -- 172.21.15.114:0/1739097953 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800fdb0 con 0x7f8cb4005240 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd016ba90 con 0x7f8cb4005240 2024-09-16T07:28:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd016c050 con 0x7f8cb4005240 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f9524a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95200d09f0 0x7f95201582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f9524a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2060 0x7f9520155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f9524a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2440 0x7f95201558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f9524a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f952016baa0 con 0x7f95200d2060 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f9524a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f952016b920 con 0x7f95200d09f0 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f9524a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f952016bc20 con 0x7f95200d2440 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2440 0x7f95201558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2440 0x7f95201558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53536/0 (socket says 172.21.15.114:53536) 2024-09-16T07:28:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 -- 172.21.15.114:0/3164100461 learned_addr learned my addr 172.21.15.114:0/3164100461 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951de00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95200d09f0 0x7f95201582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951d400640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2060 0x7f9520155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd0159bd0 con 0x7f8cb4005240 2024-09-16T07:28:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 -- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95200d09f0 msgr2=0x7f95201582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95200d09f0 0x7f95201582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 -- 172.21.15.114:0/3164100461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2060 msgr2=0x7f9520155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2060 0x7f9520155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.573+0000 7f951e800640 1 -- 172.21.15.114:0/3164100461 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952014f590 con 0x7f95200d2440 2024-09-16T07:28:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f951e800640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2440 0x7f95201558d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f951000c3c0 tx=0x7f951000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f8cccc00640 1 -- 172.21.15.114:0/1739097953 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f8cc8011430 con 0x7f8cb4005240 2024-09-16T07:28:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f194aa00640 1 -- 172.21.15.114:0/705861051 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f19400af070 con 0x7f19541e9870 2024-09-16T07:28:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f8cccc00640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8cb0072ef0 0x7f8cb00753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f8cccc00640 1 -- 172.21.15.114:0/1739097953 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8cc8094b50 con 0x7f8cb4005240 2024-09-16T07:28:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f194aa00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1934072ec0 0x7f1934075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f8ccfe00640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8cb0072ef0 0x7f8cb00753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f194aa00640 1 -- 172.21.15.114:0/705861051 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f194012e5c0 con 0x7f19541e9870 2024-09-16T07:28:32.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.577+0000 7f1952a00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1934072ec0 0x7f1934075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f9516000640 1 -- 172.21.15.114:0/3164100461 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95100068a0 con 0x7f95200d2440 2024-09-16T07:28:32.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f9516000640 1 -- 172.21.15.114:0/3164100461 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9510006b50 con 0x7f95200d2440 2024-09-16T07:28:32.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f9516000640 1 -- 172.21.15.114:0/3164100461 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510007020 con 0x7f95200d2440 2024-09-16T07:28:32.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952014f870 con 0x7f95200d2440 2024-09-16T07:28:32.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9520158800 con 0x7f95200d2440 2024-09-16T07:28:32.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f1952a00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1934072ec0 0x7f1934075380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f194c00a530 tx=0x7f194c00c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f194aa00640 1 -- 172.21.15.114:0/705861051 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f19400c9020 con 0x7f19541e9870 2024-09-16T07:28:32.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95200cf660 con 0x7f95200d2440 2024-09-16T07:28:32.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f8ccfe00640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8cb0072ef0 0x7f8cb00753b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00c9da0 tx=0x7f8cc00091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.581+0000 7f8cccc00640 1 -- 172.21.15.114:0/1739097953 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8cc805f740 con 0x7f8cb4005240 2024-09-16T07:28:32.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.585+0000 7f9516000640 1 -- 172.21.15.114:0/3164100461 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f9510019020 con 0x7f95200d2440 2024-09-16T07:28:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.593+0000 7f9516000640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9500072fc0 0x7f9500075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.593+0000 7f9516000640 1 -- 172.21.15.114:0/3164100461 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9510093ee0 con 0x7f95200d2440 2024-09-16T07:28:32.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.593+0000 7f9516000640 1 -- 172.21.15.114:0/3164100461 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9510094300 con 0x7f95200d2440 2024-09-16T07:28:32.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.597+0000 7f951de00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9500072fc0 0x7f9500075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.597+0000 7f951de00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9500072fc0 0x7f9500075480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9518009fd0 tx=0x7f951800d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.605+0000 7fe8fd400640 1 -- 172.21.15.114:0/1089848278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 msgr2=0x7fe8f81653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.605+0000 7fe8fd400640 1 --2- 172.21.15.114:0/1089848278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f81653b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009bf0 tx=0x7fe8f001cb70 comp rx=0 tx=0).stop 2024-09-16T07:28:32.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.605+0000 7fe8fd400640 1 -- 172.21.15.114:0/1089848278 shutdown_connections 2024-09-16T07:28:32.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.605+0000 7fe8fd400640 1 --2- 172.21.15.114:0/1089848278 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f81653b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.605+0000 7fe8fd400640 1 -- 172.21.15.114:0/1089848278 >> 172.21.15.114:0/1089848278 conn(0x7fe8f80b18f0 msgr2=0x7fe8f80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.605+0000 7fe8fd400640 1 -- 172.21.15.114:0/1089848278 shutdown_connections 2024-09-16T07:28:32.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.605+0000 7fe8fd400640 1 -- 172.21.15.114:0/1089848278 wait complete. 2024-09-16T07:28:32.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 Processor -- start 2024-09-16T07:28:32.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 -- start start 2024-09-16T07:28:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f806f8c0 0x7fe8f8155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80cc740 0x7fe8f8142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f8168ac0 con 0x7fe8f80cc740 2024-09-16T07:28:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f8168940 con 0x7fe8f806f8c0 2024-09-16T07:28:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8fd400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f8168c40 con 0x7fe8f8162fc0 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80cc740 0x7fe8f8142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53560/0 (socket says 172.21.15.114:53560) 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 -- 172.21.15.114:0/3572162178 learned_addr learned my addr 172.21.15.114:0/3572162178 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f6800640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f806f8c0 0x7fe8f8155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 -- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f806f8c0 msgr2=0x7fe8f8155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f806f8c0 0x7fe8f8155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 -- 172.21.15.114:0/3572162178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80cc740 msgr2=0x7fe8f8142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80cc740 0x7fe8f8142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.609+0000 7fe8f7200640 1 -- 172.21.15.114:0/3572162178 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f809d990 con 0x7fe8f8162fc0 2024-09-16T07:28:32.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.613+0000 7fe8f7200640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f815c8d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8f001a7a0 tx=0x7fe8f00a5890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.613+0000 7fe8eea00640 1 -- 172.21.15.114:0/3572162178 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00bc030 con 0x7fe8f8162fc0 2024-09-16T07:28:32.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.613+0000 7fe8eea00640 1 -- 172.21.15.114:0/3572162178 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8f00ae8a0 con 0x7fe8f8162fc0 2024-09-16T07:28:32.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.613+0000 7fe8eea00640 1 -- 172.21.15.114:0/3572162178 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00b2040 con 0x7fe8f8162fc0 2024-09-16T07:28:32.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.613+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f809dc70 con 0x7fe8f8162fc0 2024-09-16T07:28:32.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.613+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f8155920 con 0x7fe8f8162fc0 2024-09-16T07:28:32.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.613+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d00052a0 con 0x7fe8f8162fc0 2024-09-16T07:28:32.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.617+0000 7fe8eea00640 1 -- 172.21.15.114:0/3572162178 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fe8f00bf070 con 0x7fe8f8162fc0 2024-09-16T07:28:32.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.617+0000 7fe8eea00640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe8d8072ef0 0x7fe8d80753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.617+0000 7fe8eea00640 1 -- 172.21.15.114:0/3572162178 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f0002020 con 0x7fe8f8162fc0 2024-09-16T07:28:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.617+0000 7fe8f6800640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe8d8072ef0 0x7fe8d80753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.621+0000 7fe8f6800640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe8d8072ef0 0x7fe8d80753b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8000f70 tx=0x7fe8e8007b10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.621+0000 7fe8eea00640 1 -- 172.21.15.114:0/3572162178 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe8f00c5020 con 0x7fe8f8162fc0 2024-09-16T07:28:32.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.645+0000 7fc00f200640 1 -- 172.21.15.114:0/915839218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cc5f0 msgr2=0x7fc00806e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.645+0000 7fc00f200640 1 --2- 172.21.15.114:0/915839218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cc5f0 0x7fc00806e8a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009840 tx=0x7fbff001c700 comp rx=0 tx=0).stop 2024-09-16T07:28:32.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 -- 172.21.15.114:0/2102561149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f815e1a0 msgr2=0x7fb6f8072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2102561149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f815e1a0 0x7fb6f8072c70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80ce950 tx=0x7fb6f001f560 comp rx=0 tx=0).stop 2024-09-16T07:28:32.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 -- 172.21.15.114:0/2102561149 shutdown_connections 2024-09-16T07:28:32.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2102561149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f815e1a0 0x7fb6f8072c70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2102561149 >> v2:172.21.15.114:3300/0 conn(0x7fb6f80ca640 0x7fb6f815dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 -- 172.21.15.114:0/2102561149 >> 172.21.15.114:0/2102561149 conn(0x7fb6f80cfff0 msgr2=0x7fb6f80d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fc00f200640 1 -- 172.21.15.114:0/915839218 shutdown_connections 2024-09-16T07:28:32.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fc00f200640 1 --2- 172.21.15.114:0/915839218 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0080cf300 0x7fc00806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fc00f200640 1 --2- 172.21.15.114:0/915839218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cc5f0 0x7fc00806e8a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fc00f200640 1 -- 172.21.15.114:0/915839218 >> 172.21.15.114:0/915839218 conn(0x7fc0080b18f0 msgr2=0x7fc0080b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 -- 172.21.15.114:0/2102561149 shutdown_connections 2024-09-16T07:28:32.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 -- 172.21.15.114:0/2102561149 wait complete. 2024-09-16T07:28:32.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fc00f200640 1 -- 172.21.15.114:0/915839218 shutdown_connections 2024-09-16T07:28:32.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fc00f200640 1 -- 172.21.15.114:0/915839218 wait complete. 2024-09-16T07:28:32.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 Processor -- start 2024-09-16T07:28:32.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.649+0000 7fb6fe400640 1 -- start start 2024-09-16T07:28:32.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 Processor -- start 2024-09-16T07:28:32.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f80ca640 0x7fb6f80b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f80cf470 0x7fb6f80c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f815e1a0 0x7fb6f80c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f80731b0 con 0x7fb6f815e1a0 2024-09-16T07:28:32.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f80cf130 con 0x7fb6f80ca640 2024-09-16T07:28:32.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f8073330 con 0x7fb6f80cf470 2024-09-16T07:28:32.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 -- start start 2024-09-16T07:28:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f80ca640 0x7fb6f80b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f80cf470 0x7fb6f80c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f80ca640 0x7fb6f80b5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:58674/0 (socket says 172.21.15.114:58674) 2024-09-16T07:28:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 -- 172.21.15.114:0/2390676985 learned_addr learned my addr 172.21.15.114:0/2390676985 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7e00640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f815e1a0 0x7fb6f80c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc008070420 0x7fc00813f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 -- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f80cf470 msgr2=0x7fb6f80c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f80cf470 0x7fb6f80c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 -- 172.21.15.114:0/2390676985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f815e1a0 msgr2=0x7fb6f80c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f815e1a0 0x7fb6f80c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 -- 172.21.15.114:0/2390676985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f8076340 con 0x7fb6f80ca640 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7e00640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f815e1a0 0x7fb6f80c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6f7400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f80ca640 0x7fb6f80b5880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800b4a0 tx=0x7fb6e800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cf300 0x7fc00813d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6ef400640 1 -- 172.21.15.114:0/2390676985 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8014070 con 0x7fb6f80ca640 2024-09-16T07:28:32.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc007e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc008070420 0x7fc00813f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00813eb40 0x7fc00809cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081686c0 con 0x7fc0080cf300 2024-09-16T07:28:32.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc008168540 con 0x7fc008070420 2024-09-16T07:28:32.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc008168840 con 0x7fc00813eb40 2024-09-16T07:28:32.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc007e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc008070420 0x7fc00813f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:58688/0 (socket says 172.21.15.114:58688) 2024-09-16T07:28:32.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00813eb40 0x7fc00809cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00813eb40 0x7fc00809cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53586/0 (socket says 172.21.15.114:53586) 2024-09-16T07:28:32.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fc00d200640 1 -- 172.21.15.114:0/3474007201 learned_addr learned my addr 172.21.15.114:0/3474007201 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc007400640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cf300 0x7fc00813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00d200640 1 -- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc008070420 msgr2=0x7fc00813f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00d200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc008070420 0x7fc00813f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00d200640 1 -- 172.21.15.114:0/3474007201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cf300 msgr2=0x7fc00813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00d200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cf300 0x7fc00813d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00d200640 1 -- 172.21.15.114:0/3474007201 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00815be80 con 0x7fc00813eb40 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00d200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00813eb40 0x7fc00809cbe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e940 tx=0x7fbff800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fbfffe00640 1 -- 172.21.15.114:0/3474007201 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8004d30 con 0x7fc00813eb40 2024-09-16T07:28:32.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fbfffe00640 1 -- 172.21.15.114:0/3474007201 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbff800cb20 con 0x7fc00813eb40 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fbfffe00640 1 -- 172.21.15.114:0/3474007201 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8005020 con 0x7fc00813eb40 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00815c160 con 0x7fc00813eb40 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.657+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00815c720 con 0x7fc00813eb40 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6ef400640 1 -- 172.21.15.114:0/2390676985 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6e8010720 con 0x7fb6f80ca640 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6ef400640 1 -- 172.21.15.114:0/2390676985 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8010b70 con 0x7fb6f80ca640 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f806f870 con 0x7fb6f80ca640 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.653+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f806fe30 con 0x7fb6f80ca640 2024-09-16T07:28:32.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fb6ef400640 1 -- 172.21.15.114:0/2390676985 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fb6e8017070 con 0x7fb6f80ca640 2024-09-16T07:28:32.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d00052a0 con 0x7fb6f80ca640 2024-09-16T07:28:32.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0080cebf0 con 0x7fc00813eb40 2024-09-16T07:28:32.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fbfffe00640 1 -- 172.21.15.114:0/3474007201 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fbff80051c0 con 0x7fc00813eb40 2024-09-16T07:28:32.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fbfffe00640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfe4072ed0 0x7fbfe4075390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fb6ef400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb6d8072ec0 0x7fb6d8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fb6ef400640 1 -- 172.21.15.114:0/2390676985 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb6e8093760 con 0x7fb6f80ca640 2024-09-16T07:28:32.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fbfffe00640 1 -- 172.21.15.114:0/3474007201 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbff8092cf0 con 0x7fc00813eb40 2024-09-16T07:28:32.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fc007e00640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfe4072ed0 0x7fbfe4075390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.661+0000 7fb6f6a00640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb6d8072ec0 0x7fb6d8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7fc007e00640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfe4072ed0 0x7fbfe4075390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc000001910 tx=0x7fc000001420 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 -- 172.21.15.114:0/2140745606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a815e1a0 msgr2=0x7f85a806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 --2- 172.21.15.114:0/2140745606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a815e1a0 0x7f85a806eb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009c80 tx=0x7f85a001f560 comp rx=0 tx=0).stop 2024-09-16T07:28:32.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7fb6f6a00640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb6d8072ec0 0x7fb6d8075380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009600 tx=0x7fb6e40091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 -- 172.21.15.114:0/2140745606 shutdown_connections 2024-09-16T07:28:32.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 --2- 172.21.15.114:0/2140745606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a815e1a0 0x7f85a806eb80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 --2- 172.21.15.114:0/2140745606 >> v2:172.21.15.149:3300/0 conn(0x7f85a806aba0 0x7f85a815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 -- 172.21.15.114:0/2140745606 >> 172.21.15.114:0/2140745606 conn(0x7f85a80cfff0 msgr2=0x7f85a80d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 -- 172.21.15.114:0/2140745606 shutdown_connections 2024-09-16T07:28:32.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7f85b0400640 1 -- 172.21.15.114:0/2140745606 wait complete. 2024-09-16T07:28:32.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.665+0000 7fb6ef400640 1 -- 172.21.15.114:0/2390676985 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb6e805e440 con 0x7fb6f80ca640 2024-09-16T07:28:32.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 Processor -- start 2024-09-16T07:28:32.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7fbfffe00640 1 -- 172.21.15.114:0/3474007201 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbff8016030 con 0x7fc00813eb40 2024-09-16T07:28:32.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 -- start start 2024-09-16T07:28:32.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85a806aba0 0x7f85a80b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a8159e70 0x7f85a815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a815e1a0 0x7f85a81551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f85a806f450 con 0x7f85a8159e70 2024-09-16T07:28:32.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85a806f2d0 con 0x7f85a815e1a0 2024-09-16T07:28:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85b0400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85a806f5d0 con 0x7f85a806aba0 2024-09-16T07:28:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85ae400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a815e1a0 0x7f85a81551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85ada00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85a806aba0 0x7f85a80b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85ada00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85a806aba0 0x7f85a80b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53596/0 (socket says 172.21.15.114:53596) 2024-09-16T07:28:32.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85ada00640 1 -- 172.21.15.114:0/3825719387 learned_addr learned my addr 172.21.15.114:0/3825719387 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.669+0000 7f85ad000640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a8159e70 0x7f85a815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85ae400640 1 -- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85a806aba0 msgr2=0x7f85a80b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85ae400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85a806aba0 0x7f85a80b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85ae400640 1 -- 172.21.15.114:0/3825719387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a8159e70 msgr2=0x7f85a815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85ae400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a8159e70 0x7f85a815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85ae400640 1 -- 172.21.15.114:0/3825719387 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a815b9c0 con 0x7f85a815e1a0 2024-09-16T07:28:32.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85ae400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a815e1a0 0x7f85a81551e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85a00b0000 tx=0x7f85a0005b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85a5600640 1 -- 172.21.15.114:0/3825719387 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a00b5070 con 0x7f85a815e1a0 2024-09-16T07:28:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85a5600640 1 -- 172.21.15.114:0/3825719387 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85a00bf070 con 0x7f85a815e1a0 2024-09-16T07:28:32.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85a5600640 1 -- 172.21.15.114:0/3825719387 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a00b0e50 con 0x7f85a815e1a0 2024-09-16T07:28:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.673+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a8073a00 con 0x7f85a815e1a0 2024-09-16T07:28:32.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.677+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a80b3c20 con 0x7f85a815e1a0 2024-09-16T07:28:32.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.677+0000 7f85a5600640 1 -- 172.21.15.114:0/3825719387 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f85a0004000 con 0x7f85a815e1a0 2024-09-16T07:28:32.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.681+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a815b720 con 0x7f85a815e1a0 2024-09-16T07:28:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.681+0000 7f85a5600640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85880730b0 0x7f8588075570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.681+0000 7f85a5600640 1 -- 172.21.15.114:0/3825719387 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f85a0131f20 con 0x7f85a815e1a0 2024-09-16T07:28:32.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.681+0000 7f85ada00640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85880730b0 0x7f8588075570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.681+0000 7f85ada00640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85880730b0 0x7f8588075570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85a815be10 tx=0x7f859400b480 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.685+0000 7f85a5600640 1 -- 172.21.15.114:0/3825719387 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f85a00190c0 con 0x7f85a815e1a0 2024-09-16T07:28:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 -- 172.21.15.114:0/3806029272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 msgr2=0x7f1f0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 --2- 172.21.15.114:0/3806029272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c06ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009c80 tx=0x7f1f0401cca0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 -- 172.21.15.114:0/3806029272 shutdown_connections 2024-09-16T07:28:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 --2- 172.21.15.114:0/3806029272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c06ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 --2- 172.21.15.114:0/3806029272 >> v2:172.21.15.114:3300/0 conn(0x7f1f0c0cc5f0 0x7f1f0c06e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 -- 172.21.15.114:0/3806029272 >> 172.21.15.114:0/3806029272 conn(0x7f1f0c0b18f0 msgr2=0x7f1f0c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 -- 172.21.15.114:0/3806029272 shutdown_connections 2024-09-16T07:28:32.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.697+0000 7f1f11e00640 1 -- 172.21.15.114:0/3806029272 wait complete. 2024-09-16T07:28:32.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.701+0000 7f1f11e00640 1 Processor -- start 2024-09-16T07:28:32.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.701+0000 7f1f11e00640 1 -- start start 2024-09-16T07:28:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.701+0000 7f1f11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f0c070420 0x7f1f0c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f11e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c0ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f11e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c0ae7e0 0x7f1f0c1ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c0ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c0ad940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53602/0 (socket says 172.21.15.114:53602) 2024-09-16T07:28:32.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 -- 172.21.15.114:0/2188732354 learned_addr learned my addr 172.21.15.114:0/2188732354 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:32.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c168670 con 0x7f1f0c070420 2024-09-16T07:28:32.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1684f0 con 0x7f1f0c0ae7e0 2024-09-16T07:28:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c1687f0 con 0x7f1f0c0cf300 2024-09-16T07:28:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f0b400640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c0ae7e0 0x7f1f0c1ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 -- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c0ae7e0 msgr2=0x7f1f0c1ed960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c0ae7e0 0x7f1f0c1ed960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 -- 172.21.15.114:0/2188732354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f0c070420 msgr2=0x7f1f0c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f0c070420 0x7f1f0c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0aec90 con 0x7f1f0c0cf300 2024-09-16T07:28:32.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f02000640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c0ad940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e9c0 tx=0x7f1ef400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f03e00640 1 -- 172.21.15.114:0/2188732354 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400cde0 con 0x7f1f0c0cf300 2024-09-16T07:28:32.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f03e00640 1 -- 172.21.15.114:0/2188732354 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ef4010520 con 0x7f1f0c0cf300 2024-09-16T07:28:32.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f03e00640 1 -- 172.21.15.114:0/2188732354 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4010970 con 0x7f1f0c0cf300 2024-09-16T07:28:32.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c0ae040 con 0x7f1f0c0cf300 2024-09-16T07:28:32.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.705+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c142290 con 0x7f1f0c0cf300 2024-09-16T07:28:32.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.709+0000 7f1f03e00640 1 -- 172.21.15.114:0/2188732354 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1ef401f020 con 0x7f1f0c0cf300 2024-09-16T07:28:32.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.713+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c0cebf0 con 0x7f1f0c0cf300 2024-09-16T07:28:32.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.713+0000 7f1f03e00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1ee8072ec0 0x7f1ee8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:32.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.713+0000 7f1f03e00640 1 -- 172.21.15.114:0/2188732354 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1ef40946f0 con 0x7f1f0c0cf300 2024-09-16T07:28:32.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.713+0000 7f1f0aa00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1ee8072ec0 0x7f1ee8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:32.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.713+0000 7f1f0aa00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1ee8072ec0 0x7f1ee8075380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1efc007fd0 tx=0x7f1efc007980 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:32.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.717+0000 7f1f03e00640 1 -- 172.21.15.114:0/2188732354 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1ef405f8a0 con 0x7f1f0c0cf300 2024-09-16T07:28:32.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.953+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1928005860 con 0x7f19541e9870 2024-09-16T07:28:32.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.953+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f95200a1ee0 con 0x7f95200d2440 2024-09-16T07:28:32.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.953+0000 7f9516000640 1 -- 172.21.15.114:0/3164100461 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f951005eb50 con 0x7f95200d2440 2024-09-16T07:28:32.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.953+0000 7f194aa00640 1 -- 172.21.15.114:0/705861051 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19400163b0 con 0x7f19541e9870 2024-09-16T07:28:32.957 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:32.958 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-09-16T07:28:32.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8cd016c3c0 con 0x7f8cb4005240 2024-09-16T07:28:32.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1934072ec0 msgr2=0x7f1934075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f8cccc00640 1 -- 172.21.15.114:0/1739097953 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8cc8064170 con 0x7f8cb4005240 2024-09-16T07:28:32.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9500072fc0 msgr2=0x7f9500075480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9500072fc0 0x7f9500075480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9518009fd0 tx=0x7f951800d040 comp rx=0 tx=0).stop 2024-09-16T07:28:32.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2440 msgr2=0x7f95201558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2440 0x7f95201558d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f951000c3c0 tx=0x7f951000c880 comp rx=0 tx=0).stop 2024-09-16T07:28:32.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1934072ec0 0x7f1934075380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f194c00a530 tx=0x7f194c00c040 comp rx=0 tx=0).stop 2024-09-16T07:28:32.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 shutdown_connections 2024-09-16T07:28:32.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9500072fc0 0x7f9500075480 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95200d2440 0x7f95201558d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95200d2060 0x7f9520155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 --2- 172.21.15.114:0/3164100461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95200d09f0 0x7f95201582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 >> 172.21.15.114:0/3164100461 conn(0x7f95200d3fe0 msgr2=0x7f95200cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 shutdown_connections 2024-09-16T07:28:32.963 INFO:teuthology.orchestra.run.smithi114.stdout:60129542150 2024-09-16T07:28:32.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f9524a00640 1 -- 172.21.15.114:0/3164100461 wait complete. 2024-09-16T07:28:32.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19541e9870 msgr2=0x7f195415c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19541e9870 0x7f195415c0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f194001cb80 tx=0x7f1940005610 comp rx=0 tx=0).stop 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 shutdown_connections 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1934072ec0 0x7f1934075380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19540c6b00 0x7f19540c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19541e9870 0x7f195415c0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 --2- 172.21.15.114:0/705861051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19380043a0 0x7f195415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 >> 172.21.15.114:0/705861051 conn(0x7f19540b1600 msgr2=0x7f19540c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 shutdown_connections 2024-09-16T07:28:32.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.957+0000 7f193fe00640 1 -- 172.21.15.114:0/705861051 wait complete. 2024-09-16T07:28:32.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8cb0072ef0 msgr2=0x7f8cb00753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8cb0072ef0 0x7f8cb00753b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00c9da0 tx=0x7f8cc00091e0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 msgr2=0x7f8cd00ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cd00ccae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8003fc0 tx=0x7f8cc8001c10 comp rx=0 tx=0).stop 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 shutdown_connections 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8cb0072ef0 0x7f8cb00753b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8cd00cf9f0 0x7f8cd00cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8cd00c57f0 0x7f8cd01467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 --2- 172.21.15.114:0/1739097953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb4005240 0x7f8cd00ccae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 >> 172.21.15.114:0/1739097953 conn(0x7f8cd00b1600 msgr2=0x7f8cd01621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 shutdown_connections 2024-09-16T07:28:32.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.961+0000 7f8cd6400640 1 -- 172.21.15.114:0/1739097953 wait complete. 2024-09-16T07:28:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.973+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe8d0005590 con 0x7fe8f8162fc0 2024-09-16T07:28:32.978 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-09-16T07:28:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.973+0000 7fe8eea00640 1 -- 172.21.15.114:0/3572162178 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8f00167f0 con 0x7fe8f8162fc0 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe8d8072ef0 msgr2=0x7fe8d80753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe8d8072ef0 0x7fe8d80753b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8000f70 tx=0x7fe8e8007b10 comp rx=0 tx=0).stop 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 msgr2=0x7fe8f815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f815c8d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8f001a7a0 tx=0x7fe8f00a5890 comp rx=0 tx=0).stop 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 shutdown_connections 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe8d8072ef0 0x7fe8d80753b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8f8162fc0 0x7fe8f815c8d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8f80cc740 0x7fe8f8142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 --2- 172.21.15.114:0/3572162178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8f806f8c0 0x7fe8f8155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:32.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 >> 172.21.15.114:0/3572162178 conn(0x7fe8f80b18f0 msgr2=0x7fe8f815e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:32.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 shutdown_connections 2024-09-16T07:28:32.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:32.977+0000 7fe8fd400640 1 -- 172.21.15.114:0/3572162178 wait complete. 2024-09-16T07:28:33.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-16T07:28:33.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2024-09-16T07:28:33.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2024-09-16T07:28:33.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-16T07:28:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.017+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb6d0005590 con 0x7fb6f80ca640 2024-09-16T07:28:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.017+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc00813e3e0 con 0x7fc00813eb40 2024-09-16T07:28:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.017+0000 7fb6ef400640 1 -- 172.21.15.114:0/2390676985 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6e8062e70 con 0x7fb6f80ca640 2024-09-16T07:28:33.021 INFO:teuthology.orchestra.run.smithi114.stdout:64424509445 2024-09-16T07:28:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.017+0000 7fbfffe00640 1 -- 172.21.15.114:0/3474007201 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbff8063ce0 con 0x7fc00813eb40 2024-09-16T07:28:33.021 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-09-16T07:28:33.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb6d8072ec0 msgr2=0x7fb6d8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb6d8072ec0 0x7fb6d8075380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009600 tx=0x7fb6e40091e0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f80ca640 msgr2=0x7fb6f80b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f80ca640 0x7fb6f80b5880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb6e800b4a0 tx=0x7fb6e800b960 comp rx=0 tx=0).stop 2024-09-16T07:28:33.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 shutdown_connections 2024-09-16T07:28:33.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb6d8072ec0 0x7fb6d8075380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f815e1a0 0x7fb6f80c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f80cf470 0x7fb6f80c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 --2- 172.21.15.114:0/2390676985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f80ca640 0x7fb6f80b5880 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 >> 172.21.15.114:0/2390676985 conn(0x7fb6f80cfff0 msgr2=0x7fb6f8159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:33.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 shutdown_connections 2024-09-16T07:28:33.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fb6fe400640 1 -- 172.21.15.114:0/2390676985 wait complete. 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfe4072ed0 msgr2=0x7fbfe4075390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfe4072ed0 0x7fbfe4075390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc000001910 tx=0x7fc000001420 comp rx=0 tx=0).stop 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00813eb40 msgr2=0x7fc00809cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00813eb40 0x7fc00809cbe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbff800e940 tx=0x7fbff800ee00 comp rx=0 tx=0).stop 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 shutdown_connections 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfe4072ed0 0x7fbfe4075390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00813eb40 0x7fc00809cbe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0080cf300 0x7fc00813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 --2- 172.21.15.114:0/3474007201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc008070420 0x7fc00813f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 >> 172.21.15.114:0/3474007201 conn(0x7fc0080b18f0 msgr2=0x7fc0080aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 shutdown_connections 2024-09-16T07:28:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.021+0000 7fc00f200640 1 -- 172.21.15.114:0/3474007201 wait complete. 2024-09-16T07:28:33.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.037+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1f0c13cf00 con 0x7f1f0c0cf300 2024-09-16T07:28:33.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.037+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f85a815e650 con 0x7f85a815e1a0 2024-09-16T07:28:33.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.037+0000 7f1f03e00640 1 -- 172.21.15.114:0/2188732354 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ef405f1a0 con 0x7f1f0c0cf300 2024-09-16T07:28:33.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.037+0000 7f85a5600640 1 -- 172.21.15.114:0/3825719387 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85a00fd1e0 con 0x7f85a815e1a0 2024-09-16T07:28:33.045 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-09-16T07:28:33.045 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1ee8072ec0 msgr2=0x7f1ee8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1ee8072ec0 0x7f1ee8075380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1efc007fd0 tx=0x7f1efc007980 comp rx=0 tx=0).stop 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 msgr2=0x7f1f0c0ad940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c0ad940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400e9c0 tx=0x7f1ef400ee80 comp rx=0 tx=0).stop 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 shutdown_connections 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1ee8072ec0 0x7f1ee8075380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c0ae7e0 0x7f1f0c1ed960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1f0c0cf300 0x7f1f0c0ad940 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 --2- 172.21.15.114:0/2188732354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f0c070420 0x7f1f0c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 >> 172.21.15.114:0/2188732354 conn(0x7f1f0c0b18f0 msgr2=0x7f1f0c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 shutdown_connections 2024-09-16T07:28:33.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f1f11e00640 1 -- 172.21.15.114:0/2188732354 wait complete. 2024-09-16T07:28:33.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85880730b0 msgr2=0x7f8588075570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85880730b0 0x7f8588075570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85a815be10 tx=0x7f859400b480 comp rx=0 tx=0).stop 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a815e1a0 msgr2=0x7f85a81551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a815e1a0 0x7f85a81551e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85a00b0000 tx=0x7f85a0005b10 comp rx=0 tx=0).stop 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 shutdown_connections 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85880730b0 0x7f8588075570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85a815e1a0 0x7f85a81551e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85a8159e70 0x7f85a815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 --2- 172.21.15.114:0/3825719387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85a806aba0 0x7f85a80b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 >> 172.21.15.114:0/3825719387 conn(0x7f85a80cfff0 msgr2=0x7f85a8072c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 shutdown_connections 2024-09-16T07:28:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:33.041+0000 7f85b0400640 1 -- 172.21.15.114:0/3825719387 wait complete. 2024-09-16T07:28:33.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-09-16T07:28:33.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-09-16T07:28:33.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-09-16T07:28:33.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-09-16T07:28:34.002 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:28:34.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T07:28:34.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:28:34.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T07:28:34.051 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:28:34.055 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T07:28:34.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T07:28:34.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T07:28:34.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 -- 172.21.15.114:0/289361700 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 msgr2=0x7fa858162230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 --2- 172.21.15.114:0/289361700 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 0x7fa858162230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa844009840 tx=0x7fa84401c840 comp rx=0 tx=0).stop 2024-09-16T07:28:34.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 -- 172.21.15.114:0/289361700 shutdown_connections 2024-09-16T07:28:34.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 --2- 172.21.15.114:0/289361700 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 0x7fa858162230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 --2- 172.21.15.114:0/289361700 >> v2:172.21.15.149:3300/0 conn(0x7fa85806ea00 0x7fa8580b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 -- 172.21.15.114:0/289361700 >> 172.21.15.114:0/289361700 conn(0x7fa8580b18f0 msgr2=0x7fa8580b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 -- 172.21.15.114:0/289361700 shutdown_connections 2024-09-16T07:28:34.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.220+0000 7fa85ca00640 1 -- 172.21.15.114:0/289361700 wait complete. 2024-09-16T07:28:34.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.224+0000 7fa85ca00640 1 Processor -- start 2024-09-16T07:28:34.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.224+0000 7fa85ca00640 1 -- start start 2024-09-16T07:28:34.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa85ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa85806ea00 0x7fa85814f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa85ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85806ede0 0x7fa858158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa85ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 0x7fa858073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa85806ea00 0x7fa85814f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa85806ea00 0x7fa85814f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44364/0 (socket says 172.21.15.114:44364) 2024-09-16T07:28:34.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa85ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa8580ae3f0 con 0x7fa85806ea00 2024-09-16T07:28:34.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa85ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8580ae270 con 0x7fa85806ede0 2024-09-16T07:28:34.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa85ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa85815fc50 con 0x7fa8580b3ed0 2024-09-16T07:28:34.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855e00640 1 -- 172.21.15.114:0/135608372 learned_addr learned my addr 172.21.15.114:0/135608372 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855400640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85806ede0 0x7fa858158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa856800640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 0x7fa858073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fc595600640 1 -- 172.21.15.114:0/228409406 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5900a9e60 con 0x7fc598070770 2024-09-16T07:28:34.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855400640 1 -- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 msgr2=0x7fa858073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855400640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 0x7fa858073360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855400640 1 -- 172.21.15.114:0/135608372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa85806ea00 msgr2=0x7fa85814f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855400640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa85806ea00 0x7fa85814f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa855400640 1 -- 172.21.15.114:0/135608372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8581ff870 con 0x7fa85806ede0 2024-09-16T07:28:34.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.228+0000 7fa856800640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 0x7fa858073360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:34.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fa855400640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85806ede0 0x7fa858158d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c410 tx=0x7fa84800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fc597e00640 1 -- 172.21.15.114:0/228409406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598070770 msgr2=0x7fc598072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fc597e00640 1 --2- 172.21.15.114:0/228409406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598070770 0x7fc598072680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc5980cee80 tx=0x7fc590020ba0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fa84e000640 1 -- 172.21.15.114:0/135608372 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848017070 con 0x7fa85806ede0 2024-09-16T07:28:34.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fa84e000640 1 -- 172.21.15.114:0/135608372 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa848003600 con 0x7fa85806ede0 2024-09-16T07:28:34.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8581ffb50 con 0x7fa85806ede0 2024-09-16T07:28:34.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa858200110 con 0x7fa85806ede0 2024-09-16T07:28:34.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fa84e000640 1 -- 172.21.15.114:0/135608372 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848017070 con 0x7fa85806ede0 2024-09-16T07:28:34.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fc597e00640 1 -- 172.21.15.114:0/228409406 shutdown_connections 2024-09-16T07:28:34.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fc597e00640 1 --2- 172.21.15.114:0/228409406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598070770 0x7fc598072680 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fc597e00640 1 -- 172.21.15.114:0/228409406 >> 172.21.15.114:0/228409406 conn(0x7fc5980cfa30 msgr2=0x7fc5980cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8580b3990 con 0x7fa85806ede0 2024-09-16T07:28:34.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.232+0000 7fc597e00640 1 -- 172.21.15.114:0/228409406 shutdown_connections 2024-09-16T07:28:34.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.236+0000 7fc597e00640 1 -- 172.21.15.114:0/228409406 wait complete. 2024-09-16T07:28:34.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.240+0000 7fc597e00640 1 Processor -- start 2024-09-16T07:28:34.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.236+0000 7fa84e000640 1 -- 172.21.15.114:0/135608372 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fa84801a070 con 0x7fa85806ede0 2024-09-16T07:28:34.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.240+0000 7fa84e000640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8380732c0 0x7fa838075780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.240+0000 7fa84e000640 1 -- 172.21.15.114:0/135608372 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa8480052e0 con 0x7fa85806ede0 2024-09-16T07:28:34.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.240+0000 7fa84e000640 1 -- 172.21.15.114:0/135608372 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa84805dc50 con 0x7fa85806ede0 2024-09-16T07:28:34.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fa855e00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8380732c0 0x7fa838075780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fa855e00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8380732c0 0x7fa838075780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa850009fd0 tx=0x7fa85000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.240+0000 7fc597e00640 1 -- start start 2024-09-16T07:28:34.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc597e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc598070770 0x7fc5981fb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc597e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5980cf570 0x7fc5980c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc597e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598159cc0 0x7fc5981fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc597e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc59806f280 con 0x7fc598159cc0 2024-09-16T07:28:34.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc597e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc598074890 con 0x7fc5980cf570 2024-09-16T07:28:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc597e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc59806f400 con 0x7fc598070770 2024-09-16T07:28:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc597400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598159cc0 0x7fc5981fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc598070770 0x7fc5981fb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5980cf570 0x7fc5980c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc598070770 0x7fc5981fb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:38190/0 (socket says 172.21.15.114:38190) 2024-09-16T07:28:34.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 -- 172.21.15.114:0/648100931 learned_addr learned my addr 172.21.15.114:0/648100931 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 -- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5980cf570 msgr2=0x7fc5980c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5980cf570 0x7fc5980c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 -- 172.21.15.114:0/648100931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598159cc0 msgr2=0x7fc5981fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598159cc0 0x7fc5981fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596a00640 1 -- 172.21.15.114:0/648100931 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5980b56d0 con 0x7fc598070770 2024-09-16T07:28:34.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.244+0000 7fc596000640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5980cf570 0x7fc5980c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:34.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.248+0000 7fc596a00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc598070770 0x7fc5981fb7c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc59001f250 tx=0x7fc5900b1ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.252+0000 7fc58ea00640 1 -- 172.21.15.114:0/648100931 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59000d6d0 con 0x7fc598070770 2024-09-16T07:28:34.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.252+0000 7fc58ea00640 1 -- 172.21.15.114:0/648100931 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc590004a50 con 0x7fc598070770 2024-09-16T07:28:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.252+0000 7fc58ea00640 1 -- 172.21.15.114:0/648100931 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590005030 con 0x7fc598070770 2024-09-16T07:28:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.252+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5981fbe20 con 0x7fc598070770 2024-09-16T07:28:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.252+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5981fc3e0 con 0x7fc598070770 2024-09-16T07:28:34.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.252+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5700052a0 con 0x7fc598070770 2024-09-16T07:28:34.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.256+0000 7fc58ea00640 1 -- 172.21.15.114:0/648100931 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fc5900b8020 con 0x7fc598070770 2024-09-16T07:28:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.256+0000 7fc58ea00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc578072ec0 0x7fc578075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.256+0000 7fc58ea00640 1 -- 172.21.15.114:0/648100931 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc59012e6e0 con 0x7fc598070770 2024-09-16T07:28:34.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.256+0000 7fc596000640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc578072ec0 0x7fc578075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.256+0000 7fc596000640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc578072ec0 0x7fc578075380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc584007fd0 tx=0x7fc584009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.260+0000 7fc58ea00640 1 -- 172.21.15.114:0/648100931 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc5900c1030 con 0x7fc598070770 2024-09-16T07:28:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 -- 172.21.15.114:0/4128403915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c80b34e0 msgr2=0x7f02c80cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 --2- 172.21.15.114:0/4128403915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c80b34e0 0x7f02c80cfd40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009cb0 tx=0x7f02c001ccb0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 -- 172.21.15.114:0/4128403915 shutdown_connections 2024-09-16T07:28:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 --2- 172.21.15.114:0/4128403915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c815aa60 0x7f02c806e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 --2- 172.21.15.114:0/4128403915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c80b34e0 0x7f02c80cfd40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 -- 172.21.15.114:0/4128403915 >> 172.21.15.114:0/4128403915 conn(0x7f02c806cdf0 msgr2=0x7f02c806d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 -- 172.21.15.114:0/4128403915 shutdown_connections 2024-09-16T07:28:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.276+0000 7f02ce600640 1 -- 172.21.15.114:0/4128403915 wait complete. 2024-09-16T07:28:34.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.280+0000 7f02ce600640 1 Processor -- start 2024-09-16T07:28:34.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.280+0000 7f02ce600640 1 -- start start 2024-09-16T07:28:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02ce600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c80d0280 0x7f02c813a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02ce600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c815aa60 0x7f02c813dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02ce600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c81643d0 0x7f02c815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c80d0280 0x7f02c813a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c80d0280 0x7f02c813a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:38212/0 (socket says 172.21.15.114:38212) 2024-09-16T07:28:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02ce600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8166cf0 con 0x7f02c81643d0 2024-09-16T07:28:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02ce600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8166b70 con 0x7f02c815aa60 2024-09-16T07:28:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02ce600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f02c8166e70 con 0x7f02c80d0280 2024-09-16T07:28:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c815aa60 0x7f02c813dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c815aa60 0x7f02c813dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:48736/0 (socket says 172.21.15.114:48736) 2024-09-16T07:28:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c6a00640 1 -- 172.21.15.114:0/253042656 learned_addr learned my addr 172.21.15.114:0/253042656 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7e00640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c81643d0 0x7f02c815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7400640 1 -- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c815aa60 msgr2=0x7f02c813dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7400640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c815aa60 0x7f02c813dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7400640 1 -- 172.21.15.114:0/253042656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c81643d0 msgr2=0x7f02c815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7400640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c81643d0 0x7f02c815d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7400640 1 -- 172.21.15.114:0/253042656 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c8163590 con 0x7f02c80d0280 2024-09-16T07:28:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c7e00640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c81643d0 0x7f02c815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:34.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.284+0000 7f02c6a00640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c815aa60 0x7f02c813dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:34.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.288+0000 7f02c7400640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c80d0280 0x7f02c813a820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02c8070170 tx=0x7f02c0009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.288+0000 7f02bf400640 1 -- 172.21.15.114:0/253042656 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00bb070 con 0x7f02c80d0280 2024-09-16T07:28:34.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.288+0000 7f02bf400640 1 -- 172.21.15.114:0/253042656 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02c0004d60 con 0x7f02c80d0280 2024-09-16T07:28:34.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.288+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c8163870 con 0x7f02c80d0280 2024-09-16T07:28:34.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.288+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c813d460 con 0x7f02c80d0280 2024-09-16T07:28:34.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.288+0000 7f02bf400640 1 -- 172.21.15.114:0/253042656 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00b2040 con 0x7f02c80d0280 2024-09-16T07:28:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.288+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c80707a0 con 0x7f02c80d0280 2024-09-16T07:28:34.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.292+0000 7f02bf400640 1 -- 172.21.15.114:0/253042656 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f02c00be070 con 0x7f02c80d0280 2024-09-16T07:28:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.296+0000 7f02bf400640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f02a8072fc0 0x7f02a8075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.296+0000 7f02c6a00640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f02a8072fc0 0x7f02a8075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.296+0000 7f02bf400640 1 -- 172.21.15.114:0/253042656 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f02c012de50 con 0x7f02c80d0280 2024-09-16T07:28:34.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.296+0000 7f02c6a00640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f02a8072fc0 0x7f02a8075480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02c8160330 tx=0x7f02b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.296+0000 7f02bf400640 1 -- 172.21.15.114:0/253042656 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f02c00c5020 con 0x7f02c80d0280 2024-09-16T07:28:34.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.304+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1414650972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80332b0 msgr2=0x7f5aa8007780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.304+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1414650972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80332b0 0x7f5aa8007780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8010bd0 tx=0x7f5a9c01c6b0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.308+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1414650972 shutdown_connections 2024-09-16T07:28:34.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.308+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1414650972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80332b0 0x7f5aa8007780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.308+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1414650972 >> v2:172.21.15.149:3300/0 conn(0x7f5aa80e69b0 0x7f5aa80e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.308+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1414650972 >> 172.21.15.114:0/1414650972 conn(0x7f5aa8056720 msgr2=0x7f5aa8056b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.308+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1414650972 shutdown_connections 2024-09-16T07:28:34.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.308+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1414650972 wait complete. 2024-09-16T07:28:34.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.312+0000 7f5ab5e00640 1 Processor -- start 2024-09-16T07:28:34.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5e00640 1 -- start start 2024-09-16T07:28:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa80332b0 0x7f5aa80dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80e69b0 0x7f5aa80da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa80e72d0 0x7f5aa8039550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa8037140 con 0x7f5aa80e69b0 2024-09-16T07:28:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa8036fc0 con 0x7f5aa80e72d0 2024-09-16T07:28:34.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa80372c0 con 0x7f5aa80332b0 2024-09-16T07:28:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5aafe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80e69b0 0x7f5aa80da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa80e72d0 0x7f5aa8039550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa80e72d0 0x7f5aa8039550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:48782/0 (socket says 172.21.15.114:48782) 2024-09-16T07:28:34.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 -- 172.21.15.114:0/1484188293 learned_addr learned my addr 172.21.15.114:0/1484188293 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab4a00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa80332b0 0x7f5aa80dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 -- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa80332b0 msgr2=0x7f5aa80dfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa80332b0 0x7f5aa80dfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 -- 172.21.15.114:0/1484188293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80e69b0 msgr2=0x7f5aa80da8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80e69b0 0x7f5aa80da8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5ab5400640 1 -- 172.21.15.114:0/1484188293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa8049f40 con 0x7f5aa80e72d0 2024-09-16T07:28:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.316+0000 7f5aafe00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80e69b0 0x7f5aa80da8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f5ab5400640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa80e72d0 0x7f5aa8039550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0052890 tx=0x7f5ab006aef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f5aacc00640 1 -- 172.21.15.114:0/1484188293 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0090070 con 0x7f5aa80e72d0 2024-09-16T07:28:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f5aacc00640 1 -- 172.21.15.114:0/1484188293 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ab0074700 con 0x7f5aa80e72d0 2024-09-16T07:28:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f33bdc00640 1 -- 172.21.15.114:0/1183372461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0036250 msgr2=0x7f33b00e70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f33bdc00640 1 --2- 172.21.15.114:0/1183372461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0036250 0x7f33b00e70f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33a80098f0 tx=0x7f33a801d2b0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa8050ea0 con 0x7f5aa80e72d0 2024-09-16T07:28:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa8034840 con 0x7f5aa80e72d0 2024-09-16T07:28:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f33bdc00640 1 -- 172.21.15.114:0/1183372461 shutdown_connections 2024-09-16T07:28:34.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f33bdc00640 1 --2- 172.21.15.114:0/1183372461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0036250 0x7f33b00e70f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f33bdc00640 1 -- 172.21.15.114:0/1183372461 >> 172.21.15.114:0/1183372461 conn(0x7f33b001d780 msgr2=0x7f33b0054570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f5aacc00640 1 -- 172.21.15.114:0/1484188293 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0074b90 con 0x7f5aa80e72d0 2024-09-16T07:28:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f33bdc00640 1 -- 172.21.15.114:0/1183372461 shutdown_connections 2024-09-16T07:28:34.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f33bdc00640 1 -- 172.21.15.114:0/1183372461 wait complete. 2024-09-16T07:28:34.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.320+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8c0052a0 con 0x7f5aa80e72d0 2024-09-16T07:28:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7fc6b9800640 1 -- 172.21.15.114:0/969154034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c004810 msgr2=0x7fc69c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7fc6b9800640 1 --2- 172.21.15.114:0/969154034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c004810 0x7fc69c004c90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009b30 tx=0x7fc6a001d200 comp rx=0 tx=0).stop 2024-09-16T07:28:34.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f33bdc00640 1 Processor -- start 2024-09-16T07:28:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7fc6b9800640 1 -- 172.21.15.114:0/969154034 shutdown_connections 2024-09-16T07:28:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f33bdc00640 1 -- start start 2024-09-16T07:28:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7fc6b9800640 1 --2- 172.21.15.114:0/969154034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc69c004810 0x7fc69c004c90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7fc6b9800640 1 -- 172.21.15.114:0/969154034 >> 172.21.15.114:0/969154034 conn(0x7fc6ac054570 msgr2=0x7fc6ac054980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f5aacc00640 1 -- 172.21.15.114:0/1484188293 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5ab0093070 con 0x7f5aa80e72d0 2024-09-16T07:28:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7fc6b9800640 1 -- 172.21.15.114:0/969154034 shutdown_connections 2024-09-16T07:28:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7fc6b9800640 1 -- 172.21.15.114:0/969154034 wait complete. 2024-09-16T07:28:34.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f33bdc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b0036250 0x7f33b00e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f33bdc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33b0036630 0x7f33b004a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f5aacc00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5a90072f90 0x7f5a90075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b0036250 0x7f33b00e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.324+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b0036250 0x7f33b00e57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:48790/0 (socket says 172.21.15.114:48790) 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6a00640 1 -- 172.21.15.114:0/2966527764 learned_addr learned my addr 172.21.15.114:0/2966527764 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6000640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33b0036630 0x7f33b004a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33bdc00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0055070 0x7f33b004f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00e2850 con 0x7f33b0055070 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00e26d0 con 0x7f33b0036250 2024-09-16T07:28:34.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f33b00e29d0 con 0x7f33b0036630 2024-09-16T07:28:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f5aacc00640 1 -- 172.21.15.114:0/1484188293 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5ab010edc0 con 0x7f5aa80e72d0 2024-09-16T07:28:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f5ab4a00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5a90072f90 0x7f5a90075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b7400640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0055070 0x7f33b004f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f5ab4a00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5a90072f90 0x7f5a90075450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80db340 tx=0x7f5aa401a1f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7fc6b9800640 1 Processor -- start 2024-09-16T07:28:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6a00640 1 -- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33b0036630 msgr2=0x7f33b004a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6a00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33b0036630 0x7f33b004a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6a00640 1 -- 172.21.15.114:0/2966527764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0055070 msgr2=0x7f33b004f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6a00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0055070 0x7f33b004f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6a00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b00e5d30 con 0x7f33b0036250 2024-09-16T07:28:34.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7fc6b9800640 1 -- start start 2024-09-16T07:28:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f5aacc00640 1 -- 172.21.15.114:0/1484188293 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5ab00d9a30 con 0x7f5aa80e72d0 2024-09-16T07:28:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33b6a00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b0036250 0x7f33b00e57f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009840 tx=0x7f33a8005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33aea00640 1 -- 172.21.15.114:0/2966527764 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a80b2040 con 0x7f33b0036250 2024-09-16T07:28:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33aea00640 1 -- 172.21.15.114:0/2966527764 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33a80054f0 con 0x7f33b0036250 2024-09-16T07:28:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33aea00640 1 -- 172.21.15.114:0/2966527764 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8004290 con 0x7f33b0036250 2024-09-16T07:28:34.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7fc6b9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc69c004810 0x7fc6ac04de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7fc6b9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac04a920 0x7fc6ac04ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac01e0f0 0x7fc6ac01e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b9800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac00a0f0 con 0x7fc69c004810 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac009f70 con 0x7fc6ac04a920 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac00a270 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac04a920 0x7fc6ac04ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.328+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b00f1e70 con 0x7f33b0036250 2024-09-16T07:28:34.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b00f2430 con 0x7f33b0036250 2024-09-16T07:28:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac04a920 0x7fc6ac04ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:48802/0 (socket says 172.21.15.114:48802) 2024-09-16T07:28:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b3400640 1 -- 172.21.15.114:0/2133239717 learned_addr learned my addr 172.21.15.114:0/2133239717 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b8e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac01e0f0 0x7fc6ac01e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b3e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc69c004810 0x7fc6ac04de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b8e00640 1 -- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac04a920 msgr2=0x7fc6ac04ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b8e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac04a920 0x7fc6ac04ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b8e00640 1 -- 172.21.15.114:0/2133239717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc69c004810 msgr2=0x7fc6ac04de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b8e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc69c004810 0x7fc6ac04de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b8e00640 1 -- 172.21.15.114:0/2133239717 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac180ef0 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b8e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac01e0f0 0x7fc6ac01e570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6b406b800 tx=0x7fc6b4069d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6a7e00640 1 -- 172.21.15.114:0/2133239717 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4098070 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6a7e00640 1 -- 172.21.15.114:0/2133239717 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6b4073560 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6a7e00640 1 -- 172.21.15.114:0/2133239717 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40739b0 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac1811d0 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac181790 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.332+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b00e2ea0 con 0x7f33b0036250 2024-09-16T07:28:34.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac00a7d0 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7f33aea00640 1 -- 172.21.15.114:0/2966527764 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f33a80046d0 con 0x7f33b0036250 2024-09-16T07:28:34.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7f33aea00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3398072f90 0x7f3398075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7f33aea00640 1 -- 172.21.15.114:0/2966527764 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f33a812df90 con 0x7f33b0036250 2024-09-16T07:28:34.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7f33b6000640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3398072f90 0x7f3398075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7fc6a7e00640 1 -- 172.21.15.114:0/2133239717 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fc6b409b070 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7fc6a7e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc694072f90 0x7fc694075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.336+0000 7f33b6000640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3398072f90 0x7f3398075450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33b00de7f0 tx=0x7f33a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.340+0000 7fc6a7e00640 1 -- 172.21.15.114:0/2133239717 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc6b410f2d0 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.340+0000 7fc6b3e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc694072f90 0x7fc694075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.340+0000 7f33aea00640 1 -- 172.21.15.114:0/2966527764 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f33a80164d0 con 0x7f33b0036250 2024-09-16T07:28:34.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.340+0000 7fc6b3e00640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc694072f90 0x7fc694075450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80036b0 tx=0x7fc6a8003620 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.348+0000 7fc6a7e00640 1 -- 172.21.15.114:0/2133239717 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc6b40d9eb0 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7fb776600640 1 -- 172.21.15.114:0/843485146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb77015d240 msgr2=0x7fb7700ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7fb76f400640 1 -- 172.21.15.114:0/843485146 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760008d60 con 0x7fb77015d240 2024-09-16T07:28:34.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7fb776600640 1 --2- 172.21.15.114:0/843485146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb77015d240 0x7fb7700ca080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb7600074e0 tx=0x7fb76001d590 comp rx=0 tx=0).stop 2024-09-16T07:28:34.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7f04fb200640 1 -- 172.21.15.114:0/2473547440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04e0003a10 msgr2=0x7f04e0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7f04fb200640 1 --2- 172.21.15.114:0/2473547440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04e0003a10 0x7f04e0003df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0098a0 tx=0x7f04ec01c6b0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7fb776600640 1 -- 172.21.15.114:0/843485146 shutdown_connections 2024-09-16T07:28:34.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7fb776600640 1 --2- 172.21.15.114:0/843485146 >> v2:172.21.15.114:3300/0 conn(0x7fb7700ced50 0x7fb7700cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7fb776600640 1 --2- 172.21.15.114:0/843485146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb77015d240 0x7fb7700ca080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.372+0000 7fb776600640 1 -- 172.21.15.114:0/843485146 >> 172.21.15.114:0/843485146 conn(0x7fb7700b1600 msgr2=0x7fb7700b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7fb776600640 1 -- 172.21.15.114:0/843485146 shutdown_connections 2024-09-16T07:28:34.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7fb776600640 1 -- 172.21.15.114:0/843485146 wait complete. 2024-09-16T07:28:34.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7f04fb200640 1 -- 172.21.15.114:0/2473547440 shutdown_connections 2024-09-16T07:28:34.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7f04fb200640 1 --2- 172.21.15.114:0/2473547440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04e0003a10 0x7f04e0003df0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7f04fb200640 1 -- 172.21.15.114:0/2473547440 >> 172.21.15.114:0/2473547440 conn(0x7f04fc0b1600 msgr2=0x7f04fc0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7f04fb200640 1 -- 172.21.15.114:0/2473547440 shutdown_connections 2024-09-16T07:28:34.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7f04fb200640 1 -- 172.21.15.114:0/2473547440 wait complete. 2024-09-16T07:28:34.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7fb776600640 1 Processor -- start 2024-09-16T07:28:34.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.376+0000 7fb776600640 1 -- start start 2024-09-16T07:28:34.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 Processor -- start 2024-09-16T07:28:34.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 -- start start 2024-09-16T07:28:34.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb776600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7700cdb40 0x7fb770152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb776600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7700ced50 0x7fb77015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb776600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77015d240 0x7fb77015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb776600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb770166ee0 con 0x7fb7700ced50 2024-09-16T07:28:34.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb776600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb770166d60 con 0x7fb77015d240 2024-09-16T07:28:34.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb776600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb770167060 con 0x7fb7700cdb40 2024-09-16T07:28:34.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb775c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77015d240 0x7fb77015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb775c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77015d240 0x7fb77015a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:48826/0 (socket says 172.21.15.114:48826) 2024-09-16T07:28:34.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb775c00640 1 -- 172.21.15.114:0/3623203186 learned_addr learned my addr 172.21.15.114:0/3623203186 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7fb775200640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7700cdb40 0x7fb770152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04e0003a10 0x7f04fc0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04fc0c4da0 0x7f04fc0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7fb775200640 1 -- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77015d240 msgr2=0x7fb77015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1ff000 0x7f04fc1ff480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc072a10 con 0x7f04fc1ff000 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc072890 con 0x7f04e0003a10 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.380+0000 7f04fb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc072b90 con 0x7f04fc0c4da0 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04fa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1ff000 0x7f04fc1ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04e0003a10 0x7f04fc0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04fa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1ff000 0x7f04fc1ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44488/0 (socket says 172.21.15.114:44488) 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04fa800640 1 -- 172.21.15.114:0/183984492 learned_addr learned my addr 172.21.15.114:0/183984492 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9400640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04fc0c4da0 0x7f04fc0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7fb775200640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77015d240 0x7fb77015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7fb775200640 1 -- 172.21.15.114:0/3623203186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7700ced50 msgr2=0x7fb77015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7fb775200640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7700ced50 0x7fb77015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7fb775200640 1 -- 172.21.15.114:0/3623203186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7700c5c50 con 0x7fb7700cdb40 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9e00640 1 -- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04fc0c4da0 msgr2=0x7f04fc0c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9e00640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04fc0c4da0 0x7f04fc0c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9e00640 1 -- 172.21.15.114:0/183984492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1ff000 msgr2=0x7f04fc1ff480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9e00640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1ff000 0x7f04fc1ff480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9e00640 1 -- 172.21.15.114:0/183984492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc0c5960 con 0x7f04e0003a10 2024-09-16T07:28:34.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7fb775200640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7700cdb40 0x7fb770152430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7600ac000 tx=0x7fb7600058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f9e00640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04e0003a10 0x7f04fc0c9400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005fd0 tx=0x7f04ec0a6ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f2000640 1 -- 172.21.15.114:0/183984492 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec0ac030 con 0x7f04e0003a10 2024-09-16T07:28:34.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f2000640 1 -- 172.21.15.114:0/183984492 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04ec005130 con 0x7f04e0003a10 2024-09-16T07:28:34.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04f2000640 1 -- 172.21.15.114:0/183984492 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec005580 con 0x7f04e0003a10 2024-09-16T07:28:34.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc0c5c40 con 0x7f04e0003a10 2024-09-16T07:28:34.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.384+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc16d260 con 0x7f04e0003a10 2024-09-16T07:28:34.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7fb76cc00640 1 -- 172.21.15.114:0/3623203186 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760005030 con 0x7fb7700cdb40 2024-09-16T07:28:34.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7fb76cc00640 1 -- 172.21.15.114:0/3623203186 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7600bb070 con 0x7fb7700cdb40 2024-09-16T07:28:34.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7700c50d0 con 0x7fb7700cdb40 2024-09-16T07:28:34.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7fb76cc00640 1 -- 172.21.15.114:0/3623203186 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7600055c0 con 0x7fb7700cdb40 2024-09-16T07:28:34.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d40052a0 con 0x7f04e0003a10 2024-09-16T07:28:34.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7f04f2000640 1 -- 172.21.15.114:0/183984492 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f04ec0af070 con 0x7f04e0003a10 2024-09-16T07:28:34.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7700c5690 con 0x7fb7700cdb40 2024-09-16T07:28:34.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7f04f2000640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f04dc072f90 0x7f04dc075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7f04f2000640 1 -- 172.21.15.114:0/183984492 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f04ec12d280 con 0x7f04e0003a10 2024-09-16T07:28:34.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7f04f9400640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f04dc072f90 0x7f04dc075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.388+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7700cd600 con 0x7fb7700cdb40 2024-09-16T07:28:34.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7fb76cc00640 1 -- 172.21.15.114:0/3623203186 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fb760004780 con 0x7fb7700cdb40 2024-09-16T07:28:34.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7fb76cc00640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb74c072ef0 0x7fb74c0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7fb76cc00640 1 -- 172.21.15.114:0/3623203186 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb76012e010 con 0x7fb7700cdb40 2024-09-16T07:28:34.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7fb76fe00640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb74c072ef0 0x7fb74c0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7f04f9400640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f04dc072f90 0x7f04dc075450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04e8001c10 tx=0x7f04e8007bd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.392+0000 7fb76cc00640 1 -- 172.21.15.114:0/3623203186 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb760017180 con 0x7fb7700cdb40 2024-09-16T07:28:34.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.396+0000 7f04f2000640 1 -- 172.21.15.114:0/183984492 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f04ec0163f0 con 0x7f04e0003a10 2024-09-16T07:28:34.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.400+0000 7fb76fe00640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb74c072ef0 0x7fb74c0753b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb770156060 tx=0x7fb758009640 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.604+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa858074b30 con 0x7fa85806ede0 2024-09-16T07:28:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.604+0000 7fa84e000640 1 -- 172.21.15.114:0/135608372 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa848062680 con 0x7fa85806ede0 2024-09-16T07:28:34.609 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8380732c0 msgr2=0x7fa838075780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8380732c0 0x7fa838075780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa850009fd0 tx=0x7fa85000b040 comp rx=0 tx=0).stop 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85806ede0 msgr2=0x7fa858158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85806ede0 0x7fa858158d20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c410 tx=0x7fa84800c8d0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 shutdown_connections 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8380732c0 0x7fa838075780 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8580b3ed0 0x7fa858073360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa85806ede0 0x7fa858158d20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 --2- 172.21.15.114:0/135608372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa85806ea00 0x7fa85814f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 >> 172.21.15.114:0/135608372 conn(0x7fa8580b18f0 msgr2=0x7fa8580759d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 shutdown_connections 2024-09-16T07:28:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.608+0000 7fa85ca00640 1 -- 172.21.15.114:0/135608372 wait complete. 2024-09-16T07:28:34.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.628+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc570005590 con 0x7fc598070770 2024-09-16T07:28:34.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.628+0000 7fc58ea00640 1 -- 172.21.15.114:0/648100931 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc59001a7c0 con 0x7fc598070770 2024-09-16T07:28:34.638 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:34.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-16T07:28:34.644 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc578072ec0 msgr2=0x7fc578075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc578072ec0 0x7fc578075380 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc584007fd0 tx=0x7fc584009040 comp rx=0 tx=0).stop 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc598070770 msgr2=0x7fc5981fb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc598070770 0x7fc5981fb7c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc59001f250 tx=0x7fc5900b1ba0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 shutdown_connections 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc578072ec0 0x7fc578075380 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc598159cc0 0x7fc5981fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5980cf570 0x7fc5980c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 --2- 172.21.15.114:0/648100931 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc598070770 0x7fc5981fb7c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 >> 172.21.15.114:0/648100931 conn(0x7fc5980cfa30 msgr2=0x7fc5980ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 shutdown_connections 2024-09-16T07:28:34.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.640+0000 7fc597e00640 1 -- 172.21.15.114:0/648100931 wait complete. 2024-09-16T07:28:34.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-16T07:28:34.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.668+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f02c815b740 con 0x7f02c80d0280 2024-09-16T07:28:34.674 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.676+0000 7f02bf400640 1 -- 172.21.15.114:0/253042656 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02c0016990 con 0x7f02c80d0280 2024-09-16T07:28:34.684 INFO:teuthology.orchestra.run.smithi114.stdout:60129542151 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f02a8072fc0 msgr2=0x7f02a8075480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f02a8072fc0 0x7f02a8075480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f02c8160330 tx=0x7f02b8009040 comp rx=0 tx=0).stop 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c80d0280 msgr2=0x7f02c813a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c80d0280 0x7f02c813a820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02c8070170 tx=0x7f02c0009340 comp rx=0 tx=0).stop 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 shutdown_connections 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f02a8072fc0 0x7f02a8075480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02c81643d0 0x7f02c815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c815aa60 0x7f02c813dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 --2- 172.21.15.114:0/253042656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02c80d0280 0x7f02c813a820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 >> 172.21.15.114:0/253042656 conn(0x7f02c806cdf0 msgr2=0x7f02c8153430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 shutdown_connections 2024-09-16T07:28:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.680+0000 7f02ce600640 1 -- 172.21.15.114:0/253042656 wait complete. 2024-09-16T07:28:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.684+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5a8c005590 con 0x7f5aa80e72d0 2024-09-16T07:28:34.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.684+0000 7f5aacc00640 1 -- 172.21.15.114:0/1484188293 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ab00de460 con 0x7f5aa80e72d0 2024-09-16T07:28:34.689 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:34.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.684+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f33b000dc00 con 0x7f33b0036250 2024-09-16T07:28:34.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.684+0000 7f33aea00640 1 -- 172.21.15.114:0/2966527764 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33a80f8c00 con 0x7f33b0036250 2024-09-16T07:28:34.691 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-09-16T07:28:34.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5a90072f90 msgr2=0x7f5a90075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5a90072f90 0x7f5a90075450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80db340 tx=0x7f5aa401a1f0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa80e72d0 msgr2=0x7f5aa8039550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa80e72d0 0x7f5aa8039550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0052890 tx=0x7f5ab006aef0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3398072f90 msgr2=0x7f3398075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3398072f90 0x7f3398075450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33b00de7f0 tx=0x7f33a4009040 comp rx=0 tx=0).stop 2024-09-16T07:28:34.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b0036250 msgr2=0x7f33b00e57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b0036250 0x7f33b00e57f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009840 tx=0x7f33a8005040 comp rx=0 tx=0).stop 2024-09-16T07:28:34.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 shutdown_connections 2024-09-16T07:28:34.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5a90072f90 0x7f5a90075450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa80e72d0 0x7f5aa8039550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa80e69b0 0x7f5aa80da8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 --2- 172.21.15.114:0/1484188293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa80332b0 0x7f5aa80dfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 >> 172.21.15.114:0/1484188293 conn(0x7f5aa8056720 msgr2=0x7f5aa80e1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 shutdown_connections 2024-09-16T07:28:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f5ab5e00640 1 -- 172.21.15.114:0/1484188293 wait complete. 2024-09-16T07:28:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 shutdown_connections 2024-09-16T07:28:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3398072f90 0x7f3398075450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33b0055070 0x7f33b004f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33b0036630 0x7f33b004a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 --2- 172.21.15.114:0/2966527764 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33b0036250 0x7f33b00e57f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 >> 172.21.15.114:0/2966527764 conn(0x7f33b001d780 msgr2=0x7f33b0032cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 shutdown_connections 2024-09-16T07:28:34.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.688+0000 7f33bdc00640 1 -- 172.21.15.114:0/2966527764 wait complete. 2024-09-16T07:28:34.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.712+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb7700745a0 con 0x7fb7700cdb40 2024-09-16T07:28:34.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.712+0000 7fb76cc00640 1 -- 172.21.15.114:0/3623203186 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7600f8bf0 con 0x7fb7700cdb40 2024-09-16T07:28:34.719 INFO:teuthology.orchestra.run.smithi114.stdout:64424509448 2024-09-16T07:28:34.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-16T07:28:34.720 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc6ac00ab60 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb74c072ef0 msgr2=0x7fb74c0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb74c072ef0 0x7fb74c0753b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb770156060 tx=0x7fb758009640 comp rx=0 tx=0).stop 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7700cdb40 msgr2=0x7fb770152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7700cdb40 0x7fb770152430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7600ac000 tx=0x7fb7600058e0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 shutdown_connections 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb74c072ef0 0x7fb74c0753b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb77015d240 0x7fb77015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7700ced50 0x7fb77015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 --2- 172.21.15.114:0/3623203186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7700cdb40 0x7fb770152430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 >> 172.21.15.114:0/3623203186 conn(0x7fb7700b1600 msgr2=0x7fb7700c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 shutdown_connections 2024-09-16T07:28:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fb776600640 1 -- 172.21.15.114:0/3623203186 wait complete. 2024-09-16T07:28:34.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.716+0000 7fc6a7e00640 1 -- 172.21.15.114:0/2133239717 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6b40de8e0 con 0x7fc6ac01e0f0 2024-09-16T07:28:34.722 INFO:teuthology.orchestra.run.smithi114.stdout:64424509446 2024-09-16T07:28:34.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-09-16T07:28:34.723 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc694072f90 msgr2=0x7fc694075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc694072f90 0x7fc694075450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80036b0 tx=0x7fc6a8003620 comp rx=0 tx=0).stop 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac01e0f0 msgr2=0x7fc6ac01e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac01e0f0 0x7fc6ac01e570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6b406b800 tx=0x7fc6b4069d40 comp rx=0 tx=0).stop 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 shutdown_connections 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc694072f90 0x7fc694075450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac01e0f0 0x7fc6ac01e570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac04a920 0x7fc6ac04ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 --2- 172.21.15.114:0/2133239717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc69c004810 0x7fc6ac04de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 >> 172.21.15.114:0/2133239717 conn(0x7fc6ac054570 msgr2=0x7fc6ac033fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 shutdown_connections 2024-09-16T07:28:34.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7fc6b9800640 1 -- 172.21.15.114:0/2133239717 wait complete. 2024-09-16T07:28:34.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-16T07:28:34.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f04d4005590 con 0x7f04e0003a10 2024-09-16T07:28:34.727 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.720+0000 7f04f2000640 1 -- 172.21.15.114:0/183984492 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04ec0f7e60 con 0x7f04e0003a10 2024-09-16T07:28:34.727 INFO:teuthology.orchestra.run.smithi114.stdout:64424509447 2024-09-16T07:28:34.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f04dc072f90 msgr2=0x7f04dc075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f04dc072f90 0x7f04dc075450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04e8001c10 tx=0x7f04e8007bd0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04e0003a10 msgr2=0x7f04fc0c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04e0003a10 0x7f04fc0c9400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005fd0 tx=0x7f04ec0a6ef0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 shutdown_connections 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f04dc072f90 0x7f04dc075450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04fc1ff000 0x7f04fc1ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04fc0c4da0 0x7f04fc0c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 --2- 172.21.15.114:0/183984492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04e0003a10 0x7f04fc0c9400 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 >> 172.21.15.114:0/183984492 conn(0x7f04fc0b1600 msgr2=0x7f04fc0b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 shutdown_connections 2024-09-16T07:28:34.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.724+0000 7f04fb200640 1 -- 172.21.15.114:0/183984492 wait complete. 2024-09-16T07:28:34.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-16T07:28:34.745 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-16T07:28:34.749 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-09-16T07:28:34.752 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:34.752 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:28:34.752 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:28:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 -- 172.21.15.114:0/4004203111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 msgr2=0x7f17040b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 --2- 172.21.15.114:0/4004203111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f17040b1a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17040cfb60 tx=0x7f16f001c830 comp rx=0 tx=0).stop 2024-09-16T07:28:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 -- 172.21.15.114:0/4004203111 shutdown_connections 2024-09-16T07:28:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 --2- 172.21.15.114:0/4004203111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f17040b1a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 --2- 172.21.15.114:0/4004203111 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17040b1f40 0x7f17040cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 --2- 172.21.15.114:0/4004203111 >> v2:172.21.15.149:3300/0 conn(0x7f170415f490 0x7f17040b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 -- 172.21.15.114:0/4004203111 >> 172.21.15.114:0/4004203111 conn(0x7f17040d1e30 msgr2=0x7f17040d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:34.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 -- 172.21.15.114:0/4004203111 shutdown_connections 2024-09-16T07:28:34.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.932+0000 7f170c600640 1 -- 172.21.15.114:0/4004203111 wait complete. 2024-09-16T07:28:34.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 Processor -- start 2024-09-16T07:28:34.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 -- start start 2024-09-16T07:28:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17040b1f40 0x7f17041fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f1704165dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f170415f490 0x7f170415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17040b0030 con 0x7f17040b2e80 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f17040afeb0 con 0x7f17040b1f40 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f17040b01b0 con 0x7f170415f490 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f1704165dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f1704165dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44502/0 (socket says 172.21.15.114:44502) 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 -- 172.21.15.114:0/1143045723 learned_addr learned my addr 172.21.15.114:0/1143045723 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170a600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f170415f490 0x7f170415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 -- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f170415f490 msgr2=0x7f170415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f170415f490 0x7f170415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 -- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17040b1f40 msgr2=0x7f17041fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709c00640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17040b1f40 0x7f17041fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17040b1f40 0x7f17041fbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 -- 172.21.15.114:0/1143045723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1704166720 con 0x7f17040b2e80 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170a600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f170415f490 0x7f170415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709c00640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17040b1f40 0x7f17041fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1709200640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f1704165dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16f00b0040 tx=0x7f16f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1701600640 1 -- 172.21.15.114:0/1143045723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f00b2040 con 0x7f17040b2e80 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1701600640 1 -- 172.21.15.114:0/1143045723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16f0005030 con 0x7f17040b2e80 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1704166a00 con 0x7f17040b2e80 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f1701600640 1 -- 172.21.15.114:0/1143045723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f00044f0 con 0x7f17040b2e80 2024-09-16T07:28:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.936+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17041fb7c0 con 0x7f17040b2e80 2024-09-16T07:28:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.940+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17040cfda0 con 0x7f17040b2e80 2024-09-16T07:28:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.940+0000 7f1701600640 1 -- 172.21.15.114:0/1143045723 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f16f0005480 con 0x7f17040b2e80 2024-09-16T07:28:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.940+0000 7f1701600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f16e4072ec0 0x7f16e4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.940+0000 7f1701600640 1 -- 172.21.15.114:0/1143045723 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f16f012d870 con 0x7f17040b2e80 2024-09-16T07:28:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.940+0000 7f1709c00640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f16e4072ec0 0x7f16e4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:34.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.944+0000 7f1709c00640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f16e4072ec0 0x7f16e4075380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007eb0 tx=0x7f16f80073c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:34.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:34.944+0000 7f1701600640 1 -- 172.21.15.114:0/1143045723 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f16f00164b0 con 0x7f17040b2e80 2024-09-16T07:28:35.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.112+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f170415e910 con 0x7f16e4072ec0 2024-09-16T07:28:35.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.116+0000 7f1701600640 1 -- 172.21.15.114:0/1143045723 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f170415e910 con 0x7f16e4072ec0 2024-09-16T07:28:35.123 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:28:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f16e4072ec0 msgr2=0x7f16e4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f16e4072ec0 0x7f16e4075380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007eb0 tx=0x7f16f80073c0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 msgr2=0x7f1704165dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f1704165dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f16f00b0040 tx=0x7f16f0004040 comp rx=0 tx=0).stop 2024-09-16T07:28:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 shutdown_connections 2024-09-16T07:28:35.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f16e4072ec0 0x7f16e4075380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f170415f490 0x7f170415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17040b2e80 0x7f1704165dd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 --2- 172.21.15.114:0/1143045723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17040b1f40 0x7f17041fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 >> 172.21.15.114:0/1143045723 conn(0x7f17040d1e30 msgr2=0x7f17040cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 shutdown_connections 2024-09-16T07:28:35.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.120+0000 7f170c600640 1 -- 172.21.15.114:0/1143045723 wait complete. 2024-09-16T07:28:35.143 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-16T07:28:34.997567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003230"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468764+0000","last_change":"2024-09-16T07:28:21.494577+0000","last_active":"2024-09-16T07:28:22.468764+0000","last_peered":"2024-09-16T07:28:22.468764+0000","last_clean":"2024-09-16T07:28:22.468764+0000","last_became_active":"2024-09-16T07:28:21.493934+0000","last_became_peered":"2024-09-16T07:28:21.493934+0000","last_unstale":"2024-09-16T07:28:22.468764+0000","last_undegraded":"2024-09-16T07:28:22.468764+0000","last_fullsized":"2024-09-16T07:28:22.468764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:23:14.503112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496746+0000","last_change":"2024-09-16T07:28:21.477637+0000","last_active":"2024-09-16T07:28:22.496746+0000","last_peered":"2024-09-16T07:28:22.496746+0000","last_clean":"2024-09-16T07:28:22.496746+0000","last_became_active":"2024-09-16T07:28:21.477003+0000","last_became_peered":"2024-09-16T07:28:21.477003+0000","last_unstale":"2024-09-16T07:28:22.496746+0000","last_undegraded":"2024-09-16T07:28:22.496746+0000","last_fullsized":"2024-09-16T07:28:22.496746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549155+0000","last_change":"2024-09-16T07:28:21.481637+0000","last_active":"2024-09-16T07:28:22.549155+0000","last_peered":"2024-09-16T07:28:22.549155+0000","last_clean":"2024-09-16T07:28:22.549155+0000","last_became_active":"2024-09-16T07:28:21.481332+0000","last_became_peered":"2024-09-16T07:28:21.481332+0000","last_unstale":"2024-09-16T07:28:22.549155+0000","last_undegraded":"2024-09-16T07:28:22.549155+0000","last_fullsized":"2024-09-16T07:28:22.549155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467466+0000","last_change":"2024-09-16T07:28:21.487204+0000","last_active":"2024-09-16T07:28:22.467466+0000","last_peered":"2024-09-16T07:28:22.467466+0000","last_clean":"2024-09-16T07:28:22.467466+0000","last_became_active":"2024-09-16T07:28:21.486943+0000","last_became_peered":"2024-09-16T07:28:21.486943+0000","last_unstale":"2024-09-16T07:28:22.467466+0000","last_undegraded":"2024-09-16T07:28:22.467466+0000","last_fullsized":"2024-09-16T07:28:22.467466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467523+0000","last_change":"2024-09-16T07:28:21.484353+0000","last_active":"2024-09-16T07:28:22.467523+0000","last_peered":"2024-09-16T07:28:22.467523+0000","last_clean":"2024-09-16T07:28:22.467523+0000","last_became_active":"2024-09-16T07:28:21.484096+0000","last_became_peered":"2024-09-16T07:28:21.484096+0000","last_unstale":"2024-09-16T07:28:22.467523+0000","last_undegraded":"2024-09-16T07:28:22.467523+0000","last_fullsized":"2024-09-16T07:28:22.467523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:00.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467515+0000","last_change":"2024-09-16T07:28:21.496054+0000","last_active":"2024-09-16T07:28:22.467515+0000","last_peered":"2024-09-16T07:28:22.467515+0000","last_clean":"2024-09-16T07:28:22.467515+0000","last_became_active":"2024-09-16T07:28:21.495720+0000","last_became_peered":"2024-09-16T07:28:21.495720+0000","last_unstale":"2024-09-16T07:28:22.467515+0000","last_undegraded":"2024-09-16T07:28:22.467515+0000","last_fullsized":"2024-09-16T07:28:22.467515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467387+0000","last_change":"2024-09-16T07:28:21.486935+0000","last_active":"2024-09-16T07:28:22.467387+0000","last_peered":"2024-09-16T07:28:22.467387+0000","last_clean":"2024-09-16T07:28:22.467387+0000","last_became_active":"2024-09-16T07:28:21.486668+0000","last_became_peered":"2024-09-16T07:28:21.486668+0000","last_unstale":"2024-09-16T07:28:22.467387+0000","last_undegraded":"2024-09-16T07:28:22.467387+0000","last_fullsized":"2024-09-16T07:28:22.467387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:26.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464347+0000","last_change":"2024-09-16T07:28:21.488749+0000","last_active":"2024-09-16T07:28:22.464347+0000","last_peered":"2024-09-16T07:28:22.464347+0000","last_clean":"2024-09-16T07:28:22.464347+0000","last_became_active":"2024-09-16T07:28:21.488344+0000","last_became_peered":"2024-09-16T07:28:21.488344+0000","last_unstale":"2024-09-16T07:28:22.464347+0000","last_undegraded":"2024-09-16T07:28:22.464347+0000","last_fullsized":"2024-09-16T07:28:22.464347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468674+0000","last_change":"2024-09-16T07:28:21.494268+0000","last_active":"2024-09-16T07:28:22.468674+0000","last_peered":"2024-09-16T07:28:22.468674+0000","last_clean":"2024-09-16T07:28:22.468674+0000","last_became_active":"2024-09-16T07:28:21.493475+0000","last_became_peered":"2024-09-16T07:28:21.493475+0000","last_unstale":"2024-09-16T07:28:22.468674+0000","last_undegraded":"2024-09-16T07:28:22.468674+0000","last_fullsized":"2024-09-16T07:28:22.468674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:12:34.391720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503097+0000","last_change":"2024-09-16T07:28:21.483444+0000","last_active":"2024-09-16T07:28:22.503097+0000","last_peered":"2024-09-16T07:28:22.503097+0000","last_clean":"2024-09-16T07:28:22.503097+0000","last_became_active":"2024-09-16T07:28:21.477957+0000","last_became_peered":"2024-09-16T07:28:21.477957+0000","last_unstale":"2024-09-16T07:28:22.503097+0000","last_undegraded":"2024-09-16T07:28:22.503097+0000","last_fullsized":"2024-09-16T07:28:22.503097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502910+0000","last_change":"2024-09-16T07:28:21.489623+0000","last_active":"2024-09-16T07:28:22.502910+0000","last_peered":"2024-09-16T07:28:22.502910+0000","last_clean":"2024-09-16T07:28:22.502910+0000","last_became_active":"2024-09-16T07:28:21.489309+0000","last_became_peered":"2024-09-16T07:28:21.489309+0000","last_unstale":"2024-09-16T07:28:22.502910+0000","last_undegraded":"2024-09-16T07:28:22.502910+0000","last_fullsized":"2024-09-16T07:28:22.502910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551994+0000","last_change":"2024-09-16T07:28:21.478068+0000","last_active":"2024-09-16T07:28:22.551994+0000","last_peered":"2024-09-16T07:28:22.551994+0000","last_clean":"2024-09-16T07:28:22.551994+0000","last_became_active":"2024-09-16T07:28:21.477672+0000","last_became_peered":"2024-09-16T07:28:21.477672+0000","last_unstale":"2024-09-16T07:28:22.551994+0000","last_undegraded":"2024-09-16T07:28:22.551994+0000","last_fullsized":"2024-09-16T07:28:22.551994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:54.933972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464732+0000","last_change":"2024-09-16T07:28:21.476271+0000","last_active":"2024-09-16T07:28:22.464732+0000","last_peered":"2024-09-16T07:28:22.464732+0000","last_clean":"2024-09-16T07:28:22.464732+0000","last_became_active":"2024-09-16T07:28:21.475852+0000","last_became_peered":"2024-09-16T07:28:21.475852+0000","last_unstale":"2024-09-16T07:28:22.464732+0000","last_undegraded":"2024-09-16T07:28:22.464732+0000","last_fullsized":"2024-09-16T07:28:22.464732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548912+0000","last_change":"2024-09-16T07:28:21.478669+0000","last_active":"2024-09-16T07:28:22.548912+0000","last_peered":"2024-09-16T07:28:22.548912+0000","last_clean":"2024-09-16T07:28:22.548912+0000","last_became_active":"2024-09-16T07:28:21.478365+0000","last_became_peered":"2024-09-16T07:28:21.478365+0000","last_unstale":"2024-09-16T07:28:22.548912+0000","last_undegraded":"2024-09-16T07:28:22.548912+0000","last_fullsized":"2024-09-16T07:28:22.548912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:29.836351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496252+0000","last_change":"2024-09-16T07:28:21.464672+0000","last_active":"2024-09-16T07:28:22.496252+0000","last_peered":"2024-09-16T07:28:22.496252+0000","last_clean":"2024-09-16T07:28:22.496252+0000","last_became_active":"2024-09-16T07:28:21.464371+0000","last_became_peered":"2024-09-16T07:28:21.464371+0000","last_unstale":"2024-09-16T07:28:22.496252+0000","last_undegraded":"2024-09-16T07:28:22.496252+0000","last_fullsized":"2024-09-16T07:28:22.496252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467116+0000","last_change":"2024-09-16T07:28:21.495723+0000","last_active":"2024-09-16T07:28:22.467116+0000","last_peered":"2024-09-16T07:28:22.467116+0000","last_clean":"2024-09-16T07:28:22.467116+0000","last_became_active":"2024-09-16T07:28:21.495360+0000","last_became_peered":"2024-09-16T07:28:21.495360+0000","last_unstale":"2024-09-16T07:28:22.467116+0000","last_undegraded":"2024-09-16T07:28:22.467116+0000","last_fullsized":"2024-09-16T07:28:22.467116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467869+0000","last_change":"2024-09-16T07:28:21.487979+0000","last_active":"2024-09-16T07:28:22.467869+0000","last_peered":"2024-09-16T07:28:22.467869+0000","last_clean":"2024-09-16T07:28:22.467869+0000","last_became_active":"2024-09-16T07:28:21.487716+0000","last_became_peered":"2024-09-16T07:28:21.487716+0000","last_unstale":"2024-09-16T07:28:22.467869+0000","last_undegraded":"2024-09-16T07:28:22.467869+0000","last_fullsized":"2024-09-16T07:28:22.467869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548812+0000","last_change":"2024-09-16T07:28:21.473706+0000","last_active":"2024-09-16T07:28:22.548812+0000","last_peered":"2024-09-16T07:28:22.548812+0000","last_clean":"2024-09-16T07:28:22.548812+0000","last_became_active":"2024-09-16T07:28:21.472045+0000","last_became_peered":"2024-09-16T07:28:21.472045+0000","last_unstale":"2024-09-16T07:28:22.548812+0000","last_undegraded":"2024-09-16T07:28:22.548812+0000","last_fullsized":"2024-09-16T07:28:22.548812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:20.884169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468434+0000","last_change":"2024-09-16T07:28:21.483475+0000","last_active":"2024-09-16T07:28:22.468434+0000","last_peered":"2024-09-16T07:28:22.468434+0000","last_clean":"2024-09-16T07:28:22.468434+0000","last_became_active":"2024-09-16T07:28:21.483089+0000","last_became_peered":"2024-09-16T07:28:21.483089+0000","last_unstale":"2024-09-16T07:28:22.468434+0000","last_undegraded":"2024-09-16T07:28:22.468434+0000","last_fullsized":"2024-09-16T07:28:22.468434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:06.838109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502819+0000","last_change":"2024-09-16T07:28:21.484778+0000","last_active":"2024-09-16T07:28:22.502819+0000","last_peered":"2024-09-16T07:28:22.502819+0000","last_clean":"2024-09-16T07:28:22.502819+0000","last_became_active":"2024-09-16T07:28:21.484204+0000","last_became_peered":"2024-09-16T07:28:21.484204+0000","last_unstale":"2024-09-16T07:28:22.502819+0000","last_undegraded":"2024-09-16T07:28:22.502819+0000","last_fullsized":"2024-09-16T07:28:22.502819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549143+0000","last_change":"2024-09-16T07:28:21.483859+0000","last_active":"2024-09-16T07:28:22.549143+0000","last_peered":"2024-09-16T07:28:22.549143+0000","last_clean":"2024-09-16T07:28:22.549143+0000","last_became_active":"2024-09-16T07:28:21.483553+0000","last_became_peered":"2024-09-16T07:28:21.483553+0000","last_unstale":"2024-09-16T07:28:22.549143+0000","last_undegraded":"2024-09-16T07:28:22.549143+0000","last_fullsized":"2024-09-16T07:28:22.549143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:02.888442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467718+0000","last_change":"2024-09-16T07:28:21.489323+0000","last_active":"2024-09-16T07:28:22.467718+0000","last_peered":"2024-09-16T07:28:22.467718+0000","last_clean":"2024-09-16T07:28:22.467718+0000","last_became_active":"2024-09-16T07:28:21.489030+0000","last_became_peered":"2024-09-16T07:28:21.489030+0000","last_unstale":"2024-09-16T07:28:22.467718+0000","last_undegraded":"2024-09-16T07:28:22.467718+0000","last_fullsized":"2024-09-16T07:28:22.467718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464446+0000","last_change":"2024-09-16T07:28:21.486749+0000","last_active":"2024-09-16T07:28:22.464446+0000","last_peered":"2024-09-16T07:28:22.464446+0000","last_clean":"2024-09-16T07:28:22.464446+0000","last_became_active":"2024-09-16T07:28:21.486460+0000","last_became_peered":"2024-09-16T07:28:21.486460+0000","last_unstale":"2024-09-16T07:28:22.464446+0000","last_undegraded":"2024-09-16T07:28:22.464446+0000","last_fullsized":"2024-09-16T07:28:22.464446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467149+0000","last_change":"2024-09-16T07:28:21.489962+0000","last_active":"2024-09-16T07:28:22.467149+0000","last_peered":"2024-09-16T07:28:22.467149+0000","last_clean":"2024-09-16T07:28:22.467149+0000","last_became_active":"2024-09-16T07:28:21.489700+0000","last_became_peered":"2024-09-16T07:28:21.489700+0000","last_unstale":"2024-09-16T07:28:22.467149+0000","last_undegraded":"2024-09-16T07:28:22.467149+0000","last_fullsized":"2024-09-16T07:28:22.467149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465167+0000","last_change":"2024-09-16T07:28:21.475734+0000","last_active":"2024-09-16T07:28:22.465167+0000","last_peered":"2024-09-16T07:28:22.465167+0000","last_clean":"2024-09-16T07:28:22.465167+0000","last_became_active":"2024-09-16T07:28:21.474927+0000","last_became_peered":"2024-09-16T07:28:21.474927+0000","last_unstale":"2024-09-16T07:28:22.465167+0000","last_undegraded":"2024-09-16T07:28:22.465167+0000","last_fullsized":"2024-09-16T07:28:22.465167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503167+0000","last_change":"2024-09-16T07:28:21.491054+0000","last_active":"2024-09-16T07:28:22.503167+0000","last_peered":"2024-09-16T07:28:22.503167+0000","last_clean":"2024-09-16T07:28:22.503167+0000","last_became_active":"2024-09-16T07:28:21.490686+0000","last_became_peered":"2024-09-16T07:28:21.490686+0000","last_unstale":"2024-09-16T07:28:22.503167+0000","last_undegraded":"2024-09-16T07:28:22.503167+0000","last_fullsized":"2024-09-16T07:28:22.503167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496663+0000","last_change":"2024-09-16T07:28:21.473001+0000","last_active":"2024-09-16T07:28:22.496663+0000","last_peered":"2024-09-16T07:28:22.496663+0000","last_clean":"2024-09-16T07:28:22.496663+0000","last_became_active":"2024-09-16T07:28:21.472729+0000","last_became_peered":"2024-09-16T07:28:21.472729+0000","last_unstale":"2024-09-16T07:28:22.496663+0000","last_undegraded":"2024-09-16T07:28:22.496663+0000","last_fullsized":"2024-09-16T07:28:22.496663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464910+0000","last_change":"2024-09-16T07:28:21.475995+0000","last_active":"2024-09-16T07:28:22.464910+0000","last_peered":"2024-09-16T07:28:22.464910+0000","last_clean":"2024-09-16T07:28:22.464910+0000","last_became_active":"2024-09-16T07:28:21.475693+0000","last_became_peered":"2024-09-16T07:28:21.475693+0000","last_unstale":"2024-09-16T07:28:22.464910+0000","last_undegraded":"2024-09-16T07:28:22.464910+0000","last_fullsized":"2024-09-16T07:28:22.464910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549102+0000","last_change":"2024-09-16T07:28:21.480473+0000","last_active":"2024-09-16T07:28:22.549102+0000","last_peered":"2024-09-16T07:28:22.549102+0000","last_clean":"2024-09-16T07:28:22.549102+0000","last_became_active":"2024-09-16T07:28:21.480165+0000","last_became_peered":"2024-09-16T07:28:21.480165+0000","last_unstale":"2024-09-16T07:28:22.549102+0000","last_undegraded":"2024-09-16T07:28:22.549102+0000","last_fullsized":"2024-09-16T07:28:22.549102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:37.071702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467933+0000","last_change":"2024-09-16T07:28:21.500956+0000","last_active":"2024-09-16T07:28:22.467933+0000","last_peered":"2024-09-16T07:28:22.467933+0000","last_clean":"2024-09-16T07:28:22.467933+0000","last_became_active":"2024-09-16T07:28:21.500678+0000","last_became_peered":"2024-09-16T07:28:21.500678+0000","last_unstale":"2024-09-16T07:28:22.467933+0000","last_undegraded":"2024-09-16T07:28:22.467933+0000","last_fullsized":"2024-09-16T07:28:22.467933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:19:59.668925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548289+0000","last_change":"2024-09-16T07:28:21.463979+0000","last_active":"2024-09-16T07:28:22.548289+0000","last_peered":"2024-09-16T07:28:22.548289+0000","last_clean":"2024-09-16T07:28:22.548289+0000","last_became_active":"2024-09-16T07:28:21.463670+0000","last_became_peered":"2024-09-16T07:28:21.463670+0000","last_unstale":"2024-09-16T07:28:22.548289+0000","last_undegraded":"2024-09-16T07:28:22.548289+0000","last_fullsized":"2024-09-16T07:28:22.548289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:19.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502645+0000","last_change":"2024-09-16T07:28:21.484394+0000","last_active":"2024-09-16T07:28:22.502645+0000","last_peered":"2024-09-16T07:28:22.502645+0000","last_clean":"2024-09-16T07:28:22.502645+0000","last_became_active":"2024-09-16T07:28:21.484000+0000","last_became_peered":"2024-09-16T07:28:21.484000+0000","last_unstale":"2024-09-16T07:28:22.502645+0000","last_undegraded":"2024-09-16T07:28:22.502645+0000","last_fullsized":"2024-09-16T07:28:22.502645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551777+0000","last_change":"2024-09-16T07:28:21.488398+0000","last_active":"2024-09-16T07:28:22.551777+0000","last_peered":"2024-09-16T07:28:22.551777+0000","last_clean":"2024-09-16T07:28:22.551777+0000","last_became_active":"2024-09-16T07:28:21.488082+0000","last_became_peered":"2024-09-16T07:28:21.488082+0000","last_unstale":"2024-09-16T07:28:22.551777+0000","last_undegraded":"2024-09-16T07:28:22.551777+0000","last_fullsized":"2024-09-16T07:28:22.551777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:56.278436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464818+0000","last_change":"2024-09-16T07:28:20.460754+0000","last_active":"2024-09-16T07:28:22.464818+0000","last_peered":"2024-09-16T07:28:22.464818+0000","last_clean":"2024-09-16T07:28:22.464818+0000","last_became_active":"2024-09-16T07:28:20.460452+0000","last_became_peered":"2024-09-16T07:28:20.460452+0000","last_unstale":"2024-09-16T07:28:22.464818+0000","last_undegraded":"2024-09-16T07:28:22.464818+0000","last_fullsized":"2024-09-16T07:28:22.464818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:33.769857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549314+0000","last_change":"2024-09-16T07:28:21.494146+0000","last_active":"2024-09-16T07:28:22.549314+0000","last_peered":"2024-09-16T07:28:22.549314+0000","last_clean":"2024-09-16T07:28:22.549314+0000","last_became_active":"2024-09-16T07:28:21.493871+0000","last_became_peered":"2024-09-16T07:28:21.493871+0000","last_unstale":"2024-09-16T07:28:22.549314+0000","last_undegraded":"2024-09-16T07:28:22.549314+0000","last_fullsized":"2024-09-16T07:28:22.549314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502498+0000","last_change":"2024-09-16T07:28:20.459159+0000","last_active":"2024-09-16T07:28:22.502498+0000","last_peered":"2024-09-16T07:28:22.502498+0000","last_clean":"2024-09-16T07:28:22.502498+0000","last_became_active":"2024-09-16T07:28:20.456616+0000","last_became_peered":"2024-09-16T07:28:20.456616+0000","last_unstale":"2024-09-16T07:28:22.502498+0000","last_undegraded":"2024-09-16T07:28:22.502498+0000","last_fullsized":"2024-09-16T07:28:22.502498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464412+0000","last_change":"2024-09-16T07:28:20.462946+0000","last_active":"2024-09-16T07:28:22.464412+0000","last_peered":"2024-09-16T07:28:22.464412+0000","last_clean":"2024-09-16T07:28:22.464412+0000","last_became_active":"2024-09-16T07:28:20.462684+0000","last_became_peered":"2024-09-16T07:28:20.462684+0000","last_unstale":"2024-09-16T07:28:22.464412+0000","last_undegraded":"2024-09-16T07:28:22.464412+0000","last_fullsized":"2024-09-16T07:28:22.464412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:52.266984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464445+0000","last_change":"2024-09-16T07:28:21.476488+0000","last_active":"2024-09-16T07:28:22.464445+0000","last_peered":"2024-09-16T07:28:22.464445+0000","last_clean":"2024-09-16T07:28:22.464445+0000","last_became_active":"2024-09-16T07:28:21.475830+0000","last_became_peered":"2024-09-16T07:28:21.475830+0000","last_unstale":"2024-09-16T07:28:22.464445+0000","last_undegraded":"2024-09-16T07:28:22.464445+0000","last_fullsized":"2024-09-16T07:28:22.464445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467181+0000","last_change":"2024-09-16T07:28:20.466562+0000","last_active":"2024-09-16T07:28:22.467181+0000","last_peered":"2024-09-16T07:28:22.467181+0000","last_clean":"2024-09-16T07:28:22.467181+0000","last_became_active":"2024-09-16T07:28:20.465752+0000","last_became_peered":"2024-09-16T07:28:20.465752+0000","last_unstale":"2024-09-16T07:28:22.467181+0000","last_undegraded":"2024-09-16T07:28:22.467181+0000","last_fullsized":"2024-09-16T07:28:22.467181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496248+0000","last_change":"2024-09-16T07:28:21.469784+0000","last_active":"2024-09-16T07:28:22.496248+0000","last_peered":"2024-09-16T07:28:22.496248+0000","last_clean":"2024-09-16T07:28:22.496248+0000","last_became_active":"2024-09-16T07:28:21.469633+0000","last_became_peered":"2024-09-16T07:28:21.469633+0000","last_unstale":"2024-09-16T07:28:22.496248+0000","last_undegraded":"2024-09-16T07:28:22.496248+0000","last_fullsized":"2024-09-16T07:28:22.496248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503022+0000","last_change":"2024-09-16T07:28:20.463652+0000","last_active":"2024-09-16T07:28:22.503022+0000","last_peered":"2024-09-16T07:28:22.503022+0000","last_clean":"2024-09-16T07:28:22.503022+0000","last_became_active":"2024-09-16T07:28:20.463379+0000","last_became_peered":"2024-09-16T07:28:20.463379+0000","last_unstale":"2024-09-16T07:28:22.503022+0000","last_undegraded":"2024-09-16T07:28:22.503022+0000","last_fullsized":"2024-09-16T07:28:22.503022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468195+0000","last_change":"2024-09-16T07:28:21.500436+0000","last_active":"2024-09-16T07:28:22.468195+0000","last_peered":"2024-09-16T07:28:22.468195+0000","last_clean":"2024-09-16T07:28:22.468195+0000","last_became_active":"2024-09-16T07:28:21.500187+0000","last_became_peered":"2024-09-16T07:28:21.500187+0000","last_unstale":"2024-09-16T07:28:22.468195+0000","last_undegraded":"2024-09-16T07:28:22.468195+0000","last_fullsized":"2024-09-16T07:28:22.468195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:50:23.478685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468098+0000","last_change":"2024-09-16T07:28:20.472210+0000","last_active":"2024-09-16T07:28:22.468098+0000","last_peered":"2024-09-16T07:28:22.468098+0000","last_clean":"2024-09-16T07:28:22.468098+0000","last_became_active":"2024-09-16T07:28:20.471902+0000","last_became_peered":"2024-09-16T07:28:20.471902+0000","last_unstale":"2024-09-16T07:28:22.468098+0000","last_undegraded":"2024-09-16T07:28:22.468098+0000","last_fullsized":"2024-09-16T07:28:22.468098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549390+0000","last_change":"2024-09-16T07:28:21.489089+0000","last_active":"2024-09-16T07:28:22.549390+0000","last_peered":"2024-09-16T07:28:22.549390+0000","last_clean":"2024-09-16T07:28:22.549390+0000","last_became_active":"2024-09-16T07:28:21.488554+0000","last_became_peered":"2024-09-16T07:28:21.488554+0000","last_unstale":"2024-09-16T07:28:22.549390+0000","last_undegraded":"2024-09-16T07:28:22.549390+0000","last_fullsized":"2024-09-16T07:28:22.549390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:03.502755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496514+0000","last_change":"2024-09-16T07:28:20.461734+0000","last_active":"2024-09-16T07:28:22.496514+0000","last_peered":"2024-09-16T07:28:22.496514+0000","last_clean":"2024-09-16T07:28:22.496514+0000","last_became_active":"2024-09-16T07:28:20.461508+0000","last_became_peered":"2024-09-16T07:28:20.461508+0000","last_unstale":"2024-09-16T07:28:22.496514+0000","last_undegraded":"2024-09-16T07:28:22.496514+0000","last_fullsized":"2024-09-16T07:28:22.496514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:48.563809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.552021+0000","last_change":"2024-09-16T07:28:21.482206+0000","last_active":"2024-09-16T07:28:22.552021+0000","last_peered":"2024-09-16T07:28:22.552021+0000","last_clean":"2024-09-16T07:28:22.552021+0000","last_became_active":"2024-09-16T07:28:21.481551+0000","last_became_peered":"2024-09-16T07:28:21.481551+0000","last_unstale":"2024-09-16T07:28:22.552021+0000","last_undegraded":"2024-09-16T07:28:22.552021+0000","last_fullsized":"2024-09-16T07:28:22.552021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:39.225323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502717+0000","last_change":"2024-09-16T07:28:20.469828+0000","last_active":"2024-09-16T07:28:22.502717+0000","last_peered":"2024-09-16T07:28:22.502717+0000","last_clean":"2024-09-16T07:28:22.502717+0000","last_became_active":"2024-09-16T07:28:20.469327+0000","last_became_peered":"2024-09-16T07:28:20.469327+0000","last_unstale":"2024-09-16T07:28:22.502717+0000","last_undegraded":"2024-09-16T07:28:22.502717+0000","last_fullsized":"2024-09-16T07:28:22.502717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467227+0000","last_change":"2024-09-16T07:28:21.484091+0000","last_active":"2024-09-16T07:28:22.467227+0000","last_peered":"2024-09-16T07:28:22.467227+0000","last_clean":"2024-09-16T07:28:22.467227+0000","last_became_active":"2024-09-16T07:28:21.483783+0000","last_became_peered":"2024-09-16T07:28:21.483783+0000","last_unstale":"2024-09-16T07:28:22.467227+0000","last_undegraded":"2024-09-16T07:28:22.467227+0000","last_fullsized":"2024-09-16T07:28:22.467227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:07.182120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549218+0000","last_change":"2024-09-16T07:28:20.451995+0000","last_active":"2024-09-16T07:28:22.549218+0000","last_peered":"2024-09-16T07:28:22.549218+0000","last_clean":"2024-09-16T07:28:22.549218+0000","last_became_active":"2024-09-16T07:28:20.451740+0000","last_became_peered":"2024-09-16T07:28:20.451740+0000","last_unstale":"2024-09-16T07:28:22.549218+0000","last_undegraded":"2024-09-16T07:28:22.549218+0000","last_fullsized":"2024-09-16T07:28:22.549218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:50.421459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548952+0000","last_change":"2024-09-16T07:28:21.478652+0000","last_active":"2024-09-16T07:28:22.548952+0000","last_peered":"2024-09-16T07:28:22.548952+0000","last_clean":"2024-09-16T07:28:22.548952+0000","last_became_active":"2024-09-16T07:28:21.478073+0000","last_became_peered":"2024-09-16T07:28:21.478073+0000","last_unstale":"2024-09-16T07:28:22.548952+0000","last_undegraded":"2024-09-16T07:28:22.548952+0000","last_fullsized":"2024-09-16T07:28:22.548952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:19:21.305531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467810+0000","last_change":"2024-09-16T07:28:20.467427+0000","last_active":"2024-09-16T07:28:22.467810+0000","last_peered":"2024-09-16T07:28:22.467810+0000","last_clean":"2024-09-16T07:28:22.467810+0000","last_became_active":"2024-09-16T07:28:20.467214+0000","last_became_peered":"2024-09-16T07:28:20.467214+0000","last_unstale":"2024-09-16T07:28:22.467810+0000","last_undegraded":"2024-09-16T07:28:22.467810+0000","last_fullsized":"2024-09-16T07:28:22.467810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467633+0000","last_change":"2024-09-16T07:28:21.480102+0000","last_active":"2024-09-16T07:28:22.467633+0000","last_peered":"2024-09-16T07:28:22.467633+0000","last_clean":"2024-09-16T07:28:22.467633+0000","last_became_active":"2024-09-16T07:28:21.479792+0000","last_became_peered":"2024-09-16T07:28:21.479792+0000","last_unstale":"2024-09-16T07:28:22.467633+0000","last_undegraded":"2024-09-16T07:28:22.467633+0000","last_fullsized":"2024-09-16T07:28:22.467633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:01.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502453+0000","last_change":"2024-09-16T07:28:20.458181+0000","last_active":"2024-09-16T07:28:22.502453+0000","last_peered":"2024-09-16T07:28:22.502453+0000","last_clean":"2024-09-16T07:28:22.502453+0000","last_became_active":"2024-09-16T07:28:20.456385+0000","last_became_peered":"2024-09-16T07:28:20.456385+0000","last_unstale":"2024-09-16T07:28:22.502453+0000","last_undegraded":"2024-09-16T07:28:22.502453+0000","last_fullsized":"2024-09-16T07:28:22.502453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502619+0000","last_change":"2024-09-16T07:28:21.482950+0000","last_active":"2024-09-16T07:28:22.502619+0000","last_peered":"2024-09-16T07:28:22.502619+0000","last_clean":"2024-09-16T07:28:22.502619+0000","last_became_active":"2024-09-16T07:28:21.482427+0000","last_became_peered":"2024-09-16T07:28:21.482427+0000","last_unstale":"2024-09-16T07:28:22.502619+0000","last_undegraded":"2024-09-16T07:28:22.502619+0000","last_fullsized":"2024-09-16T07:28:22.502619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548130+0000","last_change":"2024-09-16T07:28:20.457548+0000","last_active":"2024-09-16T07:28:22.548130+0000","last_peered":"2024-09-16T07:28:22.548130+0000","last_clean":"2024-09-16T07:28:22.548130+0000","last_became_active":"2024-09-16T07:28:20.457151+0000","last_became_peered":"2024-09-16T07:28:20.457151+0000","last_unstale":"2024-09-16T07:28:22.548130+0000","last_undegraded":"2024-09-16T07:28:22.548130+0000","last_fullsized":"2024-09-16T07:28:22.548130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:48.914037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467591+0000","last_change":"2024-09-16T07:28:21.491418+0000","last_active":"2024-09-16T07:28:22.467591+0000","last_peered":"2024-09-16T07:28:22.467591+0000","last_clean":"2024-09-16T07:28:22.467591+0000","last_became_active":"2024-09-16T07:28:21.491157+0000","last_became_peered":"2024-09-16T07:28:21.491157+0000","last_unstale":"2024-09-16T07:28:22.467591+0000","last_undegraded":"2024-09-16T07:28:22.467591+0000","last_fullsized":"2024-09-16T07:28:22.467591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551843+0000","last_change":"2024-09-16T07:28:20.458574+0000","last_active":"2024-09-16T07:28:22.551843+0000","last_peered":"2024-09-16T07:28:22.551843+0000","last_clean":"2024-09-16T07:28:22.551843+0000","last_became_active":"2024-09-16T07:28:20.458268+0000","last_became_peered":"2024-09-16T07:28:20.458268+0000","last_unstale":"2024-09-16T07:28:22.551843+0000","last_undegraded":"2024-09-16T07:28:22.551843+0000","last_fullsized":"2024-09-16T07:28:22.551843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:46:58.633211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468568+0000","last_change":"2024-09-16T07:28:21.492507+0000","last_active":"2024-09-16T07:28:22.468568+0000","last_peered":"2024-09-16T07:28:22.468568+0000","last_clean":"2024-09-16T07:28:22.468568+0000","last_became_active":"2024-09-16T07:28:21.492267+0000","last_became_peered":"2024-09-16T07:28:21.492267+0000","last_unstale":"2024-09-16T07:28:22.468568+0000","last_undegraded":"2024-09-16T07:28:22.468568+0000","last_fullsized":"2024-09-16T07:28:22.468568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:02.918148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548720+0000","last_change":"2024-09-16T07:28:20.450706+0000","last_active":"2024-09-16T07:28:22.548720+0000","last_peered":"2024-09-16T07:28:22.548720+0000","last_clean":"2024-09-16T07:28:22.548720+0000","last_became_active":"2024-09-16T07:28:20.450379+0000","last_became_peered":"2024-09-16T07:28:20.450379+0000","last_unstale":"2024-09-16T07:28:22.548720+0000","last_undegraded":"2024-09-16T07:28:22.548720+0000","last_fullsized":"2024-09-16T07:28:22.548720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:37.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468790+0000","last_change":"2024-09-16T07:28:21.480183+0000","last_active":"2024-09-16T07:28:22.468790+0000","last_peered":"2024-09-16T07:28:22.468790+0000","last_clean":"2024-09-16T07:28:22.468790+0000","last_became_active":"2024-09-16T07:28:21.479807+0000","last_became_peered":"2024-09-16T07:28:21.479807+0000","last_unstale":"2024-09-16T07:28:22.468790+0000","last_undegraded":"2024-09-16T07:28:22.468790+0000","last_fullsized":"2024-09-16T07:28:22.468790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:35.281982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496622+0000","last_change":"2024-09-16T07:28:20.456101+0000","last_active":"2024-09-16T07:28:22.496622+0000","last_peered":"2024-09-16T07:28:22.496622+0000","last_clean":"2024-09-16T07:28:22.496622+0000","last_became_active":"2024-09-16T07:28:20.453929+0000","last_became_peered":"2024-09-16T07:28:20.453929+0000","last_unstale":"2024-09-16T07:28:22.496622+0000","last_undegraded":"2024-09-16T07:28:22.496622+0000","last_fullsized":"2024-09-16T07:28:22.496622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:53.936877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467874+0000","last_change":"2024-09-16T07:28:21.499515+0000","last_active":"2024-09-16T07:28:22.467874+0000","last_peered":"2024-09-16T07:28:22.467874+0000","last_clean":"2024-09-16T07:28:22.467874+0000","last_became_active":"2024-09-16T07:28:21.490747+0000","last_became_peered":"2024-09-16T07:28:21.490747+0000","last_unstale":"2024-09-16T07:28:22.467874+0000","last_undegraded":"2024-09-16T07:28:22.467874+0000","last_fullsized":"2024-09-16T07:28:22.467874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:32.209796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548601+0000","last_change":"2024-09-16T07:28:20.465122+0000","last_active":"2024-09-16T07:28:22.548601+0000","last_peered":"2024-09-16T07:28:22.548601+0000","last_clean":"2024-09-16T07:28:22.548601+0000","last_became_active":"2024-09-16T07:28:20.464580+0000","last_became_peered":"2024-09-16T07:28:20.464580+0000","last_unstale":"2024-09-16T07:28:22.548601+0000","last_undegraded":"2024-09-16T07:28:22.548601+0000","last_fullsized":"2024-09-16T07:28:22.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:50.567918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467440+0000","last_change":"2024-09-16T07:28:21.488112+0000","last_active":"2024-09-16T07:28:22.467440+0000","last_peered":"2024-09-16T07:28:22.467440+0000","last_clean":"2024-09-16T07:28:22.467440+0000","last_became_active":"2024-09-16T07:28:21.487902+0000","last_became_peered":"2024-09-16T07:28:21.487902+0000","last_unstale":"2024-09-16T07:28:22.467440+0000","last_undegraded":"2024-09-16T07:28:22.467440+0000","last_fullsized":"2024-09-16T07:28:22.467440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:27.706301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467313+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:28:22.467313+0000","last_peered":"2024-09-16T07:28:22.467313+0000","last_clean":"2024-09-16T07:28:22.467313+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:28:22.467313+0000","last_undegraded":"2024-09-16T07:28:22.467313+0000","last_fullsized":"2024-09-16T07:28:22.467313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.466990+0000","last_change":"2024-09-16T07:28:20.460935+0000","last_active":"2024-09-16T07:28:22.466990+0000","last_peered":"2024-09-16T07:28:22.466990+0000","last_clean":"2024-09-16T07:28:22.466990+0000","last_became_active":"2024-09-16T07:28:20.460629+0000","last_became_peered":"2024-09-16T07:28:20.460629+0000","last_unstale":"2024-09-16T07:28:22.466990+0000","last_undegraded":"2024-09-16T07:28:22.466990+0000","last_fullsized":"2024-09-16T07:28:22.466990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464687+0000","last_change":"2024-09-16T07:28:21.488741+0000","last_active":"2024-09-16T07:28:22.464687+0000","last_peered":"2024-09-16T07:28:22.464687+0000","last_clean":"2024-09-16T07:28:22.464687+0000","last_became_active":"2024-09-16T07:28:21.488257+0000","last_became_peered":"2024-09-16T07:28:21.488257+0000","last_unstale":"2024-09-16T07:28:22.464687+0000","last_undegraded":"2024-09-16T07:28:22.464687+0000","last_fullsized":"2024-09-16T07:28:22.464687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467205+0000","last_change":"2024-09-16T07:28:20.467488+0000","last_active":"2024-09-16T07:28:22.467205+0000","last_peered":"2024-09-16T07:28:22.467205+0000","last_clean":"2024-09-16T07:28:22.467205+0000","last_became_active":"2024-09-16T07:28:20.466897+0000","last_became_peered":"2024-09-16T07:28:20.466897+0000","last_unstale":"2024-09-16T07:28:22.467205+0000","last_undegraded":"2024-09-16T07:28:22.467205+0000","last_fullsized":"2024-09-16T07:28:22.467205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548576+0000","last_change":"2024-09-16T07:28:21.494039+0000","last_active":"2024-09-16T07:28:22.548576+0000","last_peered":"2024-09-16T07:28:22.548576+0000","last_clean":"2024-09-16T07:28:22.548576+0000","last_became_active":"2024-09-16T07:28:21.493705+0000","last_became_peered":"2024-09-16T07:28:21.493705+0000","last_unstale":"2024-09-16T07:28:22.548576+0000","last_undegraded":"2024-09-16T07:28:22.548576+0000","last_fullsized":"2024-09-16T07:28:22.548576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:06:41.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548390+0000","last_change":"2024-09-16T07:28:20.453271+0000","last_active":"2024-09-16T07:28:22.548390+0000","last_peered":"2024-09-16T07:28:22.548390+0000","last_clean":"2024-09-16T07:28:22.548390+0000","last_became_active":"2024-09-16T07:28:20.452985+0000","last_became_peered":"2024-09-16T07:28:20.452985+0000","last_unstale":"2024-09-16T07:28:22.548390+0000","last_undegraded":"2024-09-16T07:28:22.548390+0000","last_fullsized":"2024-09-16T07:28:22.548390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:08.366019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496234+0000","last_change":"2024-09-16T07:28:21.464203+0000","last_active":"2024-09-16T07:28:22.496234+0000","last_peered":"2024-09-16T07:28:22.496234+0000","last_clean":"2024-09-16T07:28:22.496234+0000","last_became_active":"2024-09-16T07:28:21.463943+0000","last_became_peered":"2024-09-16T07:28:21.463943+0000","last_unstale":"2024-09-16T07:28:22.496234+0000","last_undegraded":"2024-09-16T07:28:22.496234+0000","last_fullsized":"2024-09-16T07:28:22.496234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:10.337642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467921+0000","last_change":"2024-09-16T07:28:20.459755+0000","last_active":"2024-09-16T07:28:22.467921+0000","last_peered":"2024-09-16T07:28:22.467921+0000","last_clean":"2024-09-16T07:28:22.467921+0000","last_became_active":"2024-09-16T07:28:20.459383+0000","last_became_peered":"2024-09-16T07:28:20.459383+0000","last_unstale":"2024-09-16T07:28:22.467921+0000","last_undegraded":"2024-09-16T07:28:22.467921+0000","last_fullsized":"2024-09-16T07:28:22.467921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551881+0000","last_change":"2024-09-16T07:28:21.490524+0000","last_active":"2024-09-16T07:28:22.551881+0000","last_peered":"2024-09-16T07:28:22.551881+0000","last_clean":"2024-09-16T07:28:22.551881+0000","last_became_active":"2024-09-16T07:28:21.490245+0000","last_became_peered":"2024-09-16T07:28:21.490245+0000","last_unstale":"2024-09-16T07:28:22.551881+0000","last_undegraded":"2024-09-16T07:28:22.551881+0000","last_fullsized":"2024-09-16T07:28:22.551881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.777612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496506+0000","last_change":"2024-09-16T07:28:20.460535+0000","last_active":"2024-09-16T07:28:22.496506+0000","last_peered":"2024-09-16T07:28:22.496506+0000","last_clean":"2024-09-16T07:28:22.496506+0000","last_became_active":"2024-09-16T07:28:20.456847+0000","last_became_peered":"2024-09-16T07:28:20.456847+0000","last_unstale":"2024-09-16T07:28:22.496506+0000","last_undegraded":"2024-09-16T07:28:22.496506+0000","last_fullsized":"2024-09-16T07:28:22.496506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:09:04.534477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468312+0000","last_change":"2024-09-16T07:28:21.485772+0000","last_active":"2024-09-16T07:28:22.468312+0000","last_peered":"2024-09-16T07:28:22.468312+0000","last_clean":"2024-09-16T07:28:22.468312+0000","last_became_active":"2024-09-16T07:28:21.485344+0000","last_became_peered":"2024-09-16T07:28:21.485344+0000","last_unstale":"2024-09-16T07:28:22.468312+0000","last_undegraded":"2024-09-16T07:28:22.468312+0000","last_fullsized":"2024-09-16T07:28:22.468312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:45.375465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468364+0000","last_change":"2024-09-16T07:28:20.470503+0000","last_active":"2024-09-16T07:28:22.468364+0000","last_peered":"2024-09-16T07:28:22.468364+0000","last_clean":"2024-09-16T07:28:22.468364+0000","last_became_active":"2024-09-16T07:28:20.470225+0000","last_became_peered":"2024-09-16T07:28:20.470225+0000","last_unstale":"2024-09-16T07:28:22.468364+0000","last_undegraded":"2024-09-16T07:28:22.468364+0000","last_fullsized":"2024-09-16T07:28:22.468364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:38.219355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496796+0000","last_change":"2024-09-16T07:28:21.463398+0000","last_active":"2024-09-16T07:28:22.496796+0000","last_peered":"2024-09-16T07:28:22.496796+0000","last_clean":"2024-09-16T07:28:22.496796+0000","last_became_active":"2024-09-16T07:28:21.463066+0000","last_became_peered":"2024-09-16T07:28:21.463066+0000","last_unstale":"2024-09-16T07:28:22.496796+0000","last_undegraded":"2024-09-16T07:28:22.496796+0000","last_fullsized":"2024-09-16T07:28:22.496796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496604+0000","last_change":"2024-09-16T07:28:20.469212+0000","last_active":"2024-09-16T07:28:22.496604+0000","last_peered":"2024-09-16T07:28:22.496604+0000","last_clean":"2024-09-16T07:28:22.496604+0000","last_became_active":"2024-09-16T07:28:20.468969+0000","last_became_peered":"2024-09-16T07:28:20.468969+0000","last_unstale":"2024-09-16T07:28:22.496604+0000","last_undegraded":"2024-09-16T07:28:22.496604+0000","last_fullsized":"2024-09-16T07:28:22.496604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:10.096462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465338+0000","last_change":"2024-09-16T07:28:21.480569+0000","last_active":"2024-09-16T07:28:22.465338+0000","last_peered":"2024-09-16T07:28:22.465338+0000","last_clean":"2024-09-16T07:28:22.465338+0000","last_became_active":"2024-09-16T07:28:21.480272+0000","last_became_peered":"2024-09-16T07:28:21.480272+0000","last_unstale":"2024-09-16T07:28:22.465338+0000","last_undegraded":"2024-09-16T07:28:22.465338+0000","last_fullsized":"2024-09-16T07:28:22.465338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503045+0000","last_change":"2024-09-16T07:28:20.472754+0000","last_active":"2024-09-16T07:28:22.503045+0000","last_peered":"2024-09-16T07:28:22.503045+0000","last_clean":"2024-09-16T07:28:22.503045+0000","last_became_active":"2024-09-16T07:28:20.472465+0000","last_became_peered":"2024-09-16T07:28:20.472465+0000","last_unstale":"2024-09-16T07:28:22.503045+0000","last_undegraded":"2024-09-16T07:28:22.503045+0000","last_fullsized":"2024-09-16T07:28:22.503045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549298+0000","last_change":"2024-09-16T07:28:21.478910+0000","last_active":"2024-09-16T07:28:22.549298+0000","last_peered":"2024-09-16T07:28:22.549298+0000","last_clean":"2024-09-16T07:28:22.549298+0000","last_became_active":"2024-09-16T07:28:21.478515+0000","last_became_peered":"2024-09-16T07:28:21.478515+0000","last_unstale":"2024-09-16T07:28:22.549298+0000","last_undegraded":"2024-09-16T07:28:22.549298+0000","last_fullsized":"2024-09-16T07:28:22.549298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:44.297339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467103+0000","last_change":"2024-09-16T07:28:20.459234+0000","last_active":"2024-09-16T07:28:22.467103+0000","last_peered":"2024-09-16T07:28:22.467103+0000","last_clean":"2024-09-16T07:28:22.467103+0000","last_became_active":"2024-09-16T07:28:20.459002+0000","last_became_peered":"2024-09-16T07:28:20.459002+0000","last_unstale":"2024-09-16T07:28:22.467103+0000","last_undegraded":"2024-09-16T07:28:22.467103+0000","last_fullsized":"2024-09-16T07:28:22.467103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551768+0000","last_change":"2024-09-16T07:28:21.493498+0000","last_active":"2024-09-16T07:28:22.551768+0000","last_peered":"2024-09-16T07:28:22.551768+0000","last_clean":"2024-09-16T07:28:22.551768+0000","last_became_active":"2024-09-16T07:28:21.491830+0000","last_became_peered":"2024-09-16T07:28:21.491830+0000","last_unstale":"2024-09-16T07:28:22.551768+0000","last_undegraded":"2024-09-16T07:28:22.551768+0000","last_fullsized":"2024-09-16T07:28:22.551768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:49.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496318+0000","last_change":"2024-09-16T07:28:20.461750+0000","last_active":"2024-09-16T07:28:22.496318+0000","last_peered":"2024-09-16T07:28:22.496318+0000","last_clean":"2024-09-16T07:28:22.496318+0000","last_became_active":"2024-09-16T07:28:20.460989+0000","last_became_peered":"2024-09-16T07:28:20.460989+0000","last_unstale":"2024-09-16T07:28:22.496318+0000","last_undegraded":"2024-09-16T07:28:22.496318+0000","last_fullsized":"2024-09-16T07:28:22.496318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:31.404291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464583+0000","last_change":"2024-09-16T07:28:21.469832+0000","last_active":"2024-09-16T07:28:22.464583+0000","last_peered":"2024-09-16T07:28:22.464583+0000","last_clean":"2024-09-16T07:28:22.464583+0000","last_became_active":"2024-09-16T07:28:21.469570+0000","last_became_peered":"2024-09-16T07:28:21.469570+0000","last_unstale":"2024-09-16T07:28:22.464583+0000","last_undegraded":"2024-09-16T07:28:22.464583+0000","last_fullsized":"2024-09-16T07:28:22.464583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496456+0000","last_change":"2024-09-16T07:28:20.461709+0000","last_active":"2024-09-16T07:28:22.496456+0000","last_peered":"2024-09-16T07:28:22.496456+0000","last_clean":"2024-09-16T07:28:22.496456+0000","last_became_active":"2024-09-16T07:28:20.461478+0000","last_became_peered":"2024-09-16T07:28:20.461478+0000","last_unstale":"2024-09-16T07:28:22.496456+0000","last_undegraded":"2024-09-16T07:28:22.496456+0000","last_fullsized":"2024-09-16T07:28:22.496456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:27:11.719843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465235+0000","last_change":"2024-09-16T07:28:21.481588+0000","last_active":"2024-09-16T07:28:22.465235+0000","last_peered":"2024-09-16T07:28:22.465235+0000","last_clean":"2024-09-16T07:28:22.465235+0000","last_became_active":"2024-09-16T07:28:21.481312+0000","last_became_peered":"2024-09-16T07:28:21.481312+0000","last_unstale":"2024-09-16T07:28:22.465235+0000","last_undegraded":"2024-09-16T07:28:22.465235+0000","last_fullsized":"2024-09-16T07:28:22.465235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467664+0000","last_change":"2024-09-16T07:28:20.474381+0000","last_active":"2024-09-16T07:28:22.467664+0000","last_peered":"2024-09-16T07:28:22.467664+0000","last_clean":"2024-09-16T07:28:22.467664+0000","last_became_active":"2024-09-16T07:28:20.474113+0000","last_became_peered":"2024-09-16T07:28:20.474113+0000","last_unstale":"2024-09-16T07:28:22.467664+0000","last_undegraded":"2024-09-16T07:28:22.467664+0000","last_fullsized":"2024-09-16T07:28:22.467664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:13.771645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502639+0000","last_change":"2024-09-16T07:28:21.483733+0000","last_active":"2024-09-16T07:28:22.502639+0000","last_peered":"2024-09-16T07:28:22.502639+0000","last_clean":"2024-09-16T07:28:22.502639+0000","last_became_active":"2024-09-16T07:28:21.483452+0000","last_became_peered":"2024-09-16T07:28:21.483452+0000","last_unstale":"2024-09-16T07:28:22.502639+0000","last_undegraded":"2024-09-16T07:28:22.502639+0000","last_fullsized":"2024-09-16T07:28:22.502639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467989+0000","last_change":"2024-09-16T07:28:21.502241+0000","last_active":"2024-09-16T07:28:22.467989+0000","last_peered":"2024-09-16T07:28:22.467989+0000","last_clean":"2024-09-16T07:28:22.467989+0000","last_became_active":"2024-09-16T07:28:21.500368+0000","last_became_peered":"2024-09-16T07:28:21.500368+0000","last_unstale":"2024-09-16T07:28:22.467989+0000","last_undegraded":"2024-09-16T07:28:22.467989+0000","last_fullsized":"2024-09-16T07:28:22.467989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.521033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468050+0000","last_change":"2024-09-16T07:28:20.466726+0000","last_active":"2024-09-16T07:28:22.468050+0000","last_peered":"2024-09-16T07:28:22.468050+0000","last_clean":"2024-09-16T07:28:22.468050+0000","last_became_active":"2024-09-16T07:28:20.466535+0000","last_became_peered":"2024-09-16T07:28:20.466535+0000","last_unstale":"2024-09-16T07:28:22.468050+0000","last_undegraded":"2024-09-16T07:28:22.468050+0000","last_fullsized":"2024-09-16T07:28:22.468050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467654+0000","last_change":"2024-09-16T07:28:21.499780+0000","last_active":"2024-09-16T07:28:22.467654+0000","last_peered":"2024-09-16T07:28:22.467654+0000","last_clean":"2024-09-16T07:28:22.467654+0000","last_became_active":"2024-09-16T07:28:21.499225+0000","last_became_peered":"2024-09-16T07:28:21.499225+0000","last_unstale":"2024-09-16T07:28:22.467654+0000","last_undegraded":"2024-09-16T07:28:22.467654+0000","last_fullsized":"2024-09-16T07:28:22.467654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468251+0000","last_change":"2024-09-16T07:28:20.472973+0000","last_active":"2024-09-16T07:28:22.468251+0000","last_peered":"2024-09-16T07:28:22.468251+0000","last_clean":"2024-09-16T07:28:22.468251+0000","last_became_active":"2024-09-16T07:28:20.472643+0000","last_became_peered":"2024-09-16T07:28:20.472643+0000","last_unstale":"2024-09-16T07:28:22.468251+0000","last_undegraded":"2024-09-16T07:28:22.468251+0000","last_fullsized":"2024-09-16T07:28:22.468251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:53.928004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549340+0000","last_change":"2024-09-16T07:28:21.488803+0000","last_active":"2024-09-16T07:28:22.549340+0000","last_peered":"2024-09-16T07:28:22.549340+0000","last_clean":"2024-09-16T07:28:22.549340+0000","last_became_active":"2024-09-16T07:28:21.488204+0000","last_became_peered":"2024-09-16T07:28:21.488204+0000","last_unstale":"2024-09-16T07:28:22.549340+0000","last_undegraded":"2024-09-16T07:28:22.549340+0000","last_fullsized":"2024-09-16T07:28:22.549340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:38.599962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465112+0000","last_change":"2024-09-16T07:28:20.465546+0000","last_active":"2024-09-16T07:28:22.465112+0000","last_peered":"2024-09-16T07:28:22.465112+0000","last_clean":"2024-09-16T07:28:22.465112+0000","last_became_active":"2024-09-16T07:28:20.465269+0000","last_became_peered":"2024-09-16T07:28:20.465269+0000","last_unstale":"2024-09-16T07:28:22.465112+0000","last_undegraded":"2024-09-16T07:28:22.465112+0000","last_fullsized":"2024-09-16T07:28:22.465112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465103+0000","last_change":"2024-09-16T07:28:21.475942+0000","last_active":"2024-09-16T07:28:22.465103+0000","last_peered":"2024-09-16T07:28:22.465103+0000","last_clean":"2024-09-16T07:28:22.465103+0000","last_became_active":"2024-09-16T07:28:21.475610+0000","last_became_peered":"2024-09-16T07:28:21.475610+0000","last_unstale":"2024-09-16T07:28:22.465103+0000","last_undegraded":"2024-09-16T07:28:22.465103+0000","last_fullsized":"2024-09-16T07:28:22.465103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549378+0000","last_change":"2024-09-16T07:28:20.455173+0000","last_active":"2024-09-16T07:28:22.549378+0000","last_peered":"2024-09-16T07:28:22.549378+0000","last_clean":"2024-09-16T07:28:22.549378+0000","last_became_active":"2024-09-16T07:28:20.454889+0000","last_became_peered":"2024-09-16T07:28:20.454889+0000","last_unstale":"2024-09-16T07:28:22.549378+0000","last_undegraded":"2024-09-16T07:28:22.549378+0000","last_fullsized":"2024-09-16T07:28:22.549378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:53.808988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:28:35.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:28:35.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.324+0000 7f8250400640 1 -- 172.21.15.114:0/1964128711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 msgr2=0x7f82480cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.324+0000 7f8250400640 1 --2- 172.21.15.114:0/1964128711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f82480cea20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8248073d80 tx=0x7f824001cb80 comp rx=0 tx=0).stop 2024-09-16T07:28:35.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- 172.21.15.114:0/1964128711 shutdown_connections 2024-09-16T07:28:35.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 --2- 172.21.15.114:0/1964128711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f82480cea20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 --2- 172.21.15.114:0/1964128711 >> v2:172.21.15.149:3300/0 conn(0x7f824815be80 0x7f82480ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- 172.21.15.114:0/1964128711 >> 172.21.15.114:0/1964128711 conn(0x7f82480d1da0 msgr2=0x7f82480d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:35.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- 172.21.15.114:0/1964128711 shutdown_connections 2024-09-16T07:28:35.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- 172.21.15.114:0/1964128711 wait complete. 2024-09-16T07:28:35.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 Processor -- start 2024-09-16T07:28:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- start start 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f8248151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82480d28c0 0x7f8248159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f824815be80 0x7f824815a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8248168bd0 con 0x7f82480cd8c0 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8248168a50 con 0x7f824815be80 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8248168d50 con 0x7f82480d28c0 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f8248151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f8248151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44510/0 (socket says 172.21.15.114:44510) 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 -- 172.21.15.114:0/469081412 learned_addr learned my addr 172.21.15.114:0/469081412 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824e400640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f824815be80 0x7f824815a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:35.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 -- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82480d28c0 msgr2=0x7f8248159f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82480d28c0 0x7f8248159f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 -- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f824815be80 msgr2=0x7f824815a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f824815be80 0x7f824815a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 -- 172.21.15.114:0/469081412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480c7cf0 con 0x7f82480cd8c0 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f824da00640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f8248151b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f823c00e7d0 tx=0x7f823c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8245600640 1 -- 172.21.15.114:0/469081412 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c00ccc0 con 0x7f82480cd8c0 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8245600640 1 -- 172.21.15.114:0/469081412 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f823c010430 con 0x7f82480cd8c0 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82480c7fd0 con 0x7f82480cd8c0 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8245600640 1 -- 172.21.15.114:0/469081412 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c010860 con 0x7f82480cd8c0 2024-09-16T07:28:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.328+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82480c8ab0 con 0x7f82480cd8c0 2024-09-16T07:28:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.332+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480b53f0 con 0x7f82480cd8c0 2024-09-16T07:28:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.332+0000 7f8245600640 1 -- 172.21.15.114:0/469081412 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f823c010a00 con 0x7f82480cd8c0 2024-09-16T07:28:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.332+0000 7f8245600640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8228072ef0 0x7f82280753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.332+0000 7f8245600640 1 -- 172.21.15.114:0/469081412 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f823c0947f0 con 0x7f82480cd8c0 2024-09-16T07:28:35.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.336+0000 7f824d000640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8228072ef0 0x7f82280753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:35.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.336+0000 7f8245600640 1 -- 172.21.15.114:0/469081412 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f823c05fa30 con 0x7f82480cd8c0 2024-09-16T07:28:35.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.336+0000 7f824d000640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8228072ef0 0x7f82280753b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8234007fd0 tx=0x7f8234001220 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:35.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.504+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f824806aba0 con 0x7f8228072ef0 2024-09-16T07:28:35.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.508+0000 7f8245600640 1 -- 172.21.15.114:0/469081412 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f82340557d0 con 0x7f8228072ef0 2024-09-16T07:28:35.513 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:35.516 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:28:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8228072ef0 msgr2=0x7f82280753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8228072ef0 0x7f82280753b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8234007fd0 tx=0x7f8234001220 comp rx=0 tx=0).stop 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 msgr2=0x7f8248151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f8248151b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f823c00e7d0 tx=0x7f823c00ec90 comp rx=0 tx=0).stop 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 shutdown_connections 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8228072ef0 0x7f82280753b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f824815be80 0x7f824815a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82480d28c0 0x7f8248159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 --2- 172.21.15.114:0/469081412 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82480cd8c0 0x7f8248151b10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 >> 172.21.15.114:0/469081412 conn(0x7f82480d1da0 msgr2=0x7f8248071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 shutdown_connections 2024-09-16T07:28:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.512+0000 7f8250400640 1 -- 172.21.15.114:0/469081412 wait complete. 2024-09-16T07:28:35.535 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-16T07:28:34.997567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3022848,"data_stored":1795828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003230"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468764+0000","last_change":"2024-09-16T07:28:21.494577+0000","last_active":"2024-09-16T07:28:22.468764+0000","last_peered":"2024-09-16T07:28:22.468764+0000","last_clean":"2024-09-16T07:28:22.468764+0000","last_became_active":"2024-09-16T07:28:21.493934+0000","last_became_peered":"2024-09-16T07:28:21.493934+0000","last_unstale":"2024-09-16T07:28:22.468764+0000","last_undegraded":"2024-09-16T07:28:22.468764+0000","last_fullsized":"2024-09-16T07:28:22.468764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:23:14.503112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496746+0000","last_change":"2024-09-16T07:28:21.477637+0000","last_active":"2024-09-16T07:28:22.496746+0000","last_peered":"2024-09-16T07:28:22.496746+0000","last_clean":"2024-09-16T07:28:22.496746+0000","last_became_active":"2024-09-16T07:28:21.477003+0000","last_became_peered":"2024-09-16T07:28:21.477003+0000","last_unstale":"2024-09-16T07:28:22.496746+0000","last_undegraded":"2024-09-16T07:28:22.496746+0000","last_fullsized":"2024-09-16T07:28:22.496746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549155+0000","last_change":"2024-09-16T07:28:21.481637+0000","last_active":"2024-09-16T07:28:22.549155+0000","last_peered":"2024-09-16T07:28:22.549155+0000","last_clean":"2024-09-16T07:28:22.549155+0000","last_became_active":"2024-09-16T07:28:21.481332+0000","last_became_peered":"2024-09-16T07:28:21.481332+0000","last_unstale":"2024-09-16T07:28:22.549155+0000","last_undegraded":"2024-09-16T07:28:22.549155+0000","last_fullsized":"2024-09-16T07:28:22.549155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467466+0000","last_change":"2024-09-16T07:28:21.487204+0000","last_active":"2024-09-16T07:28:22.467466+0000","last_peered":"2024-09-16T07:28:22.467466+0000","last_clean":"2024-09-16T07:28:22.467466+0000","last_became_active":"2024-09-16T07:28:21.486943+0000","last_became_peered":"2024-09-16T07:28:21.486943+0000","last_unstale":"2024-09-16T07:28:22.467466+0000","last_undegraded":"2024-09-16T07:28:22.467466+0000","last_fullsized":"2024-09-16T07:28:22.467466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467523+0000","last_change":"2024-09-16T07:28:21.484353+0000","last_active":"2024-09-16T07:28:22.467523+0000","last_peered":"2024-09-16T07:28:22.467523+0000","last_clean":"2024-09-16T07:28:22.467523+0000","last_became_active":"2024-09-16T07:28:21.484096+0000","last_became_peered":"2024-09-16T07:28:21.484096+0000","last_unstale":"2024-09-16T07:28:22.467523+0000","last_undegraded":"2024-09-16T07:28:22.467523+0000","last_fullsized":"2024-09-16T07:28:22.467523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:00.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467515+0000","last_change":"2024-09-16T07:28:21.496054+0000","last_active":"2024-09-16T07:28:22.467515+0000","last_peered":"2024-09-16T07:28:22.467515+0000","last_clean":"2024-09-16T07:28:22.467515+0000","last_became_active":"2024-09-16T07:28:21.495720+0000","last_became_peered":"2024-09-16T07:28:21.495720+0000","last_unstale":"2024-09-16T07:28:22.467515+0000","last_undegraded":"2024-09-16T07:28:22.467515+0000","last_fullsized":"2024-09-16T07:28:22.467515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467387+0000","last_change":"2024-09-16T07:28:21.486935+0000","last_active":"2024-09-16T07:28:22.467387+0000","last_peered":"2024-09-16T07:28:22.467387+0000","last_clean":"2024-09-16T07:28:22.467387+0000","last_became_active":"2024-09-16T07:28:21.486668+0000","last_became_peered":"2024-09-16T07:28:21.486668+0000","last_unstale":"2024-09-16T07:28:22.467387+0000","last_undegraded":"2024-09-16T07:28:22.467387+0000","last_fullsized":"2024-09-16T07:28:22.467387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:26.987894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464347+0000","last_change":"2024-09-16T07:28:21.488749+0000","last_active":"2024-09-16T07:28:22.464347+0000","last_peered":"2024-09-16T07:28:22.464347+0000","last_clean":"2024-09-16T07:28:22.464347+0000","last_became_active":"2024-09-16T07:28:21.488344+0000","last_became_peered":"2024-09-16T07:28:21.488344+0000","last_unstale":"2024-09-16T07:28:22.464347+0000","last_undegraded":"2024-09-16T07:28:22.464347+0000","last_fullsized":"2024-09-16T07:28:22.464347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468674+0000","last_change":"2024-09-16T07:28:21.494268+0000","last_active":"2024-09-16T07:28:22.468674+0000","last_peered":"2024-09-16T07:28:22.468674+0000","last_clean":"2024-09-16T07:28:22.468674+0000","last_became_active":"2024-09-16T07:28:21.493475+0000","last_became_peered":"2024-09-16T07:28:21.493475+0000","last_unstale":"2024-09-16T07:28:22.468674+0000","last_undegraded":"2024-09-16T07:28:22.468674+0000","last_fullsized":"2024-09-16T07:28:22.468674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:12:34.391720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503097+0000","last_change":"2024-09-16T07:28:21.483444+0000","last_active":"2024-09-16T07:28:22.503097+0000","last_peered":"2024-09-16T07:28:22.503097+0000","last_clean":"2024-09-16T07:28:22.503097+0000","last_became_active":"2024-09-16T07:28:21.477957+0000","last_became_peered":"2024-09-16T07:28:21.477957+0000","last_unstale":"2024-09-16T07:28:22.503097+0000","last_undegraded":"2024-09-16T07:28:22.503097+0000","last_fullsized":"2024-09-16T07:28:22.503097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502910+0000","last_change":"2024-09-16T07:28:21.489623+0000","last_active":"2024-09-16T07:28:22.502910+0000","last_peered":"2024-09-16T07:28:22.502910+0000","last_clean":"2024-09-16T07:28:22.502910+0000","last_became_active":"2024-09-16T07:28:21.489309+0000","last_became_peered":"2024-09-16T07:28:21.489309+0000","last_unstale":"2024-09-16T07:28:22.502910+0000","last_undegraded":"2024-09-16T07:28:22.502910+0000","last_fullsized":"2024-09-16T07:28:22.502910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551994+0000","last_change":"2024-09-16T07:28:21.478068+0000","last_active":"2024-09-16T07:28:22.551994+0000","last_peered":"2024-09-16T07:28:22.551994+0000","last_clean":"2024-09-16T07:28:22.551994+0000","last_became_active":"2024-09-16T07:28:21.477672+0000","last_became_peered":"2024-09-16T07:28:21.477672+0000","last_unstale":"2024-09-16T07:28:22.551994+0000","last_undegraded":"2024-09-16T07:28:22.551994+0000","last_fullsized":"2024-09-16T07:28:22.551994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:54.933972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464732+0000","last_change":"2024-09-16T07:28:21.476271+0000","last_active":"2024-09-16T07:28:22.464732+0000","last_peered":"2024-09-16T07:28:22.464732+0000","last_clean":"2024-09-16T07:28:22.464732+0000","last_became_active":"2024-09-16T07:28:21.475852+0000","last_became_peered":"2024-09-16T07:28:21.475852+0000","last_unstale":"2024-09-16T07:28:22.464732+0000","last_undegraded":"2024-09-16T07:28:22.464732+0000","last_fullsized":"2024-09-16T07:28:22.464732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548912+0000","last_change":"2024-09-16T07:28:21.478669+0000","last_active":"2024-09-16T07:28:22.548912+0000","last_peered":"2024-09-16T07:28:22.548912+0000","last_clean":"2024-09-16T07:28:22.548912+0000","last_became_active":"2024-09-16T07:28:21.478365+0000","last_became_peered":"2024-09-16T07:28:21.478365+0000","last_unstale":"2024-09-16T07:28:22.548912+0000","last_undegraded":"2024-09-16T07:28:22.548912+0000","last_fullsized":"2024-09-16T07:28:22.548912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:29.836351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496252+0000","last_change":"2024-09-16T07:28:21.464672+0000","last_active":"2024-09-16T07:28:22.496252+0000","last_peered":"2024-09-16T07:28:22.496252+0000","last_clean":"2024-09-16T07:28:22.496252+0000","last_became_active":"2024-09-16T07:28:21.464371+0000","last_became_peered":"2024-09-16T07:28:21.464371+0000","last_unstale":"2024-09-16T07:28:22.496252+0000","last_undegraded":"2024-09-16T07:28:22.496252+0000","last_fullsized":"2024-09-16T07:28:22.496252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467116+0000","last_change":"2024-09-16T07:28:21.495723+0000","last_active":"2024-09-16T07:28:22.467116+0000","last_peered":"2024-09-16T07:28:22.467116+0000","last_clean":"2024-09-16T07:28:22.467116+0000","last_became_active":"2024-09-16T07:28:21.495360+0000","last_became_peered":"2024-09-16T07:28:21.495360+0000","last_unstale":"2024-09-16T07:28:22.467116+0000","last_undegraded":"2024-09-16T07:28:22.467116+0000","last_fullsized":"2024-09-16T07:28:22.467116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467869+0000","last_change":"2024-09-16T07:28:21.487979+0000","last_active":"2024-09-16T07:28:22.467869+0000","last_peered":"2024-09-16T07:28:22.467869+0000","last_clean":"2024-09-16T07:28:22.467869+0000","last_became_active":"2024-09-16T07:28:21.487716+0000","last_became_peered":"2024-09-16T07:28:21.487716+0000","last_unstale":"2024-09-16T07:28:22.467869+0000","last_undegraded":"2024-09-16T07:28:22.467869+0000","last_fullsized":"2024-09-16T07:28:22.467869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548812+0000","last_change":"2024-09-16T07:28:21.473706+0000","last_active":"2024-09-16T07:28:22.548812+0000","last_peered":"2024-09-16T07:28:22.548812+0000","last_clean":"2024-09-16T07:28:22.548812+0000","last_became_active":"2024-09-16T07:28:21.472045+0000","last_became_peered":"2024-09-16T07:28:21.472045+0000","last_unstale":"2024-09-16T07:28:22.548812+0000","last_undegraded":"2024-09-16T07:28:22.548812+0000","last_fullsized":"2024-09-16T07:28:22.548812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:20.884169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468434+0000","last_change":"2024-09-16T07:28:21.483475+0000","last_active":"2024-09-16T07:28:22.468434+0000","last_peered":"2024-09-16T07:28:22.468434+0000","last_clean":"2024-09-16T07:28:22.468434+0000","last_became_active":"2024-09-16T07:28:21.483089+0000","last_became_peered":"2024-09-16T07:28:21.483089+0000","last_unstale":"2024-09-16T07:28:22.468434+0000","last_undegraded":"2024-09-16T07:28:22.468434+0000","last_fullsized":"2024-09-16T07:28:22.468434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:06.838109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502819+0000","last_change":"2024-09-16T07:28:21.484778+0000","last_active":"2024-09-16T07:28:22.502819+0000","last_peered":"2024-09-16T07:28:22.502819+0000","last_clean":"2024-09-16T07:28:22.502819+0000","last_became_active":"2024-09-16T07:28:21.484204+0000","last_became_peered":"2024-09-16T07:28:21.484204+0000","last_unstale":"2024-09-16T07:28:22.502819+0000","last_undegraded":"2024-09-16T07:28:22.502819+0000","last_fullsized":"2024-09-16T07:28:22.502819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549143+0000","last_change":"2024-09-16T07:28:21.483859+0000","last_active":"2024-09-16T07:28:22.549143+0000","last_peered":"2024-09-16T07:28:22.549143+0000","last_clean":"2024-09-16T07:28:22.549143+0000","last_became_active":"2024-09-16T07:28:21.483553+0000","last_became_peered":"2024-09-16T07:28:21.483553+0000","last_unstale":"2024-09-16T07:28:22.549143+0000","last_undegraded":"2024-09-16T07:28:22.549143+0000","last_fullsized":"2024-09-16T07:28:22.549143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:02.888442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467718+0000","last_change":"2024-09-16T07:28:21.489323+0000","last_active":"2024-09-16T07:28:22.467718+0000","last_peered":"2024-09-16T07:28:22.467718+0000","last_clean":"2024-09-16T07:28:22.467718+0000","last_became_active":"2024-09-16T07:28:21.489030+0000","last_became_peered":"2024-09-16T07:28:21.489030+0000","last_unstale":"2024-09-16T07:28:22.467718+0000","last_undegraded":"2024-09-16T07:28:22.467718+0000","last_fullsized":"2024-09-16T07:28:22.467718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464446+0000","last_change":"2024-09-16T07:28:21.486749+0000","last_active":"2024-09-16T07:28:22.464446+0000","last_peered":"2024-09-16T07:28:22.464446+0000","last_clean":"2024-09-16T07:28:22.464446+0000","last_became_active":"2024-09-16T07:28:21.486460+0000","last_became_peered":"2024-09-16T07:28:21.486460+0000","last_unstale":"2024-09-16T07:28:22.464446+0000","last_undegraded":"2024-09-16T07:28:22.464446+0000","last_fullsized":"2024-09-16T07:28:22.464446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467149+0000","last_change":"2024-09-16T07:28:21.489962+0000","last_active":"2024-09-16T07:28:22.467149+0000","last_peered":"2024-09-16T07:28:22.467149+0000","last_clean":"2024-09-16T07:28:22.467149+0000","last_became_active":"2024-09-16T07:28:21.489700+0000","last_became_peered":"2024-09-16T07:28:21.489700+0000","last_unstale":"2024-09-16T07:28:22.467149+0000","last_undegraded":"2024-09-16T07:28:22.467149+0000","last_fullsized":"2024-09-16T07:28:22.467149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465167+0000","last_change":"2024-09-16T07:28:21.475734+0000","last_active":"2024-09-16T07:28:22.465167+0000","last_peered":"2024-09-16T07:28:22.465167+0000","last_clean":"2024-09-16T07:28:22.465167+0000","last_became_active":"2024-09-16T07:28:21.474927+0000","last_became_peered":"2024-09-16T07:28:21.474927+0000","last_unstale":"2024-09-16T07:28:22.465167+0000","last_undegraded":"2024-09-16T07:28:22.465167+0000","last_fullsized":"2024-09-16T07:28:22.465167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:53.203475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503167+0000","last_change":"2024-09-16T07:28:21.491054+0000","last_active":"2024-09-16T07:28:22.503167+0000","last_peered":"2024-09-16T07:28:22.503167+0000","last_clean":"2024-09-16T07:28:22.503167+0000","last_became_active":"2024-09-16T07:28:21.490686+0000","last_became_peered":"2024-09-16T07:28:21.490686+0000","last_unstale":"2024-09-16T07:28:22.503167+0000","last_undegraded":"2024-09-16T07:28:22.503167+0000","last_fullsized":"2024-09-16T07:28:22.503167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496663+0000","last_change":"2024-09-16T07:28:21.473001+0000","last_active":"2024-09-16T07:28:22.496663+0000","last_peered":"2024-09-16T07:28:22.496663+0000","last_clean":"2024-09-16T07:28:22.496663+0000","last_became_active":"2024-09-16T07:28:21.472729+0000","last_became_peered":"2024-09-16T07:28:21.472729+0000","last_unstale":"2024-09-16T07:28:22.496663+0000","last_undegraded":"2024-09-16T07:28:22.496663+0000","last_fullsized":"2024-09-16T07:28:22.496663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:32.246845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464910+0000","last_change":"2024-09-16T07:28:21.475995+0000","last_active":"2024-09-16T07:28:22.464910+0000","last_peered":"2024-09-16T07:28:22.464910+0000","last_clean":"2024-09-16T07:28:22.464910+0000","last_became_active":"2024-09-16T07:28:21.475693+0000","last_became_peered":"2024-09-16T07:28:21.475693+0000","last_unstale":"2024-09-16T07:28:22.464910+0000","last_undegraded":"2024-09-16T07:28:22.464910+0000","last_fullsized":"2024-09-16T07:28:22.464910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:55:50.579096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549102+0000","last_change":"2024-09-16T07:28:21.480473+0000","last_active":"2024-09-16T07:28:22.549102+0000","last_peered":"2024-09-16T07:28:22.549102+0000","last_clean":"2024-09-16T07:28:22.549102+0000","last_became_active":"2024-09-16T07:28:21.480165+0000","last_became_peered":"2024-09-16T07:28:21.480165+0000","last_unstale":"2024-09-16T07:28:22.549102+0000","last_undegraded":"2024-09-16T07:28:22.549102+0000","last_fullsized":"2024-09-16T07:28:22.549102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:37.071702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467933+0000","last_change":"2024-09-16T07:28:21.500956+0000","last_active":"2024-09-16T07:28:22.467933+0000","last_peered":"2024-09-16T07:28:22.467933+0000","last_clean":"2024-09-16T07:28:22.467933+0000","last_became_active":"2024-09-16T07:28:21.500678+0000","last_became_peered":"2024-09-16T07:28:21.500678+0000","last_unstale":"2024-09-16T07:28:22.467933+0000","last_undegraded":"2024-09-16T07:28:22.467933+0000","last_fullsized":"2024-09-16T07:28:22.467933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:19:59.668925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548289+0000","last_change":"2024-09-16T07:28:21.463979+0000","last_active":"2024-09-16T07:28:22.548289+0000","last_peered":"2024-09-16T07:28:22.548289+0000","last_clean":"2024-09-16T07:28:22.548289+0000","last_became_active":"2024-09-16T07:28:21.463670+0000","last_became_peered":"2024-09-16T07:28:21.463670+0000","last_unstale":"2024-09-16T07:28:22.548289+0000","last_undegraded":"2024-09-16T07:28:22.548289+0000","last_fullsized":"2024-09-16T07:28:22.548289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:19.547512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502645+0000","last_change":"2024-09-16T07:28:21.484394+0000","last_active":"2024-09-16T07:28:22.502645+0000","last_peered":"2024-09-16T07:28:22.502645+0000","last_clean":"2024-09-16T07:28:22.502645+0000","last_became_active":"2024-09-16T07:28:21.484000+0000","last_became_peered":"2024-09-16T07:28:21.484000+0000","last_unstale":"2024-09-16T07:28:22.502645+0000","last_undegraded":"2024-09-16T07:28:22.502645+0000","last_fullsized":"2024-09-16T07:28:22.502645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:06.646512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551777+0000","last_change":"2024-09-16T07:28:21.488398+0000","last_active":"2024-09-16T07:28:22.551777+0000","last_peered":"2024-09-16T07:28:22.551777+0000","last_clean":"2024-09-16T07:28:22.551777+0000","last_became_active":"2024-09-16T07:28:21.488082+0000","last_became_peered":"2024-09-16T07:28:21.488082+0000","last_unstale":"2024-09-16T07:28:22.551777+0000","last_undegraded":"2024-09-16T07:28:22.551777+0000","last_fullsized":"2024-09-16T07:28:22.551777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:56.278436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464818+0000","last_change":"2024-09-16T07:28:20.460754+0000","last_active":"2024-09-16T07:28:22.464818+0000","last_peered":"2024-09-16T07:28:22.464818+0000","last_clean":"2024-09-16T07:28:22.464818+0000","last_became_active":"2024-09-16T07:28:20.460452+0000","last_became_peered":"2024-09-16T07:28:20.460452+0000","last_unstale":"2024-09-16T07:28:22.464818+0000","last_undegraded":"2024-09-16T07:28:22.464818+0000","last_fullsized":"2024-09-16T07:28:22.464818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:33.769857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549314+0000","last_change":"2024-09-16T07:28:21.494146+0000","last_active":"2024-09-16T07:28:22.549314+0000","last_peered":"2024-09-16T07:28:22.549314+0000","last_clean":"2024-09-16T07:28:22.549314+0000","last_became_active":"2024-09-16T07:28:21.493871+0000","last_became_peered":"2024-09-16T07:28:21.493871+0000","last_unstale":"2024-09-16T07:28:22.549314+0000","last_undegraded":"2024-09-16T07:28:22.549314+0000","last_fullsized":"2024-09-16T07:28:22.549314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:39.952179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502498+0000","last_change":"2024-09-16T07:28:20.459159+0000","last_active":"2024-09-16T07:28:22.502498+0000","last_peered":"2024-09-16T07:28:22.502498+0000","last_clean":"2024-09-16T07:28:22.502498+0000","last_became_active":"2024-09-16T07:28:20.456616+0000","last_became_peered":"2024-09-16T07:28:20.456616+0000","last_unstale":"2024-09-16T07:28:22.502498+0000","last_undegraded":"2024-09-16T07:28:22.502498+0000","last_fullsized":"2024-09-16T07:28:22.502498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464412+0000","last_change":"2024-09-16T07:28:20.462946+0000","last_active":"2024-09-16T07:28:22.464412+0000","last_peered":"2024-09-16T07:28:22.464412+0000","last_clean":"2024-09-16T07:28:22.464412+0000","last_became_active":"2024-09-16T07:28:20.462684+0000","last_became_peered":"2024-09-16T07:28:20.462684+0000","last_unstale":"2024-09-16T07:28:22.464412+0000","last_undegraded":"2024-09-16T07:28:22.464412+0000","last_fullsized":"2024-09-16T07:28:22.464412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:52.266984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464445+0000","last_change":"2024-09-16T07:28:21.476488+0000","last_active":"2024-09-16T07:28:22.464445+0000","last_peered":"2024-09-16T07:28:22.464445+0000","last_clean":"2024-09-16T07:28:22.464445+0000","last_became_active":"2024-09-16T07:28:21.475830+0000","last_became_peered":"2024-09-16T07:28:21.475830+0000","last_unstale":"2024-09-16T07:28:22.464445+0000","last_undegraded":"2024-09-16T07:28:22.464445+0000","last_fullsized":"2024-09-16T07:28:22.464445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467181+0000","last_change":"2024-09-16T07:28:20.466562+0000","last_active":"2024-09-16T07:28:22.467181+0000","last_peered":"2024-09-16T07:28:22.467181+0000","last_clean":"2024-09-16T07:28:22.467181+0000","last_became_active":"2024-09-16T07:28:20.465752+0000","last_became_peered":"2024-09-16T07:28:20.465752+0000","last_unstale":"2024-09-16T07:28:22.467181+0000","last_undegraded":"2024-09-16T07:28:22.467181+0000","last_fullsized":"2024-09-16T07:28:22.467181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496248+0000","last_change":"2024-09-16T07:28:21.469784+0000","last_active":"2024-09-16T07:28:22.496248+0000","last_peered":"2024-09-16T07:28:22.496248+0000","last_clean":"2024-09-16T07:28:22.496248+0000","last_became_active":"2024-09-16T07:28:21.469633+0000","last_became_peered":"2024-09-16T07:28:21.469633+0000","last_unstale":"2024-09-16T07:28:22.496248+0000","last_undegraded":"2024-09-16T07:28:22.496248+0000","last_fullsized":"2024-09-16T07:28:22.496248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503022+0000","last_change":"2024-09-16T07:28:20.463652+0000","last_active":"2024-09-16T07:28:22.503022+0000","last_peered":"2024-09-16T07:28:22.503022+0000","last_clean":"2024-09-16T07:28:22.503022+0000","last_became_active":"2024-09-16T07:28:20.463379+0000","last_became_peered":"2024-09-16T07:28:20.463379+0000","last_unstale":"2024-09-16T07:28:22.503022+0000","last_undegraded":"2024-09-16T07:28:22.503022+0000","last_fullsized":"2024-09-16T07:28:22.503022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468195+0000","last_change":"2024-09-16T07:28:21.500436+0000","last_active":"2024-09-16T07:28:22.468195+0000","last_peered":"2024-09-16T07:28:22.468195+0000","last_clean":"2024-09-16T07:28:22.468195+0000","last_became_active":"2024-09-16T07:28:21.500187+0000","last_became_peered":"2024-09-16T07:28:21.500187+0000","last_unstale":"2024-09-16T07:28:22.468195+0000","last_undegraded":"2024-09-16T07:28:22.468195+0000","last_fullsized":"2024-09-16T07:28:22.468195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:50:23.478685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468098+0000","last_change":"2024-09-16T07:28:20.472210+0000","last_active":"2024-09-16T07:28:22.468098+0000","last_peered":"2024-09-16T07:28:22.468098+0000","last_clean":"2024-09-16T07:28:22.468098+0000","last_became_active":"2024-09-16T07:28:20.471902+0000","last_became_peered":"2024-09-16T07:28:20.471902+0000","last_unstale":"2024-09-16T07:28:22.468098+0000","last_undegraded":"2024-09-16T07:28:22.468098+0000","last_fullsized":"2024-09-16T07:28:22.468098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:18.451800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549390+0000","last_change":"2024-09-16T07:28:21.489089+0000","last_active":"2024-09-16T07:28:22.549390+0000","last_peered":"2024-09-16T07:28:22.549390+0000","last_clean":"2024-09-16T07:28:22.549390+0000","last_became_active":"2024-09-16T07:28:21.488554+0000","last_became_peered":"2024-09-16T07:28:21.488554+0000","last_unstale":"2024-09-16T07:28:22.549390+0000","last_undegraded":"2024-09-16T07:28:22.549390+0000","last_fullsized":"2024-09-16T07:28:22.549390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:03.502755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496514+0000","last_change":"2024-09-16T07:28:20.461734+0000","last_active":"2024-09-16T07:28:22.496514+0000","last_peered":"2024-09-16T07:28:22.496514+0000","last_clean":"2024-09-16T07:28:22.496514+0000","last_became_active":"2024-09-16T07:28:20.461508+0000","last_became_peered":"2024-09-16T07:28:20.461508+0000","last_unstale":"2024-09-16T07:28:22.496514+0000","last_undegraded":"2024-09-16T07:28:22.496514+0000","last_fullsized":"2024-09-16T07:28:22.496514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:48.563809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.552021+0000","last_change":"2024-09-16T07:28:21.482206+0000","last_active":"2024-09-16T07:28:22.552021+0000","last_peered":"2024-09-16T07:28:22.552021+0000","last_clean":"2024-09-16T07:28:22.552021+0000","last_became_active":"2024-09-16T07:28:21.481551+0000","last_became_peered":"2024-09-16T07:28:21.481551+0000","last_unstale":"2024-09-16T07:28:22.552021+0000","last_undegraded":"2024-09-16T07:28:22.552021+0000","last_fullsized":"2024-09-16T07:28:22.552021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:39.225323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502717+0000","last_change":"2024-09-16T07:28:20.469828+0000","last_active":"2024-09-16T07:28:22.502717+0000","last_peered":"2024-09-16T07:28:22.502717+0000","last_clean":"2024-09-16T07:28:22.502717+0000","last_became_active":"2024-09-16T07:28:20.469327+0000","last_became_peered":"2024-09-16T07:28:20.469327+0000","last_unstale":"2024-09-16T07:28:22.502717+0000","last_undegraded":"2024-09-16T07:28:22.502717+0000","last_fullsized":"2024-09-16T07:28:22.502717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467227+0000","last_change":"2024-09-16T07:28:21.484091+0000","last_active":"2024-09-16T07:28:22.467227+0000","last_peered":"2024-09-16T07:28:22.467227+0000","last_clean":"2024-09-16T07:28:22.467227+0000","last_became_active":"2024-09-16T07:28:21.483783+0000","last_became_peered":"2024-09-16T07:28:21.483783+0000","last_unstale":"2024-09-16T07:28:22.467227+0000","last_undegraded":"2024-09-16T07:28:22.467227+0000","last_fullsized":"2024-09-16T07:28:22.467227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:07.182120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549218+0000","last_change":"2024-09-16T07:28:20.451995+0000","last_active":"2024-09-16T07:28:22.549218+0000","last_peered":"2024-09-16T07:28:22.549218+0000","last_clean":"2024-09-16T07:28:22.549218+0000","last_became_active":"2024-09-16T07:28:20.451740+0000","last_became_peered":"2024-09-16T07:28:20.451740+0000","last_unstale":"2024-09-16T07:28:22.549218+0000","last_undegraded":"2024-09-16T07:28:22.549218+0000","last_fullsized":"2024-09-16T07:28:22.549218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:50.421459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548952+0000","last_change":"2024-09-16T07:28:21.478652+0000","last_active":"2024-09-16T07:28:22.548952+0000","last_peered":"2024-09-16T07:28:22.548952+0000","last_clean":"2024-09-16T07:28:22.548952+0000","last_became_active":"2024-09-16T07:28:21.478073+0000","last_became_peered":"2024-09-16T07:28:21.478073+0000","last_unstale":"2024-09-16T07:28:22.548952+0000","last_undegraded":"2024-09-16T07:28:22.548952+0000","last_fullsized":"2024-09-16T07:28:22.548952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:19:21.305531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467810+0000","last_change":"2024-09-16T07:28:20.467427+0000","last_active":"2024-09-16T07:28:22.467810+0000","last_peered":"2024-09-16T07:28:22.467810+0000","last_clean":"2024-09-16T07:28:22.467810+0000","last_became_active":"2024-09-16T07:28:20.467214+0000","last_became_peered":"2024-09-16T07:28:20.467214+0000","last_unstale":"2024-09-16T07:28:22.467810+0000","last_undegraded":"2024-09-16T07:28:22.467810+0000","last_fullsized":"2024-09-16T07:28:22.467810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467633+0000","last_change":"2024-09-16T07:28:21.480102+0000","last_active":"2024-09-16T07:28:22.467633+0000","last_peered":"2024-09-16T07:28:22.467633+0000","last_clean":"2024-09-16T07:28:22.467633+0000","last_became_active":"2024-09-16T07:28:21.479792+0000","last_became_peered":"2024-09-16T07:28:21.479792+0000","last_unstale":"2024-09-16T07:28:22.467633+0000","last_undegraded":"2024-09-16T07:28:22.467633+0000","last_fullsized":"2024-09-16T07:28:22.467633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:01.646648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502453+0000","last_change":"2024-09-16T07:28:20.458181+0000","last_active":"2024-09-16T07:28:22.502453+0000","last_peered":"2024-09-16T07:28:22.502453+0000","last_clean":"2024-09-16T07:28:22.502453+0000","last_became_active":"2024-09-16T07:28:20.456385+0000","last_became_peered":"2024-09-16T07:28:20.456385+0000","last_unstale":"2024-09-16T07:28:22.502453+0000","last_undegraded":"2024-09-16T07:28:22.502453+0000","last_fullsized":"2024-09-16T07:28:22.502453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502619+0000","last_change":"2024-09-16T07:28:21.482950+0000","last_active":"2024-09-16T07:28:22.502619+0000","last_peered":"2024-09-16T07:28:22.502619+0000","last_clean":"2024-09-16T07:28:22.502619+0000","last_became_active":"2024-09-16T07:28:21.482427+0000","last_became_peered":"2024-09-16T07:28:21.482427+0000","last_unstale":"2024-09-16T07:28:22.502619+0000","last_undegraded":"2024-09-16T07:28:22.502619+0000","last_fullsized":"2024-09-16T07:28:22.502619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:52.301812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548130+0000","last_change":"2024-09-16T07:28:20.457548+0000","last_active":"2024-09-16T07:28:22.548130+0000","last_peered":"2024-09-16T07:28:22.548130+0000","last_clean":"2024-09-16T07:28:22.548130+0000","last_became_active":"2024-09-16T07:28:20.457151+0000","last_became_peered":"2024-09-16T07:28:20.457151+0000","last_unstale":"2024-09-16T07:28:22.548130+0000","last_undegraded":"2024-09-16T07:28:22.548130+0000","last_fullsized":"2024-09-16T07:28:22.548130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:48.914037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467591+0000","last_change":"2024-09-16T07:28:21.491418+0000","last_active":"2024-09-16T07:28:22.467591+0000","last_peered":"2024-09-16T07:28:22.467591+0000","last_clean":"2024-09-16T07:28:22.467591+0000","last_became_active":"2024-09-16T07:28:21.491157+0000","last_became_peered":"2024-09-16T07:28:21.491157+0000","last_unstale":"2024-09-16T07:28:22.467591+0000","last_undegraded":"2024-09-16T07:28:22.467591+0000","last_fullsized":"2024-09-16T07:28:22.467591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:50.263679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551843+0000","last_change":"2024-09-16T07:28:20.458574+0000","last_active":"2024-09-16T07:28:22.551843+0000","last_peered":"2024-09-16T07:28:22.551843+0000","last_clean":"2024-09-16T07:28:22.551843+0000","last_became_active":"2024-09-16T07:28:20.458268+0000","last_became_peered":"2024-09-16T07:28:20.458268+0000","last_unstale":"2024-09-16T07:28:22.551843+0000","last_undegraded":"2024-09-16T07:28:22.551843+0000","last_fullsized":"2024-09-16T07:28:22.551843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:46:58.633211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468568+0000","last_change":"2024-09-16T07:28:21.492507+0000","last_active":"2024-09-16T07:28:22.468568+0000","last_peered":"2024-09-16T07:28:22.468568+0000","last_clean":"2024-09-16T07:28:22.468568+0000","last_became_active":"2024-09-16T07:28:21.492267+0000","last_became_peered":"2024-09-16T07:28:21.492267+0000","last_unstale":"2024-09-16T07:28:22.468568+0000","last_undegraded":"2024-09-16T07:28:22.468568+0000","last_fullsized":"2024-09-16T07:28:22.468568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:02.918148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548720+0000","last_change":"2024-09-16T07:28:20.450706+0000","last_active":"2024-09-16T07:28:22.548720+0000","last_peered":"2024-09-16T07:28:22.548720+0000","last_clean":"2024-09-16T07:28:22.548720+0000","last_became_active":"2024-09-16T07:28:20.450379+0000","last_became_peered":"2024-09-16T07:28:20.450379+0000","last_unstale":"2024-09-16T07:28:22.548720+0000","last_undegraded":"2024-09-16T07:28:22.548720+0000","last_fullsized":"2024-09-16T07:28:22.548720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:37.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468790+0000","last_change":"2024-09-16T07:28:21.480183+0000","last_active":"2024-09-16T07:28:22.468790+0000","last_peered":"2024-09-16T07:28:22.468790+0000","last_clean":"2024-09-16T07:28:22.468790+0000","last_became_active":"2024-09-16T07:28:21.479807+0000","last_became_peered":"2024-09-16T07:28:21.479807+0000","last_unstale":"2024-09-16T07:28:22.468790+0000","last_undegraded":"2024-09-16T07:28:22.468790+0000","last_fullsized":"2024-09-16T07:28:22.468790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:35.281982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496622+0000","last_change":"2024-09-16T07:28:20.456101+0000","last_active":"2024-09-16T07:28:22.496622+0000","last_peered":"2024-09-16T07:28:22.496622+0000","last_clean":"2024-09-16T07:28:22.496622+0000","last_became_active":"2024-09-16T07:28:20.453929+0000","last_became_peered":"2024-09-16T07:28:20.453929+0000","last_unstale":"2024-09-16T07:28:22.496622+0000","last_undegraded":"2024-09-16T07:28:22.496622+0000","last_fullsized":"2024-09-16T07:28:22.496622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:53.936877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467874+0000","last_change":"2024-09-16T07:28:21.499515+0000","last_active":"2024-09-16T07:28:22.467874+0000","last_peered":"2024-09-16T07:28:22.467874+0000","last_clean":"2024-09-16T07:28:22.467874+0000","last_became_active":"2024-09-16T07:28:21.490747+0000","last_became_peered":"2024-09-16T07:28:21.490747+0000","last_unstale":"2024-09-16T07:28:22.467874+0000","last_undegraded":"2024-09-16T07:28:22.467874+0000","last_fullsized":"2024-09-16T07:28:22.467874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:32.209796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548601+0000","last_change":"2024-09-16T07:28:20.465122+0000","last_active":"2024-09-16T07:28:22.548601+0000","last_peered":"2024-09-16T07:28:22.548601+0000","last_clean":"2024-09-16T07:28:22.548601+0000","last_became_active":"2024-09-16T07:28:20.464580+0000","last_became_peered":"2024-09-16T07:28:20.464580+0000","last_unstale":"2024-09-16T07:28:22.548601+0000","last_undegraded":"2024-09-16T07:28:22.548601+0000","last_fullsized":"2024-09-16T07:28:22.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:50.567918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467440+0000","last_change":"2024-09-16T07:28:21.488112+0000","last_active":"2024-09-16T07:28:22.467440+0000","last_peered":"2024-09-16T07:28:22.467440+0000","last_clean":"2024-09-16T07:28:22.467440+0000","last_became_active":"2024-09-16T07:28:21.487902+0000","last_became_peered":"2024-09-16T07:28:21.487902+0000","last_unstale":"2024-09-16T07:28:22.467440+0000","last_undegraded":"2024-09-16T07:28:22.467440+0000","last_fullsized":"2024-09-16T07:28:22.467440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:27.706301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467313+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:28:22.467313+0000","last_peered":"2024-09-16T07:28:22.467313+0000","last_clean":"2024-09-16T07:28:22.467313+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:28:22.467313+0000","last_undegraded":"2024-09-16T07:28:22.467313+0000","last_fullsized":"2024-09-16T07:28:22.467313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.466990+0000","last_change":"2024-09-16T07:28:20.460935+0000","last_active":"2024-09-16T07:28:22.466990+0000","last_peered":"2024-09-16T07:28:22.466990+0000","last_clean":"2024-09-16T07:28:22.466990+0000","last_became_active":"2024-09-16T07:28:20.460629+0000","last_became_peered":"2024-09-16T07:28:20.460629+0000","last_unstale":"2024-09-16T07:28:22.466990+0000","last_undegraded":"2024-09-16T07:28:22.466990+0000","last_fullsized":"2024-09-16T07:28:22.466990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464687+0000","last_change":"2024-09-16T07:28:21.488741+0000","last_active":"2024-09-16T07:28:22.464687+0000","last_peered":"2024-09-16T07:28:22.464687+0000","last_clean":"2024-09-16T07:28:22.464687+0000","last_became_active":"2024-09-16T07:28:21.488257+0000","last_became_peered":"2024-09-16T07:28:21.488257+0000","last_unstale":"2024-09-16T07:28:22.464687+0000","last_undegraded":"2024-09-16T07:28:22.464687+0000","last_fullsized":"2024-09-16T07:28:22.464687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:39:24.372408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467205+0000","last_change":"2024-09-16T07:28:20.467488+0000","last_active":"2024-09-16T07:28:22.467205+0000","last_peered":"2024-09-16T07:28:22.467205+0000","last_clean":"2024-09-16T07:28:22.467205+0000","last_became_active":"2024-09-16T07:28:20.466897+0000","last_became_peered":"2024-09-16T07:28:20.466897+0000","last_unstale":"2024-09-16T07:28:22.467205+0000","last_undegraded":"2024-09-16T07:28:22.467205+0000","last_fullsized":"2024-09-16T07:28:22.467205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548576+0000","last_change":"2024-09-16T07:28:21.494039+0000","last_active":"2024-09-16T07:28:22.548576+0000","last_peered":"2024-09-16T07:28:22.548576+0000","last_clean":"2024-09-16T07:28:22.548576+0000","last_became_active":"2024-09-16T07:28:21.493705+0000","last_became_peered":"2024-09-16T07:28:21.493705+0000","last_unstale":"2024-09-16T07:28:22.548576+0000","last_undegraded":"2024-09-16T07:28:22.548576+0000","last_fullsized":"2024-09-16T07:28:22.548576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:06:41.494621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.548390+0000","last_change":"2024-09-16T07:28:20.453271+0000","last_active":"2024-09-16T07:28:22.548390+0000","last_peered":"2024-09-16T07:28:22.548390+0000","last_clean":"2024-09-16T07:28:22.548390+0000","last_became_active":"2024-09-16T07:28:20.452985+0000","last_became_peered":"2024-09-16T07:28:20.452985+0000","last_unstale":"2024-09-16T07:28:22.548390+0000","last_undegraded":"2024-09-16T07:28:22.548390+0000","last_fullsized":"2024-09-16T07:28:22.548390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:08.366019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496234+0000","last_change":"2024-09-16T07:28:21.464203+0000","last_active":"2024-09-16T07:28:22.496234+0000","last_peered":"2024-09-16T07:28:22.496234+0000","last_clean":"2024-09-16T07:28:22.496234+0000","last_became_active":"2024-09-16T07:28:21.463943+0000","last_became_peered":"2024-09-16T07:28:21.463943+0000","last_unstale":"2024-09-16T07:28:22.496234+0000","last_undegraded":"2024-09-16T07:28:22.496234+0000","last_fullsized":"2024-09-16T07:28:22.496234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:10.337642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467921+0000","last_change":"2024-09-16T07:28:20.459755+0000","last_active":"2024-09-16T07:28:22.467921+0000","last_peered":"2024-09-16T07:28:22.467921+0000","last_clean":"2024-09-16T07:28:22.467921+0000","last_became_active":"2024-09-16T07:28:20.459383+0000","last_became_peered":"2024-09-16T07:28:20.459383+0000","last_unstale":"2024-09-16T07:28:22.467921+0000","last_undegraded":"2024-09-16T07:28:22.467921+0000","last_fullsized":"2024-09-16T07:28:22.467921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:40:55.272468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551881+0000","last_change":"2024-09-16T07:28:21.490524+0000","last_active":"2024-09-16T07:28:22.551881+0000","last_peered":"2024-09-16T07:28:22.551881+0000","last_clean":"2024-09-16T07:28:22.551881+0000","last_became_active":"2024-09-16T07:28:21.490245+0000","last_became_peered":"2024-09-16T07:28:21.490245+0000","last_unstale":"2024-09-16T07:28:22.551881+0000","last_undegraded":"2024-09-16T07:28:22.551881+0000","last_fullsized":"2024-09-16T07:28:22.551881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.777612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496506+0000","last_change":"2024-09-16T07:28:20.460535+0000","last_active":"2024-09-16T07:28:22.496506+0000","last_peered":"2024-09-16T07:28:22.496506+0000","last_clean":"2024-09-16T07:28:22.496506+0000","last_became_active":"2024-09-16T07:28:20.456847+0000","last_became_peered":"2024-09-16T07:28:20.456847+0000","last_unstale":"2024-09-16T07:28:22.496506+0000","last_undegraded":"2024-09-16T07:28:22.496506+0000","last_fullsized":"2024-09-16T07:28:22.496506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:09:04.534477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468312+0000","last_change":"2024-09-16T07:28:21.485772+0000","last_active":"2024-09-16T07:28:22.468312+0000","last_peered":"2024-09-16T07:28:22.468312+0000","last_clean":"2024-09-16T07:28:22.468312+0000","last_became_active":"2024-09-16T07:28:21.485344+0000","last_became_peered":"2024-09-16T07:28:21.485344+0000","last_unstale":"2024-09-16T07:28:22.468312+0000","last_undegraded":"2024-09-16T07:28:22.468312+0000","last_fullsized":"2024-09-16T07:28:22.468312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:45.375465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468364+0000","last_change":"2024-09-16T07:28:20.470503+0000","last_active":"2024-09-16T07:28:22.468364+0000","last_peered":"2024-09-16T07:28:22.468364+0000","last_clean":"2024-09-16T07:28:22.468364+0000","last_became_active":"2024-09-16T07:28:20.470225+0000","last_became_peered":"2024-09-16T07:28:20.470225+0000","last_unstale":"2024-09-16T07:28:22.468364+0000","last_undegraded":"2024-09-16T07:28:22.468364+0000","last_fullsized":"2024-09-16T07:28:22.468364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:38.219355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496796+0000","last_change":"2024-09-16T07:28:21.463398+0000","last_active":"2024-09-16T07:28:22.496796+0000","last_peered":"2024-09-16T07:28:22.496796+0000","last_clean":"2024-09-16T07:28:22.496796+0000","last_became_active":"2024-09-16T07:28:21.463066+0000","last_became_peered":"2024-09-16T07:28:21.463066+0000","last_unstale":"2024-09-16T07:28:22.496796+0000","last_undegraded":"2024-09-16T07:28:22.496796+0000","last_fullsized":"2024-09-16T07:28:22.496796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496604+0000","last_change":"2024-09-16T07:28:20.469212+0000","last_active":"2024-09-16T07:28:22.496604+0000","last_peered":"2024-09-16T07:28:22.496604+0000","last_clean":"2024-09-16T07:28:22.496604+0000","last_became_active":"2024-09-16T07:28:20.468969+0000","last_became_peered":"2024-09-16T07:28:20.468969+0000","last_unstale":"2024-09-16T07:28:22.496604+0000","last_undegraded":"2024-09-16T07:28:22.496604+0000","last_fullsized":"2024-09-16T07:28:22.496604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:10.096462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465338+0000","last_change":"2024-09-16T07:28:21.480569+0000","last_active":"2024-09-16T07:28:22.465338+0000","last_peered":"2024-09-16T07:28:22.465338+0000","last_clean":"2024-09-16T07:28:22.465338+0000","last_became_active":"2024-09-16T07:28:21.480272+0000","last_became_peered":"2024-09-16T07:28:21.480272+0000","last_unstale":"2024-09-16T07:28:22.465338+0000","last_undegraded":"2024-09-16T07:28:22.465338+0000","last_fullsized":"2024-09-16T07:28:22.465338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:17.659179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.503045+0000","last_change":"2024-09-16T07:28:20.472754+0000","last_active":"2024-09-16T07:28:22.503045+0000","last_peered":"2024-09-16T07:28:22.503045+0000","last_clean":"2024-09-16T07:28:22.503045+0000","last_became_active":"2024-09-16T07:28:20.472465+0000","last_became_peered":"2024-09-16T07:28:20.472465+0000","last_unstale":"2024-09-16T07:28:22.503045+0000","last_undegraded":"2024-09-16T07:28:22.503045+0000","last_fullsized":"2024-09-16T07:28:22.503045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549298+0000","last_change":"2024-09-16T07:28:21.478910+0000","last_active":"2024-09-16T07:28:22.549298+0000","last_peered":"2024-09-16T07:28:22.549298+0000","last_clean":"2024-09-16T07:28:22.549298+0000","last_became_active":"2024-09-16T07:28:21.478515+0000","last_became_peered":"2024-09-16T07:28:21.478515+0000","last_unstale":"2024-09-16T07:28:22.549298+0000","last_undegraded":"2024-09-16T07:28:22.549298+0000","last_fullsized":"2024-09-16T07:28:22.549298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:44.297339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467103+0000","last_change":"2024-09-16T07:28:20.459234+0000","last_active":"2024-09-16T07:28:22.467103+0000","last_peered":"2024-09-16T07:28:22.467103+0000","last_clean":"2024-09-16T07:28:22.467103+0000","last_became_active":"2024-09-16T07:28:20.459002+0000","last_became_peered":"2024-09-16T07:28:20.459002+0000","last_unstale":"2024-09-16T07:28:22.467103+0000","last_undegraded":"2024-09-16T07:28:22.467103+0000","last_fullsized":"2024-09-16T07:28:22.467103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:02:58.555524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.551768+0000","last_change":"2024-09-16T07:28:21.493498+0000","last_active":"2024-09-16T07:28:22.551768+0000","last_peered":"2024-09-16T07:28:22.551768+0000","last_clean":"2024-09-16T07:28:22.551768+0000","last_became_active":"2024-09-16T07:28:21.491830+0000","last_became_peered":"2024-09-16T07:28:21.491830+0000","last_unstale":"2024-09-16T07:28:22.551768+0000","last_undegraded":"2024-09-16T07:28:22.551768+0000","last_fullsized":"2024-09-16T07:28:22.551768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:49.569777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496318+0000","last_change":"2024-09-16T07:28:20.461750+0000","last_active":"2024-09-16T07:28:22.496318+0000","last_peered":"2024-09-16T07:28:22.496318+0000","last_clean":"2024-09-16T07:28:22.496318+0000","last_became_active":"2024-09-16T07:28:20.460989+0000","last_became_peered":"2024-09-16T07:28:20.460989+0000","last_unstale":"2024-09-16T07:28:22.496318+0000","last_undegraded":"2024-09-16T07:28:22.496318+0000","last_fullsized":"2024-09-16T07:28:22.496318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:06:31.404291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.464583+0000","last_change":"2024-09-16T07:28:21.469832+0000","last_active":"2024-09-16T07:28:22.464583+0000","last_peered":"2024-09-16T07:28:22.464583+0000","last_clean":"2024-09-16T07:28:22.464583+0000","last_became_active":"2024-09-16T07:28:21.469570+0000","last_became_peered":"2024-09-16T07:28:21.469570+0000","last_unstale":"2024-09-16T07:28:22.464583+0000","last_undegraded":"2024-09-16T07:28:22.464583+0000","last_fullsized":"2024-09-16T07:28:22.464583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:39.573320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.496456+0000","last_change":"2024-09-16T07:28:20.461709+0000","last_active":"2024-09-16T07:28:22.496456+0000","last_peered":"2024-09-16T07:28:22.496456+0000","last_clean":"2024-09-16T07:28:22.496456+0000","last_became_active":"2024-09-16T07:28:20.461478+0000","last_became_peered":"2024-09-16T07:28:20.461478+0000","last_unstale":"2024-09-16T07:28:22.496456+0000","last_undegraded":"2024-09-16T07:28:22.496456+0000","last_fullsized":"2024-09-16T07:28:22.496456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:27:11.719843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465235+0000","last_change":"2024-09-16T07:28:21.481588+0000","last_active":"2024-09-16T07:28:22.465235+0000","last_peered":"2024-09-16T07:28:22.465235+0000","last_clean":"2024-09-16T07:28:22.465235+0000","last_became_active":"2024-09-16T07:28:21.481312+0000","last_became_peered":"2024-09-16T07:28:21.481312+0000","last_unstale":"2024-09-16T07:28:22.465235+0000","last_undegraded":"2024-09-16T07:28:22.465235+0000","last_fullsized":"2024-09-16T07:28:22.465235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467664+0000","last_change":"2024-09-16T07:28:20.474381+0000","last_active":"2024-09-16T07:28:22.467664+0000","last_peered":"2024-09-16T07:28:22.467664+0000","last_clean":"2024-09-16T07:28:22.467664+0000","last_became_active":"2024-09-16T07:28:20.474113+0000","last_became_peered":"2024-09-16T07:28:20.474113+0000","last_unstale":"2024-09-16T07:28:22.467664+0000","last_undegraded":"2024-09-16T07:28:22.467664+0000","last_fullsized":"2024-09-16T07:28:22.467664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:13.771645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.502639+0000","last_change":"2024-09-16T07:28:21.483733+0000","last_active":"2024-09-16T07:28:22.502639+0000","last_peered":"2024-09-16T07:28:22.502639+0000","last_clean":"2024-09-16T07:28:22.502639+0000","last_became_active":"2024-09-16T07:28:21.483452+0000","last_became_peered":"2024-09-16T07:28:21.483452+0000","last_unstale":"2024-09-16T07:28:22.502639+0000","last_undegraded":"2024-09-16T07:28:22.502639+0000","last_fullsized":"2024-09-16T07:28:22.502639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:11.455532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467989+0000","last_change":"2024-09-16T07:28:21.502241+0000","last_active":"2024-09-16T07:28:22.467989+0000","last_peered":"2024-09-16T07:28:22.467989+0000","last_clean":"2024-09-16T07:28:22.467989+0000","last_became_active":"2024-09-16T07:28:21.500368+0000","last_became_peered":"2024-09-16T07:28:21.500368+0000","last_unstale":"2024-09-16T07:28:22.467989+0000","last_undegraded":"2024-09-16T07:28:22.467989+0000","last_fullsized":"2024-09-16T07:28:22.467989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.521033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468050+0000","last_change":"2024-09-16T07:28:20.466726+0000","last_active":"2024-09-16T07:28:22.468050+0000","last_peered":"2024-09-16T07:28:22.468050+0000","last_clean":"2024-09-16T07:28:22.468050+0000","last_became_active":"2024-09-16T07:28:20.466535+0000","last_became_peered":"2024-09-16T07:28:20.466535+0000","last_unstale":"2024-09-16T07:28:22.468050+0000","last_undegraded":"2024-09-16T07:28:22.468050+0000","last_fullsized":"2024-09-16T07:28:22.468050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:36.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.467654+0000","last_change":"2024-09-16T07:28:21.499780+0000","last_active":"2024-09-16T07:28:22.467654+0000","last_peered":"2024-09-16T07:28:22.467654+0000","last_clean":"2024-09-16T07:28:22.467654+0000","last_became_active":"2024-09-16T07:28:21.499225+0000","last_became_peered":"2024-09-16T07:28:21.499225+0000","last_unstale":"2024-09-16T07:28:22.467654+0000","last_undegraded":"2024-09-16T07:28:22.467654+0000","last_fullsized":"2024-09-16T07:28:22.467654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:41.693819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.468251+0000","last_change":"2024-09-16T07:28:20.472973+0000","last_active":"2024-09-16T07:28:22.468251+0000","last_peered":"2024-09-16T07:28:22.468251+0000","last_clean":"2024-09-16T07:28:22.468251+0000","last_became_active":"2024-09-16T07:28:20.472643+0000","last_became_peered":"2024-09-16T07:28:20.472643+0000","last_unstale":"2024-09-16T07:28:22.468251+0000","last_undegraded":"2024-09-16T07:28:22.468251+0000","last_fullsized":"2024-09-16T07:28:22.468251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:24:53.928004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549340+0000","last_change":"2024-09-16T07:28:21.488803+0000","last_active":"2024-09-16T07:28:22.549340+0000","last_peered":"2024-09-16T07:28:22.549340+0000","last_clean":"2024-09-16T07:28:22.549340+0000","last_became_active":"2024-09-16T07:28:21.488204+0000","last_became_peered":"2024-09-16T07:28:21.488204+0000","last_unstale":"2024-09-16T07:28:22.549340+0000","last_undegraded":"2024-09-16T07:28:22.549340+0000","last_fullsized":"2024-09-16T07:28:22.549340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:38.599962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465112+0000","last_change":"2024-09-16T07:28:20.465546+0000","last_active":"2024-09-16T07:28:22.465112+0000","last_peered":"2024-09-16T07:28:22.465112+0000","last_clean":"2024-09-16T07:28:22.465112+0000","last_became_active":"2024-09-16T07:28:20.465269+0000","last_became_peered":"2024-09-16T07:28:20.465269+0000","last_unstale":"2024-09-16T07:28:22.465112+0000","last_undegraded":"2024-09-16T07:28:22.465112+0000","last_fullsized":"2024-09-16T07:28:22.465112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:49.039694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.465103+0000","last_change":"2024-09-16T07:28:21.475942+0000","last_active":"2024-09-16T07:28:22.465103+0000","last_peered":"2024-09-16T07:28:22.465103+0000","last_clean":"2024-09-16T07:28:22.465103+0000","last_became_active":"2024-09-16T07:28:21.475610+0000","last_became_peered":"2024-09-16T07:28:21.475610+0000","last_unstale":"2024-09-16T07:28:22.465103+0000","last_undegraded":"2024-09-16T07:28:22.465103+0000","last_fullsized":"2024-09-16T07:28:22.465103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:20.431125+0000","last_clean_scrub_stamp":"2024-09-16T07:28:20.431125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:32.641427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T07:28:22.549378+0000","last_change":"2024-09-16T07:28:20.455173+0000","last_active":"2024-09-16T07:28:22.549378+0000","last_peered":"2024-09-16T07:28:22.549378+0000","last_clean":"2024-09-16T07:28:22.549378+0000","last_became_active":"2024-09-16T07:28:20.454889+0000","last_became_peered":"2024-09-16T07:28:20.454889+0000","last_unstale":"2024-09-16T07:28:22.549378+0000","last_undegraded":"2024-09-16T07:28:22.549378+0000","last_fullsized":"2024-09-16T07:28:22.549378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:19.425157+0000","last_clean_scrub_stamp":"2024-09-16T07:28:19.425157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:53.808988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":233472,"data_stored":76410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":77896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":667290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:28:35.539 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:28:35.539 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T07:28:35.539 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T07:28:35.539 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T07:28:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- 172.21.15.114:0/3716695698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 msgr2=0x7f1ac015fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/3716695698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac015fec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009900 tx=0x7f1ab001c690 comp rx=0 tx=0).stop 2024-09-16T07:28:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- 172.21.15.114:0/3716695698 shutdown_connections 2024-09-16T07:28:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/3716695698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac015fec0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/3716695698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac00cfe80 0x7f1ac00d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- 172.21.15.114:0/3716695698 >> 172.21.15.114:0/3716695698 conn(0x7f1ac00d1e40 msgr2=0x7f1ac00d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- 172.21.15.114:0/3716695698 shutdown_connections 2024-09-16T07:28:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- 172.21.15.114:0/3716695698 wait complete. 2024-09-16T07:28:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 Processor -- start 2024-09-16T07:28:35.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- start start 2024-09-16T07:28:35.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac00cfe80 0x7f1ac00cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac0160400 0x7f1ac00c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0169570 con 0x7f1ac00b2d00 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac01693f0 con 0x7f1ac00cfe80 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac01696f0 con 0x7f1ac0160400 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac006dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44538/0 (socket says 172.21.15.114:44538) 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 -- 172.21.15.114:0/785469254 learned_addr learned my addr 172.21.15.114:0/785469254 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac4a00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac00cfe80 0x7f1ac00cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac0160400 0x7f1ac00c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 -- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac0160400 msgr2=0x7f1ac00c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac0160400 0x7f1ac00c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 -- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac00cfe80 msgr2=0x7f1ac00cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac00cfe80 0x7f1ac00cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5400640 1 -- 172.21.15.114:0/785469254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac006e5a0 con 0x7f1ac00b2d00 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.720+0000 7f1ac5e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac0160400 0x7f1ac00c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1ac5400640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac006dd30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400b4a0 tx=0x7f1ab400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1abd600640 1 -- 172.21.15.114:0/785469254 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4014070 con 0x7f1ac00b2d00 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1abd600640 1 -- 172.21.15.114:0/785469254 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ab4010720 con 0x7f1ac00b2d00 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac00c82b0 con 0x7f1ac00b2d00 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1abd600640 1 -- 172.21.15.114:0/785469254 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4010b70 con 0x7f1ac00b2d00 2024-09-16T07:28:35.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac00c8850 con 0x7f1ac00b2d00 2024-09-16T07:28:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac00c8a90 con 0x7f1ac00b2d00 2024-09-16T07:28:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1abd600640 1 -- 172.21.15.114:0/785469254 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1ab4017070 con 0x7f1ac00b2d00 2024-09-16T07:28:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1abd600640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1aa4072ef0 0x7f1aa40753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:35.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1abd600640 1 -- 172.21.15.114:0/785469254 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1ab4093950 con 0x7f1ac00b2d00 2024-09-16T07:28:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.724+0000 7f1ac4a00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1aa4072ef0 0x7f1aa40753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:35.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.728+0000 7f1ac4a00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1aa4072ef0 0x7f1aa40753b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00ae000 tx=0x7f1ab001aed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:35.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.728+0000 7f1abd600640 1 -- 172.21.15.114:0/785469254 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1ab405eb00 con 0x7f1ac00b2d00 2024-09-16T07:28:35.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.932+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1ac0072410 con 0x7f1ac00b2d00 2024-09-16T07:28:35.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.932+0000 7f1abd600640 1 -- 172.21.15.114:0/785469254 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1ab405e400 con 0x7f1ac00b2d00 2024-09-16T07:28:35.937 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:35.937 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T07:28:35.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.932+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1aa4072ef0 msgr2=0x7f1aa40753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.932+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1aa4072ef0 0x7f1aa40753b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00ae000 tx=0x7f1ab001aed0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.932+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 msgr2=0x7f1ac006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:35.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.932+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac006dd30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400b4a0 tx=0x7f1ab400b960 comp rx=0 tx=0).stop 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 shutdown_connections 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1aa4072ef0 0x7f1aa40753b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac0160400 0x7f1ac00c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac00cfe80 0x7f1ac00cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 --2- 172.21.15.114:0/785469254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ac00b2d00 0x7f1ac006dd30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 >> 172.21.15.114:0/785469254 conn(0x7f1ac00d1e40 msgr2=0x7f1ac00b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 shutdown_connections 2024-09-16T07:28:35.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:35.936+0000 7f1ac7e00640 1 -- 172.21.15.114:0/785469254 wait complete. 2024-09-16T07:28:35.958 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T07:28:35.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:36.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3030439335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80cebf0 msgr2=0x7fa3f80cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3030439335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80cebf0 0x7fa3f80cc8b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009870 tx=0x7fa3e401c860 comp rx=0 tx=0).stop 2024-09-16T07:28:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3030439335 shutdown_connections 2024-09-16T07:28:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3030439335 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80cebf0 0x7fa3f80cc8b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3030439335 >> 172.21.15.114:0/3030439335 conn(0x7fa3f80d1da0 msgr2=0x7fa3f80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3030439335 shutdown_connections 2024-09-16T07:28:36.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3030439335 wait complete. 2024-09-16T07:28:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 Processor -- start 2024-09-16T07:28:36.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- start start 2024-09-16T07:28:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80b6400 0x7fa3f8154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f80cebf0 0x7fa3f8158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f815be80 0x7fa3f8153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f816a360 con 0x7fa3f80cebf0 2024-09-16T07:28:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f816a1e0 con 0x7fa3f815be80 2024-09-16T07:28:36.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3ffc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa3f816a4e0 con 0x7fa3f80b6400 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f80cebf0 0x7fa3f8158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f80cebf0 0x7fa3f8158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44552/0 (socket says 172.21.15.114:44552) 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 -- 172.21.15.114:0/3396342685 learned_addr learned my addr 172.21.15.114:0/3396342685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3fd200640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80b6400 0x7fa3f8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3fdc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f815be80 0x7fa3f8153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 -- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80b6400 msgr2=0x7fa3f8154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80b6400 0x7fa3f8154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 -- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f815be80 msgr2=0x7fa3f8153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f815be80 0x7fa3f8153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 -- 172.21.15.114:0/3396342685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f8154fe0 con 0x7fa3f80cebf0 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3fdc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f815be80 0x7fa3f8153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:36.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.096+0000 7fa3f7e00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f80cebf0 0x7fa3f8158560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4019470 tx=0x7fa3e4005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3f4c00640 1 -- 172.21.15.114:0/3396342685 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e40b2040 con 0x7fa3f80cebf0 2024-09-16T07:28:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3f4c00640 1 -- 172.21.15.114:0/3396342685 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3e40041f0 con 0x7fa3f80cebf0 2024-09-16T07:28:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3f4c00640 1 -- 172.21.15.114:0/3396342685 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4003600 con 0x7fa3f80cebf0 2024-09-16T07:28:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f81552c0 con 0x7fa3f80cebf0 2024-09-16T07:28:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f8154650 con 0x7fa3f80cebf0 2024-09-16T07:28:36.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f80ce4e0 con 0x7fa3f80cebf0 2024-09-16T07:28:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3f4c00640 1 -- 172.21.15.114:0/3396342685 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fa3e40bd030 con 0x7fa3f80cebf0 2024-09-16T07:28:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3f4c00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa3d8072ec0 0x7fa3d8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3f4c00640 1 -- 172.21.15.114:0/3396342685 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa3e412da90 con 0x7fa3f80cebf0 2024-09-16T07:28:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.100+0000 7fa3fd200640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa3d8072ec0 0x7fa3d8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.104+0000 7fa3fd200640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa3d8072ec0 0x7fa3d8075380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80012f0 tx=0x7fa3e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:36.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.104+0000 7fa3f4c00640 1 -- 172.21.15.114:0/3396342685 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa3e40c4020 con 0x7fa3f80cebf0 2024-09-16T07:28:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.304+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f8070da0 con 0x7fa3f80cebf0 2024-09-16T07:28:36.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.304+0000 7fa3f4c00640 1 -- 172.21.15.114:0/3396342685 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fa3e40ff030 con 0x7fa3f80cebf0 2024-09-16T07:28:36.311 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:36.311 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:36.311 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa3d8072ec0 msgr2=0x7fa3d8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa3d8072ec0 0x7fa3d8075380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80012f0 tx=0x7fa3e8009040 comp rx=0 tx=0).stop 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f80cebf0 msgr2=0x7fa3f8158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f80cebf0 0x7fa3f8158560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4019470 tx=0x7fa3e4005db0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 shutdown_connections 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa3d8072ec0 0x7fa3d8075380 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3f815be80 0x7fa3f8153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3f80cebf0 0x7fa3f8158560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 --2- 172.21.15.114:0/3396342685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3f80b6400 0x7fa3f8154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 >> 172.21.15.114:0/3396342685 conn(0x7fa3f80d1da0 msgr2=0x7fa3f815b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:36.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 shutdown_connections 2024-09-16T07:28:36.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.308+0000 7fa3ffc00640 1 -- 172.21.15.114:0/3396342685 wait complete. 2024-09-16T07:28:36.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:36.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- 172.21.15.114:0/4158259243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c0b42d0 msgr2=0x7f4d6c0af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 --2- 172.21.15.114:0/4158259243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c0b42d0 0x7f4d6c0af880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009c80 tx=0x7f4d6401cc80 comp rx=0 tx=0).stop 2024-09-16T07:28:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- 172.21.15.114:0/4158259243 shutdown_connections 2024-09-16T07:28:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 --2- 172.21.15.114:0/4158259243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c0b42d0 0x7f4d6c0af880 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 --2- 172.21.15.114:0/4158259243 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d6c071940 0x7f4d6c0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- 172.21.15.114:0/4158259243 >> 172.21.15.114:0/4158259243 conn(0x7f4d6c0b37b0 msgr2=0x7f4d6c0b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- 172.21.15.114:0/4158259243 shutdown_connections 2024-09-16T07:28:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- 172.21.15.114:0/4158259243 wait complete. 2024-09-16T07:28:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 Processor -- start 2024-09-16T07:28:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- start start 2024-09-16T07:28:36.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c071940 0x7f4d6c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d6c0b42d0 0x7f4d6c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c160310 0x7f4d6c1f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b0b80 con 0x7f4d6c071940 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b0a00 con 0x7f4d6c160310 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c168c50 con 0x7f4d6c0b42d0 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c071940 0x7f4d6c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c071940 0x7f4d6c06ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44568/0 (socket says 172.21.15.114:44568) 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 -- 172.21.15.114:0/2217593382 learned_addr learned my addr 172.21.15.114:0/2217593382 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d62000640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d6c0b42d0 0x7f4d6c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6b400640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c160310 0x7f4d6c1f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 -- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d6c0b42d0 msgr2=0x7f4d6c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d6c0b42d0 0x7f4d6c14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 -- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c160310 msgr2=0x7f4d6c1f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c160310 0x7f4d6c1f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 -- 172.21.15.114:0/2217593382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c06fc40 con 0x7f4d6c071940 2024-09-16T07:28:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.472+0000 7f4d6aa00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c071940 0x7f4d6c06ef50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c3c0 tx=0x7f4d5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d63400640 1 -- 172.21.15.114:0/2217593382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c017070 con 0x7f4d6c071940 2024-09-16T07:28:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d63400640 1 -- 172.21.15.114:0/2217593382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d5c0053c0 con 0x7f4d6c071940 2024-09-16T07:28:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d63400640 1 -- 172.21.15.114:0/2217593382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c003860 con 0x7f4d6c071940 2024-09-16T07:28:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c06f680 con 0x7f4d6c071940 2024-09-16T07:28:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c0b5880 con 0x7f4d6c071940 2024-09-16T07:28:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c0af880 con 0x7f4d6c071940 2024-09-16T07:28:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d63400640 1 -- 172.21.15.114:0/2217593382 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f4d5c01a070 con 0x7f4d6c071940 2024-09-16T07:28:36.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d63400640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d48072ec0 0x7f4d48075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d63400640 1 -- 172.21.15.114:0/2217593382 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4d5c093120 con 0x7f4d6c071940 2024-09-16T07:28:36.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.476+0000 7f4d62000640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d48072ec0 0x7f4d48075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.480+0000 7f4d62000640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d48072ec0 0x7f4d48075380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06e490 tx=0x7f4d540091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:36.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.480+0000 7f4d63400640 1 -- 172.21.15.114:0/2217593382 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4d5c05dc80 con 0x7f4d6c071940 2024-09-16T07:28:36.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.684+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d6c0b7c00 con 0x7f4d6c071940 2024-09-16T07:28:36.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.684+0000 7f4d63400640 1 -- 172.21.15.114:0/2217593382 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f4d5c0626b0 con 0x7f4d6c071940 2024-09-16T07:28:36.690 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:36.690 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:36.690 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:36.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d48072ec0 msgr2=0x7f4d48075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d48072ec0 0x7f4d48075380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06e490 tx=0x7f4d540091e0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c071940 msgr2=0x7f4d6c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c071940 0x7f4d6c06ef50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c3c0 tx=0x7f4d5c00c880 comp rx=0 tx=0).stop 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 shutdown_connections 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d48072ec0 0x7f4d48075380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d6c160310 0x7f4d6c1f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d6c0b42d0 0x7f4d6c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 --2- 172.21.15.114:0/2217593382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d6c071940 0x7f4d6c06ef50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 >> 172.21.15.114:0/2217593382 conn(0x7f4d6c0b37b0 msgr2=0x7f4d6c0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 shutdown_connections 2024-09-16T07:28:36.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.688+0000 7f4d6be00640 1 -- 172.21.15.114:0/2217593382 wait complete. 2024-09-16T07:28:36.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:36.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.844+0000 7f6fe2600640 1 -- 172.21.15.114:0/3789881617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc06d160 msgr2=0x7f6fdc0b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 --2- 172.21.15.114:0/3789881617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc06d160 0x7f6fdc0b4710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009bc0 tx=0x7f6fd401cba0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- 172.21.15.114:0/3789881617 shutdown_connections 2024-09-16T07:28:36.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 --2- 172.21.15.114:0/3789881617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc06d160 0x7f6fdc0b4710 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 --2- 172.21.15.114:0/3789881617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc15d3d0 0x7f6fdc06cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- 172.21.15.114:0/3789881617 >> 172.21.15.114:0/3789881617 conn(0x7f6fdc06dd30 msgr2=0x7f6fdc06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:36.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- 172.21.15.114:0/3789881617 shutdown_connections 2024-09-16T07:28:36.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- 172.21.15.114:0/3789881617 wait complete. 2024-09-16T07:28:36.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 Processor -- start 2024-09-16T07:28:36.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- start start 2024-09-16T07:28:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc06d160 0x7f6fdc148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fdc1563e0 0x7f6fdc150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc15d3d0 0x7f6fdc151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc168df0 con 0x7f6fdc1563e0 2024-09-16T07:28:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc168c70 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fe2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6fdc168f70 con 0x7f6fdc06d160 2024-09-16T07:28:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fd2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fdc1563e0 0x7f6fdc150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fd2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fdc1563e0 0x7f6fdc150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44578/0 (socket says 172.21.15.114:44578) 2024-09-16T07:28:36.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fd2a00640 1 -- 172.21.15.114:0/583894853 learned_addr learned my addr 172.21.15.114:0/583894853 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:36.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fdb400640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc06d160 0x7f6fdc148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fdbe00640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc15d3d0 0x7f6fdc151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fdbe00640 1 -- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc06d160 msgr2=0x7f6fdc148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fdbe00640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc06d160 0x7f6fdc148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fdbe00640 1 -- 172.21.15.114:0/583894853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fdc1563e0 msgr2=0x7f6fdc150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fdbe00640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fdc1563e0 0x7f6fdc150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fdbe00640 1 -- 172.21.15.114:0/583894853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fdc15af40 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.848+0000 7f6fd2a00640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fdc1563e0 0x7f6fdc150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fdbe00640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc15d3d0 0x7f6fdc151490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40ac000 tx=0x7f6fd40039a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fd3e00640 1 -- 172.21.15.114:0/583894853 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40bb070 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fd3e00640 1 -- 172.21.15.114:0/583894853 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fd4004e00 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fdc15b220 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fd3e00640 1 -- 172.21.15.114:0/583894853 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40b2040 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fdc1505e0 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fdc0b4710 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fd3e00640 1 -- 172.21.15.114:0/583894853 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6fd40be070 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fd3e00640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6fb8072ec0 0x7f6fb8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.852+0000 7f6fd3e00640 1 -- 172.21.15.114:0/583894853 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6fd412d9f0 con 0x7f6fdc15d3d0 2024-09-16T07:28:36.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.856+0000 7f6fdb400640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6fb8072ec0 0x7f6fb8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:36.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.856+0000 7f6fdb400640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6fb8072ec0 0x7f6fb8075380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc007fd0 tx=0x7f6fcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:36.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:36.856+0000 7f6fd3e00640 1 -- 172.21.15.114:0/583894853 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6fd4016790 con 0x7f6fdc15d3d0 2024-09-16T07:28:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.024+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6fdc069b00 con 0x7f6fdc15d3d0 2024-09-16T07:28:37.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.024+0000 7f6fd3e00640 1 -- 172.21.15.114:0/583894853 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16713 (secure 0 0 0) 0x7f6fd40f8660 con 0x7f6fdc15d3d0 2024-09-16T07:28:37.030 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:37.030 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:22.454295+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6fb8072ec0 msgr2=0x7f6fb8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6fb8072ec0 0x7f6fb8075380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc007fd0 tx=0x7f6fcc009040 comp rx=0 tx=0).stop 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc15d3d0 msgr2=0x7f6fdc151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc15d3d0 0x7f6fdc151490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40ac000 tx=0x7f6fd40039a0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 shutdown_connections 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6fb8072ec0 0x7f6fb8075380 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fdc15d3d0 0x7f6fdc151490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fdc1563e0 0x7f6fdc150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 --2- 172.21.15.114:0/583894853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fdc06d160 0x7f6fdc148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 >> 172.21.15.114:0/583894853 conn(0x7f6fdc06dd30 msgr2=0x7f6fdc1553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 shutdown_connections 2024-09-16T07:28:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.028+0000 7f6fe2600640 1 -- 172.21.15.114:0/583894853 wait complete. 2024-09-16T07:28:37.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:37.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 -- 172.21.15.114:0/1000304820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 msgr2=0x7fd748074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 --2- 172.21.15.114:0/1000304820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd748074d00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd740009bc0 tx=0x7fd74001cba0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 -- 172.21.15.114:0/1000304820 shutdown_connections 2024-09-16T07:28:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 --2- 172.21.15.114:0/1000304820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd748074d00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 -- 172.21.15.114:0/1000304820 >> 172.21.15.114:0/1000304820 conn(0x7fd7480b1ea0 msgr2=0x7fd7480b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 -- 172.21.15.114:0/1000304820 shutdown_connections 2024-09-16T07:28:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 -- 172.21.15.114:0/1000304820 wait complete. 2024-09-16T07:28:37.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 Processor -- start 2024-09-16T07:28:37.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.188+0000 7fd74e200640 1 -- start start 2024-09-16T07:28:37.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7480cc870 0x7fd748159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd7480c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74815ab70 0x7fd748157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd748168e20 con 0x7fd7480ce8b0 2024-09-16T07:28:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd748168ca0 con 0x7fd74815ab70 2024-09-16T07:28:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd748168fa0 con 0x7fd7480cc870 2024-09-16T07:28:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd7480c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd7480c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44608/0 (socket says 172.21.15.114:44608) 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 -- 172.21.15.114:0/1116922279 learned_addr learned my addr 172.21.15.114:0/1116922279 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74ce00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7480cc870 0x7fd748159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74d800640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74815ab70 0x7fd748157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 -- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7480cc870 msgr2=0x7fd748159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7480cc870 0x7fd748159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 -- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74815ab70 msgr2=0x7fd748157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74815ab70 0x7fd748157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 -- 172.21.15.114:0/1116922279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7481f8f70 con 0x7fd7480ce8b0 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74ce00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7480cc870 0x7fd748159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:37.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd747e00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd7480c65e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd73400c4b0 tx=0x7fd73400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:37.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd744c00640 1 -- 172.21.15.114:0/1116922279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734016020 con 0x7fd7480ce8b0 2024-09-16T07:28:37.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd744c00640 1 -- 172.21.15.114:0/1116922279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd734012920 con 0x7fd7480ce8b0 2024-09-16T07:28:37.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7481599c0 con 0x7fd7480ce8b0 2024-09-16T07:28:37.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd744c00640 1 -- 172.21.15.114:0/1116922279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734012d90 con 0x7fd7480ce8b0 2024-09-16T07:28:37.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7481589a0 con 0x7fd7480ce8b0 2024-09-16T07:28:37.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.192+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd748074d00 con 0x7fd7480ce8b0 2024-09-16T07:28:37.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.196+0000 7fd744c00640 1 -- 172.21.15.114:0/1116922279 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fd734019020 con 0x7fd7480ce8b0 2024-09-16T07:28:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.196+0000 7fd744c00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd728072ef0 0x7fd7280753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.196+0000 7fd744c00640 1 -- 172.21.15.114:0/1116922279 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd734093a20 con 0x7fd7480ce8b0 2024-09-16T07:28:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.196+0000 7fd74ce00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd728072ef0 0x7fd7280753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.196+0000 7fd74ce00640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd728072ef0 0x7fd7280753b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7480ca670 tx=0x7fd73c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:37.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.200+0000 7fd744c00640 1 -- 172.21.15.114:0/1116922279 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd734020030 con 0x7fd7480ce8b0 2024-09-16T07:28:37.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.400+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd748166860 con 0x7fd7480ce8b0 2024-09-16T07:28:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.400+0000 7fd744c00640 1 -- 172.21.15.114:0/1116922279 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fd73405ec60 con 0x7fd7480ce8b0 2024-09-16T07:28:37.406 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:37.406 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:37.406 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd728072ef0 msgr2=0x7fd7280753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd728072ef0 0x7fd7280753b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7480ca670 tx=0x7fd73c009040 comp rx=0 tx=0).stop 2024-09-16T07:28:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 msgr2=0x7fd7480c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd7480c65e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd73400c4b0 tx=0x7fd73400c970 comp rx=0 tx=0).stop 2024-09-16T07:28:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 shutdown_connections 2024-09-16T07:28:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd728072ef0 0x7fd7280753b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd74815ab70 0x7fd748157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd7480ce8b0 0x7fd7480c65e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 --2- 172.21.15.114:0/1116922279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7480cc870 0x7fd748159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 >> 172.21.15.114:0/1116922279 conn(0x7fd7480b1ea0 msgr2=0x7fd7480b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 shutdown_connections 2024-09-16T07:28:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.404+0000 7fd74e200640 1 -- 172.21.15.114:0/1116922279 wait complete. 2024-09-16T07:28:37.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:28:20.836441+0000', 'modified': '2024-09-16T07:28:23.861959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4378}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4378': {'gid': 4378, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6836/3215689811', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 3215689811}, {'type': 'v1', 'addr': '172.21.15.149:6836', 'nonce': 3215689811}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4378, 'qdb_cluster': [4378]} 2024-09-16T07:28:37.832 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:28:37.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T07:28:37.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2541055516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c003ab0 msgr2=0x7f5d1c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/2541055516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c003ab0 0x7f5d1c003ed0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c610 tx=0x7f5d2801d230 comp rx=0 tx=0).stop 2024-09-16T07:28:37.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2541055516 shutdown_connections 2024-09-16T07:28:37.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/2541055516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d1c003ab0 0x7f5d1c003ed0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2541055516 >> 172.21.15.114:0/2541055516 conn(0x7f5d380d1e30 msgr2=0x7f5d380d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:37.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2541055516 shutdown_connections 2024-09-16T07:28:37.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- 172.21.15.114:0/2541055516 wait complete. 2024-09-16T07:28:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 Processor -- start 2024-09-16T07:28:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- start start 2024-09-16T07:28:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d1c003ab0 0x7f5d380b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d381f72b0 0x7f5d3815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38160100 0x7f5d381fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5d380b1e50 con 0x7f5d38160100 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d380b1cd0 con 0x7f5d381f72b0 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.972+0000 7f5d3ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d380b1fd0 con 0x7f5d1c003ab0 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38160100 0x7f5d381fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38160100 0x7f5d381fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44624/0 (socket says 172.21.15.114:44624) 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 -- 172.21.15.114:0/935945912 learned_addr learned my addr 172.21.15.114:0/935945912 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d35e00640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d1c003ab0 0x7f5d380b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d35400640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d381f72b0 0x7f5d3815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 -- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d1c003ab0 msgr2=0x7f5d380b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d1c003ab0 0x7f5d380b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 -- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d381f72b0 msgr2=0x7f5d3815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d381f72b0 0x7f5d3815fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 -- 172.21.15.114:0/935945912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d381fbcf0 con 0x7f5d38160100 2024-09-16T07:28:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d36800640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38160100 0x7f5d381fb050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c004790 tx=0x7f5d3000e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d2e000640 1 -- 172.21.15.114:0/935945912 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30005020 con 0x7f5d38160100 2024-09-16T07:28:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d2e000640 1 -- 172.21.15.114:0/935945912 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d300052d0 con 0x7f5d38160100 2024-09-16T07:28:37.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d2e000640 1 -- 172.21.15.114:0/935945912 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d300047b0 con 0x7f5d38160100 2024-09-16T07:28:37.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d380ca710 con 0x7f5d38160100 2024-09-16T07:28:37.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.976+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d380cacd0 con 0x7f5d38160100 2024-09-16T07:28:37.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d2e000640 1 -- 172.21.15.114:0/935945912 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5d3001b020 con 0x7f5d38160100 2024-09-16T07:28:37.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 Processor -- start 2024-09-16T07:28:37.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d2e000640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d18072ec0 0x7f5d18075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 -- start start 2024-09-16T07:28:37.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d2e000640 1 -- 172.21.15.114:0/935945912 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5d300937f0 con 0x7f5d38160100 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35400640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d18072ec0 0x7f5d18075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba81657db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba8160b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba8160c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55ba8152c3f0 con 0x55ba816579d0 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ba81469b20 con 0x55ba8160be10 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ba81458f50 con 0x55ba816582f0 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba81657db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba81657db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44636/0 (socket says 172.21.15.114:44636) 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 -- 172.21.15.114:0/943339739 learned_addr learned my addr 172.21.15.114:0/943339739 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35400640 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba8160b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d36800640 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba8160c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35400640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d18072ec0 0x7f5d18075380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d380b7360 tx=0x7f5d24006bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 -- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 msgr2=0x55ba8160b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba8160b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 -- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 msgr2=0x55ba8160c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba8160c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 -- 172.21.15.114:0/943339739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba81420590 con 0x55ba816579d0 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d35e00640 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba81657db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c610 tx=0x7f5d1c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7579ab6737e6570 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d22a00640 1 -- 172.21.15.114:0/943339739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28001a80 con 0x55ba816579d0 2024-09-16T07:28:37.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d22a00640 1 -- 172.21.15.114:0/943339739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d28003980 con 0x55ba816579d0 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.980+0000 7f5d22a00640 1 -- 172.21.15.114:0/943339739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28003d70 con 0x55ba816579d0 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/943339739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 msgr2=0x55ba81657db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba81657db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c610 tx=0x7f5d1c005840 comp rx=0 tx=0).stop 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/943339739 shutdown_connections 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba8160c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba8160b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/943339739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba81657db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/943339739 >> 172.21.15.114:0/943339739 conn(0x55ba814f5130 msgr2=0x55ba8163ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/943339739 shutdown_connections 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/943339739 wait complete. 2024-09-16T07:28:37.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- start start 2024-09-16T07:28:37.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 Processor -- start 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba8160be10 0x55ba816386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816579d0 0x55ba81638e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816393b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55ba813f35d0 con 0x55ba8160be10 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ba8145cd60 con 0x55ba816582f0 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ba813ff500 con 0x55ba816579d0 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 10 client.0 _ll_register_callbacks cb 0x55ba81403810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba8160be10 0x55ba816386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba8160be10 0x55ba816386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44638/0 (socket says 172.21.15.114:44638) 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 -- 172.21.15.114:0/198414002 learned_addr learned my addr 172.21.15.114:0/198414002 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35400640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816579d0 0x55ba81638e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d36800640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 -- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816579d0 msgr2=0x55ba81638e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816579d0 0x55ba81638e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 -- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 msgr2=0x55ba816393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 -- 172.21.15.114:0/198414002 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba813f7170 con 0x55ba8160be10 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d36800640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d35e00640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba8160be10 0x55ba816386a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c610 tx=0x7f5d280a5f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c16437442f5e4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d17400640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d17400640 1 -- 172.21.15.114:0/198414002 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28001940 con 0x55ba8160be10 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d17400640 1 -- 172.21.15.114:0/198414002 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5d28003980 con 0x55ba8160be10 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ba813f10f0 con 0x55ba8160be10 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d17400640 1 -- 172.21.15.114:0/198414002 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5d280cc050 con 0x55ba8160be10 2024-09-16T07:28:37.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 10 client.4689 fetch_fsmap learned FSMap version 8 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55ba814ddef0 con 0x55ba8160be10 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d17400640 1 -- 172.21.15.114:0/198414002 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ba813f10f0 con 0x55ba8160be10 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d17400640 1 -- 172.21.15.114:0/198414002 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f5d280cf020 con 0x55ba8160be10 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 20 client.4689 populate_metadata read hostname 'smithi114' 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8163a0f0 0x55ba81669c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 4 client.4689 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.984+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 --> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba8146ba70 con 0x55ba8163a0f0 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d35400640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8163a0f0 0x55ba81669c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d35400640 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8163a0f0 0x55ba81669c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664d3f4d19ba6470 server_cookie=d82a1f648a40eec5 in_seq=0 out_seq=0 2024-09-16T07:28:37.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d17400640 10 client.4689 ms_handle_connect on v2:172.21.15.149:6834/3215689811 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d17400640 1 -- 172.21.15.114:0/198414002 <== mds.0 v2:172.21.15.149:6834/3215689811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba8146ba70 con 0x55ba8163a0f0 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d17400640 10 client.4689 handle_command_reply: tid=0 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 client.4689 shutdown 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba8160be10 msgr2=0x55ba816386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba8160be10 0x55ba816386a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c610 tx=0x7f5d280a5f80 comp rx=0 tx=0).stop 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 shutdown_connections 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8163a0f0 0x55ba81669c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816579d0 0x55ba81638e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/198414002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba8160be10 0x55ba816386a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 >> 172.21.15.114:0/198414002 conn(0x55ba814f5130 msgr2=0x55ba8160afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d17400640 0 client.4689 ms_handle_reset on v2:172.21.15.149:6834/3215689811 2024-09-16T07:28:37.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 shutdown_connections 2024-09-16T07:28:37.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 1 -- 172.21.15.114:0/198414002 wait complete. 2024-09-16T07:28:37.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:37.988+0000 7f5d3fd80000 20 client.4689 trim_cache size 0 max 16384 2024-09-16T07:28:38.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 Processor -- start 2024-09-16T07:28:38.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- start start 2024-09-16T07:28:38.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba8160be10 0x55ba816c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5d38204420 con 0x55ba816579d0 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d38203520 con 0x55ba816582f0 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d380cbc40 con 0x55ba8160be10 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44654/0 (socket says 172.21.15.114:44654) 2024-09-16T07:28:38.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 -- 172.21.15.114:0/3002193580 learned_addr learned my addr 172.21.15.114:0/3002193580 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:38.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35e00640 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba8160be10 0x55ba816c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d36800640 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 -- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba8160be10 msgr2=0x55ba816c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:38.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba8160be10 0x55ba816c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 -- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 msgr2=0x55ba816ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 -- 172.21.15.114:0/3002193580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba814b4d90 con 0x55ba816579d0 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35e00640 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba8160be10 0x55ba816c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d36800640 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d35400640 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816ca310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55ba8141c150 tx=0x7f5d24013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b886896a2f3802c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d22000640 1 -- 172.21.15.114:0/3002193580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24001730 con 0x55ba816579d0 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d22000640 1 -- 172.21.15.114:0/3002193580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d24017070 con 0x55ba816579d0 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d22000640 1 -- 172.21.15.114:0/3002193580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24001b30 con 0x55ba816579d0 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- 172.21.15.114:0/3002193580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 msgr2=0x55ba816ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816ca310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55ba8141c150 tx=0x7f5d24013000 comp rx=0 tx=0).stop 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- 172.21.15.114:0/3002193580 shutdown_connections 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba816582f0 0x55ba816ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816ca310 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/3002193580 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba8160be10 0x55ba816c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- 172.21.15.114:0/3002193580 >> 172.21.15.114:0/3002193580 conn(0x55ba814f5130 msgr2=0x55ba81613ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:38.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- 172.21.15.114:0/3002193580 shutdown_connections 2024-09-16T07:28:38.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.008+0000 7f5d3fd80000 1 -- 172.21.15.114:0/3002193580 wait complete. 2024-09-16T07:28:38.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 -- start start 2024-09-16T07:28:38.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 Processor -- start 2024-09-16T07:28:38.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba816cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba816ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55ba81424ec0 con 0x55ba816579d0 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d380ce670 con 0x55ba8160be10 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55ba813f35d0 con 0x55ba816582f0 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 10 client.0 _ll_register_callbacks cb 0x7f5d30005720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44668/0 (socket says 172.21.15.114:44668) 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 -- 172.21.15.114:0/2139112165 learned_addr learned my addr 172.21.15.114:0/2139112165 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d36800640 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba816ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35e00640 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba816cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 -- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 msgr2=0x55ba816ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba816ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 -- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 msgr2=0x55ba816cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba816cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 -- 172.21.15.114:0/2139112165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8141fa90 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d35400640 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816cdb10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d24006fd0 tx=0x7f5d24001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f121c710fca50764 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d17400640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d17400640 1 -- 172.21.15.114:0/2139112165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24001c10 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d17400640 1 -- 172.21.15.114:0/2139112165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5d2403caf0 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d24017070 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d17400640 1 -- 172.21.15.114:0/2139112165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5d24043050 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 10 client.4695 fetch_fsmap learned FSMap version 8 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55ba813fe050 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d17400640 1 -- 172.21.15.114:0/2139112165 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d24017070 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d17400640 1 -- 172.21.15.114:0/2139112165 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f5d24046020 con 0x55ba816579d0 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T07:28:38.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 20 client.4695 populate_metadata read hostname 'smithi114' 2024-09-16T07:28:38.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8166c450 0x55ba8166c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 4 client.4695 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:28:38.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.012+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 --> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] -- command(tid 0: {"prefix": "status"}) -- 0x55ba81467520 con 0x55ba8166c450 2024-09-16T07:28:38.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d35e00640 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8166c450 0x55ba8166c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d35e00640 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8166c450 0x55ba8166c830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce261de49853f57f server_cookie=308fca1c9dfdb6d9 in_seq=0 out_seq=0 2024-09-16T07:28:38.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d17400640 10 client.4695 ms_handle_connect on v2:172.21.15.149:6834/3215689811 2024-09-16T07:28:38.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d17400640 1 -- 172.21.15.114:0/2139112165 <== mds.0 v2:172.21.15.149:6834/3215689811 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55ba81467520 con 0x55ba8166c450 2024-09-16T07:28:38.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d17400640 10 client.4695 handle_command_reply: tid=0 2024-09-16T07:28:38.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 client.4695 shutdown 2024-09-16T07:28:38.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 msgr2=0x55ba816cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816cdb10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d24006fd0 tx=0x7f5d24001690 comp rx=0 tx=0).stop 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 shutdown_connections 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:6834/3215689811,v1:172.21.15.149:6836/3215689811] conn(0x55ba8166c450 0x55ba8166c830 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55ba816582f0 0x55ba816ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d17400640 0 client.4695 ms_handle_reset on v2:172.21.15.149:6834/3215689811 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ba816579d0 0x55ba816cdb10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 --2- 172.21.15.114:0/2139112165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba8160be10 0x55ba816cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 >> 172.21.15.114:0/2139112165 conn(0x55ba814f5130 msgr2=0x55ba816565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 shutdown_connections 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 1 -- 172.21.15.114:0/2139112165 wait complete. 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.016+0000 7f5d3fd80000 20 client.4695 trim_cache size 0 max 16384 2024-09-16T07:28:38.024 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4378, 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 16.546380577000001, 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 8, 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 22, 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 22, 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 22.732610489999999 2024-09-16T07:28:38.025 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:28:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d18072ec0 msgr2=0x7f5d18075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d18072ec0 0x7f5d18075380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5d380b7360 tx=0x7f5d24006bb0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38160100 msgr2=0x7f5d381fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38160100 0x7f5d381fb050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c004790 tx=0x7f5d3000e9b0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 shutdown_connections 2024-09-16T07:28:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d18072ec0 0x7f5d18075380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d38160100 0x7f5d381fb050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d381f72b0 0x7f5d3815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 --2- 172.21.15.114:0/935945912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d1c003ab0 0x7f5d380b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 >> 172.21.15.114:0/935945912 conn(0x7f5d380d1e30 msgr2=0x7f5d380b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 shutdown_connections 2024-09-16T07:28:38.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.020+0000 7f5d3ca00640 1 -- 172.21.15.114:0/935945912 wait complete. 2024-09-16T07:28:38.041 INFO:teuthology.run_tasks:Running task kclient... 2024-09-16T07:28:38.068 INFO:tasks.kclient:Mounting kernel clients... 2024-09-16T07:28:38.068 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-16T07:28:38.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.069 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:28:38.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-16T07:28:38.140 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-09-16T07:28:38.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:28:38.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.146 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:28:38.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-16T07:28:38.260 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-09-16T07:28:38.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:28:38.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.263 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:28:38.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-16T07:28:38.339 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-16T07:28:38.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:28:38.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.341 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:28:38.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-16T07:28:38.458 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-16T07:28:38.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:28:38.461 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-16T07:28:38.461 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T07:28:38.461 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:28:38.461 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:28:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.600+0000 7f6ecd600640 1 -- 172.21.15.114:0/2119452308 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ec80cf300 msgr2=0x7f6ec806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.600+0000 7f6ecd600640 1 --2- 172.21.15.114:0/2119452308 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ec80cf300 0x7f6ec806ecb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009bf0 tx=0x7f6eb001cbe0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.600+0000 7f6ecd600640 1 -- 172.21.15.114:0/2119452308 shutdown_connections 2024-09-16T07:28:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.600+0000 7f6ecd600640 1 --2- 172.21.15.114:0/2119452308 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ec80cf300 0x7f6ec806ecb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.600+0000 7f6ecd600640 1 -- 172.21.15.114:0/2119452308 >> 172.21.15.114:0/2119452308 conn(0x7f6ec80b18f0 msgr2=0x7f6ec80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.600+0000 7f6ecd600640 1 -- 172.21.15.114:0/2119452308 shutdown_connections 2024-09-16T07:28:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.600+0000 7f6ecd600640 1 -- 172.21.15.114:0/2119452308 wait complete. 2024-09-16T07:28:38.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 Processor -- start 2024-09-16T07:28:38.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 -- start start 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ec806e810 0x7f6ec80ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ec80cf300 0x7f6ec8154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec815ade0 0x7f6ec8159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8169bd0 con 0x7f6ec815ade0 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8169a50 con 0x7f6ec80cf300 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec8169d50 con 0x7f6ec806e810 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec815ade0 0x7f6ec8159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec815ade0 0x7f6ec8159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44670/0 (socket says 172.21.15.114:44670) 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 -- 172.21.15.114:0/213817205 learned_addr learned my addr 172.21.15.114:0/213817205 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ebe000640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ec80cf300 0x7f6ec8154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 -- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ec806e810 msgr2=0x7f6ec80ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ec806e810 0x7f6ec80ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 -- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ec80cf300 msgr2=0x7f6ec8154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ec80cf300 0x7f6ec8154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 -- 172.21.15.114:0/213817205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec80acde0 con 0x7f6ec815ade0 2024-09-16T07:28:38.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ec7400640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec815ade0 0x7f6ec8159a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c410 tx=0x7f6ec000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ebf400640 1 -- 172.21.15.114:0/213817205 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0017070 con 0x7f6ec815ade0 2024-09-16T07:28:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ebf400640 1 -- 172.21.15.114:0/213817205 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ec00053c0 con 0x7f6ec815ade0 2024-09-16T07:28:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec80ad050 con 0x7f6ec815ade0 2024-09-16T07:28:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ebf400640 1 -- 172.21.15.114:0/213817205 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0003860 con 0x7f6ec815ade0 2024-09-16T07:28:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec80ad610 con 0x7f6ec815ade0 2024-09-16T07:28:38.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.604+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec80cebf0 con 0x7f6ec815ade0 2024-09-16T07:28:38.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.608+0000 7f6ebf400640 1 -- 172.21.15.114:0/213817205 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6ec001a070 con 0x7f6ec815ade0 2024-09-16T07:28:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.608+0000 7f6ebf400640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ea4072ec0 0x7f6ea4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:38.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.608+0000 7f6ebf400640 1 -- 172.21.15.114:0/213817205 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6ec0093230 con 0x7f6ec815ade0 2024-09-16T07:28:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.608+0000 7f6ec6a00640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ea4072ec0 0x7f6ea4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:38.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.608+0000 7f6ec6a00640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ea4072ec0 0x7f6ea4075380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8001500 tx=0x7f6eb80078b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:38.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.612+0000 7f6ebf400640 1 -- 172.21.15.114:0/213817205 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6ec005e3e0 con 0x7f6ec815ade0 2024-09-16T07:28:38.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.812+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6ec80aea90 con 0x7f6ec815ade0 2024-09-16T07:28:38.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ebf400640 1 -- 172.21.15.114:0/213817205 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6ec0007e20 con 0x7f6ec815ade0 2024-09-16T07:28:38.820 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ea4072ec0 msgr2=0x7f6ea4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ea4072ec0 0x7f6ea4075380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8001500 tx=0x7f6eb80078b0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec815ade0 msgr2=0x7f6ec8159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec815ade0 0x7f6ec8159a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c410 tx=0x7f6ec000c8d0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 shutdown_connections 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ea4072ec0 0x7f6ea4075380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ec815ade0 0x7f6ec8159a50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ec80cf300 0x7f6ec8154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 --2- 172.21.15.114:0/213817205 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ec806e810 0x7f6ec80ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 >> 172.21.15.114:0/213817205 conn(0x7f6ec80b18f0 msgr2=0x7f6ec8073de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 shutdown_connections 2024-09-16T07:28:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38.816+0000 7f6ecd600640 1 -- 172.21.15.114:0/213817205 wait complete. 2024-09-16T07:28:38.840 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T07:28:38.840 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:28:38.840 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:28:38.841 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:28:38.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:28:38.841 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T07:28:38.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T07:28:38.841 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:28:38.841 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:28:38.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:38.841 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:28:38.850 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42422sec preferred_lft 42422sec 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:28:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:38.853 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T07:28:38.853 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:38.853 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:38.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-09-16T07:28:38.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-09-16T07:28:38.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-09-16T07:28:38.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T07:28:38.853 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:38.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:39.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:39.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:39.007 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:28:39.072 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:28:39.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:39.074 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:28:39.149 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:28:39.149 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:28:39.149 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:28:39.149 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:28:39.149 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:28:39.149 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:28:39.150 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:28:39.150 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:39.150 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:39.150 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:39.150 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:28:39.150 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:39.150 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:39.150 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:28:39.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:28:39.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:28:39.151 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:39.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:39.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:39.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:39.283 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:28:39.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:39.293 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-09-16T07:28:39.343 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:39.343 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:39.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:28:39.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T07:28:39.343 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:39.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:39.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:39.473 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T07:28:39.473 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:39.473 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:39.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T07:28:39.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T07:28:39.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T07:28:39.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T07:28:39.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T07:28:39.474 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:39.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:39.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:39.682 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:39.682 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:39.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:28:39.683 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T07:28:39.683 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:39.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:39.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:39.805 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:28:39.818 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:28:39.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:39.819 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:28:39.866 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:28:39.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:39.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:28:39.954 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:28:39.954 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:28:39.954 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:28:40.630 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:28:40.630 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:28:40.630 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:28:40.631 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:40.631 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:40.643 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:28:40.643 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:28:40.643 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:28:40.643 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:40.643 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:40.643 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:28:40.644 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:28:40.644 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:28:40.647 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:28:40.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:40.647 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:28:40.667 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:40.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:40.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:40.791 INFO:teuthology.orchestra.run.smithi114.stdout:client4704 2024-09-16T07:28:40.792 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:40.792 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:40.800 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:40.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:40.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:40.914 INFO:teuthology.orchestra.run.smithi114.stdout:client4704 2024-09-16T07:28:40.914 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:40.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:40.981 INFO:teuthology.orchestra.run.smithi114.stdout:client4704 2024-09-16T07:28:40.982 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264.client4704/status') 2024-09-16T07:28:41.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:41.049 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4704 (3)192.168.0.1:0/1866930752 2024-09-16T07:28:41.049 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-09-16T07:28:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-09-16T07:28:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-09-16T07:28:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:69 bytes copied, 5.2457e-05 s, 1.3 MB/s 2024-09-16T07:28:41.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:41.057 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-16T07:28:41.057 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T07:28:41.057 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T07:28:41.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:28:41.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.192+0000 7f436ce00640 1 -- 172.21.15.114:0/2121895569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 msgr2=0x7f434c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:41.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.192+0000 7f436ce00640 1 --2- 172.21.15.114:0/2121895569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f434c004c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f43540016f0 tx=0x7f435401c750 comp rx=0 tx=0).stop 2024-09-16T07:28:41.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.192+0000 7f436ce00640 1 -- 172.21.15.114:0/2121895569 shutdown_connections 2024-09-16T07:28:41.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.192+0000 7f436ce00640 1 --2- 172.21.15.114:0/2121895569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f434c004c90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.192+0000 7f436ce00640 1 -- 172.21.15.114:0/2121895569 >> 172.21.15.114:0/2121895569 conn(0x7f436809aa10 msgr2=0x7f436809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:41.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.192+0000 7f436ce00640 1 -- 172.21.15.114:0/2121895569 shutdown_connections 2024-09-16T07:28:41.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.192+0000 7f436ce00640 1 -- 172.21.15.114:0/2121895569 wait complete. 2024-09-16T07:28:41.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 Processor -- start 2024-09-16T07:28:41.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 -- start start 2024-09-16T07:28:41.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f43680c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:41.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43680c8390 0x7f43681fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43680c8810 0x7f43681fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f43680d1d60 con 0x7f434c004810 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f43680d1be0 con 0x7f43680c8810 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f436ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f43680d1ee0 con 0x7f43680c8390 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f43680c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f43680c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44686/0 (socket says 172.21.15.114:44686) 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 -- 172.21.15.114:0/3890472427 learned_addr learned my addr 172.21.15.114:0/3890472427 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4366a00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43680c8390 0x7f43681fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367e00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43680c8810 0x7f43681fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 -- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43680c8390 msgr2=0x7f43681fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43680c8390 0x7f43681fb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 -- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43680c8810 msgr2=0x7f43681fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43680c8810 0x7f43681fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 -- 172.21.15.114:0/3890472427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43680c75d0 con 0x7f434c004810 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367e00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43680c8810 0x7f43681fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f4367400640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f43680c5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4358011a10 tx=0x7f4358011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.196+0000 7f435f400640 1 -- 172.21.15.114:0/3890472427 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435801e070 con 0x7f434c004810 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f435f400640 1 -- 172.21.15.114:0/3890472427 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4358004460 con 0x7f434c004810 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f435f400640 1 -- 172.21.15.114:0/3890472427 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435800fba0 con 0x7f434c004810 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43680c78b0 con 0x7f434c004810 2024-09-16T07:28:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43680c7e70 con 0x7f434c004810 2024-09-16T07:28:41.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f436815f730 con 0x7f434c004810 2024-09-16T07:28:41.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f435f400640 1 -- 172.21.15.114:0/3890472427 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f4358021070 con 0x7f434c004810 2024-09-16T07:28:41.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f435f400640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4348072ec0 0x7f4348075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:41.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f435f400640 1 -- 172.21.15.114:0/3890472427 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4358094840 con 0x7f434c004810 2024-09-16T07:28:41.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.200+0000 7f4366a00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4348072ec0 0x7f4348075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:41.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.204+0000 7f4366a00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4348072ec0 0x7f4348075380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43540016c0 tx=0x7f4354019540 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:41.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.204+0000 7f435f400640 1 -- 172.21.15.114:0/3890472427 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f435805f3a0 con 0x7f434c004810 2024-09-16T07:28:41.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.404+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f436815e090 con 0x7f434c004810 2024-09-16T07:28:41.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f435f400640 1 -- 172.21.15.114:0/3890472427 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f4358063dd0 con 0x7f434c004810 2024-09-16T07:28:41.412 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:28:41.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4348072ec0 msgr2=0x7f4348075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4348072ec0 0x7f4348075380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f43540016c0 tx=0x7f4354019540 comp rx=0 tx=0).stop 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 msgr2=0x7f43680c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f43680c5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4358011a10 tx=0x7f4358011ed0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 shutdown_connections 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4348072ec0 0x7f4348075380 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43680c8810 0x7f43681fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43680c8390 0x7f43681fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 --2- 172.21.15.114:0/3890472427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f434c004810 0x7f43680c5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 >> 172.21.15.114:0/3890472427 conn(0x7f436809aa10 msgr2=0x7f43680c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 shutdown_connections 2024-09-16T07:28:41.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41.408+0000 7f436ce00640 1 -- 172.21.15.114:0/3890472427 wait complete. 2024-09-16T07:28:41.432 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T07:28:41.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:28:41.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:28:41.432 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-16T07:28:41.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T07:28:41.433 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T07:28:41.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T07:28:41.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:28:41.433 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-16T07:28:41.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:41.433 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:28:41.441 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:28:41.442 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42419sec preferred_lft 42419sec 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:28:41.443 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.444 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:28:41.444 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.444 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:28:41.444 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:28:41.444 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:28:41.444 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:41.445 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:28:41.508 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:28:41.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:41.510 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:28:41.565 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:28:41.565 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:41.566 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:28:41.566 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:41.566 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:41.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:28:41.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:28:41.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:28:41.567 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:41.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:41.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:41.704 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:28:41.712 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:28:41.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:41.713 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-09-16T07:28:41.762 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-16T07:28:41.764 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:41.764 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:41.764 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:28:41.764 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-16T07:28:41.764 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:41.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:41.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:41.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:41.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T07:28:41.909 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:41.909 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:41.909 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:41.909 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.909 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:41.909 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.910 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:28:41.910 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 1a:59:db:7a:0a:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T07:28:41.910 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T07:28:41.910 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.910 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::1859:dbff:fe7a:a59/64 scope link 2024-09-16T07:28:41.910 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:41.911 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T07:28:41.978 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 1a:59:db:7a:0a:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::1859:dbff:fe7a:a59/64 scope link 2024-09-16T07:28:41.979 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:41.981 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-16T07:28:41.981 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:42.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:42.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:42.164 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:42.164 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:28:42.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2024-09-16T07:28:42.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T07:28:42.164 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:28:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:42.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:42.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:42.247 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-16T07:28:42.303 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-16T07:28:42.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:42.303 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-16T07:28:42.354 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:28:42.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:42.354 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T07:28:42.446 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T07:28:42.446 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T07:28:42.446 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:28:42.461 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T07:28:42.461 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T07:28:42.461 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:28:42.461 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:42.462 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:42.472 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T07:28:42.473 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T07:28:42.473 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:28:42.473 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:42.473 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:42.473 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:28:42.473 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:28:42.473 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:28:42.477 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:28:42.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:42.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-16T07:28:42.496 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:42.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:42.599 INFO:teuthology.orchestra.run.smithi114.stdout:client4681 2024-09-16T07:28:42.600 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:42.600 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:42.608 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:42.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:42.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:42.706 INFO:teuthology.orchestra.run.smithi114.stdout:client4681 2024-09-16T07:28:42.706 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:42.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:42.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:42.763 INFO:teuthology.orchestra.run.smithi114.stdout:client4681 2024-09-16T07:28:42.764 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264.client4681/status') 2024-09-16T07:28:42.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:42.822 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4681 (3)172.21.15.114:0/3515132337 2024-09-16T07:28:42.822 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-09-16T07:28:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-09-16T07:28:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-09-16T07:28:42.822 INFO:teuthology.orchestra.run.smithi114.stderr:71 bytes copied, 6.0013e-05 s, 1.2 MB/s 2024-09-16T07:28:42.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:42.830 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-16T07:28:42.830 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T07:28:42.830 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:28:42.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:28:43.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.004+0000 7efe23c00640 1 -- 172.21.15.114:0/1347229400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c0b2bf0 msgr2=0x7efe1c0b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.004+0000 7efe23c00640 1 --2- 172.21.15.114:0/1347229400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c0b2bf0 0x7efe1c0b3070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0d0c90 tx=0x7efe1401cdc0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.004+0000 7efe23c00640 1 -- 172.21.15.114:0/1347229400 shutdown_connections 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.004+0000 7efe23c00640 1 --2- 172.21.15.114:0/1347229400 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c0b2bf0 0x7efe1c0b3070 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 --2- 172.21.15.114:0/1347229400 >> v2:172.21.15.149:3300/0 conn(0x7efe1c0b4a60 0x7efe1c15b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 --2- 172.21.15.114:0/1347229400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe1c158a20 0x7efe1c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 -- 172.21.15.114:0/1347229400 >> 172.21.15.114:0/1347229400 conn(0x7efe1c0b18f0 msgr2=0x7efe1c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 -- 172.21.15.114:0/1347229400 shutdown_connections 2024-09-16T07:28:43.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 -- 172.21.15.114:0/1347229400 wait complete. 2024-09-16T07:28:43.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 Processor -- start 2024-09-16T07:28:43.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 -- start start 2024-09-16T07:28:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe1c0b2bf0 0x7efe1c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1c0b4a60 0x7efe1c0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c158a20 0x7efe1c0738c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c15ea10 con 0x7efe1c158a20 2024-09-16T07:28:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c15e890 con 0x7efe1c0b4a60 2024-09-16T07:28:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe23c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe1c15eb90 con 0x7efe1c0b2bf0 2024-09-16T07:28:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c158a20 0x7efe1c0738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c158a20 0x7efe1c0738c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44702/0 (socket says 172.21.15.114:44702) 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 -- 172.21.15.114:0/2108363340 learned_addr learned my addr 172.21.15.114:0/2108363340 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 -- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe1c0b2bf0 msgr2=0x7efe1c153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe1c0b2bf0 0x7efe1c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 -- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1c0b4a60 msgr2=0x7efe1c0ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe13e00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1c0b4a60 0x7efe1c0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1c0b4a60 0x7efe1c0ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 -- 172.21.15.114:0/2108363340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c0ad990 con 0x7efe1c158a20 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe13e00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1c0b4a60 0x7efe1c0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.008+0000 7efe21c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c158a20 0x7efe1c0738c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe14009bd0 tx=0x7efe140a5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe19600640 1 -- 172.21.15.114:0/2108363340 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140bb070 con 0x7efe1c158a20 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe19600640 1 -- 172.21.15.114:0/2108363340 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe14004d40 con 0x7efe1c158a20 2024-09-16T07:28:43.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c1664a0 con 0x7efe1c158a20 2024-09-16T07:28:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe19600640 1 -- 172.21.15.114:0/2108363340 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140b2040 con 0x7efe1c158a20 2024-09-16T07:28:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c0adf30 con 0x7efe1c158a20 2024-09-16T07:28:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c15b2a0 con 0x7efe1c158a20 2024-09-16T07:28:43.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe19600640 1 -- 172.21.15.114:0/2108363340 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7efe140be070 con 0x7efe1c158a20 2024-09-16T07:28:43.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe19600640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efdf8072ec0 0x7efdf8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:43.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe19600640 1 -- 172.21.15.114:0/2108363340 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efe1412dbc0 con 0x7efe1c158a20 2024-09-16T07:28:43.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.012+0000 7efe21200640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efdf8072ec0 0x7efdf8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.016+0000 7efe21200640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efdf8072ec0 0x7efdf8075380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009650 tx=0x7efe0c006bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:43.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.016+0000 7efe19600640 1 -- 172.21.15.114:0/2108363340 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efe140169b0 con 0x7efe1c158a20 2024-09-16T07:28:43.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.220+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efe1c0b1fb0 con 0x7efe1c158a20 2024-09-16T07:28:43.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.220+0000 7efe19600640 1 -- 172.21.15.114:0/2108363340 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7efe140f8e00 con 0x7efe1c158a20 2024-09-16T07:28:43.226 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efdf8072ec0 msgr2=0x7efdf8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efdf8072ec0 0x7efdf8075380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009650 tx=0x7efe0c006bb0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c158a20 msgr2=0x7efe1c0738c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c158a20 0x7efe1c0738c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe14009bd0 tx=0x7efe140a5b60 comp rx=0 tx=0).stop 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 shutdown_connections 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efdf8072ec0 0x7efdf8075380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe1c158a20 0x7efe1c0738c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe1c0b4a60 0x7efe1c0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 --2- 172.21.15.114:0/2108363340 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe1c0b2bf0 0x7efe1c153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 >> 172.21.15.114:0/2108363340 conn(0x7efe1c0b18f0 msgr2=0x7efe1c15a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 shutdown_connections 2024-09-16T07:28:43.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:43.224+0000 7efe23c00640 1 -- 172.21.15.114:0/2108363340 wait complete. 2024-09-16T07:28:43.248 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T07:28:43.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:28:43.248 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:28:43.249 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:28:43.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:28:43.249 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T07:28:43.249 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T07:28:43.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:28:43.249 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:28:43.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:43.249 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:28:43.259 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:43.259 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:43.259 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:43.259 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:43.260 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:28:43.261 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-09-16T07:28:43.261 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:28:43.261 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:43.261 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:28:43.261 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:43.261 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:28:43.261 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:43.262 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T07:28:43.262 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:43.262 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:43.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2024-09-16T07:28:43.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2024-09-16T07:28:43.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2024-09-16T07:28:43.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T07:28:43.262 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:43.363 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:43.426 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:43.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:43.433 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:28:43.451 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:28:43.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:43.454 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:28:43.550 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:43.551 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:28:43.552 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:43.552 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:43.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:28:43.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:28:43.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:28:43.552 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:43.600 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:43.640 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:43.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:43.647 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:28:43.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:43.656 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-09-16T07:28:43.706 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:43.706 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:43.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:28:43.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-16T07:28:43.706 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:43.795 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:43.825 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:43.832 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-16T07:28:43.832 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:43.832 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:43.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-16T07:28:43.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T07:28:43.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-16T07:28:43.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-16T07:28:43.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-16T07:28:43.833 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:43.880 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:43.999 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:44.006 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:44.006 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:44.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:28:44.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T07:28:44.006 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:44.099 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:44.131 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:44.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:44.137 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:28:44.190 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:28:44.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:44.190 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:28:44.241 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:28:44.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:44.241 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:28:44.329 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:28:44.329 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:28:44.330 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:28:44.982 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:28:44.982 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:28:44.982 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:28:44.982 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:44.983 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:44.996 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:28:44.997 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:28:44.997 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:28:44.997 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:44.997 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:44.997 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:28:44.997 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:28:44.997 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:28:45.001 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:28:45.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:45.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:28:45.062 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:45.156 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:45.203 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:45.210 INFO:teuthology.orchestra.run.smithi149.stdout:client4544 2024-09-16T07:28:45.210 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:45.210 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:45.219 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:45.308 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:45.312 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:45.318 INFO:teuthology.orchestra.run.smithi149.stdout:client4544 2024-09-16T07:28:45.318 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:45.365 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:45.368 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:45.373 INFO:teuthology.orchestra.run.smithi149.stdout:client4544 2024-09-16T07:28:45.374 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264.client4544/status') 2024-09-16T07:28:45.463 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:45.476 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4544 (3)192.168.0.1:0/1128848129 2024-09-16T07:28:45.477 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-09-16T07:28:45.477 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-09-16T07:28:45.477 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-09-16T07:28:45.477 INFO:teuthology.orchestra.run.smithi149.stderr:69 bytes copied, 5.1664e-05 s, 1.3 MB/s 2024-09-16T07:28:45.477 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:45.484 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-16T07:28:45.484 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T07:28:45.484 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T07:28:45.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:28:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- 172.21.15.114:0/2499555542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000b2e80 msgr2=0x7fd7000b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 --2- 172.21.15.114:0/2499555542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000b2e80 0x7fd7000b1bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009870 tx=0x7fd6e801c710 comp rx=0 tx=0).stop 2024-09-16T07:28:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- 172.21.15.114:0/2499555542 shutdown_connections 2024-09-16T07:28:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 --2- 172.21.15.114:0/2499555542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000b2e80 0x7fd7000b1bd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- 172.21.15.114:0/2499555542 >> 172.21.15.114:0/2499555542 conn(0x7fd7000d1e30 msgr2=0x7fd7000d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- 172.21.15.114:0/2499555542 shutdown_connections 2024-09-16T07:28:45.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- 172.21.15.114:0/2499555542 wait complete. 2024-09-16T07:28:45.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 Processor -- start 2024-09-16T07:28:45.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- start start 2024-09-16T07:28:45.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000afca0 0x7fd700151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:45.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7000b2e80 0x7fd70006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:45.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd70015f490 0x7fd70014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:45.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd7000b2290 con 0x7fd70015f490 2024-09-16T07:28:45.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd7000b2110 con 0x7fd7000b2e80 2024-09-16T07:28:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd705000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd70016a4a0 con 0x7fd7000afca0 2024-09-16T07:28:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd70015f490 0x7fd70014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd70015f490 0x7fd70014f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38206/0 (socket says 172.21.15.114:38206) 2024-09-16T07:28:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 -- 172.21.15.114:0/169256938 learned_addr learned my addr 172.21.15.114:0/169256938 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6f7e00640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7000b2e80 0x7fd70006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:45.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fde00640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000afca0 0x7fd700151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 -- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000afca0 msgr2=0x7fd700151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000afca0 0x7fd700151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 -- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7000b2e80 msgr2=0x7fd70006f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:45.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7000b2e80 0x7fd70006f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 -- 172.21.15.114:0/169256938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7001521b0 con 0x7fd70015f490 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6f7e00640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7000b2e80 0x7fd70006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.632+0000 7fd6fe800640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd70015f490 0x7fd70014f9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c790 tx=0x7fd6f800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd6f6000640 1 -- 172.21.15.114:0/169256938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8003b80 con 0x7fd70015f490 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd6f6000640 1 -- 172.21.15.114:0/169256938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6f8003d40 con 0x7fd70015f490 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd6f6000640 1 -- 172.21.15.114:0/169256938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800aab0 con 0x7fd70015f490 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70006fce0 con 0x7fd70015f490 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70006e3d0 con 0x7fd70015f490 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7000b0130 con 0x7fd70015f490 2024-09-16T07:28:45.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd6f6000640 1 -- 172.21.15.114:0/169256938 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fd6f800ac50 con 0x7fd70015f490 2024-09-16T07:28:45.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd6f6000640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd6dc072ec0 0x7fd6dc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:45.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd6f6000640 1 -- 172.21.15.114:0/169256938 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd6f8093ba0 con 0x7fd70015f490 2024-09-16T07:28:45.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.636+0000 7fd6fde00640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd6dc072ec0 0x7fd6dc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:45.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.640+0000 7fd6fde00640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd6dc072ec0 0x7fd6dc075380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0001870 tx=0x7fd6f0001380 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:45.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.644+0000 7fd6f6000640 1 -- 172.21.15.114:0/169256938 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd6f805e790 con 0x7fd70015f490 2024-09-16T07:28:45.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd7000cd9b0 con 0x7fd70015f490 2024-09-16T07:28:45.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd6f6000640 1 -- 172.21.15.114:0/169256938 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd6f80631c0 con 0x7fd70015f490 2024-09-16T07:28:45.852 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd6dc072ec0 msgr2=0x7fd6dc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd6dc072ec0 0x7fd6dc075380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0001870 tx=0x7fd6f0001380 comp rx=0 tx=0).stop 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd70015f490 msgr2=0x7fd70014f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd70015f490 0x7fd70014f9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c790 tx=0x7fd6f800cc50 comp rx=0 tx=0).stop 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 shutdown_connections 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd6dc072ec0 0x7fd6dc075380 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd70015f490 0x7fd70014f9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7000b2e80 0x7fd70006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 --2- 172.21.15.114:0/169256938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd7000afca0 0x7fd700151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 >> 172.21.15.114:0/169256938 conn(0x7fd7000d1e30 msgr2=0x7fd7000cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 shutdown_connections 2024-09-16T07:28:45.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:45.848+0000 7fd705000640 1 -- 172.21.15.114:0/169256938 wait complete. 2024-09-16T07:28:45.873 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T07:28:45.873 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:28:45.873 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:28:45.873 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-16T07:28:45.873 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T07:28:45.873 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T07:28:45.874 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T07:28:45.874 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:28:45.874 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-16T07:28:45.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:45.874 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:28:45.883 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:45.883 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:45.883 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:45.883 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:45.883 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:28:45.884 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:28:45.885 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:28:45.886 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-16T07:28:45.886 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:45.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:45.886 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:28:45.943 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:28:45.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:45.946 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:28:46.001 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:28:46.001 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:28:46.001 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:28:46.001 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:28:46.002 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:28:46.002 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:28:46.002 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:28:46.002 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:46.002 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:46.002 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:28:46.002 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:28:46.002 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:46.002 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:46.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:28:46.003 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:28:46.003 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:28:46.003 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:46.087 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:46.128 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:46.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:46.135 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:28:46.144 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:28:46.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:46.144 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2024-09-16T07:28:46.193 INFO:teuthology.orchestra.run.smithi149.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-16T07:28:46.194 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:46.194 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:46.194 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:28:46.194 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-16T07:28:46.194 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:46.287 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:46.316 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:46.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:46.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether f6:05:9a:2d:f3:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.390 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::f405:9aff:fe2d:f3e1/64 scope link 2024-09-16T07:28:46.391 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:46.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T07:28:46.453 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:28:46.453 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:28:46.453 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:28:46.453 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.453 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:28:46.453 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:28:46.454 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether f6:05:9a:2d:f3:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T07:28:46.454 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T07:28:46.454 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.454 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::f405:9aff:fe2d:f3e1/64 scope link 2024-09-16T07:28:46.454 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:28:46.455 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-16T07:28:46.455 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:46.455 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:46.455 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-16T07:28:46.455 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T07:28:46.455 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-16T07:28:46.455 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-16T07:28:46.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-16T07:28:46.456 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:46.544 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:46.629 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:46.635 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:28:46.635 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:28:46.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.1 up 2024-09-16T07:28:46.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T07:28:46.636 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:28:46.681 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:46.711 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:46.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:46.718 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-16T07:28:46.775 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-16T07:28:46.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:28:46.775 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-16T07:28:46.829 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:28:46.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:46.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T07:28:46.917 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T07:28:46.917 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T07:28:46.917 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:28:46.932 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T07:28:46.932 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T07:28:46.932 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:28:46.932 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:46.932 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:28:46.941 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:28:46.945 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:28:46.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:46.945 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-16T07:28:46.964 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:47.052 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:47.055 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:47.061 INFO:teuthology.orchestra.run.smithi149.stdout:client4553 2024-09-16T07:28:47.062 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:47.062 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:47.114 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:47.209 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:47.212 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:47.218 INFO:teuthology.orchestra.run.smithi149.stdout:client4553 2024-09-16T07:28:47.218 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:28:47.311 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:28:47.315 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:47.321 INFO:teuthology.orchestra.run.smithi149.stdout:client4553 2024-09-16T07:28:47.321 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264.client4553/status') 2024-09-16T07:28:47.367 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:28:47.380 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4553 (3)192.168.0.2:0/2501127493 2024-09-16T07:28:47.380 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2024-09-16T07:28:47.380 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2024-09-16T07:28:47.380 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2024-09-16T07:28:47.380 INFO:teuthology.orchestra.run.smithi149.stderr:69 bytes copied, 5.4525e-05 s, 1.3 MB/s 2024-09-16T07:28:47.382 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:28:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:28:47.388 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-16T07:28:47.484 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2024-09-16T07:28:47.485 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:28:47.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:47.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:28:47.491 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:28:47.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 -- 172.21.15.114:0/3202921010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 msgr2=0x7fa8d80b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 --2- 172.21.15.114:0/3202921010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b29e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8d80c56a0 tx=0x7fa8d001ccf0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 -- 172.21.15.114:0/3202921010 shutdown_connections 2024-09-16T07:28:47.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 --2- 172.21.15.114:0/3202921010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b29e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 --2- 172.21.15.114:0/3202921010 >> v2:172.21.15.149:3300/0 conn(0x7fa8d80d01b0 0x7fa8d80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 -- 172.21.15.114:0/3202921010 >> 172.21.15.114:0/3202921010 conn(0x7fa8d809aa10 msgr2=0x7fa8d809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:47.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 -- 172.21.15.114:0/3202921010 shutdown_connections 2024-09-16T07:28:47.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.636+0000 7fa8dd800640 1 -- 172.21.15.114:0/3202921010 wait complete. 2024-09-16T07:28:47.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 Processor -- start 2024-09-16T07:28:47.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 -- start start 2024-09-16T07:28:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8d80d01b0 0x7fa8d8158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8d815f000 0x7fa8d80b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8168e70 con 0x7fa8d80b2590 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8168cf0 con 0x7fa8d815f000 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d8168ff0 con 0x7fa8d80d01b0 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38212/0 (socket says 172.21.15.114:38212) 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 -- 172.21.15.114:0/890416937 learned_addr learned my addr 172.21.15.114:0/890416937 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dce00640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8d815f000 0x7fa8d80b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8cf400640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8d80d01b0 0x7fa8d8158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 -- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8d80d01b0 msgr2=0x7fa8d8158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8d80d01b0 0x7fa8d8158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 -- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8d815f000 msgr2=0x7fa8d80b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8d815f000 0x7fa8d80b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 -- 172.21.15.114:0/890416937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d80b7190 con 0x7fa8d80b2590 2024-09-16T07:28:47.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d7e00640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b56f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c3c0 tx=0x7fa8c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:47.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d4c00640 1 -- 172.21.15.114:0/890416937 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8017070 con 0x7fa8d80b2590 2024-09-16T07:28:47.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d4c00640 1 -- 172.21.15.114:0/890416937 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c80053c0 con 0x7fa8d80b2590 2024-09-16T07:28:47.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8d4c00640 1 -- 172.21.15.114:0/890416937 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8003860 con 0x7fa8d80b2590 2024-09-16T07:28:47.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d80b4c10 con 0x7fa8d80b2590 2024-09-16T07:28:47.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d8158670 con 0x7fa8d80b2590 2024-09-16T07:28:47.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.640+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d80b4a00 con 0x7fa8d80b2590 2024-09-16T07:28:47.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.644+0000 7fa8d4c00640 1 -- 172.21.15.114:0/890416937 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fa8c801a070 con 0x7fa8d80b2590 2024-09-16T07:28:47.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.644+0000 7fa8d4c00640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8b4072ec0 0x7fa8b4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.644+0000 7fa8d4c00640 1 -- 172.21.15.114:0/890416937 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa8c8093070 con 0x7fa8d80b2590 2024-09-16T07:28:47.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.644+0000 7fa8cf400640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8b4072ec0 0x7fa8b4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.644+0000 7fa8cf400640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8b4072ec0 0x7fa8b4075380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8d809faa0 tx=0x7fa8c000b390 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:47.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.648+0000 7fa8d4c00640 1 -- 172.21.15.114:0/890416937 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa8c805dc60 con 0x7fa8d80b2590 2024-09-16T07:28:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.816+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8d80b29e0 con 0x7fa8d80b2590 2024-09-16T07:28:47.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8d4c00640 1 -- 172.21.15.114:0/890416937 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16713 (secure 0 0 0) 0x7fa8c8062690 con 0x7fa8d80b2590 2024-09-16T07:28:47.824 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:47.824 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:22.454295+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8b4072ec0 msgr2=0x7fa8b4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8b4072ec0 0x7fa8b4075380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8d809faa0 tx=0x7fa8c000b390 comp rx=0 tx=0).stop 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 msgr2=0x7fa8d80b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b56f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c3c0 tx=0x7fa8c800c880 comp rx=0 tx=0).stop 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 shutdown_connections 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa8b4072ec0 0x7fa8b4075380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8d815f000 0x7fa8d80b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8d80d01b0 0x7fa8d8158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 --2- 172.21.15.114:0/890416937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8d80b2590 0x7fa8d80b56f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 >> 172.21.15.114:0/890416937 conn(0x7fa8d809aa10 msgr2=0x7fa8d80aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 shutdown_connections 2024-09-16T07:28:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.820+0000 7fa8dd800640 1 -- 172.21.15.114:0/890416937 wait complete. 2024-09-16T07:28:47.846 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T07:28:18.623261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T07:28:19.803661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:28:47.846 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:28:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.984+0000 7fe565c00640 1 -- 172.21.15.114:0/3746266419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015bd50 msgr2=0x7fe5600ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.984+0000 7fe565c00640 1 --2- 172.21.15.114:0/3746266419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015bd50 0x7fe5600ce5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe550009bc0 tx=0x7fe55001ca80 comp rx=0 tx=0).stop 2024-09-16T07:28:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.984+0000 7fe565c00640 1 -- 172.21.15.114:0/3746266419 shutdown_connections 2024-09-16T07:28:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.984+0000 7fe565c00640 1 --2- 172.21.15.114:0/3746266419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015bd50 0x7fe5600ce5e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.984+0000 7fe565c00640 1 -- 172.21.15.114:0/3746266419 >> 172.21.15.114:0/3746266419 conn(0x7fe5600d1ea0 msgr2=0x7fe5600d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.984+0000 7fe565c00640 1 -- 172.21.15.114:0/3746266419 shutdown_connections 2024-09-16T07:28:47.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.984+0000 7fe565c00640 1 -- 172.21.15.114:0/3746266419 wait complete. 2024-09-16T07:28:47.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 Processor -- start 2024-09-16T07:28:47.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 -- start start 2024-09-16T07:28:47.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5600cf4e0 0x7fe560155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe56015bd50 0x7fe56014b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015c130 0x7fe560071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe56016a670 con 0x7fe56015c130 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe56016a4f0 con 0x7fe56015bd50 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe56016a7f0 con 0x7fe5600cf4e0 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5600cf4e0 0x7fe560155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015c130 0x7fe560071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5600cf4e0 0x7fe560155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:51220/0 (socket says 172.21.15.114:51220) 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 -- 172.21.15.114:0/623011603 learned_addr learned my addr 172.21.15.114:0/623011603 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55e000640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe56015bd50 0x7fe56014b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 -- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe56015bd50 msgr2=0x7fe56014b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe56015bd50 0x7fe56014b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 -- 172.21.15.114:0/623011603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015c130 msgr2=0x7fe560071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015c130 0x7fe560071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 -- 172.21.15.114:0/623011603 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5600b6fd0 con 0x7fe5600cf4e0 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe55ea00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5600cf4e0 0x7fe560155ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe550009b10 tx=0x7fe5500a5990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe556a00640 1 -- 172.21.15.114:0/623011603 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500bb070 con 0x7fe5600cf4e0 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe556a00640 1 -- 172.21.15.114:0/623011603 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe550004e00 con 0x7fe5600cf4e0 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5600b72b0 con 0x7fe5600cf4e0 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe556a00640 1 -- 172.21.15.114:0/623011603 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5500b2040 con 0x7fe5600cf4e0 2024-09-16T07:28:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.988+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5600b7870 con 0x7fe5600cf4e0 2024-09-16T07:28:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.992+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5600b7ab0 con 0x7fe5600cf4e0 2024-09-16T07:28:47.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.992+0000 7fe556a00640 1 -- 172.21.15.114:0/623011603 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fe5500be070 con 0x7fe5600cf4e0 2024-09-16T07:28:47.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.992+0000 7fe556a00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe540072ec0 0x7fe540075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:47.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.992+0000 7fe556a00640 1 -- 172.21.15.114:0/623011603 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe55012dbf0 con 0x7fe5600cf4e0 2024-09-16T07:28:47.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.992+0000 7fe55e000640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe540072ec0 0x7fe540075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:47.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.992+0000 7fe55e000640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe540072ec0 0x7fe540075380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe560155e60 tx=0x7fe54c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:48.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:47.996+0000 7fe556a00640 1 -- 172.21.15.114:0/623011603 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe5600cef30 con 0x7fe5600cf4e0 2024-09-16T07:28:48.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe5600ce5e0 con 0x7fe5600cf4e0 2024-09-16T07:28:48.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe556a00640 1 -- 172.21.15.114:0/623011603 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fe550016790 con 0x7fe5600cf4e0 2024-09-16T07:28:48.168 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:28:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe540072ec0 msgr2=0x7fe540075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe540072ec0 0x7fe540075380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe560155e60 tx=0x7fe54c009040 comp rx=0 tx=0).stop 2024-09-16T07:28:48.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5600cf4e0 msgr2=0x7fe560155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5600cf4e0 0x7fe560155ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe550009b10 tx=0x7fe5500a5990 comp rx=0 tx=0).stop 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 shutdown_connections 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe540072ec0 0x7fe540075380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015c130 0x7fe560071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe56015bd50 0x7fe56014b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 --2- 172.21.15.114:0/623011603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5600cf4e0 0x7fe560155ed0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 >> 172.21.15.114:0/623011603 conn(0x7fe5600d1ea0 msgr2=0x7fe5600d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 shutdown_connections 2024-09-16T07:28:48.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.164+0000 7fe565c00640 1 -- 172.21.15.114:0/623011603 wait complete. 2024-09-16T07:28:48.189 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T07:28:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3934184348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15f390 msgr2=0x7f1c9c15cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3934184348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15f390 0x7f1c9c15cdb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009c80 tx=0x7f1c8c01cda0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3934184348 shutdown_connections 2024-09-16T07:28:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3934184348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c9c0b3d80 0x7f1c9c06ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3934184348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15f390 0x7f1c9c15cdb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3934184348 >> 172.21.15.114:0/3934184348 conn(0x7f1c9c06ecb0 msgr2=0x7f1c9c06f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:48.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3934184348 shutdown_connections 2024-09-16T07:28:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.328+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3934184348 wait complete. 2024-09-16T07:28:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 Processor -- start 2024-09-16T07:28:48.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 -- start start 2024-09-16T07:28:48.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c9c0b3d80 0x7f1c9c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15d4f0 0x7f1c9c14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c9c15f390 0x7f1c9c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c1692c0 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c169140 con 0x7f1c9c0b3d80 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c169440 con 0x7f1c9c15f390 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15d4f0 0x7f1c9c14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15d4f0 0x7f1c9c14f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38250/0 (socket says 172.21.15.114:38250) 2024-09-16T07:28:48.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 -- 172.21.15.114:0/3769932406 learned_addr learned my addr 172.21.15.114:0/3769932406 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 -- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c9c15f390 msgr2=0x7f1c9c15a170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:28:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c9c15f390 0x7f1c9c15a170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 -- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c9c0b3d80 msgr2=0x7f1c9c150e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c9c0b3d80 0x7f1c9c150e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 -- 172.21.15.114:0/3769932406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c14f720 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c9a000640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15d4f0 0x7f1c9c14f1e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c4b0 tx=0x7f1c8800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c92a00640 1 -- 172.21.15.114:0/3769932406 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c880052d0 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c92a00640 1 -- 172.21.15.114:0/3769932406 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c88005470 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1c92a00640 1 -- 172.21.15.114:0/3769932406 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88012870 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c1f5960 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1f5f20 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.332+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c06ff10 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.336+0000 7f1c92a00640 1 -- 172.21.15.114:0/3769932406 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1c88003600 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.336+0000 7f1c92a00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c7c072ec0 0x7f1c7c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.336+0000 7f1c92a00640 1 -- 172.21.15.114:0/3769932406 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1c880939b0 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.336+0000 7f1c9aa00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c7c072ec0 0x7f1c7c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.336+0000 7f1c9aa00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c7c072ec0 0x7f1c7c075380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0af000 tx=0x7f1c8c01b5e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.340+0000 7f1c92a00640 1 -- 172.21.15.114:0/3769932406 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1c8805ec00 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.504+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1c9c155f80 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.504+0000 7f1c92a00640 1 -- 172.21.15.114:0/3769932406 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f1c8805e500 con 0x7f1c9c15d4f0 2024-09-16T07:28:48.511 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c7c072ec0 msgr2=0x7f1c7c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c7c072ec0 0x7f1c7c075380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0af000 tx=0x7f1c8c01b5e0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15d4f0 msgr2=0x7f1c9c14f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15d4f0 0x7f1c9c14f1e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c4b0 tx=0x7f1c8800c970 comp rx=0 tx=0).stop 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 shutdown_connections 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c7c072ec0 0x7f1c7c075380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c9c15f390 0x7f1c9c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c9c15d4f0 0x7f1c9c14f1e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 --2- 172.21.15.114:0/3769932406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c9c0b3d80 0x7f1c9c150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 >> 172.21.15.114:0/3769932406 conn(0x7f1c9c06ecb0 msgr2=0x7f1c9c06f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 shutdown_connections 2024-09-16T07:28:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.508+0000 7f1ca1c00640 1 -- 172.21.15.114:0/3769932406 wait complete. 2024-09-16T07:28:48.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T07:28:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 -- 172.21.15.114:0/2881712372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e81605d0 msgr2=0x7ff5e80d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 --2- 172.21.15.114:0/2881712372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e81605d0 0x7ff5e80d0690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009900 tx=0x7ff5dc01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 -- 172.21.15.114:0/2881712372 shutdown_connections 2024-09-16T07:28:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 --2- 172.21.15.114:0/2881712372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e80b1650 0x7ff5e80b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 --2- 172.21.15.114:0/2881712372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e81605d0 0x7ff5e80d0690 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 -- 172.21.15.114:0/2881712372 >> 172.21.15.114:0/2881712372 conn(0x7ff5e80d1dd0 msgr2=0x7ff5e80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 -- 172.21.15.114:0/2881712372 shutdown_connections 2024-09-16T07:28:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.672+0000 7ff5efe00640 1 -- 172.21.15.114:0/2881712372 wait complete. 2024-09-16T07:28:48.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 Processor -- start 2024-09-16T07:28:48.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 -- start start 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e80aeb00 0x7ff5e8152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e80b1650 0x7ff5e806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e81605d0 0x7ff5e8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80b0810 con 0x7ff5e80aeb00 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e80b0ee0 con 0x7ff5e80b1650 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e80b1220 con 0x7ff5e81605d0 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e80aeb00 0x7ff5e8152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:48.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e80aeb00 0x7ff5e8152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38258/0 (socket says 172.21.15.114:38258) 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5eca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e80b1650 0x7ff5e806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 -- 172.21.15.114:0/1259434084 learned_addr learned my addr 172.21.15.114:0/1259434084 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ede00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e81605d0 0x7ff5e8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 -- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e81605d0 msgr2=0x7ff5e8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e81605d0 0x7ff5e8152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 -- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e80b1650 msgr2=0x7ff5e806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e80b1650 0x7ff5e806dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 -- 172.21.15.114:0/1259434084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e8165520 con 0x7ff5e80aeb00 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5ed400640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e80aeb00 0x7ff5e8152820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc01a510 tx=0x7ff5dc005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5e5600640 1 -- 172.21.15.114:0/1259434084 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0b2040 con 0x7ff5e80aeb00 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5e5600640 1 -- 172.21.15.114:0/1259434084 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5dc004240 con 0x7ff5e80aeb00 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e8165800 con 0x7ff5e80aeb00 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5e5600640 1 -- 172.21.15.114:0/1259434084 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc005030 con 0x7ff5e80aeb00 2024-09-16T07:28:48.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e8155280 con 0x7ff5e80aeb00 2024-09-16T07:28:48.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.676+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e80b1a30 con 0x7ff5e80aeb00 2024-09-16T07:28:48.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.680+0000 7ff5e5600640 1 -- 172.21.15.114:0/1259434084 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff5dc0051d0 con 0x7ff5e80aeb00 2024-09-16T07:28:48.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.680+0000 7ff5e5600640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff5c8072ec0 0x7ff5c8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:48.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.680+0000 7ff5e5600640 1 -- 172.21.15.114:0/1259434084 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff5dc12d630 con 0x7ff5e80aeb00 2024-09-16T07:28:48.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.680+0000 7ff5eca00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff5c8072ec0 0x7ff5c8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:48.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.680+0000 7ff5eca00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff5c8072ec0 0x7ff5c8075380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5e81539a0 tx=0x7ff5d40091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:48.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.684+0000 7ff5e5600640 1 -- 172.21.15.114:0/1259434084 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff5dc0164d0 con 0x7ff5e80aeb00 2024-09-16T07:28:48.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff5e80d1080 con 0x7ff5e80aeb00 2024-09-16T07:28:48.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5e5600640 1 -- 172.21.15.114:0/1259434084 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7ff5dc0f8220 con 0x7ff5e80aeb00 2024-09-16T07:28:48.862 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-16T07:28:48.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff5c8072ec0 msgr2=0x7ff5c8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff5c8072ec0 0x7ff5c8075380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff5e81539a0 tx=0x7ff5d40091e0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e80aeb00 msgr2=0x7ff5e8152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:48.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e80aeb00 0x7ff5e8152820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc01a510 tx=0x7ff5dc005760 comp rx=0 tx=0).stop 2024-09-16T07:28:48.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 shutdown_connections 2024-09-16T07:28:48.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff5c8072ec0 0x7ff5c8075380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e81605d0 0x7ff5e8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e80b1650 0x7ff5e806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 --2- 172.21.15.114:0/1259434084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e80aeb00 0x7ff5e8152820 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:48.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 >> 172.21.15.114:0/1259434084 conn(0x7ff5e80d1dd0 msgr2=0x7ff5e80b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:48.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 shutdown_connections 2024-09-16T07:28:48.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:48.856+0000 7ff5efe00640 1 -- 172.21.15.114:0/1259434084 wait complete. 2024-09-16T07:28:48.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-16T07:28:49.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- 172.21.15.114:0/498308225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd015f490 msgr2=0x7fedd00b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 --2- 172.21.15.114:0/498308225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd015f490 0x7fedd00b14c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fedd0074950 tx=0x7fedc001c740 comp rx=0 tx=0).stop 2024-09-16T07:28:49.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- 172.21.15.114:0/498308225 shutdown_connections 2024-09-16T07:28:49.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 --2- 172.21.15.114:0/498308225 >> v2:172.21.15.149:3300/0 conn(0x7fedd00afca0 0x7fedd00b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 --2- 172.21.15.114:0/498308225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd015f490 0x7fedd00b14c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- 172.21.15.114:0/498308225 >> 172.21.15.114:0/498308225 conn(0x7fedd00d1e30 msgr2=0x7fedd00d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:49.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- 172.21.15.114:0/498308225 shutdown_connections 2024-09-16T07:28:49.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- 172.21.15.114:0/498308225 wait complete. 2024-09-16T07:28:49.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 Processor -- start 2024-09-16T07:28:49.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- start start 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd00afca0 0x7fedd01509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fedd00b2e80 0x7fedd00b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fedd015f490 0x7fedd00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fedd0168e00 con 0x7fedd00afca0 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fedd0168c80 con 0x7fedd015f490 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedd7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fedd0168f80 con 0x7fedd00b2e80 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedcfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd00afca0 0x7fedd01509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedcfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd00afca0 0x7fedd01509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38278/0 (socket says 172.21.15.114:38278) 2024-09-16T07:28:49.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.020+0000 7fedcfe00640 1 -- 172.21.15.114:0/173282443 learned_addr learned my addr 172.21.15.114:0/173282443 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedcfe00640 1 -- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fedd00b2e80 msgr2=0x7fedd00b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedcfe00640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fedd00b2e80 0x7fedd00b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedcfe00640 1 -- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fedd015f490 msgr2=0x7fedd00cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedcfe00640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fedd015f490 0x7fedd00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedcfe00640 1 -- 172.21.15.114:0/173282443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd00cd470 con 0x7fedd00afca0 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedcfe00640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd00afca0 0x7fedd01509d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fedc0000c10 tx=0x7fedc00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedccc00640 1 -- 172.21.15.114:0/173282443 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc00bc070 con 0x7fedd00afca0 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedccc00640 1 -- 172.21.15.114:0/173282443 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedc0003600 con 0x7fedd00afca0 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd00cd750 con 0x7fedd00afca0 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedccc00640 1 -- 172.21.15.114:0/173282443 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc00b2040 con 0x7fedd00afca0 2024-09-16T07:28:49.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd0150f10 con 0x7fedd00afca0 2024-09-16T07:28:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd00b00d0 con 0x7fedd00afca0 2024-09-16T07:28:49.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.024+0000 7fedccc00640 1 -- 172.21.15.114:0/173282443 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fedc00bf070 con 0x7fedd00afca0 2024-09-16T07:28:49.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.028+0000 7fedccc00640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fedac072ec0 0x7fedac075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.028+0000 7fedccc00640 1 -- 172.21.15.114:0/173282443 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fedc012d790 con 0x7fedd00afca0 2024-09-16T07:28:49.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.028+0000 7fedc7400640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fedac072ec0 0x7fedac075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:49.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.028+0000 7fedc7400640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fedac072ec0 0x7fedac075380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007fd0 tx=0x7fedb80078e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:49.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.032+0000 7fedccc00640 1 -- 172.21.15.114:0/173282443 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fedc00163f0 con 0x7fedd00afca0 2024-09-16T07:28:49.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.260+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fedd00b1440 con 0x7fedd00afca0 2024-09-16T07:28:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedccc00640 1 -- 172.21.15.114:0/173282443 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v51) ==== 161+0+0 (secure 0 0 0) 0x7fedc00f8940 con 0x7fedd00afca0 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fedac072ec0 msgr2=0x7fedac075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fedac072ec0 0x7fedac075380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007fd0 tx=0x7fedb80078e0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd00afca0 msgr2=0x7fedd01509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd00afca0 0x7fedd01509d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fedc0000c10 tx=0x7fedc00040e0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 shutdown_connections 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fedac072ec0 0x7fedac075380 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fedd015f490 0x7fedd00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fedd00b2e80 0x7fedd00b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 --2- 172.21.15.114:0/173282443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedd00afca0 0x7fedd01509d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 >> 172.21.15.114:0/173282443 conn(0x7fedd00d1e30 msgr2=0x7fedd00b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 shutdown_connections 2024-09-16T07:28:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.584+0000 7fedd7000640 1 -- 172.21.15.114:0/173282443 wait complete. 2024-09-16T07:28:49.610 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:28:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- 172.21.15.114:0/2315231014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 msgr2=0x7f1d540ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 --2- 172.21.15.114:0/2315231014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 0x7f1d540ce670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009870 tx=0x7f1d4401c860 comp rx=0 tx=0).stop 2024-09-16T07:28:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- 172.21.15.114:0/2315231014 shutdown_connections 2024-09-16T07:28:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 --2- 172.21.15.114:0/2315231014 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 0x7f1d540ce670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- 172.21.15.114:0/2315231014 >> 172.21.15.114:0/2315231014 conn(0x7f1d540d1dc0 msgr2=0x7f1d540d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- 172.21.15.114:0/2315231014 shutdown_connections 2024-09-16T07:28:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- 172.21.15.114:0/2315231014 wait complete. 2024-09-16T07:28:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 Processor -- start 2024-09-16T07:28:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- start start 2024-09-16T07:28:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d540cdb30 0x7f1d540b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d540d28e0 0x7f1d5409f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 0x7f1d541f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5416a930 con 0x7f1d540d28e0 2024-09-16T07:28:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5416a7b0 con 0x7f1d540cdb30 2024-09-16T07:28:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.748+0000 7f1d5b600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5416aab0 con 0x7f1d5415bea0 2024-09-16T07:28:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d540d28e0 0x7f1d5409f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d58c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d540cdb30 0x7f1d540b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d540d28e0 0x7f1d5409f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38292/0 (socket says 172.21.15.114:38292) 2024-09-16T07:28:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 -- 172.21.15.114:0/3722341359 learned_addr learned my addr 172.21.15.114:0/3722341359 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d59600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 0x7f1d541f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 -- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 msgr2=0x7f1d541f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 0x7f1d541f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 -- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d540cdb30 msgr2=0x7f1d540b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d540cdb30 0x7f1d540b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 -- 172.21.15.114:0/3722341359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d541f8950 con 0x7f1d540d28e0 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d58c00640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d540cdb30 0x7f1d540b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d4be00640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d540d28e0 0x7f1d5409f480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00c4c0 tx=0x7f1d3c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d51600640 1 -- 172.21.15.114:0/3722341359 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0052d0 con 0x7f1d540d28e0 2024-09-16T07:28:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d51600640 1 -- 172.21.15.114:0/3722341359 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d3c005490 con 0x7f1d540d28e0 2024-09-16T07:28:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d541f8c30 con 0x7f1d540d28e0 2024-09-16T07:28:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d51600640 1 -- 172.21.15.114:0/3722341359 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c012870 con 0x7f1d540d28e0 2024-09-16T07:28:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d540b1100 con 0x7f1d540d28e0 2024-09-16T07:28:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d540b5780 con 0x7f1d540d28e0 2024-09-16T07:28:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.752+0000 7f1d51600640 1 -- 172.21.15.114:0/3722341359 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1d3c012a10 con 0x7f1d540d28e0 2024-09-16T07:28:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.756+0000 7f1d51600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1d30072ec0 0x7f1d30075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.756+0000 7f1d51600640 1 -- 172.21.15.114:0/3722341359 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1d3c0938a0 con 0x7f1d540d28e0 2024-09-16T07:28:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.756+0000 7f1d58c00640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1d30072ec0 0x7f1d30075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:49.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.756+0000 7f1d58c00640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1d30072ec0 0x7f1d30075380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d440af000 tx=0x7f1d4401b0a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.760+0000 7f1d51600640 1 -- 172.21.15.114:0/3722341359 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1d3c05e400 con 0x7f1d540d28e0 2024-09-16T07:28:49.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.924+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f1d5409bdc0 con 0x7f1d540d28e0 2024-09-16T07:28:49.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.924+0000 7f1d51600640 1 -- 172.21.15.114:0/3722341359 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f1d3c062e30 con 0x7f1d540d28e0 2024-09-16T07:28:49.930 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:28:49.930 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:28:49.931 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:28:49.932 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:28:49.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1d30072ec0 msgr2=0x7f1d30075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1d30072ec0 0x7f1d30075380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d440af000 tx=0x7f1d4401b0a0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d540d28e0 msgr2=0x7f1d5409f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:49.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d540d28e0 0x7f1d5409f480 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00c4c0 tx=0x7f1d3c00c980 comp rx=0 tx=0).stop 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 shutdown_connections 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1d30072ec0 0x7f1d30075380 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1d5415bea0 0x7f1d541f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d540d28e0 0x7f1d5409f480 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 --2- 172.21.15.114:0/3722341359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d540cdb30 0x7f1d540b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 >> 172.21.15.114:0/3722341359 conn(0x7f1d540d1dc0 msgr2=0x7f1d5406ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 shutdown_connections 2024-09-16T07:28:49.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:49.928+0000 7f1d5b600640 1 -- 172.21.15.114:0/3722341359 wait complete. 2024-09-16T07:28:49.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:28:50.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- 172.21.15.114:0/1946126576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 msgr2=0x7f3c88004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 --2- 172.21.15.114:0/1946126576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 0x7f3c88004810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009b30 tx=0x7f3c9001cf10 comp rx=0 tx=0).stop 2024-09-16T07:28:50.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3ca8e00640 1 -- 172.21.15.114:0/1946126576 reap_dead start 2024-09-16T07:28:50.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- 172.21.15.114:0/1946126576 shutdown_connections 2024-09-16T07:28:50.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- 172.21.15.114:0/1946126576 >> 172.21.15.114:0/1946126576 conn(0x7f3ca40d1ea0 msgr2=0x7f3ca40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:50.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- 172.21.15.114:0/1946126576 shutdown_connections 2024-09-16T07:28:50.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- 172.21.15.114:0/1946126576 wait complete. 2024-09-16T07:28:50.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 Processor -- start 2024-09-16T07:28:50.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- start start 2024-09-16T07:28:50.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 0x7f3ca41fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca40c7a60 0x7f3ca40c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ca40b5e30 0x7f3ca40b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca41673b0 con 0x7f3c88003fe0 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca4167230 con 0x7f3ca40c7a60 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3caae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca4167530 con 0x7f3ca40b5e30 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3ca3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 0x7f3ca41fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3ca3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 0x7f3ca41fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38322/0 (socket says 172.21.15.114:38322) 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3ca3e00640 1 -- 172.21.15.114:0/1959197247 learned_addr learned my addr 172.21.15.114:0/1959197247 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3ca3400640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca40c7a60 0x7f3ca40c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3ca8e00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ca40b5e30 0x7f3ca40b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.092+0000 7f3ca3e00640 1 -- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ca40b5e30 msgr2=0x7f3ca40b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3ca3e00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ca40b5e30 0x7f3ca40b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3ca3e00640 1 -- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca40c7a60 msgr2=0x7f3ca40c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3ca3e00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca40c7a60 0x7f3ca40c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3ca3e00640 1 -- 172.21.15.114:0/1959197247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca40b67f0 con 0x7f3c88003fe0 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3ca8e00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ca40b5e30 0x7f3ca40b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3ca3e00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 0x7f3ca41fc260 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3c94010cc0 tx=0x7f3c9400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3c9be00640 1 -- 172.21.15.114:0/1959197247 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94017070 con 0x7f3c88003fe0 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3c9be00640 1 -- 172.21.15.114:0/1959197247 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c94011730 con 0x7f3c88003fe0 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3c9be00640 1 -- 172.21.15.114:0/1959197247 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94011b40 con 0x7f3c88003fe0 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca41f8790 con 0x7f3c88003fe0 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca41f8d50 con 0x7f3c88003fe0 2024-09-16T07:28:50.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca40ce5e0 con 0x7f3c88003fe0 2024-09-16T07:28:50.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.096+0000 7f3c9be00640 1 -- 172.21.15.114:0/1959197247 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f3c94011ce0 con 0x7f3c88003fe0 2024-09-16T07:28:50.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.100+0000 7f3c9be00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3c84072ef0 0x7f3c840753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.100+0000 7f3c9be00640 1 -- 172.21.15.114:0/1959197247 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3c94094a20 con 0x7f3c88003fe0 2024-09-16T07:28:50.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.100+0000 7f3ca3400640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3c84072ef0 0x7f3c840753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.100+0000 7f3ca3400640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3c84072ef0 0x7f3c840753b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c900ae000 tx=0x7f3c900aa040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:50.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.104+0000 7f3c9be00640 1 -- 172.21.15.114:0/1959197247 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3c9405f580 con 0x7f3c88003fe0 2024-09-16T07:28:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.268+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3ca40c8800 con 0x7f3c88003fe0 2024-09-16T07:28:50.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.272+0000 7f3c9be00640 1 -- 172.21.15.114:0/1959197247 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f3c94063fb0 con 0x7f3c88003fe0 2024-09-16T07:28:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3c84072ef0 msgr2=0x7f3c840753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3c84072ef0 0x7f3c840753b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c900ae000 tx=0x7f3c900aa040 comp rx=0 tx=0).stop 2024-09-16T07:28:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 msgr2=0x7f3ca41fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 0x7f3ca41fc260 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3c94010cc0 tx=0x7f3c9400e720 comp rx=0 tx=0).stop 2024-09-16T07:28:50.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 shutdown_connections 2024-09-16T07:28:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3c84072ef0 0x7f3c840753b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3ca40b5e30 0x7f3ca40b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca40c7a60 0x7f3ca40c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 --2- 172.21.15.114:0/1959197247 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3c88003fe0 0x7f3ca41fc260 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 >> 172.21.15.114:0/1959197247 conn(0x7f3ca40d1ea0 msgr2=0x7f3ca415aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 shutdown_connections 2024-09-16T07:28:50.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.276+0000 7f3caae00640 1 -- 172.21.15.114:0/1959197247 wait complete. 2024-09-16T07:28:50.300 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:28:50.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:28:50.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:28:50.469 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:28:50.469 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:50.470 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:50.478 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:50.479 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:50.526 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:50.527 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:50.578 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 -- 172.21.15.114:0/2387043137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 msgr2=0x7f2f480b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/2387043137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f480b14c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2f48074950 tx=0x7f2f3c01c800 comp rx=0 tx=0).stop 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 -- 172.21.15.114:0/2387043137 shutdown_connections 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/2387043137 >> v2:172.21.15.149:3300/0 conn(0x7f2f480afca0 0x7f2f480b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/2387043137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f480b14c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 -- 172.21.15.114:0/2387043137 >> 172.21.15.114:0/2387043137 conn(0x7f2f480d1e30 msgr2=0x7f2f480d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 -- 172.21.15.114:0/2387043137 shutdown_connections 2024-09-16T07:28:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.760+0000 7f2f4fe00640 1 -- 172.21.15.114:0/2387043137 wait complete. 2024-09-16T07:28:50.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 Processor -- start 2024-09-16T07:28:50.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 -- start start 2024-09-16T07:28:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f480afca0 0x7f2f4814d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f480b2e80 0x7f2f480b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f4814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48168e00 con 0x7f2f4815f490 2024-09-16T07:28:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48168c80 con 0x7f2f480afca0 2024-09-16T07:28:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f48168f80 con 0x7f2f480b2e80 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f4814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f480afca0 0x7f2f4814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f4814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38334/0 (socket says 172.21.15.114:38334) 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 -- 172.21.15.114:0/772045876 learned_addr learned my addr 172.21.15.114:0/772045876 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4ca00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f480b2e80 0x7f2f480b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 -- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f480b2e80 msgr2=0x7f2f480b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f480b2e80 0x7f2f480b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 -- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f480afca0 msgr2=0x7f2f4814d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f480afca0 0x7f2f4814d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 -- 172.21.15.114:0/772045876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f480b1e80 con 0x7f2f4815f490 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4d400640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f480afca0 0x7f2f4814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:50.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4de00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f4814e560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000eb20 tx=0x7f2f4000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:50.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f45600640 1 -- 172.21.15.114:0/772045876 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40004b30 con 0x7f2f4815f490 2024-09-16T07:28:50.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f45600640 1 -- 172.21.15.114:0/772045876 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f40004cf0 con 0x7f2f4815f490 2024-09-16T07:28:50.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f45600640 1 -- 172.21.15.114:0/772045876 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40005280 con 0x7f2f4815f490 2024-09-16T07:28:50.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4814d940 con 0x7f2f4815f490 2024-09-16T07:28:50.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f480b50e0 con 0x7f2f4815f490 2024-09-16T07:28:50.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.764+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f480b00d0 con 0x7f2f4815f490 2024-09-16T07:28:50.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.768+0000 7f2f45600640 1 -- 172.21.15.114:0/772045876 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f2f40005420 con 0x7f2f4815f490 2024-09-16T07:28:50.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.768+0000 7f2f45600640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f28072ec0 0x7f2f28075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:50.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.768+0000 7f2f45600640 1 -- 172.21.15.114:0/772045876 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2f40094b00 con 0x7f2f4815f490 2024-09-16T07:28:50.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.768+0000 7f2f4d400640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f28072ec0 0x7f2f28075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:50.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.768+0000 7f2f4d400640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f28072ec0 0x7f2f28075380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0af000 tx=0x7f2f3c01b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:50.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.772+0000 7f2f45600640 1 -- 172.21.15.114:0/772045876 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2f4005f660 con 0x7f2f4815f490 2024-09-16T07:28:50.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2f480763d0 con 0x7f2f4815f490 2024-09-16T07:28:50.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f45600640 1 -- 172.21.15.114:0/772045876 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f2f40064090 con 0x7f2f4815f490 2024-09-16T07:28:50.953 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f28072ec0 msgr2=0x7f2f28075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f28072ec0 0x7f2f28075380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0af000 tx=0x7f2f3c01b040 comp rx=0 tx=0).stop 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 msgr2=0x7f2f4814e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f4814e560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000eb20 tx=0x7f2f4000c2d0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 shutdown_connections 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f28072ec0 0x7f2f28075380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f4815f490 0x7f2f4814e560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f480b2e80 0x7f2f480b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 --2- 172.21.15.114:0/772045876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f480afca0 0x7f2f4814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:50.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 >> 172.21.15.114:0/772045876 conn(0x7f2f480d1e30 msgr2=0x7f2f480b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:50.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 shutdown_connections 2024-09-16T07:28:50.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:50.948+0000 7f2f4fe00640 1 -- 172.21.15.114:0/772045876 wait complete. 2024-09-16T07:28:50.974 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:28:50.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:50.975 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-16T07:28:51.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:28:51.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:51.010 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:28:51.071 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:51.071 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:51.081 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:51.081 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:51.129 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:51.130 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:51.178 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 -- 172.21.15.114:0/2816994108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe638159990 msgr2=0x7fe6380d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 --2- 172.21.15.114:0/2816994108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe638159990 0x7fe6380d0420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe6380b5a10 tx=0x7fe62801c830 comp rx=0 tx=0).stop 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 -- 172.21.15.114:0/2816994108 shutdown_connections 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 --2- 172.21.15.114:0/2816994108 >> v2:172.21.15.149:3300/0 conn(0x7fe6380afac0 0x7fe6380d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 --2- 172.21.15.114:0/2816994108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe638159990 0x7fe6380d0420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 -- 172.21.15.114:0/2816994108 >> 172.21.15.114:0/2816994108 conn(0x7fe6380b2240 msgr2=0x7fe6380b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 -- 172.21.15.114:0/2816994108 shutdown_connections 2024-09-16T07:28:51.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 -- 172.21.15.114:0/2816994108 wait complete. 2024-09-16T07:28:51.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 Processor -- start 2024-09-16T07:28:51.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.316+0000 7fe63e400640 1 -- start start 2024-09-16T07:28:51.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63806f1d0 0x7fe63814bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6380afac0 0x7fe6381544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe638159990 0x7fe63815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe638169060 con 0x7fe63806f1d0 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe638073390 con 0x7fe6380afac0 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6381691e0 con 0x7fe638159990 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63806f1d0 0x7fe63814bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63806f1d0 0x7fe63814bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38352/0 (socket says 172.21.15.114:38352) 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 -- 172.21.15.114:0/183909618 learned_addr learned my addr 172.21.15.114:0/183909618 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe62ea00640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6380afac0 0x7fe6381544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637e00640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe638159990 0x7fe63815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 -- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe638159990 msgr2=0x7fe63815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe638159990 0x7fe63815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 -- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6380afac0 msgr2=0x7fe6381544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6380afac0 0x7fe6381544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 -- 172.21.15.114:0/183909618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63815a3d0 con 0x7fe63806f1d0 2024-09-16T07:28:51.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe62ea00640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6380afac0 0x7fe6381544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe637400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63806f1d0 0x7fe63814bfc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe6280b0040 tx=0x7fe6280a66f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe62fe00640 1 -- 172.21.15.114:0/183909618 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628004380 con 0x7fe63806f1d0 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe62fe00640 1 -- 172.21.15.114:0/183909618 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe628005020 con 0x7fe63806f1d0 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe62fe00640 1 -- 172.21.15.114:0/183909618 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628005470 con 0x7fe63806f1d0 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe638154d30 con 0x7fe63806f1d0 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63815a950 con 0x7fe63806f1d0 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63806cc20 con 0x7fe63806f1d0 2024-09-16T07:28:51.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.320+0000 7fe62fe00640 1 -- 172.21.15.114:0/183909618 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fe6280be060 con 0x7fe63806f1d0 2024-09-16T07:28:51.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.324+0000 7fe62fe00640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe614072ec0 0x7fe614075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.324+0000 7fe62fe00640 1 -- 172.21.15.114:0/183909618 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe62812df30 con 0x7fe63806f1d0 2024-09-16T07:28:51.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.324+0000 7fe62ea00640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe614072ec0 0x7fe614075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.324+0000 7fe62ea00640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe614072ec0 0x7fe614075380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe6381593b0 tx=0x7fe620009530 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:51.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.328+0000 7fe62fe00640 1 -- 172.21.15.114:0/183909618 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe6280164b0 con 0x7fe63806f1d0 2024-09-16T07:28:51.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe638068a80 con 0x7fe63806f1d0 2024-09-16T07:28:51.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe62fe00640 1 -- 172.21.15.114:0/183909618 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fe6280f90e0 con 0x7fe63806f1d0 2024-09-16T07:28:51.509 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe614072ec0 msgr2=0x7fe614075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe614072ec0 0x7fe614075380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe6381593b0 tx=0x7fe620009530 comp rx=0 tx=0).stop 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63806f1d0 msgr2=0x7fe63814bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63806f1d0 0x7fe63814bfc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe6280b0040 tx=0x7fe6280a66f0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 shutdown_connections 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe614072ec0 0x7fe614075380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe638159990 0x7fe63815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6380afac0 0x7fe6381544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 --2- 172.21.15.114:0/183909618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63806f1d0 0x7fe63814bfc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 >> 172.21.15.114:0/183909618 conn(0x7fe6380b2240 msgr2=0x7fe63814f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:51.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 shutdown_connections 2024-09-16T07:28:51.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.504+0000 7fe63e400640 1 -- 172.21.15.114:0/183909618 wait complete. 2024-09-16T07:28:51.529 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:28:51.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:51.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-16T07:28:51.565 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:28:51.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:51.565 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:28:51.633 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:51.633 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:51.642 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:51.642 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:51.691 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:28:51.691 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:51.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:28:51.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 -- 172.21.15.114:0/3149079776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18b8004810 msgr2=0x7f18b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 --2- 172.21.15.114:0/3149079776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18b8004810 0x7f18b8004c90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f18bc001720 tx=0x7f18bc01c790 comp rx=0 tx=0).stop 2024-09-16T07:28:51.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18d8c00640 1 -- 172.21.15.114:0/3149079776 reap_dead start 2024-09-16T07:28:51.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 -- 172.21.15.114:0/3149079776 shutdown_connections 2024-09-16T07:28:51.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 -- 172.21.15.114:0/3149079776 >> 172.21.15.114:0/3149079776 conn(0x7f18d40b2240 msgr2=0x7f18d40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:51.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 -- 172.21.15.114:0/3149079776 shutdown_connections 2024-09-16T07:28:51.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 -- 172.21.15.114:0/3149079776 wait complete. 2024-09-16T07:28:51.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 Processor -- start 2024-09-16T07:28:51.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.920+0000 7f18dac00640 1 -- start start 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b8004810 0x7f18d40b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18d41f4a30 0x7f18d41f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18d415c190 0x7f18d415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f18d406fc30 con 0x7f18d415c190 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41441f0 con 0x7f18d41f4a30 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f18d406fdb0 con 0x7f18b8004810 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18d415c190 0x7f18d415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18d415c190 0x7f18d415c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38360/0 (socket says 172.21.15.114:38360) 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 -- 172.21.15.114:0/1695681134 learned_addr learned my addr 172.21.15.114:0/1695681134 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:51.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18cb400640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18d41f4a30 0x7f18d41f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d3e00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b8004810 0x7f18d40b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 -- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b8004810 msgr2=0x7f18d40b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b8004810 0x7f18d40b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 -- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18d41f4a30 msgr2=0x7f18d41f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:51.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18d41f4a30 0x7f18d41f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:51.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 -- 172.21.15.114:0/1695681134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d40b4630 con 0x7f18d415c190 2024-09-16T07:28:51.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d8c00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18d415c190 0x7f18d415c640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f18d4071200 tx=0x7f18cc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:51.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d0c00640 1 -- 172.21.15.114:0/1695681134 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc004b30 con 0x7f18d415c190 2024-09-16T07:28:51.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d0c00640 1 -- 172.21.15.114:0/1695681134 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18cc004cd0 con 0x7f18d415c190 2024-09-16T07:28:51.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d0c00640 1 -- 172.21.15.114:0/1695681134 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc003be0 con 0x7f18d415c190 2024-09-16T07:28:51.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d40b4910 con 0x7f18d415c190 2024-09-16T07:28:51.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d40b4ed0 con 0x7f18d415c190 2024-09-16T07:28:51.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d40702f0 con 0x7f18d415c190 2024-09-16T07:28:51.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.924+0000 7f18d0c00640 1 -- 172.21.15.114:0/1695681134 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f18cc004030 con 0x7f18d415c190 2024-09-16T07:28:51.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.928+0000 7f18d0c00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f18b0072ef0 0x7f18b00753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:51.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.928+0000 7f18d0c00640 1 -- 172.21.15.114:0/1695681134 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f18cc0941a0 con 0x7f18d415c190 2024-09-16T07:28:51.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.928+0000 7f18d3e00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f18b0072ef0 0x7f18b00753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:51.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.928+0000 7f18d3e00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f18b0072ef0 0x7f18b00753b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18d40b3da0 tx=0x7f18c40067b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:51.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:51.932+0000 7f18d0c00640 1 -- 172.21.15.114:0/1695681134 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f18cc05ed00 con 0x7f18d415c190 2024-09-16T07:28:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f18d415f540 con 0x7f18d415c190 2024-09-16T07:28:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18d0c00640 1 -- 172.21.15.114:0/1695681134 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f18cc063730 con 0x7f18d415c190 2024-09-16T07:28:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f18b0072ef0 msgr2=0x7f18b00753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f18b0072ef0 0x7f18b00753b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18d40b3da0 tx=0x7f18c40067b0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18d415c190 msgr2=0x7f18d415c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18d415c190 0x7f18d415c640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f18d4071200 tx=0x7f18cc00f3c0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 shutdown_connections 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f18b0072ef0 0x7f18b00753b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18d415c190 0x7f18d415c640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18d41f4a30 0x7f18d41f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 --2- 172.21.15.114:0/1695681134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18b8004810 0x7f18d40b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 >> 172.21.15.114:0/1695681134 conn(0x7f18d40b2240 msgr2=0x7f18d40b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:52.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 shutdown_connections 2024-09-16T07:28:52.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.108+0000 7f18dac00640 1 -- 172.21.15.114:0/1695681134 wait complete. 2024-09-16T07:28:52.134 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-16T07:28:52.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:52.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-16T07:28:52.157 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:28:52.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:52.157 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-16T07:28:52.208 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:52.208 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:52.219 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:52.220 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:52.271 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:28:52.271 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:28:52.323 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:28:52.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 -- 172.21.15.114:0/1720258323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607815b890 msgr2=0x7f60780ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 --2- 172.21.15.114:0/1720258323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607815b890 0x7f60780ce010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6068009840 tx=0x7f606801c7f0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 -- 172.21.15.114:0/1720258323 shutdown_connections 2024-09-16T07:28:52.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 --2- 172.21.15.114:0/1720258323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607806cc20 0x7f607806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 --2- 172.21.15.114:0/1720258323 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607815b890 0x7f60780ce010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 -- 172.21.15.114:0/1720258323 >> 172.21.15.114:0/1720258323 conn(0x7f607806dd30 msgr2=0x7f607806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:52.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 -- 172.21.15.114:0/1720258323 shutdown_connections 2024-09-16T07:28:52.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.460+0000 7f607ce00640 1 -- 172.21.15.114:0/1720258323 wait complete. 2024-09-16T07:28:52.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 Processor -- start 2024-09-16T07:28:52.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 -- start start 2024-09-16T07:28:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607806cc20 0x7f6078158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607815b890 0x7f60781fa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f607815bc70 0x7f60780c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f60781687a0 con 0x7f607815bc70 2024-09-16T07:28:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6078074630 con 0x7f607806cc20 2024-09-16T07:28:52.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6078168920 con 0x7f607815b890 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f607815bc70 0x7f60780c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f607815bc70 0x7f60780c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38364/0 (socket says 172.21.15.114:38364) 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 -- 172.21.15.114:0/2541327135 learned_addr learned my addr 172.21.15.114:0/2541327135 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077400640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607806cc20 0x7f6078158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f606fe00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607815b890 0x7f60781fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 -- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607815b890 msgr2=0x7f60781fa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607815b890 0x7f60781fa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 -- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607806cc20 msgr2=0x7f6078158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607806cc20 0x7f6078158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 -- 172.21.15.114:0/2541327135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607815c0e0 con 0x7f607815bc70 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f6077e00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f607815bc70 0x7f60780c6640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f607000eb20 tx=0x7f607000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:52.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f606f400640 1 -- 172.21.15.114:0/2541327135 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070004b30 con 0x7f607815bc70 2024-09-16T07:28:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60781fafa0 con 0x7f607815bc70 2024-09-16T07:28:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f606f400640 1 -- 172.21.15.114:0/2541327135 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6070004cf0 con 0x7f607815bc70 2024-09-16T07:28:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f606f400640 1 -- 172.21.15.114:0/2541327135 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070005280 con 0x7f607815bc70 2024-09-16T07:28:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.464+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60781fb560 con 0x7f607815bc70 2024-09-16T07:28:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.468+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607806d070 con 0x7f607815bc70 2024-09-16T07:28:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.468+0000 7f606f400640 1 -- 172.21.15.114:0/2541327135 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6070005420 con 0x7f607815bc70 2024-09-16T07:28:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.468+0000 7f606f400640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6054072ec0 0x7f6054075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.468+0000 7f606f400640 1 -- 172.21.15.114:0/2541327135 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6070094a30 con 0x7f607815bc70 2024-09-16T07:28:52.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.468+0000 7f6077400640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6054072ec0 0x7f6054075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.468+0000 7f6077400640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6054072ec0 0x7f6054075380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60680af000 tx=0x7f606801b030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:52.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.472+0000 7f606f400640 1 -- 172.21.15.114:0/2541327135 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f607005f5a0 con 0x7f607815bc70 2024-09-16T07:28:52.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60780716c0 con 0x7f607815bc70 2024-09-16T07:28:52.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f606f400640 1 -- 172.21.15.114:0/2541327135 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f6070063fd0 con 0x7f607815bc70 2024-09-16T07:28:52.657 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:28:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6054072ec0 msgr2=0x7f6054075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6054072ec0 0x7f6054075380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f60680af000 tx=0x7f606801b030 comp rx=0 tx=0).stop 2024-09-16T07:28:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f607815bc70 msgr2=0x7f60780c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f607815bc70 0x7f60780c6640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f607000eb20 tx=0x7f607000c2d0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 shutdown_connections 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6054072ec0 0x7f6054075380 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f607815bc70 0x7f60780c6640 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f607815b890 0x7f60781fa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 --2- 172.21.15.114:0/2541327135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f607806cc20 0x7f6078158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 >> 172.21.15.114:0/2541327135 conn(0x7f607806dd30 msgr2=0x7f607815a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 shutdown_connections 2024-09-16T07:28:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.652+0000 7f607ce00640 1 -- 172.21.15.114:0/2541327135 wait complete. 2024-09-16T07:28:52.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-16T07:28:52.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:52.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-16T07:28:52.703 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:28:52.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:28:52.703 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-16T07:28:52.759 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:28:52.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- 172.21.15.114:0/4210291867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 msgr2=0x7f658c0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 --2- 172.21.15.114:0/4210291867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c0cebf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f657c009900 tx=0x7f657c01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- 172.21.15.114:0/4210291867 shutdown_connections 2024-09-16T07:28:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 --2- 172.21.15.114:0/4210291867 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f658c0b4bd0 0x7f658c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 --2- 172.21.15.114:0/4210291867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c0cebf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- 172.21.15.114:0/4210291867 >> 172.21.15.114:0/4210291867 conn(0x7f658c0b18f0 msgr2=0x7f658c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- 172.21.15.114:0/4210291867 shutdown_connections 2024-09-16T07:28:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- 172.21.15.114:0/4210291867 wait complete. 2024-09-16T07:28:52.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 Processor -- start 2024-09-16T07:28:52.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- start start 2024-09-16T07:28:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f658c06e810 0x7f658c1faa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c0b4bd0 0x7f658c09d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c1fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f658c168140 con 0x7f658c15ade0 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f658c167fc0 con 0x7f658c0b4bd0 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.896+0000 7f6591200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f658c1682c0 con 0x7f658c06e810 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c1fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c1fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38378/0 (socket says 172.21.15.114:38378) 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 -- 172.21.15.114:0/260250270 learned_addr learned my addr 172.21.15.114:0/260250270 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6589e00640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f658c06e810 0x7f658c1faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6581400640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c0b4bd0 0x7f658c09d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 -- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f658c06e810 msgr2=0x7f658c1faa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f658c06e810 0x7f658c1faa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 -- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c0b4bd0 msgr2=0x7f658c09d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c0b4bd0 0x7f658c09d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 -- 172.21.15.114:0/260250270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c1fafd0 con 0x7f658c15ade0 2024-09-16T07:28:52.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f658a800640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c1fb220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f658400ea20 tx=0x7f658400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:52.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6582a00640 1 -- 172.21.15.114:0/260250270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658400cde0 con 0x7f658c15ade0 2024-09-16T07:28:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6582a00640 1 -- 172.21.15.114:0/260250270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6584004c40 con 0x7f658c15ade0 2024-09-16T07:28:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6582a00640 1 -- 172.21.15.114:0/260250270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584005280 con 0x7f658c15ade0 2024-09-16T07:28:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c073320 con 0x7f658c15ade0 2024-09-16T07:28:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c0738e0 con 0x7f658c15ade0 2024-09-16T07:28:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c069410 con 0x7f658c15ade0 2024-09-16T07:28:52.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.900+0000 7f6582a00640 1 -- 172.21.15.114:0/260250270 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6584005420 con 0x7f658c15ade0 2024-09-16T07:28:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.904+0000 7f6582a00640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6568072ec0 0x7f6568075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:52.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.904+0000 7f6582a00640 1 -- 172.21.15.114:0/260250270 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6584094800 con 0x7f658c15ade0 2024-09-16T07:28:52.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.904+0000 7f6589e00640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6568072ec0 0x7f6568075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:52.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.904+0000 7f6589e00640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6568072ec0 0x7f6568075380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f657c0af000 tx=0x7f657c01b120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:52.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:52.908+0000 7f6582a00640 1 -- 172.21.15.114:0/260250270 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f658c1fafd0 con 0x7f658c15ade0 2024-09-16T07:28:53.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.108+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f658c15e900 con 0x7f658c15ade0 2024-09-16T07:28:53.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.108+0000 7f6582a00640 1 -- 172.21.15.114:0/260250270 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f6584016030 con 0x7f658c15ade0 2024-09-16T07:28:53.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:53.115 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:53.115 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6568072ec0 msgr2=0x7f6568075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6568072ec0 0x7f6568075380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f657c0af000 tx=0x7f657c01b120 comp rx=0 tx=0).stop 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 msgr2=0x7f658c1fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c1fb220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f658400ea20 tx=0x7f658400eee0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 shutdown_connections 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6568072ec0 0x7f6568075380 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f658c15ade0 0x7f658c1fb220 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f658c0b4bd0 0x7f658c09d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 --2- 172.21.15.114:0/260250270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f658c06e810 0x7f658c1faa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 >> 172.21.15.114:0/260250270 conn(0x7f658c0b18f0 msgr2=0x7f658c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 shutdown_connections 2024-09-16T07:28:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.112+0000 7f6591200640 1 -- 172.21.15.114:0/260250270 wait complete. 2024-09-16T07:28:53.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 -- 172.21.15.114:0/3609368918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40b53f0 msgr2=0x7f06d40b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 --2- 172.21.15.114:0/3609368918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40b53f0 0x7f06d40b5860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f06d4073d80 tx=0x7f06cc01cd80 comp rx=0 tx=0).stop 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 -- 172.21.15.114:0/3609368918 shutdown_connections 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 --2- 172.21.15.114:0/3609368918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40b53f0 0x7f06d40b5860 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 --2- 172.21.15.114:0/3609368918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40d28c0 0x7f06d40cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 --2- 172.21.15.114:0/3609368918 >> v2:172.21.15.149:3300/0 conn(0x7f06d415be80 0x7f06d40ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 -- 172.21.15.114:0/3609368918 >> 172.21.15.114:0/3609368918 conn(0x7f06d40d1da0 msgr2=0x7f06d40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 -- 172.21.15.114:0/3609368918 shutdown_connections 2024-09-16T07:28:53.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.272+0000 7f06da600640 1 -- 172.21.15.114:0/3609368918 wait complete. 2024-09-16T07:28:53.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 Processor -- start 2024-09-16T07:28:53.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 -- start start 2024-09-16T07:28:53.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40b53f0 0x7f06d4152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40d28c0 0x7f06d406f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d415be80 0x7f06d415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40ccf50 con 0x7f06d40d28c0 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40ccdd0 con 0x7f06d415be80 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06d40cd0d0 con 0x7f06d40b53f0 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40d28c0 0x7f06d406f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40d28c0 0x7f06d406f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38398/0 (socket says 172.21.15.114:38398) 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 -- 172.21.15.114:0/4116492535 learned_addr learned my addr 172.21.15.114:0/4116492535 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d3e00640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d415be80 0x7f06d415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d3400640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40b53f0 0x7f06d4152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 -- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40b53f0 msgr2=0x7f06d4152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40b53f0 0x7f06d4152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 -- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d415be80 msgr2=0x7f06d415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d415be80 0x7f06d415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 -- 172.21.15.114:0/4116492535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d41f7740 con 0x7f06d40d28c0 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d3e00640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d415be80 0x7f06d415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d3400640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40b53f0 0x7f06d4152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06d2a00640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40d28c0 0x7f06d406f690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06c000d780 tx=0x7f06c000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06cb400640 1 -- 172.21.15.114:0/4116492535 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0017070 con 0x7f06d40d28c0 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06cb400640 1 -- 172.21.15.114:0/4116492535 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c000de90 con 0x7f06d40d28c0 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06cb400640 1 -- 172.21.15.114:0/4116492535 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0005020 con 0x7f06d40d28c0 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d41f7a20 con 0x7f06d40d28c0 2024-09-16T07:28:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.276+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d41f7fe0 con 0x7f06d40d28c0 2024-09-16T07:28:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.280+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d40b5860 con 0x7f06d40d28c0 2024-09-16T07:28:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.280+0000 7f06cb400640 1 -- 172.21.15.114:0/4116492535 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f06c00051c0 con 0x7f06d40d28c0 2024-09-16T07:28:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.280+0000 7f06cb400640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b4072ec0 0x7f06b4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.280+0000 7f06cb400640 1 -- 172.21.15.114:0/4116492535 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f06c0093f80 con 0x7f06d40d28c0 2024-09-16T07:28:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.280+0000 7f06d3400640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b4072ec0 0x7f06b4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.280+0000 7f06d3400640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b4072ec0 0x7f06b4075380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f06d40d2590 tx=0x7f06c400b5d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:53.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.284+0000 7f06cb400640 1 -- 172.21.15.114:0/4116492535 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f06c005f1c0 con 0x7f06d40d28c0 2024-09-16T07:28:53.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06d415e030 con 0x7f06d40d28c0 2024-09-16T07:28:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06cb400640 1 -- 172.21.15.114:0/4116492535 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f06c005eac0 con 0x7f06d40d28c0 2024-09-16T07:28:53.496 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:53.496 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:53.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b4072ec0 msgr2=0x7f06b4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b4072ec0 0x7f06b4075380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f06d40d2590 tx=0x7f06c400b5d0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40d28c0 msgr2=0x7f06d406f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40d28c0 0x7f06d406f690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06c000d780 tx=0x7f06c000dc40 comp rx=0 tx=0).stop 2024-09-16T07:28:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 shutdown_connections 2024-09-16T07:28:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b4072ec0 0x7f06b4075380 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d415be80 0x7f06d415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d40d28c0 0x7f06d406f690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 --2- 172.21.15.114:0/4116492535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40b53f0 0x7f06d4152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 >> 172.21.15.114:0/4116492535 conn(0x7f06d40d1da0 msgr2=0x7f06d4071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:53.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 shutdown_connections 2024-09-16T07:28:53.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.492+0000 7f06da600640 1 -- 172.21.15.114:0/4116492535 wait complete. 2024-09-16T07:28:53.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:53.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- 172.21.15.114:0/3780308547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c80b4a50 msgr2=0x7f13c80ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 --2- 172.21.15.114:0/3780308547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c80b4a50 0x7f13c80ce810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13c8069950 tx=0x7f13c001ccf0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- 172.21.15.114:0/3780308547 shutdown_connections 2024-09-16T07:28:53.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 --2- 172.21.15.114:0/3780308547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c80b4a50 0x7f13c80ce810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 --2- 172.21.15.114:0/3780308547 >> v2:172.21.15.149:3300/0 conn(0x7f13c815db50 0x7f13c80acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- 172.21.15.114:0/3780308547 >> 172.21.15.114:0/3780308547 conn(0x7f13c80b18f0 msgr2=0x7f13c80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:53.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- 172.21.15.114:0/3780308547 shutdown_connections 2024-09-16T07:28:53.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- 172.21.15.114:0/3780308547 wait complete. 2024-09-16T07:28:53.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 Processor -- start 2024-09-16T07:28:53.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- start start 2024-09-16T07:28:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c80b4a50 0x7f13c8164840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c80cd100 0x7f13c8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c815db50 0x7f13c80adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8167120 con 0x7f13c815db50 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13c80cf4b0 con 0x7f13c80cd100 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13ce400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f13c81672a0 con 0x7f13c80b4a50 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c815db50 0x7f13c80adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c815db50 0x7f13c80adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38412/0 (socket says 172.21.15.114:38412) 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 -- 172.21.15.114:0/376777837 learned_addr learned my addr 172.21.15.114:0/376777837 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c80b4a50 0x7f13c8164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 -- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c80b4a50 msgr2=0x7f13c8164840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c80b4a50 0x7f13c8164840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 -- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c80cd100 msgr2=0x7f13c8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c80cd100 0x7f13c8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.656+0000 7f13c7e00640 1 -- 172.21.15.114:0/376777837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c8144200 con 0x7f13c815db50 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13c7e00640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c815db50 0x7f13c80adec0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13c00987f0 tx=0x7f13c0005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13bfe00640 1 -- 172.21.15.114:0/376777837 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c00b2040 con 0x7f13c815db50 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13bfe00640 1 -- 172.21.15.114:0/376777837 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13c00bb070 con 0x7f13c815db50 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13bfe00640 1 -- 172.21.15.114:0/376777837 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0004370 con 0x7f13c815db50 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c81444e0 con 0x7f13c815db50 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c8144aa0 con 0x7f13c815db50 2024-09-16T07:28:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c8069410 con 0x7f13c815db50 2024-09-16T07:28:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13bfe00640 1 -- 172.21.15.114:0/376777837 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f13c0004510 con 0x7f13c815db50 2024-09-16T07:28:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13bfe00640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f13a4072ef0 0x7f13a40753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13bfe00640 1 -- 172.21.15.114:0/376777837 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f13c012e700 con 0x7f13c815db50 2024-09-16T07:28:53.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.660+0000 7f13c7400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f13a4072ef0 0x7f13a40753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:53.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.664+0000 7f13c7400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f13a4072ef0 0x7f13a40753b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005fd0 tx=0x7f13b8005f20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:53.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.664+0000 7f13bfe00640 1 -- 172.21.15.114:0/376777837 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f13c0016970 con 0x7f13c815db50 2024-09-16T07:28:53.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.832+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13c809e090 con 0x7f13c815db50 2024-09-16T07:28:53.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.832+0000 7f13bfe00640 1 -- 172.21.15.114:0/376777837 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16713 (secure 0 0 0) 0x7f13c00f99c0 con 0x7f13c815db50 2024-09-16T07:28:53.839 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:53.839 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:22.454295+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:53.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f13a4072ef0 msgr2=0x7f13a40753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f13a4072ef0 0x7f13a40753b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005fd0 tx=0x7f13b8005f20 comp rx=0 tx=0).stop 2024-09-16T07:28:53.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c815db50 msgr2=0x7f13c80adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:53.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c815db50 0x7f13c80adec0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f13c00987f0 tx=0x7f13c0005ae0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 shutdown_connections 2024-09-16T07:28:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f13a4072ef0 0x7f13a40753b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f13c815db50 0x7f13c80adec0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13c80cd100 0x7f13c8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 --2- 172.21.15.114:0/376777837 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f13c80b4a50 0x7f13c8164840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 >> 172.21.15.114:0/376777837 conn(0x7f13c80b18f0 msgr2=0x7f13c80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 shutdown_connections 2024-09-16T07:28:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.836+0000 7f13ce400640 1 -- 172.21.15.114:0/376777837 wait complete. 2024-09-16T07:28:53.860 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:28:53.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.996+0000 7fe08da00640 1 -- 172.21.15.114:0/1415552295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 msgr2=0x7fe0880b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.996+0000 7fe08da00640 1 --2- 172.21.15.114:0/1415552295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe0880b2bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe070009840 tx=0x7fe07001c820 comp rx=0 tx=0).stop 2024-09-16T07:28:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.996+0000 7fe08da00640 1 -- 172.21.15.114:0/1415552295 shutdown_connections 2024-09-16T07:28:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.996+0000 7fe08da00640 1 --2- 172.21.15.114:0/1415552295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe0880b2bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:53.996+0000 7fe08da00640 1 -- 172.21.15.114:0/1415552295 >> 172.21.15.114:0/1415552295 conn(0x7fe0880b18f0 msgr2=0x7fe0880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 -- 172.21.15.114:0/1415552295 shutdown_connections 2024-09-16T07:28:54.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 -- 172.21.15.114:0/1415552295 wait complete. 2024-09-16T07:28:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 Processor -- start 2024-09-16T07:28:54.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 -- start start 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0880b3130 0x7fe08806f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe08809c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08815b580 0x7fe08814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe088168f70 con 0x7fe0880b4bd0 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe088168df0 con 0x7fe0880b3130 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0881690f0 con 0x7fe08815b580 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe08809c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe08809c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38440/0 (socket says 172.21.15.114:38440) 2024-09-16T07:28:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 -- 172.21.15.114:0/2511196759 learned_addr learned my addr 172.21.15.114:0/2511196759 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe087400640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08815b580 0x7fe08814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe086a00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0880b3130 0x7fe08806f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 -- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08815b580 msgr2=0x7fe08814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08815b580 0x7fe08814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 -- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0880b3130 msgr2=0x7fe08806f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0880b3130 0x7fe08806f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 -- 172.21.15.114:0/2511196759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08814ed50 con 0x7fe0880b4bd0 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe086a00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0880b3130 0x7fe08806f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07e000640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe08809c870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe070009790 tx=0x7fe070004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07f400640 1 -- 172.21.15.114:0/2511196759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0700042f0 con 0x7fe0880b4bd0 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07f400640 1 -- 172.21.15.114:0/2511196759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe070005030 con 0x7fe0880b4bd0 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe07f400640 1 -- 172.21.15.114:0/2511196759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070005460 con 0x7fe0880b4bd0 2024-09-16T07:28:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.000+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0880aff80 con 0x7fe0880b4bd0 2024-09-16T07:28:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.004+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08809c070 con 0x7fe0880b4bd0 2024-09-16T07:28:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.004+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0880b2bf0 con 0x7fe0880b4bd0 2024-09-16T07:28:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.004+0000 7fe07f400640 1 -- 172.21.15.114:0/2511196759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fe0700c0020 con 0x7fe0880b4bd0 2024-09-16T07:28:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.004+0000 7fe07f400640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe064072ec0 0x7fe064075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.004+0000 7fe07f400640 1 -- 172.21.15.114:0/2511196759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe07012e6b0 con 0x7fe0880b4bd0 2024-09-16T07:28:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.004+0000 7fe086a00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe064072ec0 0x7fe064075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.008+0000 7fe086a00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe064072ec0 0x7fe064075380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0780016b0 tx=0x7fe078009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:54.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.008+0000 7fe07f400640 1 -- 172.21.15.114:0/2511196759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe0700c7020 con 0x7fe0880b4bd0 2024-09-16T07:28:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.212+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0880ce510 con 0x7fe0880b4bd0 2024-09-16T07:28:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.212+0000 7fe07f400640 1 -- 172.21.15.114:0/2511196759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fe070016410 con 0x7fe0880b4bd0 2024-09-16T07:28:54.217 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:54.217 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe064072ec0 msgr2=0x7fe064075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe064072ec0 0x7fe064075380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0780016b0 tx=0x7fe078009040 comp rx=0 tx=0).stop 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 msgr2=0x7fe08809c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe08809c870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe070009790 tx=0x7fe070004040 comp rx=0 tx=0).stop 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 shutdown_connections 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe064072ec0 0x7fe064075380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08815b580 0x7fe08814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0880b4bd0 0x7fe08809c870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 --2- 172.21.15.114:0/2511196759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0880b3130 0x7fe08806f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 >> 172.21.15.114:0/2511196759 conn(0x7fe0880b18f0 msgr2=0x7fe088151620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 shutdown_connections 2024-09-16T07:28:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.216+0000 7fe08da00640 1 -- 172.21.15.114:0/2511196759 wait complete. 2024-09-16T07:28:54.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:28:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 -- 172.21.15.114:0/1853304918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6300b49e0 msgr2=0x7fb63006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 --2- 172.21.15.114:0/1853304918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6300b49e0 0x7fb63006e7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb63006fcf0 tx=0x7fb62801dc70 comp rx=0 tx=0).stop 2024-09-16T07:28:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 -- 172.21.15.114:0/1853304918 shutdown_connections 2024-09-16T07:28:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 --2- 172.21.15.114:0/1853304918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6300b49e0 0x7fb63006e7a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 --2- 172.21.15.114:0/1853304918 >> v2:172.21.15.149:3300/0 conn(0x7fb630073d10 0x7fb6300cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 -- 172.21.15.114:0/1853304918 >> 172.21.15.114:0/1853304918 conn(0x7fb6300b18f0 msgr2=0x7fb6300b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:54.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 -- 172.21.15.114:0/1853304918 shutdown_connections 2024-09-16T07:28:54.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 -- 172.21.15.114:0/1853304918 wait complete. 2024-09-16T07:28:54.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 Processor -- start 2024-09-16T07:28:54.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.376+0000 7fb635000640 1 -- start start 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb630073d10 0x7fb6301f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6300b49e0 0x7fb63009ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63015a660 0x7fb63014f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb630167310 con 0x7fb63015a660 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb630167190 con 0x7fb630073d10 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb630167490 con 0x7fb6300b49e0 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb630073d10 0x7fb6301f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63015a660 0x7fb63014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb630073d10 0x7fb6301f9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:51396/0 (socket says 172.21.15.114:51396) 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62de00640 1 -- 172.21.15.114:0/289859642 learned_addr learned my addr 172.21.15.114:0/289859642 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb625400640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6300b49e0 0x7fb63009ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62e800640 1 -- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6300b49e0 msgr2=0x7fb63009ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62e800640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6300b49e0 0x7fb63009ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62e800640 1 -- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb630073d10 msgr2=0x7fb6301f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62e800640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb630073d10 0x7fb6301f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62e800640 1 -- 172.21.15.114:0/289859642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63009d200 con 0x7fb63015a660 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb62e800640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63015a660 0x7fb63014f060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb6280ad000 tx=0x7fb628004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb626a00640 1 -- 172.21.15.114:0/289859642 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280b3040 con 0x7fb63015a660 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb626a00640 1 -- 172.21.15.114:0/289859642 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb628004a50 con 0x7fb63015a660 2024-09-16T07:28:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63009d4e0 con 0x7fb63015a660 2024-09-16T07:28:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb626a00640 1 -- 172.21.15.114:0/289859642 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628004460 con 0x7fb63015a660 2024-09-16T07:28:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63009ab40 con 0x7fb63015a660 2024-09-16T07:28:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb630069410 con 0x7fb63015a660 2024-09-16T07:28:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.380+0000 7fb626a00640 1 -- 172.21.15.114:0/289859642 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fb628004600 con 0x7fb63015a660 2024-09-16T07:28:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.384+0000 7fb626a00640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb60c072ec0 0x7fb60c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.384+0000 7fb626a00640 1 -- 172.21.15.114:0/289859642 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb62812e620 con 0x7fb63015a660 2024-09-16T07:28:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.384+0000 7fb62de00640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb60c072ec0 0x7fb60c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.384+0000 7fb62de00640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb60c072ec0 0x7fb60c075380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb630164f90 tx=0x7fb620009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:54.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.388+0000 7fb626a00640 1 -- 172.21.15.114:0/289859642 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb6280c5020 con 0x7fb63015a660 2024-09-16T07:28:54.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.588+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6300cd100 con 0x7fb63015a660 2024-09-16T07:28:54.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.588+0000 7fb626a00640 1 -- 172.21.15.114:0/289859642 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fb628017860 con 0x7fb63015a660 2024-09-16T07:28:54.594 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:54.595 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":8,"btime":"2024-09-16T07:28:24:475089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1995691378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1995691378},{"type":"v1","addr":"172.21.15.149:6837","nonce":1995691378}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4347,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2445127315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2445127315},{"type":"v1","addr":"172.21.15.114:6833","nonce":2445127315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4350,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2857476678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2857476678},{"type":"v1","addr":"172.21.15.114:6835","nonce":2857476678}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:28:20.836441+0000","modified":"2024-09-16T07:28:23.861959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6836/3215689811","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3215689811},{"type":"v1","addr":"172.21.15.149:6836","nonce":3215689811}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-16T07:28:54.595 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 8 2024-09-16T07:28:54.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb60c072ec0 msgr2=0x7fb60c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb60c072ec0 0x7fb60c075380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb630164f90 tx=0x7fb620009040 comp rx=0 tx=0).stop 2024-09-16T07:28:54.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63015a660 msgr2=0x7fb63014f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63015a660 0x7fb63014f060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb6280ad000 tx=0x7fb628004270 comp rx=0 tx=0).stop 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 shutdown_connections 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb60c072ec0 0x7fb60c075380 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb63015a660 0x7fb63014f060 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6300b49e0 0x7fb63009ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 --2- 172.21.15.114:0/289859642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb630073d10 0x7fb6301f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 >> 172.21.15.114:0/289859642 conn(0x7fb6300b18f0 msgr2=0x7fb6300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 shutdown_connections 2024-09-16T07:28:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.592+0000 7fb635000640 1 -- 172.21.15.114:0/289859642 wait complete. 2024-09-16T07:28:54.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:28:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 -- 172.21.15.114:0/812776918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d0004d50 msgr2=0x7f05d00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 --2- 172.21.15.114:0/812776918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05d0004d50 0x7f05d00051d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009b60 tx=0x7f05e401d270 comp rx=0 tx=0).stop 2024-09-16T07:28:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05ebe00640 1 -- 172.21.15.114:0/812776918 reap_dead start 2024-09-16T07:28:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 -- 172.21.15.114:0/812776918 shutdown_connections 2024-09-16T07:28:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 -- 172.21.15.114:0/812776918 >> 172.21.15.114:0/812776918 conn(0x7f05ec0d4060 msgr2=0x7f05ec0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 -- 172.21.15.114:0/812776918 shutdown_connections 2024-09-16T07:28:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 -- 172.21.15.114:0/812776918 wait complete. 2024-09-16T07:28:54.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 Processor -- start 2024-09-16T07:28:54.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.756+0000 7f05f2000640 1 -- start start 2024-09-16T07:28:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05ec14fe30 0x7f05ec1f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05ec1f4da0 0x7f05ec0a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ec0a1290 0x7f05ec1f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec0b8020 con 0x7f05ec1f4da0 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec0b7ea0 con 0x7f05ec0a1290 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f05ec0b81a0 con 0x7f05ec14fe30 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05ec1f4da0 0x7f05ec0a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05ec1f4da0 0x7f05ec0a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43736/0 (socket says 172.21.15.114:43736) 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 -- 172.21.15.114:0/3096720566 learned_addr learned my addr 172.21.15.114:0/3096720566 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eb400640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05ec14fe30 0x7f05ec1f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05ebe00640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ec0a1290 0x7f05ec1f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 -- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05ec14fe30 msgr2=0x7f05ec1f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05ec14fe30 0x7f05ec1f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 -- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ec0a1290 msgr2=0x7f05ec1f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ec0a1290 0x7f05ec1f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 -- 172.21.15.114:0/3096720566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec1f52b0 con 0x7f05ec1f4da0 2024-09-16T07:28:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05eaa00640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05ec1f4da0 0x7f05ec0a0d50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05d800e680 tx=0x7f05d800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05e3400640 1 -- 172.21.15.114:0/3096720566 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8015070 con 0x7f05ec1f4da0 2024-09-16T07:28:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05e3400640 1 -- 172.21.15.114:0/3096720566 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05d800caf0 con 0x7f05ec1f4da0 2024-09-16T07:28:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec1f5590 con 0x7f05ec1f4da0 2024-09-16T07:28:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05e3400640 1 -- 172.21.15.114:0/3096720566 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8011460 con 0x7f05ec1f4da0 2024-09-16T07:28:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec150690 con 0x7f05ec1f4da0 2024-09-16T07:28:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec1f57d0 con 0x7f05ec1f4da0 2024-09-16T07:28:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.760+0000 7f05e3400640 1 -- 172.21.15.114:0/3096720566 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f05d8018070 con 0x7f05ec1f4da0 2024-09-16T07:28:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.764+0000 7f05e3400640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05cc072ec0 0x7f05cc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.764+0000 7f05e3400640 1 -- 172.21.15.114:0/3096720566 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f05d8094350 con 0x7f05ec1f4da0 2024-09-16T07:28:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.764+0000 7f05eb400640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05cc072ec0 0x7f05cc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.764+0000 7f05eb400640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05cc072ec0 0x7f05cc075380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05ec1f59d0 tx=0x7f05dc009500 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.768+0000 7f05e3400640 1 -- 172.21.15.114:0/3096720566 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f05ec1f57d0 con 0x7f05ec1f4da0 2024-09-16T07:28:54.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05ec0d0850 con 0x7f05ec1f4da0 2024-09-16T07:28:54.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05e3400640 1 -- 172.21.15.114:0/3096720566 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16713 (secure 0 0 0) 0x7f05d805f510 con 0x7f05ec1f4da0 2024-09-16T07:28:54.983 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:28:54.984 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:28:22.454295+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:28:18.623261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T07:28:19.803661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:28:54.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05cc072ec0 msgr2=0x7f05cc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05cc072ec0 0x7f05cc075380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f05ec1f59d0 tx=0x7f05dc009500 comp rx=0 tx=0).stop 2024-09-16T07:28:54.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05ec1f4da0 msgr2=0x7f05ec0a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:54.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05ec1f4da0 0x7f05ec0a0d50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05d800e680 tx=0x7f05d800eb40 comp rx=0 tx=0).stop 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 shutdown_connections 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05cc072ec0 0x7f05cc075380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05ec0a1290 0x7f05ec1f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05ec1f4da0 0x7f05ec0a0d50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 --2- 172.21.15.114:0/3096720566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05ec14fe30 0x7f05ec1f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 >> 172.21.15.114:0/3096720566 conn(0x7f05ec0d4060 msgr2=0x7f05ec0b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 shutdown_connections 2024-09-16T07:28:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:54.936+0000 7f05f2000640 1 -- 172.21.15.114:0/3096720566 wait complete. 2024-09-16T07:28:54.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:28:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 -- 172.21.15.114:0/2714215934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e940b2e80 msgr2=0x7f0e940b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/2714215934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e940b2e80 0x7f0e940b1a00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e940cfb60 tx=0x7f0e7c01c830 comp rx=0 tx=0).stop 2024-09-16T07:28:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 -- 172.21.15.114:0/2714215934 shutdown_connections 2024-09-16T07:28:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/2714215934 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e940b2e80 0x7f0e940b1a00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/2714215934 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e940b1f40 0x7f0e940cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/2714215934 >> v2:172.21.15.149:3300/0 conn(0x7f0e9415f490 0x7f0e940b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 -- 172.21.15.114:0/2714215934 >> 172.21.15.114:0/2714215934 conn(0x7f0e940d1e30 msgr2=0x7f0e940d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 -- 172.21.15.114:0/2714215934 shutdown_connections 2024-09-16T07:28:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 -- 172.21.15.114:0/2714215934 wait complete. 2024-09-16T07:28:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 Processor -- start 2024-09-16T07:28:55.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.124+0000 7f0e9ae00640 1 -- start start 2024-09-16T07:28:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e940b1f40 0x7f0e940b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e940b2e80 0x7f0e9414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e9415f490 0x7f0e94166230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940b0010 con 0x7f0e9415f490 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940afe90 con 0x7f0e940b2e80 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0e940b0190 con 0x7f0e940b1f40 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e9415f490 0x7f0e94166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e9415f490 0x7f0e94166230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43746/0 (socket says 172.21.15.114:43746) 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 -- 172.21.15.114:0/3733375700 learned_addr learned my addr 172.21.15.114:0/3733375700 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e93e00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e940b1f40 0x7f0e940b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e8b400640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e940b2e80 0x7f0e9414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 -- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e940b1f40 msgr2=0x7f0e940b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e940b1f40 0x7f0e940b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 -- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e940b2e80 msgr2=0x7f0e9414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e940b2e80 0x7f0e9414f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 -- 172.21.15.114:0/3733375700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940c96a0 con 0x7f0e9415f490 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e8b400640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e940b2e80 0x7f0e9414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e98e00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e9415f490 0x7f0e94166230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00e990 tx=0x7f0e8c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e90c00640 1 -- 172.21.15.114:0/3733375700 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c004d30 con 0x7f0e9415f490 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e90c00640 1 -- 172.21.15.114:0/3733375700 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e8c00cb00 con 0x7f0e9415f490 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e90c00640 1 -- 172.21.15.114:0/3733375700 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c005020 con 0x7f0e9415f490 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e940c9980 con 0x7f0e9415f490 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e940c9f40 con 0x7f0e9415f490 2024-09-16T07:28:55.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.128+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e940cfda0 con 0x7f0e9415f490 2024-09-16T07:28:55.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.132+0000 7f0e90c00640 1 -- 172.21.15.114:0/3733375700 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f0e8c0051c0 con 0x7f0e9415f490 2024-09-16T07:28:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.132+0000 7f0e90c00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0e70072ef0 0x7f0e700753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.132+0000 7f0e90c00640 1 -- 172.21.15.114:0/3733375700 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0e8c0946b0 con 0x7f0e9415f490 2024-09-16T07:28:55.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.132+0000 7f0e93e00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0e70072ef0 0x7f0e700753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:55.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.132+0000 7f0e93e00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0e70072ef0 0x7f0e700753b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e840058d0 tx=0x7f0e84005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:55.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.136+0000 7f0e90c00640 1 -- 172.21.15.114:0/3733375700 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0e8c016030 con 0x7f0e9415f490 2024-09-16T07:28:55.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.336+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0e940cf320 con 0x7f0e9415f490 2024-09-16T07:28:55.343 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:28:55.336+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:28:55.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.340+0000 7f0e90c00640 1 -- 172.21.15.114:0/3733375700 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f0e8c05f8f0 con 0x7f0e9415f490 2024-09-16T07:28:55.345 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:28:55.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0e70072ef0 msgr2=0x7f0e700753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0e70072ef0 0x7f0e700753b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e840058d0 tx=0x7f0e84005860 comp rx=0 tx=0).stop 2024-09-16T07:28:55.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e9415f490 msgr2=0x7f0e94166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e9415f490 0x7f0e94166230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00e990 tx=0x7f0e8c00ee50 comp rx=0 tx=0).stop 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 shutdown_connections 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0e70072ef0 0x7f0e700753b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e9415f490 0x7f0e94166230 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e940b2e80 0x7f0e9414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 --2- 172.21.15.114:0/3733375700 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0e940b1f40 0x7f0e940b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 >> 172.21.15.114:0/3733375700 conn(0x7f0e940d1e30 msgr2=0x7f0e9414fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 shutdown_connections 2024-09-16T07:28:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.344+0000 7f0e9ae00640 1 -- 172.21.15.114:0/3733375700 wait complete. 2024-09-16T07:28:55.362 INFO:tasks.ceph.mds.b.smithi149.stderr: -6974> 2024-09-16T07:28:26.282+0000 7fb9bc800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:28:55.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:28:55.413 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:28:55.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- 172.21.15.114:0/1940764002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbad0 msgr2=0x7f1ddc0afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 --2- 172.21.15.114:0/1940764002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbad0 0x7f1ddc0afb50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009840 tx=0x7f1dd001c790 comp rx=0 tx=0).stop 2024-09-16T07:28:55.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- 172.21.15.114:0/1940764002 shutdown_connections 2024-09-16T07:28:55.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 --2- 172.21.15.114:0/1940764002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbad0 0x7f1ddc0afb50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- 172.21.15.114:0/1940764002 >> 172.21.15.114:0/1940764002 conn(0x7f1ddc0d0da0 msgr2=0x7f1ddc0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- 172.21.15.114:0/1940764002 shutdown_connections 2024-09-16T07:28:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- 172.21.15.114:0/1940764002 wait complete. 2024-09-16T07:28:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 Processor -- start 2024-09-16T07:28:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- start start 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ddc06d330 0x7f1ddc1488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ddc0cbad0 0x7f1ddc06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbeb0 0x7f1ddc0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc16c850 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc16c6d0 con 0x7f1ddc06d330 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de4400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ddc16c9d0 con 0x7f1ddc0cbad0 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de2400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbeb0 0x7f1ddc0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de2400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbeb0 0x7f1ddc0b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43760/0 (socket says 172.21.15.114:43760) 2024-09-16T07:28:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.508+0000 7f1de2400640 1 -- 172.21.15.114:0/1651234856 learned_addr learned my addr 172.21.15.114:0/1651234856 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de1a00640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ddc06d330 0x7f1ddc1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de2400640 1 -- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ddc0cbad0 msgr2=0x7f1ddc06f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de2400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ddc0cbad0 0x7f1ddc06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de2400640 1 -- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ddc06d330 msgr2=0x7f1ddc1488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de2400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ddc06d330 0x7f1ddc1488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de2400640 1 -- 172.21.15.114:0/1651234856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc148e10 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de2400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbeb0 0x7f1ddc0b1860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c730 tx=0x7f1dd400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1dd9600640 1 -- 172.21.15.114:0/1651234856 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4003b80 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1dd9600640 1 -- 172.21.15.114:0/1651234856 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd4003d40 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1dd9600640 1 -- 172.21.15.114:0/1651234856 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40052d0 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc0af500 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc1523e0 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc0afb50 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1dd9600640 1 -- 172.21.15.114:0/1651234856 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1dd4005680 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.512+0000 7f1dd9600640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dbc072ec0 0x7f1dbc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:55.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.516+0000 7f1dd9600640 1 -- 172.21.15.114:0/1651234856 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f1dd4093eb0 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.516+0000 7f1de1a00640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dbc072ec0 0x7f1dbc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.516+0000 7f1de1a00640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dbc072ec0 0x7f1dbc075380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00ae000 tx=0x7f1dd001afd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:55.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.516+0000 7f1dd9600640 1 -- 172.21.15.114:0/1651234856 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1dd405f000 con 0x7f1ddc0cbeb0 2024-09-16T07:28:55.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:55.720+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1ddc0b6d20 con 0x7f1ddc0cbeb0 2024-09-16T07:28:56.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1dd9600640 1 -- 172.21.15.114:0/1651234856 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f1dd405e900 con 0x7f1ddc0cbeb0 2024-09-16T07:28:56.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dbc072ec0 msgr2=0x7f1dbc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:56.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dbc072ec0 0x7f1dbc075380 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00ae000 tx=0x7f1dd001afd0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbeb0 msgr2=0x7f1ddc0b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:56.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbeb0 0x7f1ddc0b1860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400c730 tx=0x7f1dd400cbf0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 shutdown_connections 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dbc072ec0 0x7f1dbc075380 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ddc0cbeb0 0x7f1ddc0b1860 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ddc0cbad0 0x7f1ddc06f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 --2- 172.21.15.114:0/1651234856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ddc06d330 0x7f1ddc1488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 >> 172.21.15.114:0/1651234856 conn(0x7f1ddc0d0da0 msgr2=0x7f1ddc15c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 shutdown_connections 2024-09-16T07:28:56.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.344+0000 7f1de4400640 1 -- 172.21.15.114:0/1651234856 wait complete. 2024-09-16T07:28:56.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:28:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- 172.21.15.114:0/1070971797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4978003fe0 msgr2=0x7f4978004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 --2- 172.21.15.114:0/1070971797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4978003fe0 0x7f4978004810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f497c00c310 tx=0x7f497c01f720 comp rx=0 tx=0).stop 2024-09-16T07:28:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4996600640 1 -- 172.21.15.114:0/1070971797 reap_dead start 2024-09-16T07:28:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- 172.21.15.114:0/1070971797 shutdown_connections 2024-09-16T07:28:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- 172.21.15.114:0/1070971797 >> 172.21.15.114:0/1070971797 conn(0x7f49900cfbc0 msgr2=0x7f49900cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- 172.21.15.114:0/1070971797 shutdown_connections 2024-09-16T07:28:56.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- 172.21.15.114:0/1070971797 wait complete. 2024-09-16T07:28:56.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 Processor -- start 2024-09-16T07:28:56.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- start start 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978003fe0 0x7f499006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49900b5180 0x7f49900b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49901f4950 0x7f49901f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f49900cde50 con 0x7f49900b5180 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f49900cdcd0 con 0x7f4978003fe0 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4998600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f49900cdfd0 con 0x7f49901f4950 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49900b5180 0x7f49900b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49900b5180 0x7f49900b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43768/0 (socket says 172.21.15.114:43768) 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 -- 172.21.15.114:0/2625874461 learned_addr learned my addr 172.21.15.114:0/2625874461 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995c00640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978003fe0 0x7f499006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4996600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49901f4950 0x7f49901f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 -- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49901f4950 msgr2=0x7f49901f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49901f4950 0x7f49901f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 -- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978003fe0 msgr2=0x7f499006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978003fe0 0x7f499006ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.512+0000 7f4995200640 1 -- 172.21.15.114:0/2625874461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49900cc300 con 0x7f49900b5180 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f4995200640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49900b5180 0x7f49900b55c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f497c01de20 tx=0x7f497c006c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f498d600640 1 -- 172.21.15.114:0/2625874461 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0b2070 con 0x7f49900b5180 2024-09-16T07:28:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f498d600640 1 -- 172.21.15.114:0/2625874461 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f497c006090 con 0x7f49900b5180 2024-09-16T07:28:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f498d600640 1 -- 172.21.15.114:0/2625874461 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c003860 con 0x7f49900b5180 2024-09-16T07:28:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49901e6b20 con 0x7f49900b5180 2024-09-16T07:28:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49901e70e0 con 0x7f49900b5180 2024-09-16T07:28:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4990069410 con 0x7f49900b5180 2024-09-16T07:28:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f498d600640 1 -- 172.21.15.114:0/2625874461 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f497c0c0060 con 0x7f49900b5180 2024-09-16T07:28:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f498d600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4970072ec0 0x7f4970075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f498d600640 1 -- 172.21.15.114:0/2625874461 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f497c130c90 con 0x7f49900b5180 2024-09-16T07:28:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.516+0000 7f4995c00640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4970072ec0 0x7f4970075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.520+0000 7f4995c00640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4970072ec0 0x7f4970075380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f498400ad50 tx=0x7f498400a2f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.520+0000 7f498d600640 1 -- 172.21.15.114:0/2625874461 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f497c0194d0 con 0x7f49900b5180 2024-09-16T07:28:56.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:56.692+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49900d0850 con 0x7f49900b5180 2024-09-16T07:28:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.616+0000 7f498d600640 1 -- 172.21.15.114:0/2625874461 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f497c0fbde0 con 0x7f49900b5180 2024-09-16T07:28:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:28:57.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4970072ec0 msgr2=0x7f4970075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:57.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4970072ec0 0x7f4970075380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f498400ad50 tx=0x7f498400a2f0 comp rx=0 tx=0).stop 2024-09-16T07:28:57.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49900b5180 msgr2=0x7f49900b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49900b5180 0x7f49900b55c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f497c01de20 tx=0x7f497c006c60 comp rx=0 tx=0).stop 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 shutdown_connections 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4970072ec0 0x7f4970075380 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f49901f4950 0x7f49901f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f49900b5180 0x7f49900b55c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 --2- 172.21.15.114:0/2625874461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4978003fe0 0x7f499006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 >> 172.21.15.114:0/2625874461 conn(0x7f49900cfbc0 msgr2=0x7f499015bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 shutdown_connections 2024-09-16T07:28:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.620+0000 7f4998600640 1 -- 172.21.15.114:0/2625874461 wait complete. 2024-09-16T07:28:57.648 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:28:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.792+0000 7f9f22800640 1 -- 172.21.15.114:0/2644990554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f00003c20 msgr2=0x7f9f00004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.792+0000 7f9f22800640 1 --2- 172.21.15.114:0/2644990554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f00003c20 0x7f9f00004020 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c640 tx=0x7f9f0c01d280 comp rx=0 tx=0).stop 2024-09-16T07:28:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.792+0000 7f9f1be00640 1 -- 172.21.15.114:0/2644990554 reap_dead start 2024-09-16T07:28:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- 172.21.15.114:0/2644990554 shutdown_connections 2024-09-16T07:28:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- 172.21.15.114:0/2644990554 >> 172.21.15.114:0/2644990554 conn(0x7f9f1c0d1da0 msgr2=0x7f9f1c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- 172.21.15.114:0/2644990554 shutdown_connections 2024-09-16T07:28:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- 172.21.15.114:0/2644990554 wait complete. 2024-09-16T07:28:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 Processor -- start 2024-09-16T07:28:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- start start 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f00003c20 0x7f9f1c14b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f1c1f6000 0x7f9f1c0c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f1c0c7d00 0x7f9f1c0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c167d20 con 0x7f9f1c1f6000 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1c167ba0 con 0x7f9f1c0c7d00 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1c167ea0 con 0x7f9f00003c20 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f1c1f6000 0x7f9f1c0c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f1c1f6000 0x7f9f1c0c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43774/0 (socket says 172.21.15.114:43774) 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 -- 172.21.15.114:0/385505371 learned_addr learned my addr 172.21.15.114:0/385505371 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:57.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f1be00640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f1c0c7d00 0x7f9f1c0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f1b400640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f00003c20 0x7f9f1c14b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 -- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f00003c20 msgr2=0x7f9f1c14b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f00003c20 0x7f9f1c14b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 -- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f1c0c7d00 msgr2=0x7f9f1c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f1c0c7d00 0x7f9f1c0b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 -- 172.21.15.114:0/385505371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1c14be30 con 0x7f9f1c1f6000 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f12a00640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f1c1f6000 0x7f9f1c0c77c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f04003e80 tx=0x7f9f04001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f13e00640 1 -- 172.21.15.114:0/385505371 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04016030 con 0x7f9f1c1f6000 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f13e00640 1 -- 172.21.15.114:0/385505371 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f040117c0 con 0x7f9f1c1f6000 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1c0c8260 con 0x7f9f1c1f6000 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.796+0000 7f9f13e00640 1 -- 172.21.15.114:0/385505371 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04011bb0 con 0x7f9f1c1f6000 2024-09-16T07:28:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.800+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1c1f5800 con 0x7f9f1c1f6000 2024-09-16T07:28:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.800+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1c0ce700 con 0x7f9f1c1f6000 2024-09-16T07:28:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.800+0000 7f9f13e00640 1 -- 172.21.15.114:0/385505371 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f9f04019070 con 0x7f9f1c1f6000 2024-09-16T07:28:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.800+0000 7f9f13e00640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9ef8072ef0 0x7f9ef80753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.800+0000 7f9f13e00640 1 -- 172.21.15.114:0/385505371 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5357+0+0 (secure 0 0 0) 0x7f9f040943d0 con 0x7f9f1c1f6000 2024-09-16T07:28:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.800+0000 7f9f1b400640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9ef8072ef0 0x7f9ef80753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.800+0000 7f9f1b400640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9ef8072ef0 0x7f9ef80753b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c640 tx=0x7f9f0c01a0c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.804+0000 7f9f13e00640 1 -- 172.21.15.114:0/385505371 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9f0405f090 con 0x7f9f1c1f6000 2024-09-16T07:28:57.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:57.972+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f1c070350 con 0x7f9f1c1f6000 2024-09-16T07:28:58.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f13e00640 1 -- 172.21.15.114:0/385505371 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f9f04063ac0 con 0x7f9f1c1f6000 2024-09-16T07:28:58.628 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9ef8072ef0 msgr2=0x7f9ef80753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9ef8072ef0 0x7f9ef80753b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c640 tx=0x7f9f0c01a0c0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f1c1f6000 msgr2=0x7f9f1c0c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f1c1f6000 0x7f9f1c0c77c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f04003e80 tx=0x7f9f04001810 comp rx=0 tx=0).stop 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 shutdown_connections 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9ef8072ef0 0x7f9ef80753b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f1c0c7d00 0x7f9f1c0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f1c1f6000 0x7f9f1c0c77c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 --2- 172.21.15.114:0/385505371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f00003c20 0x7f9f1c14b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.624+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 >> 172.21.15.114:0/385505371 conn(0x7f9f1c0d1da0 msgr2=0x7f9f1c152480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:58.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.628+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 shutdown_connections 2024-09-16T07:28:58.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.628+0000 7f9f22800640 1 -- 172.21.15.114:0/385505371 wait complete. 2024-09-16T07:28:58.654 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:28:58.654 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:28:58.655 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:28:58.655 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:28:58.655 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:28:58.655 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:28:58.655 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:28:58.655 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:28:58.655 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:28:58.656 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:28:58.656 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:28:58.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:28:58.656 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:28:58.656 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:28:58.656 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:28:58.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:28:58.669 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:28:58.669 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:28:58.670 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:28:58.670 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:28:58.671 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:28:58.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:28:58.672 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:28:58.672 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:28:58.712 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:28:58.713 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:58.715 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:28:58.715 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:58.721 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:28:58.721 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:58.723 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:28:58.723 DEBUG:teuthology.parallel:result is None 2024-09-16T07:28:58.723 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:28:58.800 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:28:58.800 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:28:58.812 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:28:58.812 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:28:58.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- 172.21.15.114:0/1508091503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c15dae0 msgr2=0x7faf0c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:58.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 --2- 172.21.15.114:0/1508091503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c15dae0 0x7faf0c0acd40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faefc00a950 tx=0x7faefc01da50 comp rx=0 tx=0).stop 2024-09-16T07:28:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- 172.21.15.114:0/1508091503 shutdown_connections 2024-09-16T07:28:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 --2- 172.21.15.114:0/1508091503 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c15dae0 0x7faf0c0acd40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- 172.21.15.114:0/1508091503 >> 172.21.15.114:0/1508091503 conn(0x7faf0c0b18f0 msgr2=0x7faf0c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- 172.21.15.114:0/1508091503 shutdown_connections 2024-09-16T07:28:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- 172.21.15.114:0/1508091503 wait complete. 2024-09-16T07:28:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 Processor -- start 2024-09-16T07:28:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- start start 2024-09-16T07:28:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c0b49e0 0x7faf0c15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c0cd100 0x7faf0c14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c15dae0 0x7faf0c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c1685d0 con 0x7faf0c15dae0 2024-09-16T07:28:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c168450 con 0x7faf0c0cd100 2024-09-16T07:28:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf12c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c168750 con 0x7faf0c0b49e0 2024-09-16T07:28:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c15dae0 0x7faf0c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c15dae0 0x7faf0c0b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43820/0 (socket says 172.21.15.114:43820) 2024-09-16T07:28:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 -- 172.21.15.114:0/1004708169 learned_addr learned my addr 172.21.15.114:0/1004708169 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf03400640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c0cd100 0x7faf0c14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf0be00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c0b49e0 0x7faf0c15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 -- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c0b49e0 msgr2=0x7faf0c15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c0b49e0 0x7faf0c15bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 -- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c0cd100 msgr2=0x7faf0c14f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c0cd100 0x7faf0c14f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf10c00640 1 -- 172.21.15.114:0/1004708169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c0b0b10 con 0x7faf0c15dae0 2024-09-16T07:28:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.872+0000 7faf0be00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c0b49e0 0x7faf0c15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:28:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf10c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c15dae0 0x7faf0c0b12d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c7c0 tx=0x7faf0400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf08c00640 1 -- 172.21.15.114:0/1004708169 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04003b80 con 0x7faf0c15dae0 2024-09-16T07:28:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf08c00640 1 -- 172.21.15.114:0/1004708169 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf04003d20 con 0x7faf0c15dae0 2024-09-16T07:28:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c15c290 con 0x7faf0c15dae0 2024-09-16T07:28:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf08c00640 1 -- 172.21.15.114:0/1004708169 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0400aab0 con 0x7faf0c15dae0 2024-09-16T07:28:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c14fc80 con 0x7faf0c15dae0 2024-09-16T07:28:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c0acd40 con 0x7faf0c15dae0 2024-09-16T07:28:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.876+0000 7faf08c00640 1 -- 172.21.15.114:0/1004708169 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7faf0400ac50 con 0x7faf0c15dae0 2024-09-16T07:28:58.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.880+0000 7faf08c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faee8072ec0 0x7faee8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.880+0000 7faf08c00640 1 -- 172.21.15.114:0/1004708169 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7faf04093800 con 0x7faf0c15dae0 2024-09-16T07:28:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.880+0000 7faf0be00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faee8072ec0 0x7faee8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:58.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.880+0000 7faf0be00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faee8072ec0 0x7faee8075380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faefc0b0000 tx=0x7faefc01c290 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:58.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:58.884+0000 7faf08c00640 1 -- 172.21.15.114:0/1004708169 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7faf0405e6f0 con 0x7faf0c15dae0 2024-09-16T07:28:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.060+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7faf0c0af140 con 0x7faf0c15dae0 2024-09-16T07:28:59.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf08c00640 1 -- 172.21.15.114:0/1004708169 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7faf04063120 con 0x7faf0c15dae0 2024-09-16T07:28:59.643 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:28:59.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faee8072ec0 msgr2=0x7faee8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:59.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faee8072ec0 0x7faee8075380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faefc0b0000 tx=0x7faefc01c290 comp rx=0 tx=0).stop 2024-09-16T07:28:59.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c15dae0 msgr2=0x7faf0c0b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:59.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c15dae0 0x7faf0c0b12d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf0400c7c0 tx=0x7faf0400cc80 comp rx=0 tx=0).stop 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 shutdown_connections 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faee8072ec0 0x7faee8075380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf0c15dae0 0x7faf0c0b12d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf0c0cd100 0x7faf0c14f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 --2- 172.21.15.114:0/1004708169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faf0c0b49e0 0x7faf0c15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 >> 172.21.15.114:0/1004708169 conn(0x7faf0c0b18f0 msgr2=0x7faf0c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 shutdown_connections 2024-09-16T07:28:59.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.640+0000 7faf12c00640 1 -- 172.21.15.114:0/1004708169 wait complete. 2024-09-16T07:28:59.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:28:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 -- 172.21.15.114:0/3967332599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf80cdb30 msgr2=0x7f5cf80cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 --2- 172.21.15.114:0/3967332599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf80cdb30 0x7f5cf80cebb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009840 tx=0x7f5ce401c820 comp rx=0 tx=0).stop 2024-09-16T07:28:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 -- 172.21.15.114:0/3967332599 shutdown_connections 2024-09-16T07:28:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 --2- 172.21.15.114:0/3967332599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf80cdb30 0x7f5cf80cebb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 --2- 172.21.15.114:0/3967332599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf815bea0 0x7f5cf80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 -- 172.21.15.114:0/3967332599 >> 172.21.15.114:0/3967332599 conn(0x7f5cf80d1dc0 msgr2=0x7f5cf80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:28:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 -- 172.21.15.114:0/3967332599 shutdown_connections 2024-09-16T07:28:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.812+0000 7f5cfec00640 1 -- 172.21.15.114:0/3967332599 wait complete. 2024-09-16T07:28:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 Processor -- start 2024-09-16T07:28:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 -- start start 2024-09-16T07:28:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf80cdb30 0x7f5cf80b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf80d28e0 0x7f5cf8157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf815bea0 0x7f5cf80ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf8168fc0 con 0x7f5cf815bea0 2024-09-16T07:28:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf8168e40 con 0x7f5cf80d28e0 2024-09-16T07:28:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf8169140 con 0x7f5cf80cdb30 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf815bea0 0x7f5cf80ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf815bea0 0x7f5cf80ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43846/0 (socket says 172.21.15.114:43846) 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 -- 172.21.15.114:0/929895431 learned_addr learned my addr 172.21.15.114:0/929895431 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cf7400640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf80d28e0 0x7f5cf8157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cf7e00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf80cdb30 0x7f5cf80b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 -- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf80cdb30 msgr2=0x7f5cf80b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf80cdb30 0x7f5cf80b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 -- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf80d28e0 msgr2=0x7f5cf8157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf80d28e0 0x7f5cf8157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:28:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 -- 172.21.15.114:0/929895431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf80b3200 con 0x7f5cf815bea0 2024-09-16T07:28:59.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfcc00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf815bea0 0x7f5cf80ca880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c440 tx=0x7f5cf000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:59.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cefe00640 1 -- 172.21.15.114:0/929895431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0016020 con 0x7f5cf815bea0 2024-09-16T07:28:59.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cefe00640 1 -- 172.21.15.114:0/929895431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cf0012920 con 0x7f5cf815bea0 2024-09-16T07:28:59.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf80b34e0 con 0x7f5cf815bea0 2024-09-16T07:28:59.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cefe00640 1 -- 172.21.15.114:0/929895431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0012d90 con 0x7f5cf815bea0 2024-09-16T07:28:59.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.816+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf80ca360 con 0x7f5cf815bea0 2024-09-16T07:28:59.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.820+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf80cc9d0 con 0x7f5cf815bea0 2024-09-16T07:28:59.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.820+0000 7f5cefe00640 1 -- 172.21.15.114:0/929895431 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5cf0019020 con 0x7f5cf815bea0 2024-09-16T07:28:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.820+0000 7f5cefe00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5cd8072ec0 0x7f5cd8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:28:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.820+0000 7f5cefe00640 1 -- 172.21.15.114:0/929895431 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f5cf0093680 con 0x7f5cf815bea0 2024-09-16T07:28:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.820+0000 7f5cf7e00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5cd8072ec0 0x7f5cd8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:28:59.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.820+0000 7f5cf7e00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5cd8072ec0 0x7f5cd8075380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009e50 tx=0x7f5ce80095e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:28:59.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:28:59.824+0000 7f5cefe00640 1 -- 172.21.15.114:0/929895431 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5cf0020030 con 0x7f5cf815bea0 2024-09-16T07:29:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.052+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5cf815b7b0 con 0x7f5cf815bea0 2024-09-16T07:29:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.052+0000 7f5cefe00640 1 -- 172.21.15.114:0/929895431 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f5cf005e540 con 0x7f5cf815bea0 2024-09-16T07:29:00.057 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:29:00.059 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:00.060 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.061 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.062 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.063 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.064 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:29:00.065 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:29:00.066 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:29:00.067 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:29:00.068 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:29:00.069 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mds", 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD73edmjQ++KhAAAORrybREOrb0MxDMfLh1nA==", 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mds" 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mgr", 2024-09-16T07:29:00.070 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD73edmoBq+KhAAPB88R4M0+C9o2FYrxHvJqA==", 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-osd", 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD73edmECO+KhAApsmpuvsMsnFDUTd2uicjCg==", 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-osd" 2024-09-16T07:29:00.071 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd", 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD73edmQCu+KhAA0s9GC0uOrWLD7dyymR2Gyg==", 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.072 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD73edmtDO+KhAAn92PdN3t6BTfSsLEU1iCFA==", 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rgw", 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD73edmcDy+KhAAI7VVtd53j1cU+wjjvBWEcA==", 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.073 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:29:00.074 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:29:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:00.075 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:29:00.075 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:29:00.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5cd8072ec0 msgr2=0x7f5cd8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5cd8072ec0 0x7f5cd8075380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009e50 tx=0x7f5ce80095e0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf815bea0 msgr2=0x7f5cf80ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf815bea0 0x7f5cf80ca880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c440 tx=0x7f5cf000c900 comp rx=0 tx=0).stop 2024-09-16T07:29:00.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 shutdown_connections 2024-09-16T07:29:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5cd8072ec0 0x7f5cd8075380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5cf815bea0 0x7f5cf80ca880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf80d28e0 0x7f5cf8157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 --2- 172.21.15.114:0/929895431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5cf80cdb30 0x7f5cf80b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 >> 172.21.15.114:0/929895431 conn(0x7f5cf80d1dc0 msgr2=0x7f5cf806f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 shutdown_connections 2024-09-16T07:29:00.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.056+0000 7f5cfec00640 1 -- 172.21.15.114:0/929895431 wait complete. 2024-09-16T07:29:00.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 -- 172.21.15.114:0/2226827280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb815bea0 msgr2=0x7feeb80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 --2- 172.21.15.114:0/2226827280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb815bea0 0x7feeb80ce670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feeb8073d10 tx=0x7feeac01c770 comp rx=0 tx=0).stop 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 -- 172.21.15.114:0/2226827280 shutdown_connections 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 --2- 172.21.15.114:0/2226827280 >> v2:172.21.15.149:3300/0 conn(0x7feeb80cdb30 0x7feeb80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 --2- 172.21.15.114:0/2226827280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb815bea0 0x7feeb80ce670 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 -- 172.21.15.114:0/2226827280 >> 172.21.15.114:0/2226827280 conn(0x7feeb80d1dc0 msgr2=0x7feeb80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 -- 172.21.15.114:0/2226827280 shutdown_connections 2024-09-16T07:29:00.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 -- 172.21.15.114:0/2226827280 wait complete. 2024-09-16T07:29:00.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 Processor -- start 2024-09-16T07:29:00.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.228+0000 7feec0600640 1 -- start start 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb80cdb30 0x7feeb8157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb80d28e0 0x7feeb80c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb815bea0 0x7feeb806e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8168fc0 con 0x7feeb80cdb30 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8168e40 con 0x7feeb80d28e0 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feeb8169140 con 0x7feeb815bea0 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb80cdb30 0x7feeb8157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb80cdb30 0x7feeb8157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43864/0 (socket says 172.21.15.114:43864) 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 -- 172.21.15.114:0/4167378288 learned_addr learned my addr 172.21.15.114:0/4167378288 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 -- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb815bea0 msgr2=0x7feeb806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb815bea0 0x7feeb806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 -- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb80d28e0 msgr2=0x7feeb80c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb80d28e0 0x7feeb80c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 -- 172.21.15.114:0/4167378288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb80b3640 con 0x7feeb80cdb30 2024-09-16T07:29:00.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feebdc00640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb80cdb30 0x7feeb8157780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feeac000c10 tx=0x7feeac0a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:00.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feeb5600640 1 -- 172.21.15.114:0/4167378288 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac0bb070 con 0x7feeb80cdb30 2024-09-16T07:29:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feeb5600640 1 -- 172.21.15.114:0/4167378288 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeac004470 con 0x7feeb80cdb30 2024-09-16T07:29:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feeb5600640 1 -- 172.21.15.114:0/4167378288 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac0b2040 con 0x7feeb80cdb30 2024-09-16T07:29:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb80b3920 con 0x7feeb80cdb30 2024-09-16T07:29:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb80c9210 con 0x7feeb80cdb30 2024-09-16T07:29:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb80cc9d0 con 0x7feeb80cdb30 2024-09-16T07:29:00.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.232+0000 7feeb5600640 1 -- 172.21.15.114:0/4167378288 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7feeac005230 con 0x7feeb80cdb30 2024-09-16T07:29:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.236+0000 7feeb5600640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fee9c072ec0 0x7fee9c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.236+0000 7feeb5600640 1 -- 172.21.15.114:0/4167378288 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7feeac12d420 con 0x7feeb80cdb30 2024-09-16T07:29:00.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.236+0000 7feebd200640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fee9c072ec0 0x7fee9c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:00.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.236+0000 7feebd200640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fee9c072ec0 0x7fee9c075380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feea80058d0 tx=0x7feea8005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:00.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.244+0000 7feeb5600640 1 -- 172.21.15.114:0/4167378288 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7feeac0163f0 con 0x7feeb80cdb30 2024-09-16T07:29:00.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.472+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7feeb80762f0 con 0x7feeb80cdb30 2024-09-16T07:29:00.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feeb5600640 1 -- 172.21.15.114:0/4167378288 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7feeac0f8930 con 0x7feeb80cdb30 2024-09-16T07:29:00.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fee9c072ec0 msgr2=0x7fee9c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fee9c072ec0 0x7fee9c075380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feea80058d0 tx=0x7feea8005860 comp rx=0 tx=0).stop 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb80cdb30 msgr2=0x7feeb8157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb80cdb30 0x7feeb8157780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feeac000c10 tx=0x7feeac0a55c0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 shutdown_connections 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fee9c072ec0 0x7fee9c075380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feeb815bea0 0x7feeb806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feeb80d28e0 0x7feeb80c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 --2- 172.21.15.114:0/4167378288 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeb80cdb30 0x7feeb8157780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 >> 172.21.15.114:0/4167378288 conn(0x7feeb80d1dc0 msgr2=0x7feeb8071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 shutdown_connections 2024-09-16T07:29:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.476+0000 7feec0600640 1 -- 172.21.15.114:0/4167378288 wait complete. 2024-09-16T07:29:00.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-16T07:29:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.640+0000 7ff630600640 1 -- 172.21.15.114:0/588927584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2060 msgr2=0x7ff6280cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.640+0000 7ff630600640 1 --2- 172.21.15.114:0/588927584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2060 0x7ff6280cf660 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff628074e80 tx=0x7ff61c01c8c0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- 172.21.15.114:0/588927584 shutdown_connections 2024-09-16T07:29:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 --2- 172.21.15.114:0/588927584 >> v2:172.21.15.149:3300/0 conn(0x7ff6280b7ab0 0x7ff6280b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 --2- 172.21.15.114:0/588927584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2060 0x7ff6280cf660 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- 172.21.15.114:0/588927584 >> 172.21.15.114:0/588927584 conn(0x7ff6280d3fe0 msgr2=0x7ff6280d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:00.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- 172.21.15.114:0/588927584 shutdown_connections 2024-09-16T07:29:00.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- 172.21.15.114:0/588927584 wait complete. 2024-09-16T07:29:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 Processor -- start 2024-09-16T07:29:00.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- start start 2024-09-16T07:29:00.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6280b7ab0 0x7ff6280cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6280d2060 0x7ff628154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2440 0x7ff6281fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff62816b5c0 con 0x7ff6280d2440 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff62816b440 con 0x7ff6280d2060 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff630600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff62816b740 con 0x7ff6280b7ab0 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff62e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2440 0x7ff6281fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff62dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6280b7ab0 0x7ff6280cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff62e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2440 0x7ff6281fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43880/0 (socket says 172.21.15.114:43880) 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff62e600640 1 -- 172.21.15.114:0/2222631215 learned_addr learned my addr 172.21.15.114:0/2222631215 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:00.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.644+0000 7ff62d200640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6280d2060 0x7ff628154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff62e600640 1 -- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6280b7ab0 msgr2=0x7ff6280cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff62e600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6280b7ab0 0x7ff6280cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff62e600640 1 -- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6280d2060 msgr2=0x7ff628154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff62e600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6280d2060 0x7ff628154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff62e600640 1 -- 172.21.15.114:0/2222631215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6281fbe10 con 0x7ff6280d2440 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff62e600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2440 0x7ff6281fb6a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff62000ea20 tx=0x7ff62000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff625600640 1 -- 172.21.15.114:0/2222631215 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62000cde0 con 0x7ff6280d2440 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff625600640 1 -- 172.21.15.114:0/2222631215 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff620004c40 con 0x7ff6280d2440 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6281fc0f0 con 0x7ff6280d2440 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff625600640 1 -- 172.21.15.114:0/2222631215 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620005280 con 0x7ff6280d2440 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62815d3c0 con 0x7ff6280d2440 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6280b7ec0 con 0x7ff6280d2440 2024-09-16T07:29:00.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff625600640 1 -- 172.21.15.114:0/2222631215 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff620005420 con 0x7ff6280d2440 2024-09-16T07:29:00.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.648+0000 7ff625600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff608072ec0 0x7ff608075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:00.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.652+0000 7ff625600640 1 -- 172.21.15.114:0/2222631215 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff620094420 con 0x7ff6280d2440 2024-09-16T07:29:00.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.652+0000 7ff62dc00640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff608072ec0 0x7ff608075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:00.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.652+0000 7ff62dc00640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff608072ec0 0x7ff608075380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0af000 tx=0x7ff61c01b100 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:00.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.652+0000 7ff625600640 1 -- 172.21.15.114:0/2222631215 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff620016030 con 0x7ff6280d2440 2024-09-16T07:29:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.880+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7ff6280d07d0 con 0x7ff6280d2440 2024-09-16T07:29:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.884+0000 7ff625600640 1 -- 172.21.15.114:0/2222631215 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7ff62005f360 con 0x7ff6280d2440 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff608072ec0 msgr2=0x7ff608075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff608072ec0 0x7ff608075380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0af000 tx=0x7ff61c01b100 comp rx=0 tx=0).stop 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2440 msgr2=0x7ff6281fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2440 0x7ff6281fb6a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff62000ea20 tx=0x7ff62000eee0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 shutdown_connections 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff608072ec0 0x7ff608075380 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6280d2440 0x7ff6281fb6a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6280d2060 0x7ff628154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 --2- 172.21.15.114:0/2222631215 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6280b7ab0 0x7ff6280cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 >> 172.21.15.114:0/2222631215 conn(0x7ff6280d3fe0 msgr2=0x7ff6280cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 shutdown_connections 2024-09-16T07:29:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:00.888+0000 7ff630600640 1 -- 172.21.15.114:0/2222631215 wait complete. 2024-09-16T07:29:00.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-16T07:29:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 -- 172.21.15.114:0/548373490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c0cf4e0 msgr2=0x7f6b4c0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 --2- 172.21.15.114:0/548373490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c0cf4e0 0x7f6b4c0cd950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009bc0 tx=0x7f6b4401ca80 comp rx=0 tx=0).stop 2024-09-16T07:29:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 -- 172.21.15.114:0/548373490 shutdown_connections 2024-09-16T07:29:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 --2- 172.21.15.114:0/548373490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c0cf4e0 0x7f6b4c0cd950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 --2- 172.21.15.114:0/548373490 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b4c15bd50 0x7f6b4c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 -- 172.21.15.114:0/548373490 >> 172.21.15.114:0/548373490 conn(0x7f6b4c0d1ea0 msgr2=0x7f6b4c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 -- 172.21.15.114:0/548373490 shutdown_connections 2024-09-16T07:29:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.048+0000 7f6b53000640 1 -- 172.21.15.114:0/548373490 wait complete. 2024-09-16T07:29:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 Processor -- start 2024-09-16T07:29:01.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 -- start start 2024-09-16T07:29:01.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b4c0cf4e0 0x7f6b4c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b4c15bd50 0x7f6b4c1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c15c130 0x7f6b4c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c168f00 con 0x7f6b4c15bd50 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c168d80 con 0x7f6b4c15c130 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c169080 con 0x7f6b4c0cf4e0 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b4c15bd50 0x7f6b4c1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b4c15bd50 0x7f6b4c1502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43894/0 (socket says 172.21.15.114:43894) 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 -- 172.21.15.114:0/2449777152 learned_addr learned my addr 172.21.15.114:0/2449777152 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b4be00640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b4c0cf4e0 0x7f6b4c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b51000640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c15c130 0x7f6b4c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 -- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b4c0cf4e0 msgr2=0x7f6b4c153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b4c0cf4e0 0x7f6b4c153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 -- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c15c130 msgr2=0x7f6b4c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c15c130 0x7f6b4c0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 -- 172.21.15.114:0/2449777152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c151390 con 0x7f6b4c15bd50 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b43400640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b4c15bd50 0x7f6b4c1502f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400c430 tx=0x7f6b3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b48c00640 1 -- 172.21.15.114:0/2449777152 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34011790 con 0x7f6b4c15bd50 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b48c00640 1 -- 172.21.15.114:0/2449777152 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b34017070 con 0x7f6b4c15bd50 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b48c00640 1 -- 172.21.15.114:0/2449777152 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34011ce0 con 0x7f6b4c15bd50 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c152700 con 0x7f6b4c15bd50 2024-09-16T07:29:01.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c152cc0 con 0x7f6b4c15bd50 2024-09-16T07:29:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.052+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c0ce5e0 con 0x7f6b4c15bd50 2024-09-16T07:29:01.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.056+0000 7f6b48c00640 1 -- 172.21.15.114:0/2449777152 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6b3401c460 con 0x7f6b4c15bd50 2024-09-16T07:29:01.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.056+0000 7f6b48c00640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6b28072ec0 0x7f6b28075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.056+0000 7f6b48c00640 1 -- 172.21.15.114:0/2449777152 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6b34093760 con 0x7f6b4c15bd50 2024-09-16T07:29:01.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.056+0000 7f6b4be00640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6b28072ec0 0x7f6b28075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.056+0000 7f6b4be00640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6b28072ec0 0x7f6b28075380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009600 tx=0x7f6b3c0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:01.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.060+0000 7f6b48c00640 1 -- 172.21.15.114:0/2449777152 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6b3405e760 con 0x7f6b4c15bd50 2024-09-16T07:29:01.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.284+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f6b4c076360 con 0x7f6b4c15bd50 2024-09-16T07:29:01.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b48c00640 1 -- 172.21.15.114:0/2449777152 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f6b34063190 con 0x7f6b4c15bd50 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6b28072ec0 msgr2=0x7f6b28075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6b28072ec0 0x7f6b28075380 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009600 tx=0x7f6b3c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b4c15bd50 msgr2=0x7f6b4c1502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b4c15bd50 0x7f6b4c1502f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400c430 tx=0x7f6b3400c8f0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 shutdown_connections 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6b28072ec0 0x7f6b28075380 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b4c15c130 0x7f6b4c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b4c15bd50 0x7f6b4c1502f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 --2- 172.21.15.114:0/2449777152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b4c0cf4e0 0x7f6b4c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 >> 172.21.15.114:0/2449777152 conn(0x7f6b4c0d1ea0 msgr2=0x7f6b4c070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 shutdown_connections 2024-09-16T07:29:01.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.288+0000 7f6b53000640 1 -- 172.21.15.114:0/2449777152 wait complete. 2024-09-16T07:29:01.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-16T07:29:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 -- 172.21.15.114:0/4293606660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 msgr2=0x7fb3f0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 --2- 172.21.15.114:0/4293606660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 0x7fb3f0005220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb404009ee0 tx=0x7fb40401d5f0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb40a800640 1 -- 172.21.15.114:0/4293606660 reap_dead start 2024-09-16T07:29:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 -- 172.21.15.114:0/4293606660 shutdown_connections 2024-09-16T07:29:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 -- 172.21.15.114:0/4293606660 >> 172.21.15.114:0/4293606660 conn(0x7fb40c0b18f0 msgr2=0x7fb40c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 -- 172.21.15.114:0/4293606660 shutdown_connections 2024-09-16T07:29:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 -- 172.21.15.114:0/4293606660 wait complete. 2024-09-16T07:29:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 Processor -- start 2024-09-16T07:29:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.452+0000 7fb411000640 1 -- start start 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 0x7fb40c1f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb40c1536d0 0x7fb40c157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40c09c970 0x7fb40c09cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c0ce290 con 0x7fb3f0004da0 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c0ce110 con 0x7fb40c09c970 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb40c06f560 con 0x7fb40c1536d0 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 0x7fb40c1f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 0x7fb40c1f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43912/0 (socket says 172.21.15.114:43912) 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 -- 172.21.15.114:0/4128003284 learned_addr learned my addr 172.21.15.114:0/4128003284 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb401400640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb40c1536d0 0x7fb40c157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb40a800640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40c09c970 0x7fb40c09cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 -- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb40c1536d0 msgr2=0x7fb40c157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb40c1536d0 0x7fb40c157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 -- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40c09c970 msgr2=0x7fb40c09cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40c09c970 0x7fb40c09cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 -- 172.21.15.114:0/4128003284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40c1f5dd0 con 0x7fb3f0004da0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb40a800640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40c09c970 0x7fb40c09cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb409e00640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 0x7fb40c1f5890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001490 tx=0x7fb3fc00e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb402a00640 1 -- 172.21.15.114:0/4128003284 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc015020 con 0x7fb3f0004da0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb402a00640 1 -- 172.21.15.114:0/4128003284 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3fc0109a0 con 0x7fb3f0004da0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb402a00640 1 -- 172.21.15.114:0/4128003284 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc010df0 con 0x7fb3f0004da0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40c159610 con 0x7fb3f0004da0 2024-09-16T07:29:01.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40c159b90 con 0x7fb3f0004da0 2024-09-16T07:29:01.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.456+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb40c069410 con 0x7fb3f0004da0 2024-09-16T07:29:01.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.460+0000 7fb402a00640 1 -- 172.21.15.114:0/4128003284 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fb3fc018020 con 0x7fb3f0004da0 2024-09-16T07:29:01.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.460+0000 7fb402a00640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb3e8072ef0 0x7fb3e80753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.460+0000 7fb402a00640 1 -- 172.21.15.114:0/4128003284 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fb3fc093f90 con 0x7fb3f0004da0 2024-09-16T07:29:01.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.460+0000 7fb401400640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb3e8072ef0 0x7fb3e80753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.460+0000 7fb401400640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb3e8072ef0 0x7fb3e80753b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb40c09b4a0 tx=0x7fb3f400ab60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:01.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.464+0000 7fb402a00640 1 -- 172.21.15.114:0/4128003284 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb3fc01f030 con 0x7fb3f0004da0 2024-09-16T07:29:01.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.692+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fb40c070aa0 con 0x7fb3f0004da0 2024-09-16T07:29:01.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.692+0000 7fb402a00640 1 -- 172.21.15.114:0/4128003284 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fb40c1f5dd0 con 0x7fb3f0004da0 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb3e8072ef0 msgr2=0x7fb3e80753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb3e8072ef0 0x7fb3e80753b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb40c09b4a0 tx=0x7fb3f400ab60 comp rx=0 tx=0).stop 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 msgr2=0x7fb40c1f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 0x7fb40c1f5890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001490 tx=0x7fb3fc00e960 comp rx=0 tx=0).stop 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 shutdown_connections 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb3e8072ef0 0x7fb3e80753b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40c09c970 0x7fb40c09cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb40c1536d0 0x7fb40c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 --2- 172.21.15.114:0/4128003284 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3f0004da0 0x7fb40c1f5890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 >> 172.21.15.114:0/4128003284 conn(0x7fb40c0b18f0 msgr2=0x7fb40c073ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 shutdown_connections 2024-09-16T07:29:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.696+0000 7fb411000640 1 -- 172.21.15.114:0/4128003284 wait complete. 2024-09-16T07:29:01.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-16T07:29:01.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 -- 172.21.15.114:0/3105284584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd015bea0 msgr2=0x7f7bd00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 --2- 172.21.15.114:0/3105284584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd015bea0 0x7f7bd00ce670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009900 tx=0x7f7bc001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 -- 172.21.15.114:0/3105284584 shutdown_connections 2024-09-16T07:29:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 --2- 172.21.15.114:0/3105284584 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd00cdb30 0x7f7bd00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 --2- 172.21.15.114:0/3105284584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd015bea0 0x7f7bd00ce670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 -- 172.21.15.114:0/3105284584 >> 172.21.15.114:0/3105284584 conn(0x7f7bd00d1dc0 msgr2=0x7f7bd00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 -- 172.21.15.114:0/3105284584 shutdown_connections 2024-09-16T07:29:01.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.856+0000 7f7bd7600640 1 -- 172.21.15.114:0/3105284584 wait complete. 2024-09-16T07:29:01.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 Processor -- start 2024-09-16T07:29:01.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 -- start start 2024-09-16T07:29:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd00cdb30 0x7f7bd01f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd00d28e0 0x7f7bd009e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd015bea0 0x7f7bd00ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0168fc0 con 0x7f7bd00d28e0 2024-09-16T07:29:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0168e40 con 0x7f7bd015bea0 2024-09-16T07:29:01.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd0169140 con 0x7f7bd00cdb30 2024-09-16T07:29:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd00d28e0 0x7f7bd009e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd4c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd00cdb30 0x7f7bd01f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd015bea0 0x7f7bd00ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd00d28e0 0x7f7bd009e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43942/0 (socket says 172.21.15.114:43942) 2024-09-16T07:29:01.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 -- 172.21.15.114:0/668624333 learned_addr learned my addr 172.21.15.114:0/668624333 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 -- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd00cdb30 msgr2=0x7f7bd01f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd00cdb30 0x7f7bd01f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 -- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd015bea0 msgr2=0x7f7bd00ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd015bea0 0x7f7bd00ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 -- 172.21.15.114:0/668624333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd0156d00 con 0x7f7bd00d28e0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bc7e00640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd00d28e0 0x7f7bd009e340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800d980 tx=0x7f7bb800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bcd600640 1 -- 172.21.15.114:0/668624333 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8017070 con 0x7f7bd00d28e0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bcd600640 1 -- 172.21.15.114:0/668624333 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bb8009d60 con 0x7f7bd00d28e0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bcd600640 1 -- 172.21.15.114:0/668624333 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8005280 con 0x7f7bd00d28e0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd01f5da0 con 0x7f7bd00d28e0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd0156f70 con 0x7f7bd00d28e0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.860+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd00cc9d0 con 0x7f7bd00d28e0 2024-09-16T07:29:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.864+0000 7f7bcd600640 1 -- 172.21.15.114:0/668624333 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f7bb8005420 con 0x7f7bd00d28e0 2024-09-16T07:29:01.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.864+0000 7f7bcd600640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7bac072ec0 0x7f7bac075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:01.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.864+0000 7f7bcd600640 1 -- 172.21.15.114:0/668624333 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f7bb8093d30 con 0x7f7bd00d28e0 2024-09-16T07:29:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.864+0000 7f7bd4c00640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7bac072ec0 0x7f7bac075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.864+0000 7f7bd4c00640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7bac072ec0 0x7f7bac075380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00af000 tx=0x7f7bc001b120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:01.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:01.868+0000 7f7bcd600640 1 -- 172.21.15.114:0/668624333 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7bb8099020 con 0x7f7bd00d28e0 2024-09-16T07:29:02.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.092+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f7bd00b0580 con 0x7f7bd00d28e0 2024-09-16T07:29:02.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.096+0000 7f7bcd600640 1 -- 172.21.15.114:0/668624333 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f7bb805eb60 con 0x7f7bd00d28e0 2024-09-16T07:29:02.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7bac072ec0 msgr2=0x7f7bac075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7bac072ec0 0x7f7bac075380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00af000 tx=0x7f7bc001b120 comp rx=0 tx=0).stop 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd00d28e0 msgr2=0x7f7bd009e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd00d28e0 0x7f7bd009e340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800d980 tx=0x7f7bb800de40 comp rx=0 tx=0).stop 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 shutdown_connections 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7bac072ec0 0x7f7bac075380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bd015bea0 0x7f7bd00ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bd00d28e0 0x7f7bd009e340 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 --2- 172.21.15.114:0/668624333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bd00cdb30 0x7f7bd01f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 >> 172.21.15.114:0/668624333 conn(0x7f7bd00d1dc0 msgr2=0x7f7bd00b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 shutdown_connections 2024-09-16T07:29:02.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.100+0000 7f7bd7600640 1 -- 172.21.15.114:0/668624333 wait complete. 2024-09-16T07:29:02.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-16T07:29:02.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- 172.21.15.114:0/3084618979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 msgr2=0x7f9d800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 --2- 172.21.15.114:0/3084618979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 0x7f9d800051d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009eb0 tx=0x7f9d9401d5b0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9d9b400640 1 -- 172.21.15.114:0/3084618979 reap_dead start 2024-09-16T07:29:02.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- 172.21.15.114:0/3084618979 shutdown_connections 2024-09-16T07:29:02.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- 172.21.15.114:0/3084618979 >> 172.21.15.114:0/3084618979 conn(0x7f9d9c0d1e30 msgr2=0x7f9d9c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:02.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- 172.21.15.114:0/3084618979 shutdown_connections 2024-09-16T07:29:02.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- 172.21.15.114:0/3084618979 wait complete. 2024-09-16T07:29:02.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 Processor -- start 2024-09-16T07:29:02.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- start start 2024-09-16T07:29:02.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 0x7f9d9c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d9c1588e0 0x7f9d9c1fced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d9c1f84e0 0x7f9d9c071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c15f870 con 0x7f9d80004d50 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c0b3520 con 0x7f9d9c1588e0 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9da1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9c15f9f0 con 0x7f9d9c1f84e0 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9d9aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 0x7f9d9c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9d9aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 0x7f9d9c0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43954/0 (socket says 172.21.15.114:43954) 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9d9aa00640 1 -- 172.21.15.114:0/2549003349 learned_addr learned my addr 172.21.15.114:0/2549003349 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9d9b400640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d9c1f84e0 0x7f9d9c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.264+0000 7f9d9a000640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d9c1588e0 0x7f9d9c1fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d9aa00640 1 -- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d9c1f84e0 msgr2=0x7f9d9c071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d9aa00640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d9c1f84e0 0x7f9d9c071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d9aa00640 1 -- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d9c1588e0 msgr2=0x7f9d9c1fced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d9aa00640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d9c1588e0 0x7f9d9c1fced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d9aa00640 1 -- 172.21.15.114:0/2549003349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c159110 con 0x7f9d80004d50 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d9a000640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d9c1588e0 0x7f9d9c1fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d9aa00640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 0x7f9d9c0c8f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c001870 tx=0x7f9d8c00e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d92a00640 1 -- 172.21.15.114:0/2549003349 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c012850 con 0x7f9d80004d50 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d92a00640 1 -- 172.21.15.114:0/2549003349 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d8c012ae0 con 0x7f9d80004d50 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9c158e30 con 0x7f9d80004d50 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d92a00640 1 -- 172.21.15.114:0/2549003349 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c01a400 con 0x7f9d80004d50 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9c1fc6d0 con 0x7f9d80004d50 2024-09-16T07:29:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9c0b14c0 con 0x7f9d80004d50 2024-09-16T07:29:02.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.268+0000 7f9d92a00640 1 -- 172.21.15.114:0/2549003349 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f9d8c00d030 con 0x7f9d80004d50 2024-09-16T07:29:02.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.272+0000 7f9d92a00640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9d7c072ec0 0x7f9d7c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.272+0000 7f9d92a00640 1 -- 172.21.15.114:0/2549003349 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f9d8c096bf0 con 0x7f9d80004d50 2024-09-16T07:29:02.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.272+0000 7f9d9a000640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9d7c072ec0 0x7f9d7c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.272+0000 7f9d9a000640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9d7c072ec0 0x7f9d7c075380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006fd0 tx=0x7f9d88006bd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.276+0000 7f9d92a00640 1 -- 172.21.15.114:0/2549003349 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9d8c016030 con 0x7f9d80004d50 2024-09-16T07:29:02.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.500+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f9d9c15ddd0 con 0x7f9d80004d50 2024-09-16T07:29:02.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9d92a00640 1 -- 172.21.15.114:0/2549003349 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f9d8c0620f0 con 0x7f9d80004d50 2024-09-16T07:29:02.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9d7c072ec0 msgr2=0x7f9d7c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9d7c072ec0 0x7f9d7c075380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d88006fd0 tx=0x7f9d88006bd0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 msgr2=0x7f9d9c0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 0x7f9d9c0c8f00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c001870 tx=0x7f9d8c00e770 comp rx=0 tx=0).stop 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 shutdown_connections 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9d7c072ec0 0x7f9d7c075380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9d9c1f84e0 0x7f9d9c071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d9c1588e0 0x7f9d9c1fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 --2- 172.21.15.114:0/2549003349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d80004d50 0x7f9d9c0c8f00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 >> 172.21.15.114:0/2549003349 conn(0x7f9d9c0d1e30 msgr2=0x7f9d9c15a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 shutdown_connections 2024-09-16T07:29:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.504+0000 7f9da1600640 1 -- 172.21.15.114:0/2549003349 wait complete. 2024-09-16T07:29:02.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:29:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- 172.21.15.114:0/502051829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca006ecb0 msgr2=0x7f6ca00b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 --2- 172.21.15.114:0/502051829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca006ecb0 0x7f6ca00b4a60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00cc420 tx=0x7f6c8c01c820 comp rx=0 tx=0).stop 2024-09-16T07:29:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- 172.21.15.114:0/502051829 shutdown_connections 2024-09-16T07:29:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 --2- 172.21.15.114:0/502051829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca006ecb0 0x7f6ca00b4a60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- 172.21.15.114:0/502051829 >> 172.21.15.114:0/502051829 conn(0x7f6ca00b18f0 msgr2=0x7f6ca00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- 172.21.15.114:0/502051829 shutdown_connections 2024-09-16T07:29:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- 172.21.15.114:0/502051829 wait complete. 2024-09-16T07:29:02.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 Processor -- start 2024-09-16T07:29:02.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- start start 2024-09-16T07:29:02.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca006ecb0 0x7f6ca0146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00b2bf0 0x7f6ca015d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca0158a20 0x7f6ca0163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0169120 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0168fa0 con 0x7f6ca0158a20 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6ca6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca01692a0 con 0x7f6ca006ecb0 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00b2bf0 0x7f6ca015d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00b2bf0 0x7f6ca015d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43978/0 (socket says 172.21.15.114:43978) 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9ea00640 1 -- 172.21.15.114:0/947662099 learned_addr learned my addr 172.21.15.114:0/947662099 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9fe00640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca0158a20 0x7f6ca0163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9f400640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca006ecb0 0x7f6ca0146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9ea00640 1 -- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca006ecb0 msgr2=0x7f6ca0146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9ea00640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca006ecb0 0x7f6ca0146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9ea00640 1 -- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca0158a20 msgr2=0x7f6ca0163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.668+0000 7f6c9ea00640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca0158a20 0x7f6ca0163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6c9ea00640 1 -- 172.21.15.114:0/947662099 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca0153ee0 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6c9ea00640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00b2bf0 0x7f6ca015d830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0982e0 tx=0x7f6c8c0a5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6c97400640 1 -- 172.21.15.114:0/947662099 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0bb070 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6c97400640 1 -- 172.21.15.114:0/947662099 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c8c0043f0 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca00af8b0 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6c97400640 1 -- 172.21.15.114:0/947662099 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0b2040 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca00afe70 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca0069410 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.672+0000 7f6c97400640 1 -- 172.21.15.114:0/947662099 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6c8c0be070 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.676+0000 7f6c97400640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80072ec0 0x7f6c80075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:02.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.676+0000 7f6c97400640 1 -- 172.21.15.114:0/947662099 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6c8c12d290 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.676+0000 7f6c9f400640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80072ec0 0x7f6c80075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:02.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.676+0000 7f6c9f400640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80072ec0 0x7f6c80075380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c90001640 tx=0x7f6c90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.680+0000 7f6c97400640 1 -- 172.21.15.114:0/947662099 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6c8c016410 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.848+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6ca00b4a60 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.848+0000 7f6c97400640 1 -- 172.21.15.114:0/947662099 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7f6c8c0f8830 con 0x7f6ca00b2bf0 2024-09-16T07:29:02.854 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:02.854 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:29:02.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:02.854 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:29:02.854 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:29:02.854 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:02.854 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80072ec0 msgr2=0x7f6c80075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80072ec0 0x7f6c80075380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c90001640 tx=0x7f6c90009040 comp rx=0 tx=0).stop 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00b2bf0 msgr2=0x7f6ca015d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00b2bf0 0x7f6ca015d830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0982e0 tx=0x7f6c8c0a5f70 comp rx=0 tx=0).stop 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 shutdown_connections 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80072ec0 0x7f6c80075380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca0158a20 0x7f6ca0163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00b2bf0 0x7f6ca015d830 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 --2- 172.21.15.114:0/947662099 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca006ecb0 0x7f6ca0146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:02.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 >> 172.21.15.114:0/947662099 conn(0x7f6ca00b18f0 msgr2=0x7f6ca0154230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:02.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 shutdown_connections 2024-09-16T07:29:02.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:02.852+0000 7f6ca6800640 1 -- 172.21.15.114:0/947662099 wait complete. 2024-09-16T07:29:02.874 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:29:02.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:29:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 -- 172.21.15.114:0/3938847320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 msgr2=0x7f174c0d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 --2- 172.21.15.114:0/3938847320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0d0720 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1738009840 tx=0x7f173801c7f0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 -- 172.21.15.114:0/3938847320 shutdown_connections 2024-09-16T07:29:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 --2- 172.21.15.114:0/3938847320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0d0720 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 --2- 172.21.15.114:0/3938847320 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c0cff00 0x7f174c0d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 -- 172.21.15.114:0/3938847320 >> 172.21.15.114:0/3938847320 conn(0x7f174c0d1da0 msgr2=0x7f174c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 -- 172.21.15.114:0/3938847320 shutdown_connections 2024-09-16T07:29:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 -- 172.21.15.114:0/3938847320 wait complete. 2024-09-16T07:29:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 Processor -- start 2024-09-16T07:29:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.016+0000 7f174be00640 1 -- start start 2024-09-16T07:29:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174c0cff00 0x7f174c0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15eff0 0x7f174c0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1691a0 con 0x7f174c0d02e0 2024-09-16T07:29:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f174c169020 con 0x7f174c0cff00 2024-09-16T07:29:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f174c169320 con 0x7f174c15eff0 2024-09-16T07:29:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43998/0 (socket says 172.21.15.114:43998) 2024-09-16T07:29:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 -- 172.21.15.114:0/35231380 learned_addr learned my addr 172.21.15.114:0/35231380 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174aa00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174c0cff00 0x7f174c0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174b400640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15eff0 0x7f174c0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 -- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15eff0 msgr2=0x7f174c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15eff0 0x7f174c0cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 -- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174c0cff00 msgr2=0x7f174c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174c0cff00 0x7f174c0cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 -- 172.21.15.114:0/35231380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c0b5910 con 0x7f174c0d02e0 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174aa00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174c0cff00 0x7f174c0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174a000640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0b6d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1738009790 tx=0x7f17380a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f1742a00640 1 -- 172.21.15.114:0/35231380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17380b2040 con 0x7f174c0d02e0 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f1742a00640 1 -- 172.21.15.114:0/35231380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17380044b0 con 0x7f174c0d02e0 2024-09-16T07:29:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f1742a00640 1 -- 172.21.15.114:0/35231380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738005280 con 0x7f174c0d02e0 2024-09-16T07:29:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c0b75c0 con 0x7f174c0d02e0 2024-09-16T07:29:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c150fb0 con 0x7f174c0d02e0 2024-09-16T07:29:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.020+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174c150dd0 con 0x7f174c0d02e0 2024-09-16T07:29:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.024+0000 7f1742a00640 1 -- 172.21.15.114:0/35231380 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f1738005420 con 0x7f174c0d02e0 2024-09-16T07:29:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.024+0000 7f1742a00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f172c072ec0 0x7f172c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.024+0000 7f1742a00640 1 -- 172.21.15.114:0/35231380 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f173812d290 con 0x7f174c0d02e0 2024-09-16T07:29:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.024+0000 7f174aa00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f172c072ec0 0x7f172c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.024+0000 7f174aa00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f172c072ec0 0x7f172c075380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ccfc0 tx=0x7f173c0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.028+0000 7f1742a00640 1 -- 172.21.15.114:0/35231380 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f174c150dd0 con 0x7f174c0d02e0 2024-09-16T07:29:03.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.192+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f174c0d28c0 con 0x7f174c0d02e0 2024-09-16T07:29:03.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.648+0000 7f1742a00640 1 -- 172.21.15.114:0/35231380 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f174c0b5910 con 0x7f174c0d02e0 2024-09-16T07:29:03.654 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:29:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f172c072ec0 msgr2=0x7f172c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f172c072ec0 0x7f172c075380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ccfc0 tx=0x7f173c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 msgr2=0x7f174c0b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0b6d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1738009790 tx=0x7f17380a5840 comp rx=0 tx=0).stop 2024-09-16T07:29:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 shutdown_connections 2024-09-16T07:29:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f172c072ec0 0x7f172c075380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15eff0 0x7f174c0cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c0d02e0 0x7f174c0b6d70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 --2- 172.21.15.114:0/35231380 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174c0cff00 0x7f174c0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 >> 172.21.15.114:0/35231380 conn(0x7f174c0d1da0 msgr2=0x7f174c0afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 shutdown_connections 2024-09-16T07:29:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.652+0000 7f174be00640 1 -- 172.21.15.114:0/35231380 wait complete. 2024-09-16T07:29:03.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:29:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 -- 172.21.15.114:0/908535659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d1815e520 msgr2=0x7f6d180cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 --2- 172.21.15.114:0/908535659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d1815e520 0x7f6d180cc8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009900 tx=0x7f6d0801d310 comp rx=0 tx=0).stop 2024-09-16T07:29:03.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 -- 172.21.15.114:0/908535659 shutdown_connections 2024-09-16T07:29:03.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 --2- 172.21.15.114:0/908535659 >> v2:172.21.15.149:3300/0 conn(0x7f6d180cc330 0x7f6d180ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 --2- 172.21.15.114:0/908535659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d1815e520 0x7f6d180cc8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 -- 172.21.15.114:0/908535659 >> 172.21.15.114:0/908535659 conn(0x7f6d180d0410 msgr2=0x7f6d180d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:03.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 -- 172.21.15.114:0/908535659 shutdown_connections 2024-09-16T07:29:03.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 -- 172.21.15.114:0/908535659 wait complete. 2024-09-16T07:29:03.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 Processor -- start 2024-09-16T07:29:03.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.828+0000 7f6d1d400640 1 -- start start 2024-09-16T07:29:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d18074360 0x7f6d181fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d180cc330 0x7f6d180998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d1815e520 0x7f6d180cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18168470 con 0x7f6d18074360 2024-09-16T07:29:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180b10b0 con 0x7f6d1815e520 2024-09-16T07:29:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d181685f0 con 0x7f6d180cc330 2024-09-16T07:29:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d18074360 0x7f6d181fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d18074360 0x7f6d181fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44004/0 (socket says 172.21.15.114:44004) 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 -- 172.21.15.114:0/3315551425 learned_addr learned my addr 172.21.15.114:0/3315551425 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d0fe00640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d180cc330 0x7f6d180998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d17200640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d1815e520 0x7f6d180cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 -- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d180cc330 msgr2=0x7f6d180998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d180cc330 0x7f6d180998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 -- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d1815e520 msgr2=0x7f6d180cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d1815e520 0x7f6d180cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 -- 172.21.15.114:0/3315551425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1815d4f0 con 0x7f6d18074360 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d17200640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d1815e520 0x7f6d180cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d16800640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d18074360 0x7f6d181fb9d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009850 tx=0x7f6d08005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d0ea00640 1 -- 172.21.15.114:0/3315551425 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d080b2040 con 0x7f6d18074360 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d0ea00640 1 -- 172.21.15.114:0/3315551425 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d080038f0 con 0x7f6d18074360 2024-09-16T07:29:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d0ea00640 1 -- 172.21.15.114:0/3315551425 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08003d00 con 0x7f6d18074360 2024-09-16T07:29:03.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1815d7d0 con 0x7f6d18074360 2024-09-16T07:29:03.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d180c5420 con 0x7f6d18074360 2024-09-16T07:29:03.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d180ceaf0 con 0x7f6d18074360 2024-09-16T07:29:03.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.832+0000 7f6d0ea00640 1 -- 172.21.15.114:0/3315551425 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f6d080b8470 con 0x7f6d18074360 2024-09-16T07:29:03.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.836+0000 7f6d0ea00640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cf4072ec0 0x7f6cf4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:03.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.836+0000 7f6d0ea00640 1 -- 172.21.15.114:0/3315551425 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f6d0812dff0 con 0x7f6d18074360 2024-09-16T07:29:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.836+0000 7f6d0fe00640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cf4072ec0 0x7f6cf4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.836+0000 7f6d0fe00640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cf4072ec0 0x7f6cf4075380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d1809e600 tx=0x7f6d000091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:03.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:03.840+0000 7f6d0ea00640 1 -- 172.21.15.114:0/3315551425 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6d080164d0 con 0x7f6d18074360 2024-09-16T07:29:04.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.008+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6d180b04f0 con 0x7f6d18074360 2024-09-16T07:29:04.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.656+0000 7f6d0ea00640 1 -- 172.21.15.114:0/3315551425 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f6d080f8d50 con 0x7f6d18074360 2024-09-16T07:29:04.662 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:29:04.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cf4072ec0 msgr2=0x7f6cf4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:04.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cf4072ec0 0x7f6cf4075380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d1809e600 tx=0x7f6d000091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d18074360 msgr2=0x7f6d181fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d18074360 0x7f6d181fb9d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009850 tx=0x7f6d08005790 comp rx=0 tx=0).stop 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 shutdown_connections 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cf4072ec0 0x7f6cf4075380 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d1815e520 0x7f6d180cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d180cc330 0x7f6d180998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 --2- 172.21.15.114:0/3315551425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d18074360 0x7f6d181fb9d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.660+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 >> 172.21.15.114:0/3315551425 conn(0x7f6d180d0410 msgr2=0x7f6d180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:04.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.664+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 shutdown_connections 2024-09-16T07:29:04.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.664+0000 7f6d1d400640 1 -- 172.21.15.114:0/3315551425 wait complete. 2024-09-16T07:29:04.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:29:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 -- 172.21.15.114:0/2506541930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae406e810 msgr2=0x7f2ae406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 --2- 172.21.15.114:0/2506541930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae406e810 0x7f2ae406f3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40cc770 tx=0x7f2adc01cba0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 -- 172.21.15.114:0/2506541930 shutdown_connections 2024-09-16T07:29:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 --2- 172.21.15.114:0/2506541930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae406e810 0x7f2ae406f3c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 -- 172.21.15.114:0/2506541930 >> 172.21.15.114:0/2506541930 conn(0x7f2ae40b18f0 msgr2=0x7f2ae40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 -- 172.21.15.114:0/2506541930 shutdown_connections 2024-09-16T07:29:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 -- 172.21.15.114:0/2506541930 wait complete. 2024-09-16T07:29:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 Processor -- start 2024-09-16T07:29:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.844+0000 7f2ae9200640 1 -- start start 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ae406e810 0x7f2ae41fc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae40cf300 0x7f2ae4151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ae415ade0 0x7f2ae40ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae4169b20 con 0x7f2ae40cf300 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae41699a0 con 0x7f2ae406e810 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae4169ca0 con 0x7f2ae415ade0 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae40cf300 0x7f2ae4151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae40cf300 0x7f2ae4151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50330/0 (socket says 172.21.15.114:50330) 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 -- 172.21.15.114:0/598998893 learned_addr learned my addr 172.21.15.114:0/598998893 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae2800640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ae415ade0 0x7f2ae40ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae1e00640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ae406e810 0x7f2ae41fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 -- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ae415ade0 msgr2=0x7f2ae40ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ae415ade0 0x7f2ae40ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 -- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ae406e810 msgr2=0x7f2ae41fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ae406e810 0x7f2ae41fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 -- 172.21.15.114:0/598998893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae41fc6a0 con 0x7f2ae40cf300 2024-09-16T07:29:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2adbe00640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae40cf300 0x7f2ae4151be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c530 tx=0x7f2acc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ada000640 1 -- 172.21.15.114:0/598998893 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc017070 con 0x7f2ae40cf300 2024-09-16T07:29:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ada000640 1 -- 172.21.15.114:0/598998893 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2acc003600 con 0x7f2ae40cf300 2024-09-16T07:29:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ada000640 1 -- 172.21.15.114:0/598998893 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2acc003a50 con 0x7f2ae40cf300 2024-09-16T07:29:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae4159c20 con 0x7f2ae40cf300 2024-09-16T07:29:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae40c90f0 con 0x7f2ae40cf300 2024-09-16T07:29:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.848+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae4069410 con 0x7f2ae40cf300 2024-09-16T07:29:04.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.852+0000 7f2ada000640 1 -- 172.21.15.114:0/598998893 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f2acc01a070 con 0x7f2ae40cf300 2024-09-16T07:29:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.852+0000 7f2ada000640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ac0072ef0 0x7f2ac00753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.852+0000 7f2ada000640 1 -- 172.21.15.114:0/598998893 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f2acc093500 con 0x7f2ae40cf300 2024-09-16T07:29:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.852+0000 7f2ae1e00640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ac0072ef0 0x7f2ac00753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.852+0000 7f2ae1e00640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ac0072ef0 0x7f2ac00753b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad4009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:04.856+0000 7f2ada000640 1 -- 172.21.15.114:0/598998893 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2acc021020 con 0x7f2ae40cf300 2024-09-16T07:29:05.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.056+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2ae40cebf0 con 0x7f2ae40cf300 2024-09-16T07:29:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.660+0000 7f2ada000640 1 -- 172.21.15.114:0/598998893 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f2ae41fc6a0 con 0x7f2ae40cf300 2024-09-16T07:29:05.665 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 4 and data pool 5 2024-09-16T07:29:05.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ac0072ef0 msgr2=0x7f2ac00753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:05.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ac0072ef0 0x7f2ac00753b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad4009060 comp rx=0 tx=0).stop 2024-09-16T07:29:05.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae40cf300 msgr2=0x7f2ae4151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:05.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae40cf300 0x7f2ae4151be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c530 tx=0x7f2acc00c9f0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 shutdown_connections 2024-09-16T07:29:05.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ac0072ef0 0x7f2ac00753b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2ae415ade0 0x7f2ae40ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ae40cf300 0x7f2ae4151be0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 --2- 172.21.15.114:0/598998893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ae406e810 0x7f2ae41fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 >> 172.21.15.114:0/598998893 conn(0x7f2ae40b18f0 msgr2=0x7f2ae40cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 shutdown_connections 2024-09-16T07:29:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.664+0000 7f2ae9200640 1 -- 172.21.15.114:0/598998893 wait complete. 2024-09-16T07:29:05.717 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:05.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 -- 172.21.15.114:0/2623264618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 msgr2=0x7efe580ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:05.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 --2- 172.21.15.114:0/2623264618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580ce670 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efe48009840 tx=0x7efe4801c820 comp rx=0 tx=0).stop 2024-09-16T07:29:05.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 -- 172.21.15.114:0/2623264618 shutdown_connections 2024-09-16T07:29:05.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 --2- 172.21.15.114:0/2623264618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe580d28e0 0x7efe580cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 --2- 172.21.15.114:0/2623264618 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580ce670 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 -- 172.21.15.114:0/2623264618 >> 172.21.15.114:0/2623264618 conn(0x7efe580d1dc0 msgr2=0x7efe580d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:05.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 -- 172.21.15.114:0/2623264618 shutdown_connections 2024-09-16T07:29:05.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.856+0000 7efe5f600640 1 -- 172.21.15.114:0/2623264618 wait complete. 2024-09-16T07:29:05.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 Processor -- start 2024-09-16T07:29:05.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 -- start start 2024-09-16T07:29:05.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe580cdb30 0x7efe5815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:05.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe580d28e0 0x7efe580b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efe58168fc0 con 0x7efe5815bea0 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe58168e40 con 0x7efe580d28e0 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe58169140 con 0x7efe580cdb30 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe580cdb30 0x7efe5815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe4fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe580d28e0 0x7efe580b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50350/0 (socket says 172.21.15.114:50350) 2024-09-16T07:29:05.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 -- 172.21.15.114:0/1234936715 learned_addr learned my addr 172.21.15.114:0/1234936715 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 -- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe580cdb30 msgr2=0x7efe5815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe580cdb30 0x7efe5815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 -- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe580d28e0 msgr2=0x7efe580b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:05.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe580d28e0 0x7efe580b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 -- 172.21.15.114:0/1234936715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe580c6880 con 0x7efe5815bea0 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe4fe00640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe580d28e0 0x7efe580b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5cc00640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe580cdb30 0x7efe5815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5d600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580b31d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe5000eb20 tx=0x7efe5000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe55600640 1 -- 172.21.15.114:0/1234936715 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50004b30 con 0x7efe5815bea0 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe55600640 1 -- 172.21.15.114:0/1234936715 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe50004cf0 con 0x7efe5815bea0 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe55600640 1 -- 172.21.15.114:0/1234936715 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50005280 con 0x7efe5815bea0 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe580c9ee0 con 0x7efe5815bea0 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5815b650 con 0x7efe5815bea0 2024-09-16T07:29:05.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.860+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe580cc9d0 con 0x7efe5815bea0 2024-09-16T07:29:05.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.864+0000 7efe55600640 1 -- 172.21.15.114:0/1234936715 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7efe50005420 con 0x7efe5815bea0 2024-09-16T07:29:05.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.864+0000 7efe55600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efe34072ef0 0x7efe340753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:05.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.864+0000 7efe55600640 1 -- 172.21.15.114:0/1234936715 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efe50094aa0 con 0x7efe5815bea0 2024-09-16T07:29:05.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.864+0000 7efe5cc00640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efe34072ef0 0x7efe340753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:05.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.864+0000 7efe5cc00640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efe34072ef0 0x7efe340753b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efe480af000 tx=0x7efe4801b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:05.868+0000 7efe55600640 1 -- 172.21.15.114:0/1234936715 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efe5005f600 con 0x7efe5815bea0 2024-09-16T07:29:06.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.036+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe580b07d0 con 0x7efe5815bea0 2024-09-16T07:29:06.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.036+0000 7efe55600640 1 -- 172.21.15.114:0/1234936715 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16790 (secure 0 0 0) 0x7efe50064030 con 0x7efe5815bea0 2024-09-16T07:29:06.042 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:06.043 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:05.062091+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:03.209188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:04.021718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efe34072ef0 msgr2=0x7efe340753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efe34072ef0 0x7efe340753b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efe480af000 tx=0x7efe4801b060 comp rx=0 tx=0).stop 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 msgr2=0x7efe580b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580b31d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efe5000eb20 tx=0x7efe5000c2d0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 shutdown_connections 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efe34072ef0 0x7efe340753b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe5815bea0 0x7efe580b31d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe580d28e0 0x7efe580b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 --2- 172.21.15.114:0/1234936715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe580cdb30 0x7efe5815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 >> 172.21.15.114:0/1234936715 conn(0x7efe580d1dc0 msgr2=0x7efe580b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 shutdown_connections 2024-09-16T07:29:06.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.040+0000 7efe5f600640 1 -- 172.21.15.114:0/1234936715 wait complete. 2024-09-16T07:29:06.063 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 -- 172.21.15.114:0/1128268159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 msgr2=0x7ff0100cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 --2- 172.21.15.114:0/1128268159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 0x7ff0100cebf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff000009900 tx=0x7ff00001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 -- 172.21.15.114:0/1128268159 shutdown_connections 2024-09-16T07:29:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 --2- 172.21.15.114:0/1128268159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 0x7ff0100cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 --2- 172.21.15.114:0/1128268159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 0x7ff0100cebf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 -- 172.21.15.114:0/1128268159 >> 172.21.15.114:0/1128268159 conn(0x7ff0100b18f0 msgr2=0x7ff0100b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 -- 172.21.15.114:0/1128268159 shutdown_connections 2024-09-16T07:29:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 -- 172.21.15.114:0/1128268159 wait complete. 2024-09-16T07:29:06.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 Processor -- start 2024-09-16T07:29:06.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.200+0000 7ff016000640 1 -- start start 2024-09-16T07:29:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff01006e810 0x7ff01014b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 0x7ff010152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 0x7ff0101f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff010168140 con 0x7ff01006e810 2024-09-16T07:29:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff010167fc0 con 0x7ff01015ade0 2024-09-16T07:29:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff0101682c0 con 0x7ff0100b4bd0 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 0x7ff010152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff01006e810 0x7ff01014b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 0x7ff0101f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 0x7ff010152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:45438/0 (socket says 172.21.15.114:45438) 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 -- 172.21.15.114:0/531585444 learned_addr learned my addr 172.21.15.114:0/531585444 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 -- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 msgr2=0x7ff0101f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 0x7ff0101f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 -- 172.21.15.114:0/531585444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff01006e810 msgr2=0x7ff01014b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff01006e810 0x7ff01014b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 -- 172.21.15.114:0/531585444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0101531f0 con 0x7ff0100b4bd0 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00fe00640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 0x7ff0101f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff00ea00640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 0x7ff010152cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c500 tx=0x7feffc00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff007400640 1 -- 172.21.15.114:0/531585444 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc017070 con 0x7ff0100b4bd0 2024-09-16T07:29:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff007400640 1 -- 172.21.15.114:0/531585444 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feffc0053c0 con 0x7ff0100b4bd0 2024-09-16T07:29:06.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff010153490 con 0x7ff0100b4bd0 2024-09-16T07:29:06.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff007400640 1 -- 172.21.15.114:0/531585444 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc003860 con 0x7ff0100b4bd0 2024-09-16T07:29:06.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff010153a50 con 0x7ff0100b4bd0 2024-09-16T07:29:06.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff010069410 con 0x7ff0100b4bd0 2024-09-16T07:29:06.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.204+0000 7ff007400640 1 -- 172.21.15.114:0/531585444 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7feffc01a070 con 0x7ff0100b4bd0 2024-09-16T07:29:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.208+0000 7ff007400640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7feff0072ec0 0x7feff0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.208+0000 7ff007400640 1 -- 172.21.15.114:0/531585444 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7feffc093080 con 0x7ff0100b4bd0 2024-09-16T07:29:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.208+0000 7ff00f400640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7feff0072ec0 0x7feff0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.208+0000 7ff00f400640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7feff0072ec0 0x7feff0075380 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0000af000 tx=0x7ff00001b120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:06.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.212+0000 7ff007400640 1 -- 172.21.15.114:0/531585444 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7feffc05dc70 con 0x7ff0100b4bd0 2024-09-16T07:29:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.376+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0100cf720 con 0x7ff0100b4bd0 2024-09-16T07:29:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff007400640 1 -- 172.21.15.114:0/531585444 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16790 (secure 0 0 0) 0x7feffc0626a0 con 0x7ff0100b4bd0 2024-09-16T07:29:06.384 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:06.384 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:05.062091+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:03.209188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:04.021718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:06.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7feff0072ec0 msgr2=0x7feff0075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7feff0072ec0 0x7feff0075380 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0000af000 tx=0x7ff00001b120 comp rx=0 tx=0).stop 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 msgr2=0x7ff010152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 0x7ff010152cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c500 tx=0x7feffc00c900 comp rx=0 tx=0).stop 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 shutdown_connections 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7feff0072ec0 0x7feff0075380 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff01015ade0 0x7ff0101f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0100b4bd0 0x7ff010152cb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 --2- 172.21.15.114:0/531585444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff01006e810 0x7ff01014b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 >> 172.21.15.114:0/531585444 conn(0x7ff0100b18f0 msgr2=0x7ff010151c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 shutdown_connections 2024-09-16T07:29:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.380+0000 7ff016000640 1 -- 172.21.15.114:0/531585444 wait complete. 2024-09-16T07:29:06.405 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 -- 172.21.15.114:0/2705419391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 msgr2=0x7f944406e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 --2- 172.21.15.114:0/2705419391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f944406e700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9444073a90 tx=0x7f943c01c890 comp rx=0 tx=0).stop 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 -- 172.21.15.114:0/2705419391 shutdown_connections 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 --2- 172.21.15.114:0/2705419391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f944406e700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 --2- 172.21.15.114:0/2705419391 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94441616f0 0x7f944406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 --2- 172.21.15.114:0/2705419391 >> v2:172.21.15.149:3300/0 conn(0x7f9444161310 0x7f94440d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 -- 172.21.15.114:0/2705419391 >> 172.21.15.114:0/2705419391 conn(0x7f94440d1e00 msgr2=0x7f94440d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 -- 172.21.15.114:0/2705419391 shutdown_connections 2024-09-16T07:29:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.544+0000 7f944c600640 1 -- 172.21.15.114:0/2705419391 wait complete. 2024-09-16T07:29:06.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 Processor -- start 2024-09-16T07:29:06.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 -- start start 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f9444157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9444161310 0x7f9444158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94441616f0 0x7f9444145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f94440cd340 con 0x7f944406e270 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94440cd1c0 con 0x7f94441616f0 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94440cd4c0 con 0x7f9444161310 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f9444157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f9444157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50358/0 (socket says 172.21.15.114:50358) 2024-09-16T07:29:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 -- 172.21.15.114:0/590913950 learned_addr learned my addr 172.21.15.114:0/590913950 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944a600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94441616f0 0x7f9444145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449200640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9444161310 0x7f9444158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 -- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9444161310 msgr2=0x7f9444158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9444161310 0x7f9444158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 -- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94441616f0 msgr2=0x7f9444145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94441616f0 0x7f9444145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 -- 172.21.15.114:0/590913950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440c5bb0 con 0x7f944406e270 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944a600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94441616f0 0x7f9444145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9449c00640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f9444157d30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9438009fd0 tx=0x7f943800c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:06.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9441600640 1 -- 172.21.15.114:0/590913950 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438011470 con 0x7f944406e270 2024-09-16T07:29:06.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9441600640 1 -- 172.21.15.114:0/590913950 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9438011700 con 0x7f944406e270 2024-09-16T07:29:06.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94440cb8c0 con 0x7f944406e270 2024-09-16T07:29:06.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f9441600640 1 -- 172.21.15.114:0/590913950 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9438011b30 con 0x7f944406e270 2024-09-16T07:29:06.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.548+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9444155380 con 0x7f944406e270 2024-09-16T07:29:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.552+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444155190 con 0x7f944406e270 2024-09-16T07:29:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.552+0000 7f9441600640 1 -- 172.21.15.114:0/590913950 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f9438011cd0 con 0x7f944406e270 2024-09-16T07:29:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.552+0000 7f9441600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424072ec0 0x7f9424075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.552+0000 7f9441600640 1 -- 172.21.15.114:0/590913950 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9438094be0 con 0x7f944406e270 2024-09-16T07:29:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.552+0000 7f9449200640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424072ec0 0x7f9424075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.552+0000 7f9449200640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424072ec0 0x7f9424075380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94440b5150 tx=0x7f943000d490 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.556+0000 7f9441600640 1 -- 172.21.15.114:0/590913950 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9438016030 con 0x7f944406e270 2024-09-16T07:29:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:06.760+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f94440d0a10 con 0x7f944406e270 2024-09-16T07:29:07.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.692+0000 7f9441600640 1 -- 172.21.15.114:0/590913950 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f943805fda0 con 0x7f944406e270 2024-09-16T07:29:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424072ec0 msgr2=0x7f9424075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424072ec0 0x7f9424075380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94440b5150 tx=0x7f943000d490 comp rx=0 tx=0).stop 2024-09-16T07:29:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 msgr2=0x7f9444157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f9444157d30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9438009fd0 tx=0x7f943800c270 comp rx=0 tx=0).stop 2024-09-16T07:29:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 shutdown_connections 2024-09-16T07:29:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424072ec0 0x7f9424075380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94441616f0 0x7f9444145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9444161310 0x7f9444158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 --2- 172.21.15.114:0/590913950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f944406e270 0x7f9444157d30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 >> 172.21.15.114:0/590913950 conn(0x7f94440d1e00 msgr2=0x7f944415f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 shutdown_connections 2024-09-16T07:29:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.696+0000 7f944c600640 1 -- 172.21.15.114:0/590913950 wait complete. 2024-09-16T07:29:07.723 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:29:07.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:29:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 -- 172.21.15.114:0/1283608975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 msgr2=0x7f4d7c0d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 --2- 172.21.15.114:0/1283608975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c0d1bb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009840 tx=0x7f4d6801c820 comp rx=0 tx=0).stop 2024-09-16T07:29:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 -- 172.21.15.114:0/1283608975 shutdown_connections 2024-09-16T07:29:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 --2- 172.21.15.114:0/1283608975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c0d1bb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 -- 172.21.15.114:0/1283608975 >> 172.21.15.114:0/1283608975 conn(0x7f4d7c09aa10 msgr2=0x7f4d7c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 -- 172.21.15.114:0/1283608975 shutdown_connections 2024-09-16T07:29:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 -- 172.21.15.114:0/1283608975 wait complete. 2024-09-16T07:29:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 Processor -- start 2024-09-16T07:29:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.868+0000 7f4d82a00640 1 -- start start 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c166fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c0d20f0 0x7f4d7c1fb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c15bd40 0x7f4d7c155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c169e80 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c169d00 con 0x7f4d7c15bd40 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c16a000 con 0x7f4d7c0d20f0 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c166fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c166fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50390/0 (socket says 172.21.15.114:50390) 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 -- 172.21.15.114:0/993601409 learned_addr learned my addr 172.21.15.114:0/993601409 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d80c00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c0d20f0 0x7f4d7c1fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82000640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c15bd40 0x7f4d7c155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 -- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c0d20f0 msgr2=0x7f4d7c1fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c0d20f0 0x7f4d7c1fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 -- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c15bd40 msgr2=0x7f4d7c155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c15bd40 0x7f4d7c155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 -- 172.21.15.114:0/993601409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c1532d0 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d81600640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c166fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000c740 tx=0x7f4d7000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d79600640 1 -- 172.21.15.114:0/993601409 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70003db0 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d79600640 1 -- 172.21.15.114:0/993601409 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d7000ce50 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d79600640 1 -- 172.21.15.114:0/993601409 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d700052d0 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c1fb8f0 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c167520 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c0d1bb0 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.872+0000 7f4d79600640 1 -- 172.21.15.114:0/993601409 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f4d70005470 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.876+0000 7f4d79600640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d5c072ef0 0x7f4d5c0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.876+0000 7f4d79600640 1 -- 172.21.15.114:0/993601409 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4d70093c40 con 0x7f4d7c0b0d10 2024-09-16T07:29:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.876+0000 7f4d80c00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d5c072ef0 0x7f4d5c0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.876+0000 7f4d80c00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d5c072ef0 0x7f4d5c0753b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d680af000 tx=0x7f4d6801b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:07.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:07.880+0000 7f4d79600640 1 -- 172.21.15.114:0/993601409 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4d7005edf0 con 0x7f4d7c0b0d10 2024-09-16T07:29:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.084+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4d7c09fb80 con 0x7f4d7c0b0d10 2024-09-16T07:29:08.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.700+0000 7f4d79600640 1 -- 172.21.15.114:0/993601409 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f4d7005e6f0 con 0x7f4d7c0b0d10 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d5c072ef0 msgr2=0x7f4d5c0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d5c072ef0 0x7f4d5c0753b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d680af000 tx=0x7f4d6801b060 comp rx=0 tx=0).stop 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 msgr2=0x7f4d7c166fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c166fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000c740 tx=0x7f4d7000cc00 comp rx=0 tx=0).stop 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 shutdown_connections 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4d5c072ef0 0x7f4d5c0753b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d7c15bd40 0x7f4d7c155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d7c0d20f0 0x7f4d7c1fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 --2- 172.21.15.114:0/993601409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4d7c0b0d10 0x7f4d7c166fe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 >> 172.21.15.114:0/993601409 conn(0x7f4d7c09aa10 msgr2=0x7f4d7c0b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 shutdown_connections 2024-09-16T07:29:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.704+0000 7f4d82a00640 1 -- 172.21.15.114:0/993601409 wait complete. 2024-09-16T07:29:08.728 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:29:08.728 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.864+0000 7f108c600640 1 -- 172.21.15.114:0/67103048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415f6f0 msgr2=0x7f10840b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.864+0000 7f108c600640 1 --2- 172.21.15.114:0/67103048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415f6f0 0x7f10840b5a90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1070009840 tx=0x7f107001c820 comp rx=0 tx=0).stop 2024-09-16T07:29:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.864+0000 7f108c600640 1 -- 172.21.15.114:0/67103048 shutdown_connections 2024-09-16T07:29:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.864+0000 7f108c600640 1 --2- 172.21.15.114:0/67103048 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415f6f0 0x7f10840b5a90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.864+0000 7f108c600640 1 -- 172.21.15.114:0/67103048 >> 172.21.15.114:0/67103048 conn(0x7f108406dd30 msgr2=0x7f108406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.864+0000 7f108c600640 1 -- 172.21.15.114:0/67103048 shutdown_connections 2024-09-16T07:29:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.864+0000 7f108c600640 1 -- 172.21.15.114:0/67103048 wait complete. 2024-09-16T07:29:08.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 Processor -- start 2024-09-16T07:29:08.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 -- start start 2024-09-16T07:29:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1084152cd0 0x7f108414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415c730 0x7f1084155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108415f6f0 0x7f108415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f108415cf00 con 0x7f108415c730 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f108415cd80 con 0x7f1084152cd0 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f108415d080 con 0x7f108415f6f0 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415c730 0x7f1084155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415c730 0x7f1084155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50402/0 (socket says 172.21.15.114:50402) 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 -- 172.21.15.114:0/915433998 learned_addr learned my addr 172.21.15.114:0/915433998 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089c00640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1084152cd0 0x7f108414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 -- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108415f6f0 msgr2=0x7f108415abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108415f6f0 0x7f108415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 -- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1084152cd0 msgr2=0x7f108414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:08.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1084152cd0 0x7f108414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 -- 172.21.15.114:0/915433998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1084155520 con 0x7f108415c730 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089c00640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1084152cd0 0x7f108414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1089200640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415c730 0x7f1084155fc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1070009790 tx=0x7f1070004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1081600640 1 -- 172.21.15.114:0/915433998 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10700be070 con 0x7f108415c730 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1081600640 1 -- 172.21.15.114:0/915433998 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1070005070 con 0x7f108415c730 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1084154090 con 0x7f108415c730 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f1081600640 1 -- 172.21.15.114:0/915433998 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070005460 con 0x7f108415c730 2024-09-16T07:29:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.868+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1084153ad0 con 0x7f108415c730 2024-09-16T07:29:08.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.872+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10840b5a90 con 0x7f108415c730 2024-09-16T07:29:08.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.872+0000 7f1081600640 1 -- 172.21.15.114:0/915433998 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f10700c1070 con 0x7f108415c730 2024-09-16T07:29:08.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.872+0000 7f1081600640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1064072ec0 0x7f1064075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:08.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.872+0000 7f1081600640 1 -- 172.21.15.114:0/915433998 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f107012e300 con 0x7f108415c730 2024-09-16T07:29:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.872+0000 7f1089c00640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1064072ec0 0x7f1064075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.872+0000 7f1089c00640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1064072ec0 0x7f1064075380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1078000f70 tx=0x7f1078009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:08.876+0000 7f1081600640 1 -- 172.21.15.114:0/915433998 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1070016410 con 0x7f108415c730 2024-09-16T07:29:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.076+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10840b35a0 con 0x7f108415c730 2024-09-16T07:29:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.076+0000 7f1081600640 1 -- 172.21.15.114:0/915433998 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7f10700f9530 con 0x7f108415c730 2024-09-16T07:29:09.082 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:09.083 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"btime":"2024-09-16T07:29:08:699247+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3907348015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3907348015},{"type":"v1","addr":"172.21.15.114:6834","nonce":3907348015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2595700778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2595700778},{"type":"v1","addr":"172.21.15.149:6836","nonce":2595700778}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/986042946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":986042946},{"type":"v1","addr":"172.21.15.149:6837","nonce":986042946}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:05.062058+0000","modified":"2024-09-16T07:29:08.089127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4837":{"gid":4837,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/319033864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":319033864},{"type":"v1","addr":"172.21.15.114:6835","nonce":319033864}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4837,"qdb_cluster":[4837]},"id":2}]} 2024-09-16T07:29:09.083 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1064072ec0 msgr2=0x7f1064075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1064072ec0 0x7f1064075380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1078000f70 tx=0x7f1078009040 comp rx=0 tx=0).stop 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415c730 msgr2=0x7f1084155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415c730 0x7f1084155fc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1070009790 tx=0x7f1070004040 comp rx=0 tx=0).stop 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 shutdown_connections 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1064072ec0 0x7f1064075380 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108415f6f0 0x7f108415abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108415c730 0x7f1084155fc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 --2- 172.21.15.114:0/915433998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1084152cd0 0x7f108414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 >> 172.21.15.114:0/915433998 conn(0x7f108406dd30 msgr2=0x7f10840b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 shutdown_connections 2024-09-16T07:29:09.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.080+0000 7f108c600640 1 -- 172.21.15.114:0/915433998 wait complete. 2024-09-16T07:29:09.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- 172.21.15.114:0/3696010670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f00039f0 msgr2=0x7f36f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 --2- 172.21.15.114:0/3696010670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36f00039f0 0x7f36f0003dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009b30 tx=0x7f36fc01d210 comp rx=0 tx=0).stop 2024-09-16T07:29:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3710a00640 1 -- 172.21.15.114:0/3696010670 reap_dead start 2024-09-16T07:29:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- 172.21.15.114:0/3696010670 shutdown_connections 2024-09-16T07:29:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- 172.21.15.114:0/3696010670 >> 172.21.15.114:0/3696010670 conn(0x7f370c0b2240 msgr2=0x7f370c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- 172.21.15.114:0/3696010670 shutdown_connections 2024-09-16T07:29:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- 172.21.15.114:0/3696010670 wait complete. 2024-09-16T07:29:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 Processor -- start 2024-09-16T07:29:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- start start 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36f00039f0 0x7f370c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c15eb80 0x7f370c149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f370c0cf0d0 0x7f370c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f370c0732f0 con 0x7f370c15eb80 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f370c073170 con 0x7f36f00039f0 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3712a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f370c0d0420 con 0x7f370c0cf0d0 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3703400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c15eb80 0x7f370c149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3703400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c15eb80 0x7f370c149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50418/0 (socket says 172.21.15.114:50418) 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.244+0000 7f3703400640 1 -- 172.21.15.114:0/1878650192 learned_addr learned my addr 172.21.15.114:0/1878650192 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f370be00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36f00039f0 0x7f370c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3710a00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f370c0cf0d0 0x7f370c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3703400640 1 -- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f370c0cf0d0 msgr2=0x7f370c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3703400640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f370c0cf0d0 0x7f370c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3703400640 1 -- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36f00039f0 msgr2=0x7f370c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3703400640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36f00039f0 0x7f370c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3703400640 1 -- 172.21.15.114:0/1878650192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c15af50 con 0x7f370c15eb80 2024-09-16T07:29:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3703400640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c15eb80 0x7f370c149f30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f36f40115d0 tx=0x7f36f4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3708c00640 1 -- 172.21.15.114:0/1878650192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4013720 con 0x7f370c15eb80 2024-09-16T07:29:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3708c00640 1 -- 172.21.15.114:0/1878650192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36f40138c0 con 0x7f370c15eb80 2024-09-16T07:29:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370c15bd40 con 0x7f370c15eb80 2024-09-16T07:29:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3708c00640 1 -- 172.21.15.114:0/1878650192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4013cd0 con 0x7f370c15eb80 2024-09-16T07:29:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370c15a470 con 0x7f370c15eb80 2024-09-16T07:29:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370c0d0950 con 0x7f370c15eb80 2024-09-16T07:29:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.248+0000 7f3708c00640 1 -- 172.21.15.114:0/1878650192 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f36f4024440 con 0x7f370c15eb80 2024-09-16T07:29:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.252+0000 7f3708c00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f36e8072ec0 0x7f36e8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.252+0000 7f3708c00640 1 -- 172.21.15.114:0/1878650192 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f36f4097490 con 0x7f370c15eb80 2024-09-16T07:29:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.252+0000 7f370be00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f36e8072ec0 0x7f36e8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.252+0000 7f370be00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f36e8072ec0 0x7f36e8075380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009b30 tx=0x7f36fc019fb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.256+0000 7f3708c00640 1 -- 172.21.15.114:0/1878650192 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f36f4017070 con 0x7f370c15eb80 2024-09-16T07:29:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f370c0704b0 con 0x7f370c15eb80 2024-09-16T07:29:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3708c00640 1 -- 172.21.15.114:0/1878650192 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16777 (secure 0 0 0) 0x7f36f4062080 con 0x7f370c15eb80 2024-09-16T07:29:09.428 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:09.428 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:06.683600+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:03.209188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:04.021718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f36e8072ec0 msgr2=0x7f36e8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f36e8072ec0 0x7f36e8075380 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009b30 tx=0x7f36fc019fb0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c15eb80 msgr2=0x7f370c149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c15eb80 0x7f370c149f30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f36f40115d0 tx=0x7f36f4011a90 comp rx=0 tx=0).stop 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 shutdown_connections 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f36e8072ec0 0x7f36e8075380 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f370c0cf0d0 0x7f370c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f370c15eb80 0x7f370c149f30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 --2- 172.21.15.114:0/1878650192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36f00039f0 0x7f370c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 >> 172.21.15.114:0/1878650192 conn(0x7f370c0b2240 msgr2=0x7f370c073470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 shutdown_connections 2024-09-16T07:29:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.424+0000 7f3712a00640 1 -- 172.21.15.114:0/1878650192 wait complete. 2024-09-16T07:29:09.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:29:09.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.588+0000 7f47d6800640 1 -- 172.21.15.114:0/1191833090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 msgr2=0x7f47b4005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.588+0000 7f47d6800640 1 --2- 172.21.15.114:0/1191833090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 0x7f47b4005220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47d00cdf70 tx=0x7f47c801c730 comp rx=0 tx=0).stop 2024-09-16T07:29:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.588+0000 7f47cfe00640 1 -- 172.21.15.114:0/1191833090 reap_dead start 2024-09-16T07:29:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.588+0000 7f47d6800640 1 -- 172.21.15.114:0/1191833090 shutdown_connections 2024-09-16T07:29:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.588+0000 7f47d6800640 1 -- 172.21.15.114:0/1191833090 >> 172.21.15.114:0/1191833090 conn(0x7f47d00d1dc0 msgr2=0x7f47d00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.588+0000 7f47d6800640 1 -- 172.21.15.114:0/1191833090 shutdown_connections 2024-09-16T07:29:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.588+0000 7f47d6800640 1 -- 172.21.15.114:0/1191833090 wait complete. 2024-09-16T07:29:09.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 Processor -- start 2024-09-16T07:29:09.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 -- start start 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 0x7f47d0158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d01f8710 0x7f47d00b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47d01f4cb0 0x7f47d00c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f47d00ae9b0 con 0x7f47b4004da0 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47d00d2af0 con 0x7f47d01f8710 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47d00aeb30 con 0x7f47d01f4cb0 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 0x7f47d0158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 0x7f47d0158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50438/0 (socket says 172.21.15.114:50438) 2024-09-16T07:29:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 -- 172.21.15.114:0/44676497 learned_addr learned my addr 172.21.15.114:0/44676497 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 -- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47d01f4cb0 msgr2=0x7f47d00c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47d01f4cb0 0x7f47d00c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 -- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d01f8710 msgr2=0x7f47d00b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d01f8710 0x7f47d00b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 -- 172.21.15.114:0/44676497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d00b7350 con 0x7f47b4004da0 2024-09-16T07:29:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47cf400640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 0x7f47d0158f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47c00015b0 tx=0x7f47c00067a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47c7e00640 1 -- 172.21.15.114:0/44676497 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0015070 con 0x7f47b4004da0 2024-09-16T07:29:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47c7e00640 1 -- 172.21.15.114:0/44676497 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47c000fcc0 con 0x7f47b4004da0 2024-09-16T07:29:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47c7e00640 1 -- 172.21.15.114:0/44676497 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0011690 con 0x7f47b4004da0 2024-09-16T07:29:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d00b7630 con 0x7f47b4004da0 2024-09-16T07:29:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.592+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d01f4790 con 0x7f47b4004da0 2024-09-16T07:29:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.596+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d00b7b50 con 0x7f47b4004da0 2024-09-16T07:29:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.596+0000 7f47c7e00640 1 -- 172.21.15.114:0/44676497 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f47c0011830 con 0x7f47b4004da0 2024-09-16T07:29:09.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.596+0000 7f47c7e00640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f47ac072ef0 0x7f47ac0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.596+0000 7f47c7e00640 1 -- 172.21.15.114:0/44676497 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f47c0094e60 con 0x7f47b4004da0 2024-09-16T07:29:09.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.596+0000 7f47c6a00640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f47ac072ef0 0x7f47ac0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.596+0000 7f47c6a00640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f47ac072ef0 0x7f47ac0753b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47b800dab0 tx=0x7f47b800d470 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:09.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.600+0000 7f47c7e00640 1 -- 172.21.15.114:0/44676497 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f47d00b7b50 con 0x7f47b4004da0 2024-09-16T07:29:09.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.768+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47d01f4580 con 0x7f47ac072ef0 2024-09-16T07:29:09.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.776+0000 7f47c7e00640 1 -- 172.21.15.114:0/44676497 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246071 (secure 0 0 0) 0x7f47d01f4580 con 0x7f47ac072ef0 2024-09-16T07:29:09.780 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:09.783 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f47ac072ef0 msgr2=0x7f47ac0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f47ac072ef0 0x7f47ac0753b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47b800dab0 tx=0x7f47b800d470 comp rx=0 tx=0).stop 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 msgr2=0x7f47d0158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 0x7f47d0158f00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47c00015b0 tx=0x7f47c00067a0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 shutdown_connections 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f47ac072ef0 0x7f47ac0753b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47d01f4cb0 0x7f47d00c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d01f8710 0x7f47d00b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 --2- 172.21.15.114:0/44676497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47b4004da0 0x7f47d0158f00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 >> 172.21.15.114:0/44676497 conn(0x7f47d00d1dc0 msgr2=0x7f47d0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 shutdown_connections 2024-09-16T07:29:09.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.780+0000 7f47d6800640 1 -- 172.21.15.114:0/44676497 wait complete. 2024-09-16T07:29:09.802 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-16T07:29:09.004692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219992,"kb_used_data":3756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754728,"statfs":{"total":773094113280,"available":772868841472,"internally_reserved":0,"allocated":3846144,"data_stored":2160609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.345763"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672504+0000","last_change":"2024-09-16T07:29:04.672504+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672504+0000","last_undegraded":"2024-09-16T07:29:04.672504+0000","last_fullsized":"2024-09-16T07:29:04.672504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673233+0000","last_change":"2024-09-16T07:29:04.673233+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673233+0000","last_undegraded":"2024-09-16T07:29:04.673233+0000","last_fullsized":"2024-09-16T07:29:04.673233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670033+0000","last_change":"2024-09-16T07:29:04.670033+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670033+0000","last_undegraded":"2024-09-16T07:29:04.670033+0000","last_fullsized":"2024-09-16T07:29:04.670033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.676318+0000","last_change":"2024-09-16T07:29:04.676318+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.676318+0000","last_undegraded":"2024-09-16T07:29:04.676318+0000","last_fullsized":"2024-09-16T07:29:04.676318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673431+0000","last_change":"2024-09-16T07:29:04.673431+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673431+0000","last_undegraded":"2024-09-16T07:29:04.673431+0000","last_fullsized":"2024-09-16T07:29:04.673431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678191+0000","last_change":"2024-09-16T07:29:04.678191+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678191+0000","last_undegraded":"2024-09-16T07:29:04.678191+0000","last_fullsized":"2024-09-16T07:29:04.678191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.685524+0000","last_change":"2024-09-16T07:29:04.685524+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.685524+0000","last_undegraded":"2024-09-16T07:29:04.685524+0000","last_fullsized":"2024-09-16T07:29:04.685524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673772+0000","last_change":"2024-09-16T07:29:04.673772+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673772+0000","last_undegraded":"2024-09-16T07:29:04.673772+0000","last_fullsized":"2024-09-16T07:29:04.673772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675096+0000","last_change":"2024-09-16T07:29:04.675096+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675096+0000","last_undegraded":"2024-09-16T07:29:04.675096+0000","last_fullsized":"2024-09-16T07:29:04.675096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.681652+0000","last_change":"2024-09-16T07:29:04.681652+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.681652+0000","last_undegraded":"2024-09-16T07:29:04.681652+0000","last_fullsized":"2024-09-16T07:29:04.681652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669774+0000","last_change":"2024-09-16T07:29:04.669774+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669774+0000","last_undegraded":"2024-09-16T07:29:04.669774+0000","last_fullsized":"2024-09-16T07:29:04.669774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672895+0000","last_change":"2024-09-16T07:29:04.672895+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672895+0000","last_undegraded":"2024-09-16T07:29:04.672895+0000","last_fullsized":"2024-09-16T07:29:04.672895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669437+0000","last_change":"2024-09-16T07:29:04.669437+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669437+0000","last_undegraded":"2024-09-16T07:29:04.669437+0000","last_fullsized":"2024-09-16T07:29:04.669437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.680192+0000","last_change":"2024-09-16T07:29:04.680192+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.680192+0000","last_undegraded":"2024-09-16T07:29:04.680192+0000","last_fullsized":"2024-09-16T07:29:04.680192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678625+0000","last_change":"2024-09-16T07:29:04.678625+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678625+0000","last_undegraded":"2024-09-16T07:29:04.678625+0000","last_fullsized":"2024-09-16T07:29:04.678625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672815+0000","last_change":"2024-09-16T07:29:04.672815+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672815+0000","last_undegraded":"2024-09-16T07:29:04.672815+0000","last_fullsized":"2024-09-16T07:29:04.672815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672387+0000","last_change":"2024-09-16T07:29:04.672387+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672387+0000","last_undegraded":"2024-09-16T07:29:04.672387+0000","last_fullsized":"2024-09-16T07:29:04.672387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675057+0000","last_change":"2024-09-16T07:29:04.675057+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675057+0000","last_undegraded":"2024-09-16T07:29:04.675057+0000","last_fullsized":"2024-09-16T07:29:04.675057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669090+0000","last_change":"2024-09-16T07:29:04.669090+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669090+0000","last_undegraded":"2024-09-16T07:29:04.669090+0000","last_fullsized":"2024-09-16T07:29:04.669090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672995+0000","last_change":"2024-09-16T07:29:04.672995+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672995+0000","last_undegraded":"2024-09-16T07:29:04.672995+0000","last_fullsized":"2024-09-16T07:29:04.672995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.668637+0000","last_change":"2024-09-16T07:29:04.668637+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.668637+0000","last_undegraded":"2024-09-16T07:29:04.668637+0000","last_fullsized":"2024-09-16T07:29:04.668637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678265+0000","last_change":"2024-09-16T07:29:04.678265+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678265+0000","last_undegraded":"2024-09-16T07:29:04.678265+0000","last_fullsized":"2024-09-16T07:29:04.678265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672293+0000","last_change":"2024-09-16T07:29:04.672293+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672293+0000","last_undegraded":"2024-09-16T07:29:04.672293+0000","last_fullsized":"2024-09-16T07:29:04.672293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678924+0000","last_change":"2024-09-16T07:29:04.678924+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678924+0000","last_undegraded":"2024-09-16T07:29:04.678924+0000","last_fullsized":"2024-09-16T07:29:04.678924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669239+0000","last_change":"2024-09-16T07:29:04.669239+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669239+0000","last_undegraded":"2024-09-16T07:29:04.669239+0000","last_fullsized":"2024-09-16T07:29:04.669239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.674613+0000","last_change":"2024-09-16T07:29:04.674613+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.674613+0000","last_undegraded":"2024-09-16T07:29:04.674613+0000","last_fullsized":"2024-09-16T07:29:04.674613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.681817+0000","last_change":"2024-09-16T07:29:04.681817+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.681817+0000","last_undegraded":"2024-09-16T07:29:04.681817+0000","last_fullsized":"2024-09-16T07:29:04.681817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673382+0000","last_change":"2024-09-16T07:29:04.673382+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673382+0000","last_undegraded":"2024-09-16T07:29:04.673382+0000","last_fullsized":"2024-09-16T07:29:04.673382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.685114+0000","last_change":"2024-09-16T07:29:04.685114+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.685114+0000","last_undegraded":"2024-09-16T07:29:04.685114+0000","last_fullsized":"2024-09-16T07:29:04.685114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675055+0000","last_change":"2024-09-16T07:29:04.675055+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675055+0000","last_undegraded":"2024-09-16T07:29:04.675055+0000","last_fullsized":"2024-09-16T07:29:04.675055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685951+0000","last_change":"2024-09-16T07:29:04.680366+0000","last_active":"2024-09-16T07:29:04.685951+0000","last_peered":"2024-09-16T07:29:04.685951+0000","last_clean":"2024-09-16T07:29:04.685951+0000","last_became_active":"2024-09-16T07:29:04.680082+0000","last_became_peered":"2024-09-16T07:29:04.680082+0000","last_unstale":"2024-09-16T07:29:04.685951+0000","last_undegraded":"2024-09-16T07:29:04.685951+0000","last_fullsized":"2024-09-16T07:29:04.685951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671994+0000","last_change":"2024-09-16T07:29:04.671994+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671994+0000","last_undegraded":"2024-09-16T07:29:04.671994+0000","last_fullsized":"2024-09-16T07:29:04.671994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692283+0000","last_change":"2024-09-16T07:29:04.685794+0000","last_active":"2024-09-16T07:29:04.692283+0000","last_peered":"2024-09-16T07:29:04.692283+0000","last_clean":"2024-09-16T07:29:04.692283+0000","last_became_active":"2024-09-16T07:29:04.685459+0000","last_became_peered":"2024-09-16T07:29:04.685459+0000","last_unstale":"2024-09-16T07:29:04.692283+0000","last_undegraded":"2024-09-16T07:29:04.692283+0000","last_fullsized":"2024-09-16T07:29:04.692283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:23:57.719597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675420+0000","last_change":"2024-09-16T07:29:04.675420+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675420+0000","last_undegraded":"2024-09-16T07:29:04.675420+0000","last_fullsized":"2024-09-16T07:29:04.675420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.695133+0000","last_change":"2024-09-16T07:29:04.689645+0000","last_active":"2024-09-16T07:29:04.695133+0000","last_peered":"2024-09-16T07:29:04.695133+0000","last_clean":"2024-09-16T07:29:04.695133+0000","last_became_active":"2024-09-16T07:29:04.689326+0000","last_became_peered":"2024-09-16T07:29:04.689326+0000","last_unstale":"2024-09-16T07:29:04.695133+0000","last_undegraded":"2024-09-16T07:29:04.695133+0000","last_fullsized":"2024-09-16T07:29:04.695133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:27.365752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678265+0000","last_change":"2024-09-16T07:29:04.678265+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678265+0000","last_undegraded":"2024-09-16T07:29:04.678265+0000","last_fullsized":"2024-09-16T07:29:04.678265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-16T07:29:03.665077+0000","last_change":"2024-09-16T07:29:03.665077+0000","last_active":"2024-09-16T07:29:03.647610+0000","last_peered":"2024-09-16T07:29:03.647610+0000","last_clean":"2024-09-16T07:29:03.647610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:03.665077+0000","last_undegraded":"2024-09-16T07:29:03.665077+0000","last_fullsized":"2024-09-16T07:29:03.665077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.677120+0000","last_change":"2024-09-16T07:29:04.677120+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.677120+0000","last_undegraded":"2024-09-16T07:29:04.677120+0000","last_fullsized":"2024-09-16T07:29:04.677120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694292+0000","last_change":"2024-09-16T07:29:04.693386+0000","last_active":"2024-09-16T07:29:04.694292+0000","last_peered":"2024-09-16T07:29:04.694292+0000","last_clean":"2024-09-16T07:29:04.694292+0000","last_became_active":"2024-09-16T07:29:04.693194+0000","last_became_peered":"2024-09-16T07:29:04.693194+0000","last_unstale":"2024-09-16T07:29:04.694292+0000","last_undegraded":"2024-09-16T07:29:04.694292+0000","last_fullsized":"2024-09-16T07:29:04.694292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:15.426280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.668249+0000","last_change":"2024-09-16T07:29:04.668249+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.668249+0000","last_undegraded":"2024-09-16T07:29:04.668249+0000","last_fullsized":"2024-09-16T07:29:04.668249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685130+0000","last_change":"2024-09-16T07:29:04.680986+0000","last_active":"2024-09-16T07:29:04.685130+0000","last_peered":"2024-09-16T07:29:04.685130+0000","last_clean":"2024-09-16T07:29:04.685130+0000","last_became_active":"2024-09-16T07:29:04.680600+0000","last_became_peered":"2024-09-16T07:29:04.680600+0000","last_unstale":"2024-09-16T07:29:04.685130+0000","last_undegraded":"2024-09-16T07:29:04.685130+0000","last_fullsized":"2024-09-16T07:29:04.685130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:07.588892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669129+0000","last_change":"2024-09-16T07:29:04.669129+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669129+0000","last_undegraded":"2024-09-16T07:29:04.669129+0000","last_fullsized":"2024-09-16T07:29:04.669129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690332+0000","last_change":"2024-09-16T07:29:04.681541+0000","last_active":"2024-09-16T07:29:04.690332+0000","last_peered":"2024-09-16T07:29:04.690332+0000","last_clean":"2024-09-16T07:29:04.690332+0000","last_became_active":"2024-09-16T07:29:04.680791+0000","last_became_peered":"2024-09-16T07:29:04.680791+0000","last_unstale":"2024-09-16T07:29:04.690332+0000","last_undegraded":"2024-09-16T07:29:04.690332+0000","last_fullsized":"2024-09-16T07:29:04.690332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670019+0000","last_change":"2024-09-16T07:29:04.670019+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670019+0000","last_undegraded":"2024-09-16T07:29:04.670019+0000","last_fullsized":"2024-09-16T07:29:04.670019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.683973+0000","last_change":"2024-09-16T07:29:04.677432+0000","last_active":"2024-09-16T07:29:04.683973+0000","last_peered":"2024-09-16T07:29:04.683973+0000","last_clean":"2024-09-16T07:29:04.683973+0000","last_became_active":"2024-09-16T07:29:04.677134+0000","last_became_peered":"2024-09-16T07:29:04.677134+0000","last_unstale":"2024-09-16T07:29:04.683973+0000","last_undegraded":"2024-09-16T07:29:04.683973+0000","last_fullsized":"2024-09-16T07:29:04.683973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:32:22.789804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671856+0000","last_change":"2024-09-16T07:29:04.671856+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671856+0000","last_undegraded":"2024-09-16T07:29:04.671856+0000","last_fullsized":"2024-09-16T07:29:04.671856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691646+0000","last_change":"2024-09-16T07:29:04.682861+0000","last_active":"2024-09-16T07:29:04.691646+0000","last_peered":"2024-09-16T07:29:04.691646+0000","last_clean":"2024-09-16T07:29:04.691646+0000","last_became_active":"2024-09-16T07:29:04.682605+0000","last_became_peered":"2024-09-16T07:29:04.682605+0000","last_unstale":"2024-09-16T07:29:04.691646+0000","last_undegraded":"2024-09-16T07:29:04.691646+0000","last_fullsized":"2024-09-16T07:29:04.691646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673791+0000","last_change":"2024-09-16T07:29:04.673791+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673791+0000","last_undegraded":"2024-09-16T07:29:04.673791+0000","last_fullsized":"2024-09-16T07:29:04.673791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690560+0000","last_change":"2024-09-16T07:29:04.682290+0000","last_active":"2024-09-16T07:29:04.690560+0000","last_peered":"2024-09-16T07:29:04.690560+0000","last_clean":"2024-09-16T07:29:04.690560+0000","last_became_active":"2024-09-16T07:29:04.681995+0000","last_became_peered":"2024-09-16T07:29:04.681995+0000","last_unstale":"2024-09-16T07:29:04.690560+0000","last_undegraded":"2024-09-16T07:29:04.690560+0000","last_fullsized":"2024-09-16T07:29:04.690560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.608204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672673+0000","last_change":"2024-09-16T07:29:04.672673+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672673+0000","last_undegraded":"2024-09-16T07:29:04.672673+0000","last_fullsized":"2024-09-16T07:29:04.672673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694039+0000","last_change":"2024-09-16T07:29:04.688689+0000","last_active":"2024-09-16T07:29:04.694039+0000","last_peered":"2024-09-16T07:29:04.694039+0000","last_clean":"2024-09-16T07:29:04.694039+0000","last_became_active":"2024-09-16T07:29:04.687010+0000","last_became_peered":"2024-09-16T07:29:04.687010+0000","last_unstale":"2024-09-16T07:29:04.694039+0000","last_undegraded":"2024-09-16T07:29:04.694039+0000","last_fullsized":"2024-09-16T07:29:04.694039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:25:19.296260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670459+0000","last_change":"2024-09-16T07:29:04.670459+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670459+0000","last_undegraded":"2024-09-16T07:29:04.670459+0000","last_fullsized":"2024-09-16T07:29:04.670459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691644+0000","last_change":"2024-09-16T07:29:04.687313+0000","last_active":"2024-09-16T07:29:04.691644+0000","last_peered":"2024-09-16T07:29:04.691644+0000","last_clean":"2024-09-16T07:29:04.691644+0000","last_became_active":"2024-09-16T07:29:04.686929+0000","last_became_peered":"2024-09-16T07:29:04.686929+0000","last_unstale":"2024-09-16T07:29:04.691644+0000","last_undegraded":"2024-09-16T07:29:04.691644+0000","last_fullsized":"2024-09-16T07:29:04.691644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:08.598702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678504+0000","last_change":"2024-09-16T07:29:04.678504+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678504+0000","last_undegraded":"2024-09-16T07:29:04.678504+0000","last_fullsized":"2024-09-16T07:29:04.678504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690931+0000","last_change":"2024-09-16T07:29:04.687978+0000","last_active":"2024-09-16T07:29:04.690931+0000","last_peered":"2024-09-16T07:29:04.690931+0000","last_clean":"2024-09-16T07:29:04.690931+0000","last_became_active":"2024-09-16T07:29:04.687570+0000","last_became_peered":"2024-09-16T07:29:04.687570+0000","last_unstale":"2024-09-16T07:29:04.690931+0000","last_undegraded":"2024-09-16T07:29:04.690931+0000","last_fullsized":"2024-09-16T07:29:04.690931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:15.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672148+0000","last_change":"2024-09-16T07:29:04.672148+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672148+0000","last_undegraded":"2024-09-16T07:29:04.672148+0000","last_fullsized":"2024-09-16T07:29:04.672148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690042+0000","last_change":"2024-09-16T07:29:04.683742+0000","last_active":"2024-09-16T07:29:04.690042+0000","last_peered":"2024-09-16T07:29:04.690042+0000","last_clean":"2024-09-16T07:29:04.690042+0000","last_became_active":"2024-09-16T07:29:04.683172+0000","last_became_peered":"2024-09-16T07:29:04.683172+0000","last_unstale":"2024-09-16T07:29:04.690042+0000","last_undegraded":"2024-09-16T07:29:04.690042+0000","last_fullsized":"2024-09-16T07:29:04.690042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.682375+0000","last_change":"2024-09-16T07:29:04.682375+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.682375+0000","last_undegraded":"2024-09-16T07:29:04.682375+0000","last_fullsized":"2024-09-16T07:29:04.682375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691563+0000","last_change":"2024-09-16T07:29:04.684134+0000","last_active":"2024-09-16T07:29:04.691563+0000","last_peered":"2024-09-16T07:29:04.691563+0000","last_clean":"2024-09-16T07:29:04.691563+0000","last_became_active":"2024-09-16T07:29:04.683409+0000","last_became_peered":"2024-09-16T07:29:04.683409+0000","last_unstale":"2024-09-16T07:29:04.691563+0000","last_undegraded":"2024-09-16T07:29:04.691563+0000","last_fullsized":"2024-09-16T07:29:04.691563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:41.134621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670878+0000","last_change":"2024-09-16T07:29:04.670878+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670878+0000","last_undegraded":"2024-09-16T07:29:04.670878+0000","last_fullsized":"2024-09-16T07:29:04.670878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694623+0000","last_change":"2024-09-16T07:29:04.688866+0000","last_active":"2024-09-16T07:29:04.694623+0000","last_peered":"2024-09-16T07:29:04.694623+0000","last_clean":"2024-09-16T07:29:04.694623+0000","last_became_active":"2024-09-16T07:29:04.688617+0000","last_became_peered":"2024-09-16T07:29:04.688617+0000","last_unstale":"2024-09-16T07:29:04.694623+0000","last_undegraded":"2024-09-16T07:29:04.694623+0000","last_fullsized":"2024-09-16T07:29:04.694623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:58.033566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673245+0000","last_change":"2024-09-16T07:29:04.673245+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673245+0000","last_undegraded":"2024-09-16T07:29:04.673245+0000","last_fullsized":"2024-09-16T07:29:04.673245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690228+0000","last_change":"2024-09-16T07:29:04.684997+0000","last_active":"2024-09-16T07:29:04.690228+0000","last_peered":"2024-09-16T07:29:04.690228+0000","last_clean":"2024-09-16T07:29:04.690228+0000","last_became_active":"2024-09-16T07:29:04.684520+0000","last_became_peered":"2024-09-16T07:29:04.684520+0000","last_unstale":"2024-09-16T07:29:04.690228+0000","last_undegraded":"2024-09-16T07:29:04.690228+0000","last_fullsized":"2024-09-16T07:29:04.690228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671321+0000","last_change":"2024-09-16T07:29:04.671321+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671321+0000","last_undegraded":"2024-09-16T07:29:04.671321+0000","last_fullsized":"2024-09-16T07:29:04.671321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693818+0000","last_change":"2024-09-16T07:29:04.688727+0000","last_active":"2024-09-16T07:29:04.693818+0000","last_peered":"2024-09-16T07:29:04.693818+0000","last_clean":"2024-09-16T07:29:04.693818+0000","last_became_active":"2024-09-16T07:29:04.687576+0000","last_became_peered":"2024-09-16T07:29:04.687576+0000","last_unstale":"2024-09-16T07:29:04.693818+0000","last_undegraded":"2024-09-16T07:29:04.693818+0000","last_fullsized":"2024-09-16T07:29:04.693818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:36.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675900+0000","last_change":"2024-09-16T07:29:04.675900+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675900+0000","last_undegraded":"2024-09-16T07:29:04.675900+0000","last_fullsized":"2024-09-16T07:29:04.675900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693734+0000","last_change":"2024-09-16T07:29:04.688933+0000","last_active":"2024-09-16T07:29:04.693734+0000","last_peered":"2024-09-16T07:29:04.693734+0000","last_clean":"2024-09-16T07:29:04.693734+0000","last_became_active":"2024-09-16T07:29:04.688568+0000","last_became_peered":"2024-09-16T07:29:04.688568+0000","last_unstale":"2024-09-16T07:29:04.693734+0000","last_undegraded":"2024-09-16T07:29:04.693734+0000","last_fullsized":"2024-09-16T07:29:04.693734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:24.910304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690886+0000","last_change":"2024-09-16T07:29:04.686063+0000","last_active":"2024-09-16T07:29:04.690886+0000","last_peered":"2024-09-16T07:29:04.690886+0000","last_clean":"2024-09-16T07:29:04.690886+0000","last_became_active":"2024-09-16T07:29:04.685265+0000","last_became_peered":"2024-09-16T07:29:04.685265+0000","last_unstale":"2024-09-16T07:29:04.690886+0000","last_undegraded":"2024-09-16T07:29:04.690886+0000","last_fullsized":"2024-09-16T07:29:04.690886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:56:33.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692403+0000","last_change":"2024-09-16T07:29:04.688075+0000","last_active":"2024-09-16T07:29:04.692403+0000","last_peered":"2024-09-16T07:29:04.692403+0000","last_clean":"2024-09-16T07:29:04.692403+0000","last_became_active":"2024-09-16T07:29:04.687842+0000","last_became_peered":"2024-09-16T07:29:04.687842+0000","last_unstale":"2024-09-16T07:29:04.692403+0000","last_undegraded":"2024-09-16T07:29:04.692403+0000","last_fullsized":"2024-09-16T07:29:04.692403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:18.498467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694267+0000","last_change":"2024-09-16T07:29:04.692249+0000","last_active":"2024-09-16T07:29:04.694267+0000","last_peered":"2024-09-16T07:29:04.694267+0000","last_clean":"2024-09-16T07:29:04.694267+0000","last_became_active":"2024-09-16T07:29:04.691889+0000","last_became_peered":"2024-09-16T07:29:04.691889+0000","last_unstale":"2024-09-16T07:29:04.694267+0000","last_undegraded":"2024-09-16T07:29:04.694267+0000","last_fullsized":"2024-09-16T07:29:04.694267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693863+0000","last_change":"2024-09-16T07:29:04.689801+0000","last_active":"2024-09-16T07:29:04.693863+0000","last_peered":"2024-09-16T07:29:04.693863+0000","last_clean":"2024-09-16T07:29:04.693863+0000","last_became_active":"2024-09-16T07:29:04.689407+0000","last_became_peered":"2024-09-16T07:29:04.689407+0000","last_unstale":"2024-09-16T07:29:04.693863+0000","last_undegraded":"2024-09-16T07:29:04.693863+0000","last_fullsized":"2024-09-16T07:29:04.693863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:00.875663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.679001+0000","last_change":"2024-09-16T07:29:04.679001+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.679001+0000","last_undegraded":"2024-09-16T07:29:04.679001+0000","last_fullsized":"2024-09-16T07:29:04.679001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694168+0000","last_change":"2024-09-16T07:29:04.689517+0000","last_active":"2024-09-16T07:29:04.694168+0000","last_peered":"2024-09-16T07:29:04.694168+0000","last_clean":"2024-09-16T07:29:04.694168+0000","last_became_active":"2024-09-16T07:29:04.689245+0000","last_became_peered":"2024-09-16T07:29:04.689245+0000","last_unstale":"2024-09-16T07:29:04.694168+0000","last_undegraded":"2024-09-16T07:29:04.694168+0000","last_fullsized":"2024-09-16T07:29:04.694168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:24.593805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690176+0000","last_change":"2024-09-16T07:29:04.680088+0000","last_active":"2024-09-16T07:29:04.690176+0000","last_peered":"2024-09-16T07:29:04.690176+0000","last_clean":"2024-09-16T07:29:04.690176+0000","last_became_active":"2024-09-16T07:29:04.679832+0000","last_became_peered":"2024-09-16T07:29:04.679832+0000","last_unstale":"2024-09-16T07:29:04.690176+0000","last_undegraded":"2024-09-16T07:29:04.690176+0000","last_fullsized":"2024-09-16T07:29:04.690176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670954+0000","last_change":"2024-09-16T07:29:04.670954+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670954+0000","last_undegraded":"2024-09-16T07:29:04.670954+0000","last_fullsized":"2024-09-16T07:29:04.670954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.683388+0000","last_change":"2024-09-16T07:29:04.679959+0000","last_active":"2024-09-16T07:29:04.683388+0000","last_peered":"2024-09-16T07:29:04.683388+0000","last_clean":"2024-09-16T07:29:04.683388+0000","last_became_active":"2024-09-16T07:29:04.679699+0000","last_became_peered":"2024-09-16T07:29:04.679699+0000","last_unstale":"2024-09-16T07:29:04.683388+0000","last_undegraded":"2024-09-16T07:29:04.683388+0000","last_fullsized":"2024-09-16T07:29:04.683388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:46.134632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675338+0000","last_change":"2024-09-16T07:29:04.675338+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675338+0000","last_undegraded":"2024-09-16T07:29:04.675338+0000","last_fullsized":"2024-09-16T07:29:04.675338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.689989+0000","last_change":"2024-09-16T07:29:04.685192+0000","last_active":"2024-09-16T07:29:04.689989+0000","last_peered":"2024-09-16T07:29:04.689989+0000","last_clean":"2024-09-16T07:29:04.689989+0000","last_became_active":"2024-09-16T07:29:04.684971+0000","last_became_peered":"2024-09-16T07:29:04.684971+0000","last_unstale":"2024-09-16T07:29:04.689989+0000","last_undegraded":"2024-09-16T07:29:04.689989+0000","last_fullsized":"2024-09-16T07:29:04.689989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671448+0000","last_change":"2024-09-16T07:29:04.671448+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671448+0000","last_undegraded":"2024-09-16T07:29:04.671448+0000","last_fullsized":"2024-09-16T07:29:04.671448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692429+0000","last_change":"2024-09-16T07:29:04.688174+0000","last_active":"2024-09-16T07:29:04.692429+0000","last_peered":"2024-09-16T07:29:04.692429+0000","last_clean":"2024-09-16T07:29:04.692429+0000","last_became_active":"2024-09-16T07:29:04.687913+0000","last_became_peered":"2024-09-16T07:29:04.687913+0000","last_unstale":"2024-09-16T07:29:04.692429+0000","last_undegraded":"2024-09-16T07:29:04.692429+0000","last_fullsized":"2024-09-16T07:29:04.692429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:27:22.965785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.674204+0000","last_change":"2024-09-16T07:29:04.674204+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.674204+0000","last_undegraded":"2024-09-16T07:29:04.674204+0000","last_fullsized":"2024-09-16T07:29:04.674204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690016+0000","last_change":"2024-09-16T07:29:04.683463+0000","last_active":"2024-09-16T07:29:04.690016+0000","last_peered":"2024-09-16T07:29:04.690016+0000","last_clean":"2024-09-16T07:29:04.690016+0000","last_became_active":"2024-09-16T07:29:04.682288+0000","last_became_peered":"2024-09-16T07:29:04.682288+0000","last_unstale":"2024-09-16T07:29:04.690016+0000","last_undegraded":"2024-09-16T07:29:04.690016+0000","last_fullsized":"2024-09-16T07:29:04.690016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672318+0000","last_change":"2024-09-16T07:29:04.672318+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672318+0000","last_undegraded":"2024-09-16T07:29:04.672318+0000","last_fullsized":"2024-09-16T07:29:04.672318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.688386+0000","last_change":"2024-09-16T07:29:04.682025+0000","last_active":"2024-09-16T07:29:04.688386+0000","last_peered":"2024-09-16T07:29:04.688386+0000","last_clean":"2024-09-16T07:29:04.688386+0000","last_became_active":"2024-09-16T07:29:04.681723+0000","last_became_peered":"2024-09-16T07:29:04.681723+0000","last_unstale":"2024-09-16T07:29:04.688386+0000","last_undegraded":"2024-09-16T07:29:04.688386+0000","last_fullsized":"2024-09-16T07:29:04.688386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:15.463329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669857+0000","last_change":"2024-09-16T07:29:04.669857+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669857+0000","last_undegraded":"2024-09-16T07:29:04.669857+0000","last_fullsized":"2024-09-16T07:29:04.669857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692245+0000","last_change":"2024-09-16T07:29:04.688723+0000","last_active":"2024-09-16T07:29:04.692245+0000","last_peered":"2024-09-16T07:29:04.692245+0000","last_clean":"2024-09-16T07:29:04.692245+0000","last_became_active":"2024-09-16T07:29:04.688446+0000","last_became_peered":"2024-09-16T07:29:04.688446+0000","last_unstale":"2024-09-16T07:29:04.692245+0000","last_undegraded":"2024-09-16T07:29:04.692245+0000","last_fullsized":"2024-09-16T07:29:04.692245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:37.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.677118+0000","last_change":"2024-09-16T07:29:04.677118+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.677118+0000","last_undegraded":"2024-09-16T07:29:04.677118+0000","last_fullsized":"2024-09-16T07:29:04.677118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.689769+0000","last_change":"2024-09-16T07:29:04.684672+0000","last_active":"2024-09-16T07:29:04.689769+0000","last_peered":"2024-09-16T07:29:04.689769+0000","last_clean":"2024-09-16T07:29:04.689769+0000","last_became_active":"2024-09-16T07:29:04.684435+0000","last_became_peered":"2024-09-16T07:29:04.684435+0000","last_unstale":"2024-09-16T07:29:04.689769+0000","last_undegraded":"2024-09-16T07:29:04.689769+0000","last_fullsized":"2024-09-16T07:29:04.689769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685746+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:04.685746+0000","last_peered":"2024-09-16T07:29:04.685746+0000","last_clean":"2024-09-16T07:29:04.685746+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:04.685746+0000","last_undegraded":"2024-09-16T07:29:04.685746+0000","last_fullsized":"2024-09-16T07:29:04.685746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":716769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":710502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:09.807 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- 172.21.15.114:0/860499873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6480160400 msgr2=0x7f6480160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 --2- 172.21.15.114:0/860499873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6480160400 0x7f6480160830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6480073ff0 tx=0x7f647801cc90 comp rx=0 tx=0).stop 2024-09-16T07:29:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- 172.21.15.114:0/860499873 shutdown_connections 2024-09-16T07:29:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 --2- 172.21.15.114:0/860499873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6480160400 0x7f6480160830 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 --2- 172.21.15.114:0/860499873 >> v2:172.21.15.149:3300/0 conn(0x7f64800b2d00 0x7f648015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 --2- 172.21.15.114:0/860499873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64800cfe80 0x7f64800d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- 172.21.15.114:0/860499873 >> 172.21.15.114:0/860499873 conn(0x7f64800d1e40 msgr2=0x7f64800d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- 172.21.15.114:0/860499873 shutdown_connections 2024-09-16T07:29:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- 172.21.15.114:0/860499873 wait complete. 2024-09-16T07:29:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 Processor -- start 2024-09-16T07:29:09.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- start start 2024-09-16T07:29:09.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64800b2d00 0x7f64800b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64800cfe80 0x7f64800b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6480160400 0x7f64800b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f64800b2700 con 0x7f64800cfe80 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f64800b2580 con 0x7f64800b2d00 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6486000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64800b2880 con 0x7f6480160400 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64800cfe80 0x7f64800b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64800cfe80 0x7f64800b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50454/0 (socket says 172.21.15.114:50454) 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 -- 172.21.15.114:0/2008174321 learned_addr learned my addr 172.21.15.114:0/2008174321 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f647f400640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64800b2d00 0x7f64800b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f647fe00640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6480160400 0x7f64800b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 -- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6480160400 msgr2=0x7f64800b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6480160400 0x7f64800b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 -- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64800b2d00 msgr2=0x7f64800b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64800b2d00 0x7f64800b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f6476a00640 1 -- 172.21.15.114:0/2008174321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64800b59c0 con 0x7f64800cfe80 2024-09-16T07:29:09.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f647f400640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64800b2d00 0x7f64800b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:09.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.984+0000 7f647fe00640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6480160400 0x7f64800b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:09.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6476a00640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64800cfe80 0x7f64800b4c70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f646800e9f0 tx=0x7f646800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:09.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6477e00640 1 -- 172.21.15.114:0/2008174321 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646800ccc0 con 0x7f64800cfe80 2024-09-16T07:29:09.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6477e00640 1 -- 172.21.15.114:0/2008174321 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6468010430 con 0x7f64800cfe80 2024-09-16T07:29:09.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6477e00640 1 -- 172.21.15.114:0/2008174321 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6468010840 con 0x7f64800cfe80 2024-09-16T07:29:09.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648006dd30 con 0x7f64800cfe80 2024-09-16T07:29:09.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64800b7740 con 0x7f64800cfe80 2024-09-16T07:29:09.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64800d0260 con 0x7f64800cfe80 2024-09-16T07:29:09.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6477e00640 1 -- 172.21.15.114:0/2008174321 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f64680109e0 con 0x7f64800cfe80 2024-09-16T07:29:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6477e00640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f645c072ec0 0x7f645c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.988+0000 7f6477e00640 1 -- 172.21.15.114:0/2008174321 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6468094aa0 con 0x7f64800cfe80 2024-09-16T07:29:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.992+0000 7f647f400640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f645c072ec0 0x7f645c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.992+0000 7f647f400640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f645c072ec0 0x7f645c075380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6470009c30 tx=0x7f64700091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:09.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:09.992+0000 7f6477e00640 1 -- 172.21.15.114:0/2008174321 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6468096e20 con 0x7f64800cfe80 2024-09-16T07:29:10.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.160+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64800b03f0 con 0x7f645c072ec0 2024-09-16T07:29:10.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.168+0000 7f6477e00640 1 -- 172.21.15.114:0/2008174321 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246071 (secure 0 0 0) 0x7f64800b03f0 con 0x7f645c072ec0 2024-09-16T07:29:10.175 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f645c072ec0 msgr2=0x7f645c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f645c072ec0 0x7f645c075380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6470009c30 tx=0x7f64700091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64800cfe80 msgr2=0x7f64800b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64800cfe80 0x7f64800b4c70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f646800e9f0 tx=0x7f646800eeb0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 shutdown_connections 2024-09-16T07:29:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f645c072ec0 0x7f645c075380 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6480160400 0x7f64800b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64800cfe80 0x7f64800b4c70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 --2- 172.21.15.114:0/2008174321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f64800b2d00 0x7f64800b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 >> 172.21.15.114:0/2008174321 conn(0x7f64800d1e40 msgr2=0x7f64800b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 shutdown_connections 2024-09-16T07:29:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.172+0000 7f6486000640 1 -- 172.21.15.114:0/2008174321 wait complete. 2024-09-16T07:29:10.194 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-16T07:29:09.004692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219992,"kb_used_data":3756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754728,"statfs":{"total":773094113280,"available":772868841472,"internally_reserved":0,"allocated":3846144,"data_stored":2160609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.345763"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672504+0000","last_change":"2024-09-16T07:29:04.672504+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672504+0000","last_undegraded":"2024-09-16T07:29:04.672504+0000","last_fullsized":"2024-09-16T07:29:04.672504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673233+0000","last_change":"2024-09-16T07:29:04.673233+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673233+0000","last_undegraded":"2024-09-16T07:29:04.673233+0000","last_fullsized":"2024-09-16T07:29:04.673233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670033+0000","last_change":"2024-09-16T07:29:04.670033+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670033+0000","last_undegraded":"2024-09-16T07:29:04.670033+0000","last_fullsized":"2024-09-16T07:29:04.670033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.676318+0000","last_change":"2024-09-16T07:29:04.676318+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.676318+0000","last_undegraded":"2024-09-16T07:29:04.676318+0000","last_fullsized":"2024-09-16T07:29:04.676318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673431+0000","last_change":"2024-09-16T07:29:04.673431+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673431+0000","last_undegraded":"2024-09-16T07:29:04.673431+0000","last_fullsized":"2024-09-16T07:29:04.673431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678191+0000","last_change":"2024-09-16T07:29:04.678191+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678191+0000","last_undegraded":"2024-09-16T07:29:04.678191+0000","last_fullsized":"2024-09-16T07:29:04.678191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.685524+0000","last_change":"2024-09-16T07:29:04.685524+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.685524+0000","last_undegraded":"2024-09-16T07:29:04.685524+0000","last_fullsized":"2024-09-16T07:29:04.685524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673772+0000","last_change":"2024-09-16T07:29:04.673772+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673772+0000","last_undegraded":"2024-09-16T07:29:04.673772+0000","last_fullsized":"2024-09-16T07:29:04.673772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675096+0000","last_change":"2024-09-16T07:29:04.675096+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675096+0000","last_undegraded":"2024-09-16T07:29:04.675096+0000","last_fullsized":"2024-09-16T07:29:04.675096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.681652+0000","last_change":"2024-09-16T07:29:04.681652+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.681652+0000","last_undegraded":"2024-09-16T07:29:04.681652+0000","last_fullsized":"2024-09-16T07:29:04.681652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669774+0000","last_change":"2024-09-16T07:29:04.669774+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669774+0000","last_undegraded":"2024-09-16T07:29:04.669774+0000","last_fullsized":"2024-09-16T07:29:04.669774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672895+0000","last_change":"2024-09-16T07:29:04.672895+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672895+0000","last_undegraded":"2024-09-16T07:29:04.672895+0000","last_fullsized":"2024-09-16T07:29:04.672895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669437+0000","last_change":"2024-09-16T07:29:04.669437+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669437+0000","last_undegraded":"2024-09-16T07:29:04.669437+0000","last_fullsized":"2024-09-16T07:29:04.669437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.680192+0000","last_change":"2024-09-16T07:29:04.680192+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.680192+0000","last_undegraded":"2024-09-16T07:29:04.680192+0000","last_fullsized":"2024-09-16T07:29:04.680192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678625+0000","last_change":"2024-09-16T07:29:04.678625+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678625+0000","last_undegraded":"2024-09-16T07:29:04.678625+0000","last_fullsized":"2024-09-16T07:29:04.678625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672815+0000","last_change":"2024-09-16T07:29:04.672815+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672815+0000","last_undegraded":"2024-09-16T07:29:04.672815+0000","last_fullsized":"2024-09-16T07:29:04.672815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672387+0000","last_change":"2024-09-16T07:29:04.672387+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672387+0000","last_undegraded":"2024-09-16T07:29:04.672387+0000","last_fullsized":"2024-09-16T07:29:04.672387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675057+0000","last_change":"2024-09-16T07:29:04.675057+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675057+0000","last_undegraded":"2024-09-16T07:29:04.675057+0000","last_fullsized":"2024-09-16T07:29:04.675057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669090+0000","last_change":"2024-09-16T07:29:04.669090+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669090+0000","last_undegraded":"2024-09-16T07:29:04.669090+0000","last_fullsized":"2024-09-16T07:29:04.669090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672995+0000","last_change":"2024-09-16T07:29:04.672995+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672995+0000","last_undegraded":"2024-09-16T07:29:04.672995+0000","last_fullsized":"2024-09-16T07:29:04.672995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.668637+0000","last_change":"2024-09-16T07:29:04.668637+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.668637+0000","last_undegraded":"2024-09-16T07:29:04.668637+0000","last_fullsized":"2024-09-16T07:29:04.668637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678265+0000","last_change":"2024-09-16T07:29:04.678265+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678265+0000","last_undegraded":"2024-09-16T07:29:04.678265+0000","last_fullsized":"2024-09-16T07:29:04.678265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672293+0000","last_change":"2024-09-16T07:29:04.672293+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672293+0000","last_undegraded":"2024-09-16T07:29:04.672293+0000","last_fullsized":"2024-09-16T07:29:04.672293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678924+0000","last_change":"2024-09-16T07:29:04.678924+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678924+0000","last_undegraded":"2024-09-16T07:29:04.678924+0000","last_fullsized":"2024-09-16T07:29:04.678924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669239+0000","last_change":"2024-09-16T07:29:04.669239+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669239+0000","last_undegraded":"2024-09-16T07:29:04.669239+0000","last_fullsized":"2024-09-16T07:29:04.669239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.674613+0000","last_change":"2024-09-16T07:29:04.674613+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.674613+0000","last_undegraded":"2024-09-16T07:29:04.674613+0000","last_fullsized":"2024-09-16T07:29:04.674613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.681817+0000","last_change":"2024-09-16T07:29:04.681817+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.681817+0000","last_undegraded":"2024-09-16T07:29:04.681817+0000","last_fullsized":"2024-09-16T07:29:04.681817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673382+0000","last_change":"2024-09-16T07:29:04.673382+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673382+0000","last_undegraded":"2024-09-16T07:29:04.673382+0000","last_fullsized":"2024-09-16T07:29:04.673382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.685114+0000","last_change":"2024-09-16T07:29:04.685114+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.685114+0000","last_undegraded":"2024-09-16T07:29:04.685114+0000","last_fullsized":"2024-09-16T07:29:04.685114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675055+0000","last_change":"2024-09-16T07:29:04.675055+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675055+0000","last_undegraded":"2024-09-16T07:29:04.675055+0000","last_fullsized":"2024-09-16T07:29:04.675055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685951+0000","last_change":"2024-09-16T07:29:04.680366+0000","last_active":"2024-09-16T07:29:04.685951+0000","last_peered":"2024-09-16T07:29:04.685951+0000","last_clean":"2024-09-16T07:29:04.685951+0000","last_became_active":"2024-09-16T07:29:04.680082+0000","last_became_peered":"2024-09-16T07:29:04.680082+0000","last_unstale":"2024-09-16T07:29:04.685951+0000","last_undegraded":"2024-09-16T07:29:04.685951+0000","last_fullsized":"2024-09-16T07:29:04.685951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671994+0000","last_change":"2024-09-16T07:29:04.671994+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671994+0000","last_undegraded":"2024-09-16T07:29:04.671994+0000","last_fullsized":"2024-09-16T07:29:04.671994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692283+0000","last_change":"2024-09-16T07:29:04.685794+0000","last_active":"2024-09-16T07:29:04.692283+0000","last_peered":"2024-09-16T07:29:04.692283+0000","last_clean":"2024-09-16T07:29:04.692283+0000","last_became_active":"2024-09-16T07:29:04.685459+0000","last_became_peered":"2024-09-16T07:29:04.685459+0000","last_unstale":"2024-09-16T07:29:04.692283+0000","last_undegraded":"2024-09-16T07:29:04.692283+0000","last_fullsized":"2024-09-16T07:29:04.692283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:23:57.719597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675420+0000","last_change":"2024-09-16T07:29:04.675420+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675420+0000","last_undegraded":"2024-09-16T07:29:04.675420+0000","last_fullsized":"2024-09-16T07:29:04.675420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.695133+0000","last_change":"2024-09-16T07:29:04.689645+0000","last_active":"2024-09-16T07:29:04.695133+0000","last_peered":"2024-09-16T07:29:04.695133+0000","last_clean":"2024-09-16T07:29:04.695133+0000","last_became_active":"2024-09-16T07:29:04.689326+0000","last_became_peered":"2024-09-16T07:29:04.689326+0000","last_unstale":"2024-09-16T07:29:04.695133+0000","last_undegraded":"2024-09-16T07:29:04.695133+0000","last_fullsized":"2024-09-16T07:29:04.695133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:27.365752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678265+0000","last_change":"2024-09-16T07:29:04.678265+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678265+0000","last_undegraded":"2024-09-16T07:29:04.678265+0000","last_fullsized":"2024-09-16T07:29:04.678265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-16T07:29:03.665077+0000","last_change":"2024-09-16T07:29:03.665077+0000","last_active":"2024-09-16T07:29:03.647610+0000","last_peered":"2024-09-16T07:29:03.647610+0000","last_clean":"2024-09-16T07:29:03.647610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:03.665077+0000","last_undegraded":"2024-09-16T07:29:03.665077+0000","last_fullsized":"2024-09-16T07:29:03.665077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.677120+0000","last_change":"2024-09-16T07:29:04.677120+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.677120+0000","last_undegraded":"2024-09-16T07:29:04.677120+0000","last_fullsized":"2024-09-16T07:29:04.677120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694292+0000","last_change":"2024-09-16T07:29:04.693386+0000","last_active":"2024-09-16T07:29:04.694292+0000","last_peered":"2024-09-16T07:29:04.694292+0000","last_clean":"2024-09-16T07:29:04.694292+0000","last_became_active":"2024-09-16T07:29:04.693194+0000","last_became_peered":"2024-09-16T07:29:04.693194+0000","last_unstale":"2024-09-16T07:29:04.694292+0000","last_undegraded":"2024-09-16T07:29:04.694292+0000","last_fullsized":"2024-09-16T07:29:04.694292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:15.426280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.668249+0000","last_change":"2024-09-16T07:29:04.668249+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.668249+0000","last_undegraded":"2024-09-16T07:29:04.668249+0000","last_fullsized":"2024-09-16T07:29:04.668249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685130+0000","last_change":"2024-09-16T07:29:04.680986+0000","last_active":"2024-09-16T07:29:04.685130+0000","last_peered":"2024-09-16T07:29:04.685130+0000","last_clean":"2024-09-16T07:29:04.685130+0000","last_became_active":"2024-09-16T07:29:04.680600+0000","last_became_peered":"2024-09-16T07:29:04.680600+0000","last_unstale":"2024-09-16T07:29:04.685130+0000","last_undegraded":"2024-09-16T07:29:04.685130+0000","last_fullsized":"2024-09-16T07:29:04.685130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:07.588892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669129+0000","last_change":"2024-09-16T07:29:04.669129+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669129+0000","last_undegraded":"2024-09-16T07:29:04.669129+0000","last_fullsized":"2024-09-16T07:29:04.669129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690332+0000","last_change":"2024-09-16T07:29:04.681541+0000","last_active":"2024-09-16T07:29:04.690332+0000","last_peered":"2024-09-16T07:29:04.690332+0000","last_clean":"2024-09-16T07:29:04.690332+0000","last_became_active":"2024-09-16T07:29:04.680791+0000","last_became_peered":"2024-09-16T07:29:04.680791+0000","last_unstale":"2024-09-16T07:29:04.690332+0000","last_undegraded":"2024-09-16T07:29:04.690332+0000","last_fullsized":"2024-09-16T07:29:04.690332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670019+0000","last_change":"2024-09-16T07:29:04.670019+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670019+0000","last_undegraded":"2024-09-16T07:29:04.670019+0000","last_fullsized":"2024-09-16T07:29:04.670019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.683973+0000","last_change":"2024-09-16T07:29:04.677432+0000","last_active":"2024-09-16T07:29:04.683973+0000","last_peered":"2024-09-16T07:29:04.683973+0000","last_clean":"2024-09-16T07:29:04.683973+0000","last_became_active":"2024-09-16T07:29:04.677134+0000","last_became_peered":"2024-09-16T07:29:04.677134+0000","last_unstale":"2024-09-16T07:29:04.683973+0000","last_undegraded":"2024-09-16T07:29:04.683973+0000","last_fullsized":"2024-09-16T07:29:04.683973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:32:22.789804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671856+0000","last_change":"2024-09-16T07:29:04.671856+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671856+0000","last_undegraded":"2024-09-16T07:29:04.671856+0000","last_fullsized":"2024-09-16T07:29:04.671856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691646+0000","last_change":"2024-09-16T07:29:04.682861+0000","last_active":"2024-09-16T07:29:04.691646+0000","last_peered":"2024-09-16T07:29:04.691646+0000","last_clean":"2024-09-16T07:29:04.691646+0000","last_became_active":"2024-09-16T07:29:04.682605+0000","last_became_peered":"2024-09-16T07:29:04.682605+0000","last_unstale":"2024-09-16T07:29:04.691646+0000","last_undegraded":"2024-09-16T07:29:04.691646+0000","last_fullsized":"2024-09-16T07:29:04.691646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673791+0000","last_change":"2024-09-16T07:29:04.673791+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673791+0000","last_undegraded":"2024-09-16T07:29:04.673791+0000","last_fullsized":"2024-09-16T07:29:04.673791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690560+0000","last_change":"2024-09-16T07:29:04.682290+0000","last_active":"2024-09-16T07:29:04.690560+0000","last_peered":"2024-09-16T07:29:04.690560+0000","last_clean":"2024-09-16T07:29:04.690560+0000","last_became_active":"2024-09-16T07:29:04.681995+0000","last_became_peered":"2024-09-16T07:29:04.681995+0000","last_unstale":"2024-09-16T07:29:04.690560+0000","last_undegraded":"2024-09-16T07:29:04.690560+0000","last_fullsized":"2024-09-16T07:29:04.690560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.608204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672673+0000","last_change":"2024-09-16T07:29:04.672673+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672673+0000","last_undegraded":"2024-09-16T07:29:04.672673+0000","last_fullsized":"2024-09-16T07:29:04.672673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694039+0000","last_change":"2024-09-16T07:29:04.688689+0000","last_active":"2024-09-16T07:29:04.694039+0000","last_peered":"2024-09-16T07:29:04.694039+0000","last_clean":"2024-09-16T07:29:04.694039+0000","last_became_active":"2024-09-16T07:29:04.687010+0000","last_became_peered":"2024-09-16T07:29:04.687010+0000","last_unstale":"2024-09-16T07:29:04.694039+0000","last_undegraded":"2024-09-16T07:29:04.694039+0000","last_fullsized":"2024-09-16T07:29:04.694039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:25:19.296260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670459+0000","last_change":"2024-09-16T07:29:04.670459+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670459+0000","last_undegraded":"2024-09-16T07:29:04.670459+0000","last_fullsized":"2024-09-16T07:29:04.670459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691644+0000","last_change":"2024-09-16T07:29:04.687313+0000","last_active":"2024-09-16T07:29:04.691644+0000","last_peered":"2024-09-16T07:29:04.691644+0000","last_clean":"2024-09-16T07:29:04.691644+0000","last_became_active":"2024-09-16T07:29:04.686929+0000","last_became_peered":"2024-09-16T07:29:04.686929+0000","last_unstale":"2024-09-16T07:29:04.691644+0000","last_undegraded":"2024-09-16T07:29:04.691644+0000","last_fullsized":"2024-09-16T07:29:04.691644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:08.598702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678504+0000","last_change":"2024-09-16T07:29:04.678504+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678504+0000","last_undegraded":"2024-09-16T07:29:04.678504+0000","last_fullsized":"2024-09-16T07:29:04.678504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690931+0000","last_change":"2024-09-16T07:29:04.687978+0000","last_active":"2024-09-16T07:29:04.690931+0000","last_peered":"2024-09-16T07:29:04.690931+0000","last_clean":"2024-09-16T07:29:04.690931+0000","last_became_active":"2024-09-16T07:29:04.687570+0000","last_became_peered":"2024-09-16T07:29:04.687570+0000","last_unstale":"2024-09-16T07:29:04.690931+0000","last_undegraded":"2024-09-16T07:29:04.690931+0000","last_fullsized":"2024-09-16T07:29:04.690931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:15.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672148+0000","last_change":"2024-09-16T07:29:04.672148+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672148+0000","last_undegraded":"2024-09-16T07:29:04.672148+0000","last_fullsized":"2024-09-16T07:29:04.672148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690042+0000","last_change":"2024-09-16T07:29:04.683742+0000","last_active":"2024-09-16T07:29:04.690042+0000","last_peered":"2024-09-16T07:29:04.690042+0000","last_clean":"2024-09-16T07:29:04.690042+0000","last_became_active":"2024-09-16T07:29:04.683172+0000","last_became_peered":"2024-09-16T07:29:04.683172+0000","last_unstale":"2024-09-16T07:29:04.690042+0000","last_undegraded":"2024-09-16T07:29:04.690042+0000","last_fullsized":"2024-09-16T07:29:04.690042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.682375+0000","last_change":"2024-09-16T07:29:04.682375+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.682375+0000","last_undegraded":"2024-09-16T07:29:04.682375+0000","last_fullsized":"2024-09-16T07:29:04.682375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691563+0000","last_change":"2024-09-16T07:29:04.684134+0000","last_active":"2024-09-16T07:29:04.691563+0000","last_peered":"2024-09-16T07:29:04.691563+0000","last_clean":"2024-09-16T07:29:04.691563+0000","last_became_active":"2024-09-16T07:29:04.683409+0000","last_became_peered":"2024-09-16T07:29:04.683409+0000","last_unstale":"2024-09-16T07:29:04.691563+0000","last_undegraded":"2024-09-16T07:29:04.691563+0000","last_fullsized":"2024-09-16T07:29:04.691563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:41.134621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670878+0000","last_change":"2024-09-16T07:29:04.670878+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670878+0000","last_undegraded":"2024-09-16T07:29:04.670878+0000","last_fullsized":"2024-09-16T07:29:04.670878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694623+0000","last_change":"2024-09-16T07:29:04.688866+0000","last_active":"2024-09-16T07:29:04.694623+0000","last_peered":"2024-09-16T07:29:04.694623+0000","last_clean":"2024-09-16T07:29:04.694623+0000","last_became_active":"2024-09-16T07:29:04.688617+0000","last_became_peered":"2024-09-16T07:29:04.688617+0000","last_unstale":"2024-09-16T07:29:04.694623+0000","last_undegraded":"2024-09-16T07:29:04.694623+0000","last_fullsized":"2024-09-16T07:29:04.694623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:58.033566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673245+0000","last_change":"2024-09-16T07:29:04.673245+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673245+0000","last_undegraded":"2024-09-16T07:29:04.673245+0000","last_fullsized":"2024-09-16T07:29:04.673245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690228+0000","last_change":"2024-09-16T07:29:04.684997+0000","last_active":"2024-09-16T07:29:04.690228+0000","last_peered":"2024-09-16T07:29:04.690228+0000","last_clean":"2024-09-16T07:29:04.690228+0000","last_became_active":"2024-09-16T07:29:04.684520+0000","last_became_peered":"2024-09-16T07:29:04.684520+0000","last_unstale":"2024-09-16T07:29:04.690228+0000","last_undegraded":"2024-09-16T07:29:04.690228+0000","last_fullsized":"2024-09-16T07:29:04.690228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671321+0000","last_change":"2024-09-16T07:29:04.671321+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671321+0000","last_undegraded":"2024-09-16T07:29:04.671321+0000","last_fullsized":"2024-09-16T07:29:04.671321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693818+0000","last_change":"2024-09-16T07:29:04.688727+0000","last_active":"2024-09-16T07:29:04.693818+0000","last_peered":"2024-09-16T07:29:04.693818+0000","last_clean":"2024-09-16T07:29:04.693818+0000","last_became_active":"2024-09-16T07:29:04.687576+0000","last_became_peered":"2024-09-16T07:29:04.687576+0000","last_unstale":"2024-09-16T07:29:04.693818+0000","last_undegraded":"2024-09-16T07:29:04.693818+0000","last_fullsized":"2024-09-16T07:29:04.693818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:36.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675900+0000","last_change":"2024-09-16T07:29:04.675900+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675900+0000","last_undegraded":"2024-09-16T07:29:04.675900+0000","last_fullsized":"2024-09-16T07:29:04.675900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693734+0000","last_change":"2024-09-16T07:29:04.688933+0000","last_active":"2024-09-16T07:29:04.693734+0000","last_peered":"2024-09-16T07:29:04.693734+0000","last_clean":"2024-09-16T07:29:04.693734+0000","last_became_active":"2024-09-16T07:29:04.688568+0000","last_became_peered":"2024-09-16T07:29:04.688568+0000","last_unstale":"2024-09-16T07:29:04.693734+0000","last_undegraded":"2024-09-16T07:29:04.693734+0000","last_fullsized":"2024-09-16T07:29:04.693734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:24.910304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690886+0000","last_change":"2024-09-16T07:29:04.686063+0000","last_active":"2024-09-16T07:29:04.690886+0000","last_peered":"2024-09-16T07:29:04.690886+0000","last_clean":"2024-09-16T07:29:04.690886+0000","last_became_active":"2024-09-16T07:29:04.685265+0000","last_became_peered":"2024-09-16T07:29:04.685265+0000","last_unstale":"2024-09-16T07:29:04.690886+0000","last_undegraded":"2024-09-16T07:29:04.690886+0000","last_fullsized":"2024-09-16T07:29:04.690886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:56:33.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692403+0000","last_change":"2024-09-16T07:29:04.688075+0000","last_active":"2024-09-16T07:29:04.692403+0000","last_peered":"2024-09-16T07:29:04.692403+0000","last_clean":"2024-09-16T07:29:04.692403+0000","last_became_active":"2024-09-16T07:29:04.687842+0000","last_became_peered":"2024-09-16T07:29:04.687842+0000","last_unstale":"2024-09-16T07:29:04.692403+0000","last_undegraded":"2024-09-16T07:29:04.692403+0000","last_fullsized":"2024-09-16T07:29:04.692403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:18.498467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694267+0000","last_change":"2024-09-16T07:29:04.692249+0000","last_active":"2024-09-16T07:29:04.694267+0000","last_peered":"2024-09-16T07:29:04.694267+0000","last_clean":"2024-09-16T07:29:04.694267+0000","last_became_active":"2024-09-16T07:29:04.691889+0000","last_became_peered":"2024-09-16T07:29:04.691889+0000","last_unstale":"2024-09-16T07:29:04.694267+0000","last_undegraded":"2024-09-16T07:29:04.694267+0000","last_fullsized":"2024-09-16T07:29:04.694267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693863+0000","last_change":"2024-09-16T07:29:04.689801+0000","last_active":"2024-09-16T07:29:04.693863+0000","last_peered":"2024-09-16T07:29:04.693863+0000","last_clean":"2024-09-16T07:29:04.693863+0000","last_became_active":"2024-09-16T07:29:04.689407+0000","last_became_peered":"2024-09-16T07:29:04.689407+0000","last_unstale":"2024-09-16T07:29:04.693863+0000","last_undegraded":"2024-09-16T07:29:04.693863+0000","last_fullsized":"2024-09-16T07:29:04.693863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:00.875663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.679001+0000","last_change":"2024-09-16T07:29:04.679001+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.679001+0000","last_undegraded":"2024-09-16T07:29:04.679001+0000","last_fullsized":"2024-09-16T07:29:04.679001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694168+0000","last_change":"2024-09-16T07:29:04.689517+0000","last_active":"2024-09-16T07:29:04.694168+0000","last_peered":"2024-09-16T07:29:04.694168+0000","last_clean":"2024-09-16T07:29:04.694168+0000","last_became_active":"2024-09-16T07:29:04.689245+0000","last_became_peered":"2024-09-16T07:29:04.689245+0000","last_unstale":"2024-09-16T07:29:04.694168+0000","last_undegraded":"2024-09-16T07:29:04.694168+0000","last_fullsized":"2024-09-16T07:29:04.694168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:24.593805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690176+0000","last_change":"2024-09-16T07:29:04.680088+0000","last_active":"2024-09-16T07:29:04.690176+0000","last_peered":"2024-09-16T07:29:04.690176+0000","last_clean":"2024-09-16T07:29:04.690176+0000","last_became_active":"2024-09-16T07:29:04.679832+0000","last_became_peered":"2024-09-16T07:29:04.679832+0000","last_unstale":"2024-09-16T07:29:04.690176+0000","last_undegraded":"2024-09-16T07:29:04.690176+0000","last_fullsized":"2024-09-16T07:29:04.690176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670954+0000","last_change":"2024-09-16T07:29:04.670954+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670954+0000","last_undegraded":"2024-09-16T07:29:04.670954+0000","last_fullsized":"2024-09-16T07:29:04.670954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.683388+0000","last_change":"2024-09-16T07:29:04.679959+0000","last_active":"2024-09-16T07:29:04.683388+0000","last_peered":"2024-09-16T07:29:04.683388+0000","last_clean":"2024-09-16T07:29:04.683388+0000","last_became_active":"2024-09-16T07:29:04.679699+0000","last_became_peered":"2024-09-16T07:29:04.679699+0000","last_unstale":"2024-09-16T07:29:04.683388+0000","last_undegraded":"2024-09-16T07:29:04.683388+0000","last_fullsized":"2024-09-16T07:29:04.683388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:46.134632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675338+0000","last_change":"2024-09-16T07:29:04.675338+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675338+0000","last_undegraded":"2024-09-16T07:29:04.675338+0000","last_fullsized":"2024-09-16T07:29:04.675338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.689989+0000","last_change":"2024-09-16T07:29:04.685192+0000","last_active":"2024-09-16T07:29:04.689989+0000","last_peered":"2024-09-16T07:29:04.689989+0000","last_clean":"2024-09-16T07:29:04.689989+0000","last_became_active":"2024-09-16T07:29:04.684971+0000","last_became_peered":"2024-09-16T07:29:04.684971+0000","last_unstale":"2024-09-16T07:29:04.689989+0000","last_undegraded":"2024-09-16T07:29:04.689989+0000","last_fullsized":"2024-09-16T07:29:04.689989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671448+0000","last_change":"2024-09-16T07:29:04.671448+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671448+0000","last_undegraded":"2024-09-16T07:29:04.671448+0000","last_fullsized":"2024-09-16T07:29:04.671448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692429+0000","last_change":"2024-09-16T07:29:04.688174+0000","last_active":"2024-09-16T07:29:04.692429+0000","last_peered":"2024-09-16T07:29:04.692429+0000","last_clean":"2024-09-16T07:29:04.692429+0000","last_became_active":"2024-09-16T07:29:04.687913+0000","last_became_peered":"2024-09-16T07:29:04.687913+0000","last_unstale":"2024-09-16T07:29:04.692429+0000","last_undegraded":"2024-09-16T07:29:04.692429+0000","last_fullsized":"2024-09-16T07:29:04.692429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:27:22.965785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.674204+0000","last_change":"2024-09-16T07:29:04.674204+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.674204+0000","last_undegraded":"2024-09-16T07:29:04.674204+0000","last_fullsized":"2024-09-16T07:29:04.674204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690016+0000","last_change":"2024-09-16T07:29:04.683463+0000","last_active":"2024-09-16T07:29:04.690016+0000","last_peered":"2024-09-16T07:29:04.690016+0000","last_clean":"2024-09-16T07:29:04.690016+0000","last_became_active":"2024-09-16T07:29:04.682288+0000","last_became_peered":"2024-09-16T07:29:04.682288+0000","last_unstale":"2024-09-16T07:29:04.690016+0000","last_undegraded":"2024-09-16T07:29:04.690016+0000","last_fullsized":"2024-09-16T07:29:04.690016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672318+0000","last_change":"2024-09-16T07:29:04.672318+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672318+0000","last_undegraded":"2024-09-16T07:29:04.672318+0000","last_fullsized":"2024-09-16T07:29:04.672318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.688386+0000","last_change":"2024-09-16T07:29:04.682025+0000","last_active":"2024-09-16T07:29:04.688386+0000","last_peered":"2024-09-16T07:29:04.688386+0000","last_clean":"2024-09-16T07:29:04.688386+0000","last_became_active":"2024-09-16T07:29:04.681723+0000","last_became_peered":"2024-09-16T07:29:04.681723+0000","last_unstale":"2024-09-16T07:29:04.688386+0000","last_undegraded":"2024-09-16T07:29:04.688386+0000","last_fullsized":"2024-09-16T07:29:04.688386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:15.463329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669857+0000","last_change":"2024-09-16T07:29:04.669857+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669857+0000","last_undegraded":"2024-09-16T07:29:04.669857+0000","last_fullsized":"2024-09-16T07:29:04.669857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692245+0000","last_change":"2024-09-16T07:29:04.688723+0000","last_active":"2024-09-16T07:29:04.692245+0000","last_peered":"2024-09-16T07:29:04.692245+0000","last_clean":"2024-09-16T07:29:04.692245+0000","last_became_active":"2024-09-16T07:29:04.688446+0000","last_became_peered":"2024-09-16T07:29:04.688446+0000","last_unstale":"2024-09-16T07:29:04.692245+0000","last_undegraded":"2024-09-16T07:29:04.692245+0000","last_fullsized":"2024-09-16T07:29:04.692245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:37.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.677118+0000","last_change":"2024-09-16T07:29:04.677118+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.677118+0000","last_undegraded":"2024-09-16T07:29:04.677118+0000","last_fullsized":"2024-09-16T07:29:04.677118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.689769+0000","last_change":"2024-09-16T07:29:04.684672+0000","last_active":"2024-09-16T07:29:04.689769+0000","last_peered":"2024-09-16T07:29:04.689769+0000","last_clean":"2024-09-16T07:29:04.689769+0000","last_became_active":"2024-09-16T07:29:04.684435+0000","last_became_peered":"2024-09-16T07:29:04.684435+0000","last_unstale":"2024-09-16T07:29:04.689769+0000","last_undegraded":"2024-09-16T07:29:04.689769+0000","last_fullsized":"2024-09-16T07:29:04.689769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685746+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:04.685746+0000","last_peered":"2024-09-16T07:29:04.685746+0000","last_clean":"2024-09-16T07:29:04.685746+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:04.685746+0000","last_undegraded":"2024-09-16T07:29:04.685746+0000","last_fullsized":"2024-09-16T07:29:04.685746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":716769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":710502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:10.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- 172.21.15.114:0/3622240810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33400cecf0 msgr2=0x7f33400cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 --2- 172.21.15.114:0/3622240810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33400cecf0 0x7f33400cc940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f332c009900 tx=0x7f332c01c7c0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- 172.21.15.114:0/3622240810 shutdown_connections 2024-09-16T07:29:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 --2- 172.21.15.114:0/3622240810 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334015c130 0x7f33400cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 --2- 172.21.15.114:0/3622240810 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33400cecf0 0x7f33400cc940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- 172.21.15.114:0/3622240810 >> 172.21.15.114:0/3622240810 conn(0x7f33400d1ea0 msgr2=0x7f33400d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- 172.21.15.114:0/3622240810 shutdown_connections 2024-09-16T07:29:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- 172.21.15.114:0/3622240810 wait complete. 2024-09-16T07:29:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 Processor -- start 2024-09-16T07:29:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- start start 2024-09-16T07:29:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33400cecf0 0x7f3340154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f334015bd50 0x7f334009bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334015c130 0x7f33400cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3340169540 con 0x7f334015bd50 2024-09-16T07:29:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f33401693c0 con 0x7f33400cecf0 2024-09-16T07:29:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3348600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f33401696c0 con 0x7f334015c130 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f334015bd50 0x7f334009bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f334015bd50 0x7f334009bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50484/0 (socket says 172.21.15.114:50484) 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 -- 172.21.15.114:0/4287214011 learned_addr learned my addr 172.21.15.114:0/4287214011 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345c00640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33400cecf0 0x7f3340154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3346600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334015c130 0x7f33400cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 -- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334015c130 msgr2=0x7f33400cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334015c130 0x7f33400cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 -- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33400cecf0 msgr2=0x7f3340154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33400cecf0 0x7f3340154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.392+0000 7f3345200640 1 -- 172.21.15.114:0/4287214011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3340155450 con 0x7f334015bd50 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f3345200640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f334015bd50 0x7f334009bba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f332c009850 tx=0x7f332c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f333d600640 1 -- 172.21.15.114:0/4287214011 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0b2040 con 0x7f334015bd50 2024-09-16T07:29:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f333d600640 1 -- 172.21.15.114:0/4287214011 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f332c005030 con 0x7f334015bd50 2024-09-16T07:29:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f333d600640 1 -- 172.21.15.114:0/4287214011 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c005440 con 0x7f334015bd50 2024-09-16T07:29:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33401f9420 con 0x7f334015bd50 2024-09-16T07:29:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33401f96c0 con 0x7f334015bd50 2024-09-16T07:29:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33400ce5e0 con 0x7f334015bd50 2024-09-16T07:29:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f333d600640 1 -- 172.21.15.114:0/4287214011 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f332c0046d0 con 0x7f334015bd50 2024-09-16T07:29:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f333d600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3320072ec0 0x7f3320075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f333d600640 1 -- 172.21.15.114:0/4287214011 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f332c12d850 con 0x7f334015bd50 2024-09-16T07:29:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.396+0000 7f3345c00640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3320072ec0 0x7f3320075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.400+0000 7f3345c00640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3320072ec0 0x7f3320075380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3334005680 tx=0x7f3334003dd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:10.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.400+0000 7f333d600640 1 -- 172.21.15.114:0/4287214011 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f332c0164d0 con 0x7f334015bd50 2024-09-16T07:29:10.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.564+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33400ceab0 con 0x7f3320072ec0 2024-09-16T07:29:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.572+0000 7f333d600640 1 -- 172.21.15.114:0/4287214011 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246071 (secure 0 0 0) 0x7f33400ceab0 con 0x7f3320072ec0 2024-09-16T07:29:10.578 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3320072ec0 msgr2=0x7f3320075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3320072ec0 0x7f3320075380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3334005680 tx=0x7f3334003dd0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f334015bd50 msgr2=0x7f334009bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f334015bd50 0x7f334009bba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f332c009850 tx=0x7f332c004040 comp rx=0 tx=0).stop 2024-09-16T07:29:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 shutdown_connections 2024-09-16T07:29:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3320072ec0 0x7f3320075380 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f334015c130 0x7f33400cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f334015bd50 0x7f334009bba0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 --2- 172.21.15.114:0/4287214011 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33400cecf0 0x7f3340154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 >> 172.21.15.114:0/4287214011 conn(0x7f33400d1ea0 msgr2=0x7f33400712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 shutdown_connections 2024-09-16T07:29:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.576+0000 7f3348600640 1 -- 172.21.15.114:0/4287214011 wait complete. 2024-09-16T07:29:10.598 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-16T07:29:09.004692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219992,"kb_used_data":3756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754728,"statfs":{"total":773094113280,"available":772868841472,"internally_reserved":0,"allocated":3846144,"data_stored":2160609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.345763"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672504+0000","last_change":"2024-09-16T07:29:04.672504+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672504+0000","last_undegraded":"2024-09-16T07:29:04.672504+0000","last_fullsized":"2024-09-16T07:29:04.672504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673233+0000","last_change":"2024-09-16T07:29:04.673233+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673233+0000","last_undegraded":"2024-09-16T07:29:04.673233+0000","last_fullsized":"2024-09-16T07:29:04.673233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670033+0000","last_change":"2024-09-16T07:29:04.670033+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670033+0000","last_undegraded":"2024-09-16T07:29:04.670033+0000","last_fullsized":"2024-09-16T07:29:04.670033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.676318+0000","last_change":"2024-09-16T07:29:04.676318+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.676318+0000","last_undegraded":"2024-09-16T07:29:04.676318+0000","last_fullsized":"2024-09-16T07:29:04.676318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673431+0000","last_change":"2024-09-16T07:29:04.673431+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673431+0000","last_undegraded":"2024-09-16T07:29:04.673431+0000","last_fullsized":"2024-09-16T07:29:04.673431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678191+0000","last_change":"2024-09-16T07:29:04.678191+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678191+0000","last_undegraded":"2024-09-16T07:29:04.678191+0000","last_fullsized":"2024-09-16T07:29:04.678191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.685524+0000","last_change":"2024-09-16T07:29:04.685524+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.685524+0000","last_undegraded":"2024-09-16T07:29:04.685524+0000","last_fullsized":"2024-09-16T07:29:04.685524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673772+0000","last_change":"2024-09-16T07:29:04.673772+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673772+0000","last_undegraded":"2024-09-16T07:29:04.673772+0000","last_fullsized":"2024-09-16T07:29:04.673772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675096+0000","last_change":"2024-09-16T07:29:04.675096+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675096+0000","last_undegraded":"2024-09-16T07:29:04.675096+0000","last_fullsized":"2024-09-16T07:29:04.675096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.681652+0000","last_change":"2024-09-16T07:29:04.681652+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.681652+0000","last_undegraded":"2024-09-16T07:29:04.681652+0000","last_fullsized":"2024-09-16T07:29:04.681652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669774+0000","last_change":"2024-09-16T07:29:04.669774+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669774+0000","last_undegraded":"2024-09-16T07:29:04.669774+0000","last_fullsized":"2024-09-16T07:29:04.669774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672895+0000","last_change":"2024-09-16T07:29:04.672895+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672895+0000","last_undegraded":"2024-09-16T07:29:04.672895+0000","last_fullsized":"2024-09-16T07:29:04.672895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669437+0000","last_change":"2024-09-16T07:29:04.669437+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669437+0000","last_undegraded":"2024-09-16T07:29:04.669437+0000","last_fullsized":"2024-09-16T07:29:04.669437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.680192+0000","last_change":"2024-09-16T07:29:04.680192+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.680192+0000","last_undegraded":"2024-09-16T07:29:04.680192+0000","last_fullsized":"2024-09-16T07:29:04.680192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678625+0000","last_change":"2024-09-16T07:29:04.678625+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678625+0000","last_undegraded":"2024-09-16T07:29:04.678625+0000","last_fullsized":"2024-09-16T07:29:04.678625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672815+0000","last_change":"2024-09-16T07:29:04.672815+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672815+0000","last_undegraded":"2024-09-16T07:29:04.672815+0000","last_fullsized":"2024-09-16T07:29:04.672815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672387+0000","last_change":"2024-09-16T07:29:04.672387+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672387+0000","last_undegraded":"2024-09-16T07:29:04.672387+0000","last_fullsized":"2024-09-16T07:29:04.672387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675057+0000","last_change":"2024-09-16T07:29:04.675057+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675057+0000","last_undegraded":"2024-09-16T07:29:04.675057+0000","last_fullsized":"2024-09-16T07:29:04.675057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669090+0000","last_change":"2024-09-16T07:29:04.669090+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669090+0000","last_undegraded":"2024-09-16T07:29:04.669090+0000","last_fullsized":"2024-09-16T07:29:04.669090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672995+0000","last_change":"2024-09-16T07:29:04.672995+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672995+0000","last_undegraded":"2024-09-16T07:29:04.672995+0000","last_fullsized":"2024-09-16T07:29:04.672995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.668637+0000","last_change":"2024-09-16T07:29:04.668637+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.668637+0000","last_undegraded":"2024-09-16T07:29:04.668637+0000","last_fullsized":"2024-09-16T07:29:04.668637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678265+0000","last_change":"2024-09-16T07:29:04.678265+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678265+0000","last_undegraded":"2024-09-16T07:29:04.678265+0000","last_fullsized":"2024-09-16T07:29:04.678265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672293+0000","last_change":"2024-09-16T07:29:04.672293+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672293+0000","last_undegraded":"2024-09-16T07:29:04.672293+0000","last_fullsized":"2024-09-16T07:29:04.672293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678924+0000","last_change":"2024-09-16T07:29:04.678924+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678924+0000","last_undegraded":"2024-09-16T07:29:04.678924+0000","last_fullsized":"2024-09-16T07:29:04.678924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669239+0000","last_change":"2024-09-16T07:29:04.669239+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669239+0000","last_undegraded":"2024-09-16T07:29:04.669239+0000","last_fullsized":"2024-09-16T07:29:04.669239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.674613+0000","last_change":"2024-09-16T07:29:04.674613+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.674613+0000","last_undegraded":"2024-09-16T07:29:04.674613+0000","last_fullsized":"2024-09-16T07:29:04.674613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.681817+0000","last_change":"2024-09-16T07:29:04.681817+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.681817+0000","last_undegraded":"2024-09-16T07:29:04.681817+0000","last_fullsized":"2024-09-16T07:29:04.681817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673382+0000","last_change":"2024-09-16T07:29:04.673382+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673382+0000","last_undegraded":"2024-09-16T07:29:04.673382+0000","last_fullsized":"2024-09-16T07:29:04.673382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.685114+0000","last_change":"2024-09-16T07:29:04.685114+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.685114+0000","last_undegraded":"2024-09-16T07:29:04.685114+0000","last_fullsized":"2024-09-16T07:29:04.685114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675055+0000","last_change":"2024-09-16T07:29:04.675055+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675055+0000","last_undegraded":"2024-09-16T07:29:04.675055+0000","last_fullsized":"2024-09-16T07:29:04.675055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685951+0000","last_change":"2024-09-16T07:29:04.680366+0000","last_active":"2024-09-16T07:29:04.685951+0000","last_peered":"2024-09-16T07:29:04.685951+0000","last_clean":"2024-09-16T07:29:04.685951+0000","last_became_active":"2024-09-16T07:29:04.680082+0000","last_became_peered":"2024-09-16T07:29:04.680082+0000","last_unstale":"2024-09-16T07:29:04.685951+0000","last_undegraded":"2024-09-16T07:29:04.685951+0000","last_fullsized":"2024-09-16T07:29:04.685951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671994+0000","last_change":"2024-09-16T07:29:04.671994+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671994+0000","last_undegraded":"2024-09-16T07:29:04.671994+0000","last_fullsized":"2024-09-16T07:29:04.671994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692283+0000","last_change":"2024-09-16T07:29:04.685794+0000","last_active":"2024-09-16T07:29:04.692283+0000","last_peered":"2024-09-16T07:29:04.692283+0000","last_clean":"2024-09-16T07:29:04.692283+0000","last_became_active":"2024-09-16T07:29:04.685459+0000","last_became_peered":"2024-09-16T07:29:04.685459+0000","last_unstale":"2024-09-16T07:29:04.692283+0000","last_undegraded":"2024-09-16T07:29:04.692283+0000","last_fullsized":"2024-09-16T07:29:04.692283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:23:57.719597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675420+0000","last_change":"2024-09-16T07:29:04.675420+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675420+0000","last_undegraded":"2024-09-16T07:29:04.675420+0000","last_fullsized":"2024-09-16T07:29:04.675420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.695133+0000","last_change":"2024-09-16T07:29:04.689645+0000","last_active":"2024-09-16T07:29:04.695133+0000","last_peered":"2024-09-16T07:29:04.695133+0000","last_clean":"2024-09-16T07:29:04.695133+0000","last_became_active":"2024-09-16T07:29:04.689326+0000","last_became_peered":"2024-09-16T07:29:04.689326+0000","last_unstale":"2024-09-16T07:29:04.695133+0000","last_undegraded":"2024-09-16T07:29:04.695133+0000","last_fullsized":"2024-09-16T07:29:04.695133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:27.365752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678265+0000","last_change":"2024-09-16T07:29:04.678265+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678265+0000","last_undegraded":"2024-09-16T07:29:04.678265+0000","last_fullsized":"2024-09-16T07:29:04.678265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-16T07:29:03.665077+0000","last_change":"2024-09-16T07:29:03.665077+0000","last_active":"2024-09-16T07:29:03.647610+0000","last_peered":"2024-09-16T07:29:03.647610+0000","last_clean":"2024-09-16T07:29:03.647610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:03.665077+0000","last_undegraded":"2024-09-16T07:29:03.665077+0000","last_fullsized":"2024-09-16T07:29:03.665077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.677120+0000","last_change":"2024-09-16T07:29:04.677120+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.677120+0000","last_undegraded":"2024-09-16T07:29:04.677120+0000","last_fullsized":"2024-09-16T07:29:04.677120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694292+0000","last_change":"2024-09-16T07:29:04.693386+0000","last_active":"2024-09-16T07:29:04.694292+0000","last_peered":"2024-09-16T07:29:04.694292+0000","last_clean":"2024-09-16T07:29:04.694292+0000","last_became_active":"2024-09-16T07:29:04.693194+0000","last_became_peered":"2024-09-16T07:29:04.693194+0000","last_unstale":"2024-09-16T07:29:04.694292+0000","last_undegraded":"2024-09-16T07:29:04.694292+0000","last_fullsized":"2024-09-16T07:29:04.694292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:15.426280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.668249+0000","last_change":"2024-09-16T07:29:04.668249+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.668249+0000","last_undegraded":"2024-09-16T07:29:04.668249+0000","last_fullsized":"2024-09-16T07:29:04.668249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685130+0000","last_change":"2024-09-16T07:29:04.680986+0000","last_active":"2024-09-16T07:29:04.685130+0000","last_peered":"2024-09-16T07:29:04.685130+0000","last_clean":"2024-09-16T07:29:04.685130+0000","last_became_active":"2024-09-16T07:29:04.680600+0000","last_became_peered":"2024-09-16T07:29:04.680600+0000","last_unstale":"2024-09-16T07:29:04.685130+0000","last_undegraded":"2024-09-16T07:29:04.685130+0000","last_fullsized":"2024-09-16T07:29:04.685130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:07.588892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669129+0000","last_change":"2024-09-16T07:29:04.669129+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669129+0000","last_undegraded":"2024-09-16T07:29:04.669129+0000","last_fullsized":"2024-09-16T07:29:04.669129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690332+0000","last_change":"2024-09-16T07:29:04.681541+0000","last_active":"2024-09-16T07:29:04.690332+0000","last_peered":"2024-09-16T07:29:04.690332+0000","last_clean":"2024-09-16T07:29:04.690332+0000","last_became_active":"2024-09-16T07:29:04.680791+0000","last_became_peered":"2024-09-16T07:29:04.680791+0000","last_unstale":"2024-09-16T07:29:04.690332+0000","last_undegraded":"2024-09-16T07:29:04.690332+0000","last_fullsized":"2024-09-16T07:29:04.690332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670019+0000","last_change":"2024-09-16T07:29:04.670019+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670019+0000","last_undegraded":"2024-09-16T07:29:04.670019+0000","last_fullsized":"2024-09-16T07:29:04.670019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.683973+0000","last_change":"2024-09-16T07:29:04.677432+0000","last_active":"2024-09-16T07:29:04.683973+0000","last_peered":"2024-09-16T07:29:04.683973+0000","last_clean":"2024-09-16T07:29:04.683973+0000","last_became_active":"2024-09-16T07:29:04.677134+0000","last_became_peered":"2024-09-16T07:29:04.677134+0000","last_unstale":"2024-09-16T07:29:04.683973+0000","last_undegraded":"2024-09-16T07:29:04.683973+0000","last_fullsized":"2024-09-16T07:29:04.683973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:32:22.789804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671856+0000","last_change":"2024-09-16T07:29:04.671856+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671856+0000","last_undegraded":"2024-09-16T07:29:04.671856+0000","last_fullsized":"2024-09-16T07:29:04.671856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691646+0000","last_change":"2024-09-16T07:29:04.682861+0000","last_active":"2024-09-16T07:29:04.691646+0000","last_peered":"2024-09-16T07:29:04.691646+0000","last_clean":"2024-09-16T07:29:04.691646+0000","last_became_active":"2024-09-16T07:29:04.682605+0000","last_became_peered":"2024-09-16T07:29:04.682605+0000","last_unstale":"2024-09-16T07:29:04.691646+0000","last_undegraded":"2024-09-16T07:29:04.691646+0000","last_fullsized":"2024-09-16T07:29:04.691646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673791+0000","last_change":"2024-09-16T07:29:04.673791+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673791+0000","last_undegraded":"2024-09-16T07:29:04.673791+0000","last_fullsized":"2024-09-16T07:29:04.673791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690560+0000","last_change":"2024-09-16T07:29:04.682290+0000","last_active":"2024-09-16T07:29:04.690560+0000","last_peered":"2024-09-16T07:29:04.690560+0000","last_clean":"2024-09-16T07:29:04.690560+0000","last_became_active":"2024-09-16T07:29:04.681995+0000","last_became_peered":"2024-09-16T07:29:04.681995+0000","last_unstale":"2024-09-16T07:29:04.690560+0000","last_undegraded":"2024-09-16T07:29:04.690560+0000","last_fullsized":"2024-09-16T07:29:04.690560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.608204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672673+0000","last_change":"2024-09-16T07:29:04.672673+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672673+0000","last_undegraded":"2024-09-16T07:29:04.672673+0000","last_fullsized":"2024-09-16T07:29:04.672673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694039+0000","last_change":"2024-09-16T07:29:04.688689+0000","last_active":"2024-09-16T07:29:04.694039+0000","last_peered":"2024-09-16T07:29:04.694039+0000","last_clean":"2024-09-16T07:29:04.694039+0000","last_became_active":"2024-09-16T07:29:04.687010+0000","last_became_peered":"2024-09-16T07:29:04.687010+0000","last_unstale":"2024-09-16T07:29:04.694039+0000","last_undegraded":"2024-09-16T07:29:04.694039+0000","last_fullsized":"2024-09-16T07:29:04.694039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:25:19.296260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670459+0000","last_change":"2024-09-16T07:29:04.670459+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670459+0000","last_undegraded":"2024-09-16T07:29:04.670459+0000","last_fullsized":"2024-09-16T07:29:04.670459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691644+0000","last_change":"2024-09-16T07:29:04.687313+0000","last_active":"2024-09-16T07:29:04.691644+0000","last_peered":"2024-09-16T07:29:04.691644+0000","last_clean":"2024-09-16T07:29:04.691644+0000","last_became_active":"2024-09-16T07:29:04.686929+0000","last_became_peered":"2024-09-16T07:29:04.686929+0000","last_unstale":"2024-09-16T07:29:04.691644+0000","last_undegraded":"2024-09-16T07:29:04.691644+0000","last_fullsized":"2024-09-16T07:29:04.691644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:08.598702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.678504+0000","last_change":"2024-09-16T07:29:04.678504+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.678504+0000","last_undegraded":"2024-09-16T07:29:04.678504+0000","last_fullsized":"2024-09-16T07:29:04.678504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690931+0000","last_change":"2024-09-16T07:29:04.687978+0000","last_active":"2024-09-16T07:29:04.690931+0000","last_peered":"2024-09-16T07:29:04.690931+0000","last_clean":"2024-09-16T07:29:04.690931+0000","last_became_active":"2024-09-16T07:29:04.687570+0000","last_became_peered":"2024-09-16T07:29:04.687570+0000","last_unstale":"2024-09-16T07:29:04.690931+0000","last_undegraded":"2024-09-16T07:29:04.690931+0000","last_fullsized":"2024-09-16T07:29:04.690931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:15.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672148+0000","last_change":"2024-09-16T07:29:04.672148+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672148+0000","last_undegraded":"2024-09-16T07:29:04.672148+0000","last_fullsized":"2024-09-16T07:29:04.672148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690042+0000","last_change":"2024-09-16T07:29:04.683742+0000","last_active":"2024-09-16T07:29:04.690042+0000","last_peered":"2024-09-16T07:29:04.690042+0000","last_clean":"2024-09-16T07:29:04.690042+0000","last_became_active":"2024-09-16T07:29:04.683172+0000","last_became_peered":"2024-09-16T07:29:04.683172+0000","last_unstale":"2024-09-16T07:29:04.690042+0000","last_undegraded":"2024-09-16T07:29:04.690042+0000","last_fullsized":"2024-09-16T07:29:04.690042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.682375+0000","last_change":"2024-09-16T07:29:04.682375+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.682375+0000","last_undegraded":"2024-09-16T07:29:04.682375+0000","last_fullsized":"2024-09-16T07:29:04.682375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.691563+0000","last_change":"2024-09-16T07:29:04.684134+0000","last_active":"2024-09-16T07:29:04.691563+0000","last_peered":"2024-09-16T07:29:04.691563+0000","last_clean":"2024-09-16T07:29:04.691563+0000","last_became_active":"2024-09-16T07:29:04.683409+0000","last_became_peered":"2024-09-16T07:29:04.683409+0000","last_unstale":"2024-09-16T07:29:04.691563+0000","last_undegraded":"2024-09-16T07:29:04.691563+0000","last_fullsized":"2024-09-16T07:29:04.691563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:41.134621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670878+0000","last_change":"2024-09-16T07:29:04.670878+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670878+0000","last_undegraded":"2024-09-16T07:29:04.670878+0000","last_fullsized":"2024-09-16T07:29:04.670878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694623+0000","last_change":"2024-09-16T07:29:04.688866+0000","last_active":"2024-09-16T07:29:04.694623+0000","last_peered":"2024-09-16T07:29:04.694623+0000","last_clean":"2024-09-16T07:29:04.694623+0000","last_became_active":"2024-09-16T07:29:04.688617+0000","last_became_peered":"2024-09-16T07:29:04.688617+0000","last_unstale":"2024-09-16T07:29:04.694623+0000","last_undegraded":"2024-09-16T07:29:04.694623+0000","last_fullsized":"2024-09-16T07:29:04.694623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:58.033566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.673245+0000","last_change":"2024-09-16T07:29:04.673245+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.673245+0000","last_undegraded":"2024-09-16T07:29:04.673245+0000","last_fullsized":"2024-09-16T07:29:04.673245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690228+0000","last_change":"2024-09-16T07:29:04.684997+0000","last_active":"2024-09-16T07:29:04.690228+0000","last_peered":"2024-09-16T07:29:04.690228+0000","last_clean":"2024-09-16T07:29:04.690228+0000","last_became_active":"2024-09-16T07:29:04.684520+0000","last_became_peered":"2024-09-16T07:29:04.684520+0000","last_unstale":"2024-09-16T07:29:04.690228+0000","last_undegraded":"2024-09-16T07:29:04.690228+0000","last_fullsized":"2024-09-16T07:29:04.690228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671321+0000","last_change":"2024-09-16T07:29:04.671321+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671321+0000","last_undegraded":"2024-09-16T07:29:04.671321+0000","last_fullsized":"2024-09-16T07:29:04.671321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693818+0000","last_change":"2024-09-16T07:29:04.688727+0000","last_active":"2024-09-16T07:29:04.693818+0000","last_peered":"2024-09-16T07:29:04.693818+0000","last_clean":"2024-09-16T07:29:04.693818+0000","last_became_active":"2024-09-16T07:29:04.687576+0000","last_became_peered":"2024-09-16T07:29:04.687576+0000","last_unstale":"2024-09-16T07:29:04.693818+0000","last_undegraded":"2024-09-16T07:29:04.693818+0000","last_fullsized":"2024-09-16T07:29:04.693818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:36.419959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675900+0000","last_change":"2024-09-16T07:29:04.675900+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675900+0000","last_undegraded":"2024-09-16T07:29:04.675900+0000","last_fullsized":"2024-09-16T07:29:04.675900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693734+0000","last_change":"2024-09-16T07:29:04.688933+0000","last_active":"2024-09-16T07:29:04.693734+0000","last_peered":"2024-09-16T07:29:04.693734+0000","last_clean":"2024-09-16T07:29:04.693734+0000","last_became_active":"2024-09-16T07:29:04.688568+0000","last_became_peered":"2024-09-16T07:29:04.688568+0000","last_unstale":"2024-09-16T07:29:04.693734+0000","last_undegraded":"2024-09-16T07:29:04.693734+0000","last_fullsized":"2024-09-16T07:29:04.693734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:24.910304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690886+0000","last_change":"2024-09-16T07:29:04.686063+0000","last_active":"2024-09-16T07:29:04.690886+0000","last_peered":"2024-09-16T07:29:04.690886+0000","last_clean":"2024-09-16T07:29:04.690886+0000","last_became_active":"2024-09-16T07:29:04.685265+0000","last_became_peered":"2024-09-16T07:29:04.685265+0000","last_unstale":"2024-09-16T07:29:04.690886+0000","last_undegraded":"2024-09-16T07:29:04.690886+0000","last_fullsized":"2024-09-16T07:29:04.690886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:56:33.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692403+0000","last_change":"2024-09-16T07:29:04.688075+0000","last_active":"2024-09-16T07:29:04.692403+0000","last_peered":"2024-09-16T07:29:04.692403+0000","last_clean":"2024-09-16T07:29:04.692403+0000","last_became_active":"2024-09-16T07:29:04.687842+0000","last_became_peered":"2024-09-16T07:29:04.687842+0000","last_unstale":"2024-09-16T07:29:04.692403+0000","last_undegraded":"2024-09-16T07:29:04.692403+0000","last_fullsized":"2024-09-16T07:29:04.692403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:18.498467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694267+0000","last_change":"2024-09-16T07:29:04.692249+0000","last_active":"2024-09-16T07:29:04.694267+0000","last_peered":"2024-09-16T07:29:04.694267+0000","last_clean":"2024-09-16T07:29:04.694267+0000","last_became_active":"2024-09-16T07:29:04.691889+0000","last_became_peered":"2024-09-16T07:29:04.691889+0000","last_unstale":"2024-09-16T07:29:04.694267+0000","last_undegraded":"2024-09-16T07:29:04.694267+0000","last_fullsized":"2024-09-16T07:29:04.694267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.693863+0000","last_change":"2024-09-16T07:29:04.689801+0000","last_active":"2024-09-16T07:29:04.693863+0000","last_peered":"2024-09-16T07:29:04.693863+0000","last_clean":"2024-09-16T07:29:04.693863+0000","last_became_active":"2024-09-16T07:29:04.689407+0000","last_became_peered":"2024-09-16T07:29:04.689407+0000","last_unstale":"2024-09-16T07:29:04.693863+0000","last_undegraded":"2024-09-16T07:29:04.693863+0000","last_fullsized":"2024-09-16T07:29:04.693863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:00.875663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.679001+0000","last_change":"2024-09-16T07:29:04.679001+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.679001+0000","last_undegraded":"2024-09-16T07:29:04.679001+0000","last_fullsized":"2024-09-16T07:29:04.679001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.694168+0000","last_change":"2024-09-16T07:29:04.689517+0000","last_active":"2024-09-16T07:29:04.694168+0000","last_peered":"2024-09-16T07:29:04.694168+0000","last_clean":"2024-09-16T07:29:04.694168+0000","last_became_active":"2024-09-16T07:29:04.689245+0000","last_became_peered":"2024-09-16T07:29:04.689245+0000","last_unstale":"2024-09-16T07:29:04.694168+0000","last_undegraded":"2024-09-16T07:29:04.694168+0000","last_fullsized":"2024-09-16T07:29:04.694168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:24.593805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:04.656093+0000","last_change":"2024-09-16T07:29:04.656093+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.656093+0000","last_undegraded":"2024-09-16T07:29:04.656093+0000","last_fullsized":"2024-09-16T07:29:04.656093+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690176+0000","last_change":"2024-09-16T07:29:04.680088+0000","last_active":"2024-09-16T07:29:04.690176+0000","last_peered":"2024-09-16T07:29:04.690176+0000","last_clean":"2024-09-16T07:29:04.690176+0000","last_became_active":"2024-09-16T07:29:04.679832+0000","last_became_peered":"2024-09-16T07:29:04.679832+0000","last_unstale":"2024-09-16T07:29:04.690176+0000","last_undegraded":"2024-09-16T07:29:04.690176+0000","last_fullsized":"2024-09-16T07:29:04.690176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.670954+0000","last_change":"2024-09-16T07:29:04.670954+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.670954+0000","last_undegraded":"2024-09-16T07:29:04.670954+0000","last_fullsized":"2024-09-16T07:29:04.670954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.683388+0000","last_change":"2024-09-16T07:29:04.679959+0000","last_active":"2024-09-16T07:29:04.683388+0000","last_peered":"2024-09-16T07:29:04.683388+0000","last_clean":"2024-09-16T07:29:04.683388+0000","last_became_active":"2024-09-16T07:29:04.679699+0000","last_became_peered":"2024-09-16T07:29:04.679699+0000","last_unstale":"2024-09-16T07:29:04.683388+0000","last_undegraded":"2024-09-16T07:29:04.683388+0000","last_fullsized":"2024-09-16T07:29:04.683388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:46.134632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.675338+0000","last_change":"2024-09-16T07:29:04.675338+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.675338+0000","last_undegraded":"2024-09-16T07:29:04.675338+0000","last_fullsized":"2024-09-16T07:29:04.675338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.689989+0000","last_change":"2024-09-16T07:29:04.685192+0000","last_active":"2024-09-16T07:29:04.689989+0000","last_peered":"2024-09-16T07:29:04.689989+0000","last_clean":"2024-09-16T07:29:04.689989+0000","last_became_active":"2024-09-16T07:29:04.684971+0000","last_became_peered":"2024-09-16T07:29:04.684971+0000","last_unstale":"2024-09-16T07:29:04.689989+0000","last_undegraded":"2024-09-16T07:29:04.689989+0000","last_fullsized":"2024-09-16T07:29:04.689989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.671448+0000","last_change":"2024-09-16T07:29:04.671448+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.671448+0000","last_undegraded":"2024-09-16T07:29:04.671448+0000","last_fullsized":"2024-09-16T07:29:04.671448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692429+0000","last_change":"2024-09-16T07:29:04.688174+0000","last_active":"2024-09-16T07:29:04.692429+0000","last_peered":"2024-09-16T07:29:04.692429+0000","last_clean":"2024-09-16T07:29:04.692429+0000","last_became_active":"2024-09-16T07:29:04.687913+0000","last_became_peered":"2024-09-16T07:29:04.687913+0000","last_unstale":"2024-09-16T07:29:04.692429+0000","last_undegraded":"2024-09-16T07:29:04.692429+0000","last_fullsized":"2024-09-16T07:29:04.692429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:27:22.965785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.674204+0000","last_change":"2024-09-16T07:29:04.674204+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.674204+0000","last_undegraded":"2024-09-16T07:29:04.674204+0000","last_fullsized":"2024-09-16T07:29:04.674204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.690016+0000","last_change":"2024-09-16T07:29:04.683463+0000","last_active":"2024-09-16T07:29:04.690016+0000","last_peered":"2024-09-16T07:29:04.690016+0000","last_clean":"2024-09-16T07:29:04.690016+0000","last_became_active":"2024-09-16T07:29:04.682288+0000","last_became_peered":"2024-09-16T07:29:04.682288+0000","last_unstale":"2024-09-16T07:29:04.690016+0000","last_undegraded":"2024-09-16T07:29:04.690016+0000","last_fullsized":"2024-09-16T07:29:04.690016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.672318+0000","last_change":"2024-09-16T07:29:04.672318+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.672318+0000","last_undegraded":"2024-09-16T07:29:04.672318+0000","last_fullsized":"2024-09-16T07:29:04.672318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.688386+0000","last_change":"2024-09-16T07:29:04.682025+0000","last_active":"2024-09-16T07:29:04.688386+0000","last_peered":"2024-09-16T07:29:04.688386+0000","last_clean":"2024-09-16T07:29:04.688386+0000","last_became_active":"2024-09-16T07:29:04.681723+0000","last_became_peered":"2024-09-16T07:29:04.681723+0000","last_unstale":"2024-09-16T07:29:04.688386+0000","last_undegraded":"2024-09-16T07:29:04.688386+0000","last_fullsized":"2024-09-16T07:29:04.688386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:15.463329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.669857+0000","last_change":"2024-09-16T07:29:04.669857+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.669857+0000","last_undegraded":"2024-09-16T07:29:04.669857+0000","last_fullsized":"2024-09-16T07:29:04.669857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.692245+0000","last_change":"2024-09-16T07:29:04.688723+0000","last_active":"2024-09-16T07:29:04.692245+0000","last_peered":"2024-09-16T07:29:04.692245+0000","last_clean":"2024-09-16T07:29:04.692245+0000","last_became_active":"2024-09-16T07:29:04.688446+0000","last_became_peered":"2024-09-16T07:29:04.688446+0000","last_unstale":"2024-09-16T07:29:04.692245+0000","last_undegraded":"2024-09-16T07:29:04.692245+0000","last_fullsized":"2024-09-16T07:29:04.692245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:37.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T07:29:04.677118+0000","last_change":"2024-09-16T07:29:04.677118+0000","last_active":"2024-09-16T07:29:04.656093+0000","last_peered":"2024-09-16T07:29:04.656093+0000","last_clean":"2024-09-16T07:29:04.656093+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:04.677118+0000","last_undegraded":"2024-09-16T07:29:04.677118+0000","last_fullsized":"2024-09-16T07:29:04.677118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.689769+0000","last_change":"2024-09-16T07:29:04.684672+0000","last_active":"2024-09-16T07:29:04.689769+0000","last_peered":"2024-09-16T07:29:04.689769+0000","last_clean":"2024-09-16T07:29:04.689769+0000","last_became_active":"2024-09-16T07:29:04.684435+0000","last_became_peered":"2024-09-16T07:29:04.684435+0000","last_unstale":"2024-09-16T07:29:04.689769+0000","last_undegraded":"2024-09-16T07:29:04.689769+0000","last_fullsized":"2024-09-16T07:29:04.689769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":127,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T07:29:04.685746+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:04.685746+0000","last_peered":"2024-09-16T07:29:04.685746+0000","last_clean":"2024-09-16T07:29:04.685746+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:04.685746+0000","last_undegraded":"2024-09-16T07:29:04.685746+0000","last_fullsized":"2024-09-16T07:29:04.685746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":716769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":710502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:10.601 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-16T07:29:10.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672504+0000', 'last_change': '2024-09-16T07:29:04.672504+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672504+0000', 'last_undegraded': '2024-09-16T07:29:04.672504+0000', 'last_fullsized': '2024-09-16T07:29:04.672504+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.673233+0000', 'last_change': '2024-09-16T07:29:04.673233+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.673233+0000', 'last_undegraded': '2024-09-16T07:29:04.673233+0000', 'last_fullsized': '2024-09-16T07:29:04.673233+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.670033+0000', 'last_change': '2024-09-16T07:29:04.670033+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.670033+0000', 'last_undegraded': '2024-09-16T07:29:04.670033+0000', 'last_fullsized': '2024-09-16T07:29:04.670033+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.676318+0000', 'last_change': '2024-09-16T07:29:04.676318+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.676318+0000', 'last_undegraded': '2024-09-16T07:29:04.676318+0000', 'last_fullsized': '2024-09-16T07:29:04.676318+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.673431+0000', 'last_change': '2024-09-16T07:29:04.673431+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.673431+0000', 'last_undegraded': '2024-09-16T07:29:04.673431+0000', 'last_fullsized': '2024-09-16T07:29:04.673431+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.602 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.678191+0000', 'last_change': '2024-09-16T07:29:04.678191+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.678191+0000', 'last_undegraded': '2024-09-16T07:29:04.678191+0000', 'last_fullsized': '2024-09-16T07:29:04.678191+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.685524+0000', 'last_change': '2024-09-16T07:29:04.685524+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.685524+0000', 'last_undegraded': '2024-09-16T07:29:04.685524+0000', 'last_fullsized': '2024-09-16T07:29:04.685524+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.673772+0000', 'last_change': '2024-09-16T07:29:04.673772+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.673772+0000', 'last_undegraded': '2024-09-16T07:29:04.673772+0000', 'last_fullsized': '2024-09-16T07:29:04.673772+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.675096+0000', 'last_change': '2024-09-16T07:29:04.675096+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.675096+0000', 'last_undegraded': '2024-09-16T07:29:04.675096+0000', 'last_fullsized': '2024-09-16T07:29:04.675096+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-16T07:29:10.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.681652+0000', 'last_change': '2024-09-16T07:29:04.681652+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.681652+0000', 'last_undegraded': '2024-09-16T07:29:04.681652+0000', 'last_fullsized': '2024-09-16T07:29:04.681652+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.669774+0000', 'last_change': '2024-09-16T07:29:04.669774+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.669774+0000', 'last_undegraded': '2024-09-16T07:29:04.669774+0000', 'last_fullsized': '2024-09-16T07:29:04.669774+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672895+0000', 'last_change': '2024-09-16T07:29:04.672895+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672895+0000', 'last_undegraded': '2024-09-16T07:29:04.672895+0000', 'last_fullsized': '2024-09-16T07:29:04.672895+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.669437+0000', 'last_change': '2024-09-16T07:29:04.669437+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.669437+0000', 'last_undegraded': '2024-09-16T07:29:04.669437+0000', 'last_fullsized': '2024-09-16T07:29:04.669437+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-16T07:29:10.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.680192+0000', 'last_change': '2024-09-16T07:29:04.680192+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.680192+0000', 'last_undegraded': '2024-09-16T07:29:04.680192+0000', 'last_fullsized': '2024-09-16T07:29:04.680192+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.678625+0000', 'last_change': '2024-09-16T07:29:04.678625+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.678625+0000', 'last_undegraded': '2024-09-16T07:29:04.678625+0000', 'last_fullsized': '2024-09-16T07:29:04.678625+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672815+0000', 'last_change': '2024-09-16T07:29:04.672815+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672815+0000', 'last_undegraded': '2024-09-16T07:29:04.672815+0000', 'last_fullsized': '2024-09-16T07:29:04.672815+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672387+0000', 'last_change': '2024-09-16T07:29:04.672387+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672387+0000', 'last_undegraded': '2024-09-16T07:29:04.672387+0000', 'last_fullsized': '2024-09-16T07:29:04.672387+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.675057+0000', 'last_change': '2024-09-16T07:29:04.675057+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.675057+0000', 'last_undegraded': '2024-09-16T07:29:04.675057+0000', 'last_fullsized': '2024-09-16T07:29:04.675057+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.605 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.669090+0000', 'last_change': '2024-09-16T07:29:04.669090+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.669090+0000', 'last_undegraded': '2024-09-16T07:29:04.669090+0000', 'last_fullsized': '2024-09-16T07:29:04.669090+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672995+0000', 'last_change': '2024-09-16T07:29:04.672995+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672995+0000', 'last_undegraded': '2024-09-16T07:29:04.672995+0000', 'last_fullsized': '2024-09-16T07:29:04.672995+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.668637+0000', 'last_change': '2024-09-16T07:29:04.668637+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.668637+0000', 'last_undegraded': '2024-09-16T07:29:04.668637+0000', 'last_fullsized': '2024-09-16T07:29:04.668637+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.678265+0000', 'last_change': '2024-09-16T07:29:04.678265+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.678265+0000', 'last_undegraded': '2024-09-16T07:29:04.678265+0000', 'last_fullsized': '2024-09-16T07:29:04.678265+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.606 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672293+0000', 'last_change': '2024-09-16T07:29:04.672293+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672293+0000', 'last_undegraded': '2024-09-16T07:29:04.672293+0000', 'last_fullsized': '2024-09-16T07:29:04.672293+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.678924+0000', 'last_change': '2024-09-16T07:29:04.678924+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.678924+0000', 'last_undegraded': '2024-09-16T07:29:04.678924+0000', 'last_fullsized': '2024-09-16T07:29:04.678924+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.669239+0000', 'last_change': '2024-09-16T07:29:04.669239+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.669239+0000', 'last_undegraded': '2024-09-16T07:29:04.669239+0000', 'last_fullsized': '2024-09-16T07:29:04.669239+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.674613+0000', 'last_change': '2024-09-16T07:29:04.674613+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.674613+0000', 'last_undegraded': '2024-09-16T07:29:04.674613+0000', 'last_fullsized': '2024-09-16T07:29:04.674613+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.681817+0000', 'last_change': '2024-09-16T07:29:04.681817+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.681817+0000', 'last_undegraded': '2024-09-16T07:29:04.681817+0000', 'last_fullsized': '2024-09-16T07:29:04.681817+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.607 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-16T07:29:10.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.673382+0000', 'last_change': '2024-09-16T07:29:04.673382+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.673382+0000', 'last_undegraded': '2024-09-16T07:29:04.673382+0000', 'last_fullsized': '2024-09-16T07:29:04.673382+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:10.608 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-16T07:29:10.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.685114+0000', 'last_change': '2024-09-16T07:29:04.685114+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.685114+0000', 'last_undegraded': '2024-09-16T07:29:04.685114+0000', 'last_fullsized': '2024-09-16T07:29:04.685114+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.608 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-16T07:29:10.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.675055+0000', 'last_change': '2024-09-16T07:29:04.675055+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.675055+0000', 'last_undegraded': '2024-09-16T07:29:04.675055+0000', 'last_fullsized': '2024-09-16T07:29:04.675055+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:10.608 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-16T07:29:10.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.671994+0000', 'last_change': '2024-09-16T07:29:04.671994+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.671994+0000', 'last_undegraded': '2024-09-16T07:29:04.671994+0000', 'last_fullsized': '2024-09-16T07:29:04.671994+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.675420+0000', 'last_change': '2024-09-16T07:29:04.675420+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.675420+0000', 'last_undegraded': '2024-09-16T07:29:04.675420+0000', 'last_fullsized': '2024-09-16T07:29:04.675420+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.678265+0000', 'last_change': '2024-09-16T07:29:04.678265+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.678265+0000', 'last_undegraded': '2024-09-16T07:29:04.678265+0000', 'last_fullsized': '2024-09-16T07:29:04.678265+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:03.665077+0000', 'last_change': '2024-09-16T07:29:03.665077+0000', 'last_active': '2024-09-16T07:29:03.647610+0000', 'last_peered': '2024-09-16T07:29:03.647610+0000', 'last_clean': '2024-09-16T07:29:03.647610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:03.665077+0000', 'last_undegraded': '2024-09-16T07:29:03.665077+0000', 'last_fullsized': '2024-09-16T07:29:03.665077+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:03.647610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:03.647610+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:03.647610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.677120+0000', 'last_change': '2024-09-16T07:29:04.677120+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.677120+0000', 'last_undegraded': '2024-09-16T07:29:04.677120+0000', 'last_fullsized': '2024-09-16T07:29:04.677120+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.609 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.668249+0000', 'last_change': '2024-09-16T07:29:04.668249+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.668249+0000', 'last_undegraded': '2024-09-16T07:29:04.668249+0000', 'last_fullsized': '2024-09-16T07:29:04.668249+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.669129+0000', 'last_change': '2024-09-16T07:29:04.669129+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.669129+0000', 'last_undegraded': '2024-09-16T07:29:04.669129+0000', 'last_fullsized': '2024-09-16T07:29:04.669129+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.670019+0000', 'last_change': '2024-09-16T07:29:04.670019+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.670019+0000', 'last_undegraded': '2024-09-16T07:29:04.670019+0000', 'last_fullsized': '2024-09-16T07:29:04.670019+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.671856+0000', 'last_change': '2024-09-16T07:29:04.671856+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.671856+0000', 'last_undegraded': '2024-09-16T07:29:04.671856+0000', 'last_fullsized': '2024-09-16T07:29:04.671856+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-16T07:29:10.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.673791+0000', 'last_change': '2024-09-16T07:29:04.673791+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.673791+0000', 'last_undegraded': '2024-09-16T07:29:04.673791+0000', 'last_fullsized': '2024-09-16T07:29:04.673791+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672673+0000', 'last_change': '2024-09-16T07:29:04.672673+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672673+0000', 'last_undegraded': '2024-09-16T07:29:04.672673+0000', 'last_fullsized': '2024-09-16T07:29:04.672673+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.670459+0000', 'last_change': '2024-09-16T07:29:04.670459+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.670459+0000', 'last_undegraded': '2024-09-16T07:29:04.670459+0000', 'last_fullsized': '2024-09-16T07:29:04.670459+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.678504+0000', 'last_change': '2024-09-16T07:29:04.678504+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.678504+0000', 'last_undegraded': '2024-09-16T07:29:04.678504+0000', 'last_fullsized': '2024-09-16T07:29:04.678504+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-16T07:29:10.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672148+0000', 'last_change': '2024-09-16T07:29:04.672148+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672148+0000', 'last_undegraded': '2024-09-16T07:29:04.672148+0000', 'last_fullsized': '2024-09-16T07:29:04.672148+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.682375+0000', 'last_change': '2024-09-16T07:29:04.682375+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.682375+0000', 'last_undegraded': '2024-09-16T07:29:04.682375+0000', 'last_fullsized': '2024-09-16T07:29:04.682375+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.670878+0000', 'last_change': '2024-09-16T07:29:04.670878+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.670878+0000', 'last_undegraded': '2024-09-16T07:29:04.670878+0000', 'last_fullsized': '2024-09-16T07:29:04.670878+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.673245+0000', 'last_change': '2024-09-16T07:29:04.673245+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.673245+0000', 'last_undegraded': '2024-09-16T07:29:04.673245+0000', 'last_fullsized': '2024-09-16T07:29:04.673245+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.671321+0000', 'last_change': '2024-09-16T07:29:04.671321+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.671321+0000', 'last_undegraded': '2024-09-16T07:29:04.671321+0000', 'last_fullsized': '2024-09-16T07:29:04.671321+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-16T07:29:10.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.675900+0000', 'last_change': '2024-09-16T07:29:04.675900+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.675900+0000', 'last_undegraded': '2024-09-16T07:29:04.675900+0000', 'last_fullsized': '2024-09-16T07:29:04.675900+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-16T07:29:10.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.679001+0000', 'last_change': '2024-09-16T07:29:04.679001+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.679001+0000', 'last_undegraded': '2024-09-16T07:29:04.679001+0000', 'last_fullsized': '2024-09-16T07:29:04.679001+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T07:29:04.656093+0000', 'last_change': '2024-09-16T07:29:04.656093+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.656093+0000', 'last_undegraded': '2024-09-16T07:29:04.656093+0000', 'last_fullsized': '2024-09-16T07:29:04.656093+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.670954+0000', 'last_change': '2024-09-16T07:29:04.670954+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.670954+0000', 'last_undegraded': '2024-09-16T07:29:04.670954+0000', 'last_fullsized': '2024-09-16T07:29:04.670954+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.675338+0000', 'last_change': '2024-09-16T07:29:04.675338+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.675338+0000', 'last_undegraded': '2024-09-16T07:29:04.675338+0000', 'last_fullsized': '2024-09-16T07:29:04.675338+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-16T07:29:10.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.671448+0000', 'last_change': '2024-09-16T07:29:04.671448+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.671448+0000', 'last_undegraded': '2024-09-16T07:29:04.671448+0000', 'last_fullsized': '2024-09-16T07:29:04.671448+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.674204+0000', 'last_change': '2024-09-16T07:29:04.674204+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.674204+0000', 'last_undegraded': '2024-09-16T07:29:04.674204+0000', 'last_fullsized': '2024-09-16T07:29:04.674204+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.672318+0000', 'last_change': '2024-09-16T07:29:04.672318+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.672318+0000', 'last_undegraded': '2024-09-16T07:29:04.672318+0000', 'last_fullsized': '2024-09-16T07:29:04.672318+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.669857+0000', 'last_change': '2024-09-16T07:29:04.669857+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.669857+0000', 'last_undegraded': '2024-09-16T07:29:04.669857+0000', 'last_fullsized': '2024-09-16T07:29:04.669857+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-16T07:29:10.615 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:04.677118+0000', 'last_change': '2024-09-16T07:29:04.677118+0000', 'last_active': '2024-09-16T07:29:04.656093+0000', 'last_peered': '2024-09-16T07:29:04.656093+0000', 'last_clean': '2024-09-16T07:29:04.656093+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:04.677118+0000', 'last_undegraded': '2024-09-16T07:29:04.677118+0000', 'last_fullsized': '2024-09-16T07:29:04.677118+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:04.656093+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:10.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:29:10.651 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-16T07:29:10.648+0000 7f81d0800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:29:10.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- 172.21.15.114:0/4060649328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900b2d00 msgr2=0x7f319015fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 --2- 172.21.15.114:0/4060649328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900b2d00 0x7f319015fec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f317c009900 tx=0x7f317c01c850 comp rx=0 tx=0).stop 2024-09-16T07:29:10.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- 172.21.15.114:0/4060649328 shutdown_connections 2024-09-16T07:29:10.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 --2- 172.21.15.114:0/4060649328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900b2d00 0x7f319015fec0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 --2- 172.21.15.114:0/4060649328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31900cfe80 0x7f31900d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- 172.21.15.114:0/4060649328 >> 172.21.15.114:0/4060649328 conn(0x7f31900d1e40 msgr2=0x7f31900d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:10.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- 172.21.15.114:0/4060649328 shutdown_connections 2024-09-16T07:29:10.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- 172.21.15.114:0/4060649328 wait complete. 2024-09-16T07:29:10.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 Processor -- start 2024-09-16T07:29:10.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- start start 2024-09-16T07:29:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31900b2d00 0x7f3190159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900cfe80 0x7f319015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3190160400 0x7f31901fb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f31901695d0 con 0x7f31900cfe80 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3190169450 con 0x7f31900b2d00 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.780+0000 7f3198600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3190169750 con 0x7f3190160400 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900cfe80 0x7f319015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900cfe80 0x7f319015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50504/0 (socket says 172.21.15.114:50504) 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31900b2d00 0x7f3190159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 -- 172.21.15.114:0/1154635804 learned_addr learned my addr 172.21.15.114:0/1154635804 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3196600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3190160400 0x7f31901fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 -- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3190160400 msgr2=0x7f31901fb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3190160400 0x7f31901fb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 -- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31900b2d00 msgr2=0x7f3190159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31900b2d00 0x7f3190159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 -- 172.21.15.114:0/1154635804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31900cb5b0 con 0x7f31900cfe80 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3195200640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900cfe80 0x7f319015d690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f317c009850 tx=0x7f317c0a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f318d600640 1 -- 172.21.15.114:0/1154635804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c0b2040 con 0x7f31900cfe80 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f318d600640 1 -- 172.21.15.114:0/1154635804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f317c004380 con 0x7f31900cfe80 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f318d600640 1 -- 172.21.15.114:0/1154635804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c0052d0 con 0x7f31900cfe80 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31900cb890 con 0x7f31900cfe80 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31900cbe50 con 0x7f31900cfe80 2024-09-16T07:29:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319015fec0 con 0x7f31900cfe80 2024-09-16T07:29:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.784+0000 7f318d600640 1 -- 172.21.15.114:0/1154635804 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f317c005470 con 0x7f31900cfe80 2024-09-16T07:29:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.788+0000 7f318d600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3170072ef0 0x7f31700753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.788+0000 7f318d600640 1 -- 172.21.15.114:0/1154635804 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f317c12d720 con 0x7f31900cfe80 2024-09-16T07:29:10.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.788+0000 7f3195c00640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3170072ef0 0x7f31700753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:10.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.788+0000 7f3195c00640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3170072ef0 0x7f31700753b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f318400bc00 tx=0x7f318400b390 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:10.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:10.788+0000 7f318d600640 1 -- 172.21.15.114:0/1154635804 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f317c0164d0 con 0x7f31900cfe80 2024-09-16T07:29:11.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.016+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f31900aeee0 con 0x7f31900cfe80 2024-09-16T07:29:11.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.016+0000 7f318d600640 1 -- 172.21.15.114:0/1154635804 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2764 (secure 0 0 0) 0x7f317c0f83b0 con 0x7f31900cfe80 2024-09-16T07:29:11.021 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:11.021 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":32},{"state_name":"unknown","count":8}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225271808,"bytes_avail":772868841472,"bytes_total":773094113280,"unknown_pgs_ratio":0.082474224269390106,"inactive_pgs_ratio":0.58762884140014648},"fsmap":{"epoch":17,"btime":"2024-09-16T07:29:08:699247+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4837}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:29:03.003688+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T07:29:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3170072ef0 msgr2=0x7f31700753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3170072ef0 0x7f31700753b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f318400bc00 tx=0x7f318400b390 comp rx=0 tx=0).stop 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900cfe80 msgr2=0x7f319015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900cfe80 0x7f319015d690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f317c009850 tx=0x7f317c0a5590 comp rx=0 tx=0).stop 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 shutdown_connections 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3170072ef0 0x7f31700753b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3190160400 0x7f31901fb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31900cfe80 0x7f319015d690 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 --2- 172.21.15.114:0/1154635804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31900b2d00 0x7f3190159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 >> 172.21.15.114:0/1154635804 conn(0x7f31900d1e40 msgr2=0x7f3190075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 shutdown_connections 2024-09-16T07:29:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.020+0000 7f3198600640 1 -- 172.21.15.114:0/1154635804 wait complete. 2024-09-16T07:29:11.043 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:29:11.043 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:11.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 -- 172.21.15.114:0/2730869045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 msgr2=0x7fe1cc005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:11.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2730869045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1cc005da0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00016f0 tx=0x7fe1d001c750 comp rx=0 tx=0).stop 2024-09-16T07:29:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 -- 172.21.15.114:0/2730869045 shutdown_connections 2024-09-16T07:29:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2730869045 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1cc005da0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 -- 172.21.15.114:0/2730869045 >> 172.21.15.114:0/2730869045 conn(0x7fe1e80b18f0 msgr2=0x7fe1e80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 -- 172.21.15.114:0/2730869045 shutdown_connections 2024-09-16T07:29:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 -- 172.21.15.114:0/2730869045 wait complete. 2024-09-16T07:29:11.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 Processor -- start 2024-09-16T07:29:11.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.224+0000 7fe1ef800640 1 -- start start 2024-09-16T07:29:11.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1e81e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:11.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e81e91b0 0x7fe1e806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:11.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1e806f5f0 0x7fe1e809c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e80cec20 con 0x7fe1cc005920 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e80ceaa0 con 0x7fe1e81e91b0 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e80ceda0 con 0x7fe1e806f5f0 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1e81e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1e81e9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50520/0 (socket says 172.21.15.114:50520) 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 -- 172.21.15.114:0/2332244049 learned_addr learned my addr 172.21.15.114:0/2332244049 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ed800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1e806f5f0 0x7fe1e809c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 -- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1e806f5f0 msgr2=0x7fe1e809c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1dfe00640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e81e91b0 0x7fe1e806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1e806f5f0 0x7fe1e809c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 -- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e81e91b0 msgr2=0x7fe1e806f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:11.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e81e91b0 0x7fe1e806f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 -- 172.21.15.114:0/2332244049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e81fb8a0 con 0x7fe1cc005920 2024-09-16T07:29:11.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ed800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1e806f5f0 0x7fe1e809c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:11.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ece00640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1e81e9db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8011a70 tx=0x7fe1d8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:11.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1e5600640 1 -- 172.21.15.114:0/2332244049 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d801e070 con 0x7fe1cc005920 2024-09-16T07:29:11.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1e5600640 1 -- 172.21.15.114:0/2332244049 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1d8004460 con 0x7fe1cc005920 2024-09-16T07:29:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1e5600640 1 -- 172.21.15.114:0/2332244049 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800fc60 con 0x7fe1cc005920 2024-09-16T07:29:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e81fbb80 con 0x7fe1cc005920 2024-09-16T07:29:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e81fc140 con 0x7fe1cc005920 2024-09-16T07:29:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.228+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e8069410 con 0x7fe1cc005920 2024-09-16T07:29:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.232+0000 7fe1e5600640 1 -- 172.21.15.114:0/2332244049 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fe1d8021070 con 0x7fe1cc005920 2024-09-16T07:29:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.232+0000 7fe1e5600640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe1c4072ec0 0x7fe1c4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.232+0000 7fe1e5600640 1 -- 172.21.15.114:0/2332244049 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d8094870 con 0x7fe1cc005920 2024-09-16T07:29:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.232+0000 7fe1dfe00640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe1c4072ec0 0x7fe1c4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.232+0000 7fe1dfe00640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe1c4072ec0 0x7fe1c4075380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00016c0 tx=0x7fe1d0019540 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.236+0000 7fe1e5600640 1 -- 172.21.15.114:0/2332244049 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe1d805f3d0 con 0x7fe1cc005920 2024-09-16T07:29:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.404+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1e806f9d0 con 0x7fe1c4072ec0 2024-09-16T07:29:11.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.408+0000 7fe1e5600640 1 -- 172.21.15.114:0/2332244049 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7fe1e806f9d0 con 0x7fe1c4072ec0 2024-09-16T07:29:11.414 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:11.415 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:11.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe1c4072ec0 msgr2=0x7fe1c4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe1c4072ec0 0x7fe1c4075380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00016c0 tx=0x7fe1d0019540 comp rx=0 tx=0).stop 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 msgr2=0x7fe1e81e9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1e81e9db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8011a70 tx=0x7fe1d8011f30 comp rx=0 tx=0).stop 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 shutdown_connections 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe1c4072ec0 0x7fe1c4075380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1e806f5f0 0x7fe1e809c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe1e81e91b0 0x7fe1e806f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 --2- 172.21.15.114:0/2332244049 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1cc005920 0x7fe1e81e9db0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 >> 172.21.15.114:0/2332244049 conn(0x7fe1e80b18f0 msgr2=0x7fe1e80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 shutdown_connections 2024-09-16T07:29:11.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:11.412+0000 7fe1ef800640 1 -- 172.21.15.114:0/2332244049 wait complete. 2024-09-16T07:29:11.435 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-16T07:29:11.005032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220308,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754412,"statfs":{"total":773094113280,"available":772868517888,"internally_reserved":0,"allocated":4169728,"data_stored":2301364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.339119"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991282+0000","last_change":"2024-09-16T07:29:05.688893+0000","last_active":"2024-09-16T07:29:07.991282+0000","last_peered":"2024-09-16T07:29:07.991282+0000","last_clean":"2024-09-16T07:29:07.991282+0000","last_became_active":"2024-09-16T07:29:05.688458+0000","last_became_peered":"2024-09-16T07:29:05.688458+0000","last_unstale":"2024-09-16T07:29:07.991282+0000","last_undegraded":"2024-09-16T07:29:07.991282+0000","last_fullsized":"2024-09-16T07:29:07.991282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:47.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691867+0000","last_change":"2024-09-16T07:29:05.716226+0000","last_active":"2024-09-16T07:29:06.691867+0000","last_peered":"2024-09-16T07:29:06.691867+0000","last_clean":"2024-09-16T07:29:06.691867+0000","last_became_active":"2024-09-16T07:29:05.716004+0000","last_became_peered":"2024-09-16T07:29:05.716004+0000","last_unstale":"2024-09-16T07:29:06.691867+0000","last_undegraded":"2024-09-16T07:29:06.691867+0000","last_fullsized":"2024-09-16T07:29:06.691867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:34.648432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699097+0000","last_change":"2024-09-16T07:29:05.703481+0000","last_active":"2024-09-16T07:29:06.699097+0000","last_peered":"2024-09-16T07:29:06.699097+0000","last_clean":"2024-09-16T07:29:06.699097+0000","last_became_active":"2024-09-16T07:29:05.702985+0000","last_became_peered":"2024-09-16T07:29:05.702985+0000","last_unstale":"2024-09-16T07:29:06.699097+0000","last_undegraded":"2024-09-16T07:29:06.699097+0000","last_fullsized":"2024-09-16T07:29:06.699097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:34:33.437563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551973+0000","last_change":"2024-09-16T07:29:05.705272+0000","last_active":"2024-09-16T07:29:07.551973+0000","last_peered":"2024-09-16T07:29:07.551973+0000","last_clean":"2024-09-16T07:29:07.551973+0000","last_became_active":"2024-09-16T07:29:05.704998+0000","last_became_peered":"2024-09-16T07:29:05.704998+0000","last_unstale":"2024-09-16T07:29:07.551973+0000","last_undegraded":"2024-09-16T07:29:07.551973+0000","last_fullsized":"2024-09-16T07:29:07.551973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:29.777189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988570+0000","last_change":"2024-09-16T07:29:05.705903+0000","last_active":"2024-09-16T07:29:07.988570+0000","last_peered":"2024-09-16T07:29:07.988570+0000","last_clean":"2024-09-16T07:29:07.988570+0000","last_became_active":"2024-09-16T07:29:05.705624+0000","last_became_peered":"2024-09-16T07:29:05.705624+0000","last_unstale":"2024-09-16T07:29:07.988570+0000","last_undegraded":"2024-09-16T07:29:07.988570+0000","last_fullsized":"2024-09-16T07:29:07.988570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:46:49.930994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691456+0000","last_change":"2024-09-16T07:29:05.691278+0000","last_active":"2024-09-16T07:29:06.691456+0000","last_peered":"2024-09-16T07:29:06.691456+0000","last_clean":"2024-09-16T07:29:06.691456+0000","last_became_active":"2024-09-16T07:29:05.690563+0000","last_became_peered":"2024-09-16T07:29:05.690563+0000","last_unstale":"2024-09-16T07:29:06.691456+0000","last_undegraded":"2024-09-16T07:29:06.691456+0000","last_fullsized":"2024-09-16T07:29:06.691456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:04.901751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990810+0000","last_change":"2024-09-16T07:29:05.695672+0000","last_active":"2024-09-16T07:29:07.990810+0000","last_peered":"2024-09-16T07:29:07.990810+0000","last_clean":"2024-09-16T07:29:07.990810+0000","last_became_active":"2024-09-16T07:29:05.694840+0000","last_became_peered":"2024-09-16T07:29:05.694840+0000","last_unstale":"2024-09-16T07:29:07.990810+0000","last_undegraded":"2024-09-16T07:29:07.990810+0000","last_fullsized":"2024-09-16T07:29:07.990810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:58.013913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.989875+0000","last_change":"2024-09-16T07:29:05.713582+0000","last_active":"2024-09-16T07:29:07.989875+0000","last_peered":"2024-09-16T07:29:07.989875+0000","last_clean":"2024-09-16T07:29:07.989875+0000","last_became_active":"2024-09-16T07:29:05.713358+0000","last_became_peered":"2024-09-16T07:29:05.713358+0000","last_unstale":"2024-09-16T07:29:07.989875+0000","last_undegraded":"2024-09-16T07:29:07.989875+0000","last_fullsized":"2024-09-16T07:29:07.989875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:29.777189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700979+0000","last_change":"2024-09-16T07:29:05.706503+0000","last_active":"2024-09-16T07:29:06.700979+0000","last_peered":"2024-09-16T07:29:06.700979+0000","last_clean":"2024-09-16T07:29:06.700979+0000","last_became_active":"2024-09-16T07:29:05.706233+0000","last_became_peered":"2024-09-16T07:29:05.706233+0000","last_unstale":"2024-09-16T07:29:06.700979+0000","last_undegraded":"2024-09-16T07:29:06.700979+0000","last_fullsized":"2024-09-16T07:29:06.700979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:17.514384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552198+0000","last_change":"2024-09-16T07:29:05.710282+0000","last_active":"2024-09-16T07:29:07.552198+0000","last_peered":"2024-09-16T07:29:07.552198+0000","last_clean":"2024-09-16T07:29:07.552198+0000","last_became_active":"2024-09-16T07:29:05.707389+0000","last_became_peered":"2024-09-16T07:29:05.707389+0000","last_unstale":"2024-09-16T07:29:07.552198+0000","last_undegraded":"2024-09-16T07:29:07.552198+0000","last_fullsized":"2024-09-16T07:29:07.552198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:51.365024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990280+0000","last_change":"2024-09-16T07:29:05.708668+0000","last_active":"2024-09-16T07:29:07.990280+0000","last_peered":"2024-09-16T07:29:07.990280+0000","last_clean":"2024-09-16T07:29:07.990280+0000","last_became_active":"2024-09-16T07:29:05.708471+0000","last_became_peered":"2024-09-16T07:29:05.708471+0000","last_unstale":"2024-09-16T07:29:07.990280+0000","last_undegraded":"2024-09-16T07:29:07.990280+0000","last_fullsized":"2024-09-16T07:29:07.990280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:06.601020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698951+0000","last_change":"2024-09-16T07:29:05.686062+0000","last_active":"2024-09-16T07:29:06.698951+0000","last_peered":"2024-09-16T07:29:06.698951+0000","last_clean":"2024-09-16T07:29:06.698951+0000","last_became_active":"2024-09-16T07:29:05.684983+0000","last_became_peered":"2024-09-16T07:29:05.684983+0000","last_unstale":"2024-09-16T07:29:06.698951+0000","last_undegraded":"2024-09-16T07:29:06.698951+0000","last_fullsized":"2024-09-16T07:29:06.698951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:37.562977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988788+0000","last_change":"2024-09-16T07:29:05.688351+0000","last_active":"2024-09-16T07:29:07.988788+0000","last_peered":"2024-09-16T07:29:07.988788+0000","last_clean":"2024-09-16T07:29:07.988788+0000","last_became_active":"2024-09-16T07:29:05.688141+0000","last_became_peered":"2024-09-16T07:29:05.688141+0000","last_unstale":"2024-09-16T07:29:07.988788+0000","last_undegraded":"2024-09-16T07:29:07.988788+0000","last_fullsized":"2024-09-16T07:29:07.988788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:08:21.411855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691524+0000","last_change":"2024-09-16T07:29:05.709802+0000","last_active":"2024-09-16T07:29:06.691524+0000","last_peered":"2024-09-16T07:29:06.691524+0000","last_clean":"2024-09-16T07:29:06.691524+0000","last_became_active":"2024-09-16T07:29:05.709550+0000","last_became_peered":"2024-09-16T07:29:05.709550+0000","last_unstale":"2024-09-16T07:29:06.691524+0000","last_undegraded":"2024-09-16T07:29:06.691524+0000","last_fullsized":"2024-09-16T07:29:06.691524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:36.380404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698769+0000","last_change":"2024-09-16T07:29:05.691067+0000","last_active":"2024-09-16T07:29:06.698769+0000","last_peered":"2024-09-16T07:29:06.698769+0000","last_clean":"2024-09-16T07:29:06.698769+0000","last_became_active":"2024-09-16T07:29:05.690813+0000","last_became_peered":"2024-09-16T07:29:05.690813+0000","last_unstale":"2024-09-16T07:29:06.698769+0000","last_undegraded":"2024-09-16T07:29:06.698769+0000","last_fullsized":"2024-09-16T07:29:06.698769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:22.249670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990623+0000","last_change":"2024-09-16T07:29:05.695112+0000","last_active":"2024-09-16T07:29:07.990623+0000","last_peered":"2024-09-16T07:29:07.990623+0000","last_clean":"2024-09-16T07:29:07.990623+0000","last_became_active":"2024-09-16T07:29:05.694826+0000","last_became_peered":"2024-09-16T07:29:05.694826+0000","last_unstale":"2024-09-16T07:29:07.990623+0000","last_undegraded":"2024-09-16T07:29:07.990623+0000","last_fullsized":"2024-09-16T07:29:07.990623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:44.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990405+0000","last_change":"2024-09-16T07:29:05.697885+0000","last_active":"2024-09-16T07:29:07.990405+0000","last_peered":"2024-09-16T07:29:07.990405+0000","last_clean":"2024-09-16T07:29:07.990405+0000","last_became_active":"2024-09-16T07:29:05.697566+0000","last_became_peered":"2024-09-16T07:29:05.697566+0000","last_unstale":"2024-09-16T07:29:07.990405+0000","last_undegraded":"2024-09-16T07:29:07.990405+0000","last_fullsized":"2024-09-16T07:29:07.990405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:10.656705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691910+0000","last_change":"2024-09-16T07:29:05.709510+0000","last_active":"2024-09-16T07:29:06.691910+0000","last_peered":"2024-09-16T07:29:06.691910+0000","last_clean":"2024-09-16T07:29:06.691910+0000","last_became_active":"2024-09-16T07:29:05.709266+0000","last_became_peered":"2024-09-16T07:29:05.709266+0000","last_unstale":"2024-09-16T07:29:06.691910+0000","last_undegraded":"2024-09-16T07:29:06.691910+0000","last_fullsized":"2024-09-16T07:29:06.691910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:00:43.107309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691365+0000","last_change":"2024-09-16T07:29:05.710516+0000","last_active":"2024-09-16T07:29:06.691365+0000","last_peered":"2024-09-16T07:29:06.691365+0000","last_clean":"2024-09-16T07:29:06.691365+0000","last_became_active":"2024-09-16T07:29:05.710250+0000","last_became_peered":"2024-09-16T07:29:05.710250+0000","last_unstale":"2024-09-16T07:29:06.691365+0000","last_undegraded":"2024-09-16T07:29:06.691365+0000","last_fullsized":"2024-09-16T07:29:06.691365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:44.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988913+0000","last_change":"2024-09-16T07:29:05.703789+0000","last_active":"2024-09-16T07:29:07.988913+0000","last_peered":"2024-09-16T07:29:07.988913+0000","last_clean":"2024-09-16T07:29:07.988913+0000","last_became_active":"2024-09-16T07:29:05.703545+0000","last_became_peered":"2024-09-16T07:29:05.703545+0000","last_unstale":"2024-09-16T07:29:07.988913+0000","last_undegraded":"2024-09-16T07:29:07.988913+0000","last_fullsized":"2024-09-16T07:29:07.988913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:12:13.084835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700600+0000","last_change":"2024-09-16T07:29:05.705011+0000","last_active":"2024-09-16T07:29:06.700600+0000","last_peered":"2024-09-16T07:29:06.700600+0000","last_clean":"2024-09-16T07:29:06.700600+0000","last_became_active":"2024-09-16T07:29:05.704734+0000","last_became_peered":"2024-09-16T07:29:05.704734+0000","last_unstale":"2024-09-16T07:29:06.700600+0000","last_undegraded":"2024-09-16T07:29:06.700600+0000","last_fullsized":"2024-09-16T07:29:06.700600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:27.093090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700262+0000","last_change":"2024-09-16T07:29:05.686329+0000","last_active":"2024-09-16T07:29:06.700262+0000","last_peered":"2024-09-16T07:29:06.700262+0000","last_clean":"2024-09-16T07:29:06.700262+0000","last_became_active":"2024-09-16T07:29:05.686029+0000","last_became_peered":"2024-09-16T07:29:05.686029+0000","last_unstale":"2024-09-16T07:29:06.700262+0000","last_undegraded":"2024-09-16T07:29:06.700262+0000","last_fullsized":"2024-09-16T07:29:06.700262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:07.598934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677221+0000","last_change":"2024-09-16T07:29:05.685144+0000","last_active":"2024-09-16T07:29:07.677221+0000","last_peered":"2024-09-16T07:29:07.677221+0000","last_clean":"2024-09-16T07:29:07.677221+0000","last_became_active":"2024-09-16T07:29:05.684362+0000","last_became_peered":"2024-09-16T07:29:05.684362+0000","last_unstale":"2024-09-16T07:29:07.677221+0000","last_undegraded":"2024-09-16T07:29:07.677221+0000","last_fullsized":"2024-09-16T07:29:07.677221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:47.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698616+0000","last_change":"2024-09-16T07:29:05.681153+0000","last_active":"2024-09-16T07:29:06.698616+0000","last_peered":"2024-09-16T07:29:06.698616+0000","last_clean":"2024-09-16T07:29:06.698616+0000","last_became_active":"2024-09-16T07:29:05.680893+0000","last_became_peered":"2024-09-16T07:29:05.680893+0000","last_unstale":"2024-09-16T07:29:06.698616+0000","last_undegraded":"2024-09-16T07:29:06.698616+0000","last_fullsized":"2024-09-16T07:29:06.698616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:29:57.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552312+0000","last_change":"2024-09-16T07:29:05.707511+0000","last_active":"2024-09-16T07:29:07.552312+0000","last_peered":"2024-09-16T07:29:07.552312+0000","last_clean":"2024-09-16T07:29:07.552312+0000","last_became_active":"2024-09-16T07:29:05.707182+0000","last_became_peered":"2024-09-16T07:29:05.707182+0000","last_unstale":"2024-09-16T07:29:07.552312+0000","last_undegraded":"2024-09-16T07:29:07.552312+0000","last_fullsized":"2024-09-16T07:29:07.552312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:06.601020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.692096+0000","last_change":"2024-09-16T07:29:05.693162+0000","last_active":"2024-09-16T07:29:06.692096+0000","last_peered":"2024-09-16T07:29:06.692096+0000","last_clean":"2024-09-16T07:29:06.692096+0000","last_became_active":"2024-09-16T07:29:05.692788+0000","last_became_peered":"2024-09-16T07:29:05.692788+0000","last_unstale":"2024-09-16T07:29:06.692096+0000","last_undegraded":"2024-09-16T07:29:06.692096+0000","last_fullsized":"2024-09-16T07:29:06.692096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:14.177362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552341+0000","last_change":"2024-09-16T07:29:05.705405+0000","last_active":"2024-09-16T07:29:07.552341+0000","last_peered":"2024-09-16T07:29:07.552341+0000","last_clean":"2024-09-16T07:29:07.552341+0000","last_became_active":"2024-09-16T07:29:05.705035+0000","last_became_peered":"2024-09-16T07:29:05.705035+0000","last_unstale":"2024-09-16T07:29:07.552341+0000","last_undegraded":"2024-09-16T07:29:07.552341+0000","last_fullsized":"2024-09-16T07:29:07.552341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:11.886160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698986+0000","last_change":"2024-09-16T07:29:05.699187+0000","last_active":"2024-09-16T07:29:06.698986+0000","last_peered":"2024-09-16T07:29:06.698986+0000","last_clean":"2024-09-16T07:29:06.698986+0000","last_became_active":"2024-09-16T07:29:05.698935+0000","last_became_peered":"2024-09-16T07:29:05.698935+0000","last_unstale":"2024-09-16T07:29:06.698986+0000","last_undegraded":"2024-09-16T07:29:06.698986+0000","last_fullsized":"2024-09-16T07:29:06.698986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:52.398199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700483+0000","last_change":"2024-09-16T07:29:05.685756+0000","last_active":"2024-09-16T07:29:06.700483+0000","last_peered":"2024-09-16T07:29:06.700483+0000","last_clean":"2024-09-16T07:29:06.700483+0000","last_became_active":"2024-09-16T07:29:05.685411+0000","last_became_peered":"2024-09-16T07:29:05.685411+0000","last_unstale":"2024-09-16T07:29:06.700483+0000","last_undegraded":"2024-09-16T07:29:06.700483+0000","last_fullsized":"2024-09-16T07:29:06.700483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:56.954842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990570+0000","last_change":"2024-09-16T07:29:05.686799+0000","last_active":"2024-09-16T07:29:07.990570+0000","last_peered":"2024-09-16T07:29:07.990570+0000","last_clean":"2024-09-16T07:29:07.990570+0000","last_became_active":"2024-09-16T07:29:05.686553+0000","last_became_peered":"2024-09-16T07:29:05.686553+0000","last_unstale":"2024-09-16T07:29:07.990570+0000","last_undegraded":"2024-09-16T07:29:07.990570+0000","last_fullsized":"2024-09-16T07:29:07.990570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:37.562977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990810+0000","last_change":"2024-09-16T07:29:05.699337+0000","last_active":"2024-09-16T07:29:07.990810+0000","last_peered":"2024-09-16T07:29:07.990810+0000","last_clean":"2024-09-16T07:29:07.990810+0000","last_became_active":"2024-09-16T07:29:05.698537+0000","last_became_peered":"2024-09-16T07:29:05.698537+0000","last_unstale":"2024-09-16T07:29:07.990810+0000","last_undegraded":"2024-09-16T07:29:07.990810+0000","last_fullsized":"2024-09-16T07:29:07.990810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:42:11.548433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990398+0000","last_change":"2024-09-16T07:29:05.698132+0000","last_active":"2024-09-16T07:29:07.990398+0000","last_peered":"2024-09-16T07:29:07.990398+0000","last_clean":"2024-09-16T07:29:07.990398+0000","last_became_active":"2024-09-16T07:29:05.697730+0000","last_became_peered":"2024-09-16T07:29:05.697730+0000","last_unstale":"2024-09-16T07:29:07.990398+0000","last_undegraded":"2024-09-16T07:29:07.990398+0000","last_fullsized":"2024-09-16T07:29:07.990398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:11.886160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677508+0000","last_change":"2024-09-16T07:29:05.702986+0000","last_active":"2024-09-16T07:29:07.677508+0000","last_peered":"2024-09-16T07:29:07.677508+0000","last_clean":"2024-09-16T07:29:07.677508+0000","last_became_active":"2024-09-16T07:29:05.702694+0000","last_became_peered":"2024-09-16T07:29:05.702694+0000","last_unstale":"2024-09-16T07:29:07.677508+0000","last_undegraded":"2024-09-16T07:29:07.677508+0000","last_fullsized":"2024-09-16T07:29:07.677508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:42.104005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991433+0000","last_change":"2024-09-16T07:29:04.680366+0000","last_active":"2024-09-16T07:29:07.991433+0000","last_peered":"2024-09-16T07:29:07.991433+0000","last_clean":"2024-09-16T07:29:07.991433+0000","last_became_active":"2024-09-16T07:29:04.680082+0000","last_became_peered":"2024-09-16T07:29:04.680082+0000","last_unstale":"2024-09-16T07:29:07.991433+0000","last_undegraded":"2024-09-16T07:29:07.991433+0000","last_fullsized":"2024-09-16T07:29:07.991433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:08.598702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991295+0000","last_change":"2024-09-16T07:29:05.689136+0000","last_active":"2024-09-16T07:29:07.991295+0000","last_peered":"2024-09-16T07:29:07.991295+0000","last_clean":"2024-09-16T07:29:07.991295+0000","last_became_active":"2024-09-16T07:29:05.688849+0000","last_became_peered":"2024-09-16T07:29:05.688849+0000","last_unstale":"2024-09-16T07:29:07.991295+0000","last_undegraded":"2024-09-16T07:29:07.991295+0000","last_fullsized":"2024-09-16T07:29:07.991295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:53.638340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677499+0000","last_change":"2024-09-16T07:29:04.685794+0000","last_active":"2024-09-16T07:29:07.677499+0000","last_peered":"2024-09-16T07:29:07.677499+0000","last_clean":"2024-09-16T07:29:07.677499+0000","last_became_active":"2024-09-16T07:29:04.685459+0000","last_became_peered":"2024-09-16T07:29:04.685459+0000","last_unstale":"2024-09-16T07:29:07.677499+0000","last_undegraded":"2024-09-16T07:29:07.677499+0000","last_fullsized":"2024-09-16T07:29:07.677499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:58.033566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700425+0000","last_change":"2024-09-16T07:29:05.696003+0000","last_active":"2024-09-16T07:29:06.700425+0000","last_peered":"2024-09-16T07:29:06.700425+0000","last_clean":"2024-09-16T07:29:06.700425+0000","last_became_active":"2024-09-16T07:29:05.695747+0000","last_became_peered":"2024-09-16T07:29:05.695747+0000","last_unstale":"2024-09-16T07:29:06.700425+0000","last_undegraded":"2024-09-16T07:29:06.700425+0000","last_fullsized":"2024-09-16T07:29:06.700425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:45.008473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691276+0000","last_change":"2024-09-16T07:29:04.689645+0000","last_active":"2024-09-16T07:29:06.691276+0000","last_peered":"2024-09-16T07:29:06.691276+0000","last_clean":"2024-09-16T07:29:06.691276+0000","last_became_active":"2024-09-16T07:29:04.689326+0000","last_became_peered":"2024-09-16T07:29:04.689326+0000","last_unstale":"2024-09-16T07:29:06.691276+0000","last_undegraded":"2024-09-16T07:29:06.691276+0000","last_fullsized":"2024-09-16T07:29:06.691276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:29.324427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552374+0000","last_change":"2024-09-16T07:29:05.700717+0000","last_active":"2024-09-16T07:29:07.552374+0000","last_peered":"2024-09-16T07:29:07.552374+0000","last_clean":"2024-09-16T07:29:07.552374+0000","last_became_active":"2024-09-16T07:29:05.700463+0000","last_became_peered":"2024-09-16T07:29:05.700463+0000","last_unstale":"2024-09-16T07:29:07.552374+0000","last_undegraded":"2024-09-16T07:29:07.552374+0000","last_fullsized":"2024-09-16T07:29:07.552374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:10.656705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988816+0000","last_change":"2024-09-16T07:29:04.686085+0000","last_active":"2024-09-16T07:29:07.988816+0000","last_peered":"2024-09-16T07:29:07.988816+0000","last_clean":"2024-09-16T07:29:07.988816+0000","last_became_active":"2024-09-16T07:29:04.685791+0000","last_became_peered":"2024-09-16T07:29:04.685791+0000","last_unstale":"2024-09-16T07:29:07.988816+0000","last_undegraded":"2024-09-16T07:29:07.988816+0000","last_fullsized":"2024-09-16T07:29:07.988816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:32:32.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990549+0000","last_change":"2024-09-16T07:29:05.699121+0000","last_active":"2024-09-16T07:29:07.990549+0000","last_peered":"2024-09-16T07:29:07.990549+0000","last_clean":"2024-09-16T07:29:07.990549+0000","last_became_active":"2024-09-16T07:29:05.698841+0000","last_became_peered":"2024-09-16T07:29:05.698841+0000","last_unstale":"2024-09-16T07:29:07.990549+0000","last_undegraded":"2024-09-16T07:29:07.990549+0000","last_fullsized":"2024-09-16T07:29:07.990549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:17.955172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700623+0000","last_change":"2024-09-16T07:29:04.693386+0000","last_active":"2024-09-16T07:29:06.700623+0000","last_peered":"2024-09-16T07:29:06.700623+0000","last_clean":"2024-09-16T07:29:06.700623+0000","last_became_active":"2024-09-16T07:29:04.693194+0000","last_became_peered":"2024-09-16T07:29:04.693194+0000","last_unstale":"2024-09-16T07:29:06.700623+0000","last_undegraded":"2024-09-16T07:29:06.700623+0000","last_fullsized":"2024-09-16T07:29:06.700623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:45.737517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698843+0000","last_change":"2024-09-16T07:29:05.694634+0000","last_active":"2024-09-16T07:29:06.698843+0000","last_peered":"2024-09-16T07:29:06.698843+0000","last_clean":"2024-09-16T07:29:06.698843+0000","last_became_active":"2024-09-16T07:29:05.694368+0000","last_became_peered":"2024-09-16T07:29:05.694368+0000","last_unstale":"2024-09-16T07:29:06.698843+0000","last_undegraded":"2024-09-16T07:29:06.698843+0000","last_fullsized":"2024-09-16T07:29:06.698843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:31.602901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700354+0000","last_change":"2024-09-16T07:29:04.680986+0000","last_active":"2024-09-16T07:29:06.700354+0000","last_peered":"2024-09-16T07:29:06.700354+0000","last_clean":"2024-09-16T07:29:06.700354+0000","last_became_active":"2024-09-16T07:29:04.680600+0000","last_became_peered":"2024-09-16T07:29:04.680600+0000","last_unstale":"2024-09-16T07:29:06.700354+0000","last_undegraded":"2024-09-16T07:29:06.700354+0000","last_fullsized":"2024-09-16T07:29:06.700354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:41.134621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700109+0000","last_change":"2024-09-16T07:29:05.684542+0000","last_active":"2024-09-16T07:29:06.700109+0000","last_peered":"2024-09-16T07:29:06.700109+0000","last_clean":"2024-09-16T07:29:06.700109+0000","last_became_active":"2024-09-16T07:29:05.684159+0000","last_became_peered":"2024-09-16T07:29:05.684159+0000","last_unstale":"2024-09-16T07:29:06.700109+0000","last_undegraded":"2024-09-16T07:29:06.700109+0000","last_fullsized":"2024-09-16T07:29:06.700109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:47.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691386+0000","last_change":"2024-09-16T07:29:04.681541+0000","last_active":"2024-09-16T07:29:06.691386+0000","last_peered":"2024-09-16T07:29:06.691386+0000","last_clean":"2024-09-16T07:29:06.691386+0000","last_became_active":"2024-09-16T07:29:04.680791+0000","last_became_peered":"2024-09-16T07:29:04.680791+0000","last_unstale":"2024-09-16T07:29:06.691386+0000","last_undegraded":"2024-09-16T07:29:06.691386+0000","last_fullsized":"2024-09-16T07:29:06.691386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:52.629856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551701+0000","last_change":"2024-09-16T07:29:05.699374+0000","last_active":"2024-09-16T07:29:07.551701+0000","last_peered":"2024-09-16T07:29:07.551701+0000","last_clean":"2024-09-16T07:29:07.551701+0000","last_became_active":"2024-09-16T07:29:05.686490+0000","last_became_peered":"2024-09-16T07:29:05.686490+0000","last_unstale":"2024-09-16T07:29:07.551701+0000","last_undegraded":"2024-09-16T07:29:07.551701+0000","last_fullsized":"2024-09-16T07:29:07.551701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:02.946673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700304+0000","last_change":"2024-09-16T07:29:04.677432+0000","last_active":"2024-09-16T07:29:06.700304+0000","last_peered":"2024-09-16T07:29:06.700304+0000","last_clean":"2024-09-16T07:29:06.700304+0000","last_became_active":"2024-09-16T07:29:04.677134+0000","last_became_peered":"2024-09-16T07:29:04.677134+0000","last_unstale":"2024-09-16T07:29:06.700304+0000","last_undegraded":"2024-09-16T07:29:06.700304+0000","last_fullsized":"2024-09-16T07:29:06.700304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699336+0000","last_change":"2024-09-16T07:29:05.695653+0000","last_active":"2024-09-16T07:29:06.699336+0000","last_peered":"2024-09-16T07:29:06.699336+0000","last_clean":"2024-09-16T07:29:06.699336+0000","last_became_active":"2024-09-16T07:29:05.695280+0000","last_became_peered":"2024-09-16T07:29:05.695280+0000","last_unstale":"2024-09-16T07:29:06.699336+0000","last_undegraded":"2024-09-16T07:29:06.699336+0000","last_fullsized":"2024-09-16T07:29:06.699336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:44.294346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691946+0000","last_change":"2024-09-16T07:29:04.682861+0000","last_active":"2024-09-16T07:29:06.691946+0000","last_peered":"2024-09-16T07:29:06.691946+0000","last_clean":"2024-09-16T07:29:06.691946+0000","last_became_active":"2024-09-16T07:29:04.682605+0000","last_became_peered":"2024-09-16T07:29:04.682605+0000","last_unstale":"2024-09-16T07:29:06.691946+0000","last_undegraded":"2024-09-16T07:29:06.691946+0000","last_fullsized":"2024-09-16T07:29:06.691946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:41.095521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691888+0000","last_change":"2024-09-16T07:29:05.714627+0000","last_active":"2024-09-16T07:29:06.691888+0000","last_peered":"2024-09-16T07:29:06.691888+0000","last_clean":"2024-09-16T07:29:06.691888+0000","last_became_active":"2024-09-16T07:29:05.714354+0000","last_became_peered":"2024-09-16T07:29:05.714354+0000","last_unstale":"2024-09-16T07:29:06.691888+0000","last_undegraded":"2024-09-16T07:29:06.691888+0000","last_fullsized":"2024-09-16T07:29:06.691888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:01.936202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677679+0000","last_change":"2024-09-16T07:29:04.682290+0000","last_active":"2024-09-16T07:29:07.677679+0000","last_peered":"2024-09-16T07:29:07.677679+0000","last_clean":"2024-09-16T07:29:07.677679+0000","last_became_active":"2024-09-16T07:29:04.681995+0000","last_became_peered":"2024-09-16T07:29:04.681995+0000","last_unstale":"2024-09-16T07:29:07.677679+0000","last_undegraded":"2024-09-16T07:29:07.677679+0000","last_fullsized":"2024-09-16T07:29:07.677679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:03:17.545776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691545+0000","last_change":"2024-09-16T07:29:05.684697+0000","last_active":"2024-09-16T07:29:06.691545+0000","last_peered":"2024-09-16T07:29:06.691545+0000","last_clean":"2024-09-16T07:29:06.691545+0000","last_became_active":"2024-09-16T07:29:05.683882+0000","last_became_peered":"2024-09-16T07:29:05.683882+0000","last_unstale":"2024-09-16T07:29:06.691545+0000","last_undegraded":"2024-09-16T07:29:06.691545+0000","last_fullsized":"2024-09-16T07:29:06.691545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:24.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699148+0000","last_change":"2024-09-16T07:29:04.688689+0000","last_active":"2024-09-16T07:29:06.699148+0000","last_peered":"2024-09-16T07:29:06.699148+0000","last_clean":"2024-09-16T07:29:06.699148+0000","last_became_active":"2024-09-16T07:29:04.687010+0000","last_became_peered":"2024-09-16T07:29:04.687010+0000","last_unstale":"2024-09-16T07:29:06.699148+0000","last_undegraded":"2024-09-16T07:29:06.699148+0000","last_fullsized":"2024-09-16T07:29:06.699148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:29.324427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698968+0000","last_change":"2024-09-16T07:29:05.703232+0000","last_active":"2024-09-16T07:29:06.698968+0000","last_peered":"2024-09-16T07:29:06.698968+0000","last_clean":"2024-09-16T07:29:06.698968+0000","last_became_active":"2024-09-16T07:29:05.702661+0000","last_became_peered":"2024-09-16T07:29:05.702661+0000","last_unstale":"2024-09-16T07:29:06.698968+0000","last_undegraded":"2024-09-16T07:29:06.698968+0000","last_fullsized":"2024-09-16T07:29:06.698968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:14.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691546+0000","last_change":"2024-09-16T07:29:04.687313+0000","last_active":"2024-09-16T07:29:06.691546+0000","last_peered":"2024-09-16T07:29:06.691546+0000","last_clean":"2024-09-16T07:29:06.691546+0000","last_became_active":"2024-09-16T07:29:04.686929+0000","last_became_peered":"2024-09-16T07:29:04.686929+0000","last_unstale":"2024-09-16T07:29:06.691546+0000","last_undegraded":"2024-09-16T07:29:06.691546+0000","last_fullsized":"2024-09-16T07:29:06.691546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:49.928022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551710+0000","last_change":"2024-09-16T07:29:05.698400+0000","last_active":"2024-09-16T07:29:07.551710+0000","last_peered":"2024-09-16T07:29:07.551710+0000","last_clean":"2024-09-16T07:29:07.551710+0000","last_became_active":"2024-09-16T07:29:05.698108+0000","last_became_peered":"2024-09-16T07:29:05.698108+0000","last_unstale":"2024-09-16T07:29:07.551710+0000","last_undegraded":"2024-09-16T07:29:07.551710+0000","last_fullsized":"2024-09-16T07:29:07.551710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:53:31.326753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700692+0000","last_change":"2024-09-16T07:29:04.687978+0000","last_active":"2024-09-16T07:29:06.700692+0000","last_peered":"2024-09-16T07:29:06.700692+0000","last_clean":"2024-09-16T07:29:06.700692+0000","last_became_active":"2024-09-16T07:29:04.687570+0000","last_became_peered":"2024-09-16T07:29:04.687570+0000","last_unstale":"2024-09-16T07:29:06.700692+0000","last_undegraded":"2024-09-16T07:29:06.700692+0000","last_fullsized":"2024-09-16T07:29:06.700692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691465+0000","last_change":"2024-09-16T07:29:05.703911+0000","last_active":"2024-09-16T07:29:06.691465+0000","last_peered":"2024-09-16T07:29:06.691465+0000","last_clean":"2024-09-16T07:29:06.691465+0000","last_became_active":"2024-09-16T07:29:05.701641+0000","last_became_peered":"2024-09-16T07:29:05.701641+0000","last_unstale":"2024-09-16T07:29:06.691465+0000","last_undegraded":"2024-09-16T07:29:06.691465+0000","last_fullsized":"2024-09-16T07:29:06.691465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:58.013913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551747+0000","last_change":"2024-09-16T07:29:04.683742+0000","last_active":"2024-09-16T07:29:07.551747+0000","last_peered":"2024-09-16T07:29:07.551747+0000","last_clean":"2024-09-16T07:29:07.551747+0000","last_became_active":"2024-09-16T07:29:04.683172+0000","last_became_peered":"2024-09-16T07:29:04.683172+0000","last_unstale":"2024-09-16T07:29:07.551747+0000","last_undegraded":"2024-09-16T07:29:07.551747+0000","last_fullsized":"2024-09-16T07:29:07.551747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:58.033566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990130+0000","last_change":"2024-09-16T07:29:05.698267+0000","last_active":"2024-09-16T07:29:07.990130+0000","last_peered":"2024-09-16T07:29:07.990130+0000","last_clean":"2024-09-16T07:29:07.990130+0000","last_became_active":"2024-09-16T07:29:05.697840+0000","last_became_peered":"2024-09-16T07:29:05.697840+0000","last_unstale":"2024-09-16T07:29:07.990130+0000","last_undegraded":"2024-09-16T07:29:07.990130+0000","last_fullsized":"2024-09-16T07:29:07.990130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:51.365024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691256+0000","last_change":"2024-09-16T07:29:04.684134+0000","last_active":"2024-09-16T07:29:06.691256+0000","last_peered":"2024-09-16T07:29:06.691256+0000","last_clean":"2024-09-16T07:29:06.691256+0000","last_became_active":"2024-09-16T07:29:04.683409+0000","last_became_peered":"2024-09-16T07:29:04.683409+0000","last_unstale":"2024-09-16T07:29:06.691256+0000","last_undegraded":"2024-09-16T07:29:06.691256+0000","last_fullsized":"2024-09-16T07:29:06.691256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:00.473499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.989977+0000","last_change":"2024-09-16T07:29:05.690389+0000","last_active":"2024-09-16T07:29:07.989977+0000","last_peered":"2024-09-16T07:29:07.989977+0000","last_clean":"2024-09-16T07:29:07.989977+0000","last_became_active":"2024-09-16T07:29:05.689175+0000","last_became_peered":"2024-09-16T07:29:05.689175+0000","last_unstale":"2024-09-16T07:29:07.989977+0000","last_undegraded":"2024-09-16T07:29:07.989977+0000","last_fullsized":"2024-09-16T07:29:07.989977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:38:00.361615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691266+0000","last_change":"2024-09-16T07:29:04.688866+0000","last_active":"2024-09-16T07:29:06.691266+0000","last_peered":"2024-09-16T07:29:06.691266+0000","last_clean":"2024-09-16T07:29:06.691266+0000","last_became_active":"2024-09-16T07:29:04.688617+0000","last_became_peered":"2024-09-16T07:29:04.688617+0000","last_unstale":"2024-09-16T07:29:06.691266+0000","last_undegraded":"2024-09-16T07:29:06.691266+0000","last_fullsized":"2024-09-16T07:29:06.691266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:04:33.664159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700907+0000","last_change":"2024-09-16T07:29:05.686066+0000","last_active":"2024-09-16T07:29:06.700907+0000","last_peered":"2024-09-16T07:29:06.700907+0000","last_clean":"2024-09-16T07:29:06.700907+0000","last_became_active":"2024-09-16T07:29:05.685800+0000","last_became_peered":"2024-09-16T07:29:05.685800+0000","last_unstale":"2024-09-16T07:29:06.700907+0000","last_undegraded":"2024-09-16T07:29:06.700907+0000","last_fullsized":"2024-09-16T07:29:06.700907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:24.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552365+0000","last_change":"2024-09-16T07:29:04.684997+0000","last_active":"2024-09-16T07:29:07.552365+0000","last_peered":"2024-09-16T07:29:07.552365+0000","last_clean":"2024-09-16T07:29:07.552365+0000","last_became_active":"2024-09-16T07:29:04.684520+0000","last_became_peered":"2024-09-16T07:29:04.684520+0000","last_unstale":"2024-09-16T07:29:07.552365+0000","last_undegraded":"2024-09-16T07:29:07.552365+0000","last_fullsized":"2024-09-16T07:29:07.552365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:46.880482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699438+0000","last_change":"2024-09-16T07:29:05.679651+0000","last_active":"2024-09-16T07:29:06.699438+0000","last_peered":"2024-09-16T07:29:06.699438+0000","last_clean":"2024-09-16T07:29:06.699438+0000","last_became_active":"2024-09-16T07:29:05.679281+0000","last_became_peered":"2024-09-16T07:29:05.679281+0000","last_unstale":"2024-09-16T07:29:06.699438+0000","last_undegraded":"2024-09-16T07:29:06.699438+0000","last_fullsized":"2024-09-16T07:29:06.699438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:54:42.349663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700854+0000","last_change":"2024-09-16T07:29:04.688727+0000","last_active":"2024-09-16T07:29:06.700854+0000","last_peered":"2024-09-16T07:29:06.700854+0000","last_clean":"2024-09-16T07:29:06.700854+0000","last_became_active":"2024-09-16T07:29:04.687576+0000","last_became_peered":"2024-09-16T07:29:04.687576+0000","last_unstale":"2024-09-16T07:29:06.700854+0000","last_undegraded":"2024-09-16T07:29:06.700854+0000","last_fullsized":"2024-09-16T07:29:06.700854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551970+0000","last_change":"2024-09-16T07:29:05.705266+0000","last_active":"2024-09-16T07:29:07.551970+0000","last_peered":"2024-09-16T07:29:07.551970+0000","last_clean":"2024-09-16T07:29:07.551970+0000","last_became_active":"2024-09-16T07:29:05.704987+0000","last_became_peered":"2024-09-16T07:29:05.704987+0000","last_unstale":"2024-09-16T07:29:07.551970+0000","last_undegraded":"2024-09-16T07:29:07.551970+0000","last_fullsized":"2024-09-16T07:29:07.551970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:04.580102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700807+0000","last_change":"2024-09-16T07:29:04.688933+0000","last_active":"2024-09-16T07:29:06.700807+0000","last_peered":"2024-09-16T07:29:06.700807+0000","last_clean":"2024-09-16T07:29:06.700807+0000","last_became_active":"2024-09-16T07:29:04.688568+0000","last_became_peered":"2024-09-16T07:29:04.688568+0000","last_unstale":"2024-09-16T07:29:06.700807+0000","last_undegraded":"2024-09-16T07:29:06.700807+0000","last_fullsized":"2024-09-16T07:29:06.700807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988965+0000","last_change":"2024-09-16T07:29:05.691684+0000","last_active":"2024-09-16T07:29:07.988965+0000","last_peered":"2024-09-16T07:29:07.988965+0000","last_clean":"2024-09-16T07:29:07.988965+0000","last_became_active":"2024-09-16T07:29:05.691415+0000","last_became_peered":"2024-09-16T07:29:05.691415+0000","last_unstale":"2024-09-16T07:29:07.988965+0000","last_undegraded":"2024-09-16T07:29:07.988965+0000","last_fullsized":"2024-09-16T07:29:07.988965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:27:51.028445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700453+0000","last_change":"2024-09-16T07:29:04.686063+0000","last_active":"2024-09-16T07:29:06.700453+0000","last_peered":"2024-09-16T07:29:06.700453+0000","last_clean":"2024-09-16T07:29:06.700453+0000","last_became_active":"2024-09-16T07:29:04.685265+0000","last_became_peered":"2024-09-16T07:29:04.685265+0000","last_unstale":"2024-09-16T07:29:06.700453+0000","last_undegraded":"2024-09-16T07:29:06.700453+0000","last_fullsized":"2024-09-16T07:29:06.700453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:20:04.767977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988551+0000","last_change":"2024-09-16T07:29:05.680005+0000","last_active":"2024-09-16T07:29:07.988551+0000","last_peered":"2024-09-16T07:29:07.988551+0000","last_clean":"2024-09-16T07:29:07.988551+0000","last_became_active":"2024-09-16T07:29:05.679750+0000","last_became_peered":"2024-09-16T07:29:05.679750+0000","last_unstale":"2024-09-16T07:29:07.988551+0000","last_undegraded":"2024-09-16T07:29:07.988551+0000","last_fullsized":"2024-09-16T07:29:07.988551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:53.415692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677397+0000","last_change":"2024-09-16T07:29:04.688075+0000","last_active":"2024-09-16T07:29:07.677397+0000","last_peered":"2024-09-16T07:29:07.677397+0000","last_clean":"2024-09-16T07:29:07.677397+0000","last_became_active":"2024-09-16T07:29:04.687842+0000","last_became_peered":"2024-09-16T07:29:04.687842+0000","last_unstale":"2024-09-16T07:29:07.677397+0000","last_undegraded":"2024-09-16T07:29:07.677397+0000","last_fullsized":"2024-09-16T07:29:07.677397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:08.598702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988837+0000","last_change":"2024-09-16T07:29:05.693645+0000","last_active":"2024-09-16T07:29:07.988837+0000","last_peered":"2024-09-16T07:29:07.988837+0000","last_clean":"2024-09-16T07:29:07.988837+0000","last_became_active":"2024-09-16T07:29:05.693349+0000","last_became_peered":"2024-09-16T07:29:05.693349+0000","last_unstale":"2024-09-16T07:29:07.988837+0000","last_undegraded":"2024-09-16T07:29:07.988837+0000","last_fullsized":"2024-09-16T07:29:07.988837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:05.940761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.989971+0000","last_change":"2024-09-16T07:29:04.692249+0000","last_active":"2024-09-16T07:29:07.989971+0000","last_peered":"2024-09-16T07:29:07.989971+0000","last_clean":"2024-09-16T07:29:07.989971+0000","last_became_active":"2024-09-16T07:29:04.691889+0000","last_became_peered":"2024-09-16T07:29:04.691889+0000","last_unstale":"2024-09-16T07:29:07.989971+0000","last_undegraded":"2024-09-16T07:29:07.989971+0000","last_fullsized":"2024-09-16T07:29:07.989971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988537+0000","last_change":"2024-09-16T07:29:05.681733+0000","last_active":"2024-09-16T07:29:07.988537+0000","last_peered":"2024-09-16T07:29:07.988537+0000","last_clean":"2024-09-16T07:29:07.988537+0000","last_became_active":"2024-09-16T07:29:05.681458+0000","last_became_peered":"2024-09-16T07:29:05.681458+0000","last_unstale":"2024-09-16T07:29:07.988537+0000","last_undegraded":"2024-09-16T07:29:07.988537+0000","last_fullsized":"2024-09-16T07:29:07.988537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:00.822201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700303+0000","last_change":"2024-09-16T07:29:04.689801+0000","last_active":"2024-09-16T07:29:06.700303+0000","last_peered":"2024-09-16T07:29:06.700303+0000","last_clean":"2024-09-16T07:29:06.700303+0000","last_became_active":"2024-09-16T07:29:04.689407+0000","last_became_peered":"2024-09-16T07:29:04.689407+0000","last_unstale":"2024-09-16T07:29:06.700303+0000","last_undegraded":"2024-09-16T07:29:06.700303+0000","last_fullsized":"2024-09-16T07:29:06.700303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991022+0000","last_change":"2024-09-16T07:29:05.690529+0000","last_active":"2024-09-16T07:29:07.991022+0000","last_peered":"2024-09-16T07:29:07.991022+0000","last_clean":"2024-09-16T07:29:07.991022+0000","last_became_active":"2024-09-16T07:29:05.690240+0000","last_became_peered":"2024-09-16T07:29:05.690240+0000","last_unstale":"2024-09-16T07:29:07.991022+0000","last_undegraded":"2024-09-16T07:29:07.991022+0000","last_fullsized":"2024-09-16T07:29:07.991022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:04.901751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698821+0000","last_change":"2024-09-16T07:29:04.689517+0000","last_active":"2024-09-16T07:29:06.698821+0000","last_peered":"2024-09-16T07:29:06.698821+0000","last_clean":"2024-09-16T07:29:06.698821+0000","last_became_active":"2024-09-16T07:29:04.689245+0000","last_became_peered":"2024-09-16T07:29:04.689245+0000","last_unstale":"2024-09-16T07:29:06.698821+0000","last_undegraded":"2024-09-16T07:29:06.698821+0000","last_fullsized":"2024-09-16T07:29:06.698821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:00.473499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988953+0000","last_change":"2024-09-16T07:29:05.692685+0000","last_active":"2024-09-16T07:29:07.988953+0000","last_peered":"2024-09-16T07:29:07.988953+0000","last_clean":"2024-09-16T07:29:07.988953+0000","last_became_active":"2024-09-16T07:29:05.692384+0000","last_became_peered":"2024-09-16T07:29:05.692384+0000","last_unstale":"2024-09-16T07:29:07.988953+0000","last_undegraded":"2024-09-16T07:29:07.988953+0000","last_fullsized":"2024-09-16T07:29:07.988953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:10.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552432+0000","last_change":"2024-09-16T07:29:04.680088+0000","last_active":"2024-09-16T07:29:07.552432+0000","last_peered":"2024-09-16T07:29:07.552432+0000","last_clean":"2024-09-16T07:29:07.552432+0000","last_became_active":"2024-09-16T07:29:04.679832+0000","last_became_peered":"2024-09-16T07:29:04.679832+0000","last_unstale":"2024-09-16T07:29:07.552432+0000","last_undegraded":"2024-09-16T07:29:07.552432+0000","last_fullsized":"2024-09-16T07:29:07.552432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:16.151181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699437+0000","last_change":"2024-09-16T07:29:05.701956+0000","last_active":"2024-09-16T07:29:06.699437+0000","last_peered":"2024-09-16T07:29:06.699437+0000","last_clean":"2024-09-16T07:29:06.699437+0000","last_became_active":"2024-09-16T07:29:05.700771+0000","last_became_peered":"2024-09-16T07:29:05.700771+0000","last_unstale":"2024-09-16T07:29:06.699437+0000","last_undegraded":"2024-09-16T07:29:06.699437+0000","last_fullsized":"2024-09-16T07:29:06.699437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:24.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677664+0000","last_change":"2024-09-16T07:29:04.679959+0000","last_active":"2024-09-16T07:29:07.677664+0000","last_peered":"2024-09-16T07:29:07.677664+0000","last_clean":"2024-09-16T07:29:07.677664+0000","last_became_active":"2024-09-16T07:29:04.679699+0000","last_became_peered":"2024-09-16T07:29:04.679699+0000","last_unstale":"2024-09-16T07:29:07.677664+0000","last_undegraded":"2024-09-16T07:29:07.677664+0000","last_fullsized":"2024-09-16T07:29:07.677664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:07:10.270600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677459+0000","last_change":"2024-09-16T07:29:05.713917+0000","last_active":"2024-09-16T07:29:07.677459+0000","last_peered":"2024-09-16T07:29:07.677459+0000","last_clean":"2024-09-16T07:29:07.677459+0000","last_became_active":"2024-09-16T07:29:05.713437+0000","last_became_peered":"2024-09-16T07:29:05.713437+0000","last_unstale":"2024-09-16T07:29:07.677459+0000","last_undegraded":"2024-09-16T07:29:07.677459+0000","last_fullsized":"2024-09-16T07:29:07.677459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:17.159665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552235+0000","last_change":"2024-09-16T07:29:04.685192+0000","last_active":"2024-09-16T07:29:07.552235+0000","last_peered":"2024-09-16T07:29:07.552235+0000","last_clean":"2024-09-16T07:29:07.552235+0000","last_became_active":"2024-09-16T07:29:04.684971+0000","last_became_peered":"2024-09-16T07:29:04.684971+0000","last_unstale":"2024-09-16T07:29:07.552235+0000","last_undegraded":"2024-09-16T07:29:07.552235+0000","last_fullsized":"2024-09-16T07:29:07.552235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:03:17.545776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990051+0000","last_change":"2024-09-16T07:29:05.683940+0000","last_active":"2024-09-16T07:29:07.990051+0000","last_peered":"2024-09-16T07:29:07.990051+0000","last_clean":"2024-09-16T07:29:07.990051+0000","last_became_active":"2024-09-16T07:29:05.683668+0000","last_became_peered":"2024-09-16T07:29:05.683668+0000","last_unstale":"2024-09-16T07:29:07.990051+0000","last_undegraded":"2024-09-16T07:29:07.990051+0000","last_fullsized":"2024-09-16T07:29:07.990051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:12:55.434863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677637+0000","last_change":"2024-09-16T07:29:04.688174+0000","last_active":"2024-09-16T07:29:07.677637+0000","last_peered":"2024-09-16T07:29:07.677637+0000","last_clean":"2024-09-16T07:29:07.677637+0000","last_became_active":"2024-09-16T07:29:04.687913+0000","last_became_peered":"2024-09-16T07:29:04.687913+0000","last_unstale":"2024-09-16T07:29:07.677637+0000","last_undegraded":"2024-09-16T07:29:07.677637+0000","last_fullsized":"2024-09-16T07:29:07.677637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:37.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677442+0000","last_change":"2024-09-16T07:29:05.703810+0000","last_active":"2024-09-16T07:29:07.677442+0000","last_peered":"2024-09-16T07:29:07.677442+0000","last_clean":"2024-09-16T07:29:07.677442+0000","last_became_active":"2024-09-16T07:29:05.703546+0000","last_became_peered":"2024-09-16T07:29:05.703546+0000","last_unstale":"2024-09-16T07:29:07.677442+0000","last_undegraded":"2024-09-16T07:29:07.677442+0000","last_fullsized":"2024-09-16T07:29:07.677442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:07.598934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551832+0000","last_change":"2024-09-16T07:29:04.683463+0000","last_active":"2024-09-16T07:29:07.551832+0000","last_peered":"2024-09-16T07:29:07.551832+0000","last_clean":"2024-09-16T07:29:07.551832+0000","last_became_active":"2024-09-16T07:29:04.682288+0000","last_became_peered":"2024-09-16T07:29:04.682288+0000","last_unstale":"2024-09-16T07:29:07.551832+0000","last_undegraded":"2024-09-16T07:29:07.551832+0000","last_fullsized":"2024-09-16T07:29:07.551832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:37.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691150+0000","last_change":"2024-09-16T07:29:05.690104+0000","last_active":"2024-09-16T07:29:06.691150+0000","last_peered":"2024-09-16T07:29:06.691150+0000","last_clean":"2024-09-16T07:29:06.691150+0000","last_became_active":"2024-09-16T07:29:05.689811+0000","last_became_peered":"2024-09-16T07:29:05.689811+0000","last_unstale":"2024-09-16T07:29:06.691150+0000","last_undegraded":"2024-09-16T07:29:06.691150+0000","last_fullsized":"2024-09-16T07:29:06.691150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:22.381670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700630+0000","last_change":"2024-09-16T07:29:04.682025+0000","last_active":"2024-09-16T07:29:06.700630+0000","last_peered":"2024-09-16T07:29:06.700630+0000","last_clean":"2024-09-16T07:29:06.700630+0000","last_became_active":"2024-09-16T07:29:04.681723+0000","last_became_peered":"2024-09-16T07:29:04.681723+0000","last_unstale":"2024-09-16T07:29:06.700630+0000","last_undegraded":"2024-09-16T07:29:06.700630+0000","last_fullsized":"2024-09-16T07:29:06.700630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:42.885409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700127+0000","last_change":"2024-09-16T07:29:05.687330+0000","last_active":"2024-09-16T07:29:06.700127+0000","last_peered":"2024-09-16T07:29:06.700127+0000","last_clean":"2024-09-16T07:29:06.700127+0000","last_became_active":"2024-09-16T07:29:05.685401+0000","last_became_peered":"2024-09-16T07:29:05.685401+0000","last_unstale":"2024-09-16T07:29:06.700127+0000","last_undegraded":"2024-09-16T07:29:06.700127+0000","last_fullsized":"2024-09-16T07:29:06.700127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:53.638340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691144+0000","last_change":"2024-09-16T07:29:04.688723+0000","last_active":"2024-09-16T07:29:06.691144+0000","last_peered":"2024-09-16T07:29:06.691144+0000","last_clean":"2024-09-16T07:29:06.691144+0000","last_became_active":"2024-09-16T07:29:04.688446+0000","last_became_peered":"2024-09-16T07:29:04.688446+0000","last_unstale":"2024-09-16T07:29:06.691144+0000","last_undegraded":"2024-09-16T07:29:06.691144+0000","last_fullsized":"2024-09-16T07:29:06.691144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:24.593805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990368+0000","last_change":"2024-09-16T07:29:05.708094+0000","last_active":"2024-09-16T07:29:07.990368+0000","last_peered":"2024-09-16T07:29:07.990368+0000","last_clean":"2024-09-16T07:29:07.990368+0000","last_became_active":"2024-09-16T07:29:05.707129+0000","last_became_peered":"2024-09-16T07:29:05.707129+0000","last_unstale":"2024-09-16T07:29:07.990368+0000","last_undegraded":"2024-09-16T07:29:07.990368+0000","last_fullsized":"2024-09-16T07:29:07.990368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:36.380404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990216+0000","last_change":"2024-09-16T07:29:04.684672+0000","last_active":"2024-09-16T07:29:07.990216+0000","last_peered":"2024-09-16T07:29:07.990216+0000","last_clean":"2024-09-16T07:29:07.990216+0000","last_became_active":"2024-09-16T07:29:04.684435+0000","last_became_peered":"2024-09-16T07:29:04.684435+0000","last_unstale":"2024-09-16T07:29:07.990216+0000","last_undegraded":"2024-09-16T07:29:07.990216+0000","last_fullsized":"2024-09-16T07:29:07.990216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990596+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:07.990596+0000","last_peered":"2024-09-16T07:29:07.990596+0000","last_clean":"2024-09-16T07:29:07.990596+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:07.990596+0000","last_undegraded":"2024-09-16T07:29:07.990596+0000","last_fullsized":"2024-09-16T07:29:07.990596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":729934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":140092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":140148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":139580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":141110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":141110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":139546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:14.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 -- 172.21.15.114:0/1750597129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 msgr2=0x7f37ac0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 --2- 172.21.15.114:0/1750597129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac0b2a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009bc0 tx=0x7f37a401cb10 comp rx=0 tx=0).stop 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 -- 172.21.15.114:0/1750597129 shutdown_connections 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 --2- 172.21.15.114:0/1750597129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac0b2a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 --2- 172.21.15.114:0/1750597129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37ac0d01b0 0x7f37ac0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 -- 172.21.15.114:0/1750597129 >> 172.21.15.114:0/1750597129 conn(0x7f37ac09aa10 msgr2=0x7f37ac09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 -- 172.21.15.114:0/1750597129 shutdown_connections 2024-09-16T07:29:14.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 -- 172.21.15.114:0/1750597129 wait complete. 2024-09-16T07:29:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 Processor -- start 2024-09-16T07:29:14.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.588+0000 7f37b2600640 1 -- start start 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37ac0d01b0 0x7f37ac159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37ac15f000 0x7f37ac0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac168df0 con 0x7f37ac0b2590 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac168c70 con 0x7f37ac15f000 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f37ac168f70 con 0x7f37ac0d01b0 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac164e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43396/0 (socket says 172.21.15.114:43396) 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 -- 172.21.15.114:0/339545540 learned_addr learned my addr 172.21.15.114:0/339545540 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37abe00640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37ac0d01b0 0x7f37ac159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1c00640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37ac15f000 0x7f37ac0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 -- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37ac0d01b0 msgr2=0x7f37ac159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37ac0d01b0 0x7f37ac159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 -- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37ac15f000 msgr2=0x7f37ac0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37ac15f000 0x7f37ac0c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 -- 172.21.15.114:0/339545540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ac1f8660 con 0x7f37ac0b2590 2024-09-16T07:29:14.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37abe00640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37ac0d01b0 0x7f37ac159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b1200640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac164e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c430 tx=0x7f37a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37a8c00640 1 -- 172.21.15.114:0/339545540 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0011790 con 0x7f37ac0b2590 2024-09-16T07:29:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37a8c00640 1 -- 172.21.15.114:0/339545540 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37a0017070 con 0x7f37ac0b2590 2024-09-16T07:29:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ac1f7a50 con 0x7f37ac0b2590 2024-09-16T07:29:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37a8c00640 1 -- 172.21.15.114:0/339545540 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0011ce0 con 0x7f37ac0b2590 2024-09-16T07:29:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ac1f8010 con 0x7f37ac0b2590 2024-09-16T07:29:14.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.592+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ac0cefb0 con 0x7f37ac0b2590 2024-09-16T07:29:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.596+0000 7f37a8c00640 1 -- 172.21.15.114:0/339545540 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f37a001c460 con 0x7f37ac0b2590 2024-09-16T07:29:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.596+0000 7f37a8c00640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f378c072ec0 0x7f378c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.596+0000 7f37a8c00640 1 -- 172.21.15.114:0/339545540 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f37a0093bb0 con 0x7f37ac0b2590 2024-09-16T07:29:14.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.596+0000 7f37abe00640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f378c072ec0 0x7f378c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.596+0000 7f37abe00640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f378c072ec0 0x7f378c075380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37ac09fd00 tx=0x7f37980091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:14.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.600+0000 7f37a8c00640 1 -- 172.21.15.114:0/339545540 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f37a005eeb0 con 0x7f37ac0b2590 2024-09-16T07:29:14.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.764+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37ac0cdc60 con 0x7f378c072ec0 2024-09-16T07:29:14.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.768+0000 7f37a8c00640 1 -- 172.21.15.114:0/339545540 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7f37ac0cdc60 con 0x7f378c072ec0 2024-09-16T07:29:14.777 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:14.778 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:14.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f378c072ec0 msgr2=0x7f378c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f378c072ec0 0x7f378c075380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37ac09fd00 tx=0x7f37980091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 msgr2=0x7f37ac164e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac164e80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f37a000c430 tx=0x7f37a000c8f0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 shutdown_connections 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f378c072ec0 0x7f378c075380 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f37ac15f000 0x7f37ac0c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37ac0d01b0 0x7f37ac159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 --2- 172.21.15.114:0/339545540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37ac0b2590 0x7f37ac164e80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 >> 172.21.15.114:0/339545540 conn(0x7f37ac09aa10 msgr2=0x7f37ac15def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 shutdown_connections 2024-09-16T07:29:14.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.772+0000 7f37b2600640 1 -- 172.21.15.114:0/339545540 wait complete. 2024-09-16T07:29:14.797 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-16T07:29:13.005685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220308,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754412,"statfs":{"total":773094113280,"available":772868517888,"internally_reserved":0,"allocated":4169728,"data_stored":2301364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001689"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991282+0000","last_change":"2024-09-16T07:29:05.688893+0000","last_active":"2024-09-16T07:29:07.991282+0000","last_peered":"2024-09-16T07:29:07.991282+0000","last_clean":"2024-09-16T07:29:07.991282+0000","last_became_active":"2024-09-16T07:29:05.688458+0000","last_became_peered":"2024-09-16T07:29:05.688458+0000","last_unstale":"2024-09-16T07:29:07.991282+0000","last_undegraded":"2024-09-16T07:29:07.991282+0000","last_fullsized":"2024-09-16T07:29:07.991282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:47.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691867+0000","last_change":"2024-09-16T07:29:05.716226+0000","last_active":"2024-09-16T07:29:06.691867+0000","last_peered":"2024-09-16T07:29:06.691867+0000","last_clean":"2024-09-16T07:29:06.691867+0000","last_became_active":"2024-09-16T07:29:05.716004+0000","last_became_peered":"2024-09-16T07:29:05.716004+0000","last_unstale":"2024-09-16T07:29:06.691867+0000","last_undegraded":"2024-09-16T07:29:06.691867+0000","last_fullsized":"2024-09-16T07:29:06.691867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:34.648432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699097+0000","last_change":"2024-09-16T07:29:05.703481+0000","last_active":"2024-09-16T07:29:06.699097+0000","last_peered":"2024-09-16T07:29:06.699097+0000","last_clean":"2024-09-16T07:29:06.699097+0000","last_became_active":"2024-09-16T07:29:05.702985+0000","last_became_peered":"2024-09-16T07:29:05.702985+0000","last_unstale":"2024-09-16T07:29:06.699097+0000","last_undegraded":"2024-09-16T07:29:06.699097+0000","last_fullsized":"2024-09-16T07:29:06.699097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:34:33.437563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551973+0000","last_change":"2024-09-16T07:29:05.705272+0000","last_active":"2024-09-16T07:29:07.551973+0000","last_peered":"2024-09-16T07:29:07.551973+0000","last_clean":"2024-09-16T07:29:07.551973+0000","last_became_active":"2024-09-16T07:29:05.704998+0000","last_became_peered":"2024-09-16T07:29:05.704998+0000","last_unstale":"2024-09-16T07:29:07.551973+0000","last_undegraded":"2024-09-16T07:29:07.551973+0000","last_fullsized":"2024-09-16T07:29:07.551973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:29.777189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988570+0000","last_change":"2024-09-16T07:29:05.705903+0000","last_active":"2024-09-16T07:29:07.988570+0000","last_peered":"2024-09-16T07:29:07.988570+0000","last_clean":"2024-09-16T07:29:07.988570+0000","last_became_active":"2024-09-16T07:29:05.705624+0000","last_became_peered":"2024-09-16T07:29:05.705624+0000","last_unstale":"2024-09-16T07:29:07.988570+0000","last_undegraded":"2024-09-16T07:29:07.988570+0000","last_fullsized":"2024-09-16T07:29:07.988570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:46:49.930994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691456+0000","last_change":"2024-09-16T07:29:05.691278+0000","last_active":"2024-09-16T07:29:06.691456+0000","last_peered":"2024-09-16T07:29:06.691456+0000","last_clean":"2024-09-16T07:29:06.691456+0000","last_became_active":"2024-09-16T07:29:05.690563+0000","last_became_peered":"2024-09-16T07:29:05.690563+0000","last_unstale":"2024-09-16T07:29:06.691456+0000","last_undegraded":"2024-09-16T07:29:06.691456+0000","last_fullsized":"2024-09-16T07:29:06.691456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:04.901751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990810+0000","last_change":"2024-09-16T07:29:05.695672+0000","last_active":"2024-09-16T07:29:07.990810+0000","last_peered":"2024-09-16T07:29:07.990810+0000","last_clean":"2024-09-16T07:29:07.990810+0000","last_became_active":"2024-09-16T07:29:05.694840+0000","last_became_peered":"2024-09-16T07:29:05.694840+0000","last_unstale":"2024-09-16T07:29:07.990810+0000","last_undegraded":"2024-09-16T07:29:07.990810+0000","last_fullsized":"2024-09-16T07:29:07.990810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:58.013913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.989875+0000","last_change":"2024-09-16T07:29:05.713582+0000","last_active":"2024-09-16T07:29:07.989875+0000","last_peered":"2024-09-16T07:29:07.989875+0000","last_clean":"2024-09-16T07:29:07.989875+0000","last_became_active":"2024-09-16T07:29:05.713358+0000","last_became_peered":"2024-09-16T07:29:05.713358+0000","last_unstale":"2024-09-16T07:29:07.989875+0000","last_undegraded":"2024-09-16T07:29:07.989875+0000","last_fullsized":"2024-09-16T07:29:07.989875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:29.777189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700979+0000","last_change":"2024-09-16T07:29:05.706503+0000","last_active":"2024-09-16T07:29:06.700979+0000","last_peered":"2024-09-16T07:29:06.700979+0000","last_clean":"2024-09-16T07:29:06.700979+0000","last_became_active":"2024-09-16T07:29:05.706233+0000","last_became_peered":"2024-09-16T07:29:05.706233+0000","last_unstale":"2024-09-16T07:29:06.700979+0000","last_undegraded":"2024-09-16T07:29:06.700979+0000","last_fullsized":"2024-09-16T07:29:06.700979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:17.514384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552198+0000","last_change":"2024-09-16T07:29:05.710282+0000","last_active":"2024-09-16T07:29:07.552198+0000","last_peered":"2024-09-16T07:29:07.552198+0000","last_clean":"2024-09-16T07:29:07.552198+0000","last_became_active":"2024-09-16T07:29:05.707389+0000","last_became_peered":"2024-09-16T07:29:05.707389+0000","last_unstale":"2024-09-16T07:29:07.552198+0000","last_undegraded":"2024-09-16T07:29:07.552198+0000","last_fullsized":"2024-09-16T07:29:07.552198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:51.365024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990280+0000","last_change":"2024-09-16T07:29:05.708668+0000","last_active":"2024-09-16T07:29:07.990280+0000","last_peered":"2024-09-16T07:29:07.990280+0000","last_clean":"2024-09-16T07:29:07.990280+0000","last_became_active":"2024-09-16T07:29:05.708471+0000","last_became_peered":"2024-09-16T07:29:05.708471+0000","last_unstale":"2024-09-16T07:29:07.990280+0000","last_undegraded":"2024-09-16T07:29:07.990280+0000","last_fullsized":"2024-09-16T07:29:07.990280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:06.601020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698951+0000","last_change":"2024-09-16T07:29:05.686062+0000","last_active":"2024-09-16T07:29:06.698951+0000","last_peered":"2024-09-16T07:29:06.698951+0000","last_clean":"2024-09-16T07:29:06.698951+0000","last_became_active":"2024-09-16T07:29:05.684983+0000","last_became_peered":"2024-09-16T07:29:05.684983+0000","last_unstale":"2024-09-16T07:29:06.698951+0000","last_undegraded":"2024-09-16T07:29:06.698951+0000","last_fullsized":"2024-09-16T07:29:06.698951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:37.562977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988788+0000","last_change":"2024-09-16T07:29:05.688351+0000","last_active":"2024-09-16T07:29:07.988788+0000","last_peered":"2024-09-16T07:29:07.988788+0000","last_clean":"2024-09-16T07:29:07.988788+0000","last_became_active":"2024-09-16T07:29:05.688141+0000","last_became_peered":"2024-09-16T07:29:05.688141+0000","last_unstale":"2024-09-16T07:29:07.988788+0000","last_undegraded":"2024-09-16T07:29:07.988788+0000","last_fullsized":"2024-09-16T07:29:07.988788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:08:21.411855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691524+0000","last_change":"2024-09-16T07:29:05.709802+0000","last_active":"2024-09-16T07:29:06.691524+0000","last_peered":"2024-09-16T07:29:06.691524+0000","last_clean":"2024-09-16T07:29:06.691524+0000","last_became_active":"2024-09-16T07:29:05.709550+0000","last_became_peered":"2024-09-16T07:29:05.709550+0000","last_unstale":"2024-09-16T07:29:06.691524+0000","last_undegraded":"2024-09-16T07:29:06.691524+0000","last_fullsized":"2024-09-16T07:29:06.691524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:36.380404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698769+0000","last_change":"2024-09-16T07:29:05.691067+0000","last_active":"2024-09-16T07:29:06.698769+0000","last_peered":"2024-09-16T07:29:06.698769+0000","last_clean":"2024-09-16T07:29:06.698769+0000","last_became_active":"2024-09-16T07:29:05.690813+0000","last_became_peered":"2024-09-16T07:29:05.690813+0000","last_unstale":"2024-09-16T07:29:06.698769+0000","last_undegraded":"2024-09-16T07:29:06.698769+0000","last_fullsized":"2024-09-16T07:29:06.698769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:22.249670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990623+0000","last_change":"2024-09-16T07:29:05.695112+0000","last_active":"2024-09-16T07:29:07.990623+0000","last_peered":"2024-09-16T07:29:07.990623+0000","last_clean":"2024-09-16T07:29:07.990623+0000","last_became_active":"2024-09-16T07:29:05.694826+0000","last_became_peered":"2024-09-16T07:29:05.694826+0000","last_unstale":"2024-09-16T07:29:07.990623+0000","last_undegraded":"2024-09-16T07:29:07.990623+0000","last_fullsized":"2024-09-16T07:29:07.990623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:44.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990405+0000","last_change":"2024-09-16T07:29:05.697885+0000","last_active":"2024-09-16T07:29:07.990405+0000","last_peered":"2024-09-16T07:29:07.990405+0000","last_clean":"2024-09-16T07:29:07.990405+0000","last_became_active":"2024-09-16T07:29:05.697566+0000","last_became_peered":"2024-09-16T07:29:05.697566+0000","last_unstale":"2024-09-16T07:29:07.990405+0000","last_undegraded":"2024-09-16T07:29:07.990405+0000","last_fullsized":"2024-09-16T07:29:07.990405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:10.656705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691910+0000","last_change":"2024-09-16T07:29:05.709510+0000","last_active":"2024-09-16T07:29:06.691910+0000","last_peered":"2024-09-16T07:29:06.691910+0000","last_clean":"2024-09-16T07:29:06.691910+0000","last_became_active":"2024-09-16T07:29:05.709266+0000","last_became_peered":"2024-09-16T07:29:05.709266+0000","last_unstale":"2024-09-16T07:29:06.691910+0000","last_undegraded":"2024-09-16T07:29:06.691910+0000","last_fullsized":"2024-09-16T07:29:06.691910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:00:43.107309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691365+0000","last_change":"2024-09-16T07:29:05.710516+0000","last_active":"2024-09-16T07:29:06.691365+0000","last_peered":"2024-09-16T07:29:06.691365+0000","last_clean":"2024-09-16T07:29:06.691365+0000","last_became_active":"2024-09-16T07:29:05.710250+0000","last_became_peered":"2024-09-16T07:29:05.710250+0000","last_unstale":"2024-09-16T07:29:06.691365+0000","last_undegraded":"2024-09-16T07:29:06.691365+0000","last_fullsized":"2024-09-16T07:29:06.691365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:44.455316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988913+0000","last_change":"2024-09-16T07:29:05.703789+0000","last_active":"2024-09-16T07:29:07.988913+0000","last_peered":"2024-09-16T07:29:07.988913+0000","last_clean":"2024-09-16T07:29:07.988913+0000","last_became_active":"2024-09-16T07:29:05.703545+0000","last_became_peered":"2024-09-16T07:29:05.703545+0000","last_unstale":"2024-09-16T07:29:07.988913+0000","last_undegraded":"2024-09-16T07:29:07.988913+0000","last_fullsized":"2024-09-16T07:29:07.988913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:12:13.084835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700600+0000","last_change":"2024-09-16T07:29:05.705011+0000","last_active":"2024-09-16T07:29:06.700600+0000","last_peered":"2024-09-16T07:29:06.700600+0000","last_clean":"2024-09-16T07:29:06.700600+0000","last_became_active":"2024-09-16T07:29:05.704734+0000","last_became_peered":"2024-09-16T07:29:05.704734+0000","last_unstale":"2024-09-16T07:29:06.700600+0000","last_undegraded":"2024-09-16T07:29:06.700600+0000","last_fullsized":"2024-09-16T07:29:06.700600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:27.093090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700262+0000","last_change":"2024-09-16T07:29:05.686329+0000","last_active":"2024-09-16T07:29:06.700262+0000","last_peered":"2024-09-16T07:29:06.700262+0000","last_clean":"2024-09-16T07:29:06.700262+0000","last_became_active":"2024-09-16T07:29:05.686029+0000","last_became_peered":"2024-09-16T07:29:05.686029+0000","last_unstale":"2024-09-16T07:29:06.700262+0000","last_undegraded":"2024-09-16T07:29:06.700262+0000","last_fullsized":"2024-09-16T07:29:06.700262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:07.598934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677221+0000","last_change":"2024-09-16T07:29:05.685144+0000","last_active":"2024-09-16T07:29:07.677221+0000","last_peered":"2024-09-16T07:29:07.677221+0000","last_clean":"2024-09-16T07:29:07.677221+0000","last_became_active":"2024-09-16T07:29:05.684362+0000","last_became_peered":"2024-09-16T07:29:05.684362+0000","last_unstale":"2024-09-16T07:29:07.677221+0000","last_undegraded":"2024-09-16T07:29:07.677221+0000","last_fullsized":"2024-09-16T07:29:07.677221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:47.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698616+0000","last_change":"2024-09-16T07:29:05.681153+0000","last_active":"2024-09-16T07:29:06.698616+0000","last_peered":"2024-09-16T07:29:06.698616+0000","last_clean":"2024-09-16T07:29:06.698616+0000","last_became_active":"2024-09-16T07:29:05.680893+0000","last_became_peered":"2024-09-16T07:29:05.680893+0000","last_unstale":"2024-09-16T07:29:06.698616+0000","last_undegraded":"2024-09-16T07:29:06.698616+0000","last_fullsized":"2024-09-16T07:29:06.698616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:29:57.988014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552312+0000","last_change":"2024-09-16T07:29:05.707511+0000","last_active":"2024-09-16T07:29:07.552312+0000","last_peered":"2024-09-16T07:29:07.552312+0000","last_clean":"2024-09-16T07:29:07.552312+0000","last_became_active":"2024-09-16T07:29:05.707182+0000","last_became_peered":"2024-09-16T07:29:05.707182+0000","last_unstale":"2024-09-16T07:29:07.552312+0000","last_undegraded":"2024-09-16T07:29:07.552312+0000","last_fullsized":"2024-09-16T07:29:07.552312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:06.601020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.692096+0000","last_change":"2024-09-16T07:29:05.693162+0000","last_active":"2024-09-16T07:29:06.692096+0000","last_peered":"2024-09-16T07:29:06.692096+0000","last_clean":"2024-09-16T07:29:06.692096+0000","last_became_active":"2024-09-16T07:29:05.692788+0000","last_became_peered":"2024-09-16T07:29:05.692788+0000","last_unstale":"2024-09-16T07:29:06.692096+0000","last_undegraded":"2024-09-16T07:29:06.692096+0000","last_fullsized":"2024-09-16T07:29:06.692096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:14.177362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552341+0000","last_change":"2024-09-16T07:29:05.705405+0000","last_active":"2024-09-16T07:29:07.552341+0000","last_peered":"2024-09-16T07:29:07.552341+0000","last_clean":"2024-09-16T07:29:07.552341+0000","last_became_active":"2024-09-16T07:29:05.705035+0000","last_became_peered":"2024-09-16T07:29:05.705035+0000","last_unstale":"2024-09-16T07:29:07.552341+0000","last_undegraded":"2024-09-16T07:29:07.552341+0000","last_fullsized":"2024-09-16T07:29:07.552341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:11.886160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698986+0000","last_change":"2024-09-16T07:29:05.699187+0000","last_active":"2024-09-16T07:29:06.698986+0000","last_peered":"2024-09-16T07:29:06.698986+0000","last_clean":"2024-09-16T07:29:06.698986+0000","last_became_active":"2024-09-16T07:29:05.698935+0000","last_became_peered":"2024-09-16T07:29:05.698935+0000","last_unstale":"2024-09-16T07:29:06.698986+0000","last_undegraded":"2024-09-16T07:29:06.698986+0000","last_fullsized":"2024-09-16T07:29:06.698986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:52.398199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700483+0000","last_change":"2024-09-16T07:29:05.685756+0000","last_active":"2024-09-16T07:29:06.700483+0000","last_peered":"2024-09-16T07:29:06.700483+0000","last_clean":"2024-09-16T07:29:06.700483+0000","last_became_active":"2024-09-16T07:29:05.685411+0000","last_became_peered":"2024-09-16T07:29:05.685411+0000","last_unstale":"2024-09-16T07:29:06.700483+0000","last_undegraded":"2024-09-16T07:29:06.700483+0000","last_fullsized":"2024-09-16T07:29:06.700483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:56.954842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990570+0000","last_change":"2024-09-16T07:29:05.686799+0000","last_active":"2024-09-16T07:29:07.990570+0000","last_peered":"2024-09-16T07:29:07.990570+0000","last_clean":"2024-09-16T07:29:07.990570+0000","last_became_active":"2024-09-16T07:29:05.686553+0000","last_became_peered":"2024-09-16T07:29:05.686553+0000","last_unstale":"2024-09-16T07:29:07.990570+0000","last_undegraded":"2024-09-16T07:29:07.990570+0000","last_fullsized":"2024-09-16T07:29:07.990570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:37.562977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990810+0000","last_change":"2024-09-16T07:29:05.699337+0000","last_active":"2024-09-16T07:29:07.990810+0000","last_peered":"2024-09-16T07:29:07.990810+0000","last_clean":"2024-09-16T07:29:07.990810+0000","last_became_active":"2024-09-16T07:29:05.698537+0000","last_became_peered":"2024-09-16T07:29:05.698537+0000","last_unstale":"2024-09-16T07:29:07.990810+0000","last_undegraded":"2024-09-16T07:29:07.990810+0000","last_fullsized":"2024-09-16T07:29:07.990810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:42:11.548433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990398+0000","last_change":"2024-09-16T07:29:05.698132+0000","last_active":"2024-09-16T07:29:07.990398+0000","last_peered":"2024-09-16T07:29:07.990398+0000","last_clean":"2024-09-16T07:29:07.990398+0000","last_became_active":"2024-09-16T07:29:05.697730+0000","last_became_peered":"2024-09-16T07:29:05.697730+0000","last_unstale":"2024-09-16T07:29:07.990398+0000","last_undegraded":"2024-09-16T07:29:07.990398+0000","last_fullsized":"2024-09-16T07:29:07.990398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:11.886160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677508+0000","last_change":"2024-09-16T07:29:05.702986+0000","last_active":"2024-09-16T07:29:07.677508+0000","last_peered":"2024-09-16T07:29:07.677508+0000","last_clean":"2024-09-16T07:29:07.677508+0000","last_became_active":"2024-09-16T07:29:05.702694+0000","last_became_peered":"2024-09-16T07:29:05.702694+0000","last_unstale":"2024-09-16T07:29:07.677508+0000","last_undegraded":"2024-09-16T07:29:07.677508+0000","last_fullsized":"2024-09-16T07:29:07.677508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:42.104005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991433+0000","last_change":"2024-09-16T07:29:04.680366+0000","last_active":"2024-09-16T07:29:07.991433+0000","last_peered":"2024-09-16T07:29:07.991433+0000","last_clean":"2024-09-16T07:29:07.991433+0000","last_became_active":"2024-09-16T07:29:04.680082+0000","last_became_peered":"2024-09-16T07:29:04.680082+0000","last_unstale":"2024-09-16T07:29:07.991433+0000","last_undegraded":"2024-09-16T07:29:07.991433+0000","last_fullsized":"2024-09-16T07:29:07.991433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:08.598702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991295+0000","last_change":"2024-09-16T07:29:05.689136+0000","last_active":"2024-09-16T07:29:07.991295+0000","last_peered":"2024-09-16T07:29:07.991295+0000","last_clean":"2024-09-16T07:29:07.991295+0000","last_became_active":"2024-09-16T07:29:05.688849+0000","last_became_peered":"2024-09-16T07:29:05.688849+0000","last_unstale":"2024-09-16T07:29:07.991295+0000","last_undegraded":"2024-09-16T07:29:07.991295+0000","last_fullsized":"2024-09-16T07:29:07.991295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:53.638340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677499+0000","last_change":"2024-09-16T07:29:04.685794+0000","last_active":"2024-09-16T07:29:07.677499+0000","last_peered":"2024-09-16T07:29:07.677499+0000","last_clean":"2024-09-16T07:29:07.677499+0000","last_became_active":"2024-09-16T07:29:04.685459+0000","last_became_peered":"2024-09-16T07:29:04.685459+0000","last_unstale":"2024-09-16T07:29:07.677499+0000","last_undegraded":"2024-09-16T07:29:07.677499+0000","last_fullsized":"2024-09-16T07:29:07.677499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:58.033566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700425+0000","last_change":"2024-09-16T07:29:05.696003+0000","last_active":"2024-09-16T07:29:06.700425+0000","last_peered":"2024-09-16T07:29:06.700425+0000","last_clean":"2024-09-16T07:29:06.700425+0000","last_became_active":"2024-09-16T07:29:05.695747+0000","last_became_peered":"2024-09-16T07:29:05.695747+0000","last_unstale":"2024-09-16T07:29:06.700425+0000","last_undegraded":"2024-09-16T07:29:06.700425+0000","last_fullsized":"2024-09-16T07:29:06.700425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:45.008473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691276+0000","last_change":"2024-09-16T07:29:04.689645+0000","last_active":"2024-09-16T07:29:06.691276+0000","last_peered":"2024-09-16T07:29:06.691276+0000","last_clean":"2024-09-16T07:29:06.691276+0000","last_became_active":"2024-09-16T07:29:04.689326+0000","last_became_peered":"2024-09-16T07:29:04.689326+0000","last_unstale":"2024-09-16T07:29:06.691276+0000","last_undegraded":"2024-09-16T07:29:06.691276+0000","last_fullsized":"2024-09-16T07:29:06.691276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:29.324427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552374+0000","last_change":"2024-09-16T07:29:05.700717+0000","last_active":"2024-09-16T07:29:07.552374+0000","last_peered":"2024-09-16T07:29:07.552374+0000","last_clean":"2024-09-16T07:29:07.552374+0000","last_became_active":"2024-09-16T07:29:05.700463+0000","last_became_peered":"2024-09-16T07:29:05.700463+0000","last_unstale":"2024-09-16T07:29:07.552374+0000","last_undegraded":"2024-09-16T07:29:07.552374+0000","last_fullsized":"2024-09-16T07:29:07.552374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:10.656705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988816+0000","last_change":"2024-09-16T07:29:04.686085+0000","last_active":"2024-09-16T07:29:07.988816+0000","last_peered":"2024-09-16T07:29:07.988816+0000","last_clean":"2024-09-16T07:29:07.988816+0000","last_became_active":"2024-09-16T07:29:04.685791+0000","last_became_peered":"2024-09-16T07:29:04.685791+0000","last_unstale":"2024-09-16T07:29:07.988816+0000","last_undegraded":"2024-09-16T07:29:07.988816+0000","last_fullsized":"2024-09-16T07:29:07.988816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:32:32.365681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990549+0000","last_change":"2024-09-16T07:29:05.699121+0000","last_active":"2024-09-16T07:29:07.990549+0000","last_peered":"2024-09-16T07:29:07.990549+0000","last_clean":"2024-09-16T07:29:07.990549+0000","last_became_active":"2024-09-16T07:29:05.698841+0000","last_became_peered":"2024-09-16T07:29:05.698841+0000","last_unstale":"2024-09-16T07:29:07.990549+0000","last_undegraded":"2024-09-16T07:29:07.990549+0000","last_fullsized":"2024-09-16T07:29:07.990549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:17.955172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700623+0000","last_change":"2024-09-16T07:29:04.693386+0000","last_active":"2024-09-16T07:29:06.700623+0000","last_peered":"2024-09-16T07:29:06.700623+0000","last_clean":"2024-09-16T07:29:06.700623+0000","last_became_active":"2024-09-16T07:29:04.693194+0000","last_became_peered":"2024-09-16T07:29:04.693194+0000","last_unstale":"2024-09-16T07:29:06.700623+0000","last_undegraded":"2024-09-16T07:29:06.700623+0000","last_fullsized":"2024-09-16T07:29:06.700623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:45.737517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698843+0000","last_change":"2024-09-16T07:29:05.694634+0000","last_active":"2024-09-16T07:29:06.698843+0000","last_peered":"2024-09-16T07:29:06.698843+0000","last_clean":"2024-09-16T07:29:06.698843+0000","last_became_active":"2024-09-16T07:29:05.694368+0000","last_became_peered":"2024-09-16T07:29:05.694368+0000","last_unstale":"2024-09-16T07:29:06.698843+0000","last_undegraded":"2024-09-16T07:29:06.698843+0000","last_fullsized":"2024-09-16T07:29:06.698843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:31.602901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700354+0000","last_change":"2024-09-16T07:29:04.680986+0000","last_active":"2024-09-16T07:29:06.700354+0000","last_peered":"2024-09-16T07:29:06.700354+0000","last_clean":"2024-09-16T07:29:06.700354+0000","last_became_active":"2024-09-16T07:29:04.680600+0000","last_became_peered":"2024-09-16T07:29:04.680600+0000","last_unstale":"2024-09-16T07:29:06.700354+0000","last_undegraded":"2024-09-16T07:29:06.700354+0000","last_fullsized":"2024-09-16T07:29:06.700354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:41.134621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700109+0000","last_change":"2024-09-16T07:29:05.684542+0000","last_active":"2024-09-16T07:29:06.700109+0000","last_peered":"2024-09-16T07:29:06.700109+0000","last_clean":"2024-09-16T07:29:06.700109+0000","last_became_active":"2024-09-16T07:29:05.684159+0000","last_became_peered":"2024-09-16T07:29:05.684159+0000","last_unstale":"2024-09-16T07:29:06.700109+0000","last_undegraded":"2024-09-16T07:29:06.700109+0000","last_fullsized":"2024-09-16T07:29:06.700109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:47.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691386+0000","last_change":"2024-09-16T07:29:04.681541+0000","last_active":"2024-09-16T07:29:06.691386+0000","last_peered":"2024-09-16T07:29:06.691386+0000","last_clean":"2024-09-16T07:29:06.691386+0000","last_became_active":"2024-09-16T07:29:04.680791+0000","last_became_peered":"2024-09-16T07:29:04.680791+0000","last_unstale":"2024-09-16T07:29:06.691386+0000","last_undegraded":"2024-09-16T07:29:06.691386+0000","last_fullsized":"2024-09-16T07:29:06.691386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:52.629856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551701+0000","last_change":"2024-09-16T07:29:05.699374+0000","last_active":"2024-09-16T07:29:07.551701+0000","last_peered":"2024-09-16T07:29:07.551701+0000","last_clean":"2024-09-16T07:29:07.551701+0000","last_became_active":"2024-09-16T07:29:05.686490+0000","last_became_peered":"2024-09-16T07:29:05.686490+0000","last_unstale":"2024-09-16T07:29:07.551701+0000","last_undegraded":"2024-09-16T07:29:07.551701+0000","last_fullsized":"2024-09-16T07:29:07.551701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:02.946673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700304+0000","last_change":"2024-09-16T07:29:04.677432+0000","last_active":"2024-09-16T07:29:06.700304+0000","last_peered":"2024-09-16T07:29:06.700304+0000","last_clean":"2024-09-16T07:29:06.700304+0000","last_became_active":"2024-09-16T07:29:04.677134+0000","last_became_peered":"2024-09-16T07:29:04.677134+0000","last_unstale":"2024-09-16T07:29:06.700304+0000","last_undegraded":"2024-09-16T07:29:06.700304+0000","last_fullsized":"2024-09-16T07:29:06.700304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:03.823610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699336+0000","last_change":"2024-09-16T07:29:05.695653+0000","last_active":"2024-09-16T07:29:06.699336+0000","last_peered":"2024-09-16T07:29:06.699336+0000","last_clean":"2024-09-16T07:29:06.699336+0000","last_became_active":"2024-09-16T07:29:05.695280+0000","last_became_peered":"2024-09-16T07:29:05.695280+0000","last_unstale":"2024-09-16T07:29:06.699336+0000","last_undegraded":"2024-09-16T07:29:06.699336+0000","last_fullsized":"2024-09-16T07:29:06.699336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:44.294346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691946+0000","last_change":"2024-09-16T07:29:04.682861+0000","last_active":"2024-09-16T07:29:06.691946+0000","last_peered":"2024-09-16T07:29:06.691946+0000","last_clean":"2024-09-16T07:29:06.691946+0000","last_became_active":"2024-09-16T07:29:04.682605+0000","last_became_peered":"2024-09-16T07:29:04.682605+0000","last_unstale":"2024-09-16T07:29:06.691946+0000","last_undegraded":"2024-09-16T07:29:06.691946+0000","last_fullsized":"2024-09-16T07:29:06.691946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:41.095521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691888+0000","last_change":"2024-09-16T07:29:05.714627+0000","last_active":"2024-09-16T07:29:06.691888+0000","last_peered":"2024-09-16T07:29:06.691888+0000","last_clean":"2024-09-16T07:29:06.691888+0000","last_became_active":"2024-09-16T07:29:05.714354+0000","last_became_peered":"2024-09-16T07:29:05.714354+0000","last_unstale":"2024-09-16T07:29:06.691888+0000","last_undegraded":"2024-09-16T07:29:06.691888+0000","last_fullsized":"2024-09-16T07:29:06.691888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:01.936202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677679+0000","last_change":"2024-09-16T07:29:04.682290+0000","last_active":"2024-09-16T07:29:07.677679+0000","last_peered":"2024-09-16T07:29:07.677679+0000","last_clean":"2024-09-16T07:29:07.677679+0000","last_became_active":"2024-09-16T07:29:04.681995+0000","last_became_peered":"2024-09-16T07:29:04.681995+0000","last_unstale":"2024-09-16T07:29:07.677679+0000","last_undegraded":"2024-09-16T07:29:07.677679+0000","last_fullsized":"2024-09-16T07:29:07.677679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:03:17.545776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691545+0000","last_change":"2024-09-16T07:29:05.684697+0000","last_active":"2024-09-16T07:29:06.691545+0000","last_peered":"2024-09-16T07:29:06.691545+0000","last_clean":"2024-09-16T07:29:06.691545+0000","last_became_active":"2024-09-16T07:29:05.683882+0000","last_became_peered":"2024-09-16T07:29:05.683882+0000","last_unstale":"2024-09-16T07:29:06.691545+0000","last_undegraded":"2024-09-16T07:29:06.691545+0000","last_fullsized":"2024-09-16T07:29:06.691545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:24.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699148+0000","last_change":"2024-09-16T07:29:04.688689+0000","last_active":"2024-09-16T07:29:06.699148+0000","last_peered":"2024-09-16T07:29:06.699148+0000","last_clean":"2024-09-16T07:29:06.699148+0000","last_became_active":"2024-09-16T07:29:04.687010+0000","last_became_peered":"2024-09-16T07:29:04.687010+0000","last_unstale":"2024-09-16T07:29:06.699148+0000","last_undegraded":"2024-09-16T07:29:06.699148+0000","last_fullsized":"2024-09-16T07:29:06.699148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:29.324427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698968+0000","last_change":"2024-09-16T07:29:05.703232+0000","last_active":"2024-09-16T07:29:06.698968+0000","last_peered":"2024-09-16T07:29:06.698968+0000","last_clean":"2024-09-16T07:29:06.698968+0000","last_became_active":"2024-09-16T07:29:05.702661+0000","last_became_peered":"2024-09-16T07:29:05.702661+0000","last_unstale":"2024-09-16T07:29:06.698968+0000","last_undegraded":"2024-09-16T07:29:06.698968+0000","last_fullsized":"2024-09-16T07:29:06.698968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:14.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691546+0000","last_change":"2024-09-16T07:29:04.687313+0000","last_active":"2024-09-16T07:29:06.691546+0000","last_peered":"2024-09-16T07:29:06.691546+0000","last_clean":"2024-09-16T07:29:06.691546+0000","last_became_active":"2024-09-16T07:29:04.686929+0000","last_became_peered":"2024-09-16T07:29:04.686929+0000","last_unstale":"2024-09-16T07:29:06.691546+0000","last_undegraded":"2024-09-16T07:29:06.691546+0000","last_fullsized":"2024-09-16T07:29:06.691546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:49.928022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551710+0000","last_change":"2024-09-16T07:29:05.698400+0000","last_active":"2024-09-16T07:29:07.551710+0000","last_peered":"2024-09-16T07:29:07.551710+0000","last_clean":"2024-09-16T07:29:07.551710+0000","last_became_active":"2024-09-16T07:29:05.698108+0000","last_became_peered":"2024-09-16T07:29:05.698108+0000","last_unstale":"2024-09-16T07:29:07.551710+0000","last_undegraded":"2024-09-16T07:29:07.551710+0000","last_fullsized":"2024-09-16T07:29:07.551710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:53:31.326753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700692+0000","last_change":"2024-09-16T07:29:04.687978+0000","last_active":"2024-09-16T07:29:06.700692+0000","last_peered":"2024-09-16T07:29:06.700692+0000","last_clean":"2024-09-16T07:29:06.700692+0000","last_became_active":"2024-09-16T07:29:04.687570+0000","last_became_peered":"2024-09-16T07:29:04.687570+0000","last_unstale":"2024-09-16T07:29:06.700692+0000","last_undegraded":"2024-09-16T07:29:06.700692+0000","last_fullsized":"2024-09-16T07:29:06.700692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:28.591950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691465+0000","last_change":"2024-09-16T07:29:05.703911+0000","last_active":"2024-09-16T07:29:06.691465+0000","last_peered":"2024-09-16T07:29:06.691465+0000","last_clean":"2024-09-16T07:29:06.691465+0000","last_became_active":"2024-09-16T07:29:05.701641+0000","last_became_peered":"2024-09-16T07:29:05.701641+0000","last_unstale":"2024-09-16T07:29:06.691465+0000","last_undegraded":"2024-09-16T07:29:06.691465+0000","last_fullsized":"2024-09-16T07:29:06.691465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:58.013913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551747+0000","last_change":"2024-09-16T07:29:04.683742+0000","last_active":"2024-09-16T07:29:07.551747+0000","last_peered":"2024-09-16T07:29:07.551747+0000","last_clean":"2024-09-16T07:29:07.551747+0000","last_became_active":"2024-09-16T07:29:04.683172+0000","last_became_peered":"2024-09-16T07:29:04.683172+0000","last_unstale":"2024-09-16T07:29:07.551747+0000","last_undegraded":"2024-09-16T07:29:07.551747+0000","last_fullsized":"2024-09-16T07:29:07.551747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:58.033566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990130+0000","last_change":"2024-09-16T07:29:05.698267+0000","last_active":"2024-09-16T07:29:07.990130+0000","last_peered":"2024-09-16T07:29:07.990130+0000","last_clean":"2024-09-16T07:29:07.990130+0000","last_became_active":"2024-09-16T07:29:05.697840+0000","last_became_peered":"2024-09-16T07:29:05.697840+0000","last_unstale":"2024-09-16T07:29:07.990130+0000","last_undegraded":"2024-09-16T07:29:07.990130+0000","last_fullsized":"2024-09-16T07:29:07.990130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:51.365024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691256+0000","last_change":"2024-09-16T07:29:04.684134+0000","last_active":"2024-09-16T07:29:06.691256+0000","last_peered":"2024-09-16T07:29:06.691256+0000","last_clean":"2024-09-16T07:29:06.691256+0000","last_became_active":"2024-09-16T07:29:04.683409+0000","last_became_peered":"2024-09-16T07:29:04.683409+0000","last_unstale":"2024-09-16T07:29:06.691256+0000","last_undegraded":"2024-09-16T07:29:06.691256+0000","last_fullsized":"2024-09-16T07:29:06.691256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:00.473499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.989977+0000","last_change":"2024-09-16T07:29:05.690389+0000","last_active":"2024-09-16T07:29:07.989977+0000","last_peered":"2024-09-16T07:29:07.989977+0000","last_clean":"2024-09-16T07:29:07.989977+0000","last_became_active":"2024-09-16T07:29:05.689175+0000","last_became_peered":"2024-09-16T07:29:05.689175+0000","last_unstale":"2024-09-16T07:29:07.989977+0000","last_undegraded":"2024-09-16T07:29:07.989977+0000","last_fullsized":"2024-09-16T07:29:07.989977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:38:00.361615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691266+0000","last_change":"2024-09-16T07:29:04.688866+0000","last_active":"2024-09-16T07:29:06.691266+0000","last_peered":"2024-09-16T07:29:06.691266+0000","last_clean":"2024-09-16T07:29:06.691266+0000","last_became_active":"2024-09-16T07:29:04.688617+0000","last_became_peered":"2024-09-16T07:29:04.688617+0000","last_unstale":"2024-09-16T07:29:06.691266+0000","last_undegraded":"2024-09-16T07:29:06.691266+0000","last_fullsized":"2024-09-16T07:29:06.691266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:04:33.664159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700907+0000","last_change":"2024-09-16T07:29:05.686066+0000","last_active":"2024-09-16T07:29:06.700907+0000","last_peered":"2024-09-16T07:29:06.700907+0000","last_clean":"2024-09-16T07:29:06.700907+0000","last_became_active":"2024-09-16T07:29:05.685800+0000","last_became_peered":"2024-09-16T07:29:05.685800+0000","last_unstale":"2024-09-16T07:29:06.700907+0000","last_undegraded":"2024-09-16T07:29:06.700907+0000","last_fullsized":"2024-09-16T07:29:06.700907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:24.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552365+0000","last_change":"2024-09-16T07:29:04.684997+0000","last_active":"2024-09-16T07:29:07.552365+0000","last_peered":"2024-09-16T07:29:07.552365+0000","last_clean":"2024-09-16T07:29:07.552365+0000","last_became_active":"2024-09-16T07:29:04.684520+0000","last_became_peered":"2024-09-16T07:29:04.684520+0000","last_unstale":"2024-09-16T07:29:07.552365+0000","last_undegraded":"2024-09-16T07:29:07.552365+0000","last_fullsized":"2024-09-16T07:29:07.552365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:46.880482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699438+0000","last_change":"2024-09-16T07:29:05.679651+0000","last_active":"2024-09-16T07:29:06.699438+0000","last_peered":"2024-09-16T07:29:06.699438+0000","last_clean":"2024-09-16T07:29:06.699438+0000","last_became_active":"2024-09-16T07:29:05.679281+0000","last_became_peered":"2024-09-16T07:29:05.679281+0000","last_unstale":"2024-09-16T07:29:06.699438+0000","last_undegraded":"2024-09-16T07:29:06.699438+0000","last_fullsized":"2024-09-16T07:29:06.699438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:54:42.349663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700854+0000","last_change":"2024-09-16T07:29:04.688727+0000","last_active":"2024-09-16T07:29:06.700854+0000","last_peered":"2024-09-16T07:29:06.700854+0000","last_clean":"2024-09-16T07:29:06.700854+0000","last_became_active":"2024-09-16T07:29:04.687576+0000","last_became_peered":"2024-09-16T07:29:04.687576+0000","last_unstale":"2024-09-16T07:29:06.700854+0000","last_undegraded":"2024-09-16T07:29:06.700854+0000","last_fullsized":"2024-09-16T07:29:06.700854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:06.695170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551970+0000","last_change":"2024-09-16T07:29:05.705266+0000","last_active":"2024-09-16T07:29:07.551970+0000","last_peered":"2024-09-16T07:29:07.551970+0000","last_clean":"2024-09-16T07:29:07.551970+0000","last_became_active":"2024-09-16T07:29:05.704987+0000","last_became_peered":"2024-09-16T07:29:05.704987+0000","last_unstale":"2024-09-16T07:29:07.551970+0000","last_undegraded":"2024-09-16T07:29:07.551970+0000","last_fullsized":"2024-09-16T07:29:07.551970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:04.580102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700807+0000","last_change":"2024-09-16T07:29:04.688933+0000","last_active":"2024-09-16T07:29:06.700807+0000","last_peered":"2024-09-16T07:29:06.700807+0000","last_clean":"2024-09-16T07:29:06.700807+0000","last_became_active":"2024-09-16T07:29:04.688568+0000","last_became_peered":"2024-09-16T07:29:04.688568+0000","last_unstale":"2024-09-16T07:29:06.700807+0000","last_undegraded":"2024-09-16T07:29:06.700807+0000","last_fullsized":"2024-09-16T07:29:06.700807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988965+0000","last_change":"2024-09-16T07:29:05.691684+0000","last_active":"2024-09-16T07:29:07.988965+0000","last_peered":"2024-09-16T07:29:07.988965+0000","last_clean":"2024-09-16T07:29:07.988965+0000","last_became_active":"2024-09-16T07:29:05.691415+0000","last_became_peered":"2024-09-16T07:29:05.691415+0000","last_unstale":"2024-09-16T07:29:07.988965+0000","last_undegraded":"2024-09-16T07:29:07.988965+0000","last_fullsized":"2024-09-16T07:29:07.988965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:27:51.028445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700453+0000","last_change":"2024-09-16T07:29:04.686063+0000","last_active":"2024-09-16T07:29:06.700453+0000","last_peered":"2024-09-16T07:29:06.700453+0000","last_clean":"2024-09-16T07:29:06.700453+0000","last_became_active":"2024-09-16T07:29:04.685265+0000","last_became_peered":"2024-09-16T07:29:04.685265+0000","last_unstale":"2024-09-16T07:29:06.700453+0000","last_undegraded":"2024-09-16T07:29:06.700453+0000","last_fullsized":"2024-09-16T07:29:06.700453+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:20:04.767977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988551+0000","last_change":"2024-09-16T07:29:05.680005+0000","last_active":"2024-09-16T07:29:07.988551+0000","last_peered":"2024-09-16T07:29:07.988551+0000","last_clean":"2024-09-16T07:29:07.988551+0000","last_became_active":"2024-09-16T07:29:05.679750+0000","last_became_peered":"2024-09-16T07:29:05.679750+0000","last_unstale":"2024-09-16T07:29:07.988551+0000","last_undegraded":"2024-09-16T07:29:07.988551+0000","last_fullsized":"2024-09-16T07:29:07.988551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:53.415692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677397+0000","last_change":"2024-09-16T07:29:04.688075+0000","last_active":"2024-09-16T07:29:07.677397+0000","last_peered":"2024-09-16T07:29:07.677397+0000","last_clean":"2024-09-16T07:29:07.677397+0000","last_became_active":"2024-09-16T07:29:04.687842+0000","last_became_peered":"2024-09-16T07:29:04.687842+0000","last_unstale":"2024-09-16T07:29:07.677397+0000","last_undegraded":"2024-09-16T07:29:07.677397+0000","last_fullsized":"2024-09-16T07:29:07.677397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:14:08.598702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988837+0000","last_change":"2024-09-16T07:29:05.693645+0000","last_active":"2024-09-16T07:29:07.988837+0000","last_peered":"2024-09-16T07:29:07.988837+0000","last_clean":"2024-09-16T07:29:07.988837+0000","last_became_active":"2024-09-16T07:29:05.693349+0000","last_became_peered":"2024-09-16T07:29:05.693349+0000","last_unstale":"2024-09-16T07:29:07.988837+0000","last_undegraded":"2024-09-16T07:29:07.988837+0000","last_fullsized":"2024-09-16T07:29:07.988837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:05.940761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.989971+0000","last_change":"2024-09-16T07:29:04.692249+0000","last_active":"2024-09-16T07:29:07.989971+0000","last_peered":"2024-09-16T07:29:07.989971+0000","last_clean":"2024-09-16T07:29:07.989971+0000","last_became_active":"2024-09-16T07:29:04.691889+0000","last_became_peered":"2024-09-16T07:29:04.691889+0000","last_unstale":"2024-09-16T07:29:07.989971+0000","last_undegraded":"2024-09-16T07:29:07.989971+0000","last_fullsized":"2024-09-16T07:29:07.989971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:21.585790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988537+0000","last_change":"2024-09-16T07:29:05.681733+0000","last_active":"2024-09-16T07:29:07.988537+0000","last_peered":"2024-09-16T07:29:07.988537+0000","last_clean":"2024-09-16T07:29:07.988537+0000","last_became_active":"2024-09-16T07:29:05.681458+0000","last_became_peered":"2024-09-16T07:29:05.681458+0000","last_unstale":"2024-09-16T07:29:07.988537+0000","last_undegraded":"2024-09-16T07:29:07.988537+0000","last_fullsized":"2024-09-16T07:29:07.988537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:00.822201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700303+0000","last_change":"2024-09-16T07:29:04.689801+0000","last_active":"2024-09-16T07:29:06.700303+0000","last_peered":"2024-09-16T07:29:06.700303+0000","last_clean":"2024-09-16T07:29:06.700303+0000","last_became_active":"2024-09-16T07:29:04.689407+0000","last_became_peered":"2024-09-16T07:29:04.689407+0000","last_unstale":"2024-09-16T07:29:06.700303+0000","last_undegraded":"2024-09-16T07:29:06.700303+0000","last_fullsized":"2024-09-16T07:29:06.700303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.991022+0000","last_change":"2024-09-16T07:29:05.690529+0000","last_active":"2024-09-16T07:29:07.991022+0000","last_peered":"2024-09-16T07:29:07.991022+0000","last_clean":"2024-09-16T07:29:07.991022+0000","last_became_active":"2024-09-16T07:29:05.690240+0000","last_became_peered":"2024-09-16T07:29:05.690240+0000","last_unstale":"2024-09-16T07:29:07.991022+0000","last_undegraded":"2024-09-16T07:29:07.991022+0000","last_fullsized":"2024-09-16T07:29:07.991022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:04.901751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.698821+0000","last_change":"2024-09-16T07:29:04.689517+0000","last_active":"2024-09-16T07:29:06.698821+0000","last_peered":"2024-09-16T07:29:06.698821+0000","last_clean":"2024-09-16T07:29:06.698821+0000","last_became_active":"2024-09-16T07:29:04.689245+0000","last_became_peered":"2024-09-16T07:29:04.689245+0000","last_unstale":"2024-09-16T07:29:06.698821+0000","last_undegraded":"2024-09-16T07:29:06.698821+0000","last_fullsized":"2024-09-16T07:29:06.698821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:00.473499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.988953+0000","last_change":"2024-09-16T07:29:05.692685+0000","last_active":"2024-09-16T07:29:07.988953+0000","last_peered":"2024-09-16T07:29:07.988953+0000","last_clean":"2024-09-16T07:29:07.988953+0000","last_became_active":"2024-09-16T07:29:05.692384+0000","last_became_peered":"2024-09-16T07:29:05.692384+0000","last_unstale":"2024-09-16T07:29:07.988953+0000","last_undegraded":"2024-09-16T07:29:07.988953+0000","last_fullsized":"2024-09-16T07:29:07.988953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:10.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552432+0000","last_change":"2024-09-16T07:29:04.680088+0000","last_active":"2024-09-16T07:29:07.552432+0000","last_peered":"2024-09-16T07:29:07.552432+0000","last_clean":"2024-09-16T07:29:07.552432+0000","last_became_active":"2024-09-16T07:29:04.679832+0000","last_became_peered":"2024-09-16T07:29:04.679832+0000","last_unstale":"2024-09-16T07:29:07.552432+0000","last_undegraded":"2024-09-16T07:29:07.552432+0000","last_fullsized":"2024-09-16T07:29:07.552432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:16.151181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.699437+0000","last_change":"2024-09-16T07:29:05.701956+0000","last_active":"2024-09-16T07:29:06.699437+0000","last_peered":"2024-09-16T07:29:06.699437+0000","last_clean":"2024-09-16T07:29:06.699437+0000","last_became_active":"2024-09-16T07:29:05.700771+0000","last_became_peered":"2024-09-16T07:29:05.700771+0000","last_unstale":"2024-09-16T07:29:06.699437+0000","last_undegraded":"2024-09-16T07:29:06.699437+0000","last_fullsized":"2024-09-16T07:29:06.699437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:24.646705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677664+0000","last_change":"2024-09-16T07:29:04.679959+0000","last_active":"2024-09-16T07:29:07.677664+0000","last_peered":"2024-09-16T07:29:07.677664+0000","last_clean":"2024-09-16T07:29:07.677664+0000","last_became_active":"2024-09-16T07:29:04.679699+0000","last_became_peered":"2024-09-16T07:29:04.679699+0000","last_unstale":"2024-09-16T07:29:07.677664+0000","last_undegraded":"2024-09-16T07:29:07.677664+0000","last_fullsized":"2024-09-16T07:29:07.677664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:07:10.270600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677459+0000","last_change":"2024-09-16T07:29:05.713917+0000","last_active":"2024-09-16T07:29:07.677459+0000","last_peered":"2024-09-16T07:29:07.677459+0000","last_clean":"2024-09-16T07:29:07.677459+0000","last_became_active":"2024-09-16T07:29:05.713437+0000","last_became_peered":"2024-09-16T07:29:05.713437+0000","last_unstale":"2024-09-16T07:29:07.677459+0000","last_undegraded":"2024-09-16T07:29:07.677459+0000","last_fullsized":"2024-09-16T07:29:07.677459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:17.159665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.552235+0000","last_change":"2024-09-16T07:29:04.685192+0000","last_active":"2024-09-16T07:29:07.552235+0000","last_peered":"2024-09-16T07:29:07.552235+0000","last_clean":"2024-09-16T07:29:07.552235+0000","last_became_active":"2024-09-16T07:29:04.684971+0000","last_became_peered":"2024-09-16T07:29:04.684971+0000","last_unstale":"2024-09-16T07:29:07.552235+0000","last_undegraded":"2024-09-16T07:29:07.552235+0000","last_fullsized":"2024-09-16T07:29:07.552235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:03:17.545776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990051+0000","last_change":"2024-09-16T07:29:05.683940+0000","last_active":"2024-09-16T07:29:07.990051+0000","last_peered":"2024-09-16T07:29:07.990051+0000","last_clean":"2024-09-16T07:29:07.990051+0000","last_became_active":"2024-09-16T07:29:05.683668+0000","last_became_peered":"2024-09-16T07:29:05.683668+0000","last_unstale":"2024-09-16T07:29:07.990051+0000","last_undegraded":"2024-09-16T07:29:07.990051+0000","last_fullsized":"2024-09-16T07:29:07.990051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:12:55.434863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677637+0000","last_change":"2024-09-16T07:29:04.688174+0000","last_active":"2024-09-16T07:29:07.677637+0000","last_peered":"2024-09-16T07:29:07.677637+0000","last_clean":"2024-09-16T07:29:07.677637+0000","last_became_active":"2024-09-16T07:29:04.687913+0000","last_became_peered":"2024-09-16T07:29:04.687913+0000","last_unstale":"2024-09-16T07:29:07.677637+0000","last_undegraded":"2024-09-16T07:29:07.677637+0000","last_fullsized":"2024-09-16T07:29:07.677637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:37.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.677442+0000","last_change":"2024-09-16T07:29:05.703810+0000","last_active":"2024-09-16T07:29:07.677442+0000","last_peered":"2024-09-16T07:29:07.677442+0000","last_clean":"2024-09-16T07:29:07.677442+0000","last_became_active":"2024-09-16T07:29:05.703546+0000","last_became_peered":"2024-09-16T07:29:05.703546+0000","last_unstale":"2024-09-16T07:29:07.677442+0000","last_undegraded":"2024-09-16T07:29:07.677442+0000","last_fullsized":"2024-09-16T07:29:07.677442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:07.598934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.551832+0000","last_change":"2024-09-16T07:29:04.683463+0000","last_active":"2024-09-16T07:29:07.551832+0000","last_peered":"2024-09-16T07:29:07.551832+0000","last_clean":"2024-09-16T07:29:07.551832+0000","last_became_active":"2024-09-16T07:29:04.682288+0000","last_became_peered":"2024-09-16T07:29:04.682288+0000","last_unstale":"2024-09-16T07:29:07.551832+0000","last_undegraded":"2024-09-16T07:29:07.551832+0000","last_fullsized":"2024-09-16T07:29:07.551832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:37.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691150+0000","last_change":"2024-09-16T07:29:05.690104+0000","last_active":"2024-09-16T07:29:06.691150+0000","last_peered":"2024-09-16T07:29:06.691150+0000","last_clean":"2024-09-16T07:29:06.691150+0000","last_became_active":"2024-09-16T07:29:05.689811+0000","last_became_peered":"2024-09-16T07:29:05.689811+0000","last_unstale":"2024-09-16T07:29:06.691150+0000","last_undegraded":"2024-09-16T07:29:06.691150+0000","last_fullsized":"2024-09-16T07:29:06.691150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:22.381670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700630+0000","last_change":"2024-09-16T07:29:04.682025+0000","last_active":"2024-09-16T07:29:06.700630+0000","last_peered":"2024-09-16T07:29:06.700630+0000","last_clean":"2024-09-16T07:29:06.700630+0000","last_became_active":"2024-09-16T07:29:04.681723+0000","last_became_peered":"2024-09-16T07:29:04.681723+0000","last_unstale":"2024-09-16T07:29:06.700630+0000","last_undegraded":"2024-09-16T07:29:06.700630+0000","last_fullsized":"2024-09-16T07:29:06.700630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:42.885409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.700127+0000","last_change":"2024-09-16T07:29:05.687330+0000","last_active":"2024-09-16T07:29:06.700127+0000","last_peered":"2024-09-16T07:29:06.700127+0000","last_clean":"2024-09-16T07:29:06.700127+0000","last_became_active":"2024-09-16T07:29:05.685401+0000","last_became_peered":"2024-09-16T07:29:05.685401+0000","last_unstale":"2024-09-16T07:29:06.700127+0000","last_undegraded":"2024-09-16T07:29:06.700127+0000","last_fullsized":"2024-09-16T07:29:06.700127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:53.638340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:06.691144+0000","last_change":"2024-09-16T07:29:04.688723+0000","last_active":"2024-09-16T07:29:06.691144+0000","last_peered":"2024-09-16T07:29:06.691144+0000","last_clean":"2024-09-16T07:29:06.691144+0000","last_became_active":"2024-09-16T07:29:04.688446+0000","last_became_peered":"2024-09-16T07:29:04.688446+0000","last_unstale":"2024-09-16T07:29:06.691144+0000","last_undegraded":"2024-09-16T07:29:06.691144+0000","last_fullsized":"2024-09-16T07:29:06.691144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:24.593805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990368+0000","last_change":"2024-09-16T07:29:05.708094+0000","last_active":"2024-09-16T07:29:07.990368+0000","last_peered":"2024-09-16T07:29:07.990368+0000","last_clean":"2024-09-16T07:29:07.990368+0000","last_became_active":"2024-09-16T07:29:05.707129+0000","last_became_peered":"2024-09-16T07:29:05.707129+0000","last_unstale":"2024-09-16T07:29:07.990368+0000","last_undegraded":"2024-09-16T07:29:07.990368+0000","last_fullsized":"2024-09-16T07:29:07.990368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:04.656093+0000","last_clean_scrub_stamp":"2024-09-16T07:29:04.656093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:36.380404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990216+0000","last_change":"2024-09-16T07:29:04.684672+0000","last_active":"2024-09-16T07:29:07.990216+0000","last_peered":"2024-09-16T07:29:07.990216+0000","last_clean":"2024-09-16T07:29:07.990216+0000","last_became_active":"2024-09-16T07:29:04.684435+0000","last_became_peered":"2024-09-16T07:29:04.684435+0000","last_unstale":"2024-09-16T07:29:07.990216+0000","last_undegraded":"2024-09-16T07:29:07.990216+0000","last_fullsized":"2024-09-16T07:29:07.990216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:03.647610+0000","last_clean_scrub_stamp":"2024-09-16T07:29:03.647610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:38.019521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:29:07.990596+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:07.990596+0000","last_peered":"2024-09-16T07:29:07.990596+0000","last_clean":"2024-09-16T07:29:07.990596+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:07.990596+0000","last_undegraded":"2024-09-16T07:29:07.990596+0000","last_fullsized":"2024-09-16T07:29:07.990596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":729934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":140092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":140148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":139580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":141110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":141110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":139546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:14.801 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:29:14.801 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:29:14.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- 172.21.15.114:0/3953135321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcec004d50 msgr2=0x7efcec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 --2- 172.21.15.114:0/3953135321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcec004d50 0x7efcec0051d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00ac40 tx=0x7efcfc01e050 comp rx=0 tx=0).stop 2024-09-16T07:29:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0a200640 1 -- 172.21.15.114:0/3953135321 reap_dead start 2024-09-16T07:29:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- 172.21.15.114:0/3953135321 shutdown_connections 2024-09-16T07:29:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- 172.21.15.114:0/3953135321 >> 172.21.15.114:0/3953135321 conn(0x7efd040b18f0 msgr2=0x7efd040b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- 172.21.15.114:0/3953135321 shutdown_connections 2024-09-16T07:29:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- 172.21.15.114:0/3953135321 wait complete. 2024-09-16T07:29:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 Processor -- start 2024-09-16T07:29:14.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- start start 2024-09-16T07:29:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcec004d50 0x7efd04155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd041563c0 0x7efd0409c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0414a560 0x7efd041e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efd040acd40 con 0x7efd0414a560 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd0406fb00 con 0x7efcec004d50 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd040acec0 con 0x7efd041563c0 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0414a560 0x7efd041e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0414a560 0x7efd041e7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43404/0 (socket says 172.21.15.114:43404) 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd0a200640 1 -- 172.21.15.114:0/3946016750 learned_addr learned my addr 172.21.15.114:0/3946016750 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd09800640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcec004d50 0x7efd04155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.988+0000 7efd08e00640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd041563c0 0x7efd0409c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0a200640 1 -- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd041563c0 msgr2=0x7efd0409c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0a200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd041563c0 0x7efd0409c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0a200640 1 -- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcec004d50 msgr2=0x7efd04155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0a200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcec004d50 0x7efd04155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0a200640 1 -- 172.21.15.114:0/3946016750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd040b1670 con 0x7efd0414a560 2024-09-16T07:29:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0a200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0414a560 0x7efd041e7180 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00ac40 tx=0x7efcfc0ae9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd01600640 1 -- 172.21.15.114:0/3946016750 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0b2050 con 0x7efd0414a560 2024-09-16T07:29:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd01600640 1 -- 172.21.15.114:0/3946016750 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcfc0b3040 con 0x7efd0414a560 2024-09-16T07:29:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd01600640 1 -- 172.21.15.114:0/3946016750 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0aec70 con 0x7efd0414a560 2024-09-16T07:29:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd040b1390 con 0x7efd0414a560 2024-09-16T07:29:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0409ad90 con 0x7efd0414a560 2024-09-16T07:29:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd04069410 con 0x7efd0414a560 2024-09-16T07:29:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd01600640 1 -- 172.21.15.114:0/3946016750 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7efcfc0c0020 con 0x7efd0414a560 2024-09-16T07:29:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd01600640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efce4072ec0 0x7efce4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.992+0000 7efd01600640 1 -- 172.21.15.114:0/3946016750 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7efcfc12e860 con 0x7efd0414a560 2024-09-16T07:29:14.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.996+0000 7efd09800640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efce4072ec0 0x7efce4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:14.996+0000 7efd09800640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efce4072ec0 0x7efce4075380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd0415ace0 tx=0x7efcf8006ea0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.000+0000 7efd01600640 1 -- 172.21.15.114:0/3946016750 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efcfc0c7020 con 0x7efd0414a560 2024-09-16T07:29:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.224+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efd040698f0 con 0x7efd0414a560 2024-09-16T07:29:15.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd01600640 1 -- 172.21.15.114:0/3946016750 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7efcfc12e0e0 con 0x7efd0414a560 2024-09-16T07:29:15.231 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:29:15.231 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:29:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:29:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:29:15.232 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:29:15.232 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efce4072ec0 msgr2=0x7efce4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efce4072ec0 0x7efce4075380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efd0415ace0 tx=0x7efcf8006ea0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0414a560 msgr2=0x7efd041e7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0414a560 0x7efd041e7180 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00ac40 tx=0x7efcfc0ae9f0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 shutdown_connections 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efce4072ec0 0x7efce4075380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0414a560 0x7efd041e7180 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd041563c0 0x7efd0409c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 --2- 172.21.15.114:0/3946016750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcec004d50 0x7efd04155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 >> 172.21.15.114:0/3946016750 conn(0x7efd040b18f0 msgr2=0x7efd040aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 shutdown_connections 2024-09-16T07:29:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.228+0000 7efd0c200640 1 -- 172.21.15.114:0/3946016750 wait complete. 2024-09-16T07:29:15.253 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- 172.21.15.114:0/384876513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d415b580 msgr2=0x7f94d415b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 --2- 172.21.15.114:0/384876513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d415b580 0x7f94d415b960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009bc0 tx=0x7f94c401cba0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- 172.21.15.114:0/384876513 shutdown_connections 2024-09-16T07:29:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 --2- 172.21.15.114:0/384876513 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d415b580 0x7f94d415b960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- 172.21.15.114:0/384876513 >> 172.21.15.114:0/384876513 conn(0x7f94d40b18f0 msgr2=0x7f94d40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- 172.21.15.114:0/384876513 shutdown_connections 2024-09-16T07:29:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- 172.21.15.114:0/384876513 wait complete. 2024-09-16T07:29:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 Processor -- start 2024-09-16T07:29:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- start start 2024-09-16T07:29:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d40b3300 0x7f94d40746e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94d40b4bd0 0x7f94d414b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94d415b580 0x7f94d40aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4169360 con 0x7f94d40b3300 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41691e0 con 0x7f94d40b4bd0 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94da800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94d41694e0 con 0x7f94d415b580 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d40b3300 0x7f94d40746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d40b3300 0x7f94d40746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43416/0 (socket says 172.21.15.114:43416) 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94d3400640 1 -- 172.21.15.114:0/1836228607 learned_addr learned my addr 172.21.15.114:0/1836228607 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94caa00640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94d40b4bd0 0x7f94d414b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.392+0000 7f94d3e00640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94d415b580 0x7f94d40aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94d3400640 1 -- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94d415b580 msgr2=0x7f94d40aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94d3400640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94d415b580 0x7f94d40aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94d3400640 1 -- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94d40b4bd0 msgr2=0x7f94d414b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94d3400640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94d40b4bd0 0x7f94d414b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94d3400640 1 -- 172.21.15.114:0/1836228607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d414be10 con 0x7f94d40b3300 2024-09-16T07:29:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94d3400640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d40b3300 0x7f94d40746e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009b10 tx=0x7f94c40092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94cbe00640 1 -- 172.21.15.114:0/1836228607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c40bb070 con 0x7f94d40b3300 2024-09-16T07:29:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94cbe00640 1 -- 172.21.15.114:0/1836228607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94c4004d40 con 0x7f94d40b3300 2024-09-16T07:29:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d414c0f0 con 0x7f94d40b3300 2024-09-16T07:29:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94cbe00640 1 -- 172.21.15.114:0/1836228607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c40b2040 con 0x7f94d40b3300 2024-09-16T07:29:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d4073b10 con 0x7f94d40b3300 2024-09-16T07:29:15.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d415b960 con 0x7f94d40b3300 2024-09-16T07:29:15.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94cbe00640 1 -- 172.21.15.114:0/1836228607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f94c40be070 con 0x7f94d40b3300 2024-09-16T07:29:15.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94cbe00640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94b0072ec0 0x7f94b0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:15.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.396+0000 7f94cbe00640 1 -- 172.21.15.114:0/1836228607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f94c412d940 con 0x7f94d40b3300 2024-09-16T07:29:15.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.400+0000 7f94caa00640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94b0072ec0 0x7f94b0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.400+0000 7f94caa00640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94b0072ec0 0x7f94b0075380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94d4166930 tx=0x7f94bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.400+0000 7f94cbe00640 1 -- 172.21.15.114:0/1836228607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f94c40a5e20 con 0x7f94d40b3300 2024-09-16T07:29:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.604+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94d415d9d0 con 0x7f94d40b3300 2024-09-16T07:29:15.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.604+0000 7f94cbe00640 1 -- 172.21.15.114:0/1836228607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7f94c4016790 con 0x7f94d40b3300 2024-09-16T07:29:15.609 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:15.609 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"btime":"2024-09-16T07:29:08:699247+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3907348015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3907348015},{"type":"v1","addr":"172.21.15.114:6834","nonce":3907348015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2595700778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2595700778},{"type":"v1","addr":"172.21.15.149:6836","nonce":2595700778}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/986042946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":986042946},{"type":"v1","addr":"172.21.15.149:6837","nonce":986042946}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:05.062058+0000","modified":"2024-09-16T07:29:08.089127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4837":{"gid":4837,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/319033864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":319033864},{"type":"v1","addr":"172.21.15.114:6835","nonce":319033864}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4837,"qdb_cluster":[4837]},"id":2}]} 2024-09-16T07:29:15.609 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-09-16T07:29:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94b0072ec0 msgr2=0x7f94b0075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94b0072ec0 0x7f94b0075380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94d4166930 tx=0x7f94bc009040 comp rx=0 tx=0).stop 2024-09-16T07:29:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d40b3300 msgr2=0x7f94d40746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d40b3300 0x7f94d40746e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009b10 tx=0x7f94c40092a0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 shutdown_connections 2024-09-16T07:29:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94b0072ec0 0x7f94b0075380 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94d415b580 0x7f94d40aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94d40b4bd0 0x7f94d414b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 --2- 172.21.15.114:0/1836228607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94d40b3300 0x7f94d40746e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 >> 172.21.15.114:0/1836228607 conn(0x7f94d40b18f0 msgr2=0x7f94d40cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 shutdown_connections 2024-09-16T07:29:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:15.608+0000 7f94da800640 1 -- 172.21.15.114:0/1836228607 wait complete. 2024-09-16T07:29:16.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:29:05.062058+0000', 'modified': '2024-09-16T07:29:08.089127+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4837}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4837': {'gid': 4837, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/319033864', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 319033864}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 319033864}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4837, 'qdb_cluster': [4837]} 2024-09-16T07:29:16.034 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:29:16.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T07:29:16.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.176+0000 7fc9f9400640 1 -- 172.21.15.114:0/544119838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d8005220 msgr2=0x7fc9d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.176+0000 7fc9f9400640 1 --2- 172.21.15.114:0/544119838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d8005220 0x7fc9d800b9d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4072530 tx=0x7fc9ec01cbc0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.176+0000 7fc9f9400640 1 -- 172.21.15.114:0/544119838 shutdown_connections 2024-09-16T07:29:16.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.176+0000 7fc9f9400640 1 --2- 172.21.15.114:0/544119838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d8005220 0x7fc9d800b9d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.176+0000 7fc9f9400640 1 -- 172.21.15.114:0/544119838 >> 172.21.15.114:0/544119838 conn(0x7fc9f40b18f0 msgr2=0x7fc9f40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.176+0000 7fc9f9400640 1 -- 172.21.15.114:0/544119838 shutdown_connections 2024-09-16T07:29:16.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.176+0000 7fc9f9400640 1 -- 172.21.15.114:0/544119838 wait complete. 2024-09-16T07:29:16.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 Processor -- start 2024-09-16T07:29:16.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 -- start start 2024-09-16T07:29:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d8005220 0x7fc9f4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9f40aebc0 0x7fc9f40cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f415ccd0 0x7fc9f415d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f40b4930 con 0x7fc9f415ccd0 2024-09-16T07:29:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f40b47b0 con 0x7fc9d8005220 2024-09-16T07:29:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f40b4ab0 con 0x7fc9f40aebc0 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f415ccd0 0x7fc9f415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f415ccd0 0x7fc9f415d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43430/0 (socket says 172.21.15.114:43430) 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 -- 172.21.15.114:0/4232834906 learned_addr learned my addr 172.21.15.114:0/4232834906 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f2800640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d8005220 0x7fc9f4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9f40aebc0 0x7fc9f40cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 -- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9f40aebc0 msgr2=0x7fc9f40cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9f40aebc0 0x7fc9f40cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 -- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d8005220 msgr2=0x7fc9f4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d8005220 0x7fc9f4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 -- 172.21.15.114:0/4232834906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f41f8c80 con 0x7fc9f415ccd0 2024-09-16T07:29:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f3200640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f415ccd0 0x7fc9f415d180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec01d460 tx=0x7fc9ec004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9eaa00640 1 -- 172.21.15.114:0/4232834906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec001ba0 con 0x7fc9f415ccd0 2024-09-16T07:29:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9eaa00640 1 -- 172.21.15.114:0/4232834906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9ec0b9070 con 0x7fc9f415ccd0 2024-09-16T07:29:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f41f8100 con 0x7fc9f415ccd0 2024-09-16T07:29:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9eaa00640 1 -- 172.21.15.114:0/4232834906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec006c50 con 0x7fc9f415ccd0 2024-09-16T07:29:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.180+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f41f86c0 con 0x7fc9f415ccd0 2024-09-16T07:29:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9eaa00640 1 -- 172.21.15.114:0/4232834906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fc9ec006470 con 0x7fc9f415ccd0 2024-09-16T07:29:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9eaa00640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc9d4072ec0 0x7fc9d4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9eaa00640 1 -- 172.21.15.114:0/4232834906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc9ec12e500 con 0x7fc9f415ccd0 2024-09-16T07:29:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 Processor -- start 2024-09-16T07:29:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f2800640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc9d4072ec0 0x7fc9d4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 -- start start 2024-09-16T07:29:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f2800640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc9d4072ec0 0x7fc9d4075380 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4001cc0 tx=0x7fc9e40011d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be87ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be87ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560be86cd3f0 con 0x560be87f92f0 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x560be860ab20 con 0x560be87ace10 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x560be85f9f50 con 0x560be87f89d0 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be87ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be87ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43432/0 (socket says 172.21.15.114:43432) 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 -- 172.21.15.114:0/2858556473 learned_addr learned my addr 172.21.15.114:0/2858556473 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f2800640 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f3200640 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be87ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 -- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 msgr2=0x560be87f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 -- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 msgr2=0x560be87ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be87ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.184+0000 7fc9f1e00640 1 -- 172.21.15.114:0/2858556473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be85c1590 con 0x560be87f92f0 2024-09-16T07:29:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be87ac8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000ac20 tx=0x7fc9e000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b443d024cf34e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9df400640 1 -- 172.21.15.114:0/2858556473 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0004020 con 0x560be87f92f0 2024-09-16T07:29:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9df400640 1 -- 172.21.15.114:0/2858556473 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9e00041c0 con 0x560be87f92f0 2024-09-16T07:29:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9df400640 1 -- 172.21.15.114:0/2858556473 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0005020 con 0x560be87f92f0 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/2858556473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 msgr2=0x560be87ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be87ac8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000ac20 tx=0x7fc9e000e820 comp rx=0 tx=0).stop 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/2858556473 shutdown_connections 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be87ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be87ac8d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/2858556473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/2858556473 >> 172.21.15.114:0/2858556473 conn(0x560be8696130 msgr2=0x560be87dbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/2858556473 shutdown_connections 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/2858556473 wait complete. 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- start start 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 Processor -- start 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87ace10 0x560be87ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87ae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f92f0 0x560be87aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560be85945d0 con 0x560be87ace10 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x560be85fdd60 con 0x560be87f92f0 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x560be85a0500 con 0x560be87f89d0 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9fc8e9000 10 client.0 _ll_register_callbacks cb 0x560be85a4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87ace10 0x560be87ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87ace10 0x560be87ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43442/0 (socket says 172.21.15.114:43442) 2024-09-16T07:29:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 -- 172.21.15.114:0/1512209988 learned_addr learned my addr 172.21.15.114:0/1512209988 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f3200640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f92f0 0x560be87aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 -- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 msgr2=0x560be87ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 -- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f92f0 msgr2=0x560be87aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f92f0 0x560be87aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f2800640 1 -- 172.21.15.114:0/1512209988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be8598170 con 0x560be87ace10 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.188+0000 7fc9f3200640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f92f0 0x560be87aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9f2800640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87ace10 0x560be87ae240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4012480 tx=0x7fc9e4006730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6728ad03a284ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:29:16.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 1 -- 172.21.15.114:0/1512209988 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4020640 con 0x560be87ace10 2024-09-16T07:29:16.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560be85920f0 con 0x560be87ace10 2024-09-16T07:29:16.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 1 -- 172.21.15.114:0/1512209988 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc9e4019070 con 0x560be87ace10 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 1 -- 172.21.15.114:0/1512209988 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc9e40207e0 con 0x560be87ace10 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 10 client.5082 fetch_fsmap learned FSMap version 17 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560be867eef0 con 0x560be87ace10 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 1 -- 172.21.15.114:0/1512209988 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560be85920f0 con 0x560be87ace10 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 1 -- 172.21.15.114:0/1512209988 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7fc9e4035070 con 0x560be87ace10 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 10 client.5082 fetch_fsmap finished waiting for FSMap version 17 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 10 client.5082 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 20 client.5082 populate_metadata read hostname 'smithi114' 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be8807c70 0x560be880a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 4 client.5082 mds_command: new command op to 4837 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 --> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560be860ca70 con 0x560be8807c70 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be8807c70 0x560be880a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 10 client.5082 ms_handle_connect on v2:172.21.15.114:6833/319033864 2024-09-16T07:29:16.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be8807c70 0x560be880a060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=482acf92449906d3 server_cookie=f383af5e46d1d8bd in_seq=0 out_seq=0 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 1 -- 172.21.15.114:0/1512209988 <== mds.0 v2:172.21.15.114:6833/319033864 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560be860ca70 con 0x560be8807c70 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 10 client.5082 handle_command_reply: tid=0 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 client.5082 shutdown 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87ace10 msgr2=0x560be87ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87ace10 0x560be87ae240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4012480 tx=0x7fc9e4006730 comp rx=0 tx=0).stop 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 shutdown_connections 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be8807c70 0x560be880a060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f92f0 0x560be87aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be87ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9d3e00640 0 client.5082 ms_handle_reset on v2:172.21.15.114:6833/319033864 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/1512209988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87ace10 0x560be87ae240 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 >> 172.21.15.114:0/1512209988 conn(0x560be8696130 msgr2=0x560be87abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 shutdown_connections 2024-09-16T07:29:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/1512209988 wait complete. 2024-09-16T07:29:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.192+0000 7fc9fc8e9000 20 client.5082 trim_cache size 0 max 16384 2024-09-16T07:29:16.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 Processor -- start 2024-09-16T07:29:16.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 -- start start 2024-09-16T07:29:16.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87ace10 0x560be886a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f89d0 0x560be886a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be886ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f42014e0 con 0x560be87f92f0 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4200530 con 0x560be87f89d0 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f40c9f70 con 0x560be87ace10 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be886ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be886ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43444/0 (socket says 172.21.15.114:43444) 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 -- 172.21.15.114:0/4075126797 learned_addr learned my addr 172.21.15.114:0/4075126797 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f2800640 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87ace10 0x560be886a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f89d0 0x560be886a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 -- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87ace10 msgr2=0x560be886a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87ace10 0x560be886a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 -- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f89d0 msgr2=0x560be886a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f89d0 0x560be886a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 -- 172.21.15.114:0/4075126797 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560be8655d90 con 0x560be87f92f0 2024-09-16T07:29:16.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9f3200640 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be886ac30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0f8f50 tx=0x7fc9ec000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336fd88a9a242f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9dea00640 1 -- 172.21.15.114:0/4075126797 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0f8730 con 0x560be87f92f0 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9dea00640 1 -- 172.21.15.114:0/4075126797 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9ec0f96c0 con 0x560be87f92f0 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.212+0000 7fc9dea00640 1 -- 172.21.15.114:0/4075126797 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0f8fc0 con 0x560be87f92f0 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/4075126797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 msgr2=0x560be886ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be886ac30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0f8f50 tx=0x7fc9ec000f50 comp rx=0 tx=0).stop 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/4075126797 shutdown_connections 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be886ac30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87f89d0 0x560be886a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/4075126797 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87ace10 0x560be886a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/4075126797 >> 172.21.15.114:0/4075126797 conn(0x560be8696130 msgr2=0x560be87ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/4075126797 shutdown_connections 2024-09-16T07:29:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/4075126797 wait complete. 2024-09-16T07:29:16.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- start start 2024-09-16T07:29:16.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 Processor -- start 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be880f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be882a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be882aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560be85c5ec0 con 0x560be87f92f0 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f40ca5c0 con 0x560be87ace10 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x560be86098f0 con 0x560be87f89d0 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 10 client.0 _ll_register_callbacks cb 0x7fc9e4004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be882aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be882aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43460/0 (socket says 172.21.15.114:43460) 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 -- 172.21.15.114:0/260146648 learned_addr learned my addr 172.21.15.114:0/260146648 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f2800640 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be880f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f1e00640 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be882a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 -- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 msgr2=0x560be882a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be882a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 -- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 msgr2=0x560be880f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be880f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 -- 172.21.15.114:0/260146648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560be85c0a90 con 0x560be87f92f0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9f3200640 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be882aac0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec01d0a0 tx=0x7fc9ec0f87b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce50307d2c015f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9d3e00640 1 -- 172.21.15.114:0/260146648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0fdaa0 con 0x560be87f92f0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9d3e00640 1 -- 172.21.15.114:0/260146648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc9ec006760 con 0x560be87f92f0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9ec0f96c0 con 0x560be87f92f0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9d3e00640 1 -- 172.21.15.114:0/260146648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc9ec102950 con 0x560be87f92f0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 10 client.5088 fetch_fsmap learned FSMap version 17 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560be859f050 con 0x560be87f92f0 2024-09-16T07:29:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9d3e00640 1 -- 172.21.15.114:0/260146648 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9ec0f96c0 con 0x560be87f92f0 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9d3e00640 1 -- 172.21.15.114:0/260146648 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7fc9ec0fb040 con 0x560be87f92f0 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 10 client.5088 fetch_fsmap finished waiting for FSMap version 17 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 10 client.5088 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 20 client.5088 populate_metadata read hostname 'smithi114' 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.216+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be882b000 0x560be886dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 4 client.5088 mds_command: new command op to 4837 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 --> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] -- command(tid 0: {"prefix": "status"}) -- 0x560be8608520 con 0x560be882b000 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f2800640 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be882b000 0x560be886dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f2800640 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be882b000 0x560be886dfe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91e3807996b6774 server_cookie=7cf30e677ea2e8d4 in_seq=0 out_seq=0 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9d3e00640 10 client.5088 ms_handle_connect on v2:172.21.15.114:6833/319033864 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9d3e00640 1 -- 172.21.15.114:0/260146648 <== mds.0 v2:172.21.15.114:6833/319033864 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560be8608520 con 0x560be882b000 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9d3e00640 10 client.5088 handle_command_reply: tid=0 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 client.5088 shutdown 2024-09-16T07:29:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 msgr2=0x560be882aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be882aac0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec01d0a0 tx=0x7fc9ec0f87b0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 shutdown_connections 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:6833/319033864,v1:172.21.15.114:6835/319033864] conn(0x560be882b000 0x560be886dfe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560be87f92f0 0x560be882aac0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560be87f89d0 0x560be882a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 --2- 172.21.15.114:0/260146648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560be87ace10 0x560be880f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9d3e00640 0 client.5088 ms_handle_reset on v2:172.21.15.114:6833/319033864 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 >> 172.21.15.114:0/260146648 conn(0x560be8696130 msgr2=0x560be880a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 shutdown_connections 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 1 -- 172.21.15.114:0/260146648 wait complete. 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9fc8e9000 20 client.5088 trim_cache size 0 max 16384 2024-09-16T07:29:16.227 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4837, 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.557535033000001, 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 17, 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 33, 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 33, 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 17.408089743000001 2024-09-16T07:29:16.228 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:29:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc9d4072ec0 msgr2=0x7fc9d4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc9d4072ec0 0x7fc9d4075380 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4001cc0 tx=0x7fc9e40011d0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f415ccd0 msgr2=0x7fc9f415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f415ccd0 0x7fc9f415d180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec01d460 tx=0x7fc9ec004f70 comp rx=0 tx=0).stop 2024-09-16T07:29:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 shutdown_connections 2024-09-16T07:29:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc9d4072ec0 0x7fc9d4075380 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9f415ccd0 0x7fc9f415d180 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9f40aebc0 0x7fc9f40cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 --2- 172.21.15.114:0/4232834906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9d8005220 0x7fc9f4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 >> 172.21.15.114:0/4232834906 conn(0x7fc9f40b18f0 msgr2=0x7fc9f41598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 shutdown_connections 2024-09-16T07:29:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.220+0000 7fc9f9400640 1 -- 172.21.15.114:0/4232834906 wait complete. 2024-09-16T07:29:16.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:29:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.380+0000 7f7e91800640 1 -- 172.21.15.114:0/3700650477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 msgr2=0x7f7e70004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.380+0000 7f7e91800640 1 --2- 172.21.15.114:0/3700650477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e70004c90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7e78006fa0 tx=0x7f7e7801f630 comp rx=0 tx=0).stop 2024-09-16T07:29:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.380+0000 7f7e91800640 1 -- 172.21.15.114:0/3700650477 shutdown_connections 2024-09-16T07:29:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.380+0000 7f7e91800640 1 --2- 172.21.15.114:0/3700650477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e70004c90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.380+0000 7f7e91800640 1 -- 172.21.15.114:0/3700650477 >> 172.21.15.114:0/3700650477 conn(0x7f7e8c06dd30 msgr2=0x7f7e8c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.380+0000 7f7e91800640 1 -- 172.21.15.114:0/3700650477 shutdown_connections 2024-09-16T07:29:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.380+0000 7f7e91800640 1 -- 172.21.15.114:0/3700650477 wait complete. 2024-09-16T07:29:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 Processor -- start 2024-09-16T07:29:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 -- start start 2024-09-16T07:29:16.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e8c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8c15ecc0 0x7f7e8c1f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c15f140 0x7f7e8c14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0cc550 con 0x7f7e70004810 2024-09-16T07:29:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c0ce270 con 0x7f7e8c15f140 2024-09-16T07:29:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c0cc6d0 con 0x7f7e8c15ecc0 2024-09-16T07:29:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e8c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e8c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43466/0 (socket says 172.21.15.114:43466) 2024-09-16T07:29:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 -- 172.21.15.114:0/3635968686 learned_addr learned my addr 172.21.15.114:0/3635968686 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8b400640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8c15ecc0 0x7f7e8c1f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e90e00640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c15f140 0x7f7e8c14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 -- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8c15ecc0 msgr2=0x7f7e8c1f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8c15ecc0 0x7f7e8c1f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 -- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c15f140 msgr2=0x7f7e8c14e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c15f140 0x7f7e8c14e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 -- 172.21.15.114:0/3635968686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c15df00 con 0x7f7e70004810 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8b400640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8c15ecc0 0x7f7e8c1f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e90e00640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c15f140 0x7f7e8c14e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e8be00640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e8c15c080 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0069a0 tx=0x7f7e7c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e83e00640 1 -- 172.21.15.114:0/3635968686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0107d0 con 0x7f7e70004810 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e83e00640 1 -- 172.21.15.114:0/3635968686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7c016070 con 0x7f7e70004810 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e83e00640 1 -- 172.21.15.114:0/3635968686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c010ce0 con 0x7f7e70004810 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c15e1e0 con 0x7f7e70004810 2024-09-16T07:29:16.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c15e7a0 con 0x7f7e70004810 2024-09-16T07:29:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.384+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c06cc20 con 0x7f7e70004810 2024-09-16T07:29:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.388+0000 7f7e83e00640 1 -- 172.21.15.114:0/3635968686 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f7e7c01b460 con 0x7f7e70004810 2024-09-16T07:29:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.388+0000 7f7e83e00640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e6c072ec0 0x7f7e6c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.388+0000 7f7e83e00640 1 -- 172.21.15.114:0/3635968686 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7e7c094590 con 0x7f7e70004810 2024-09-16T07:29:16.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.388+0000 7f7e8b400640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e6c072ec0 0x7f7e6c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:16.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.388+0000 7f7e8b400640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e6c072ec0 0x7f7e6c075380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e780af000 tx=0x7f7e78006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:16.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.392+0000 7f7e83e00640 1 -- 172.21.15.114:0/3635968686 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7e7c05f7e0 con 0x7f7e70004810 2024-09-16T07:29:16.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.596+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7e8c0cbce0 con 0x7f7e70004810 2024-09-16T07:29:16.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.596+0000 7f7e83e00640 1 -- 172.21.15.114:0/3635968686 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f7e7c05f0e0 con 0x7f7e70004810 2024-09-16T07:29:16.601 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:29:16.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e6c072ec0 msgr2=0x7f7e6c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e6c072ec0 0x7f7e6c075380 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e780af000 tx=0x7f7e78006040 comp rx=0 tx=0).stop 2024-09-16T07:29:16.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 msgr2=0x7f7e8c15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:16.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e8c15c080 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0069a0 tx=0x7f7e7c001640 comp rx=0 tx=0).stop 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 shutdown_connections 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e6c072ec0 0x7f7e6c075380 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c15f140 0x7f7e8c14e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8c15ecc0 0x7f7e8c1f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 --2- 172.21.15.114:0/3635968686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e70004810 0x7f7e8c15c080 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 >> 172.21.15.114:0/3635968686 conn(0x7f7e8c06dd30 msgr2=0x7f7e8c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 shutdown_connections 2024-09-16T07:29:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16.600+0000 7f7e91800640 1 -- 172.21.15.114:0/3635968686 wait complete. 2024-09-16T07:29:16.622 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:29:16.623 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:29:16.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:16.623 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:29:16.632 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:16.633 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42384sec preferred_lft 42384sec 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.634 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:16.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:16.635 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:29:16.691 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:29:16.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:16.693 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:29:16.745 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:16.746 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:29:16.747 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:29:16.747 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:29:16.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:29:16.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:29:16.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:29:16.747 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:29:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:29:16.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:16.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:16.880 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:29:16.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:29:16.889 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:29:16.890 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:29:16.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:16.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:29:16.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:16.950 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:16.998 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:29:16.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:16.998 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:17.049 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:29:17.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:17.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:17.138 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:17.139 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:29:17.139 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:29:17.154 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:17.154 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:29:17.154 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:29:17.154 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:17.154 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:29:17.163 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:29:17.166 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:29:17.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:17.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:17.186 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:29:17.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:29:17.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:17.297 INFO:teuthology.orchestra.run.smithi114.stdout:client4999 2024-09-16T07:29:17.297 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:17.297 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:17.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- 172.21.15.114:0/2261358615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 msgr2=0x7f5fc40cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2261358615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc40cd950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009c80 tx=0x7f5fbc01cc80 comp rx=0 tx=0).stop 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- 172.21.15.114:0/2261358615 shutdown_connections 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2261358615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc40cd950 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2261358615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc415bd50 0x7f5fc40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- 172.21.15.114:0/2261358615 >> 172.21.15.114:0/2261358615 conn(0x7f5fc40d1ea0 msgr2=0x7f5fc40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- 172.21.15.114:0/2261358615 shutdown_connections 2024-09-16T07:29:17.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- 172.21.15.114:0/2261358615 wait complete. 2024-09-16T07:29:17.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 Processor -- start 2024-09-16T07:29:17.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- start start 2024-09-16T07:29:17.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:17.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc415bd50 0x7f5fc4156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:17.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc415c130 0x7f5fc41398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:17.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4168f00 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4168d80 con 0x7f5fc415bd50 2024-09-16T07:29:17.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.488+0000 7f5fc9400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc4169080 con 0x7f5fc415c130 2024-09-16T07:29:17.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:17.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc414b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43474/0 (socket says 172.21.15.114:43474) 2024-09-16T07:29:17.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 -- 172.21.15.114:0/2903305915 learned_addr learned my addr 172.21.15.114:0/2903305915 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:17.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 -- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc415c130 msgr2=0x7f5fc41398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc415c130 0x7f5fc41398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 -- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc415bd50 msgr2=0x7f5fc4156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc415bd50 0x7f5fc4156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 -- 172.21.15.114:0/2903305915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc4156b50 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc2800640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc414b140 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400e9f0 tx=0x7f5fb400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fbb400640 1 -- 172.21.15.114:0/2903305915 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400cd80 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fbb400640 1 -- 172.21.15.114:0/2903305915 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fb4010430 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc40b4d70 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fbb400640 1 -- 172.21.15.114:0/2903305915 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4010860 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc40b5330 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc40ce5e0 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fbb400640 1 -- 172.21.15.114:0/2903305915 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5fb4010a00 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.492+0000 7f5fbb400640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5fa0072ef0 0x7f5fa00753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:17.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.496+0000 7f5fbb400640 1 -- 172.21.15.114:0/2903305915 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5fb40949b0 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.496+0000 7f5fb9e00640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5fa0072ef0 0x7f5fa00753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:17.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.496+0000 7f5fb9e00640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5fa0072ef0 0x7f5fa00753b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5fac007fd0 tx=0x7f5fac007960 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:17.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.500+0000 7f5fbb400640 1 -- 172.21.15.114:0/2903305915 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5fb405fbf0 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.539 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:29:17.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:29:17.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.704+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5fc4076360 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fbb400640 1 -- 172.21.15.114:0/2903305915 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f5fb405f4f0 con 0x7f5fc40cf4e0 2024-09-16T07:29:17.711 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:29:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5fa0072ef0 msgr2=0x7f5fa00753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5fa0072ef0 0x7f5fa00753b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5fac007fd0 tx=0x7f5fac007960 comp rx=0 tx=0).stop 2024-09-16T07:29:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 msgr2=0x7f5fc414b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:17.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc414b140 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400e9f0 tx=0x7f5fb400eeb0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 shutdown_connections 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5fa0072ef0 0x7f5fa00753b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5fc415c130 0x7f5fc41398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc415bd50 0x7f5fc4156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 --2- 172.21.15.114:0/2903305915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fc40cf4e0 0x7f5fc414b140 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 >> 172.21.15.114:0/2903305915 conn(0x7f5fc40d1ea0 msgr2=0x7f5fc4151fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 shutdown_connections 2024-09-16T07:29:17.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:17.708+0000 7f5fc9400640 1 -- 172.21.15.114:0/2903305915 wait complete. 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:29:17.732 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:29:17.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:17.733 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:29:17.742 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:29:17.742 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:17.743 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42392sec preferred_lft 42392sec 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:17.744 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:17.745 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:29:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:29:17.746 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:17.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:17.747 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:29:17.806 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:29:17.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:17.809 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:29:17.864 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:29:17.864 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:17.865 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:29:17.865 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:29:17.866 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:29:17.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:29:17.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:29:17.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:29:17.866 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:29:17.960 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:29:18.003 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:18.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:18.010 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:29:18.019 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:29:18.019 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:29:18.019 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:29:18.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:18.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:29:18.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:18.087 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:18.135 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:29:18.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:18.135 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:18.190 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:29:18.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:18.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:18.278 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:18.279 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:29:18.279 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:29:18.294 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:18.294 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:29:18.294 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:29:18.294 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:18.294 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:29:18.303 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:29:18.307 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:29:18.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:18.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:18.326 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:29:18.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:29:18.418 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:18.424 INFO:teuthology.orchestra.run.smithi149.stdout:client4802 2024-09-16T07:29:18.424 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:18.425 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:18.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:29:18.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 -- 172.21.15.114:0/286227235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae8815a9d0 msgr2=0x7fae880ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:18.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 --2- 172.21.15.114:0/286227235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae8815a9d0 0x7fae880ce350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fae88072800 tx=0x7fae7401dbf0 comp rx=0 tx=0).stop 2024-09-16T07:29:18.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 -- 172.21.15.114:0/286227235 shutdown_connections 2024-09-16T07:29:18.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 --2- 172.21.15.114:0/286227235 >> v2:172.21.15.149:3300/0 conn(0x7fae880ce890 0x7fae8806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:18.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 --2- 172.21.15.114:0/286227235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae8815a9d0 0x7fae880ce350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:18.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 -- 172.21.15.114:0/286227235 >> 172.21.15.114:0/286227235 conn(0x7fae880cfbc0 msgr2=0x7fae880cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:18.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 -- 172.21.15.114:0/286227235 shutdown_connections 2024-09-16T07:29:18.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 -- 172.21.15.114:0/286227235 wait complete. 2024-09-16T07:29:18.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 Processor -- start 2024-09-16T07:29:18.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.576+0000 7fae8fe00640 1 -- start start 2024-09-16T07:29:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae880734f0 0x7fae88151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae880ce890 0x7fae88146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8815a9d0 0x7fae8809d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fae8806fac0 con 0x7fae880ce890 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fae8806f940 con 0x7fae8815a9d0 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fae8806fc40 con 0x7fae880734f0 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae880ce890 0x7fae88146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae880ce890 0x7fae88146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43488/0 (socket says 172.21.15.114:43488) 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 -- 172.21.15.114:0/3365354421 learned_addr learned my addr 172.21.15.114:0/3365354421 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8de00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8815a9d0 0x7fae8809d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8d400640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae880734f0 0x7fae88151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 -- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae880734f0 msgr2=0x7fae88151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae880734f0 0x7fae88151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 -- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8815a9d0 msgr2=0x7fae8809d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8815a9d0 0x7fae8809d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 -- 172.21.15.114:0/3365354421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8809b670 con 0x7fae880ce890 2024-09-16T07:29:18.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8ca00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae880ce890 0x7fae88146030 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae740b1040 tx=0x7fae74005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:18.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae85600640 1 -- 172.21.15.114:0/3365354421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae740b3070 con 0x7fae880ce890 2024-09-16T07:29:18.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae85600640 1 -- 172.21.15.114:0/3365354421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae74005530 con 0x7fae880ce890 2024-09-16T07:29:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8809b950 con 0x7fae880ce890 2024-09-16T07:29:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae85600640 1 -- 172.21.15.114:0/3365354421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae74004930 con 0x7fae880ce890 2024-09-16T07:29:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8809dc60 con 0x7fae880ce890 2024-09-16T07:29:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae88069410 con 0x7fae880ce890 2024-09-16T07:29:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.580+0000 7fae85600640 1 -- 172.21.15.114:0/3365354421 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fae740be060 con 0x7fae880ce890 2024-09-16T07:29:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.584+0000 7fae85600640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fae68072ec0 0x7fae68075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.584+0000 7fae85600640 1 -- 172.21.15.114:0/3365354421 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fae7412ddc0 con 0x7fae880ce890 2024-09-16T07:29:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.584+0000 7fae8d400640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fae68072ec0 0x7fae68075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.584+0000 7fae8d400640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fae68072ec0 0x7fae68075380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae7c000f70 tx=0x7fae7c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:18.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.588+0000 7fae85600640 1 -- 172.21.15.114:0/3365354421 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fae740177e0 con 0x7fae880ce890 2024-09-16T07:29:18.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:18.788+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fae880d0850 con 0x7fae880ce890 2024-09-16T07:29:19.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.744+0000 7fae85600640 1 -- 172.21.15.114:0/3365354421 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7fae740f89c0 con 0x7fae880ce890 2024-09-16T07:29:19.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fae68072ec0 msgr2=0x7fae68075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:19.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fae68072ec0 0x7fae68075380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae7c000f70 tx=0x7fae7c009040 comp rx=0 tx=0).stop 2024-09-16T07:29:19.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae880ce890 msgr2=0x7fae88146030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:19.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae880ce890 0x7fae88146030 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae740b1040 tx=0x7fae74005de0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 shutdown_connections 2024-09-16T07:29:19.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fae68072ec0 0x7fae68075380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae8815a9d0 0x7fae8809d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae880ce890 0x7fae88146030 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 --2- 172.21.15.114:0/3365354421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae880734f0 0x7fae88151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 >> 172.21.15.114:0/3365354421 conn(0x7fae880cfbc0 msgr2=0x7fae8815bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:19.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 shutdown_connections 2024-09-16T07:29:19.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.748+0000 7fae8fe00640 1 -- 172.21.15.114:0/3365354421 wait complete. 2024-09-16T07:29:19.775 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:29:19.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 -- 172.21.15.114:0/3121019961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 msgr2=0x7f4de0161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:19.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 --2- 172.21.15.114:0/3121019961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 0x7f4de0161de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009840 tx=0x7f4dcc01c820 comp rx=0 tx=0).stop 2024-09-16T07:29:19.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 -- 172.21.15.114:0/3121019961 shutdown_connections 2024-09-16T07:29:19.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 --2- 172.21.15.114:0/3121019961 >> v2:172.21.15.149:3300/0 conn(0x7f4de0157a00 0x7f4de0157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 --2- 172.21.15.114:0/3121019961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 0x7f4de0161de0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 -- 172.21.15.114:0/3121019961 >> 172.21.15.114:0/3121019961 conn(0x7f4de0074310 msgr2=0x7f4de00746f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:19.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 -- 172.21.15.114:0/3121019961 shutdown_connections 2024-09-16T07:29:19.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.916+0000 7f4de7000640 1 -- 172.21.15.114:0/3121019961 wait complete. 2024-09-16T07:29:19.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 Processor -- start 2024-09-16T07:29:19.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 -- start start 2024-09-16T07:29:19.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de0157a00 0x7f4de00989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015e5e0 0x7f4de0154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 0x7f4de00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00adef0 con 0x7f4de0157a00 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00add70 con 0x7f4de015e5e0 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4de00ae070 con 0x7f4de0161950 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de0157a00 0x7f4de00989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de0157a00 0x7f4de00989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43492/0 (socket says 172.21.15.114:43492) 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 -- 172.21.15.114:0/294203712 learned_addr learned my addr 172.21.15.114:0/294203712 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de6600640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 0x7f4de00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5200640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015e5e0 0x7f4de0154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 -- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 msgr2=0x7f4de00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 0x7f4de00b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 -- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015e5e0 msgr2=0x7f4de0154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:19.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015e5e0 0x7f4de0154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:19.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 -- 172.21.15.114:0/294203712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de0098130 con 0x7f4de0157a00 2024-09-16T07:29:19.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5200640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015e5e0 0x7f4de0154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:19.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de5c00640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de0157a00 0x7f4de00989d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c490 tx=0x7f4dd400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:19.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4ddd600640 1 -- 172.21.15.114:0/294203712 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4016020 con 0x7f4de0157a00 2024-09-16T07:29:19.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4ddd600640 1 -- 172.21.15.114:0/294203712 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dd4012940 con 0x7f4de0157a00 2024-09-16T07:29:19.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de0098410 con 0x7f4de0157a00 2024-09-16T07:29:19.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4ddd600640 1 -- 172.21.15.114:0/294203712 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4012d90 con 0x7f4de0157a00 2024-09-16T07:29:19.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.920+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de0155210 con 0x7f4de0157a00 2024-09-16T07:29:19.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.924+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de00ae590 con 0x7f4de0157a00 2024-09-16T07:29:19.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.924+0000 7f4ddd600640 1 -- 172.21.15.114:0/294203712 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f4dd4019020 con 0x7f4de0157a00 2024-09-16T07:29:19.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.924+0000 7f4ddd600640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072ec0 0x7f4dc0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:19.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.924+0000 7f4ddd600640 1 -- 172.21.15.114:0/294203712 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4dd4093eb0 con 0x7f4de0157a00 2024-09-16T07:29:19.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.924+0000 7f4de5200640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072ec0 0x7f4dc0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:19.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.924+0000 7f4de5200640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072ec0 0x7f4dc0075380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0af000 tx=0x7f4dcc01b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:19.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:19.928+0000 7f4ddd600640 1 -- 172.21.15.114:0/294203712 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4dd4020020 con 0x7f4de0157a00 2024-09-16T07:29:20.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.116+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f4de00b1420 con 0x7f4dc0072ec0 2024-09-16T07:29:20.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.120+0000 7f4ddd600640 1 -- 172.21.15.114:0/294203712 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f4de00b1420 con 0x7f4dc0072ec0 2024-09-16T07:29:20.124 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:29:20.124 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:20.124 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:29:20.125 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:20.125 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072ec0 msgr2=0x7f4dc0075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072ec0 0x7f4dc0075380 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0af000 tx=0x7f4dcc01b060 comp rx=0 tx=0).stop 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de0157a00 msgr2=0x7f4de00989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de0157a00 0x7f4de00989d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c490 tx=0x7f4dd400c950 comp rx=0 tx=0).stop 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 shutdown_connections 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072ec0 0x7f4dc0075380 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de0161950 0x7f4de00b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015e5e0 0x7f4de0154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 --2- 172.21.15.114:0/294203712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de0157a00 0x7f4de00989d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 >> 172.21.15.114:0/294203712 conn(0x7f4de0074310 msgr2=0x7f4de00d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:20.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 shutdown_connections 2024-09-16T07:29:20.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.124+0000 7f4de7000640 1 -- 172.21.15.114:0/294203712 wait complete. 2024-09-16T07:29:20.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:29:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- 172.21.15.114:0/3714549571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0b6400 msgr2=0x7f8ebc0ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 --2- 172.21.15.114:0/3714549571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0b6400 0x7f8ebc0ccfc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009bc0 tx=0x7f8eb401cba0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- 172.21.15.114:0/3714549571 shutdown_connections 2024-09-16T07:29:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 --2- 172.21.15.114:0/3714549571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc0b6400 0x7f8ebc0ccfc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- 172.21.15.114:0/3714549571 >> 172.21.15.114:0/3714549571 conn(0x7f8ebc0d1da0 msgr2=0x7f8ebc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- 172.21.15.114:0/3714549571 shutdown_connections 2024-09-16T07:29:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- 172.21.15.114:0/3714549571 wait complete. 2024-09-16T07:29:20.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 Processor -- start 2024-09-16T07:29:20.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- start start 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ebc0b6400 0x7f8ebc153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ebc0cebf0 0x7f8ebc0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc15be80 0x7f8ebc156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc16a310 con 0x7f8ebc15be80 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc16a190 con 0x7f8ebc0b6400 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ec2000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ebc16a490 con 0x7f8ebc0cebf0 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc15be80 0x7f8ebc156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc15be80 0x7f8ebc156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43500/0 (socket says 172.21.15.114:43500) 2024-09-16T07:29:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 -- 172.21.15.114:0/2920652664 learned_addr learned my addr 172.21.15.114:0/2920652664 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebb400640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ebc0b6400 0x7f8ebc153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebaa00640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ebc0cebf0 0x7f8ebc0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 -- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ebc0cebf0 msgr2=0x7f8ebc0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ebc0cebf0 0x7f8ebc0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 -- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ebc0b6400 msgr2=0x7f8ebc153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ebc0b6400 0x7f8ebc153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.288+0000 7f8ebbe00640 1 -- 172.21.15.114:0/2920652664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc0ca810 con 0x7f8ebc15be80 2024-09-16T07:29:20.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8ebbe00640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc15be80 0x7f8ebc156850 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009b10 tx=0x7f8eb4009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8eb3400640 1 -- 172.21.15.114:0/2920652664 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40b2040 con 0x7f8ebc15be80 2024-09-16T07:29:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8eb3400640 1 -- 172.21.15.114:0/2920652664 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8eb4004d40 con 0x7f8ebc15be80 2024-09-16T07:29:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc0caaf0 con 0x7f8ebc15be80 2024-09-16T07:29:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8eb3400640 1 -- 172.21.15.114:0/2920652664 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4004240 con 0x7f8ebc15be80 2024-09-16T07:29:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc0cb0b0 con 0x7f8ebc15be80 2024-09-16T07:29:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ebc0ce4e0 con 0x7f8ebc15be80 2024-09-16T07:29:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8eb3400640 1 -- 172.21.15.114:0/2920652664 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f8eb40be060 con 0x7f8ebc15be80 2024-09-16T07:29:20.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8eb3400640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e9c072ef0 0x7f8e9c0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8eb3400640 1 -- 172.21.15.114:0/2920652664 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8eb412db80 con 0x7f8ebc15be80 2024-09-16T07:29:20.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.292+0000 7f8ebb400640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e9c072ef0 0x7f8e9c0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.296+0000 7f8ebb400640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e9c072ef0 0x7f8e9c0753b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00b810 tx=0x7f8eac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.296+0000 7f8eb3400640 1 -- 172.21.15.114:0/2920652664 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8eb40a5e20 con 0x7f8ebc15be80 2024-09-16T07:29:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8ebc155280 con 0x7f8ebc15be80 2024-09-16T07:29:20.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8eb3400640 1 -- 172.21.15.114:0/2920652664 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f8eb4016790 con 0x7f8ebc15be80 2024-09-16T07:29:20.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e9c072ef0 msgr2=0x7f8e9c0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e9c072ef0 0x7f8e9c0753b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00b810 tx=0x7f8eac008040 comp rx=0 tx=0).stop 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc15be80 msgr2=0x7f8ebc156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc15be80 0x7f8ebc156850 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009b10 tx=0x7f8eb4009300 comp rx=0 tx=0).stop 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 shutdown_connections 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e9c072ef0 0x7f8e9c0753b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ebc15be80 0x7f8ebc156850 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ebc0cebf0 0x7f8ebc0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 --2- 172.21.15.114:0/2920652664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ebc0b6400 0x7f8ebc153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 >> 172.21.15.114:0/2920652664 conn(0x7f8ebc0d1da0 msgr2=0x7f8ebc1546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 shutdown_connections 2024-09-16T07:29:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.464+0000 7f8ec2000640 1 -- 172.21.15.114:0/2920652664 wait complete. 2024-09-16T07:29:20.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:20.555 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp33150/subvol95640) 2024-09-16T07:29:20.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:20.581 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:29:20.631 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:29:20.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:20.632 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp33150/subvol95640) 2024-09-16T07:29:20.717 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:20.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp33150/subvol95640/.meta 2024-09-16T07:29:20.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol95640 subvol_grp33150 2024-09-16T07:29:20.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- 172.21.15.114:0/2184170992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 msgr2=0x7f93240ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 --2- 172.21.15.114:0/2184170992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93240ae490 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f930c009900 tx=0x7f930c01c850 comp rx=0 tx=0).stop 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- 172.21.15.114:0/2184170992 shutdown_connections 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 --2- 172.21.15.114:0/2184170992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93240ae490 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 --2- 172.21.15.114:0/2184170992 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f932415e360 0x7f93240adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- 172.21.15.114:0/2184170992 >> 172.21.15.114:0/2184170992 conn(0x7f93240cfbc0 msgr2=0x7f93240cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- 172.21.15.114:0/2184170992 shutdown_connections 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- 172.21.15.114:0/2184170992 wait complete. 2024-09-16T07:29:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 Processor -- start 2024-09-16T07:29:20.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- start start 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93240ae9d0 0x7f9324158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93241fb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f932415e360 0x7f93240b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f93241680b0 con 0x7f93240aef60 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9324167f30 con 0x7f93240ae9d0 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9329200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9324168230 con 0x7f932415e360 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9319400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93241fb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9319400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93241fb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43518/0 (socket says 172.21.15.114:43518) 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9319400640 1 -- 172.21.15.114:0/3399793302 learned_addr learned my addr 172.21.15.114:0/3399793302 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.964+0000 7f9322800640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f932415e360 0x7f93240b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9321e00640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93240ae9d0 0x7f9324158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9319400640 1 -- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f932415e360 msgr2=0x7f93240b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9319400640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f932415e360 0x7f93240b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9319400640 1 -- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93240ae9d0 msgr2=0x7f9324158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9319400640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93240ae9d0 0x7f9324158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9319400640 1 -- 172.21.15.114:0/3399793302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932409c580 con 0x7f93240aef60 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9322800640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f932415e360 0x7f93240b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9319400640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93241fb0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f930c009850 tx=0x7f930c0a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f931aa00640 1 -- 172.21.15.114:0/3399793302 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c004300 con 0x7f93240aef60 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f931aa00640 1 -- 172.21.15.114:0/3399793302 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f930c005030 con 0x7f93240aef60 2024-09-16T07:29:20.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f931aa00640 1 -- 172.21.15.114:0/3399793302 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c005460 con 0x7f93240aef60 2024-09-16T07:29:20.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932409c860 con 0x7f93240aef60 2024-09-16T07:29:20.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932414b230 con 0x7f93240aef60 2024-09-16T07:29:20.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9324069410 con 0x7f93240aef60 2024-09-16T07:29:20.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f931aa00640 1 -- 172.21.15.114:0/3399793302 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f930c0a67f0 con 0x7f93240aef60 2024-09-16T07:29:20.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.968+0000 7f931aa00640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9300072ef0 0x7f93000753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:20.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.972+0000 7f931aa00640 1 -- 172.21.15.114:0/3399793302 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f930c12e090 con 0x7f93240aef60 2024-09-16T07:29:20.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.972+0000 7f9321e00640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9300072ef0 0x7f93000753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:20.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.972+0000 7f9321e00640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9300072ef0 0x7f93000753b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f93140058d0 tx=0x7f9314005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:20.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:20.976+0000 7f931aa00640 1 -- 172.21.15.114:0/3399793302 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f930c0bf060 con 0x7f93240aef60 2024-09-16T07:29:21.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.168+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol95640", "group_name": "subvol_grp33150", "target": ["mon-mgr", ""]}) -- 0x7f932414bc00 con 0x7f9300072ef0 2024-09-16T07:29:21.181 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:21.175+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:21.181 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:21.175+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:21.181 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:21.175+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:21.181 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:21.175+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:21.181 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:21.175+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:21.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.328+0000 7f931aa00640 1 -- 172.21.15.114:0/3399793302 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f932414bc00 con 0x7f9300072ef0 2024-09-16T07:29:21.334 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp33150/subvol95640 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9300072ef0 msgr2=0x7f93000753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9300072ef0 0x7f93000753b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f93140058d0 tx=0x7f9314005860 comp rx=0 tx=0).stop 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 msgr2=0x7f93241fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93241fb0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f930c009850 tx=0x7f930c0a6600 comp rx=0 tx=0).stop 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 shutdown_connections 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9300072ef0 0x7f93000753b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f932415e360 0x7f93240b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93240aef60 0x7f93241fb0f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 --2- 172.21.15.114:0/3399793302 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93240ae9d0 0x7f9324158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 >> 172.21.15.114:0/3399793302 conn(0x7f93240cfbc0 msgr2=0x7f932406f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:21.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 shutdown_connections 2024-09-16T07:29:21.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.332+0000 7f9329200640 1 -- 172.21.15.114:0/3399793302 wait complete. 2024-09-16T07:29:21.355 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol95640 subvol_grp33150 2024-09-16T07:29:21.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.496+0000 7effe2200640 1 -- 172.21.15.114:0/3988404040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc0003a60 msgr2=0x7effc0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:21.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.496+0000 7effe2200640 1 --2- 172.21.15.114:0/3988404040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc0003a60 0x7effc0003e80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7effcc009b60 tx=0x7effcc01d270 comp rx=0 tx=0).stop 2024-09-16T07:29:21.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.496+0000 7effe2200640 1 -- 172.21.15.114:0/3988404040 shutdown_connections 2024-09-16T07:29:21.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.496+0000 7effe2200640 1 --2- 172.21.15.114:0/3988404040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc0003a60 0x7effc0003e80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.496+0000 7effe2200640 1 -- 172.21.15.114:0/3988404040 >> 172.21.15.114:0/3988404040 conn(0x7effdc0d1da0 msgr2=0x7effdc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:21.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.496+0000 7effe2200640 1 -- 172.21.15.114:0/3988404040 shutdown_connections 2024-09-16T07:29:21.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.496+0000 7effe2200640 1 -- 172.21.15.114:0/3988404040 wait complete. 2024-09-16T07:29:21.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 Processor -- start 2024-09-16T07:29:21.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 -- start start 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effc0003a60 0x7effdc15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effdc0c8400 0x7effdc0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effdc0b70d0 0x7effdc0b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0ce7a0 con 0x7effdc0b70d0 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0ce620 con 0x7effc0003a60 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7effdc0ce920 con 0x7effdc0c8400 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effdc0b70d0 0x7effdc0b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effc0003a60 0x7effdc15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effdc0c8400 0x7effdc0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effc0003a60 0x7effdc15f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:43654/0 (socket says 172.21.15.114:43654) 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdb400640 1 -- 172.21.15.114:0/3529023476 learned_addr learned my addr 172.21.15.114:0/3529023476 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdaa00640 1 -- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effc0003a60 msgr2=0x7effdc15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:21.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdaa00640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effc0003a60 0x7effdc15f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdaa00640 1 -- 172.21.15.114:0/3529023476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effdc0b70d0 msgr2=0x7effdc0b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdaa00640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effdc0b70d0 0x7effdc0b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdaa00640 1 -- 172.21.15.114:0/3529023476 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc155290 con 0x7effdc0c8400 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdbe00640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effdc0b70d0 0x7effdc0b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effdaa00640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effdc0c8400 0x7effdc0c78d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7effc8003f00 tx=0x7effc8001640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effd3400640 1 -- 172.21.15.114:0/3529023476 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8015070 con 0x7effdc0c8400 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effd3400640 1 -- 172.21.15.114:0/3529023476 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effc8011840 con 0x7effdc0c8400 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc15fd50 con 0x7effdc0c8400 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effd3400640 1 -- 172.21.15.114:0/3529023476 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8011c70 con 0x7effdc0c8400 2024-09-16T07:29:21.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.500+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc160310 con 0x7effdc0c8400 2024-09-16T07:29:21.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.504+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc0cee20 con 0x7effdc0c8400 2024-09-16T07:29:21.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.504+0000 7effd3400640 1 -- 172.21.15.114:0/3529023476 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7effc8018070 con 0x7effdc0c8400 2024-09-16T07:29:21.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.504+0000 7effd3400640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7effbc072ef0 0x7effbc0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:21.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.504+0000 7effd3400640 1 -- 172.21.15.114:0/3529023476 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7effc80949d0 con 0x7effdc0c8400 2024-09-16T07:29:21.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.504+0000 7effdb400640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7effbc072ef0 0x7effbc0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:21.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.504+0000 7effdb400640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7effbc072ef0 0x7effbc0753b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7effcc0a6010 tx=0x7effcc01a010 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:21.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.508+0000 7effd3400640 1 -- 172.21.15.114:0/3529023476 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7effc805f530 con 0x7effdc0c8400 2024-09-16T07:29:21.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.704+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol95640", "group_name": "subvol_grp33150", "target": ["mon-mgr", ""]}) -- 0x7effdc070350 con 0x7effbc072ef0 2024-09-16T07:29:21.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effd3400640 1 -- 172.21.15.114:0/3529023476 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7effdc070350 con 0x7effbc072ef0 2024-09-16T07:29:21.715 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp33150/subvol95640 2024-09-16T07:29:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7effbc072ef0 msgr2=0x7effbc0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7effbc072ef0 0x7effbc0753b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7effcc0a6010 tx=0x7effcc01a010 comp rx=0 tx=0).stop 2024-09-16T07:29:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effdc0c8400 msgr2=0x7effdc0c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effdc0c8400 0x7effdc0c78d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7effc8003f00 tx=0x7effc8001640 comp rx=0 tx=0).stop 2024-09-16T07:29:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 shutdown_connections 2024-09-16T07:29:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7effbc072ef0 0x7effbc0753b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effdc0b70d0 0x7effdc0b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7effdc0c8400 0x7effdc0c78d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 --2- 172.21.15.114:0/3529023476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effc0003a60 0x7effdc15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 >> 172.21.15.114:0/3529023476 conn(0x7effdc0d1da0 msgr2=0x7effdc0b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 shutdown_connections 2024-09-16T07:29:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:21.712+0000 7effe2200640 1 -- 172.21.15.114:0/3529023476 wait complete. 2024-09-16T07:29:21.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:21.737 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/d583d8612ea392bcd87b4c75c711fc90.meta) 2024-09-16T07:29:23.824 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:29:23.824 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:29:23.824 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:29:23.824 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/subvol_grp33150/subvol95640 2024-09-16T07:29:23.825 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:29:23.825 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:23.827 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol95640 subvol_grp33150 2024-09-16T07:29:23.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.972+0000 7f8bd7200640 1 -- 172.21.15.114:0/1018051349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015c1f0 msgr2=0x7f8bd00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.972+0000 7f8bd7200640 1 --2- 172.21.15.114:0/1018051349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015c1f0 0x7f8bd00cec40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0074e00 tx=0x7f8bb801f0b0 comp rx=0 tx=0).stop 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- 172.21.15.114:0/1018051349 shutdown_connections 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 --2- 172.21.15.114:0/1018051349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015c1f0 0x7f8bd00cec40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 --2- 172.21.15.114:0/1018051349 >> v2:172.21.15.149:3300/0 conn(0x7f8bd00b0b60 0x7f8bd00cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 --2- 172.21.15.114:0/1018051349 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bd015be10 0x7f8bd00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- 172.21.15.114:0/1018051349 >> 172.21.15.114:0/1018051349 conn(0x7f8bd00d1da0 msgr2=0x7f8bd00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- 172.21.15.114:0/1018051349 shutdown_connections 2024-09-16T07:29:23.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- 172.21.15.114:0/1018051349 wait complete. 2024-09-16T07:29:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 Processor -- start 2024-09-16T07:29:23.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- start start 2024-09-16T07:29:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bd00b0b60 0x7f8bd015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015be10 0x7f8bd01f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bd015c1f0 0x7f8bd01f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:23.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd01600a0 con 0x7f8bd015be10 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd015ff20 con 0x7f8bd015c1f0 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd0160220 con 0x7f8bd00b0b60 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015be10 0x7f8bd01f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015be10 0x7f8bd01f81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43568/0 (socket says 172.21.15.114:43568) 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 -- 172.21.15.114:0/82895630 learned_addr learned my addr 172.21.15.114:0/82895630 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bcfe00640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bd00b0b60 0x7f8bd015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd5200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bd015c1f0 0x7f8bd01f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 -- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bd00b0b60 msgr2=0x7f8bd015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bd00b0b60 0x7f8bd015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 -- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bd015c1f0 msgr2=0x7f8bd01f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bd015c1f0 0x7f8bd01f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 -- 172.21.15.114:0/82895630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd006e990 con 0x7f8bd015be10 2024-09-16T07:29:23.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bcfe00640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bd00b0b60 0x7f8bd015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd5200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bd015c1f0 0x7f8bd01f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bc7400640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015be10 0x7f8bd01f81c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80b3040 tx=0x7f8bb8005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bccc00640 1 -- 172.21.15.114:0/82895630 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80b5040 con 0x7f8bd015be10 2024-09-16T07:29:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bccc00640 1 -- 172.21.15.114:0/82895630 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bb8005320 con 0x7f8bd015be10 2024-09-16T07:29:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bccc00640 1 -- 172.21.15.114:0/82895630 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80046d0 con 0x7f8bd015be10 2024-09-16T07:29:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.976+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd006ec70 con 0x7f8bd015be10 2024-09-16T07:29:23.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.980+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd006f230 con 0x7f8bd015be10 2024-09-16T07:29:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.980+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd01606d0 con 0x7f8bd015be10 2024-09-16T07:29:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.980+0000 7f8bccc00640 1 -- 172.21.15.114:0/82895630 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 97131+0+0 (secure 0 0 0) 0x7f8bb8004890 con 0x7f8bd015be10 2024-09-16T07:29:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.980+0000 7f8bccc00640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8bac072f50 0x7f8bac075410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.980+0000 7f8bccc00640 1 -- 172.21.15.114:0/82895630 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8bb8131060 con 0x7f8bd015be10 2024-09-16T07:29:23.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.980+0000 7f8bcfe00640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8bac072f50 0x7f8bac075410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:23.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.984+0000 7f8bcfe00640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8bac072f50 0x7f8bac075410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009b60 tx=0x7f8bc00091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:23.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:23.984+0000 7f8bccc00640 1 -- 172.21.15.114:0/82895630 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8bb8018c10 con 0x7f8bd015be10 2024-09-16T07:29:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.176+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol95640", "group_name": "subvol_grp33150", "target": ["mon-mgr", ""]}) -- 0x7f8bd006f400 con 0x7f8bac072f50 2024-09-16T07:29:24.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.204+0000 7f8bccc00640 1 -- 172.21.15.114:0/82895630 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8bd006f400 con 0x7f8bac072f50 2024-09-16T07:29:24.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8bac072f50 msgr2=0x7f8bac075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:24.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8bac072f50 0x7f8bac075410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009b60 tx=0x7f8bc00091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015be10 msgr2=0x7f8bd01f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015be10 0x7f8bd01f81c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80b3040 tx=0x7f8bb8005d60 comp rx=0 tx=0).stop 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 shutdown_connections 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8bac072f50 0x7f8bac075410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bd015c1f0 0x7f8bd01f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bd015be10 0x7f8bd01f81c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 --2- 172.21.15.114:0/82895630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bd00b0b60 0x7f8bd015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 >> 172.21.15.114:0/82895630 conn(0x7f8bd00d1da0 msgr2=0x7f8bd0072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 shutdown_connections 2024-09-16T07:29:24.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.208+0000 7f8bd7200640 1 -- 172.21.15.114:0/82895630 wait complete. 2024-09-16T07:29:24.214 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.211+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.214 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.211+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.214 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.211+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.215 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.211+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.215 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.211+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.233 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.231+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.233 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.231+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.233 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.231+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.233 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.231+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.233 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:24.231+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:24.235 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T07:29:24.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:29:24.308 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-09-16T07:29:24.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:24.316 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp33150 2024-09-16T07:29:24.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.456+0000 7f6a9b800640 1 -- 172.21.15.114:0/4087306027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a78004d50 msgr2=0x7f6a780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:24.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.456+0000 7f6a9b800640 1 --2- 172.21.15.114:0/4087306027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a78004d50 0x7f6a780051d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009ee0 tx=0x7f6a8c01d5f0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.456+0000 7f6a99800640 1 -- 172.21.15.114:0/4087306027 reap_dead start 2024-09-16T07:29:24.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.456+0000 7f6a9b800640 1 -- 172.21.15.114:0/4087306027 shutdown_connections 2024-09-16T07:29:24.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.456+0000 7f6a9b800640 1 -- 172.21.15.114:0/4087306027 >> 172.21.15.114:0/4087306027 conn(0x7f6a940d1ea0 msgr2=0x7f6a940d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:24.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.456+0000 7f6a9b800640 1 -- 172.21.15.114:0/4087306027 shutdown_connections 2024-09-16T07:29:24.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.456+0000 7f6a9b800640 1 -- 172.21.15.114:0/4087306027 wait complete. 2024-09-16T07:29:24.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 Processor -- start 2024-09-16T07:29:24.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 -- start start 2024-09-16T07:29:24.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a78004d50 0x7f6a941f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9409dce0 0x7f6a940aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a940cd7a0 0x7f6a941593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6a940cce80 con 0x7f6a9409dce0 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a940cf6f0 con 0x7f6a940cd7a0 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a940cd000 con 0x7f6a78004d50 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9409dce0 0x7f6a940aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9409dce0 0x7f6a940aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48130/0 (socket says 172.21.15.114:48130) 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 -- 172.21.15.114:0/1575240418 learned_addr learned my addr 172.21.15.114:0/1575240418 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a99800640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a940cd7a0 0x7f6a941593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a98e00640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a78004d50 0x7f6a941f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 -- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a78004d50 msgr2=0x7f6a941f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:24.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a78004d50 0x7f6a941f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 -- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a940cd7a0 msgr2=0x7f6a941593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a940cd7a0 0x7f6a941593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 -- 172.21.15.114:0/1575240418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a941f5fc0 con 0x7f6a9409dce0 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a98e00640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a78004d50 0x7f6a941f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a8be00640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9409dce0 0x7f6a940aed70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c011840 tx=0x7f6a7c011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a91600640 1 -- 172.21.15.114:0/1575240418 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c01f070 con 0x7f6a9409dce0 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a91600640 1 -- 172.21.15.114:0/1575240418 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a7c00fd50 con 0x7f6a9409dce0 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a91600640 1 -- 172.21.15.114:0/1575240418 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c012690 con 0x7f6a9409dce0 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a941f62a0 con 0x7f6a9409dce0 2024-09-16T07:29:24.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.460+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9409be70 con 0x7f6a9409dce0 2024-09-16T07:29:24.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.464+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a940d2c40 con 0x7f6a9409dce0 2024-09-16T07:29:24.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.464+0000 7f6a91600640 1 -- 172.21.15.114:0/1575240418 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 97131+0+0 (secure 0 0 0) 0x7f6a7c022070 con 0x7f6a9409dce0 2024-09-16T07:29:24.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.464+0000 7f6a91600640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a70072f80 0x7f6a70075440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:24.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.464+0000 7f6a91600640 1 -- 172.21.15.114:0/1575240418 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6a7c094950 con 0x7f6a9409dce0 2024-09-16T07:29:24.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.464+0000 7f6a98e00640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a70072f80 0x7f6a70075440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:24.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.464+0000 7f6a98e00640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a70072f80 0x7f6a70075440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6a84000fc0 tx=0x7f6a84001cc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:24.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.468+0000 7f6a91600640 1 -- 172.21.15.114:0/1575240418 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6a7c05f3e0 con 0x7f6a9409dce0 2024-09-16T07:29:24.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.656+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp33150", "target": ["mon-mgr", ""]}) -- 0x7f6a94076360 con 0x7f6a70072f80 2024-09-16T07:29:24.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.660+0000 7f6a91600640 1 -- 172.21.15.114:0/1575240418 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6a94076360 con 0x7f6a70072f80 2024-09-16T07:29:24.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a70072f80 msgr2=0x7f6a70075440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a70072f80 0x7f6a70075440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6a84000fc0 tx=0x7f6a84001cc0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9409dce0 msgr2=0x7f6a940aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9409dce0 0x7f6a940aed70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c011840 tx=0x7f6a7c011d00 comp rx=0 tx=0).stop 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 shutdown_connections 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a70072f80 0x7f6a70075440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a940cd7a0 0x7f6a941593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9409dce0 0x7f6a940aed70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 --2- 172.21.15.114:0/1575240418 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a78004d50 0x7f6a941f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 >> 172.21.15.114:0/1575240418 conn(0x7f6a940d1ea0 msgr2=0x7f6a940d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 shutdown_connections 2024-09-16T07:29:24.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:24.664+0000 7f6a9b800640 1 -- 172.21.15.114:0/1575240418 wait complete. 2024-09-16T07:29:24.686 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:29:24.687 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:29:24.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:29:24.882 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:29:24.883 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:29:24.883 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:24.883 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:24.892 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:24.892 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:24.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 -- 172.21.15.114:0/3570881446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 msgr2=0x7fe0800b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 --2- 172.21.15.114:0/3570881446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800b7e60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe080161c90 tx=0x7fe07801c7d0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 -- 172.21.15.114:0/3570881446 shutdown_connections 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 --2- 172.21.15.114:0/3570881446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800b7e60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 --2- 172.21.15.114:0/3570881446 >> v2:172.21.15.149:3300/0 conn(0x7fe0800d2100 0x7fe0800d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 -- 172.21.15.114:0/3570881446 >> 172.21.15.114:0/3570881446 conn(0x7fe0800d4060 msgr2=0x7fe0800d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 -- 172.21.15.114:0/3570881446 shutdown_connections 2024-09-16T07:29:25.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 -- 172.21.15.114:0/3570881446 wait complete. 2024-09-16T07:29:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 Processor -- start 2024-09-16T07:29:25.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.124+0000 7fe087000640 1 -- start start 2024-09-16T07:29:25.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0800d2100 0x7fe0800ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08015e2d0 0x7fe080152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe08016b1c0 con 0x7fe0800b7a30 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe08016b040 con 0x7fe0800d2100 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe08016b340 con 0x7fe08015e2d0 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48150/0 (socket says 172.21.15.114:48150) 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 -- 172.21.15.114:0/2177302545 learned_addr learned my addr 172.21.15.114:0/2177302545 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe077400640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0800d2100 0x7fe0800ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe085000640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08015e2d0 0x7fe080152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 -- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08015e2d0 msgr2=0x7fe080152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08015e2d0 0x7fe080152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 -- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0800d2100 msgr2=0x7fe0800ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0800d2100 0x7fe0800ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 -- 172.21.15.114:0/2177302545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe080152650 con 0x7fe0800b7a30 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07fe00640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800cd6d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe07000cb10 tx=0x7fe07000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07cc00640 1 -- 172.21.15.114:0/2177302545 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070016020 con 0x7fe0800b7a30 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07cc00640 1 -- 172.21.15.114:0/2177302545 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe07000ce50 con 0x7fe0800b7a30 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0800ca890 con 0x7fe0800b7a30 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07cc00640 1 -- 172.21.15.114:0/2177302545 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07000ae00 con 0x7fe0800b7a30 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0801562f0 con 0x7fe0800b7a30 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0800b7e60 con 0x7fe0800b7a30 2024-09-16T07:29:25.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.128+0000 7fe07cc00640 1 -- 172.21.15.114:0/2177302545 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 97131+0+0 (secure 0 0 0) 0x7fe070019020 con 0x7fe0800b7a30 2024-09-16T07:29:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.132+0000 7fe07cc00640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe05c072f50 0x7fe05c075410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.132+0000 7fe07cc00640 1 -- 172.21.15.114:0/2177302545 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe0700941d0 con 0x7fe0800b7a30 2024-09-16T07:29:25.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.132+0000 7fe077400640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe05c072f50 0x7fe05c075410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:25.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.132+0000 7fe077400640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe05c072f50 0x7fe05c075410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0680058d0 tx=0x7fe068005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:25.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.136+0000 7fe07cc00640 1 -- 172.21.15.114:0/2177302545 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe070020020 con 0x7fe0800b7a30 2024-09-16T07:29:25.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.316+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe08015b6b0 con 0x7fe0800b7a30 2024-09-16T07:29:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.316+0000 7fe07cc00640 1 -- 172.21.15.114:0/2177302545 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7fe07005f2a0 con 0x7fe0800b7a30 2024-09-16T07:29:25.322 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:29:25.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe05c072f50 msgr2=0x7fe05c075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe05c072f50 0x7fe05c075410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0680058d0 tx=0x7fe068005860 comp rx=0 tx=0).stop 2024-09-16T07:29:25.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 msgr2=0x7fe0800cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800cd6d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe07000cb10 tx=0x7fe07000cc00 comp rx=0 tx=0).stop 2024-09-16T07:29:25.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 shutdown_connections 2024-09-16T07:29:25.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe05c072f50 0x7fe05c075410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe08015e2d0 0x7fe080152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0800d2100 0x7fe0800ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 --2- 172.21.15.114:0/2177302545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0800b7a30 0x7fe0800cd6d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 >> 172.21.15.114:0/2177302545 conn(0x7fe0800d4060 msgr2=0x7fe08006df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:25.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 shutdown_connections 2024-09-16T07:29:25.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.320+0000 7fe087000640 1 -- 172.21.15.114:0/2177302545 wait complete. 2024-09-16T07:29:25.344 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:29:25.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:25.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:25.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:29:25.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:25.399 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:29:25.425 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:29:25.425 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:25.425 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:25.434 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:25.434 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:25.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:29:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 -- 172.21.15.114:0/1387048840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00d01b0 msgr2=0x7f4de00cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/1387048840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00d01b0 0x7f4de00cefb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009840 tx=0x7f4dcc01c790 comp rx=0 tx=0).stop 2024-09-16T07:29:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 -- 172.21.15.114:0/1387048840 shutdown_connections 2024-09-16T07:29:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/1387048840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00d01b0 0x7f4de00cefb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 -- 172.21.15.114:0/1387048840 >> 172.21.15.114:0/1387048840 conn(0x7f4de009aa10 msgr2=0x7f4de009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 -- 172.21.15.114:0/1387048840 shutdown_connections 2024-09-16T07:29:25.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 -- 172.21.15.114:0/1387048840 wait complete. 2024-09-16T07:29:25.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 Processor -- start 2024-09-16T07:29:25.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.624+0000 7f4ddfe00640 1 -- start start 2024-09-16T07:29:25.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00b2590 0x7f4de0158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de00d01b0 0x7f4de0153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015f000 0x7f4de01f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4de016a0f0 con 0x7f4de00b2590 2024-09-16T07:29:25.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4de0169f70 con 0x7f4de015f000 2024-09-16T07:29:25.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4de016a270 con 0x7f4de00d01b0 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00b2590 0x7f4de0158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00b2590 0x7f4de0158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48180/0 (socket says 172.21.15.114:48180) 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 -- 172.21.15.114:0/198414338 learned_addr learned my addr 172.21.15.114:0/198414338 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 -- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de00d01b0 msgr2=0x7f4de0153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de00d01b0 0x7f4de0153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 -- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015f000 msgr2=0x7f4de01f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015f000 0x7f4de01f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 -- 172.21.15.114:0/198414338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de01591c0 con 0x7f4de00b2590 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddea00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00b2590 0x7f4de0158070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000c420 tx=0x7f4dd000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0017070 con 0x7f4de00b2590 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dd00053c0 con 0x7f4de00b2590 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0003860 con 0x7f4de00b2590 2024-09-16T07:29:25.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de01594a0 con 0x7f4de00b2590 2024-09-16T07:29:25.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de00b7110 con 0x7f4de00b2590 2024-09-16T07:29:25.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de00cefb0 con 0x7f4de00b2590 2024-09-16T07:29:25.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.628+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 6) ==== 97131+0+0 (secure 0 0 0) 0x7f4dd001a070 con 0x7f4de00b2590 2024-09-16T07:29:25.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.632+0000 7f4dd6a00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072f50 0x7f4dc0075410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:25.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.632+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4dd00933d0 con 0x7f4de00b2590 2024-09-16T07:29:25.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.632+0000 7f4dde000640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072f50 0x7f4dc0075410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:25.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.632+0000 7f4dde000640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072f50 0x7f4dc0075410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0af000 tx=0x7f4dcc019530 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:25.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.636+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4dd005e420 con 0x7f4de00b2590 2024-09-16T07:29:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.776+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f4dd0059f90 con 0x7f4de00b2590 2024-09-16T07:29:25.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.816+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4de00b12b0 con 0x7f4de00b2590 2024-09-16T07:29:25.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.816+0000 7f4dd6a00640 1 -- 172.21.15.114:0/198414338 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) ==== 80+0+0 (secure 0 0 0) 0x7f4dd006d250 con 0x7f4de00b2590 2024-09-16T07:29:25.821 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072f50 msgr2=0x7f4dc0075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072f50 0x7f4dc0075410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0af000 tx=0x7f4dcc019530 comp rx=0 tx=0).stop 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00b2590 msgr2=0x7f4de0158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00b2590 0x7f4de0158070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000c420 tx=0x7f4dd000c8e0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 shutdown_connections 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4dc0072f50 0x7f4dc0075410 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4de015f000 0x7f4de01f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4de00d01b0 0x7f4de0153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 --2- 172.21.15.114:0/198414338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4de00b2590 0x7f4de0158070 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:25.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 >> 172.21.15.114:0/198414338 conn(0x7f4de009aa10 msgr2=0x7f4de00ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:25.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 shutdown_connections 2024-09-16T07:29:25.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:25.820+0000 7f4ddfe00640 1 -- 172.21.15.114:0/198414338 wait complete. 2024-09-16T07:29:25.843 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:29:25.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:25.843 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:25.869 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:29:25.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:25.870 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:29:25.924 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:29:25.925 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:25.925 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:25.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:29:25.934 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:29:25.934 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:25.934 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:25.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:29:25.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:26.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 -- 172.21.15.114:0/3406777597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0cdb30 msgr2=0x7f692c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 --2- 172.21.15.114:0/3406777597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0cdb30 0x7f692c0aeef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6924009bc0 tx=0x7f692401cac0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 -- 172.21.15.114:0/3406777597 shutdown_connections 2024-09-16T07:29:26.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 --2- 172.21.15.114:0/3406777597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0cdb30 0x7f692c0aeef0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 --2- 172.21.15.114:0/3406777597 >> v2:172.21.15.149:3300/0 conn(0x7f692c0ced80 0x7f692c0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 -- 172.21.15.114:0/3406777597 >> 172.21.15.114:0/3406777597 conn(0x7f692c0d1dc0 msgr2=0x7f692c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:26.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 -- 172.21.15.114:0/3406777597 shutdown_connections 2024-09-16T07:29:26.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 -- 172.21.15.114:0/3406777597 wait complete. 2024-09-16T07:29:26.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 Processor -- start 2024-09-16T07:29:26.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.116+0000 7f6931c00640 1 -- start start 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0cdb30 0x7f692c15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0ced80 0x7f692c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c15bea0 0x7f692c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f692c169340 con 0x7f692c15bea0 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f692c1691c0 con 0x7f692c0cdb30 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f692c1694c0 con 0x7f692c0ced80 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c15bea0 0x7f692c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c15bea0 0x7f692c1561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48184/0 (socket says 172.21.15.114:48184) 2024-09-16T07:29:26.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 -- 172.21.15.114:0/3733015734 learned_addr learned my addr 172.21.15.114:0/3733015734 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6922000640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0ced80 0x7f692c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692aa00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0cdb30 0x7f692c15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 -- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0ced80 msgr2=0x7f692c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0ced80 0x7f692c0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 -- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0cdb30 msgr2=0x7f692c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0cdb30 0x7f692c15af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 -- 172.21.15.114:0/3733015734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c156ef0 con 0x7f692c15bea0 2024-09-16T07:29:26.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f692b400640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c15bea0 0x7f692c1561a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f692401b170 tx=0x7f6924005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:26.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6923400640 1 -- 172.21.15.114:0/3733015734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69240bb070 con 0x7f692c15bea0 2024-09-16T07:29:26.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6923400640 1 -- 172.21.15.114:0/3733015734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6924004e00 con 0x7f692c15bea0 2024-09-16T07:29:26.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6923400640 1 -- 172.21.15.114:0/3733015734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69240b2040 con 0x7f692c15bea0 2024-09-16T07:29:26.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c15a730 con 0x7f692c15bea0 2024-09-16T07:29:26.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c1577f0 con 0x7f692c15bea0 2024-09-16T07:29:26.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692c15a520 con 0x7f692c15bea0 2024-09-16T07:29:26.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.120+0000 7f6923400640 1 -- 172.21.15.114:0/3733015734 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f6924003bc0 con 0x7f692c15bea0 2024-09-16T07:29:26.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.124+0000 7f6923400640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6908073070 0x7f6908075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.124+0000 7f6923400640 1 -- 172.21.15.114:0/3733015734 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f692412db10 con 0x7f692c15bea0 2024-09-16T07:29:26.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.124+0000 7f692aa00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6908073070 0x7f6908075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.124+0000 7f692aa00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6908073070 0x7f6908075530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f692c159500 tx=0x7f691c001da0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:26.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.128+0000 7f6923400640 1 -- 172.21.15.114:0/3733015734 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f69240166b0 con 0x7f692c15bea0 2024-09-16T07:29:26.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f692c0ce620 con 0x7f692c15bea0 2024-09-16T07:29:26.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6923400640 1 -- 172.21.15.114:0/3733015734 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f69240f8390 con 0x7f692c15bea0 2024-09-16T07:29:26.331 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:26.331 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"btime":"2024-09-16T07:29:19:743625+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3907348015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3907348015},{"type":"v1","addr":"172.21.15.114:6834","nonce":3907348015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2595700778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2595700778},{"type":"v1","addr":"172.21.15.149:6836","nonce":2595700778}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/986042946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":986042946},{"type":"v1","addr":"172.21.15.149:6837","nonce":986042946}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:05.062058+0000","modified":"2024-09-16T07:29:08.089127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4837":{"gid":4837,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/319033864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":319033864},{"type":"v1","addr":"172.21.15.114:6835","nonce":319033864}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4837,"qdb_cluster":[4837]},"id":2}]} 2024-09-16T07:29:26.332 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-09-16T07:29:26.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6908073070 msgr2=0x7f6908075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6908073070 0x7f6908075530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f692c159500 tx=0x7f691c001da0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c15bea0 msgr2=0x7f692c1561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c15bea0 0x7f692c1561a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f692401b170 tx=0x7f6924005b00 comp rx=0 tx=0).stop 2024-09-16T07:29:26.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 shutdown_connections 2024-09-16T07:29:26.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6908073070 0x7f6908075530 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f692c15bea0 0x7f692c1561a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f692c0ced80 0x7f692c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 --2- 172.21.15.114:0/3733015734 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f692c0cdb30 0x7f692c15af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 >> 172.21.15.114:0/3733015734 conn(0x7f692c0d1dc0 msgr2=0x7f692c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:26.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 shutdown_connections 2024-09-16T07:29:26.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.328+0000 7f6931c00640 1 -- 172.21.15.114:0/3733015734 wait complete. 2024-09-16T07:29:26.353 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- 172.21.15.114:0/456105456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 msgr2=0x7fb8fc0d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 --2- 172.21.15.114:0/456105456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 0x7fb8fc0d13b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009900 tx=0x7fb8ec01c880 comp rx=0 tx=0).stop 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- 172.21.15.114:0/456105456 shutdown_connections 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 --2- 172.21.15.114:0/456105456 >> v2:172.21.15.149:3300/0 conn(0x7fb8fc0b3dc0 0x7fb8fc0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 --2- 172.21.15.114:0/456105456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 0x7fb8fc0d13b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- 172.21.15.114:0/456105456 >> 172.21.15.114:0/456105456 conn(0x7fb8fc0b2890 msgr2=0x7fb8fc0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- 172.21.15.114:0/456105456 shutdown_connections 2024-09-16T07:29:26.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- 172.21.15.114:0/456105456 wait complete. 2024-09-16T07:29:26.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 Processor -- start 2024-09-16T07:29:26.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- start start 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc0b3dc0 0x7fb8fc1f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8fc0b4be0 0x7fb8fc1415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 0x7fb8fc09caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc167e10 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc167c90 con 0x7fb8fc0b3dc0 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb902e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc167f90 con 0x7fb8fc15a980 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8fc0b4be0 0x7fb8fc1415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8fc0b4be0 0x7fb8fc1415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48188/0 (socket says 172.21.15.114:48188) 2024-09-16T07:29:26.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 -- 172.21.15.114:0/1794788711 learned_addr learned my addr 172.21.15.114:0/1794788711 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb900e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 0x7fb8fc09caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fbe00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc0b3dc0 0x7fb8fc1f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 -- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 msgr2=0x7fb8fc09caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 0x7fb8fc09caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 -- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc0b3dc0 msgr2=0x7fb8fc1f9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc0b3dc0 0x7fb8fc1f9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.492+0000 7fb8fb400640 1 -- 172.21.15.114:0/1794788711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc1f9e80 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8fb400640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8fc0b4be0 0x7fb8fc1415c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800ea20 tx=0x7fb8e800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8f3e00640 1 -- 172.21.15.114:0/1794788711 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800cd80 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8f3e00640 1 -- 172.21.15.114:0/1794788711 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8e8010430 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc1f5d90 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8f3e00640 1 -- 172.21.15.114:0/1794788711 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8010860 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc1f6350 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc0b46a0 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8f3e00640 1 -- 172.21.15.114:0/1794788711 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fb8e8010a00 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8f3e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb8dc073070 0x7fb8dc075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8f3e00640 1 -- 172.21.15.114:0/1794788711 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb8e8094c60 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.496+0000 7fb8fbe00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb8dc073070 0x7fb8dc075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.500+0000 7fb8fbe00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb8dc073070 0x7fb8dc075530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0af000 tx=0x7fb8ec01b120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:26.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.500+0000 7fb8f3e00640 1 -- 172.21.15.114:0/1794788711 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb8fc1f9e80 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8fc06adb0 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb8f3e00640 1 -- 172.21.15.114:0/1794788711 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7fb8e805f580 con 0x7fb8fc0b4be0 2024-09-16T07:29:26.711 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:26.711 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"btime":"2024-09-16T07:29:19:743625+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3907348015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3907348015},{"type":"v1","addr":"172.21.15.114:6834","nonce":3907348015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2595700778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2595700778},{"type":"v1","addr":"172.21.15.149:6836","nonce":2595700778}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/986042946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":986042946},{"type":"v1","addr":"172.21.15.149:6837","nonce":986042946}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:05.062058+0000","modified":"2024-09-16T07:29:08.089127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4837":{"gid":4837,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/319033864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":319033864},{"type":"v1","addr":"172.21.15.114:6835","nonce":319033864}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4837,"qdb_cluster":[4837]},"id":2}]} 2024-09-16T07:29:26.712 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-09-16T07:29:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb8dc073070 msgr2=0x7fb8dc075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb8dc073070 0x7fb8dc075530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0af000 tx=0x7fb8ec01b120 comp rx=0 tx=0).stop 2024-09-16T07:29:26.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8fc0b4be0 msgr2=0x7fb8fc1415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8fc0b4be0 0x7fb8fc1415c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800ea20 tx=0x7fb8e800eee0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 shutdown_connections 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb8dc073070 0x7fb8dc075530 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8fc15a980 0x7fb8fc09caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8fc0b4be0 0x7fb8fc1415c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 --2- 172.21.15.114:0/1794788711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc0b3dc0 0x7fb8fc1f9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 >> 172.21.15.114:0/1794788711 conn(0x7fb8fc0b2890 msgr2=0x7fb8fc15d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 shutdown_connections 2024-09-16T07:29:26.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.708+0000 7fb902e00640 1 -- 172.21.15.114:0/1794788711 wait complete. 2024-09-16T07:29:26.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.872+0000 7fc68f000640 1 -- 172.21.15.114:0/1012667278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc66c004810 msgr2=0x7fc66c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.872+0000 7fc68f000640 1 --2- 172.21.15.114:0/1012667278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc66c004810 0x7fc66c004c90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc67000c2e0 tx=0x7fc67001f6a0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.872+0000 7fc68f000640 1 -- 172.21.15.114:0/1012667278 shutdown_connections 2024-09-16T07:29:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.872+0000 7fc68f000640 1 --2- 172.21.15.114:0/1012667278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc66c004810 0x7fc66c004c90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.872+0000 7fc68f000640 1 -- 172.21.15.114:0/1012667278 >> 172.21.15.114:0/1012667278 conn(0x7fc6880d0c90 msgr2=0x7fc6880d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.872+0000 7fc68f000640 1 -- 172.21.15.114:0/1012667278 shutdown_connections 2024-09-16T07:29:26.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.872+0000 7fc68f000640 1 -- 172.21.15.114:0/1012667278 wait complete. 2024-09-16T07:29:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 Processor -- start 2024-09-16T07:29:26.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 -- start start 2024-09-16T07:29:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc66c004810 0x7fc6881f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc68815e320 0x7fc688156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6880ca6a0 0x7fc688156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc688073940 con 0x7fc6880ca6a0 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880737c0 con 0x7fc66c004810 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc688073ac0 con 0x7fc68815e320 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6880ca6a0 0x7fc688156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6880ca6a0 0x7fc688156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48216/0 (socket says 172.21.15.114:48216) 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 -- 172.21.15.114:0/112155974 learned_addr learned my addr 172.21.15.114:0/112155974 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc687e00640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc66c004810 0x7fc6881f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc67f400640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc68815e320 0x7fc688156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 -- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc68815e320 msgr2=0x7fc688156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc68815e320 0x7fc688156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 -- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc66c004810 msgr2=0x7fc6881f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc66c004810 0x7fc6881f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 -- 172.21.15.114:0/112155974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6880b2cc0 con 0x7fc6880ca6a0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68d000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6880ca6a0 0x7fc688156950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc680011750 tx=0x7fc680011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc684c00640 1 -- 172.21.15.114:0/112155974 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680004460 con 0x7fc6880ca6a0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc684c00640 1 -- 172.21.15.114:0/112155974 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc680016070 con 0x7fc6880ca6a0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc684c00640 1 -- 172.21.15.114:0/112155974 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68000fac0 con 0x7fc6880ca6a0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6880b2fa0 con 0x7fc6880ca6a0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.876+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6881f25f0 con 0x7fc6880ca6a0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.880+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc688074020 con 0x7fc6880ca6a0 2024-09-16T07:29:26.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.880+0000 7fc684c00640 1 -- 172.21.15.114:0/112155974 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fc68000fc60 con 0x7fc6880ca6a0 2024-09-16T07:29:26.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.880+0000 7fc684c00640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc664073070 0x7fc664075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:26.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.880+0000 7fc684c00640 1 -- 172.21.15.114:0/112155974 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc680094ba0 con 0x7fc6880ca6a0 2024-09-16T07:29:26.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.880+0000 7fc687e00640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc664073070 0x7fc664075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:26.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.884+0000 7fc687e00640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc664073070 0x7fc664075530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc678004fd0 tx=0x7fc678004a30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:26.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:26.884+0000 7fc684c00640 1 -- 172.21.15.114:0/112155974 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc68005f400 con 0x7fc6880ca6a0 2024-09-16T07:29:27.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.052+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc688154a00 con 0x7fc6880ca6a0 2024-09-16T07:29:27.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc684c00640 1 -- 172.21.15.114:0/112155974 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16777 (secure 0 0 0) 0x7fc680063e30 con 0x7fc6880ca6a0 2024-09-16T07:29:27.059 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:27.059 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:06.683600+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:03.209188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:04.021718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:27.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc664073070 msgr2=0x7fc664075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc664073070 0x7fc664075530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc678004fd0 tx=0x7fc678004a30 comp rx=0 tx=0).stop 2024-09-16T07:29:27.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6880ca6a0 msgr2=0x7fc688156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6880ca6a0 0x7fc688156950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc680011750 tx=0x7fc680011c10 comp rx=0 tx=0).stop 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 shutdown_connections 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc664073070 0x7fc664075530 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6880ca6a0 0x7fc688156950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc68815e320 0x7fc688156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 --2- 172.21.15.114:0/112155974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc66c004810 0x7fc6881f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 >> 172.21.15.114:0/112155974 conn(0x7fc6880d0c90 msgr2=0x7fc688157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 shutdown_connections 2024-09-16T07:29:27.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.056+0000 7fc68f000640 1 -- 172.21.15.114:0/112155974 wait complete. 2024-09-16T07:29:27.082 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:29:27.082 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.220+0000 7f2a75600640 1 -- 172.21.15.114:0/989422375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a54004d50 msgr2=0x7f2a540051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.220+0000 7f2a75600640 1 --2- 172.21.15.114:0/989422375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a54004d50 0x7f2a540051d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009f10 tx=0x7f2a6801d5f0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.220+0000 7f2a6f400640 1 -- 172.21.15.114:0/989422375 reap_dead start 2024-09-16T07:29:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.220+0000 7f2a75600640 1 -- 172.21.15.114:0/989422375 shutdown_connections 2024-09-16T07:29:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.220+0000 7f2a75600640 1 -- 172.21.15.114:0/989422375 >> 172.21.15.114:0/989422375 conn(0x7f2a700d1dc0 msgr2=0x7f2a700d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.220+0000 7f2a75600640 1 -- 172.21.15.114:0/989422375 shutdown_connections 2024-09-16T07:29:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.220+0000 7f2a75600640 1 -- 172.21.15.114:0/989422375 wait complete. 2024-09-16T07:29:27.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 Processor -- start 2024-09-16T07:29:27.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 -- start start 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a700c7560 0x7f2a700b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a700b3dc0 0x7f2a700b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700b4240 0x7f2a700b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7015c400 con 0x7f2a700b3dc0 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7015c280 con 0x7f2a700b4240 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a700cebb0 con 0x7f2a700c7560 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a700b3dc0 0x7f2a700b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a700b3dc0 0x7f2a700b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48240/0 (socket says 172.21.15.114:48240) 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 -- 172.21.15.114:0/4112899459 learned_addr learned my addr 172.21.15.114:0/4112899459 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6ea00640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a700c7560 0x7f2a700b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6f400640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700b4240 0x7f2a700b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 -- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a700c7560 msgr2=0x7f2a700b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a700c7560 0x7f2a700b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 -- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700b4240 msgr2=0x7f2a700b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700b4240 0x7f2a700b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 -- 172.21.15.114:0/4112899459 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a700b2350 con 0x7f2a700b3dc0 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6f400640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700b4240 0x7f2a700b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a6e000640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a700b3dc0 0x7f2a700b7050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c003680 tx=0x7f2a5c00eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a66a00640 1 -- 172.21.15.114:0/4112899459 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c015070 con 0x7f2a700b3dc0 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a66a00640 1 -- 172.21.15.114:0/4112899459 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a5c00cac0 con 0x7f2a700b3dc0 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a66a00640 1 -- 172.21.15.114:0/4112899459 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c011460 con 0x7f2a700b3dc0 2024-09-16T07:29:27.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a700b3560 con 0x7f2a700b3dc0 2024-09-16T07:29:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a700b3b20 con 0x7f2a700b3dc0 2024-09-16T07:29:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.224+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a700cfcf0 con 0x7f2a700b3dc0 2024-09-16T07:29:27.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.228+0000 7f2a66a00640 1 -- 172.21.15.114:0/4112899459 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f2a5c018070 con 0x7f2a700b3dc0 2024-09-16T07:29:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.228+0000 7f2a66a00640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2a50073070 0x7f2a50075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.228+0000 7f2a66a00640 1 -- 172.21.15.114:0/4112899459 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f2a5c094550 con 0x7f2a700b3dc0 2024-09-16T07:29:27.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.228+0000 7f2a6ea00640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2a50073070 0x7f2a50075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.228+0000 7f2a6ea00640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2a50073070 0x7f2a50075530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009470 tx=0x7f2a600091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:27.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.232+0000 7f2a66a00640 1 -- 172.21.15.114:0/4112899459 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2a5c05ee50 con 0x7f2a700b3dc0 2024-09-16T07:29:27.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.440+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a70071670 con 0x7f2a700b3dc0 2024-09-16T07:29:27.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.440+0000 7f2a66a00640 1 -- 172.21.15.114:0/4112899459 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f2a5c063880 con 0x7f2a700b3dc0 2024-09-16T07:29:27.444 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:27.445 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"btime":"2024-09-16T07:29:19:743625+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3907348015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3907348015},{"type":"v1","addr":"172.21.15.114:6834","nonce":3907348015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2595700778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2595700778},{"type":"v1","addr":"172.21.15.149:6836","nonce":2595700778}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/986042946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":986042946},{"type":"v1","addr":"172.21.15.149:6837","nonce":986042946}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:05.062058+0000","modified":"2024-09-16T07:29:08.089127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4837":{"gid":4837,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/319033864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":319033864},{"type":"v1","addr":"172.21.15.114:6835","nonce":319033864}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4837,"qdb_cluster":[4837]},"id":2}]} 2024-09-16T07:29:27.445 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-09-16T07:29:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2a50073070 msgr2=0x7f2a50075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2a50073070 0x7f2a50075530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009470 tx=0x7f2a600091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a700b3dc0 msgr2=0x7f2a700b7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a700b3dc0 0x7f2a700b7050 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c003680 tx=0x7f2a5c00eb60 comp rx=0 tx=0).stop 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 shutdown_connections 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2a50073070 0x7f2a50075530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a700b4240 0x7f2a700b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a700b3dc0 0x7f2a700b7050 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 --2- 172.21.15.114:0/4112899459 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a700c7560 0x7f2a700b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 >> 172.21.15.114:0/4112899459 conn(0x7f2a700d1dc0 msgr2=0x7f2a70070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 shutdown_connections 2024-09-16T07:29:27.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.444+0000 7f2a75600640 1 -- 172.21.15.114:0/4112899459 wait complete. 2024-09-16T07:29:27.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 -- 172.21.15.114:0/512086092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b4d80 msgr2=0x7f108c0b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 --2- 172.21.15.114:0/512086092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b4d80 0x7f108c0b11a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f108c0b48c0 tx=0x7f108001c8c0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 -- 172.21.15.114:0/512086092 shutdown_connections 2024-09-16T07:29:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 --2- 172.21.15.114:0/512086092 >> v2:172.21.15.149:3300/0 conn(0x7f108c0b5870 0x7f108c165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 --2- 172.21.15.114:0/512086092 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b4d80 0x7f108c0b11a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 -- 172.21.15.114:0/512086092 >> 172.21.15.114:0/512086092 conn(0x7f108c09aa10 msgr2=0x7f108c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 -- 172.21.15.114:0/512086092 shutdown_connections 2024-09-16T07:29:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 -- 172.21.15.114:0/512086092 wait complete. 2024-09-16T07:29:27.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 Processor -- start 2024-09-16T07:29:27.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.604+0000 7f1092e00640 1 -- start start 2024-09-16T07:29:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b0ce0 0x7f108c1f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f108c0b4d80 0x7f108c1fb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108c0b5870 0x7f108c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f108c168a70 con 0x7f108c0b0ce0 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f108c1688f0 con 0x7f108c0b4d80 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f108c168bf0 con 0x7f108c0b5870 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b0ce0 0x7f108c1f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b0ce0 0x7f108c1f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48250/0 (socket says 172.21.15.114:48250) 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 -- 172.21.15.114:0/2155265052 learned_addr learned my addr 172.21.15.114:0/2155265052 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092400640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108c0b5870 0x7f108c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091000640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f108c0b4d80 0x7f108c1fb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 -- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108c0b5870 msgr2=0x7f108c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108c0b5870 0x7f108c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 -- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f108c0b4d80 msgr2=0x7f108c1fb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f108c0b4d80 0x7f108c1fb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 -- 172.21.15.114:0/2155265052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c1fbaf0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091000640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f108c0b4d80 0x7f108c1fb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1091a00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b0ce0 0x7f108c1f7400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f10800b0040 tx=0x7f10800a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1089600640 1 -- 172.21.15.114:0/2155265052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10800b2040 con 0x7f108c0b0ce0 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1089600640 1 -- 172.21.15.114:0/2155265052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1080004470 con 0x7f108c0b0ce0 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c1fbdd0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1089600640 1 -- 172.21.15.114:0/2155265052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10800052d0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c1f7940 con 0x7f108c0b0ce0 2024-09-16T07:29:27.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.608+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c0b11a0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.612+0000 7f1089600640 1 -- 172.21.15.114:0/2155265052 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f10800bd060 con 0x7f108c0b0ce0 2024-09-16T07:29:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.612+0000 7f1089600640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f106c073070 0x7f106c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.612+0000 7f1089600640 1 -- 172.21.15.114:0/2155265052 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f108012d9b0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.612+0000 7f1091000640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f106c073070 0x7f106c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.612+0000 7f1091000640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f106c073070 0x7f106c075530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f108c1492b0 tx=0x7f1078009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:27.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.616+0000 7f1089600640 1 -- 172.21.15.114:0/2155265052 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f10800164b0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f108c15a4b0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1089600640 1 -- 172.21.15.114:0/2155265052 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f10800f87e0 con 0x7f108c0b0ce0 2024-09-16T07:29:27.828 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:27.828 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"btime":"2024-09-16T07:29:19:743625+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3907348015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3907348015},{"type":"v1","addr":"172.21.15.114:6834","nonce":3907348015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2595700778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2595700778},{"type":"v1","addr":"172.21.15.149:6836","nonce":2595700778}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/986042946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":986042946},{"type":"v1","addr":"172.21.15.149:6837","nonce":986042946}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:05.062058+0000","modified":"2024-09-16T07:29:08.089127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4837},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4837":{"gid":4837,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/319033864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":319033864},{"type":"v1","addr":"172.21.15.114:6835","nonce":319033864}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4837,"qdb_cluster":[4837]},"id":2}]} 2024-09-16T07:29:27.829 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f106c073070 msgr2=0x7f106c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f106c073070 0x7f106c075530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f108c1492b0 tx=0x7f1078009040 comp rx=0 tx=0).stop 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b0ce0 msgr2=0x7f108c1f7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b0ce0 0x7f108c1f7400 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f10800b0040 tx=0x7f10800a55c0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 shutdown_connections 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f106c073070 0x7f106c075530 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f108c0b5870 0x7f108c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f108c0b4d80 0x7f108c1fb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 --2- 172.21.15.114:0/2155265052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f108c0b0ce0 0x7f108c1f7400 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 >> 172.21.15.114:0/2155265052 conn(0x7f108c09aa10 msgr2=0x7f108c15c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 shutdown_connections 2024-09-16T07:29:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.824+0000 7f1092e00640 1 -- 172.21.15.114:0/2155265052 wait complete. 2024-09-16T07:29:27.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:27.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 -- 172.21.15.114:0/1232362902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 msgr2=0x7fa29c0ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 --2- 172.21.15.114:0/1232362902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 0x7fa29c0ce4e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009840 tx=0x7fa28c01c820 comp rx=0 tx=0).stop 2024-09-16T07:29:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 -- 172.21.15.114:0/1232362902 shutdown_connections 2024-09-16T07:29:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 --2- 172.21.15.114:0/1232362902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa29c0cd8c0 0x7fa29c0cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 --2- 172.21.15.114:0/1232362902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 0x7fa29c0ce4e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 -- 172.21.15.114:0/1232362902 >> 172.21.15.114:0/1232362902 conn(0x7fa29c0d1da0 msgr2=0x7fa29c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 -- 172.21.15.114:0/1232362902 shutdown_connections 2024-09-16T07:29:27.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 -- 172.21.15.114:0/1232362902 wait complete. 2024-09-16T07:29:27.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 Processor -- start 2024-09-16T07:29:27.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.988+0000 7fa2a2200640 1 -- start start 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa29c0cd8c0 0x7fa29c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa29c0d28c0 0x7fa29c163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 0x7fa29c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c168c60 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c0b66f0 con 0x7fa29c15be80 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa29c168de0 con 0x7fa29c0d28c0 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa29c0cd8c0 0x7fa29c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa29c0cd8c0 0x7fa29c0cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48260/0 (socket says 172.21.15.114:48260) 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 -- 172.21.15.114:0/2920792926 learned_addr learned my addr 172.21.15.114:0/2920792926 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29be00640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 0x7fa29c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29aa00640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa29c0d28c0 0x7fa29c163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 -- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa29c0d28c0 msgr2=0x7fa29c163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa29c0d28c0 0x7fa29c163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 -- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 msgr2=0x7fa29c15ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 0x7fa29c15ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 -- 172.21.15.114:0/2920792926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c15e0f0 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29be00640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 0x7fa29c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa29b400640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa29c0cd8c0 0x7fa29c0cb3b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009790 tx=0x7fa28c0a64f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa293400640 1 -- 172.21.15.114:0/2920792926 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0a66e0 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa293400640 1 -- 172.21.15.114:0/2920792926 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa28c004130 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa293400640 1 -- 172.21.15.114:0/2920792926 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c003600 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29c164660 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29c15eb90 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa29c0b53f0 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.992+0000 7fa293400640 1 -- 172.21.15.114:0/2920792926 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fa28c0c1020 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.996+0000 7fa293400640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa27c073240 0x7fa27c075700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:27.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.996+0000 7fa293400640 1 -- 172.21.15.114:0/2920792926 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa28c12ecb0 con 0x7fa29c0cd8c0 2024-09-16T07:29:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.996+0000 7fa29aa00640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa27c073240 0x7fa27c075700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:27.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:27.996+0000 7fa29aa00640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa27c073240 0x7fa27c075700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa29c14f970 tx=0x7fa288009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:28.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.000+0000 7fa293400640 1 -- 172.21.15.114:0/2920792926 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa28c0c8020 con 0x7fa29c0cd8c0 2024-09-16T07:29:28.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa29c1597c0 con 0x7fa29c0cd8c0 2024-09-16T07:29:28.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa293400640 1 -- 172.21.15.114:0/2920792926 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16777 (secure 0 0 0) 0x7fa28c016410 con 0x7fa29c0cd8c0 2024-09-16T07:29:28.172 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:28.172 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":33,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:06.683600+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:03.209188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:04.021718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa27c073240 msgr2=0x7fa27c075700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa27c073240 0x7fa27c075700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa29c14f970 tx=0x7fa288009040 comp rx=0 tx=0).stop 2024-09-16T07:29:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa29c0cd8c0 msgr2=0x7fa29c0cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa29c0cd8c0 0x7fa29c0cb3b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009790 tx=0x7fa28c0a64f0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 shutdown_connections 2024-09-16T07:29:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa27c073240 0x7fa27c075700 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa29c15be80 0x7fa29c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa29c0d28c0 0x7fa29c163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 --2- 172.21.15.114:0/2920792926 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa29c0cd8c0 0x7fa29c0cb3b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 >> 172.21.15.114:0/2920792926 conn(0x7fa29c0d1da0 msgr2=0x7fa29c15ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:28.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 shutdown_connections 2024-09-16T07:29:28.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.168+0000 7fa2a2200640 1 -- 172.21.15.114:0/2920792926 wait complete. 2024-09-16T07:29:28.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:29:28.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.332+0000 7fbfcb200640 1 -- 172.21.15.114:0/1147917102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb0003a40 msgr2=0x7fbfb0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.332+0000 7fbfcb200640 1 --2- 172.21.15.114:0/1147917102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfb0003a40 0x7fbfb0003e60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0016f0 tx=0x7fbfbc01c7b0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.332+0000 7fbfca800640 1 -- 172.21.15.114:0/1147917102 reap_dead start 2024-09-16T07:29:28.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.332+0000 7fbfcb200640 1 -- 172.21.15.114:0/1147917102 shutdown_connections 2024-09-16T07:29:28.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.332+0000 7fbfcb200640 1 -- 172.21.15.114:0/1147917102 >> 172.21.15.114:0/1147917102 conn(0x7fbfcc073490 msgr2=0x7fbfcc0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:28.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.332+0000 7fbfcb200640 1 -- 172.21.15.114:0/1147917102 shutdown_connections 2024-09-16T07:29:28.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.332+0000 7fbfcb200640 1 -- 172.21.15.114:0/1147917102 wait complete. 2024-09-16T07:29:28.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 Processor -- start 2024-09-16T07:29:28.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 -- start start 2024-09-16T07:29:28.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfb0003a40 0x7fbfcc15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfcc0b1970 0x7fbfcc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfcc161f30 0x7fbfcc1623e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc167a90 con 0x7fbfcc161f30 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc167910 con 0x7fbfb0003a40 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbfcc167c10 con 0x7fbfcc0b1970 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfcc161f30 0x7fbfcc1623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfcc161f30 0x7fbfcc1623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48284/0 (socket says 172.21.15.114:48284) 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 -- 172.21.15.114:0/3050847494 learned_addr learned my addr 172.21.15.114:0/3050847494 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfc9e00640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfb0003a40 0x7fbfcc15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfc9400640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfcc0b1970 0x7fbfcc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 -- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfcc0b1970 msgr2=0x7fbfcc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfcc0b1970 0x7fbfcc0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 -- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfb0003a40 msgr2=0x7fbfcc15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfb0003a40 0x7fbfcc15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 -- 172.21.15.114:0/3050847494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc162cf0 con 0x7fbfcc161f30 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfc9e00640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfb0003a40 0x7fbfcc15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfca800640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfcc161f30 0x7fbfcc1623e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ccca0 tx=0x7fbfc400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfc2000640 1 -- 172.21.15.114:0/3050847494 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4004b30 con 0x7fbfcc161f30 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfc2000640 1 -- 172.21.15.114:0/3050847494 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfc4004cd0 con 0x7fbfcc161f30 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfc2000640 1 -- 172.21.15.114:0/3050847494 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4003be0 con 0x7fbfcc161f30 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc162fd0 con 0x7fbfcc161f30 2024-09-16T07:29:28.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.336+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc163590 con 0x7fbfcc161f30 2024-09-16T07:29:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.340+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfcc0cd0b0 con 0x7fbfcc161f30 2024-09-16T07:29:28.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.340+0000 7fbfc2000640 1 -- 172.21.15.114:0/3050847494 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fbfc4004030 con 0x7fbfcc161f30 2024-09-16T07:29:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.340+0000 7fbfc2000640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfac073070 0x7fbfac075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.340+0000 7fbfc2000640 1 -- 172.21.15.114:0/3050847494 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbfc4094a10 con 0x7fbfcc161f30 2024-09-16T07:29:28.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.340+0000 7fbfc9e00640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfac073070 0x7fbfac075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.344+0000 7fbfc9e00640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfac073070 0x7fbfac075530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ac000 tx=0x7fbfbc0a8040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:28.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.344+0000 7fbfc2000640 1 -- 172.21.15.114:0/3050847494 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbfc405f960 con 0x7fbfcc161f30 2024-09-16T07:29:28.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.548+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbfcc068fd0 con 0x7fbfcc161f30 2024-09-16T07:29:28.551 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:29:28.548+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:29:28.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.548+0000 7fbfc2000640 1 -- 172.21.15.114:0/3050847494 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fbfc405f260 con 0x7fbfcc161f30 2024-09-16T07:29:28.553 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:29:28.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfac073070 msgr2=0x7fbfac075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfac073070 0x7fbfac075530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ac000 tx=0x7fbfbc0a8040 comp rx=0 tx=0).stop 2024-09-16T07:29:28.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfcc161f30 msgr2=0x7fbfcc1623e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfcc161f30 0x7fbfcc1623e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ccca0 tx=0x7fbfc400f3c0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 shutdown_connections 2024-09-16T07:29:28.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbfac073070 0x7fbfac075530 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfcc161f30 0x7fbfcc1623e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfcc0b1970 0x7fbfcc0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 --2- 172.21.15.114:0/3050847494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfb0003a40 0x7fbfcc15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 >> 172.21.15.114:0/3050847494 conn(0x7fbfcc073490 msgr2=0x7fbfcc0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:28.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 shutdown_connections 2024-09-16T07:29:28.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.552+0000 7fbfcb200640 1 -- 172.21.15.114:0/3050847494 wait complete. 2024-09-16T07:29:28.578 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:29:28.622 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:29:28.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 -- 172.21.15.114:0/4268256669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d29b0 msgr2=0x7f62700b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 --2- 172.21.15.114:0/4268256669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d29b0 0x7f62700b1cf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f625c009900 tx=0x7f625c01f0d0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 -- 172.21.15.114:0/4268256669 shutdown_connections 2024-09-16T07:29:28.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 --2- 172.21.15.114:0/4268256669 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62700d04d0 0x7f62700af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 --2- 172.21.15.114:0/4268256669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d29b0 0x7f62700b1cf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 -- 172.21.15.114:0/4268256669 >> 172.21.15.114:0/4268256669 conn(0x7f62700d1e90 msgr2=0x7f62700d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:28.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 -- 172.21.15.114:0/4268256669 shutdown_connections 2024-09-16T07:29:28.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.724+0000 7f6275600640 1 -- 172.21.15.114:0/4268256669 wait complete. 2024-09-16T07:29:28.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 Processor -- start 2024-09-16T07:29:28.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 -- start start 2024-09-16T07:29:28.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62700d00f0 0x7f62700c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d04d0 0x7f62700cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62700d29b0 0x7f62700ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f62700b0ed0 con 0x7f62700d04d0 2024-09-16T07:29:28.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f62700b0d50 con 0x7f62700d00f0 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f62700af740 con 0x7f62700d29b0 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d04d0 0x7f62700cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62700d29b0 0x7f62700ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d04d0 0x7f62700cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48298/0 (socket says 172.21.15.114:48298) 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 -- 172.21.15.114:0/2795179827 learned_addr learned my addr 172.21.15.114:0/2795179827 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626ea00640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62700d00f0 0x7f62700c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 -- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62700d29b0 msgr2=0x7f62700ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62700d29b0 0x7f62700ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 -- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62700d00f0 msgr2=0x7f62700c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62700d00f0 0x7f62700c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 -- 172.21.15.114:0/2795179827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62700ce8e0 con 0x7f62700d04d0 2024-09-16T07:29:28.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f626e000640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d04d0 0x7f62700cc6c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b3040 tx=0x7f625c005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:28.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6266a00640 1 -- 172.21.15.114:0/2795179827 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c0b5040 con 0x7f62700d04d0 2024-09-16T07:29:28.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6266a00640 1 -- 172.21.15.114:0/2795179827 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f625c0b08e0 con 0x7f62700d04d0 2024-09-16T07:29:28.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62700b7a00 con 0x7f62700d04d0 2024-09-16T07:29:28.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6266a00640 1 -- 172.21.15.114:0/2795179827 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c0b0cf0 con 0x7f62700d04d0 2024-09-16T07:29:28.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.728+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62700cee60 con 0x7f62700d04d0 2024-09-16T07:29:28.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.732+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62700af200 con 0x7f62700d04d0 2024-09-16T07:29:28.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.732+0000 7f6266a00640 1 -- 172.21.15.114:0/2795179827 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f625c0c0060 con 0x7f62700d04d0 2024-09-16T07:29:28.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.732+0000 7f6266a00640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6250073070 0x7f6250075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:28.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.732+0000 7f6266a00640 1 -- 172.21.15.114:0/2795179827 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f625c130d10 con 0x7f62700d04d0 2024-09-16T07:29:28.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.732+0000 7f626ea00640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6250073070 0x7f6250075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:28.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.732+0000 7f626ea00640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6250073070 0x7f6250075530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6260001ee0 tx=0x7f6260009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:28.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.736+0000 7f6266a00640 1 -- 172.21.15.114:0/2795179827 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f625c136020 con 0x7f62700d04d0 2024-09-16T07:29:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:28.940+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f62700d25f0 con 0x7f62700d04d0 2024-09-16T07:29:29.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6266a00640 1 -- 172.21.15.114:0/2795179827 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f625c018c30 con 0x7f62700d04d0 2024-09-16T07:29:29.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6250073070 msgr2=0x7f6250075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6250073070 0x7f6250075530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6260001ee0 tx=0x7f6260009040 comp rx=0 tx=0).stop 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d04d0 msgr2=0x7f62700cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d04d0 0x7f62700cc6c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b3040 tx=0x7f625c005790 comp rx=0 tx=0).stop 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 shutdown_connections 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6250073070 0x7f6250075530 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f62700d29b0 0x7f62700ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62700d04d0 0x7f62700cc6c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 --2- 172.21.15.114:0/2795179827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62700d00f0 0x7f62700c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 >> 172.21.15.114:0/2795179827 conn(0x7f62700d1e90 msgr2=0x7f627006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 shutdown_connections 2024-09-16T07:29:29.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.552+0000 7f6275600640 1 -- 172.21.15.114:0/2795179827 wait complete. 2024-09-16T07:29:29.581 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 -- 172.21.15.114:0/2011809585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 msgr2=0x7f76100d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 --2- 172.21.15.114:0/2011809585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f76100d0170 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f76100746b0 tx=0x7f75fc01c600 comp rx=0 tx=0).stop 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 -- 172.21.15.114:0/2011809585 shutdown_connections 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 --2- 172.21.15.114:0/2011809585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f76100d0170 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 --2- 172.21.15.114:0/2011809585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76100d06b0 0x7f76100b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 --2- 172.21.15.114:0/2011809585 >> v2:172.21.15.149:3300/0 conn(0x7f761015f390 0x7f76100cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 -- 172.21.15.114:0/2011809585 >> 172.21.15.114:0/2011809585 conn(0x7f76100d1dc0 msgr2=0x7f76100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 -- 172.21.15.114:0/2011809585 shutdown_connections 2024-09-16T07:29:29.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 -- 172.21.15.114:0/2011809585 wait complete. 2024-09-16T07:29:29.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 Processor -- start 2024-09-16T07:29:29.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.768+0000 7f7615e00640 1 -- start start 2024-09-16T07:29:29.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76100d06b0 0x7f761014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:29.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f761014c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:29.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761015f390 0x7f76100cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:29.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76100afe20 con 0x7f76100d28e0 2024-09-16T07:29:29.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76100afca0 con 0x7f76100d06b0 2024-09-16T07:29:29.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76100affa0 con 0x7f761015f390 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f761014c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f761014c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48314/0 (socket says 172.21.15.114:48314) 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 -- 172.21.15.114:0/338809446 learned_addr learned my addr 172.21.15.114:0/338809446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760ea00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76100d06b0 0x7f761014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760f400640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761015f390 0x7f76100cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 -- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761015f390 msgr2=0x7f76100cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761015f390 0x7f76100cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 -- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76100d06b0 msgr2=0x7f761014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76100d06b0 0x7f761014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 -- 172.21.15.114:0/338809446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761014ce10 con 0x7f76100d28e0 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f760e000640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f761014c8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f75fc01acb0 tx=0x7f75fc0b0a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7607400640 1 -- 172.21.15.114:0/338809446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0b0c30 con 0x7f76100d28e0 2024-09-16T07:29:29.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7607400640 1 -- 172.21.15.114:0/338809446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75fc0b0dd0 con 0x7f76100d28e0 2024-09-16T07:29:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7607400640 1 -- 172.21.15.114:0/338809446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0042a0 con 0x7f76100d28e0 2024-09-16T07:29:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7610071860 con 0x7f76100d28e0 2024-09-16T07:29:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76100ccbd0 con 0x7f76100d28e0 2024-09-16T07:29:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76100b1350 con 0x7f76100d28e0 2024-09-16T07:29:29.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.772+0000 7f7607400640 1 -- 172.21.15.114:0/338809446 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f75fc0c0060 con 0x7f76100d28e0 2024-09-16T07:29:29.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.776+0000 7f7607400640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75f0073070 0x7f75f0075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:29.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.776+0000 7f7607400640 1 -- 172.21.15.114:0/338809446 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f75fc12db80 con 0x7f76100d28e0 2024-09-16T07:29:29.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.776+0000 7f760ea00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75f0073070 0x7f75f0075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:29.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.776+0000 7f760ea00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75f0073070 0x7f75f0075530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f76100b7590 tx=0x7f760000a250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:29.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.780+0000 7f7607400640 1 -- 172.21.15.114:0/338809446 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f75fc0ac030 con 0x7f76100d28e0 2024-09-16T07:29:29.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:29.948+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7610152f50 con 0x7f76100d28e0 2024-09-16T07:29:30.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.792+0000 7f7607400640 1 -- 172.21.15.114:0/338809446 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) ==== 181+0+0 (secure 0 0 0) 0x7f75fc0164b0 con 0x7f76100d28e0 2024-09-16T07:29:30.798 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:29:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75f0073070 msgr2=0x7f75f0075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75f0073070 0x7f75f0075530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f76100b7590 tx=0x7f760000a250 comp rx=0 tx=0).stop 2024-09-16T07:29:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 msgr2=0x7f761014c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f761014c8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f75fc01acb0 tx=0x7f75fc0b0a40 comp rx=0 tx=0).stop 2024-09-16T07:29:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 shutdown_connections 2024-09-16T07:29:30.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75f0073070 0x7f75f0075530 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f761015f390 0x7f76100cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76100d28e0 0x7f761014c8d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 --2- 172.21.15.114:0/338809446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76100d06b0 0x7f761014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 >> 172.21.15.114:0/338809446 conn(0x7f76100d1dc0 msgr2=0x7f7610153390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:30.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 shutdown_connections 2024-09-16T07:29:30.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.796+0000 7f7615e00640 1 -- 172.21.15.114:0/338809446 wait complete. 2024-09-16T07:29:30.821 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:29:30.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 -- 172.21.15.114:0/145561822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01900b3440 msgr2=0x7f0190073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 --2- 172.21.15.114:0/145561822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01900b3440 0x7f0190073120 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0188009870 tx=0x7f018801c6c0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 -- 172.21.15.114:0/145561822 shutdown_connections 2024-09-16T07:29:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 --2- 172.21.15.114:0/145561822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01900b3440 0x7f0190073120 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 --2- 172.21.15.114:0/145561822 >> v2:172.21.15.149:3300/0 conn(0x7f019015fe70 0x7f01900cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 -- 172.21.15.114:0/145561822 >> 172.21.15.114:0/145561822 conn(0x7f01900b2140 msgr2=0x7f01900b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 -- 172.21.15.114:0/145561822 shutdown_connections 2024-09-16T07:29:30.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 -- 172.21.15.114:0/145561822 wait complete. 2024-09-16T07:29:30.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 Processor -- start 2024-09-16T07:29:30.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.964+0000 7f0197a00640 1 -- start start 2024-09-16T07:29:30.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01900b3440 0x7f019015d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:30.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01901561a0 0x7f019014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f019015fe70 0x7f01901503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0190168fd0 con 0x7f01901561a0 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0190168e50 con 0x7f019015fe70 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0190169150 con 0x7f01900b3440 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01901561a0 0x7f019014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01901561a0 0x7f019014ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48342/0 (socket says 172.21.15.114:48342) 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 -- 172.21.15.114:0/2055962433 learned_addr learned my addr 172.21.15.114:0/2055962433 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0195000640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01900b3440 0x7f019015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0195a00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f019015fe70 0x7f01901503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 -- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01900b3440 msgr2=0x7f019015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01900b3440 0x7f019015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 -- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f019015fe70 msgr2=0x7f01901503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:30.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f019015fe70 0x7f01901503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:30.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 -- 172.21.15.114:0/2055962433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019014f4c0 con 0x7f01901561a0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018fe00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01901561a0 0x7f019014ef80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f017c00d750 tx=0x7f017c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018cc00640 1 -- 172.21.15.114:0/2055962433 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c017070 con 0x7f01901561a0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018cc00640 1 -- 172.21.15.114:0/2055962433 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f017c0099d0 con 0x7f01901561a0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0190150900 con 0x7f01901561a0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018cc00640 1 -- 172.21.15.114:0/2055962433 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c009e00 con 0x7f01901561a0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01901652d0 con 0x7f01901561a0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0190073120 con 0x7f01901561a0 2024-09-16T07:29:30.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.968+0000 7f018cc00640 1 -- 172.21.15.114:0/2055962433 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f017c01a070 con 0x7f01901561a0 2024-09-16T07:29:30.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.972+0000 7f018cc00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f01700730a0 0x7f0170075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:30.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.972+0000 7f018cc00640 1 -- 172.21.15.114:0/2055962433 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5357+0+0 (secure 0 0 0) 0x7f017c094220 con 0x7f01901561a0 2024-09-16T07:29:30.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.972+0000 7f0195000640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f01700730a0 0x7f0170075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:30.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.972+0000 7f0195000640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f01700730a0 0x7f0170075560 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01800021a0 tx=0x7f0180009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:30.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:30.976+0000 7f018cc00640 1 -- 172.21.15.114:0/2055962433 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f017c05f1a0 con 0x7f01901561a0 2024-09-16T07:29:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.144+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f019006add0 con 0x7f01901561a0 2024-09-16T07:29:31.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.800+0000 7f018cc00640 1 -- 172.21.15.114:0/2055962433 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) ==== 169+0+0 (secure 0 0 0) 0x7f017c05eaa0 con 0x7f01901561a0 2024-09-16T07:29:31.804 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:29:31.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f01700730a0 msgr2=0x7f0170075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:31.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f01700730a0 0x7f0170075560 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f01800021a0 tx=0x7f0180009040 comp rx=0 tx=0).stop 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01901561a0 msgr2=0x7f019014ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01901561a0 0x7f019014ef80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f017c00d750 tx=0x7f017c00dc10 comp rx=0 tx=0).stop 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 shutdown_connections 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f01700730a0 0x7f0170075560 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f019015fe70 0x7f01901503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01901561a0 0x7f019014ef80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 --2- 172.21.15.114:0/2055962433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01900b3440 0x7f019015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 >> 172.21.15.114:0/2055962433 conn(0x7f01900b2140 msgr2=0x7f019015b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 shutdown_connections 2024-09-16T07:29:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.804+0000 7f0197a00640 1 -- 172.21.15.114:0/2055962433 wait complete. 2024-09-16T07:29:31.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:29:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- 172.21.15.114:0/3160373381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8340b2e80 msgr2=0x7ff8340b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 --2- 172.21.15.114:0/3160373381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8340b2e80 0x7ff8340b1bd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009840 tx=0x7ff81c01c760 comp rx=0 tx=0).stop 2024-09-16T07:29:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- 172.21.15.114:0/3160373381 shutdown_connections 2024-09-16T07:29:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 --2- 172.21.15.114:0/3160373381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8340afca0 0x7ff8340b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 --2- 172.21.15.114:0/3160373381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8340b2e80 0x7ff8340b1bd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- 172.21.15.114:0/3160373381 >> 172.21.15.114:0/3160373381 conn(0x7ff8340d1e30 msgr2=0x7ff8340d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- 172.21.15.114:0/3160373381 shutdown_connections 2024-09-16T07:29:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- 172.21.15.114:0/3160373381 wait complete. 2024-09-16T07:29:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 Processor -- start 2024-09-16T07:29:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- start start 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8340afca0 0x7ff83415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8340b2e80 0x7ff8340b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff83415f490 0x7ff83414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff834168c80 con 0x7ff8340afca0 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff8340b2320 con 0x7ff83415f490 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff83a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff834168e00 con 0x7ff8340b2e80 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff833400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8340afca0 0x7ff83415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff833400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8340afca0 0x7ff83415b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48356/0 (socket says 172.21.15.114:48356) 2024-09-16T07:29:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff833400640 1 -- 172.21.15.114:0/1112126489 learned_addr learned my addr 172.21.15.114:0/1112126489 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff833e00640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff83415f490 0x7ff83414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.976+0000 7ff82aa00640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8340b2e80 0x7ff8340b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff833400640 1 -- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8340b2e80 msgr2=0x7ff8340b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff833400640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8340b2e80 0x7ff8340b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff833400640 1 -- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff83415f490 msgr2=0x7ff83414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff833400640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff83415f490 0x7ff83414f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff833400640 1 -- 172.21.15.114:0/1112126489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8340b75a0 con 0x7ff8340afca0 2024-09-16T07:29:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff833e00640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff83415f490 0x7ff83414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:29:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff833400640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8340afca0 0x7ff83415b1c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c3f0 tx=0x7ff82400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff82be00640 1 -- 172.21.15.114:0/1112126489 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824017070 con 0x7ff8340afca0 2024-09-16T07:29:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff82be00640 1 -- 172.21.15.114:0/1112126489 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8240053c0 con 0x7ff8340afca0 2024-09-16T07:29:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff82be00640 1 -- 172.21.15.114:0/1112126489 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff824003860 con 0x7ff8340afca0 2024-09-16T07:29:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8340b7b00 con 0x7ff8340afca0 2024-09-16T07:29:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83406ddd0 con 0x7ff8340afca0 2024-09-16T07:29:31.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8340b0110 con 0x7ff8340afca0 2024-09-16T07:29:31.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.980+0000 7ff82be00640 1 -- 172.21.15.114:0/1112126489 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7ff82401a070 con 0x7ff8340afca0 2024-09-16T07:29:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.984+0000 7ff82be00640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff810073070 0x7ff810075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.984+0000 7ff82be00640 1 -- 172.21.15.114:0/1112126489 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7ff8240931a0 con 0x7ff8340afca0 2024-09-16T07:29:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.984+0000 7ff82aa00640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff810073070 0x7ff810075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:31.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.984+0000 7ff82aa00640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff810073070 0x7ff810075530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0af000 tx=0x7ff81c01afa0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:31.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:31.988+0000 7ff82be00640 1 -- 172.21.15.114:0/1112126489 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff8340b75a0 con 0x7ff8340afca0 2024-09-16T07:29:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.164+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7ff834159600 con 0x7ff8340afca0 2024-09-16T07:29:32.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.172+0000 7ff82be00640 1 -- 172.21.15.114:0/1112126489 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7ff82405ddb0 con 0x7ff8340afca0 2024-09-16T07:29:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff810073070 msgr2=0x7ff810075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff810073070 0x7ff810075530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0af000 tx=0x7ff81c01afa0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8340afca0 msgr2=0x7ff83415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8340afca0 0x7ff83415b1c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff82400c3f0 tx=0x7ff82400c8b0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 shutdown_connections 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff810073070 0x7ff810075530 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff83415f490 0x7ff83414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8340b2e80 0x7ff8340b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 --2- 172.21.15.114:0/1112126489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8340afca0 0x7ff83415b1c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 >> 172.21.15.114:0/1112126489 conn(0x7ff8340d1e30 msgr2=0x7ff83415c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 shutdown_connections 2024-09-16T07:29:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.176+0000 7ff83a800640 1 -- 172.21.15.114:0/1112126489 wait complete. 2024-09-16T07:29:32.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-16T07:29:32.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.336+0000 7f85f4800640 1 -- 172.21.15.114:0/39549347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85d4004d50 msgr2=0x7f85d40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 --2- 172.21.15.114:0/39549347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85d4004d50 0x7f85d40051d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009ee0 tx=0x7f85e801d5f0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 -- 172.21.15.114:0/39549347 reap_dead start 2024-09-16T07:29:32.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- 172.21.15.114:0/39549347 shutdown_connections 2024-09-16T07:29:32.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- 172.21.15.114:0/39549347 >> 172.21.15.114:0/39549347 conn(0x7f85ec0d1dc0 msgr2=0x7f85ec0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:32.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- 172.21.15.114:0/39549347 shutdown_connections 2024-09-16T07:29:32.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- 172.21.15.114:0/39549347 wait complete. 2024-09-16T07:29:32.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 Processor -- start 2024-09-16T07:29:32.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- start start 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85d4004d50 0x7f85ec0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ec1f8640 0x7f85ec0c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85ec15aee0 0x7f85ec15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec15c450 con 0x7f85ec15aee0 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec0d2af0 con 0x7f85ec1f8640 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f4800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec0af0c0 con 0x7f85d4004d50 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85ec15aee0 0x7f85ec15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85ec15aee0 0x7f85ec15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48370/0 (socket says 172.21.15.114:48370) 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 -- 172.21.15.114:0/3374400178 learned_addr learned my addr 172.21.15.114:0/3374400178 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f1e00640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85d4004d50 0x7f85ec0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f1400640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ec1f8640 0x7f85ec0c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 -- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85d4004d50 msgr2=0x7f85ec0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85d4004d50 0x7f85ec0b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 -- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ec1f8640 msgr2=0x7f85ec0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ec1f8640 0x7f85ec0c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 -- 172.21.15.114:0/3374400178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec1f4740 con 0x7f85ec15aee0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.340+0000 7f85f2800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85ec15aee0 0x7f85ec15b370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f85e801d060 tx=0x7f85e8004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85e6000640 1 -- 172.21.15.114:0/3374400178 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e80ad050 con 0x7f85ec15aee0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85e6000640 1 -- 172.21.15.114:0/3374400178 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e80a7a90 con 0x7f85ec15aee0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec1f4a20 con 0x7f85ec15aee0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85e6000640 1 -- 172.21.15.114:0/3374400178 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e80a7ea0 con 0x7f85ec15aee0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec1f4fe0 con 0x7f85ec15aee0 2024-09-16T07:29:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ec0cfcf0 con 0x7f85ec15aee0 2024-09-16T07:29:32.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85e6000640 1 -- 172.21.15.114:0/3374400178 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f85e80b0070 con 0x7f85ec15aee0 2024-09-16T07:29:32.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.344+0000 7f85e6000640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85d0073070 0x7f85d0075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.348+0000 7f85e6000640 1 -- 172.21.15.114:0/3374400178 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f85e812efd0 con 0x7f85ec15aee0 2024-09-16T07:29:32.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.348+0000 7f85f1e00640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85d0073070 0x7f85d0075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.348+0000 7f85f1e00640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85d0073070 0x7f85d0075530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0aeb00 tx=0x7f85e00067b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:32.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.352+0000 7f85e6000640 1 -- 172.21.15.114:0/3374400178 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f85e8017300 con 0x7f85ec15aee0 2024-09-16T07:29:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.576+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f85ec15b8b0 con 0x7f85ec15aee0 2024-09-16T07:29:32.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.800+0000 7f85e6000640 1 -- 172.21.15.114:0/3374400178 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v92) ==== 158+0+0 (secure 0 0 0) 0x7f85e80fa180 con 0x7f85ec15aee0 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85d0073070 msgr2=0x7f85d0075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85d0073070 0x7f85d0075530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0aeb00 tx=0x7f85e00067b0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85ec15aee0 msgr2=0x7f85ec15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85ec15aee0 0x7f85ec15b370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f85e801d060 tx=0x7f85e8004f10 comp rx=0 tx=0).stop 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 shutdown_connections 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f85d0073070 0x7f85d0075530 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85ec15aee0 0x7f85ec15b370 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ec1f8640 0x7f85ec0c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 --2- 172.21.15.114:0/3374400178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85d4004d50 0x7f85ec0b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 >> 172.21.15.114:0/3374400178 conn(0x7f85ec0d1dc0 msgr2=0x7f85ec0af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 shutdown_connections 2024-09-16T07:29:32.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.804+0000 7f85f4800640 1 -- 172.21.15.114:0/3374400178 wait complete. 2024-09-16T07:29:32.828 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2024-09-16T07:29:32.828 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:29:32.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:32.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.964+0000 7f756c400640 1 -- 172.21.15.114:0/3662214413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756415ade0 msgr2=0x7f75640cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.964+0000 7f756c400640 1 --2- 172.21.15.114:0/3662214413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756415ade0 0x7f75640cebf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7558009840 tx=0x7f755801c820 comp rx=0 tx=0).stop 2024-09-16T07:29:32.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- 172.21.15.114:0/3662214413 shutdown_connections 2024-09-16T07:29:32.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 --2- 172.21.15.114:0/3662214413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756415ade0 0x7f75640cebf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- 172.21.15.114:0/3662214413 >> 172.21.15.114:0/3662214413 conn(0x7f75640b18f0 msgr2=0x7f75640b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- 172.21.15.114:0/3662214413 shutdown_connections 2024-09-16T07:29:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- 172.21.15.114:0/3662214413 wait complete. 2024-09-16T07:29:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 Processor -- start 2024-09-16T07:29:32.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- start start 2024-09-16T07:29:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756406e810 0x7f7564156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75640b4bd0 0x7f756414b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f756415ade0 0x7f7564158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7564169850 con 0x7f756406e810 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f75641696d0 con 0x7f75640b4bd0 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f75641699d0 con 0x7f756415ade0 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756406e810 0x7f7564156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756406e810 0x7f7564156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48388/0 (socket says 172.21.15.114:48388) 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 -- 172.21.15.114:0/2513631624 learned_addr learned my addr 172.21.15.114:0/2513631624 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569000640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75640b4bd0 0x7f756414b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756a400640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f756415ade0 0x7f7564158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 -- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f756415ade0 msgr2=0x7f7564158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f756415ade0 0x7f7564158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 -- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75640b4bd0 msgr2=0x7f756414b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75640b4bd0 0x7f756414b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 -- 172.21.15.114:0/2513631624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75641f9080 con 0x7f756406e810 2024-09-16T07:29:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7569a00640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756406e810 0x7f7564156c30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7558009790 tx=0x7f75580a8580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7561600640 1 -- 172.21.15.114:0/2513631624 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580a8a80 con 0x7f756406e810 2024-09-16T07:29:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7561600640 1 -- 172.21.15.114:0/2513631624 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75580a8c20 con 0x7f756406e810 2024-09-16T07:29:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641f9360 con 0x7f756406e810 2024-09-16T07:29:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.968+0000 7f7561600640 1 -- 172.21.15.114:0/2513631624 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558005030 con 0x7f756406e810 2024-09-16T07:29:32.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.972+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75641f9920 con 0x7f756406e810 2024-09-16T07:29:32.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.972+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7564069410 con 0x7f756406e810 2024-09-16T07:29:32.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.972+0000 7f7561600640 1 -- 172.21.15.114:0/2513631624 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f75580b8030 con 0x7f756406e810 2024-09-16T07:29:32.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.972+0000 7f7561600640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7544073070 0x7f7544075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.972+0000 7f7561600640 1 -- 172.21.15.114:0/2513631624 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f755812dcf0 con 0x7f756406e810 2024-09-16T07:29:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.972+0000 7f7569000640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7544073070 0x7f7544075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.976+0000 7f7569000640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7544073070 0x7f7544075530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7564156740 tx=0x7f7550009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:32.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:32.976+0000 7f7561600640 1 -- 172.21.15.114:0/2513631624 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f75580ac030 con 0x7f756406e810 2024-09-16T07:29:33.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.144+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75640cebf0 con 0x7f756406e810 2024-09-16T07:29:33.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.144+0000 7f7561600640 1 -- 172.21.15.114:0/2513631624 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13080 (secure 0 0 0) 0x7f7558016410 con 0x7f756406e810 2024-09-16T07:29:33.149 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:33.149 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:31.800402+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/319033864":"2024-09-17T07:29:28.552888+0000","172.21.15.114:6833/319033864":"2024-09-17T07:29:28.552888+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:33.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7544073070 msgr2=0x7f7544075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7544073070 0x7f7544075530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7564156740 tx=0x7f7550009040 comp rx=0 tx=0).stop 2024-09-16T07:29:33.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756406e810 msgr2=0x7f7564156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756406e810 0x7f7564156c30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7558009790 tx=0x7f75580a8580 comp rx=0 tx=0).stop 2024-09-16T07:29:33.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 shutdown_connections 2024-09-16T07:29:33.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7544073070 0x7f7544075530 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f756415ade0 0x7f7564158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75640b4bd0 0x7f756414b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 --2- 172.21.15.114:0/2513631624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f756406e810 0x7f7564156c30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 >> 172.21.15.114:0/2513631624 conn(0x7f75640b18f0 msgr2=0x7f7564154600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:33.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 shutdown_connections 2024-09-16T07:29:33.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.148+0000 7f756c400640 1 -- 172.21.15.114:0/2513631624 wait complete. 2024-09-16T07:29:33.170 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:29:33.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:29:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- 172.21.15.114:0/2470050932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf0004810 msgr2=0x7fcaf0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 --2- 172.21.15.114:0/2470050932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf0004810 0x7fcaf0004c90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40016c0 tx=0x7fcaf401c730 comp rx=0 tx=0).stop 2024-09-16T07:29:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- 172.21.15.114:0/2470050932 shutdown_connections 2024-09-16T07:29:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 --2- 172.21.15.114:0/2470050932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf0004810 0x7fcaf0004c90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- 172.21.15.114:0/2470050932 >> 172.21.15.114:0/2470050932 conn(0x7fcb0c0d1dc0 msgr2=0x7fcb0c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- 172.21.15.114:0/2470050932 shutdown_connections 2024-09-16T07:29:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- 172.21.15.114:0/2470050932 wait complete. 2024-09-16T07:29:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 Processor -- start 2024-09-16T07:29:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- start start 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaf0004810 0x7fcb0c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0c155470 0x7fcb0c15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15e310 0x7fcb0c0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c15ffb0 con 0x7fcb0c15e310 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c15fe30 con 0x7fcb0c155470 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb12a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcb0c160130 con 0x7fcaf0004810 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15e310 0x7fcb0c0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15e310 0x7fcb0c0b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48396/0 (socket says 172.21.15.114:48396) 2024-09-16T07:29:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 -- 172.21.15.114:0/737809 learned_addr learned my addr 172.21.15.114:0/737809 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb0be00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaf0004810 0x7fcb0c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb03400640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0c155470 0x7fcb0c15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 -- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaf0004810 msgr2=0x7fcb0c0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaf0004810 0x7fcb0c0b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 -- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0c155470 msgr2=0x7fcb0c15ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0c155470 0x7fcb0c15ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 -- 172.21.15.114:0/737809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c0c5f40 con 0x7fcb0c15e310 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.312+0000 7fcb10a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15e310 0x7fcb0c0b5c40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcb04000c10 tx=0x7fcb0400e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb08c00640 1 -- 172.21.15.114:0/737809 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04011870 con 0x7fcb0c15e310 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb08c00640 1 -- 172.21.15.114:0/737809 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb04017070 con 0x7fcb0c15e310 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb08c00640 1 -- 172.21.15.114:0/737809 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04011da0 con 0x7fcb0c15e310 2024-09-16T07:29:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0c0c6220 con 0x7fcb0c15e310 2024-09-16T07:29:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0c15efb0 con 0x7fcb0c15e310 2024-09-16T07:29:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb0c15f2e0 con 0x7fcb0c15e310 2024-09-16T07:29:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb08c00640 1 -- 172.21.15.114:0/737809 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fcb0401c460 con 0x7fcb0c15e310 2024-09-16T07:29:33.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.316+0000 7fcb08c00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcae8073070 0x7fcae8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.320+0000 7fcb08c00640 1 -- 172.21.15.114:0/737809 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fcb040941d0 con 0x7fcb0c15e310 2024-09-16T07:29:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.320+0000 7fcb0be00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcae8073070 0x7fcae8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.320+0000 7fcb0be00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcae8073070 0x7fcae8075530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c052940 tx=0x7fcafc009500 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:33.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.324+0000 7fcb08c00640 1 -- 172.21.15.114:0/737809 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcb0405f2f0 con 0x7fcb0c15e310 2024-09-16T07:29:33.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb0c160690 con 0x7fcb0c15e310 2024-09-16T07:29:33.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb08c00640 1 -- 172.21.15.114:0/737809 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fcb0405ebf0 con 0x7fcb0c15e310 2024-09-16T07:29:33.495 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:29:33.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcae8073070 msgr2=0x7fcae8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcae8073070 0x7fcae8075530 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c052940 tx=0x7fcafc009500 comp rx=0 tx=0).stop 2024-09-16T07:29:33.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15e310 msgr2=0x7fcb0c0b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15e310 0x7fcb0c0b5c40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcb04000c10 tx=0x7fcb0400e730 comp rx=0 tx=0).stop 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 shutdown_connections 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcae8073070 0x7fcae8075530 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15e310 0x7fcb0c0b5c40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb0c155470 0x7fcb0c15ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 --2- 172.21.15.114:0/737809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcaf0004810 0x7fcb0c0b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 >> 172.21.15.114:0/737809 conn(0x7fcb0c0d1dc0 msgr2=0x7fcb0c0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 shutdown_connections 2024-09-16T07:29:33.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.492+0000 7fcb12a00640 1 -- 172.21.15.114:0/737809 wait complete. 2024-09-16T07:29:33.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-16T07:29:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.652+0000 7f52f1200640 1 -- 172.21.15.114:0/1589237463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52d0004d50 msgr2=0x7f52d00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.652+0000 7f52f1200640 1 --2- 172.21.15.114:0/1589237463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52d0004d50 0x7f52d00051d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52e400c610 tx=0x7f52e401d340 comp rx=0 tx=0).stop 2024-09-16T07:29:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.652+0000 7f52ea800640 1 -- 172.21.15.114:0/1589237463 reap_dead start 2024-09-16T07:29:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.652+0000 7f52f1200640 1 -- 172.21.15.114:0/1589237463 shutdown_connections 2024-09-16T07:29:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.652+0000 7f52f1200640 1 -- 172.21.15.114:0/1589237463 >> 172.21.15.114:0/1589237463 conn(0x7f52ec0d1dc0 msgr2=0x7f52ec0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.652+0000 7f52f1200640 1 -- 172.21.15.114:0/1589237463 shutdown_connections 2024-09-16T07:29:33.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.652+0000 7f52f1200640 1 -- 172.21.15.114:0/1589237463 wait complete. 2024-09-16T07:29:33.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 Processor -- start 2024-09-16T07:29:33.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 -- start start 2024-09-16T07:29:33.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52d0004d50 0x7f52ec1f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ec0b4450 0x7f52ec15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52ec0ca220 0x7f52ec0ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec0cfb30 con 0x7f52ec0b4450 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec15c490 con 0x7f52ec0ca220 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f52ec0ce670 con 0x7f52d0004d50 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ec0b4450 0x7f52ec15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ec0b4450 0x7f52ec15a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48404/0 (socket says 172.21.15.114:48404) 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 -- 172.21.15.114:0/1638370983 learned_addr learned my addr 172.21.15.114:0/1638370983 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e9e00640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52d0004d50 0x7f52ec1f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52ea800640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52ec0ca220 0x7f52ec0ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 -- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52d0004d50 msgr2=0x7f52ec1f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52d0004d50 0x7f52ec1f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 -- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52ec0ca220 msgr2=0x7f52ec0ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:33.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52ec0ca220 0x7f52ec0ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 -- 172.21.15.114:0/1638370983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec0b2590 con 0x7f52ec0b4450 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52ea800640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52ec0ca220 0x7f52ec0ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e1400640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ec0b4450 0x7f52ec15a9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52d4011840 tx=0x7f52d4011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e2a00640 1 -- 172.21.15.114:0/1638370983 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d401f070 con 0x7f52ec0b4450 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e2a00640 1 -- 172.21.15.114:0/1638370983 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52d400fd50 con 0x7f52ec0b4450 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52e2a00640 1 -- 172.21.15.114:0/1638370983 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4012690 con 0x7f52ec0b4450 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec0b2870 con 0x7f52ec0b4450 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.656+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec0c8fc0 con 0x7f52ec0b4450 2024-09-16T07:29:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.660+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec0b2e90 con 0x7f52ec0b4450 2024-09-16T07:29:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.660+0000 7f52e2a00640 1 -- 172.21.15.114:0/1638370983 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f52d4022070 con 0x7f52ec0b4450 2024-09-16T07:29:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.660+0000 7f52e2a00640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f52c8073070 0x7f52c8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:33.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.660+0000 7f52e2a00640 1 -- 172.21.15.114:0/1638370983 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f52d4094860 con 0x7f52ec0b4450 2024-09-16T07:29:33.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.660+0000 7f52e9e00640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f52c8073070 0x7f52c8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:33.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.660+0000 7f52e9e00640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f52c8073070 0x7f52c8075530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009b60 tx=0x7f52dc0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:33.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.664+0000 7f52e2a00640 1 -- 172.21.15.114:0/1638370983 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f52d405f510 con 0x7f52ec0b4450 2024-09-16T07:29:33.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:33.896+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7f52ec0710e0 con 0x7f52ec0b4450 2024-09-16T07:29:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.812+0000 7f52e2a00640 1 -- 172.21.15.114:0/1638370983 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v94) ==== 143+0+0 (secure 0 0 0) 0x7f52d4063f40 con 0x7f52ec0b4450 2024-09-16T07:29:34.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f52c8073070 msgr2=0x7f52c8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:34.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f52c8073070 0x7f52c8075530 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009b60 tx=0x7f52dc0091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ec0b4450 msgr2=0x7f52ec15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:34.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ec0b4450 0x7f52ec15a9c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52d4011840 tx=0x7f52d4011d00 comp rx=0 tx=0).stop 2024-09-16T07:29:34.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 shutdown_connections 2024-09-16T07:29:34.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f52c8073070 0x7f52c8075530 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52ec0ca220 0x7f52ec0ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52ec0b4450 0x7f52ec15a9c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 --2- 172.21.15.114:0/1638370983 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52d0004d50 0x7f52ec1f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 >> 172.21.15.114:0/1638370983 conn(0x7f52ec0d1dc0 msgr2=0x7f52ec0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:34.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 shutdown_connections 2024-09-16T07:29:34.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.816+0000 7f52f1200640 1 -- 172.21.15.114:0/1638370983 wait complete. 2024-09-16T07:29:34.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:29:34.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.980+0000 7f8bcb200640 1 -- 172.21.15.114:0/3351207741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc4073d10 msgr2=0x7f8bc40cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:34.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.980+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3351207741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc4073d10 0x7f8bc40cd100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000aa10 tx=0x7f8bb001dc30 comp rx=0 tx=0).stop 2024-09-16T07:29:34.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.980+0000 7f8bcb200640 1 -- 172.21.15.114:0/3351207741 shutdown_connections 2024-09-16T07:29:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.980+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3351207741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc4073d10 0x7f8bc40cd100 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.980+0000 7f8bcb200640 1 -- 172.21.15.114:0/3351207741 >> 172.21.15.114:0/3351207741 conn(0x7f8bc40b18f0 msgr2=0x7f8bc40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.980+0000 7f8bcb200640 1 -- 172.21.15.114:0/3351207741 shutdown_connections 2024-09-16T07:29:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.980+0000 7f8bcb200640 1 -- 172.21.15.114:0/3351207741 wait complete. 2024-09-16T07:29:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 Processor -- start 2024-09-16T07:29:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 -- start start 2024-09-16T07:29:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc4073d10 0x7f8bc414d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bc40b49e0 0x7f8bc4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc415a660 0x7f8bc4155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4168530 con 0x7f8bc415a660 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41683b0 con 0x7f8bc4073d10 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc41686b0 con 0x7f8bc40b49e0 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc415a660 0x7f8bc4155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc415a660 0x7f8bc4155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58440/0 (socket says 172.21.15.114:58440) 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 -- 172.21.15.114:0/3417843079 learned_addr learned my addr 172.21.15.114:0/3417843079 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc3400640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bc40b49e0 0x7f8bc4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc3e00640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc4073d10 0x7f8bc414d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 -- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bc40b49e0 msgr2=0x7f8bc4157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bc40b49e0 0x7f8bc4157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 -- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc4073d10 msgr2=0x7f8bc414d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc4073d10 0x7f8bc414d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 -- 172.21.15.114:0/3417843079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc41f99c0 con 0x7f8bc415a660 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc3e00640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc4073d10 0x7f8bc414d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bc9200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc415a660 0x7f8bc4155d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c770 tx=0x7f8bbc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bbbe00640 1 -- 172.21.15.114:0/3417843079 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc017070 con 0x7f8bc415a660 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bbbe00640 1 -- 172.21.15.114:0/3417843079 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bbc005070 con 0x7f8bc415a660 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc41f9ca0 con 0x7f8bc415a660 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bbbe00640 1 -- 172.21.15.114:0/3417843079 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0054c0 con 0x7f8bc415a660 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.984+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc41fa260 con 0x7f8bc415a660 2024-09-16T07:29:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.988+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc4069410 con 0x7f8bc415a660 2024-09-16T07:29:34.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.988+0000 7f8bbbe00640 1 -- 172.21.15.114:0/3417843079 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f8bbc01a070 con 0x7f8bc415a660 2024-09-16T07:29:34.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.988+0000 7f8bbbe00640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ba4073070 0x7f8ba4075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:34.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.988+0000 7f8bbbe00640 1 -- 172.21.15.114:0/3417843079 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f8bbc093660 con 0x7f8bc415a660 2024-09-16T07:29:34.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.988+0000 7f8bc3e00640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ba4073070 0x7f8ba4075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:34.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.988+0000 7f8bc3e00640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ba4073070 0x7f8ba4075530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400a850 tx=0x7f8bb4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:34.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:34.992+0000 7f8bbbe00640 1 -- 172.21.15.114:0/3417843079 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8bbc05e780 con 0x7f8bc415a660 2024-09-16T07:29:35.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.160+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8bc40cd100 con 0x7f8bc415a660 2024-09-16T07:29:35.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.160+0000 7f8bbbe00640 1 -- 172.21.15.114:0/3417843079 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1998 (secure 0 0 0) 0x7f8bbc05e080 con 0x7f8bc415a660 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:29:35.166 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:29:35.167 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:29:35.168 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ba4073070 msgr2=0x7f8ba4075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ba4073070 0x7f8ba4075530 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400a850 tx=0x7f8bb4008040 comp rx=0 tx=0).stop 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc415a660 msgr2=0x7f8bc4155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc415a660 0x7f8bc4155d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c770 tx=0x7f8bbc00cc30 comp rx=0 tx=0).stop 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 shutdown_connections 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ba4073070 0x7f8ba4075530 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8bc415a660 0x7f8bc4155d90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8bc40b49e0 0x7f8bc4157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 --2- 172.21.15.114:0/3417843079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8bc4073d10 0x7f8bc414d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 >> 172.21.15.114:0/3417843079 conn(0x7f8bc40b18f0 msgr2=0x7f8bc40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 shutdown_connections 2024-09-16T07:29:35.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.164+0000 7f8bcb200640 1 -- 172.21.15.114:0/3417843079 wait complete. 2024-09-16T07:29:35.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:29:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.328+0000 7f71c3200640 1 -- 172.21.15.114:0/3106656540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 msgr2=0x7f71a00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.328+0000 7f71c3200640 1 --2- 172.21.15.114:0/3106656540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 0x7f71a00051d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009b60 tx=0x7f71b401d2b0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.328+0000 7f71c1200640 1 -- 172.21.15.114:0/3106656540 reap_dead start 2024-09-16T07:29:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.328+0000 7f71c3200640 1 -- 172.21.15.114:0/3106656540 shutdown_connections 2024-09-16T07:29:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.328+0000 7f71c3200640 1 -- 172.21.15.114:0/3106656540 >> 172.21.15.114:0/3106656540 conn(0x7f71bc0b18f0 msgr2=0x7f71bc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.328+0000 7f71c3200640 1 -- 172.21.15.114:0/3106656540 shutdown_connections 2024-09-16T07:29:35.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.328+0000 7f71c3200640 1 -- 172.21.15.114:0/3106656540 wait complete. 2024-09-16T07:29:35.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 Processor -- start 2024-09-16T07:29:35.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 -- start start 2024-09-16T07:29:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 0x7f71bc14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71bc0c9a80 0x7f71bc0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71bc0cab20 0x7f71bc0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc0cf490 con 0x7f71a0004d50 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc0cf310 con 0x7f71bc0cab20 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71bc166120 con 0x7f71bc0c9a80 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 0x7f71bc14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 0x7f71bc14d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58468/0 (socket says 172.21.15.114:58468) 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 -- 172.21.15.114:0/1168979698 learned_addr learned my addr 172.21.15.114:0/1168979698 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c1200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71bc0cab20 0x7f71bc0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bb400640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71bc0c9a80 0x7f71bc0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 -- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71bc0c9a80 msgr2=0x7f71bc0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71bc0c9a80 0x7f71bc0c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 -- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71bc0cab20 msgr2=0x7f71bc0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71bc0cab20 0x7f71bc0cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 -- 172.21.15.114:0/1168979698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc0aeef0 con 0x7f71a0004d50 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bb400640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71bc0c9a80 0x7f71bc0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c1200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71bc0cab20 0x7f71bc0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71bbe00640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 0x7f71bc14d6c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f71ac006330 tx=0x7f71ac0067f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71b3e00640 1 -- 172.21.15.114:0/1168979698 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00fb40 con 0x7f71a0004d50 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71b3e00640 1 -- 172.21.15.114:0/1168979698 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71ac016020 con 0x7f71a0004d50 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71b3e00640 1 -- 172.21.15.114:0/1168979698 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac011430 con 0x7f71a0004d50 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc0b0a70 con 0x7f71a0004d50 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc0b1030 con 0x7f71a0004d50 2024-09-16T07:29:35.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.332+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71bc069410 con 0x7f71a0004d50 2024-09-16T07:29:35.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.336+0000 7f71b3e00640 1 -- 172.21.15.114:0/1168979698 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f71ac0115d0 con 0x7f71a0004d50 2024-09-16T07:29:35.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.336+0000 7f71b3e00640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f719c073070 0x7f719c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.336+0000 7f71b3e00640 1 -- 172.21.15.114:0/1168979698 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7f71ac094b50 con 0x7f71a0004d50 2024-09-16T07:29:35.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.336+0000 7f71bb400640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f719c073070 0x7f719c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.336+0000 7f71bb400640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f719c073070 0x7f719c075530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0cc5c0 tx=0x7f71a80091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:35.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.340+0000 7f71b3e00640 1 -- 172.21.15.114:0/1168979698 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f71ac020030 con 0x7f71a0004d50 2024-09-16T07:29:35.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.508+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f71bc0b42d0 con 0x7f71a0004d50 2024-09-16T07:29:35.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71b3e00640 1 -- 172.21.15.114:0/1168979698 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f71ac05fc70 con 0x7f71a0004d50 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f719c073070 msgr2=0x7f719c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f719c073070 0x7f719c075530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0cc5c0 tx=0x7f71a80091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 msgr2=0x7f71bc14d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 0x7f71bc14d6c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f71ac006330 tx=0x7f71ac0067f0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 shutdown_connections 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f719c073070 0x7f719c075530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71bc0cab20 0x7f71bc0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71bc0c9a80 0x7f71bc0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 --2- 172.21.15.114:0/1168979698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71a0004d50 0x7f71bc14d6c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 >> 172.21.15.114:0/1168979698 conn(0x7f71bc0b18f0 msgr2=0x7f71bc073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:35.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 shutdown_connections 2024-09-16T07:29:35.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.512+0000 7f71c3200640 1 -- 172.21.15.114:0/1168979698 wait complete. 2024-09-16T07:29:35.536 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:29:35.536 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:29:35.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:29:35.690 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:29:35.691 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:35.691 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:35.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:29:35.700 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:35.700 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:35.709 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:29:35.709 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:35.709 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:35.749 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:29:35.749 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:35.750 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:35.760 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:29:35.760 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:29:35.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 -- 172.21.15.114:0/4201108050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 msgr2=0x7fd19806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 --2- 172.21.15.114:0/4201108050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 0x7fd19806e7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd180009840 tx=0x7fd18001c7f0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 -- 172.21.15.114:0/4201108050 shutdown_connections 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 --2- 172.21.15.114:0/4201108050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 0x7fd19806e7a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 --2- 172.21.15.114:0/4201108050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1980b43d0 0x7fd1980b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 -- 172.21.15.114:0/4201108050 >> 172.21.15.114:0/4201108050 conn(0x7fd1980b18f0 msgr2=0x7fd1980b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 -- 172.21.15.114:0/4201108050 shutdown_connections 2024-09-16T07:29:35.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.936+0000 7fd19fa00640 1 -- 172.21.15.114:0/4201108050 wait complete. 2024-09-16T07:29:35.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 Processor -- start 2024-09-16T07:29:35.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 -- start start 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1980b2bf0 0x7fd1981596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1980b43d0 0x7fd19809b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 0x7fd19815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd198167440 con 0x7fd1980b2bf0 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1981672c0 con 0x7fd1980cd100 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd1981675c0 con 0x7fd1980b43d0 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1980b2bf0 0x7fd1981596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1980b2bf0 0x7fd1981596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58480/0 (socket says 172.21.15.114:58480) 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 -- 172.21.15.114:0/3070003532 learned_addr learned my addr 172.21.15.114:0/3070003532 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd18fe00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1980b43d0 0x7fd19809b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19da00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 0x7fd19815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 -- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1980b43d0 msgr2=0x7fd19809b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1980b43d0 0x7fd19809b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 -- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 msgr2=0x7fd19815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 0x7fd19815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 -- 172.21.15.114:0/3070003532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1980ad8a0 con 0x7fd1980b2bf0 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19da00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 0x7fd19815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19d000640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1980b2bf0 0x7fd1981596f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd18800eb50 tx=0x7fd18800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd195600640 1 -- 172.21.15.114:0/3070003532 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188004220 con 0x7fd1980b2bf0 2024-09-16T07:29:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd195600640 1 -- 172.21.15.114:0/3070003532 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1880043c0 con 0x7fd1980b2bf0 2024-09-16T07:29:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1980aec40 con 0x7fd1980b2bf0 2024-09-16T07:29:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd195600640 1 -- 172.21.15.114:0/3070003532 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188003860 con 0x7fd1980b2bf0 2024-09-16T07:29:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1980adb10 con 0x7fd1980b2bf0 2024-09-16T07:29:35.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.940+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd198069410 con 0x7fd1980b2bf0 2024-09-16T07:29:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.944+0000 7fd195600640 1 -- 172.21.15.114:0/3070003532 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fd188003a00 con 0x7fd1980b2bf0 2024-09-16T07:29:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.944+0000 7fd195600640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd174073070 0x7fd174075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.944+0000 7fd195600640 1 -- 172.21.15.114:0/3070003532 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fd1880948d0 con 0x7fd1980b2bf0 2024-09-16T07:29:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.944+0000 7fd18fe00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd174073070 0x7fd174075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:35.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.944+0000 7fd18fe00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd174073070 0x7fd174075530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1800af000 tx=0x7fd18001b030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:35.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:35.948+0000 7fd195600640 1 -- 172.21.15.114:0/3070003532 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd18805fa80 con 0x7fd1980b2bf0 2024-09-16T07:29:36.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.148+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1980b47b0 con 0x7fd1980b2bf0 2024-09-16T07:29:36.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.148+0000 7fd195600640 1 -- 172.21.15.114:0/3070003532 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3917 (secure 0 0 0) 0x7fd18805f380 con 0x7fd1980b2bf0 2024-09-16T07:29:36.153 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:36.153 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"btime":"2024-09-16T07:29:29:555182+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3907348015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3907348015},{"type":"v1","addr":"172.21.15.114:6834","nonce":3907348015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2595700778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2595700778},{"type":"v1","addr":"172.21.15.149:6836","nonce":2595700778}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4825,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/986042946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":986042946},{"type":"v1","addr":"172.21.15.149:6837","nonce":986042946}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/669328586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":669328586},{"type":"v1","addr":"172.21.15.114:6835","nonce":669328586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-16T07:29:36.153 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2024-09-16T07:29:36.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd174073070 msgr2=0x7fd174075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:36.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd174073070 0x7fd174075530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd1800af000 tx=0x7fd18001b030 comp rx=0 tx=0).stop 2024-09-16T07:29:36.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1980b2bf0 msgr2=0x7fd1981596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:36.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1980b2bf0 0x7fd1981596f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd18800eb50 tx=0x7fd18800c7a0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 shutdown_connections 2024-09-16T07:29:36.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd174073070 0x7fd174075530 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd1980cd100 0x7fd19815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd1980b43d0 0x7fd19809b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 --2- 172.21.15.114:0/3070003532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1980b2bf0 0x7fd1981596f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 >> 172.21.15.114:0/3070003532 conn(0x7fd1980b18f0 msgr2=0x7fd1980cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:36.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 shutdown_connections 2024-09-16T07:29:36.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.152+0000 7fd19fa00640 1 -- 172.21.15.114:0/3070003532 wait complete. 2024-09-16T07:29:36.174 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:29:36.174 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:29:36.175 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:29:36.175 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:29:36.175 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:29:36.175 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:29:36.175 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:29:36.175 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:29:36.176 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:29:36.176 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:29:36.176 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:29:36.176 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:29:36.176 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:29:36.176 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:29:36.176 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:29:36.176 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:29:36.188 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:29:36.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:29:36.189 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:29:36.189 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:29:36.190 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:29:36.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:29:36.192 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:29:36.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:29:36.236 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:29:36.236 DEBUG:teuthology.parallel:result is None 2024-09-16T07:29:36.237 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:29:36.238 DEBUG:teuthology.parallel:result is None 2024-09-16T07:29:36.242 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:29:36.242 DEBUG:teuthology.parallel:result is None 2024-09-16T07:29:36.244 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:29:36.244 DEBUG:teuthology.parallel:result is None 2024-09-16T07:29:36.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:29:36.324 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:29:36.325 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:29:36.332 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:29:36.334 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 -- 172.21.15.114:0/1072912101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea815bea0 msgr2=0x7fdea80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 --2- 172.21.15.114:0/1072912101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea815bea0 0x7fdea80ce670 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdea8073d10 tx=0x7fde9c01c8c0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 -- 172.21.15.114:0/1072912101 shutdown_connections 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 --2- 172.21.15.114:0/1072912101 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdea80d28e0 0x7fdea80cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 --2- 172.21.15.114:0/1072912101 >> v2:172.21.15.149:3300/0 conn(0x7fdea80cdb30 0x7fdea80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 --2- 172.21.15.114:0/1072912101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea815bea0 0x7fdea80ce670 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 -- 172.21.15.114:0/1072912101 >> 172.21.15.114:0/1072912101 conn(0x7fdea80d1dc0 msgr2=0x7fdea80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 -- 172.21.15.114:0/1072912101 shutdown_connections 2024-09-16T07:29:36.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 -- 172.21.15.114:0/1072912101 wait complete. 2024-09-16T07:29:36.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 Processor -- start 2024-09-16T07:29:36.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.392+0000 7fdeb0800640 1 -- start start 2024-09-16T07:29:36.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdea80cdb30 0x7fdea81fbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:36.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80d28e0 0x7fdea80c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:36.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdea815bea0 0x7fdea81fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:36.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdea80af070 con 0x7fdea80d28e0 2024-09-16T07:29:36.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdea80aeef0 con 0x7fdea815bea0 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdea80af1f0 con 0x7fdea80cdb30 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80d28e0 0x7fdea80c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80d28e0 0x7fdea80c5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58510/0 (socket says 172.21.15.114:58510) 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 -- 172.21.15.114:0/396383663 learned_addr learned my addr 172.21.15.114:0/396383663 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeade00640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdea80cdb30 0x7fdea81fbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeae800640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdea815bea0 0x7fdea81fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 -- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdea80cdb30 msgr2=0x7fdea81fbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdea80cdb30 0x7fdea81fbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 -- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdea815bea0 msgr2=0x7fdea81fabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdea815bea0 0x7fdea81fabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 -- 172.21.15.114:0/396383663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea80b17c0 con 0x7fdea80d28e0 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdead400640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80d28e0 0x7fdea80c5b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fde9800d770 tx=0x7fde9800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:36.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdea2000640 1 -- 172.21.15.114:0/396383663 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98017070 con 0x7fdea80d28e0 2024-09-16T07:29:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdea2000640 1 -- 172.21.15.114:0/396383663 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde98009d20 con 0x7fdea80d28e0 2024-09-16T07:29:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdea2000640 1 -- 172.21.15.114:0/396383663 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde980106c0 con 0x7fdea80d28e0 2024-09-16T07:29:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea80b1aa0 con 0x7fdea80d28e0 2024-09-16T07:29:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea80b3480 con 0x7fdea80d28e0 2024-09-16T07:29:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea80cc9d0 con 0x7fdea80d28e0 2024-09-16T07:29:36.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.396+0000 7fdea2000640 1 -- 172.21.15.114:0/396383663 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fde9801a070 con 0x7fdea80d28e0 2024-09-16T07:29:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.400+0000 7fdea2000640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fde8c073070 0x7fde8c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:36.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.400+0000 7fdea2000640 1 -- 172.21.15.114:0/396383663 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4943+0+0 (secure 0 0 0) 0x7fde98093f60 con 0x7fdea80d28e0 2024-09-16T07:29:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.400+0000 7fdeade00640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fde8c073070 0x7fde8c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:36.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.400+0000 7fdeade00640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fde8c073070 0x7fde8c075530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0af000 tx=0x7fde9c0a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:36.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.404+0000 7fdea2000640 1 -- 172.21.15.114:0/396383663 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fde9805ec10 con 0x7fdea80d28e0 2024-09-16T07:29:36.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.584+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fdea8071630 con 0x7fdea80d28e0 2024-09-16T07:29:36.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdea2000640 1 -- 172.21.15.114:0/396383663 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) ==== 97+0+0 (secure 0 0 0) 0x7fde98063640 con 0x7fdea80d28e0 2024-09-16T07:29:36.835 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:29:36.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fde8c073070 msgr2=0x7fde8c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:36.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fde8c073070 0x7fde8c075530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0af000 tx=0x7fde9c0a7040 comp rx=0 tx=0).stop 2024-09-16T07:29:36.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80d28e0 msgr2=0x7fdea80c5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:36.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80d28e0 0x7fdea80c5b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fde9800d770 tx=0x7fde9800dc30 comp rx=0 tx=0).stop 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 shutdown_connections 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fde8c073070 0x7fde8c075530 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdea815bea0 0x7fdea81fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdea80d28e0 0x7fdea80c5b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 --2- 172.21.15.114:0/396383663 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdea80cdb30 0x7fdea81fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.832+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 >> 172.21.15.114:0/396383663 conn(0x7fdea80d1dc0 msgr2=0x7fdea80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.836+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 shutdown_connections 2024-09-16T07:29:36.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.836+0000 7fdeb0800640 1 -- 172.21.15.114:0/396383663 wait complete. 2024-09-16T07:29:36.859 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:29:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.996+0000 7f1635600640 1 -- 172.21.15.114:0/1051563585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16140039f0 msgr2=0x7f1614003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.996+0000 7f1635600640 1 --2- 172.21.15.114:0/1051563585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16140039f0 0x7f1614003dd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b30 tx=0x7f162001d210 comp rx=0 tx=0).stop 2024-09-16T07:29:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.996+0000 7f1634c00640 1 -- 172.21.15.114:0/1051563585 reap_dead start 2024-09-16T07:29:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.996+0000 7f1635600640 1 -- 172.21.15.114:0/1051563585 shutdown_connections 2024-09-16T07:29:37.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.996+0000 7f1635600640 1 -- 172.21.15.114:0/1051563585 >> 172.21.15.114:0/1051563585 conn(0x7f163009aa10 msgr2=0x7f163009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:37.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.996+0000 7f1635600640 1 -- 172.21.15.114:0/1051563585 shutdown_connections 2024-09-16T07:29:37.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:36.996+0000 7f1635600640 1 -- 172.21.15.114:0/1051563585 wait complete. 2024-09-16T07:29:37.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 Processor -- start 2024-09-16T07:29:37.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 -- start start 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16140039f0 0x7f1630157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1630161000 0x7f163015e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1630148310 0x7f16301487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1630071ce0 con 0x7f1630161000 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1630071b60 con 0x7f16140039f0 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f163015e040 con 0x7f1630148310 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1630161000 0x7f163015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16140039f0 0x7f1630157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1630161000 0x7f163015e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58528/0 (socket says 172.21.15.114:58528) 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16140039f0 0x7f1630157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:56500/0 (socket says 172.21.15.114:56500) 2024-09-16T07:29:37.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 -- 172.21.15.114:0/1973230977 learned_addr learned my addr 172.21.15.114:0/1973230977 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1634c00640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1630148310 0x7f16301487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 -- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1630148310 msgr2=0x7f16301487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1630148310 0x7f16301487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 -- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16140039f0 msgr2=0x7f1630157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16140039f0 0x7f1630157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 -- 172.21.15.114:0/1973230977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163015eb50 con 0x7f1630161000 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f162f400640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1630161000 0x7f163015e610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f161c0116a0 tx=0x7f161c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1627e00640 1 -- 172.21.15.114:0/1973230977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c00c840 con 0x7f1630161000 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1627e00640 1 -- 172.21.15.114:0/1973230977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f161c00ca00 con 0x7f1630161000 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16300cbf40 con 0x7f1630161000 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1627e00640 1 -- 172.21.15.114:0/1973230977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c00ce50 con 0x7f1630161000 2024-09-16T07:29:37.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.000+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16300cc500 con 0x7f1630161000 2024-09-16T07:29:37.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.004+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f163015ed80 con 0x7f1630161000 2024-09-16T07:29:37.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.004+0000 7f1627e00640 1 -- 172.21.15.114:0/1973230977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f161c013450 con 0x7f1630161000 2024-09-16T07:29:37.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.004+0000 7f1627e00640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1610073240 0x7f1610075700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.004+0000 7f1627e00640 1 -- 172.21.15.114:0/1973230977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f161c097770 con 0x7f1630161000 2024-09-16T07:29:37.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.004+0000 7f162fe00640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1610073240 0x7f1610075700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.004+0000 7f162fe00640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1610073240 0x7f1610075700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b30 tx=0x7f1614005840 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:37.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.008+0000 7f1627e00640 1 -- 172.21.15.114:0/1973230977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f161c017070 con 0x7f1630161000 2024-09-16T07:29:37.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f163015adb0 con 0x7f1630161000 2024-09-16T07:29:37.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1627e00640 1 -- 172.21.15.114:0/1973230977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f161c062290 con 0x7f1630161000 2024-09-16T07:29:37.238 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.239 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:29:37.240 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:37.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.242 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.243 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:29:37.244 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.245 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:29:37.246 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:29:37.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:29:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:29:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:29:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.252 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:29:37.252 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1610073240 msgr2=0x7f1610075700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1610073240 0x7f1610075700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b30 tx=0x7f1614005840 comp rx=0 tx=0).stop 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1630161000 msgr2=0x7f163015e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1630161000 0x7f163015e610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f161c0116a0 tx=0x7f161c011b60 comp rx=0 tx=0).stop 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 shutdown_connections 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1610073240 0x7f1610075700 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1630148310 0x7f16301487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1630161000 0x7f163015e610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 --2- 172.21.15.114:0/1973230977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16140039f0 0x7f1630157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 >> 172.21.15.114:0/1973230977 conn(0x7f163009aa10 msgr2=0x7f163006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 shutdown_connections 2024-09-16T07:29:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.236+0000 7f1635600640 1 -- 172.21.15.114:0/1973230977 wait complete. 2024-09-16T07:29:37.261 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:29:37.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 -- 172.21.15.114:0/3435030607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380afca0 msgr2=0x7fc6380b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 --2- 172.21.15.114:0/3435030607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380afca0 0x7fc6380b0130 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc630009c80 tx=0x7fc63001cc50 comp rx=0 tx=0).stop 2024-09-16T07:29:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 -- 172.21.15.114:0/3435030607 shutdown_connections 2024-09-16T07:29:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 --2- 172.21.15.114:0/3435030607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380afca0 0x7fc6380b0130 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 --2- 172.21.15.114:0/3435030607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc63815f490 0x7fc6380b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 -- 172.21.15.114:0/3435030607 >> 172.21.15.114:0/3435030607 conn(0x7fc6380d1e30 msgr2=0x7fc6380d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 -- 172.21.15.114:0/3435030607 shutdown_connections 2024-09-16T07:29:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 -- 172.21.15.114:0/3435030607 wait complete. 2024-09-16T07:29:37.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 Processor -- start 2024-09-16T07:29:37.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.400+0000 7fc63fe00640 1 -- start start 2024-09-16T07:29:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6380afca0 0x7fc63814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6380b2e80 0x7fc6380b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63815f490 0x7fc638150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc638168e00 con 0x7fc63815f490 2024-09-16T07:29:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc638168c80 con 0x7fc6380b2e80 2024-09-16T07:29:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc638168f80 con 0x7fc6380afca0 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63815f490 0x7fc638150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63815f490 0x7fc638150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58554/0 (socket says 172.21.15.114:58554) 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6380afca0 0x7fc63814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 -- 172.21.15.114:0/564355073 learned_addr learned my addr 172.21.15.114:0/564355073 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63ca00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6380b2e80 0x7fc6380b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 -- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6380afca0 msgr2=0x7fc63814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6380afca0 0x7fc63814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 -- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6380b2e80 msgr2=0x7fc6380b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6380b2e80 0x7fc6380b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 -- 172.21.15.114:0/564355073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6380c6560 con 0x7fc63815f490 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63de00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63815f490 0x7fc638150a60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc630009bd0 tx=0x7fc630009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc635600640 1 -- 172.21.15.114:0/564355073 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300bb070 con 0x7fc63815f490 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc635600640 1 -- 172.21.15.114:0/564355073 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc630004d40 con 0x7fc63815f490 2024-09-16T07:29:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc635600640 1 -- 172.21.15.114:0/564355073 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300b2040 con 0x7fc63815f490 2024-09-16T07:29:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63815ea70 con 0x7fc63815f490 2024-09-16T07:29:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6380b55d0 con 0x7fc63815f490 2024-09-16T07:29:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6380b0130 con 0x7fc63815f490 2024-09-16T07:29:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.404+0000 7fc635600640 1 -- 172.21.15.114:0/564355073 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fc6300be070 con 0x7fc63815f490 2024-09-16T07:29:37.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.408+0000 7fc635600640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc618073070 0x7fc618075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.408+0000 7fc635600640 1 -- 172.21.15.114:0/564355073 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7fc63012dae0 con 0x7fc63815f490 2024-09-16T07:29:37.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.408+0000 7fc63d400640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc618073070 0x7fc618075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.408+0000 7fc63d400640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc618073070 0x7fc618075530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00bb50 tx=0x7fc62c00b2e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.412+0000 7fc635600640 1 -- 172.21.15.114:0/564355073 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc630016990 con 0x7fc63815f490 2024-09-16T07:29:37.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc6380b10f0 con 0x7fc63815f490 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc635600640 1 -- 172.21.15.114:0/564355073 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) ==== 84+0+65 (secure 0 0 0) 0x7fc6300f86b0 con 0x7fc63815f490 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:37.587 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc618073070 msgr2=0x7fc618075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc618073070 0x7fc618075530 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00bb50 tx=0x7fc62c00b2e0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63815f490 msgr2=0x7fc638150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63815f490 0x7fc638150a60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc630009bd0 tx=0x7fc630009370 comp rx=0 tx=0).stop 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 shutdown_connections 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc618073070 0x7fc618075530 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc63815f490 0x7fc638150a60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6380b2e80 0x7fc6380b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 --2- 172.21.15.114:0/564355073 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6380afca0 0x7fc63814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 >> 172.21.15.114:0/564355073 conn(0x7fc6380d1e30 msgr2=0x7fc6380d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 shutdown_connections 2024-09-16T07:29:37.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.584+0000 7fc63fe00640 1 -- 172.21.15.114:0/564355073 wait complete. 2024-09-16T07:29:37.607 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:29:37.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:29:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.748+0000 7f6224e00640 1 -- 172.21.15.114:0/2373659590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6220073f20 msgr2=0x7f622006cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.748+0000 7f6224e00640 1 --2- 172.21.15.114:0/2373659590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6220073f20 0x7f622006cc20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f620c009900 tx=0x7f620c01c820 comp rx=0 tx=0).stop 2024-09-16T07:29:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.748+0000 7f6224e00640 1 -- 172.21.15.114:0/2373659590 shutdown_connections 2024-09-16T07:29:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.748+0000 7f6224e00640 1 --2- 172.21.15.114:0/2373659590 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6220073f20 0x7f622006cc20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.748+0000 7f6224e00640 1 -- 172.21.15.114:0/2373659590 >> 172.21.15.114:0/2373659590 conn(0x7f622006dd30 msgr2=0x7f622006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.748+0000 7f6224e00640 1 -- 172.21.15.114:0/2373659590 shutdown_connections 2024-09-16T07:29:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.748+0000 7f6224e00640 1 -- 172.21.15.114:0/2373659590 wait complete. 2024-09-16T07:29:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 Processor -- start 2024-09-16T07:29:37.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 -- start start 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f622006d160 0x7f62201fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6220073f20 0x7f62201575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622015bd40 0x7f622014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f622016a720 con 0x7f622006d160 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f622016a5a0 con 0x7f622015bd40 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f622016a8a0 con 0x7f6220073f20 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f622006d160 0x7f62201fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f622006d160 0x7f62201fc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58574/0 (socket says 172.21.15.114:58574) 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 -- 172.21.15.114:0/1609857984 learned_addr learned my addr 172.21.15.114:0/1609857984 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621e800640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622015bd40 0x7f622014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621d400640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6220073f20 0x7f62201575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 -- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6220073f20 msgr2=0x7f62201575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6220073f20 0x7f62201575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 -- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622015bd40 msgr2=0x7f622014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622015bd40 0x7f622014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 -- 172.21.15.114:0/1609857984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6220154af0 con 0x7f622006d160 2024-09-16T07:29:37.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f621de00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f622006d160 0x7f62201fc4c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f621000c730 tx=0x7f621000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:37.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6216000640 1 -- 172.21.15.114:0/1609857984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210003b80 con 0x7f622006d160 2024-09-16T07:29:37.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6216000640 1 -- 172.21.15.114:0/1609857984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6210003d40 con 0x7f622006d160 2024-09-16T07:29:37.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6216000640 1 -- 172.21.15.114:0/1609857984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621000aab0 con 0x7f622006d160 2024-09-16T07:29:37.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.752+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6220154dd0 con 0x7f622006d160 2024-09-16T07:29:37.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.756+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6220157090 con 0x7f622006d160 2024-09-16T07:29:37.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.756+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f622006cc20 con 0x7f622006d160 2024-09-16T07:29:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.756+0000 7f6216000640 1 -- 172.21.15.114:0/1609857984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f621000ac50 con 0x7f622006d160 2024-09-16T07:29:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.756+0000 7f6216000640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f62000730a0 0x7f6200075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.756+0000 7f6216000640 1 -- 172.21.15.114:0/1609857984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f6210093a90 con 0x7f622006d160 2024-09-16T07:29:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.756+0000 7f621d400640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f62000730a0 0x7f6200075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.760+0000 7f621d400640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f62000730a0 0x7f6200075560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f620c0af000 tx=0x7f620c01b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:37.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.760+0000 7f6216000640 1 -- 172.21.15.114:0/1609857984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6220074390 con 0x7f622006d160 2024-09-16T07:29:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:37.928+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6220154fa0 con 0x7f622006d160 2024-09-16T07:29:38.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.844+0000 7f6216000640 1 -- 172.21.15.114:0/1609857984 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) ==== 138+0+0 (secure 0 0 0) 0x7f621005e6e0 con 0x7f622006d160 2024-09-16T07:29:38.848 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:29:38.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f62000730a0 msgr2=0x7f6200075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:38.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f62000730a0 0x7f6200075560 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f620c0af000 tx=0x7f620c01b060 comp rx=0 tx=0).stop 2024-09-16T07:29:38.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f622006d160 msgr2=0x7f62201fc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:38.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f622006d160 0x7f62201fc4c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f621000c730 tx=0x7f621000cbf0 comp rx=0 tx=0).stop 2024-09-16T07:29:38.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 shutdown_connections 2024-09-16T07:29:38.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f62000730a0 0x7f6200075560 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:38.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f622015bd40 0x7f622014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:38.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6220073f20 0x7f62201575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:38.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 --2- 172.21.15.114:0/1609857984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f622006d160 0x7f62201fc4c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:38.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 >> 172.21.15.114:0/1609857984 conn(0x7f622006dd30 msgr2=0x7f622015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:38.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 shutdown_connections 2024-09-16T07:29:38.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:38.848+0000 7f6224e00640 1 -- 172.21.15.114:0/1609857984 wait complete. 2024-09-16T07:29:38.877 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 -- 172.21.15.114:0/1863452617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a80b3130 msgr2=0x7f95a80cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 --2- 172.21.15.114:0/1863452617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a80b3130 0x7f95a80cc550 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009c80 tx=0x7f95a401cda0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 -- 172.21.15.114:0/1863452617 shutdown_connections 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 --2- 172.21.15.114:0/1863452617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a80b3130 0x7f95a80cc550 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 --2- 172.21.15.114:0/1863452617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95a80b4bd0 0x7f95a80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 -- 172.21.15.114:0/1863452617 >> 172.21.15.114:0/1863452617 conn(0x7f95a80b18f0 msgr2=0x7f95a80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 -- 172.21.15.114:0/1863452617 shutdown_connections 2024-09-16T07:29:39.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 -- 172.21.15.114:0/1863452617 wait complete. 2024-09-16T07:29:39.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 Processor -- start 2024-09-16T07:29:39.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.024+0000 7f95b0800640 1 -- start start 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a80b3130 0x7f95a80ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95a80b4bd0 0x7f95a8150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a815b580 0x7f95a81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95a8167b70 con 0x7f95a815b580 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95a80cd570 con 0x7f95a80b3130 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95a8167cf0 con 0x7f95a80b4bd0 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a815b580 0x7f95a81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a815b580 0x7f95a81513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58594/0 (socket says 172.21.15.114:58594) 2024-09-16T07:29:39.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 -- 172.21.15.114:0/1662636818 learned_addr learned my addr 172.21.15.114:0/1662636818 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ade00640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a80b3130 0x7f95a80ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ad400640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95a80b4bd0 0x7f95a8150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 -- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95a80b4bd0 msgr2=0x7f95a8150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95a80b4bd0 0x7f95a8150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 -- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a80b3130 msgr2=0x7f95a80ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a80b3130 0x7f95a80ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 -- 172.21.15.114:0/1662636818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a809d420 con 0x7f95a815b580 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95ae800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a815b580 0x7f95a81513f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009bd0 tx=0x7f95a40a5a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95a2000640 1 -- 172.21.15.114:0/1662636818 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a40bb070 con 0x7f95a815b580 2024-09-16T07:29:39.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95a2000640 1 -- 172.21.15.114:0/1662636818 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95a4004c50 con 0x7f95a815b580 2024-09-16T07:29:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a809d700 con 0x7f95a815b580 2024-09-16T07:29:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95a2000640 1 -- 172.21.15.114:0/1662636818 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a40b2040 con 0x7f95a815b580 2024-09-16T07:29:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a8139790 con 0x7f95a815b580 2024-09-16T07:29:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a8069410 con 0x7f95a815b580 2024-09-16T07:29:39.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.028+0000 7f95a2000640 1 -- 172.21.15.114:0/1662636818 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f95a40be070 con 0x7f95a815b580 2024-09-16T07:29:39.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.032+0000 7f95a2000640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f958c073070 0x7f958c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:39.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.032+0000 7f95a2000640 1 -- 172.21.15.114:0/1662636818 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5227+0+0 (secure 0 0 0) 0x7f95a412dfc0 con 0x7f95a815b580 2024-09-16T07:29:39.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.032+0000 7f95ade00640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f958c073070 0x7f958c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:39.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.032+0000 7f95ade00640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f958c073070 0x7f958c075530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f959c000f70 tx=0x7f959c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:39.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.036+0000 7f95a2000640 1 -- 172.21.15.114:0/1662636818 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f95a4016990 con 0x7f95a815b580 2024-09-16T07:29:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.200+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f95a80b1e70 con 0x7f95a815b580 2024-09-16T07:29:39.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95a2000640 1 -- 172.21.15.114:0/1662636818 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) ==== 170+0+0 (secure 0 0 0) 0x7f95a40f90d0 con 0x7f95a815b580 2024-09-16T07:29:39.858 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f958c073070 msgr2=0x7f958c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f958c073070 0x7f958c075530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f959c000f70 tx=0x7f959c009040 comp rx=0 tx=0).stop 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a815b580 msgr2=0x7f95a81513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a815b580 0x7f95a81513f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009bd0 tx=0x7f95a40a5a90 comp rx=0 tx=0).stop 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 shutdown_connections 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f958c073070 0x7f958c075530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95a815b580 0x7f95a81513f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95a80b4bd0 0x7f95a8150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 --2- 172.21.15.114:0/1662636818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95a80b3130 0x7f95a80ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:39.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 >> 172.21.15.114:0/1662636818 conn(0x7f95a80b18f0 msgr2=0x7f95a815b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:39.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 shutdown_connections 2024-09-16T07:29:39.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:39.856+0000 7f95b0800640 1 -- 172.21.15.114:0/1662636818 wait complete. 2024-09-16T07:29:39.896 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:29:40.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- 172.21.15.114:0/320831174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 msgr2=0x7fea940cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 --2- 172.21.15.114:0/320831174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cea20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009c80 tx=0x7fea7c01cda0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- 172.21.15.114:0/320831174 shutdown_connections 2024-09-16T07:29:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 --2- 172.21.15.114:0/320831174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cea20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 --2- 172.21.15.114:0/320831174 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415be80 0x7fea940ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- 172.21.15.114:0/320831174 >> 172.21.15.114:0/320831174 conn(0x7fea940d1da0 msgr2=0x7fea940d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- 172.21.15.114:0/320831174 shutdown_connections 2024-09-16T07:29:40.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- 172.21.15.114:0/320831174 wait complete. 2024-09-16T07:29:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 Processor -- start 2024-09-16T07:29:40.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- start start 2024-09-16T07:29:40.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940b53f0 0x7fea941f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:40.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:40.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415be80 0x7fea94140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fea941691c0 con 0x7fea940d28c0 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea94169040 con 0x7fea940b53f0 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea99200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea94169340 con 0x7fea9415be80 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea89400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea89400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58612/0 (socket says 172.21.15.114:58612) 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea89400640 1 -- 172.21.15.114:0/3865541154 learned_addr learned my addr 172.21.15.114:0/3865541154 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.040+0000 7fea92800640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415be80 0x7fea94140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea91e00640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940b53f0 0x7fea941f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea89400640 1 -- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415be80 msgr2=0x7fea94140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea89400640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415be80 0x7fea94140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea89400640 1 -- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940b53f0 msgr2=0x7fea941f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea89400640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940b53f0 0x7fea941f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea89400640 1 -- 172.21.15.114:0/3865541154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9414e9f0 con 0x7fea940d28c0 2024-09-16T07:29:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea89400640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cb670 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fea7c000f90 tx=0x7fea7c0093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea8aa00640 1 -- 172.21.15.114:0/3865541154 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0bb070 con 0x7fea940d28c0 2024-09-16T07:29:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea8aa00640 1 -- 172.21.15.114:0/3865541154 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea7c004d10 con 0x7fea940d28c0 2024-09-16T07:29:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea8aa00640 1 -- 172.21.15.114:0/3865541154 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0b2040 con 0x7fea940d28c0 2024-09-16T07:29:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea940c5d70 con 0x7fea940d28c0 2024-09-16T07:29:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea941fb810 con 0x7fea940d28c0 2024-09-16T07:29:40.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea940b5880 con 0x7fea940d28c0 2024-09-16T07:29:40.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.044+0000 7fea8aa00640 1 -- 172.21.15.114:0/3865541154 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fea7c0a5bf0 con 0x7fea940d28c0 2024-09-16T07:29:40.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.048+0000 7fea8aa00640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fea70073070 0x7fea70075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:40.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.048+0000 7fea8aa00640 1 -- 172.21.15.114:0/3865541154 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5609+0+0 (secure 0 0 0) 0x7fea7c12e250 con 0x7fea940d28c0 2024-09-16T07:29:40.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.048+0000 7fea91e00640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fea70073070 0x7fea70075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:40.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.048+0000 7fea91e00640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fea70073070 0x7fea70075530 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea840058d0 tx=0x7fea84005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:40.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.052+0000 7fea8aa00640 1 -- 172.21.15.114:0/3865541154 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fea7c0c4020 con 0x7fea940d28c0 2024-09-16T07:29:40.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.256+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fea940d2460 con 0x7fea940d28c0 2024-09-16T07:29:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.856+0000 7fea8aa00640 1 -- 172.21.15.114:0/3865541154 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v23) ==== 172+0+0 (secure 0 0 0) 0x7fea7c016990 con 0x7fea940d28c0 2024-09-16T07:29:40.860 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 6 and data pool 7 2024-09-16T07:29:40.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fea70073070 msgr2=0x7fea70075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fea70073070 0x7fea70075530 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea840058d0 tx=0x7fea84005860 comp rx=0 tx=0).stop 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 msgr2=0x7fea940cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cb670 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fea7c000f90 tx=0x7fea7c0093f0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 shutdown_connections 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fea70073070 0x7fea70075530 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea9415be80 0x7fea94140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea940d28c0 0x7fea940cb670 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 --2- 172.21.15.114:0/3865541154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea940b53f0 0x7fea941f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:40.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 >> 172.21.15.114:0/3865541154 conn(0x7fea940d1da0 msgr2=0x7fea940b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:40.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 shutdown_connections 2024-09-16T07:29:40.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:40.860+0000 7fea99200640 1 -- 172.21.15.114:0/3865541154 wait complete. 2024-09-16T07:29:40.910 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 -- 172.21.15.114:0/1800945943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980d1b60 msgr2=0x7f07980d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 --2- 172.21.15.114:0/1800945943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980d1b60 0x7f07980d1f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0788009840 tx=0x7f078801c6d0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 -- 172.21.15.114:0/1800945943 shutdown_connections 2024-09-16T07:29:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 --2- 172.21.15.114:0/1800945943 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 0x7f07980ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 --2- 172.21.15.114:0/1800945943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980d1b60 0x7f07980d1f40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 -- 172.21.15.114:0/1800945943 >> 172.21.15.114:0/1800945943 conn(0x7f079809aa10 msgr2=0x7f079809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 -- 172.21.15.114:0/1800945943 shutdown_connections 2024-09-16T07:29:41.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.048+0000 7f079e400640 1 -- 172.21.15.114:0/1800945943 wait complete. 2024-09-16T07:29:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 Processor -- start 2024-09-16T07:29:41.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 -- start start 2024-09-16T07:29:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 0x7f0798150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980cea20 0x7f079814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07980d1b60 0x7f0798071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f079816b6f0 con 0x7f07980d1b60 2024-09-16T07:29:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f079816b570 con 0x7f07980cea20 2024-09-16T07:29:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f079816b870 con 0x7f07980b24b0 2024-09-16T07:29:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 0x7f0798150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 0x7f0798150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:43104/0 (socket says 172.21.15.114:43104) 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 -- 172.21.15.114:0/4257860958 learned_addr learned my addr 172.21.15.114:0/4257860958 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079da00640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07980d1b60 0x7f0798071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f078fe00640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980cea20 0x7f079814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 -- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980cea20 msgr2=0x7f079814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980cea20 0x7f079814f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 -- 172.21.15.114:0/4257860958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07980d1b60 msgr2=0x7f0798071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07980d1b60 0x7f0798071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 -- 172.21.15.114:0/4257860958 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07981f8a90 con 0x7f07980b24b0 2024-09-16T07:29:41.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079d000640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 0x7f0798150ef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0788009790 tx=0x7f07880a5590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f0795600640 1 -- 172.21.15.114:0/4257860958 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880bb070 con 0x7f07980b24b0 2024-09-16T07:29:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f0795600640 1 -- 172.21.15.114:0/4257860958 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0788004470 con 0x7f07980b24b0 2024-09-16T07:29:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07981f7cd0 con 0x7f07980b24b0 2024-09-16T07:29:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.052+0000 7f0795600640 1 -- 172.21.15.114:0/4257860958 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880b2040 con 0x7f07980b24b0 2024-09-16T07:29:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.056+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07981f8290 con 0x7f07980b24b0 2024-09-16T07:29:41.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.056+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07980ce4e0 con 0x7f07980b24b0 2024-09-16T07:29:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.056+0000 7f0795600640 1 -- 172.21.15.114:0/4257860958 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f07880be070 con 0x7f07980b24b0 2024-09-16T07:29:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.056+0000 7f0795600640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f07740730a0 0x7f0774075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.056+0000 7f0795600640 1 -- 172.21.15.114:0/4257860958 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f078812d910 con 0x7f07980b24b0 2024-09-16T07:29:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.056+0000 7f078fe00640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f07740730a0 0x7f0774075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.060+0000 7f078fe00640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f07740730a0 0x7f0774075560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0798154bf0 tx=0x7f07800091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:41.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.064+0000 7f0795600640 1 -- 172.21.15.114:0/4257860958 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0788016410 con 0x7f07980b24b0 2024-09-16T07:29:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.228+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f079809b480 con 0x7f07980b24b0 2024-09-16T07:29:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f0795600640 1 -- 172.21.15.114:0/4257860958 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16734 (secure 0 0 0) 0x7f07880f8220 con 0x7f07980b24b0 2024-09-16T07:29:41.235 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:41.235 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":43,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:40.260913+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:37.945620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:39.216269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f07740730a0 msgr2=0x7f0774075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f07740730a0 0x7f0774075560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0798154bf0 tx=0x7f07800091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 msgr2=0x7f0798150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 0x7f0798150ef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0788009790 tx=0x7f07880a5590 comp rx=0 tx=0).stop 2024-09-16T07:29:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 shutdown_connections 2024-09-16T07:29:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f07740730a0 0x7f0774075560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07980d1b60 0x7f0798071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07980cea20 0x7f079814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 --2- 172.21.15.114:0/4257860958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f07980b24b0 0x7f0798150ef0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 >> 172.21.15.114:0/4257860958 conn(0x7f079809aa10 msgr2=0x7f079806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 shutdown_connections 2024-09-16T07:29:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.232+0000 7f079e400640 1 -- 172.21.15.114:0/4257860958 wait complete. 2024-09-16T07:29:41.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:41.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 -- 172.21.15.114:0/948950509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c0737c0 msgr2=0x7f5e2c15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 --2- 172.21.15.114:0/948950509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c0737c0 0x7f5e2c15c1c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009930 tx=0x7f5e1801c8b0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 -- 172.21.15.114:0/948950509 shutdown_connections 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 --2- 172.21.15.114:0/948950509 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c071030 0x7f5e2c0714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 --2- 172.21.15.114:0/948950509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c0737c0 0x7f5e2c15c1c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 -- 172.21.15.114:0/948950509 >> 172.21.15.114:0/948950509 conn(0x7f5e2c0d0c90 msgr2=0x7f5e2c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 -- 172.21.15.114:0/948950509 shutdown_connections 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 -- 172.21.15.114:0/948950509 wait complete. 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.396+0000 7f5e34200640 1 Processor -- start 2024-09-16T07:29:41.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 -- start start 2024-09-16T07:29:41.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c06cc20 0x7f5e2c0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c071030 0x7f5e2c0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0737c0 0x7f5e2c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c168f90 con 0x7f5e2c071030 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c168e10 con 0x7f5e2c06cc20 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2c169110 con 0x7f5e2c0737c0 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c071030 0x7f5e2c0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c071030 0x7f5e2c0c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58640/0 (socket says 172.21.15.114:58640) 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 -- 172.21.15.114:0/643467450 learned_addr learned my addr 172.21.15.114:0/643467450 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e32200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0737c0 0x7f5e2c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 -- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0737c0 msgr2=0x7f5e2c0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0737c0 0x7f5e2c0c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 -- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c06cc20 msgr2=0x7f5e2c0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c06cc20 0x7f5e2c0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 -- 172.21.15.114:0/643467450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c0b2070 con 0x7f5e2c071030 2024-09-16T07:29:41.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e32200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0737c0 0x7f5e2c0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:41.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e30e00640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c071030 0x7f5e2c0c7f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5e180b0040 tx=0x7f5e180a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:41.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e29600640 1 -- 172.21.15.114:0/643467450 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180b2040 con 0x7f5e2c071030 2024-09-16T07:29:41.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e29600640 1 -- 172.21.15.114:0/643467450 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e18004430 con 0x7f5e2c071030 2024-09-16T07:29:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e29600640 1 -- 172.21.15.114:0/643467450 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18005280 con 0x7f5e2c071030 2024-09-16T07:29:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c0b2350 con 0x7f5e2c071030 2024-09-16T07:29:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c0b2910 con 0x7f5e2c071030 2024-09-16T07:29:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.400+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c0714a0 con 0x7f5e2c071030 2024-09-16T07:29:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.404+0000 7f5e29600640 1 -- 172.21.15.114:0/643467450 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f5e180bd060 con 0x7f5e2c071030 2024-09-16T07:29:41.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.404+0000 7f5e29600640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5e0c073070 0x7f5e0c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.404+0000 7f5e29600640 1 -- 172.21.15.114:0/643467450 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f5e1812db20 con 0x7f5e2c071030 2024-09-16T07:29:41.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.404+0000 7f5e31800640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5e0c073070 0x7f5e0c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.404+0000 7f5e31800640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5e0c073070 0x7f5e0c075530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000f70 tx=0x7f5e200079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:41.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.408+0000 7f5e29600640 1 -- 172.21.15.114:0/643467450 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5e180164d0 con 0x7f5e2c071030 2024-09-16T07:29:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.576+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e2c0b6c10 con 0x7f5e2c071030 2024-09-16T07:29:41.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.576+0000 7f5e29600640 1 -- 172.21.15.114:0/643467450 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16734 (secure 0 0 0) 0x7f5e180f8940 con 0x7f5e2c071030 2024-09-16T07:29:41.581 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:41.581 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":43,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:40.260913+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:37.945620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:39.216269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:41.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5e0c073070 msgr2=0x7f5e0c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5e0c073070 0x7f5e0c075530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000f70 tx=0x7f5e200079c0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c071030 msgr2=0x7f5e2c0c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c071030 0x7f5e2c0c7f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5e180b0040 tx=0x7f5e180a5790 comp rx=0 tx=0).stop 2024-09-16T07:29:41.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 shutdown_connections 2024-09-16T07:29:41.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5e0c073070 0x7f5e0c075530 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5e2c0737c0 0x7f5e2c0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e2c071030 0x7f5e2c0c7f70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 --2- 172.21.15.114:0/643467450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e2c06cc20 0x7f5e2c0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 >> 172.21.15.114:0/643467450 conn(0x7f5e2c0d0c90 msgr2=0x7f5e2c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:41.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 shutdown_connections 2024-09-16T07:29:41.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.580+0000 7f5e34200640 1 -- 172.21.15.114:0/643467450 wait complete. 2024-09-16T07:29:41.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:29:41.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- 172.21.15.114:0/2148678635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0015f340 msgr2=0x7f4f000b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 --2- 172.21.15.114:0/2148678635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0015f340 0x7f4f000b34a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4f00073ef0 tx=0x7f4ef001c890 comp rx=0 tx=0).stop 2024-09-16T07:29:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- 172.21.15.114:0/2148678635 shutdown_connections 2024-09-16T07:29:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 --2- 172.21.15.114:0/2148678635 >> v2:172.21.15.149:3300/0 conn(0x7f4f000b2a00 0x7f4f000b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 --2- 172.21.15.114:0/2148678635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f0015f340 0x7f4f000b34a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- 172.21.15.114:0/2148678635 >> 172.21.15.114:0/2148678635 conn(0x7f4f000d1e00 msgr2=0x7f4f000d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- 172.21.15.114:0/2148678635 shutdown_connections 2024-09-16T07:29:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- 172.21.15.114:0/2148678635 wait complete. 2024-09-16T07:29:41.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 Processor -- start 2024-09-16T07:29:41.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- start start 2024-09-16T07:29:41.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f000b2a00 0x7f4f0014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f000ccf10 0x7f4f000c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0015f340 0x7f4f000b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f001690c0 con 0x7f4f000ccf10 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00168f40 con 0x7f4f000b2a00 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4f05400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4f00169240 con 0x7f4f0015f340 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f000ccf10 0x7f4f000c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f000ccf10 0x7f4f000c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58662/0 (socket says 172.21.15.114:58662) 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 -- 172.21.15.114:0/2203196328 learned_addr learned my addr 172.21.15.114:0/2203196328 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efe800640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f000b2a00 0x7f4f0014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4eff200640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0015f340 0x7f4f000b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 -- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0015f340 msgr2=0x7f4f000b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0015f340 0x7f4f000b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 -- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f000b2a00 msgr2=0x7f4f0014dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f000b2a00 0x7f4f0014dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:41.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4efde00640 1 -- 172.21.15.114:0/2203196328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0014e580 con 0x7f4f000ccf10 2024-09-16T07:29:41.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.744+0000 7f4eff200640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0015f340 0x7f4f000b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:41.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4efde00640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f000ccf10 0x7f4f000c7440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00d980 tx=0x7f4eec00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:41.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4ef6a00640 1 -- 172.21.15.114:0/2203196328 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec017070 con 0x7f4f000ccf10 2024-09-16T07:29:41.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4ef6a00640 1 -- 172.21.15.114:0/2203196328 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eec009d60 con 0x7f4f000ccf10 2024-09-16T07:29:41.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0014e860 con 0x7f4f000ccf10 2024-09-16T07:29:41.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4ef6a00640 1 -- 172.21.15.114:0/2203196328 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec005280 con 0x7f4f000ccf10 2024-09-16T07:29:41.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0014ee20 con 0x7f4f000ccf10 2024-09-16T07:29:41.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f000cd340 con 0x7f4f000ccf10 2024-09-16T07:29:41.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4ef6a00640 1 -- 172.21.15.114:0/2203196328 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f4eec005420 con 0x7f4f000ccf10 2024-09-16T07:29:41.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4ef6a00640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4ee0073070 0x7f4ee0075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:41.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4ef6a00640 1 -- 172.21.15.114:0/2203196328 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f4eec094430 con 0x7f4f000ccf10 2024-09-16T07:29:41.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.748+0000 7f4efe800640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4ee0073070 0x7f4ee0075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:41.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.752+0000 7f4efe800640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4ee0073070 0x7f4ee0075530 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00af000 tx=0x7f4ef001b0d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:41.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.752+0000 7f4ef6a00640 1 -- 172.21.15.114:0/2203196328 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4eec05ec00 con 0x7f4f000ccf10 2024-09-16T07:29:41.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:41.960+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4f000c5820 con 0x7f4f000ccf10 2024-09-16T07:29:42.846 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-16T07:29:42.844+0000 7f23cba00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.888+0000 7f4ef6a00640 1 -- 172.21.15.114:0/2203196328 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7f4eec063630 con 0x7f4f000ccf10 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4ee0073070 msgr2=0x7f4ee0075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4ee0073070 0x7f4ee0075530 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ef00af000 tx=0x7f4ef001b0d0 comp rx=0 tx=0).stop 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f000ccf10 msgr2=0x7f4f000c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f000ccf10 0x7f4f000c7440 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00d980 tx=0x7f4eec00de40 comp rx=0 tx=0).stop 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 shutdown_connections 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4ee0073070 0x7f4ee0075530 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f0015f340 0x7f4f000b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f000ccf10 0x7f4f000c7440 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 --2- 172.21.15.114:0/2203196328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f000b2a00 0x7f4f0014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 >> 172.21.15.114:0/2203196328 conn(0x7f4f000d1e00 msgr2=0x7f4f000aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 shutdown_connections 2024-09-16T07:29:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:42.892+0000 7f4f05400640 1 -- 172.21.15.114:0/2203196328 wait complete. 2024-09-16T07:29:42.920 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:29:42.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:29:43.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.064+0000 7f1deae00640 1 -- 172.21.15.114:0/1694123156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 msgr2=0x7f1de406f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:43.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.064+0000 7f1deae00640 1 --2- 172.21.15.114:0/1694123156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de406f7b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00a950 tx=0x7f1dcc01da50 comp rx=0 tx=0).stop 2024-09-16T07:29:43.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.064+0000 7f1deae00640 1 -- 172.21.15.114:0/1694123156 shutdown_connections 2024-09-16T07:29:43.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.064+0000 7f1deae00640 1 --2- 172.21.15.114:0/1694123156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de406f7b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:43.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.064+0000 7f1deae00640 1 -- 172.21.15.114:0/1694123156 >> 172.21.15.114:0/1694123156 conn(0x7f1de40b18f0 msgr2=0x7f1de40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:43.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.064+0000 7f1deae00640 1 -- 172.21.15.114:0/1694123156 shutdown_connections 2024-09-16T07:29:43.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.064+0000 7f1deae00640 1 -- 172.21.15.114:0/1694123156 wait complete. 2024-09-16T07:29:43.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 Processor -- start 2024-09-16T07:29:43.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 -- start start 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1de40b49e0 0x7f1de41f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de4159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1de415dae0 0x7f1de4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41685d0 con 0x7f1de40cd100 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1de4168450 con 0x7f1de40b49e0 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1de4168750 con 0x7f1de415dae0 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de4159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de4159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58672/0 (socket says 172.21.15.114:58672) 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 -- 172.21.15.114:0/2849707887 learned_addr learned my addr 172.21.15.114:0/2849707887 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1de3e00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1de40b49e0 0x7f1de41f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1de8e00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1de415dae0 0x7f1de4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 -- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1de415dae0 msgr2=0x7f1de4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1de415dae0 0x7f1de4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 -- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1de40b49e0 msgr2=0x7f1de41f9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1de40b49e0 0x7f1de41f9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 -- 172.21.15.114:0/2849707887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de41f6180 con 0x7f1de40cd100 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1ddb400640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de4159230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00a8a0 tx=0x7f1dcc004220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1de0c00640 1 -- 172.21.15.114:0/2849707887 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0b3040 con 0x7f1de40cd100 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1de0c00640 1 -- 172.21.15.114:0/2849707887 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dcc005230 con 0x7f1de40cd100 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1de0c00640 1 -- 172.21.15.114:0/2849707887 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0044d0 con 0x7f1de40cd100 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de4158900 con 0x7f1de40cd100 2024-09-16T07:29:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.068+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de41f66e0 con 0x7f1de40cd100 2024-09-16T07:29:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.072+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de4069410 con 0x7f1de40cd100 2024-09-16T07:29:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.072+0000 7f1de0c00640 1 -- 172.21.15.114:0/2849707887 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f1dcc0046d0 con 0x7f1de40cd100 2024-09-16T07:29:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.072+0000 7f1de0c00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dc00730a0 0x7f1dc0075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.072+0000 7f1de0c00640 1 -- 172.21.15.114:0/2849707887 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f1dcc12e470 con 0x7f1de40cd100 2024-09-16T07:29:43.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.072+0000 7f1de3e00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dc00730a0 0x7f1dc0075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:43.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.072+0000 7f1de3e00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dc00730a0 0x7f1dc0075560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40012f0 tx=0x7f1dd4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.076+0000 7f1de0c00640 1 -- 172.21.15.114:0/2849707887 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1dcc0c5060 con 0x7f1de40cd100 2024-09-16T07:29:43.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.280+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1de415a920 con 0x7f1de40cd100 2024-09-16T07:29:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1de0c00640 1 -- 172.21.15.114:0/2849707887 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7f1de41f6180 con 0x7f1de40cd100 2024-09-16T07:29:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dc00730a0 msgr2=0x7f1dc0075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dc00730a0 0x7f1dc0075560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40012f0 tx=0x7f1dd4009040 comp rx=0 tx=0).stop 2024-09-16T07:29:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 msgr2=0x7f1de4159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de4159230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00a8a0 tx=0x7f1dcc004220 comp rx=0 tx=0).stop 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 shutdown_connections 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1dc00730a0 0x7f1dc0075560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1de415dae0 0x7f1de4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1de40cd100 0x7f1de4159230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 --2- 172.21.15.114:0/2849707887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1de40b49e0 0x7f1de41f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 >> 172.21.15.114:0/2849707887 conn(0x7f1de40b18f0 msgr2=0x7f1de409cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 shutdown_connections 2024-09-16T07:29:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:43.896+0000 7f1deae00640 1 -- 172.21.15.114:0/2849707887 wait complete. 2024-09-16T07:29:43.923 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:29:43.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 -- 172.21.15.114:0/2531817390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 msgr2=0x7f56280b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 --2- 172.21.15.114:0/2531817390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280b1bd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5614009840 tx=0x7f561401c760 comp rx=0 tx=0).stop 2024-09-16T07:29:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 -- 172.21.15.114:0/2531817390 shutdown_connections 2024-09-16T07:29:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 --2- 172.21.15.114:0/2531817390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280b1bd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 -- 172.21.15.114:0/2531817390 >> 172.21.15.114:0/2531817390 conn(0x7f56280d1e30 msgr2=0x7f56280d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 -- 172.21.15.114:0/2531817390 shutdown_connections 2024-09-16T07:29:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 -- 172.21.15.114:0/2531817390 wait complete. 2024-09-16T07:29:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 Processor -- start 2024-09-16T07:29:44.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.060+0000 7f562f400640 1 -- start start 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280afca0 0x7f562814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f562815f490 0x7f56280c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f56280b2290 con 0x7f56280b2e80 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f56280b2110 con 0x7f56280afca0 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f562816a4a0 con 0x7f562815f490 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58690/0 (socket says 172.21.15.114:58690) 2024-09-16T07:29:44.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 -- 172.21.15.114:0/1660043457 learned_addr learned my addr 172.21.15.114:0/1660043457 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562d400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f562815f490 0x7f56280c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562ca00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280afca0 0x7f562814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 -- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f562815f490 msgr2=0x7f56280c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f562815f490 0x7f56280c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 -- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280afca0 msgr2=0x7f562814ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280afca0 0x7f562814ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 -- 172.21.15.114:0/1660043457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56280c7a70 con 0x7f56280b2e80 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562d400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f562815f490 0x7f56280c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562ca00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280afca0 0x7f562814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5627e00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280c5960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5614009790 tx=0x7f56140040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5624c00640 1 -- 172.21.15.114:0/1660043457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140bb070 con 0x7f56280b2e80 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5624c00640 1 -- 172.21.15.114:0/1660043457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5614005030 con 0x7f56280b2e80 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562806fc20 con 0x7f56280b2e80 2024-09-16T07:29:44.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f5624c00640 1 -- 172.21.15.114:0/1660043457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56140b2040 con 0x7f56280b2e80 2024-09-16T07:29:44.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56280c8010 con 0x7f56280b2e80 2024-09-16T07:29:44.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.064+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56280b00d0 con 0x7f56280b2e80 2024-09-16T07:29:44.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.068+0000 7f5624c00640 1 -- 172.21.15.114:0/1660043457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f56140be070 con 0x7f56280b2e80 2024-09-16T07:29:44.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.068+0000 7f5624c00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f56080730a0 0x7f5608075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.068+0000 7f5624c00640 1 -- 172.21.15.114:0/1660043457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f561412db50 con 0x7f56280b2e80 2024-09-16T07:29:44.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.068+0000 7f562ca00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f56080730a0 0x7f5608075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.068+0000 7f562ca00640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f56080730a0 0x7f5608075560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f562815a780 tx=0x7f561c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.072+0000 7f5624c00640 1 -- 172.21.15.114:0/1660043457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5614016410 con 0x7f56280b2e80 2024-09-16T07:29:44.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.272+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56280c8710 con 0x7f56280b2e80 2024-09-16T07:29:44.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.272+0000 7f5624c00640 1 -- 172.21.15.114:0/1660043457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7f56140f8970 con 0x7f56280b2e80 2024-09-16T07:29:44.277 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:44.277 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":27,"btime":"2024-09-16T07:29:43:896581+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:29:44.277 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 27 2024-09-16T07:29:44.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f56080730a0 msgr2=0x7f5608075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f56080730a0 0x7f5608075560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f562815a780 tx=0x7f561c008040 comp rx=0 tx=0).stop 2024-09-16T07:29:44.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 msgr2=0x7f56280c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280c5960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5614009790 tx=0x7f56140040e0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 shutdown_connections 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f56080730a0 0x7f5608075560 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f562815f490 0x7f56280c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56280b2e80 0x7f56280c5960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 --2- 172.21.15.114:0/1660043457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56280afca0 0x7f562814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 >> 172.21.15.114:0/1660043457 conn(0x7f56280d1e30 msgr2=0x7f56280d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 shutdown_connections 2024-09-16T07:29:44.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.276+0000 7f562f400640 1 -- 172.21.15.114:0/1660043457 wait complete. 2024-09-16T07:29:44.299 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:29:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.436+0000 7f611d200640 1 -- 172.21.15.114:0/79785324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60fc004810 msgr2=0x7f60fc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.436+0000 7f611d200640 1 --2- 172.21.15.114:0/79785324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60fc004810 0x7f60fc004c90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6100009b60 tx=0x7f610001d210 comp rx=0 tx=0).stop 2024-09-16T07:29:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.436+0000 7f6116800640 1 -- 172.21.15.114:0/79785324 reap_dead start 2024-09-16T07:29:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.436+0000 7f611d200640 1 -- 172.21.15.114:0/79785324 shutdown_connections 2024-09-16T07:29:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.436+0000 7f611d200640 1 -- 172.21.15.114:0/79785324 >> 172.21.15.114:0/79785324 conn(0x7f61180d1dc0 msgr2=0x7f61180d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.436+0000 7f611d200640 1 -- 172.21.15.114:0/79785324 shutdown_connections 2024-09-16T07:29:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.436+0000 7f611d200640 1 -- 172.21.15.114:0/79785324 wait complete. 2024-09-16T07:29:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 Processor -- start 2024-09-16T07:29:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 -- start start 2024-09-16T07:29:44.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc004810 0x7f61181f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61181f44b0 0x7f611806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6118071ad0 0x7f6118071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f611815c470 con 0x7f61181f44b0 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61180d2af0 con 0x7f60fc004810 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61180ae9b0 con 0x7f6118071ad0 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61181f44b0 0x7f611806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61181f44b0 0x7f611806eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33746/0 (socket says 172.21.15.114:33746) 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 -- 172.21.15.114:0/1866121656 learned_addr learned my addr 172.21.15.114:0/1866121656 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f6115e00640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc004810 0x7f61181f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 -- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6118071ad0 msgr2=0x7f6118071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6118071ad0 0x7f6118071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 -- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc004810 msgr2=0x7f61181f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc004810 0x7f61181f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 -- 172.21.15.114:0/1866121656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61181f4a00 con 0x7f61181f44b0 2024-09-16T07:29:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610d400640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61181f44b0 0x7f611806eed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f610001d040 tx=0x7f6100005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610ea00640 1 -- 172.21.15.114:0/1866121656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61000b1040 con 0x7f61181f44b0 2024-09-16T07:29:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610ea00640 1 -- 172.21.15.114:0/1866121656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61000ac8a0 con 0x7f61181f44b0 2024-09-16T07:29:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f610ea00640 1 -- 172.21.15.114:0/1866121656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61000accd0 con 0x7f61181f44b0 2024-09-16T07:29:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61181f4ce0 con 0x7f61181f44b0 2024-09-16T07:29:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.440+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61181f52a0 con 0x7f61181f44b0 2024-09-16T07:29:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.444+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61180ce670 con 0x7f61181f44b0 2024-09-16T07:29:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.444+0000 7f610ea00640 1 -- 172.21.15.114:0/1866121656 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f61000bf060 con 0x7f61181f44b0 2024-09-16T07:29:44.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.444+0000 7f610ea00640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f60f40730a0 0x7f60f4075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.444+0000 7f610ea00640 1 -- 172.21.15.114:0/1866121656 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f610012e260 con 0x7f61181f44b0 2024-09-16T07:29:44.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.444+0000 7f6115e00640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f60f40730a0 0x7f60f4075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.444+0000 7f6115e00640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f60f40730a0 0x7f60f4075560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6108001d60 tx=0x7f6108006ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.448+0000 7f610ea00640 1 -- 172.21.15.114:0/1866121656 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6100016f80 con 0x7f61181f44b0 2024-09-16T07:29:44.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.616+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f611815ab20 con 0x7f61181f44b0 2024-09-16T07:29:44.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.616+0000 7f610ea00640 1 -- 172.21.15.114:0/1866121656 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16721 (secure 0 0 0) 0x7f61000f9080 con 0x7f61181f44b0 2024-09-16T07:29:44.621 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:44.621 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":44,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:29:41.877886+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:37.945620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:39.216269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:29:44.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f60f40730a0 msgr2=0x7f60f4075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f60f40730a0 0x7f60f4075560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6108001d60 tx=0x7f6108006ba0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61181f44b0 msgr2=0x7f611806eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61181f44b0 0x7f611806eed0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f610001d040 tx=0x7f6100005620 comp rx=0 tx=0).stop 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 shutdown_connections 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f60f40730a0 0x7f60f4075560 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6118071ad0 0x7f6118071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61181f44b0 0x7f611806eed0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 --2- 172.21.15.114:0/1866121656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60fc004810 0x7f61181f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 >> 172.21.15.114:0/1866121656 conn(0x7f61180d1dc0 msgr2=0x7f6118159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 shutdown_connections 2024-09-16T07:29:44.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.620+0000 7f611d200640 1 -- 172.21.15.114:0/1866121656 wait complete. 2024-09-16T07:29:44.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:29:44.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 -- 172.21.15.114:0/2440017807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c15bea0 msgr2=0x7fbf1c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 --2- 172.21.15.114:0/2440017807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c15bea0 0x7fbf1c0ce670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009840 tx=0x7fbf0c01c820 comp rx=0 tx=0).stop 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 -- 172.21.15.114:0/2440017807 shutdown_connections 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 --2- 172.21.15.114:0/2440017807 >> v2:172.21.15.149:3300/0 conn(0x7fbf1c0d28e0 0x7fbf1c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 --2- 172.21.15.114:0/2440017807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c15bea0 0x7fbf1c0ce670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 -- 172.21.15.114:0/2440017807 >> 172.21.15.114:0/2440017807 conn(0x7fbf1c0d1dc0 msgr2=0x7fbf1c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 -- 172.21.15.114:0/2440017807 shutdown_connections 2024-09-16T07:29:44.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.780+0000 7fbf22600640 1 -- 172.21.15.114:0/2440017807 wait complete. 2024-09-16T07:29:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 Processor -- start 2024-09-16T07:29:44.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 -- start start 2024-09-16T07:29:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf1c0cdb30 0x7fbf1c166330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c0d28e0 0x7fbf1c09e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf1c15bea0 0x7fbf1c09e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c168f10 con 0x7fbf1c15bea0 2024-09-16T07:29:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c168d90 con 0x7fbf1c0cdb30 2024-09-16T07:29:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c169090 con 0x7fbf1c0d28e0 2024-09-16T07:29:44.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf1c15bea0 0x7fbf1c09e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf1c15bea0 0x7fbf1c09e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33758/0 (socket says 172.21.15.114:33758) 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 -- 172.21.15.114:0/3395510606 learned_addr learned my addr 172.21.15.114:0/3395510606 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1b400640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf1c0cdb30 0x7fbf1c166330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1aa00640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c0d28e0 0x7fbf1c09e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 -- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c0d28e0 msgr2=0x7fbf1c09e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c0d28e0 0x7fbf1c09e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 -- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf1c0cdb30 msgr2=0x7fbf1c166330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf1c0cdb30 0x7fbf1c166330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 -- 172.21.15.114:0/3395510606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c147f70 con 0x7fbf1c15bea0 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf1be00640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf1c15bea0 0x7fbf1c09e8a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400eb50 tx=0x7fbf1400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf13400640 1 -- 172.21.15.114:0/3395510606 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14004d30 con 0x7fbf1c15bea0 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1c1479b0 con 0x7fbf1c15bea0 2024-09-16T07:29:44.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf13400640 1 -- 172.21.15.114:0/3395510606 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf1400ee50 con 0x7fbf1c15bea0 2024-09-16T07:29:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf13400640 1 -- 172.21.15.114:0/3395510606 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14005280 con 0x7fbf1c15bea0 2024-09-16T07:29:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1c0b1ad0 con 0x7fbf1c15bea0 2024-09-16T07:29:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.784+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf1c0cc9d0 con 0x7fbf1c15bea0 2024-09-16T07:29:44.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.788+0000 7fbf13400640 1 -- 172.21.15.114:0/3395510606 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fbf14005420 con 0x7fbf1c15bea0 2024-09-16T07:29:44.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.788+0000 7fbf13400640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbefc073070 0x7fbefc075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:44.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.788+0000 7fbf13400640 1 -- 172.21.15.114:0/3395510606 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fbf14094f10 con 0x7fbf1c15bea0 2024-09-16T07:29:44.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.788+0000 7fbf1b400640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbefc073070 0x7fbefc075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:44.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.788+0000 7fbf1b400640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbefc073070 0x7fbefc075530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0af000 tx=0x7fbf0c01b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:44.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.792+0000 7fbf13400640 1 -- 172.21.15.114:0/3395510606 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbf1405f660 con 0x7fbf1c15bea0 2024-09-16T07:29:44.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.956+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf1c0b01a0 con 0x7fbefc073070 2024-09-16T07:29:44.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.960+0000 7fbf13400640 1 -- 172.21.15.114:0/3395510606 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246064 (secure 0 0 0) 0x7fbf1c0b01a0 con 0x7fbefc073070 2024-09-16T07:29:44.968 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:44.970 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbefc073070 msgr2=0x7fbefc075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbefc073070 0x7fbefc075530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0af000 tx=0x7fbf0c01b060 comp rx=0 tx=0).stop 2024-09-16T07:29:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf1c15bea0 msgr2=0x7fbf1c09e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf1c15bea0 0x7fbf1c09e8a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400eb50 tx=0x7fbf1400c6a0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 shutdown_connections 2024-09-16T07:29:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbefc073070 0x7fbefc075530 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf1c15bea0 0x7fbf1c09e8a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf1c0d28e0 0x7fbf1c09e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 --2- 172.21.15.114:0/3395510606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf1c0cdb30 0x7fbf1c166330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:44.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 >> 172.21.15.114:0/3395510606 conn(0x7fbf1c0d1dc0 msgr2=0x7fbf1c15aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:44.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 shutdown_connections 2024-09-16T07:29:44.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:44.964+0000 7fbf22600640 1 -- 172.21.15.114:0/3395510606 wait complete. 2024-09-16T07:29:44.989 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-16T07:29:43.012942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221104,"kb_used_data":4852,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":4968448,"data_stored":2653611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.157669"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865421+0000","last_change":"2024-09-16T07:29:39.865421+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865421+0000","last_undegraded":"2024-09-16T07:29:39.865421+0000","last_fullsized":"2024-09-16T07:29:39.865421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866535+0000","last_change":"2024-09-16T07:29:39.866535+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866535+0000","last_undegraded":"2024-09-16T07:29:39.866535+0000","last_fullsized":"2024-09-16T07:29:39.866535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.876573+0000","last_change":"2024-09-16T07:29:39.876573+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.876573+0000","last_undegraded":"2024-09-16T07:29:39.876573+0000","last_fullsized":"2024-09-16T07:29:39.876573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874114+0000","last_change":"2024-09-16T07:29:39.874114+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874114+0000","last_undegraded":"2024-09-16T07:29:39.874114+0000","last_fullsized":"2024-09-16T07:29:39.874114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866051+0000","last_change":"2024-09-16T07:29:39.866051+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866051+0000","last_undegraded":"2024-09-16T07:29:39.866051+0000","last_fullsized":"2024-09-16T07:29:39.866051+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867756+0000","last_change":"2024-09-16T07:29:39.867756+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867756+0000","last_undegraded":"2024-09-16T07:29:39.867756+0000","last_fullsized":"2024-09-16T07:29:39.867756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865262+0000","last_change":"2024-09-16T07:29:39.865262+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865262+0000","last_undegraded":"2024-09-16T07:29:39.865262+0000","last_fullsized":"2024-09-16T07:29:39.865262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877907+0000","last_change":"2024-09-16T07:29:39.877907+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877907+0000","last_undegraded":"2024-09-16T07:29:39.877907+0000","last_fullsized":"2024-09-16T07:29:39.877907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875034+0000","last_change":"2024-09-16T07:29:39.875034+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875034+0000","last_undegraded":"2024-09-16T07:29:39.875034+0000","last_fullsized":"2024-09-16T07:29:39.875034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875359+0000","last_change":"2024-09-16T07:29:39.875359+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875359+0000","last_undegraded":"2024-09-16T07:29:39.875359+0000","last_fullsized":"2024-09-16T07:29:39.875359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878663+0000","last_change":"2024-09-16T07:29:39.878663+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878663+0000","last_undegraded":"2024-09-16T07:29:39.878663+0000","last_fullsized":"2024-09-16T07:29:39.878663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867105+0000","last_change":"2024-09-16T07:29:39.867105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867105+0000","last_undegraded":"2024-09-16T07:29:39.867105+0000","last_fullsized":"2024-09-16T07:29:39.867105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:39.850949+0000","last_change":"2024-09-16T07:29:39.850949+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.850949+0000","last_undegraded":"2024-09-16T07:29:39.850949+0000","last_fullsized":"2024-09-16T07:29:39.850949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875826+0000","last_change":"2024-09-16T07:29:39.875826+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875826+0000","last_undegraded":"2024-09-16T07:29:39.875826+0000","last_fullsized":"2024-09-16T07:29:39.875826+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867469+0000","last_change":"2024-09-16T07:29:39.867469+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867469+0000","last_undegraded":"2024-09-16T07:29:39.867469+0000","last_fullsized":"2024-09-16T07:29:39.867469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868646+0000","last_change":"2024-09-16T07:29:39.868646+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868646+0000","last_undegraded":"2024-09-16T07:29:39.868646+0000","last_fullsized":"2024-09-16T07:29:39.868646+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875302+0000","last_change":"2024-09-16T07:29:39.875302+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875302+0000","last_undegraded":"2024-09-16T07:29:39.875302+0000","last_fullsized":"2024-09-16T07:29:39.875302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878579+0000","last_change":"2024-09-16T07:29:39.878579+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878579+0000","last_undegraded":"2024-09-16T07:29:39.878579+0000","last_fullsized":"2024-09-16T07:29:39.878579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869105+0000","last_change":"2024-09-16T07:29:39.869105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869105+0000","last_undegraded":"2024-09-16T07:29:39.869105+0000","last_fullsized":"2024-09-16T07:29:39.869105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:39.850949+0000","last_change":"2024-09-16T07:29:39.850949+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.850949+0000","last_undegraded":"2024-09-16T07:29:39.850949+0000","last_fullsized":"2024-09-16T07:29:39.850949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.870163+0000","last_change":"2024-09-16T07:29:39.870163+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.870163+0000","last_undegraded":"2024-09-16T07:29:39.870163+0000","last_fullsized":"2024-09-16T07:29:39.870163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875466+0000","last_change":"2024-09-16T07:29:39.875466+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875466+0000","last_undegraded":"2024-09-16T07:29:39.875466+0000","last_fullsized":"2024-09-16T07:29:39.875466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868964+0000","last_change":"2024-09-16T07:29:39.868964+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868964+0000","last_undegraded":"2024-09-16T07:29:39.868964+0000","last_fullsized":"2024-09-16T07:29:39.868964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867472+0000","last_change":"2024-09-16T07:29:39.867472+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867472+0000","last_undegraded":"2024-09-16T07:29:39.867472+0000","last_fullsized":"2024-09-16T07:29:39.867472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867678+0000","last_change":"2024-09-16T07:29:39.867678+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867678+0000","last_undegraded":"2024-09-16T07:29:39.867678+0000","last_fullsized":"2024-09-16T07:29:39.867678+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:39.850949+0000","last_change":"2024-09-16T07:29:39.850949+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.850949+0000","last_undegraded":"2024-09-16T07:29:39.850949+0000","last_fullsized":"2024-09-16T07:29:39.850949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874644+0000","last_change":"2024-09-16T07:29:39.874644+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874644+0000","last_undegraded":"2024-09-16T07:29:39.874644+0000","last_fullsized":"2024-09-16T07:29:39.874644+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866700+0000","last_change":"2024-09-16T07:29:39.866700+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866700+0000","last_undegraded":"2024-09-16T07:29:39.866700+0000","last_fullsized":"2024-09-16T07:29:39.866700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868093+0000","last_change":"2024-09-16T07:29:39.868093+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868093+0000","last_undegraded":"2024-09-16T07:29:39.868093+0000","last_fullsized":"2024-09-16T07:29:39.868093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875529+0000","last_change":"2024-09-16T07:29:39.875529+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875529+0000","last_undegraded":"2024-09-16T07:29:39.875529+0000","last_fullsized":"2024-09-16T07:29:39.875529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866942+0000","last_change":"2024-09-16T07:29:39.866942+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866942+0000","last_undegraded":"2024-09-16T07:29:39.866942+0000","last_fullsized":"2024-09-16T07:29:39.866942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:39.850949+0000","last_change":"2024-09-16T07:29:39.850949+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.850949+0000","last_undegraded":"2024-09-16T07:29:39.850949+0000","last_fullsized":"2024-09-16T07:29:39.850949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867156+0000","last_change":"2024-09-16T07:29:39.867156+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867156+0000","last_undegraded":"2024-09-16T07:29:39.867156+0000","last_fullsized":"2024-09-16T07:29:39.867156+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886213+0000","last_change":"2024-09-16T07:29:39.879762+0000","last_active":"2024-09-16T07:29:39.886213+0000","last_peered":"2024-09-16T07:29:39.886213+0000","last_clean":"2024-09-16T07:29:39.886213+0000","last_became_active":"2024-09-16T07:29:39.879485+0000","last_became_peered":"2024-09-16T07:29:39.879485+0000","last_unstale":"2024-09-16T07:29:39.886213+0000","last_undegraded":"2024-09-16T07:29:39.886213+0000","last_fullsized":"2024-09-16T07:29:39.886213+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:26.574030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867143+0000","last_change":"2024-09-16T07:29:39.867143+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867143+0000","last_undegraded":"2024-09-16T07:29:39.867143+0000","last_fullsized":"2024-09-16T07:29:39.867143+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890481+0000","last_change":"2024-09-16T07:29:39.885953+0000","last_active":"2024-09-16T07:29:39.890481+0000","last_peered":"2024-09-16T07:29:39.890481+0000","last_clean":"2024-09-16T07:29:39.890481+0000","last_became_active":"2024-09-16T07:29:39.885790+0000","last_became_peered":"2024-09-16T07:29:39.885790+0000","last_unstale":"2024-09-16T07:29:39.890481+0000","last_undegraded":"2024-09-16T07:29:39.890481+0000","last_fullsized":"2024-09-16T07:29:39.890481+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.094051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866249+0000","last_change":"2024-09-16T07:29:39.866249+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866249+0000","last_undegraded":"2024-09-16T07:29:39.866249+0000","last_fullsized":"2024-09-16T07:29:39.866249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886021+0000","last_change":"2024-09-16T07:29:39.879740+0000","last_active":"2024-09-16T07:29:39.886021+0000","last_peered":"2024-09-16T07:29:39.886021+0000","last_clean":"2024-09-16T07:29:39.886021+0000","last_became_active":"2024-09-16T07:29:39.879515+0000","last_became_peered":"2024-09-16T07:29:39.879515+0000","last_unstale":"2024-09-16T07:29:39.886021+0000","last_undegraded":"2024-09-16T07:29:39.886021+0000","last_fullsized":"2024-09-16T07:29:39.886021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:18.486646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867072+0000","last_change":"2024-09-16T07:29:39.867072+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867072+0000","last_undegraded":"2024-09-16T07:29:39.867072+0000","last_fullsized":"2024-09-16T07:29:39.867072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890350+0000","last_change":"2024-09-16T07:29:39.883681+0000","last_active":"2024-09-16T07:29:39.890350+0000","last_peered":"2024-09-16T07:29:39.890350+0000","last_clean":"2024-09-16T07:29:39.890350+0000","last_became_active":"2024-09-16T07:29:39.883379+0000","last_became_peered":"2024-09-16T07:29:39.883379+0000","last_unstale":"2024-09-16T07:29:39.890350+0000","last_undegraded":"2024-09-16T07:29:39.890350+0000","last_fullsized":"2024-09-16T07:29:39.890350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874833+0000","last_change":"2024-09-16T07:29:39.874833+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874833+0000","last_undegraded":"2024-09-16T07:29:39.874833+0000","last_fullsized":"2024-09-16T07:29:39.874833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890236+0000","last_change":"2024-09-16T07:29:39.887081+0000","last_active":"2024-09-16T07:29:39.890236+0000","last_peered":"2024-09-16T07:29:39.890236+0000","last_clean":"2024-09-16T07:29:39.890236+0000","last_became_active":"2024-09-16T07:29:39.886495+0000","last_became_peered":"2024-09-16T07:29:39.886495+0000","last_unstale":"2024-09-16T07:29:39.890236+0000","last_undegraded":"2024-09-16T07:29:39.890236+0000","last_fullsized":"2024-09-16T07:29:39.890236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:41.057483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878951+0000","last_change":"2024-09-16T07:29:39.878951+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878951+0000","last_undegraded":"2024-09-16T07:29:39.878951+0000","last_fullsized":"2024-09-16T07:29:39.878951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887879+0000","last_change":"2024-09-16T07:29:39.883435+0000","last_active":"2024-09-16T07:29:39.887879+0000","last_peered":"2024-09-16T07:29:39.887879+0000","last_clean":"2024-09-16T07:29:39.887879+0000","last_became_active":"2024-09-16T07:29:39.883171+0000","last_became_peered":"2024-09-16T07:29:39.883171+0000","last_unstale":"2024-09-16T07:29:39.887879+0000","last_undegraded":"2024-09-16T07:29:39.887879+0000","last_fullsized":"2024-09-16T07:29:39.887879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:19:18.647616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877557+0000","last_change":"2024-09-16T07:29:39.877557+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877557+0000","last_undegraded":"2024-09-16T07:29:39.877557+0000","last_fullsized":"2024-09-16T07:29:39.877557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.879105+0000","last_change":"2024-09-16T07:29:39.873042+0000","last_active":"2024-09-16T07:29:39.879105+0000","last_peered":"2024-09-16T07:29:39.879105+0000","last_clean":"2024-09-16T07:29:39.879105+0000","last_became_active":"2024-09-16T07:29:39.872658+0000","last_became_peered":"2024-09-16T07:29:39.872658+0000","last_unstale":"2024-09-16T07:29:39.879105+0000","last_undegraded":"2024-09-16T07:29:39.879105+0000","last_fullsized":"2024-09-16T07:29:39.879105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:35.078592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867062+0000","last_change":"2024-09-16T07:29:39.867062+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867062+0000","last_undegraded":"2024-09-16T07:29:39.867062+0000","last_fullsized":"2024-09-16T07:29:39.867062+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892814+0000","last_change":"2024-09-16T07:29:39.888960+0000","last_active":"2024-09-16T07:29:39.892814+0000","last_peered":"2024-09-16T07:29:39.892814+0000","last_clean":"2024-09-16T07:29:39.892814+0000","last_became_active":"2024-09-16T07:29:39.888703+0000","last_became_peered":"2024-09-16T07:29:39.888703+0000","last_unstale":"2024-09-16T07:29:39.892814+0000","last_undegraded":"2024-09-16T07:29:39.892814+0000","last_fullsized":"2024-09-16T07:29:39.892814+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:46.078460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877960+0000","last_change":"2024-09-16T07:29:39.877960+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877960+0000","last_undegraded":"2024-09-16T07:29:39.877960+0000","last_fullsized":"2024-09-16T07:29:39.877960+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887868+0000","last_change":"2024-09-16T07:29:39.884308+0000","last_active":"2024-09-16T07:29:39.887868+0000","last_peered":"2024-09-16T07:29:39.887868+0000","last_clean":"2024-09-16T07:29:39.887868+0000","last_became_active":"2024-09-16T07:29:39.883979+0000","last_became_peered":"2024-09-16T07:29:39.883979+0000","last_unstale":"2024-09-16T07:29:39.887868+0000","last_undegraded":"2024-09-16T07:29:39.887868+0000","last_fullsized":"2024-09-16T07:29:39.887868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:32.206213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864953+0000","last_change":"2024-09-16T07:29:39.864953+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864953+0000","last_undegraded":"2024-09-16T07:29:39.864953+0000","last_fullsized":"2024-09-16T07:29:39.864953+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892866+0000","last_change":"2024-09-16T07:29:39.889286+0000","last_active":"2024-09-16T07:29:39.892866+0000","last_peered":"2024-09-16T07:29:39.892866+0000","last_clean":"2024-09-16T07:29:39.892866+0000","last_became_active":"2024-09-16T07:29:39.888837+0000","last_became_peered":"2024-09-16T07:29:39.888837+0000","last_unstale":"2024-09-16T07:29:39.892866+0000","last_undegraded":"2024-09-16T07:29:39.892866+0000","last_fullsized":"2024-09-16T07:29:39.892866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:56.573970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868428+0000","last_change":"2024-09-16T07:29:39.868428+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868428+0000","last_undegraded":"2024-09-16T07:29:39.868428+0000","last_fullsized":"2024-09-16T07:29:39.868428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887500+0000","last_change":"2024-09-16T07:29:39.881119+0000","last_active":"2024-09-16T07:29:39.887500+0000","last_peered":"2024-09-16T07:29:39.887500+0000","last_clean":"2024-09-16T07:29:39.887500+0000","last_became_active":"2024-09-16T07:29:39.880463+0000","last_became_peered":"2024-09-16T07:29:39.880463+0000","last_unstale":"2024-09-16T07:29:39.887500+0000","last_undegraded":"2024-09-16T07:29:39.887500+0000","last_fullsized":"2024-09-16T07:29:39.887500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:24.703174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865621+0000","last_change":"2024-09-16T07:29:39.865621+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865621+0000","last_undegraded":"2024-09-16T07:29:39.865621+0000","last_fullsized":"2024-09-16T07:29:39.865621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:29:38.863072+0000","last_change":"2024-09-16T07:29:38.863072+0000","last_active":"2024-09-16T07:29:38.848393+0000","last_peered":"2024-09-16T07:29:38.848393+0000","last_clean":"2024-09-16T07:29:38.848393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:38.863072+0000","last_undegraded":"2024-09-16T07:29:38.863072+0000","last_fullsized":"2024-09-16T07:29:38.863072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866086+0000","last_change":"2024-09-16T07:29:39.866086+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866086+0000","last_undegraded":"2024-09-16T07:29:39.866086+0000","last_fullsized":"2024-09-16T07:29:39.866086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888047+0000","last_change":"2024-09-16T07:29:39.885365+0000","last_active":"2024-09-16T07:29:39.888047+0000","last_peered":"2024-09-16T07:29:39.888047+0000","last_clean":"2024-09-16T07:29:39.888047+0000","last_became_active":"2024-09-16T07:29:39.884959+0000","last_became_peered":"2024-09-16T07:29:39.884959+0000","last_unstale":"2024-09-16T07:29:39.888047+0000","last_undegraded":"2024-09-16T07:29:39.888047+0000","last_fullsized":"2024-09-16T07:29:39.888047+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:17.128096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878546+0000","last_change":"2024-09-16T07:29:39.878546+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878546+0000","last_undegraded":"2024-09-16T07:29:39.878546+0000","last_fullsized":"2024-09-16T07:29:39.878546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887314+0000","last_change":"2024-09-16T07:29:39.877326+0000","last_active":"2024-09-16T07:29:39.887314+0000","last_peered":"2024-09-16T07:29:39.887314+0000","last_clean":"2024-09-16T07:29:39.887314+0000","last_became_active":"2024-09-16T07:29:39.877050+0000","last_became_peered":"2024-09-16T07:29:39.877050+0000","last_unstale":"2024-09-16T07:29:39.887314+0000","last_undegraded":"2024-09-16T07:29:39.887314+0000","last_fullsized":"2024-09-16T07:29:39.887314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:48.369661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866685+0000","last_change":"2024-09-16T07:29:39.866685+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866685+0000","last_undegraded":"2024-09-16T07:29:39.866685+0000","last_fullsized":"2024-09-16T07:29:39.866685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888072+0000","last_change":"2024-09-16T07:29:39.885291+0000","last_active":"2024-09-16T07:29:39.888072+0000","last_peered":"2024-09-16T07:29:39.888072+0000","last_clean":"2024-09-16T07:29:39.888072+0000","last_became_active":"2024-09-16T07:29:39.885042+0000","last_became_peered":"2024-09-16T07:29:39.885042+0000","last_unstale":"2024-09-16T07:29:39.888072+0000","last_undegraded":"2024-09-16T07:29:39.888072+0000","last_fullsized":"2024-09-16T07:29:39.888072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:03.118256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864736+0000","last_change":"2024-09-16T07:29:39.864736+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864736+0000","last_undegraded":"2024-09-16T07:29:39.864736+0000","last_fullsized":"2024-09-16T07:29:39.864736+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890066+0000","last_change":"2024-09-16T07:29:39.884132+0000","last_active":"2024-09-16T07:29:39.890066+0000","last_peered":"2024-09-16T07:29:39.890066+0000","last_clean":"2024-09-16T07:29:39.890066+0000","last_became_active":"2024-09-16T07:29:39.883836+0000","last_became_peered":"2024-09-16T07:29:39.883836+0000","last_unstale":"2024-09-16T07:29:39.890066+0000","last_undegraded":"2024-09-16T07:29:39.890066+0000","last_fullsized":"2024-09-16T07:29:39.890066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:40.793320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:39.850949+0000","last_change":"2024-09-16T07:29:39.850949+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.850949+0000","last_undegraded":"2024-09-16T07:29:39.850949+0000","last_fullsized":"2024-09-16T07:29:39.850949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:29:38.863063+0000","last_change":"2024-09-16T07:29:38.863063+0000","last_active":"2024-09-16T07:29:38.848393+0000","last_peered":"2024-09-16T07:29:38.848393+0000","last_clean":"2024-09-16T07:29:38.848393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:38.863063+0000","last_undegraded":"2024-09-16T07:29:38.863063+0000","last_fullsized":"2024-09-16T07:29:38.863063+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874640+0000","last_change":"2024-09-16T07:29:39.874640+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874640+0000","last_undegraded":"2024-09-16T07:29:39.874640+0000","last_fullsized":"2024-09-16T07:29:39.874640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.893178+0000","last_change":"2024-09-16T07:29:39.888996+0000","last_active":"2024-09-16T07:29:39.893178+0000","last_peered":"2024-09-16T07:29:39.893178+0000","last_clean":"2024-09-16T07:29:39.893178+0000","last_became_active":"2024-09-16T07:29:39.888800+0000","last_became_peered":"2024-09-16T07:29:39.888800+0000","last_unstale":"2024-09-16T07:29:39.893178+0000","last_undegraded":"2024-09-16T07:29:39.893178+0000","last_fullsized":"2024-09-16T07:29:39.893178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.839005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865792+0000","last_change":"2024-09-16T07:29:39.865792+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865792+0000","last_undegraded":"2024-09-16T07:29:39.865792+0000","last_fullsized":"2024-09-16T07:29:39.865792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.880938+0000","last_change":"2024-09-16T07:29:39.875251+0000","last_active":"2024-09-16T07:29:39.880938+0000","last_peered":"2024-09-16T07:29:39.880938+0000","last_clean":"2024-09-16T07:29:39.880938+0000","last_became_active":"2024-09-16T07:29:39.875004+0000","last_became_peered":"2024-09-16T07:29:39.875004+0000","last_unstale":"2024-09-16T07:29:39.880938+0000","last_undegraded":"2024-09-16T07:29:39.880938+0000","last_fullsized":"2024-09-16T07:29:39.880938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:45.556407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866527+0000","last_change":"2024-09-16T07:29:39.866527+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866527+0000","last_undegraded":"2024-09-16T07:29:39.866527+0000","last_fullsized":"2024-09-16T07:29:39.866527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884516+0000","last_change":"2024-09-16T07:29:39.878820+0000","last_active":"2024-09-16T07:29:39.884516+0000","last_peered":"2024-09-16T07:29:39.884516+0000","last_clean":"2024-09-16T07:29:39.884516+0000","last_became_active":"2024-09-16T07:29:39.878471+0000","last_became_peered":"2024-09-16T07:29:39.878471+0000","last_unstale":"2024-09-16T07:29:39.884516+0000","last_undegraded":"2024-09-16T07:29:39.884516+0000","last_fullsized":"2024-09-16T07:29:39.884516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:50:08.547444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867321+0000","last_change":"2024-09-16T07:29:39.867321+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867321+0000","last_undegraded":"2024-09-16T07:29:39.867321+0000","last_fullsized":"2024-09-16T07:29:39.867321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884787+0000","last_change":"2024-09-16T07:29:39.875309+0000","last_active":"2024-09-16T07:29:39.884787+0000","last_peered":"2024-09-16T07:29:39.884787+0000","last_clean":"2024-09-16T07:29:39.884787+0000","last_became_active":"2024-09-16T07:29:39.875039+0000","last_became_peered":"2024-09-16T07:29:39.875039+0000","last_unstale":"2024-09-16T07:29:39.884787+0000","last_undegraded":"2024-09-16T07:29:39.884787+0000","last_fullsized":"2024-09-16T07:29:39.884787+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869690+0000","last_change":"2024-09-16T07:29:39.869690+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869690+0000","last_undegraded":"2024-09-16T07:29:39.869690+0000","last_fullsized":"2024-09-16T07:29:39.869690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.882704+0000","last_change":"2024-09-16T07:29:39.877319+0000","last_active":"2024-09-16T07:29:39.882704+0000","last_peered":"2024-09-16T07:29:39.882704+0000","last_clean":"2024-09-16T07:29:39.882704+0000","last_became_active":"2024-09-16T07:29:39.876985+0000","last_became_peered":"2024-09-16T07:29:39.876985+0000","last_unstale":"2024-09-16T07:29:39.882704+0000","last_undegraded":"2024-09-16T07:29:39.882704+0000","last_fullsized":"2024-09-16T07:29:39.882704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:30.703785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:29:39.850949+0000","last_change":"2024-09-16T07:29:39.850949+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.850949+0000","last_undegraded":"2024-09-16T07:29:39.850949+0000","last_fullsized":"2024-09-16T07:29:39.850949+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892832+0000","last_change":"2024-09-16T07:29:39.889122+0000","last_active":"2024-09-16T07:29:39.892832+0000","last_peered":"2024-09-16T07:29:39.892832+0000","last_clean":"2024-09-16T07:29:39.892832+0000","last_became_active":"2024-09-16T07:29:39.888890+0000","last_became_peered":"2024-09-16T07:29:39.888890+0000","last_unstale":"2024-09-16T07:29:39.892832+0000","last_undegraded":"2024-09-16T07:29:39.892832+0000","last_fullsized":"2024-09-16T07:29:39.892832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:52.147472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877065+0000","last_change":"2024-09-16T07:29:39.877065+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877065+0000","last_undegraded":"2024-09-16T07:29:39.877065+0000","last_fullsized":"2024-09-16T07:29:39.877065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890340+0000","last_change":"2024-09-16T07:29:39.883628+0000","last_active":"2024-09-16T07:29:39.890340+0000","last_peered":"2024-09-16T07:29:39.890340+0000","last_clean":"2024-09-16T07:29:39.890340+0000","last_became_active":"2024-09-16T07:29:39.883294+0000","last_became_peered":"2024-09-16T07:29:39.883294+0000","last_unstale":"2024-09-16T07:29:39.890340+0000","last_undegraded":"2024-09-16T07:29:39.890340+0000","last_fullsized":"2024-09-16T07:29:39.890340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:15:03.149984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865824+0000","last_change":"2024-09-16T07:29:39.865824+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865824+0000","last_undegraded":"2024-09-16T07:29:39.865824+0000","last_fullsized":"2024-09-16T07:29:39.865824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888472+0000","last_change":"2024-09-16T07:29:39.886269+0000","last_active":"2024-09-16T07:29:39.888472+0000","last_peered":"2024-09-16T07:29:39.888472+0000","last_clean":"2024-09-16T07:29:39.888472+0000","last_became_active":"2024-09-16T07:29:39.885929+0000","last_became_peered":"2024-09-16T07:29:39.885929+0000","last_unstale":"2024-09-16T07:29:39.888472+0000","last_undegraded":"2024-09-16T07:29:39.888472+0000","last_fullsized":"2024-09-16T07:29:39.888472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.873597+0000","last_change":"2024-09-16T07:29:39.873597+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.873597+0000","last_undegraded":"2024-09-16T07:29:39.873597+0000","last_fullsized":"2024-09-16T07:29:39.873597+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887526+0000","last_change":"2024-09-16T07:29:39.881323+0000","last_active":"2024-09-16T07:29:39.887526+0000","last_peered":"2024-09-16T07:29:39.887526+0000","last_clean":"2024-09-16T07:29:39.887526+0000","last_became_active":"2024-09-16T07:29:39.880843+0000","last_became_peered":"2024-09-16T07:29:39.880843+0000","last_unstale":"2024-09-16T07:29:39.887526+0000","last_undegraded":"2024-09-16T07:29:39.887526+0000","last_fullsized":"2024-09-16T07:29:39.887526+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:38:28.410493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864744+0000","last_change":"2024-09-16T07:29:39.864744+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864744+0000","last_undegraded":"2024-09-16T07:29:39.864744+0000","last_fullsized":"2024-09-16T07:29:39.864744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888449+0000","last_change":"2024-09-16T07:29:39.884411+0000","last_active":"2024-09-16T07:29:39.888449+0000","last_peered":"2024-09-16T07:29:39.888449+0000","last_clean":"2024-09-16T07:29:39.888449+0000","last_became_active":"2024-09-16T07:29:39.882654+0000","last_became_peered":"2024-09-16T07:29:39.882654+0000","last_unstale":"2024-09-16T07:29:39.888449+0000","last_undegraded":"2024-09-16T07:29:39.888449+0000","last_fullsized":"2024-09-16T07:29:39.888449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:55:16.541963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866691+0000","last_change":"2024-09-16T07:29:39.866691+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866691+0000","last_undegraded":"2024-09-16T07:29:39.866691+0000","last_fullsized":"2024-09-16T07:29:39.866691+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887291+0000","last_change":"2024-09-16T07:29:39.878614+0000","last_active":"2024-09-16T07:29:39.887291+0000","last_peered":"2024-09-16T07:29:39.887291+0000","last_clean":"2024-09-16T07:29:39.887291+0000","last_became_active":"2024-09-16T07:29:39.878365+0000","last_became_peered":"2024-09-16T07:29:39.878365+0000","last_unstale":"2024-09-16T07:29:39.887291+0000","last_undegraded":"2024-09-16T07:29:39.887291+0000","last_fullsized":"2024-09-16T07:29:39.887291+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:43.611481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869794+0000","last_change":"2024-09-16T07:29:39.869794+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869794+0000","last_undegraded":"2024-09-16T07:29:39.869794+0000","last_fullsized":"2024-09-16T07:29:39.869794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890518+0000","last_change":"2024-09-16T07:29:39.886820+0000","last_active":"2024-09-16T07:29:39.890518+0000","last_peered":"2024-09-16T07:29:39.890518+0000","last_clean":"2024-09-16T07:29:39.890518+0000","last_became_active":"2024-09-16T07:29:39.886480+0000","last_became_peered":"2024-09-16T07:29:39.886480+0000","last_unstale":"2024-09-16T07:29:39.890518+0000","last_undegraded":"2024-09-16T07:29:39.890518+0000","last_fullsized":"2024-09-16T07:29:39.890518+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:10.572704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864858+0000","last_change":"2024-09-16T07:29:39.864858+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864858+0000","last_undegraded":"2024-09-16T07:29:39.864858+0000","last_fullsized":"2024-09-16T07:29:39.864858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.885632+0000","last_change":"2024-09-16T07:29:39.877534+0000","last_active":"2024-09-16T07:29:39.885632+0000","last_peered":"2024-09-16T07:29:39.885632+0000","last_clean":"2024-09-16T07:29:39.885632+0000","last_became_active":"2024-09-16T07:29:39.877243+0000","last_became_peered":"2024-09-16T07:29:39.877243+0000","last_unstale":"2024-09-16T07:29:39.885632+0000","last_undegraded":"2024-09-16T07:29:39.885632+0000","last_fullsized":"2024-09-16T07:29:39.885632+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:07.629863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874229+0000","last_change":"2024-09-16T07:29:39.874229+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874229+0000","last_undegraded":"2024-09-16T07:29:39.874229+0000","last_fullsized":"2024-09-16T07:29:39.874229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892771+0000","last_change":"2024-09-16T07:29:39.887812+0000","last_active":"2024-09-16T07:29:39.892771+0000","last_peered":"2024-09-16T07:29:39.892771+0000","last_clean":"2024-09-16T07:29:39.892771+0000","last_became_active":"2024-09-16T07:29:39.886975+0000","last_became_peered":"2024-09-16T07:29:39.886975+0000","last_unstale":"2024-09-16T07:29:39.892771+0000","last_undegraded":"2024-09-16T07:29:39.892771+0000","last_fullsized":"2024-09-16T07:29:39.892771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.849005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874253+0000","last_change":"2024-09-16T07:29:39.874253+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874253+0000","last_undegraded":"2024-09-16T07:29:39.874253+0000","last_fullsized":"2024-09-16T07:29:39.874253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884961+0000","last_change":"2024-09-16T07:29:39.880008+0000","last_active":"2024-09-16T07:29:39.884961+0000","last_peered":"2024-09-16T07:29:39.884961+0000","last_clean":"2024-09-16T07:29:39.884961+0000","last_became_active":"2024-09-16T07:29:39.879765+0000","last_became_peered":"2024-09-16T07:29:39.879765+0000","last_unstale":"2024-09-16T07:29:39.884961+0000","last_undegraded":"2024-09-16T07:29:39.884961+0000","last_fullsized":"2024-09-16T07:29:39.884961+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:35.640560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.870813+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:39.870813+0000","last_peered":"2024-09-16T07:29:39.870813+0000","last_clean":"2024-09-16T07:29:39.870813+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:39.870813+0000","last_undegraded":"2024-09-16T07:29:39.870813+0000","last_fullsized":"2024-09-16T07:29:39.870813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1077248,"data_stored":779961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":773694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:44.994 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:45.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- 172.21.15.114:0/1639067110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec0cefb0 msgr2=0x7faaec0cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 --2- 172.21.15.114:0/1639067110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec0cefb0 0x7faaec0cc5b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faaec09b750 tx=0x7faad401c7a0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- 172.21.15.114:0/1639067110 shutdown_connections 2024-09-16T07:29:45.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 --2- 172.21.15.114:0/1639067110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec0cefb0 0x7faaec0cc5b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 --2- 172.21.15.114:0/1639067110 >> v2:172.21.15.149:3300/0 conn(0x7faaec15f000 0x7faaec0d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- 172.21.15.114:0/1639067110 >> 172.21.15.114:0/1639067110 conn(0x7faaec09aa10 msgr2=0x7faaec09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:45.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- 172.21.15.114:0/1639067110 shutdown_connections 2024-09-16T07:29:45.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- 172.21.15.114:0/1639067110 wait complete. 2024-09-16T07:29:45.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 Processor -- start 2024-09-16T07:29:45.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- start start 2024-09-16T07:29:45.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaec0ccaf0 0x7faaec15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaec0cefb0 0x7faaec1f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec15f000 0x7faaec15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faaec1692e0 con 0x7faaec15f000 2024-09-16T07:29:45.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faaec169160 con 0x7faaec0ccaf0 2024-09-16T07:29:45.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faaec169460 con 0x7faaec0cefb0 2024-09-16T07:29:45.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec15f000 0x7faaec15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec15f000 0x7faaec15db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33772/0 (socket says 172.21.15.114:33772) 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 -- 172.21.15.114:0/4140268557 learned_addr learned my addr 172.21.15.114:0/4140268557 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1200640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaec0ccaf0 0x7faaec15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faae3e00640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaec0cefb0 0x7faaec1f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 -- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaec0cefb0 msgr2=0x7faaec1f8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaec0cefb0 0x7faaec1f8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 -- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaec0ccaf0 msgr2=0x7faaec15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaec0ccaf0 0x7faaec15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1c00640 1 -- 172.21.15.114:0/4140268557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec1f9280 con 0x7faaec15f000 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.172+0000 7faaf1200640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaec0ccaf0 0x7faaec15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faaf1c00640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec15f000 0x7faaec15db60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faae400c780 tx=0x7faae400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faae9600640 1 -- 172.21.15.114:0/4140268557 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4003ba0 con 0x7faaec15f000 2024-09-16T07:29:45.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faae9600640 1 -- 172.21.15.114:0/4140268557 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faae4003d60 con 0x7faaec15f000 2024-09-16T07:29:45.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faae9600640 1 -- 172.21.15.114:0/4140268557 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae400aab0 con 0x7faaec15f000 2024-09-16T07:29:45.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec163ad0 con 0x7faaec15f000 2024-09-16T07:29:45.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec164050 con 0x7faaec15f000 2024-09-16T07:29:45.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec0cc5b0 con 0x7faaec15f000 2024-09-16T07:29:45.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faae9600640 1 -- 172.21.15.114:0/4140268557 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7faae400ac50 con 0x7faaec15f000 2024-09-16T07:29:45.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faae9600640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faac8073070 0x7faac8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.176+0000 7faae9600640 1 -- 172.21.15.114:0/4140268557 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7faae4094110 con 0x7faaec15f000 2024-09-16T07:29:45.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.180+0000 7faaf1200640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faac8073070 0x7faac8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.180+0000 7faaf1200640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faac8073070 0x7faac8075530 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faadc005fd0 tx=0x7faadc005f20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:45.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.180+0000 7faae9600640 1 -- 172.21.15.114:0/4140268557 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7faaec1f9280 con 0x7faaec15f000 2024-09-16T07:29:45.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.348+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faaec0b3500 con 0x7faac8073070 2024-09-16T07:29:45.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.352+0000 7faae9600640 1 -- 172.21.15.114:0/4140268557 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247171 (secure 0 0 0) 0x7faadc00b7f0 con 0x7faac8073070 2024-09-16T07:29:45.358 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:45.360 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:45.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faac8073070 msgr2=0x7faac8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faac8073070 0x7faac8075530 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faadc005fd0 tx=0x7faadc005f20 comp rx=0 tx=0).stop 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec15f000 msgr2=0x7faaec15db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec15f000 0x7faaec15db60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7faae400c780 tx=0x7faae400cc40 comp rx=0 tx=0).stop 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 shutdown_connections 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7faac8073070 0x7faac8075530 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaec15f000 0x7faaec15db60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaec0cefb0 0x7faaec1f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 --2- 172.21.15.114:0/4140268557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaec0ccaf0 0x7faaec15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 >> 172.21.15.114:0/4140268557 conn(0x7faaec09aa10 msgr2=0x7faaec15d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 shutdown_connections 2024-09-16T07:29:45.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.356+0000 7faaf2600640 1 -- 172.21.15.114:0/4140268557 wait complete. 2024-09-16T07:29:45.379 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-16T07:29:45.013401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221160,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753560,"statfs":{"total":773094113280,"available":772867645440,"internally_reserved":0,"allocated":5021696,"data_stored":2674587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001665"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865421+0000","last_change":"2024-09-16T07:29:39.865421+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865421+0000","last_undegraded":"2024-09-16T07:29:39.865421+0000","last_fullsized":"2024-09-16T07:29:39.865421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866535+0000","last_change":"2024-09-16T07:29:39.866535+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866535+0000","last_undegraded":"2024-09-16T07:29:39.866535+0000","last_fullsized":"2024-09-16T07:29:39.866535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.876573+0000","last_change":"2024-09-16T07:29:39.876573+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.876573+0000","last_undegraded":"2024-09-16T07:29:39.876573+0000","last_fullsized":"2024-09-16T07:29:39.876573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874114+0000","last_change":"2024-09-16T07:29:39.874114+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874114+0000","last_undegraded":"2024-09-16T07:29:39.874114+0000","last_fullsized":"2024-09-16T07:29:39.874114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866051+0000","last_change":"2024-09-16T07:29:39.866051+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866051+0000","last_undegraded":"2024-09-16T07:29:39.866051+0000","last_fullsized":"2024-09-16T07:29:39.866051+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867756+0000","last_change":"2024-09-16T07:29:39.867756+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867756+0000","last_undegraded":"2024-09-16T07:29:39.867756+0000","last_fullsized":"2024-09-16T07:29:39.867756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865262+0000","last_change":"2024-09-16T07:29:39.865262+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865262+0000","last_undegraded":"2024-09-16T07:29:39.865262+0000","last_fullsized":"2024-09-16T07:29:39.865262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877907+0000","last_change":"2024-09-16T07:29:39.877907+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877907+0000","last_undegraded":"2024-09-16T07:29:39.877907+0000","last_fullsized":"2024-09-16T07:29:39.877907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875034+0000","last_change":"2024-09-16T07:29:39.875034+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875034+0000","last_undegraded":"2024-09-16T07:29:39.875034+0000","last_fullsized":"2024-09-16T07:29:39.875034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875359+0000","last_change":"2024-09-16T07:29:39.875359+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875359+0000","last_undegraded":"2024-09-16T07:29:39.875359+0000","last_fullsized":"2024-09-16T07:29:39.875359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878663+0000","last_change":"2024-09-16T07:29:39.878663+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878663+0000","last_undegraded":"2024-09-16T07:29:39.878663+0000","last_fullsized":"2024-09-16T07:29:39.878663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867105+0000","last_change":"2024-09-16T07:29:39.867105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867105+0000","last_undegraded":"2024-09-16T07:29:39.867105+0000","last_fullsized":"2024-09-16T07:29:39.867105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923011+0000","last_change":"2024-09-16T07:29:40.900644+0000","last_active":"2024-09-16T07:29:41.923011+0000","last_peered":"2024-09-16T07:29:41.923011+0000","last_clean":"2024-09-16T07:29:41.923011+0000","last_became_active":"2024-09-16T07:29:40.892564+0000","last_became_peered":"2024-09-16T07:29:40.892564+0000","last_unstale":"2024-09-16T07:29:41.923011+0000","last_undegraded":"2024-09-16T07:29:41.923011+0000","last_fullsized":"2024-09-16T07:29:41.923011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:34.793795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875826+0000","last_change":"2024-09-16T07:29:39.875826+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875826+0000","last_undegraded":"2024-09-16T07:29:39.875826+0000","last_fullsized":"2024-09-16T07:29:39.875826+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867469+0000","last_change":"2024-09-16T07:29:39.867469+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867469+0000","last_undegraded":"2024-09-16T07:29:39.867469+0000","last_fullsized":"2024-09-16T07:29:39.867469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868646+0000","last_change":"2024-09-16T07:29:39.868646+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868646+0000","last_undegraded":"2024-09-16T07:29:39.868646+0000","last_fullsized":"2024-09-16T07:29:39.868646+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875302+0000","last_change":"2024-09-16T07:29:39.875302+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875302+0000","last_undegraded":"2024-09-16T07:29:39.875302+0000","last_fullsized":"2024-09-16T07:29:39.875302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878579+0000","last_change":"2024-09-16T07:29:39.878579+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878579+0000","last_undegraded":"2024-09-16T07:29:39.878579+0000","last_fullsized":"2024-09-16T07:29:39.878579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869105+0000","last_change":"2024-09-16T07:29:39.869105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869105+0000","last_undegraded":"2024-09-16T07:29:39.869105+0000","last_fullsized":"2024-09-16T07:29:39.869105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923204+0000","last_change":"2024-09-16T07:29:40.902051+0000","last_active":"2024-09-16T07:29:41.923204+0000","last_peered":"2024-09-16T07:29:41.923204+0000","last_clean":"2024-09-16T07:29:41.923204+0000","last_became_active":"2024-09-16T07:29:40.901757+0000","last_became_peered":"2024-09-16T07:29:40.901757+0000","last_unstale":"2024-09-16T07:29:41.923204+0000","last_undegraded":"2024-09-16T07:29:41.923204+0000","last_fullsized":"2024-09-16T07:29:41.923204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:25.890937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.870163+0000","last_change":"2024-09-16T07:29:39.870163+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.870163+0000","last_undegraded":"2024-09-16T07:29:39.870163+0000","last_fullsized":"2024-09-16T07:29:39.870163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875466+0000","last_change":"2024-09-16T07:29:39.875466+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875466+0000","last_undegraded":"2024-09-16T07:29:39.875466+0000","last_fullsized":"2024-09-16T07:29:39.875466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868964+0000","last_change":"2024-09-16T07:29:39.868964+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868964+0000","last_undegraded":"2024-09-16T07:29:39.868964+0000","last_fullsized":"2024-09-16T07:29:39.868964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867472+0000","last_change":"2024-09-16T07:29:39.867472+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867472+0000","last_undegraded":"2024-09-16T07:29:39.867472+0000","last_fullsized":"2024-09-16T07:29:39.867472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867678+0000","last_change":"2024-09-16T07:29:39.867678+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867678+0000","last_undegraded":"2024-09-16T07:29:39.867678+0000","last_fullsized":"2024-09-16T07:29:39.867678+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923245+0000","last_change":"2024-09-16T07:29:40.905384+0000","last_active":"2024-09-16T07:29:41.923245+0000","last_peered":"2024-09-16T07:29:41.923245+0000","last_clean":"2024-09-16T07:29:41.923245+0000","last_became_active":"2024-09-16T07:29:40.904671+0000","last_became_peered":"2024-09-16T07:29:40.904671+0000","last_unstale":"2024-09-16T07:29:41.923245+0000","last_undegraded":"2024-09-16T07:29:41.923245+0000","last_fullsized":"2024-09-16T07:29:41.923245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:35.612179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874644+0000","last_change":"2024-09-16T07:29:39.874644+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874644+0000","last_undegraded":"2024-09-16T07:29:39.874644+0000","last_fullsized":"2024-09-16T07:29:39.874644+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866700+0000","last_change":"2024-09-16T07:29:39.866700+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866700+0000","last_undegraded":"2024-09-16T07:29:39.866700+0000","last_fullsized":"2024-09-16T07:29:39.866700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868093+0000","last_change":"2024-09-16T07:29:39.868093+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868093+0000","last_undegraded":"2024-09-16T07:29:39.868093+0000","last_fullsized":"2024-09-16T07:29:39.868093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875529+0000","last_change":"2024-09-16T07:29:39.875529+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875529+0000","last_undegraded":"2024-09-16T07:29:39.875529+0000","last_fullsized":"2024-09-16T07:29:39.875529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866942+0000","last_change":"2024-09-16T07:29:39.866942+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866942+0000","last_undegraded":"2024-09-16T07:29:39.866942+0000","last_fullsized":"2024-09-16T07:29:39.866942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922955+0000","last_change":"2024-09-16T07:29:40.886091+0000","last_active":"2024-09-16T07:29:41.922955+0000","last_peered":"2024-09-16T07:29:41.922955+0000","last_clean":"2024-09-16T07:29:41.922955+0000","last_became_active":"2024-09-16T07:29:40.885871+0000","last_became_peered":"2024-09-16T07:29:40.885871+0000","last_unstale":"2024-09-16T07:29:41.922955+0000","last_undegraded":"2024-09-16T07:29:41.922955+0000","last_fullsized":"2024-09-16T07:29:41.922955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:00.605118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867156+0000","last_change":"2024-09-16T07:29:39.867156+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867156+0000","last_undegraded":"2024-09-16T07:29:39.867156+0000","last_fullsized":"2024-09-16T07:29:39.867156+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886213+0000","last_change":"2024-09-16T07:29:39.879762+0000","last_active":"2024-09-16T07:29:39.886213+0000","last_peered":"2024-09-16T07:29:39.886213+0000","last_clean":"2024-09-16T07:29:39.886213+0000","last_became_active":"2024-09-16T07:29:39.879485+0000","last_became_peered":"2024-09-16T07:29:39.879485+0000","last_unstale":"2024-09-16T07:29:39.886213+0000","last_undegraded":"2024-09-16T07:29:39.886213+0000","last_fullsized":"2024-09-16T07:29:39.886213+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:26.574030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867143+0000","last_change":"2024-09-16T07:29:39.867143+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867143+0000","last_undegraded":"2024-09-16T07:29:39.867143+0000","last_fullsized":"2024-09-16T07:29:39.867143+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890481+0000","last_change":"2024-09-16T07:29:39.885953+0000","last_active":"2024-09-16T07:29:39.890481+0000","last_peered":"2024-09-16T07:29:39.890481+0000","last_clean":"2024-09-16T07:29:39.890481+0000","last_became_active":"2024-09-16T07:29:39.885790+0000","last_became_peered":"2024-09-16T07:29:39.885790+0000","last_unstale":"2024-09-16T07:29:39.890481+0000","last_undegraded":"2024-09-16T07:29:39.890481+0000","last_fullsized":"2024-09-16T07:29:39.890481+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.094051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866249+0000","last_change":"2024-09-16T07:29:39.866249+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866249+0000","last_undegraded":"2024-09-16T07:29:39.866249+0000","last_fullsized":"2024-09-16T07:29:39.866249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886021+0000","last_change":"2024-09-16T07:29:39.879740+0000","last_active":"2024-09-16T07:29:39.886021+0000","last_peered":"2024-09-16T07:29:39.886021+0000","last_clean":"2024-09-16T07:29:39.886021+0000","last_became_active":"2024-09-16T07:29:39.879515+0000","last_became_peered":"2024-09-16T07:29:39.879515+0000","last_unstale":"2024-09-16T07:29:39.886021+0000","last_undegraded":"2024-09-16T07:29:39.886021+0000","last_fullsized":"2024-09-16T07:29:39.886021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:18.486646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867072+0000","last_change":"2024-09-16T07:29:39.867072+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867072+0000","last_undegraded":"2024-09-16T07:29:39.867072+0000","last_fullsized":"2024-09-16T07:29:39.867072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890350+0000","last_change":"2024-09-16T07:29:39.883681+0000","last_active":"2024-09-16T07:29:39.890350+0000","last_peered":"2024-09-16T07:29:39.890350+0000","last_clean":"2024-09-16T07:29:39.890350+0000","last_became_active":"2024-09-16T07:29:39.883379+0000","last_became_peered":"2024-09-16T07:29:39.883379+0000","last_unstale":"2024-09-16T07:29:39.890350+0000","last_undegraded":"2024-09-16T07:29:39.890350+0000","last_fullsized":"2024-09-16T07:29:39.890350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874833+0000","last_change":"2024-09-16T07:29:39.874833+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874833+0000","last_undegraded":"2024-09-16T07:29:39.874833+0000","last_fullsized":"2024-09-16T07:29:39.874833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890236+0000","last_change":"2024-09-16T07:29:39.887081+0000","last_active":"2024-09-16T07:29:39.890236+0000","last_peered":"2024-09-16T07:29:39.890236+0000","last_clean":"2024-09-16T07:29:39.890236+0000","last_became_active":"2024-09-16T07:29:39.886495+0000","last_became_peered":"2024-09-16T07:29:39.886495+0000","last_unstale":"2024-09-16T07:29:39.890236+0000","last_undegraded":"2024-09-16T07:29:39.890236+0000","last_fullsized":"2024-09-16T07:29:39.890236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:41.057483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878951+0000","last_change":"2024-09-16T07:29:39.878951+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878951+0000","last_undegraded":"2024-09-16T07:29:39.878951+0000","last_fullsized":"2024-09-16T07:29:39.878951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887879+0000","last_change":"2024-09-16T07:29:39.883435+0000","last_active":"2024-09-16T07:29:39.887879+0000","last_peered":"2024-09-16T07:29:39.887879+0000","last_clean":"2024-09-16T07:29:39.887879+0000","last_became_active":"2024-09-16T07:29:39.883171+0000","last_became_peered":"2024-09-16T07:29:39.883171+0000","last_unstale":"2024-09-16T07:29:39.887879+0000","last_undegraded":"2024-09-16T07:29:39.887879+0000","last_fullsized":"2024-09-16T07:29:39.887879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:19:18.647616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877557+0000","last_change":"2024-09-16T07:29:39.877557+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877557+0000","last_undegraded":"2024-09-16T07:29:39.877557+0000","last_fullsized":"2024-09-16T07:29:39.877557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.879105+0000","last_change":"2024-09-16T07:29:39.873042+0000","last_active":"2024-09-16T07:29:39.879105+0000","last_peered":"2024-09-16T07:29:39.879105+0000","last_clean":"2024-09-16T07:29:39.879105+0000","last_became_active":"2024-09-16T07:29:39.872658+0000","last_became_peered":"2024-09-16T07:29:39.872658+0000","last_unstale":"2024-09-16T07:29:39.879105+0000","last_undegraded":"2024-09-16T07:29:39.879105+0000","last_fullsized":"2024-09-16T07:29:39.879105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:35.078592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867062+0000","last_change":"2024-09-16T07:29:39.867062+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867062+0000","last_undegraded":"2024-09-16T07:29:39.867062+0000","last_fullsized":"2024-09-16T07:29:39.867062+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892814+0000","last_change":"2024-09-16T07:29:39.888960+0000","last_active":"2024-09-16T07:29:39.892814+0000","last_peered":"2024-09-16T07:29:39.892814+0000","last_clean":"2024-09-16T07:29:39.892814+0000","last_became_active":"2024-09-16T07:29:39.888703+0000","last_became_peered":"2024-09-16T07:29:39.888703+0000","last_unstale":"2024-09-16T07:29:39.892814+0000","last_undegraded":"2024-09-16T07:29:39.892814+0000","last_fullsized":"2024-09-16T07:29:39.892814+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:46.078460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877960+0000","last_change":"2024-09-16T07:29:39.877960+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877960+0000","last_undegraded":"2024-09-16T07:29:39.877960+0000","last_fullsized":"2024-09-16T07:29:39.877960+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887868+0000","last_change":"2024-09-16T07:29:39.884308+0000","last_active":"2024-09-16T07:29:39.887868+0000","last_peered":"2024-09-16T07:29:39.887868+0000","last_clean":"2024-09-16T07:29:39.887868+0000","last_became_active":"2024-09-16T07:29:39.883979+0000","last_became_peered":"2024-09-16T07:29:39.883979+0000","last_unstale":"2024-09-16T07:29:39.887868+0000","last_undegraded":"2024-09-16T07:29:39.887868+0000","last_fullsized":"2024-09-16T07:29:39.887868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:32.206213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864953+0000","last_change":"2024-09-16T07:29:39.864953+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864953+0000","last_undegraded":"2024-09-16T07:29:39.864953+0000","last_fullsized":"2024-09-16T07:29:39.864953+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892866+0000","last_change":"2024-09-16T07:29:39.889286+0000","last_active":"2024-09-16T07:29:39.892866+0000","last_peered":"2024-09-16T07:29:39.892866+0000","last_clean":"2024-09-16T07:29:39.892866+0000","last_became_active":"2024-09-16T07:29:39.888837+0000","last_became_peered":"2024-09-16T07:29:39.888837+0000","last_unstale":"2024-09-16T07:29:39.892866+0000","last_undegraded":"2024-09-16T07:29:39.892866+0000","last_fullsized":"2024-09-16T07:29:39.892866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:56.573970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868428+0000","last_change":"2024-09-16T07:29:39.868428+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868428+0000","last_undegraded":"2024-09-16T07:29:39.868428+0000","last_fullsized":"2024-09-16T07:29:39.868428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887500+0000","last_change":"2024-09-16T07:29:39.881119+0000","last_active":"2024-09-16T07:29:39.887500+0000","last_peered":"2024-09-16T07:29:39.887500+0000","last_clean":"2024-09-16T07:29:39.887500+0000","last_became_active":"2024-09-16T07:29:39.880463+0000","last_became_peered":"2024-09-16T07:29:39.880463+0000","last_unstale":"2024-09-16T07:29:39.887500+0000","last_undegraded":"2024-09-16T07:29:39.887500+0000","last_fullsized":"2024-09-16T07:29:39.887500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:24.703174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865621+0000","last_change":"2024-09-16T07:29:39.865621+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865621+0000","last_undegraded":"2024-09-16T07:29:39.865621+0000","last_fullsized":"2024-09-16T07:29:39.865621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923072+0000","last_change":"2024-09-16T07:29:39.881374+0000","last_active":"2024-09-16T07:29:41.923072+0000","last_peered":"2024-09-16T07:29:41.923072+0000","last_clean":"2024-09-16T07:29:41.923072+0000","last_became_active":"2024-09-16T07:29:39.880798+0000","last_became_peered":"2024-09-16T07:29:39.880798+0000","last_unstale":"2024-09-16T07:29:41.923072+0000","last_undegraded":"2024-09-16T07:29:41.923072+0000","last_fullsized":"2024-09-16T07:29:41.923072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:38.543742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866086+0000","last_change":"2024-09-16T07:29:39.866086+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866086+0000","last_undegraded":"2024-09-16T07:29:39.866086+0000","last_fullsized":"2024-09-16T07:29:39.866086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888047+0000","last_change":"2024-09-16T07:29:39.885365+0000","last_active":"2024-09-16T07:29:39.888047+0000","last_peered":"2024-09-16T07:29:39.888047+0000","last_clean":"2024-09-16T07:29:39.888047+0000","last_became_active":"2024-09-16T07:29:39.884959+0000","last_became_peered":"2024-09-16T07:29:39.884959+0000","last_unstale":"2024-09-16T07:29:39.888047+0000","last_undegraded":"2024-09-16T07:29:39.888047+0000","last_fullsized":"2024-09-16T07:29:39.888047+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:17.128096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878546+0000","last_change":"2024-09-16T07:29:39.878546+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878546+0000","last_undegraded":"2024-09-16T07:29:39.878546+0000","last_fullsized":"2024-09-16T07:29:39.878546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887314+0000","last_change":"2024-09-16T07:29:39.877326+0000","last_active":"2024-09-16T07:29:39.887314+0000","last_peered":"2024-09-16T07:29:39.887314+0000","last_clean":"2024-09-16T07:29:39.887314+0000","last_became_active":"2024-09-16T07:29:39.877050+0000","last_became_peered":"2024-09-16T07:29:39.877050+0000","last_unstale":"2024-09-16T07:29:39.887314+0000","last_undegraded":"2024-09-16T07:29:39.887314+0000","last_fullsized":"2024-09-16T07:29:39.887314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:48.369661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866685+0000","last_change":"2024-09-16T07:29:39.866685+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866685+0000","last_undegraded":"2024-09-16T07:29:39.866685+0000","last_fullsized":"2024-09-16T07:29:39.866685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888072+0000","last_change":"2024-09-16T07:29:39.885291+0000","last_active":"2024-09-16T07:29:39.888072+0000","last_peered":"2024-09-16T07:29:39.888072+0000","last_clean":"2024-09-16T07:29:39.888072+0000","last_became_active":"2024-09-16T07:29:39.885042+0000","last_became_peered":"2024-09-16T07:29:39.885042+0000","last_unstale":"2024-09-16T07:29:39.888072+0000","last_undegraded":"2024-09-16T07:29:39.888072+0000","last_fullsized":"2024-09-16T07:29:39.888072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:03.118256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864736+0000","last_change":"2024-09-16T07:29:39.864736+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864736+0000","last_undegraded":"2024-09-16T07:29:39.864736+0000","last_fullsized":"2024-09-16T07:29:39.864736+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890066+0000","last_change":"2024-09-16T07:29:39.884132+0000","last_active":"2024-09-16T07:29:39.890066+0000","last_peered":"2024-09-16T07:29:39.890066+0000","last_clean":"2024-09-16T07:29:39.890066+0000","last_became_active":"2024-09-16T07:29:39.883836+0000","last_became_peered":"2024-09-16T07:29:39.883836+0000","last_unstale":"2024-09-16T07:29:39.890066+0000","last_undegraded":"2024-09-16T07:29:39.890066+0000","last_fullsized":"2024-09-16T07:29:39.890066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:40.793320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923356+0000","last_change":"2024-09-16T07:29:40.883420+0000","last_active":"2024-09-16T07:29:41.923356+0000","last_peered":"2024-09-16T07:29:41.923356+0000","last_clean":"2024-09-16T07:29:41.923356+0000","last_became_active":"2024-09-16T07:29:40.883191+0000","last_became_peered":"2024-09-16T07:29:40.883191+0000","last_unstale":"2024-09-16T07:29:41.923356+0000","last_undegraded":"2024-09-16T07:29:41.923356+0000","last_fullsized":"2024-09-16T07:29:41.923356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:31.229980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923177+0000","last_change":"2024-09-16T07:29:39.879866+0000","last_active":"2024-09-16T07:29:41.923177+0000","last_peered":"2024-09-16T07:29:41.923177+0000","last_clean":"2024-09-16T07:29:41.923177+0000","last_became_active":"2024-09-16T07:29:39.879449+0000","last_became_peered":"2024-09-16T07:29:39.879449+0000","last_unstale":"2024-09-16T07:29:41.923177+0000","last_undegraded":"2024-09-16T07:29:41.923177+0000","last_fullsized":"2024-09-16T07:29:41.923177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:11:51.597102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874640+0000","last_change":"2024-09-16T07:29:39.874640+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874640+0000","last_undegraded":"2024-09-16T07:29:39.874640+0000","last_fullsized":"2024-09-16T07:29:39.874640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.893178+0000","last_change":"2024-09-16T07:29:39.888996+0000","last_active":"2024-09-16T07:29:39.893178+0000","last_peered":"2024-09-16T07:29:39.893178+0000","last_clean":"2024-09-16T07:29:39.893178+0000","last_became_active":"2024-09-16T07:29:39.888800+0000","last_became_peered":"2024-09-16T07:29:39.888800+0000","last_unstale":"2024-09-16T07:29:39.893178+0000","last_undegraded":"2024-09-16T07:29:39.893178+0000","last_fullsized":"2024-09-16T07:29:39.893178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.839005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865792+0000","last_change":"2024-09-16T07:29:39.865792+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865792+0000","last_undegraded":"2024-09-16T07:29:39.865792+0000","last_fullsized":"2024-09-16T07:29:39.865792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.880938+0000","last_change":"2024-09-16T07:29:39.875251+0000","last_active":"2024-09-16T07:29:39.880938+0000","last_peered":"2024-09-16T07:29:39.880938+0000","last_clean":"2024-09-16T07:29:39.880938+0000","last_became_active":"2024-09-16T07:29:39.875004+0000","last_became_peered":"2024-09-16T07:29:39.875004+0000","last_unstale":"2024-09-16T07:29:39.880938+0000","last_undegraded":"2024-09-16T07:29:39.880938+0000","last_fullsized":"2024-09-16T07:29:39.880938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:45.556407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866527+0000","last_change":"2024-09-16T07:29:39.866527+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866527+0000","last_undegraded":"2024-09-16T07:29:39.866527+0000","last_fullsized":"2024-09-16T07:29:39.866527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884516+0000","last_change":"2024-09-16T07:29:39.878820+0000","last_active":"2024-09-16T07:29:39.884516+0000","last_peered":"2024-09-16T07:29:39.884516+0000","last_clean":"2024-09-16T07:29:39.884516+0000","last_became_active":"2024-09-16T07:29:39.878471+0000","last_became_peered":"2024-09-16T07:29:39.878471+0000","last_unstale":"2024-09-16T07:29:39.884516+0000","last_undegraded":"2024-09-16T07:29:39.884516+0000","last_fullsized":"2024-09-16T07:29:39.884516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:50:08.547444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867321+0000","last_change":"2024-09-16T07:29:39.867321+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867321+0000","last_undegraded":"2024-09-16T07:29:39.867321+0000","last_fullsized":"2024-09-16T07:29:39.867321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884787+0000","last_change":"2024-09-16T07:29:39.875309+0000","last_active":"2024-09-16T07:29:39.884787+0000","last_peered":"2024-09-16T07:29:39.884787+0000","last_clean":"2024-09-16T07:29:39.884787+0000","last_became_active":"2024-09-16T07:29:39.875039+0000","last_became_peered":"2024-09-16T07:29:39.875039+0000","last_unstale":"2024-09-16T07:29:39.884787+0000","last_undegraded":"2024-09-16T07:29:39.884787+0000","last_fullsized":"2024-09-16T07:29:39.884787+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869690+0000","last_change":"2024-09-16T07:29:39.869690+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869690+0000","last_undegraded":"2024-09-16T07:29:39.869690+0000","last_fullsized":"2024-09-16T07:29:39.869690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.882704+0000","last_change":"2024-09-16T07:29:39.877319+0000","last_active":"2024-09-16T07:29:39.882704+0000","last_peered":"2024-09-16T07:29:39.882704+0000","last_clean":"2024-09-16T07:29:39.882704+0000","last_became_active":"2024-09-16T07:29:39.876985+0000","last_became_peered":"2024-09-16T07:29:39.876985+0000","last_unstale":"2024-09-16T07:29:39.882704+0000","last_undegraded":"2024-09-16T07:29:39.882704+0000","last_fullsized":"2024-09-16T07:29:39.882704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:30.703785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922956+0000","last_change":"2024-09-16T07:29:40.900347+0000","last_active":"2024-09-16T07:29:41.922956+0000","last_peered":"2024-09-16T07:29:41.922956+0000","last_clean":"2024-09-16T07:29:41.922956+0000","last_became_active":"2024-09-16T07:29:40.892923+0000","last_became_peered":"2024-09-16T07:29:40.892923+0000","last_unstale":"2024-09-16T07:29:41.922956+0000","last_undegraded":"2024-09-16T07:29:41.922956+0000","last_fullsized":"2024-09-16T07:29:41.922956+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:42.855984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892832+0000","last_change":"2024-09-16T07:29:39.889122+0000","last_active":"2024-09-16T07:29:39.892832+0000","last_peered":"2024-09-16T07:29:39.892832+0000","last_clean":"2024-09-16T07:29:39.892832+0000","last_became_active":"2024-09-16T07:29:39.888890+0000","last_became_peered":"2024-09-16T07:29:39.888890+0000","last_unstale":"2024-09-16T07:29:39.892832+0000","last_undegraded":"2024-09-16T07:29:39.892832+0000","last_fullsized":"2024-09-16T07:29:39.892832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:52.147472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877065+0000","last_change":"2024-09-16T07:29:39.877065+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877065+0000","last_undegraded":"2024-09-16T07:29:39.877065+0000","last_fullsized":"2024-09-16T07:29:39.877065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890340+0000","last_change":"2024-09-16T07:29:39.883628+0000","last_active":"2024-09-16T07:29:39.890340+0000","last_peered":"2024-09-16T07:29:39.890340+0000","last_clean":"2024-09-16T07:29:39.890340+0000","last_became_active":"2024-09-16T07:29:39.883294+0000","last_became_peered":"2024-09-16T07:29:39.883294+0000","last_unstale":"2024-09-16T07:29:39.890340+0000","last_undegraded":"2024-09-16T07:29:39.890340+0000","last_fullsized":"2024-09-16T07:29:39.890340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:15:03.149984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865824+0000","last_change":"2024-09-16T07:29:39.865824+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865824+0000","last_undegraded":"2024-09-16T07:29:39.865824+0000","last_fullsized":"2024-09-16T07:29:39.865824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888472+0000","last_change":"2024-09-16T07:29:39.886269+0000","last_active":"2024-09-16T07:29:39.888472+0000","last_peered":"2024-09-16T07:29:39.888472+0000","last_clean":"2024-09-16T07:29:39.888472+0000","last_became_active":"2024-09-16T07:29:39.885929+0000","last_became_peered":"2024-09-16T07:29:39.885929+0000","last_unstale":"2024-09-16T07:29:39.888472+0000","last_undegraded":"2024-09-16T07:29:39.888472+0000","last_fullsized":"2024-09-16T07:29:39.888472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.873597+0000","last_change":"2024-09-16T07:29:39.873597+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.873597+0000","last_undegraded":"2024-09-16T07:29:39.873597+0000","last_fullsized":"2024-09-16T07:29:39.873597+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887526+0000","last_change":"2024-09-16T07:29:39.881323+0000","last_active":"2024-09-16T07:29:39.887526+0000","last_peered":"2024-09-16T07:29:39.887526+0000","last_clean":"2024-09-16T07:29:39.887526+0000","last_became_active":"2024-09-16T07:29:39.880843+0000","last_became_peered":"2024-09-16T07:29:39.880843+0000","last_unstale":"2024-09-16T07:29:39.887526+0000","last_undegraded":"2024-09-16T07:29:39.887526+0000","last_fullsized":"2024-09-16T07:29:39.887526+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:38:28.410493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864744+0000","last_change":"2024-09-16T07:29:39.864744+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864744+0000","last_undegraded":"2024-09-16T07:29:39.864744+0000","last_fullsized":"2024-09-16T07:29:39.864744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888449+0000","last_change":"2024-09-16T07:29:39.884411+0000","last_active":"2024-09-16T07:29:39.888449+0000","last_peered":"2024-09-16T07:29:39.888449+0000","last_clean":"2024-09-16T07:29:39.888449+0000","last_became_active":"2024-09-16T07:29:39.882654+0000","last_became_peered":"2024-09-16T07:29:39.882654+0000","last_unstale":"2024-09-16T07:29:39.888449+0000","last_undegraded":"2024-09-16T07:29:39.888449+0000","last_fullsized":"2024-09-16T07:29:39.888449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:55:16.541963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866691+0000","last_change":"2024-09-16T07:29:39.866691+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866691+0000","last_undegraded":"2024-09-16T07:29:39.866691+0000","last_fullsized":"2024-09-16T07:29:39.866691+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887291+0000","last_change":"2024-09-16T07:29:39.878614+0000","last_active":"2024-09-16T07:29:39.887291+0000","last_peered":"2024-09-16T07:29:39.887291+0000","last_clean":"2024-09-16T07:29:39.887291+0000","last_became_active":"2024-09-16T07:29:39.878365+0000","last_became_peered":"2024-09-16T07:29:39.878365+0000","last_unstale":"2024-09-16T07:29:39.887291+0000","last_undegraded":"2024-09-16T07:29:39.887291+0000","last_fullsized":"2024-09-16T07:29:39.887291+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:43.611481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869794+0000","last_change":"2024-09-16T07:29:39.869794+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869794+0000","last_undegraded":"2024-09-16T07:29:39.869794+0000","last_fullsized":"2024-09-16T07:29:39.869794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890518+0000","last_change":"2024-09-16T07:29:39.886820+0000","last_active":"2024-09-16T07:29:39.890518+0000","last_peered":"2024-09-16T07:29:39.890518+0000","last_clean":"2024-09-16T07:29:39.890518+0000","last_became_active":"2024-09-16T07:29:39.886480+0000","last_became_peered":"2024-09-16T07:29:39.886480+0000","last_unstale":"2024-09-16T07:29:39.890518+0000","last_undegraded":"2024-09-16T07:29:39.890518+0000","last_fullsized":"2024-09-16T07:29:39.890518+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:10.572704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864858+0000","last_change":"2024-09-16T07:29:39.864858+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864858+0000","last_undegraded":"2024-09-16T07:29:39.864858+0000","last_fullsized":"2024-09-16T07:29:39.864858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.885632+0000","last_change":"2024-09-16T07:29:39.877534+0000","last_active":"2024-09-16T07:29:39.885632+0000","last_peered":"2024-09-16T07:29:39.885632+0000","last_clean":"2024-09-16T07:29:39.885632+0000","last_became_active":"2024-09-16T07:29:39.877243+0000","last_became_peered":"2024-09-16T07:29:39.877243+0000","last_unstale":"2024-09-16T07:29:39.885632+0000","last_undegraded":"2024-09-16T07:29:39.885632+0000","last_fullsized":"2024-09-16T07:29:39.885632+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:07.629863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874229+0000","last_change":"2024-09-16T07:29:39.874229+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874229+0000","last_undegraded":"2024-09-16T07:29:39.874229+0000","last_fullsized":"2024-09-16T07:29:39.874229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892771+0000","last_change":"2024-09-16T07:29:39.887812+0000","last_active":"2024-09-16T07:29:39.892771+0000","last_peered":"2024-09-16T07:29:39.892771+0000","last_clean":"2024-09-16T07:29:39.892771+0000","last_became_active":"2024-09-16T07:29:39.886975+0000","last_became_peered":"2024-09-16T07:29:39.886975+0000","last_unstale":"2024-09-16T07:29:39.892771+0000","last_undegraded":"2024-09-16T07:29:39.892771+0000","last_fullsized":"2024-09-16T07:29:39.892771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.849005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874253+0000","last_change":"2024-09-16T07:29:39.874253+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874253+0000","last_undegraded":"2024-09-16T07:29:39.874253+0000","last_fullsized":"2024-09-16T07:29:39.874253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884961+0000","last_change":"2024-09-16T07:29:39.880008+0000","last_active":"2024-09-16T07:29:39.884961+0000","last_peered":"2024-09-16T07:29:39.884961+0000","last_clean":"2024-09-16T07:29:39.884961+0000","last_became_active":"2024-09-16T07:29:39.879765+0000","last_became_peered":"2024-09-16T07:29:39.879765+0000","last_unstale":"2024-09-16T07:29:39.884961+0000","last_undegraded":"2024-09-16T07:29:39.884961+0000","last_fullsized":"2024-09-16T07:29:39.884961+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:35.640560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.870813+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:39.870813+0000","last_peered":"2024-09-16T07:29:39.870813+0000","last_clean":"2024-09-16T07:29:39.870813+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:39.870813+0000","last_undegraded":"2024-09-16T07:29:39.870813+0000","last_fullsized":"2024-09-16T07:29:39.870813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1077248,"data_stored":779961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":773694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":524288,"data_stored":204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:45.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:45.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- 172.21.15.114:0/1497559276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac815b580 msgr2=0x7fbac815b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 --2- 172.21.15.114:0/1497559276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac815b580 0x7fbac815b960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009840 tx=0x7fbab801c820 comp rx=0 tx=0).stop 2024-09-16T07:29:45.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- 172.21.15.114:0/1497559276 shutdown_connections 2024-09-16T07:29:45.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 --2- 172.21.15.114:0/1497559276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac815b580 0x7fbac815b960 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- 172.21.15.114:0/1497559276 >> 172.21.15.114:0/1497559276 conn(0x7fbac80b18f0 msgr2=0x7fbac80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:45.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- 172.21.15.114:0/1497559276 shutdown_connections 2024-09-16T07:29:45.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- 172.21.15.114:0/1497559276 wait complete. 2024-09-16T07:29:45.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 Processor -- start 2024-09-16T07:29:45.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- start start 2024-09-16T07:29:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80b3300 0x7fbac8148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbac80b4bd0 0x7fbac8149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbac815b580 0x7fbac8165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbac8169360 con 0x7fbac80b3300 2024-09-16T07:29:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbac81691e0 con 0x7fbac815b580 2024-09-16T07:29:45.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbacde00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbac81694e0 con 0x7fbac80b4bd0 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80b3300 0x7fbac8148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80b3300 0x7fbac8148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33798/0 (socket says 172.21.15.114:33798) 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 -- 172.21.15.114:0/4038070115 learned_addr learned my addr 172.21.15.114:0/4038070115 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac7400640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbac815b580 0x7fbac8165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbabe000640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbac80b4bd0 0x7fbac8149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 -- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbac80b4bd0 msgr2=0x7fbac8149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbac80b4bd0 0x7fbac8149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 -- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbac815b580 msgr2=0x7fbac8165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbac815b580 0x7fbac8165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac6a00640 1 -- 172.21.15.114:0/4038070115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac81492e0 con 0x7fbac80b3300 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbac7400640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbac815b580 0x7fbac8165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.564+0000 7fbabe000640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbac80b4bd0 0x7fbac8149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:45.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbac6a00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80b3300 0x7fbac8148da0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009790 tx=0x7fbab8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbabfe00640 1 -- 172.21.15.114:0/4038070115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab80b2040 con 0x7fbac80b3300 2024-09-16T07:29:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbabfe00640 1 -- 172.21.15.114:0/4038070115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbab8005030 con 0x7fbac80b3300 2024-09-16T07:29:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac8072da0 con 0x7fbac80b3300 2024-09-16T07:29:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbabfe00640 1 -- 172.21.15.114:0/4038070115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8005440 con 0x7fbac80b3300 2024-09-16T07:29:45.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac8073360 con 0x7fbac80b3300 2024-09-16T07:29:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac815b960 con 0x7fbac80b3300 2024-09-16T07:29:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbabfe00640 1 -- 172.21.15.114:0/4038070115 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fbab80bd060 con 0x7fbac80b3300 2024-09-16T07:29:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbabfe00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbaa4073070 0x7fbaa4075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbabfe00640 1 -- 172.21.15.114:0/4038070115 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fbab812d670 con 0x7fbac80b3300 2024-09-16T07:29:45.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.568+0000 7fbabe000640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbaa4073070 0x7fbaa4075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.572+0000 7fbabe000640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbaa4073070 0x7fbaa4075530 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbac81fb600 tx=0x7fbab0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:45.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.572+0000 7fbabfe00640 1 -- 172.21.15.114:0/4038070115 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbab8016410 con 0x7fbac80b3300 2024-09-16T07:29:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.740+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbac80b2d10 con 0x7fbaa4073070 2024-09-16T07:29:45.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.744+0000 7fbabfe00640 1 -- 172.21.15.114:0/4038070115 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247171 (secure 0 0 0) 0x7fbab00545a0 con 0x7fbaa4073070 2024-09-16T07:29:45.750 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:45.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbaa4073070 msgr2=0x7fbaa4075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbaa4073070 0x7fbaa4075530 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbac81fb600 tx=0x7fbab0009040 comp rx=0 tx=0).stop 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80b3300 msgr2=0x7fbac8148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80b3300 0x7fbac8148da0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009790 tx=0x7fbab8004040 comp rx=0 tx=0).stop 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 shutdown_connections 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbaa4073070 0x7fbaa4075530 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbac815b580 0x7fbac8165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbac80b4bd0 0x7fbac8149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 --2- 172.21.15.114:0/4038070115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac80b3300 0x7fbac8148da0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 >> 172.21.15.114:0/4038070115 conn(0x7fbac80b18f0 msgr2=0x7fbac814f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 shutdown_connections 2024-09-16T07:29:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.748+0000 7fbacde00640 1 -- 172.21.15.114:0/4038070115 wait complete. 2024-09-16T07:29:45.769 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-16T07:29:45.013401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221160,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753560,"statfs":{"total":773094113280,"available":772867645440,"internally_reserved":0,"allocated":5021696,"data_stored":2674587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001665"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865421+0000","last_change":"2024-09-16T07:29:39.865421+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865421+0000","last_undegraded":"2024-09-16T07:29:39.865421+0000","last_fullsized":"2024-09-16T07:29:39.865421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866535+0000","last_change":"2024-09-16T07:29:39.866535+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866535+0000","last_undegraded":"2024-09-16T07:29:39.866535+0000","last_fullsized":"2024-09-16T07:29:39.866535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.876573+0000","last_change":"2024-09-16T07:29:39.876573+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.876573+0000","last_undegraded":"2024-09-16T07:29:39.876573+0000","last_fullsized":"2024-09-16T07:29:39.876573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874114+0000","last_change":"2024-09-16T07:29:39.874114+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874114+0000","last_undegraded":"2024-09-16T07:29:39.874114+0000","last_fullsized":"2024-09-16T07:29:39.874114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866051+0000","last_change":"2024-09-16T07:29:39.866051+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866051+0000","last_undegraded":"2024-09-16T07:29:39.866051+0000","last_fullsized":"2024-09-16T07:29:39.866051+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867756+0000","last_change":"2024-09-16T07:29:39.867756+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867756+0000","last_undegraded":"2024-09-16T07:29:39.867756+0000","last_fullsized":"2024-09-16T07:29:39.867756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865262+0000","last_change":"2024-09-16T07:29:39.865262+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865262+0000","last_undegraded":"2024-09-16T07:29:39.865262+0000","last_fullsized":"2024-09-16T07:29:39.865262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877907+0000","last_change":"2024-09-16T07:29:39.877907+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877907+0000","last_undegraded":"2024-09-16T07:29:39.877907+0000","last_fullsized":"2024-09-16T07:29:39.877907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875034+0000","last_change":"2024-09-16T07:29:39.875034+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875034+0000","last_undegraded":"2024-09-16T07:29:39.875034+0000","last_fullsized":"2024-09-16T07:29:39.875034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875359+0000","last_change":"2024-09-16T07:29:39.875359+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875359+0000","last_undegraded":"2024-09-16T07:29:39.875359+0000","last_fullsized":"2024-09-16T07:29:39.875359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878663+0000","last_change":"2024-09-16T07:29:39.878663+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878663+0000","last_undegraded":"2024-09-16T07:29:39.878663+0000","last_fullsized":"2024-09-16T07:29:39.878663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867105+0000","last_change":"2024-09-16T07:29:39.867105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867105+0000","last_undegraded":"2024-09-16T07:29:39.867105+0000","last_fullsized":"2024-09-16T07:29:39.867105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923011+0000","last_change":"2024-09-16T07:29:40.900644+0000","last_active":"2024-09-16T07:29:41.923011+0000","last_peered":"2024-09-16T07:29:41.923011+0000","last_clean":"2024-09-16T07:29:41.923011+0000","last_became_active":"2024-09-16T07:29:40.892564+0000","last_became_peered":"2024-09-16T07:29:40.892564+0000","last_unstale":"2024-09-16T07:29:41.923011+0000","last_undegraded":"2024-09-16T07:29:41.923011+0000","last_fullsized":"2024-09-16T07:29:41.923011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:34.793795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875826+0000","last_change":"2024-09-16T07:29:39.875826+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875826+0000","last_undegraded":"2024-09-16T07:29:39.875826+0000","last_fullsized":"2024-09-16T07:29:39.875826+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867469+0000","last_change":"2024-09-16T07:29:39.867469+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867469+0000","last_undegraded":"2024-09-16T07:29:39.867469+0000","last_fullsized":"2024-09-16T07:29:39.867469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868646+0000","last_change":"2024-09-16T07:29:39.868646+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868646+0000","last_undegraded":"2024-09-16T07:29:39.868646+0000","last_fullsized":"2024-09-16T07:29:39.868646+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875302+0000","last_change":"2024-09-16T07:29:39.875302+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875302+0000","last_undegraded":"2024-09-16T07:29:39.875302+0000","last_fullsized":"2024-09-16T07:29:39.875302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878579+0000","last_change":"2024-09-16T07:29:39.878579+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878579+0000","last_undegraded":"2024-09-16T07:29:39.878579+0000","last_fullsized":"2024-09-16T07:29:39.878579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869105+0000","last_change":"2024-09-16T07:29:39.869105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869105+0000","last_undegraded":"2024-09-16T07:29:39.869105+0000","last_fullsized":"2024-09-16T07:29:39.869105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923204+0000","last_change":"2024-09-16T07:29:40.902051+0000","last_active":"2024-09-16T07:29:41.923204+0000","last_peered":"2024-09-16T07:29:41.923204+0000","last_clean":"2024-09-16T07:29:41.923204+0000","last_became_active":"2024-09-16T07:29:40.901757+0000","last_became_peered":"2024-09-16T07:29:40.901757+0000","last_unstale":"2024-09-16T07:29:41.923204+0000","last_undegraded":"2024-09-16T07:29:41.923204+0000","last_fullsized":"2024-09-16T07:29:41.923204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:25.890937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.870163+0000","last_change":"2024-09-16T07:29:39.870163+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.870163+0000","last_undegraded":"2024-09-16T07:29:39.870163+0000","last_fullsized":"2024-09-16T07:29:39.870163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875466+0000","last_change":"2024-09-16T07:29:39.875466+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875466+0000","last_undegraded":"2024-09-16T07:29:39.875466+0000","last_fullsized":"2024-09-16T07:29:39.875466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868964+0000","last_change":"2024-09-16T07:29:39.868964+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868964+0000","last_undegraded":"2024-09-16T07:29:39.868964+0000","last_fullsized":"2024-09-16T07:29:39.868964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867472+0000","last_change":"2024-09-16T07:29:39.867472+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867472+0000","last_undegraded":"2024-09-16T07:29:39.867472+0000","last_fullsized":"2024-09-16T07:29:39.867472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867678+0000","last_change":"2024-09-16T07:29:39.867678+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867678+0000","last_undegraded":"2024-09-16T07:29:39.867678+0000","last_fullsized":"2024-09-16T07:29:39.867678+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923245+0000","last_change":"2024-09-16T07:29:40.905384+0000","last_active":"2024-09-16T07:29:41.923245+0000","last_peered":"2024-09-16T07:29:41.923245+0000","last_clean":"2024-09-16T07:29:41.923245+0000","last_became_active":"2024-09-16T07:29:40.904671+0000","last_became_peered":"2024-09-16T07:29:40.904671+0000","last_unstale":"2024-09-16T07:29:41.923245+0000","last_undegraded":"2024-09-16T07:29:41.923245+0000","last_fullsized":"2024-09-16T07:29:41.923245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:35.612179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874644+0000","last_change":"2024-09-16T07:29:39.874644+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874644+0000","last_undegraded":"2024-09-16T07:29:39.874644+0000","last_fullsized":"2024-09-16T07:29:39.874644+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866700+0000","last_change":"2024-09-16T07:29:39.866700+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866700+0000","last_undegraded":"2024-09-16T07:29:39.866700+0000","last_fullsized":"2024-09-16T07:29:39.866700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868093+0000","last_change":"2024-09-16T07:29:39.868093+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868093+0000","last_undegraded":"2024-09-16T07:29:39.868093+0000","last_fullsized":"2024-09-16T07:29:39.868093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875529+0000","last_change":"2024-09-16T07:29:39.875529+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875529+0000","last_undegraded":"2024-09-16T07:29:39.875529+0000","last_fullsized":"2024-09-16T07:29:39.875529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866942+0000","last_change":"2024-09-16T07:29:39.866942+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866942+0000","last_undegraded":"2024-09-16T07:29:39.866942+0000","last_fullsized":"2024-09-16T07:29:39.866942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922955+0000","last_change":"2024-09-16T07:29:40.886091+0000","last_active":"2024-09-16T07:29:41.922955+0000","last_peered":"2024-09-16T07:29:41.922955+0000","last_clean":"2024-09-16T07:29:41.922955+0000","last_became_active":"2024-09-16T07:29:40.885871+0000","last_became_peered":"2024-09-16T07:29:40.885871+0000","last_unstale":"2024-09-16T07:29:41.922955+0000","last_undegraded":"2024-09-16T07:29:41.922955+0000","last_fullsized":"2024-09-16T07:29:41.922955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:00.605118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867156+0000","last_change":"2024-09-16T07:29:39.867156+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867156+0000","last_undegraded":"2024-09-16T07:29:39.867156+0000","last_fullsized":"2024-09-16T07:29:39.867156+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886213+0000","last_change":"2024-09-16T07:29:39.879762+0000","last_active":"2024-09-16T07:29:39.886213+0000","last_peered":"2024-09-16T07:29:39.886213+0000","last_clean":"2024-09-16T07:29:39.886213+0000","last_became_active":"2024-09-16T07:29:39.879485+0000","last_became_peered":"2024-09-16T07:29:39.879485+0000","last_unstale":"2024-09-16T07:29:39.886213+0000","last_undegraded":"2024-09-16T07:29:39.886213+0000","last_fullsized":"2024-09-16T07:29:39.886213+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:26.574030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867143+0000","last_change":"2024-09-16T07:29:39.867143+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867143+0000","last_undegraded":"2024-09-16T07:29:39.867143+0000","last_fullsized":"2024-09-16T07:29:39.867143+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890481+0000","last_change":"2024-09-16T07:29:39.885953+0000","last_active":"2024-09-16T07:29:39.890481+0000","last_peered":"2024-09-16T07:29:39.890481+0000","last_clean":"2024-09-16T07:29:39.890481+0000","last_became_active":"2024-09-16T07:29:39.885790+0000","last_became_peered":"2024-09-16T07:29:39.885790+0000","last_unstale":"2024-09-16T07:29:39.890481+0000","last_undegraded":"2024-09-16T07:29:39.890481+0000","last_fullsized":"2024-09-16T07:29:39.890481+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.094051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866249+0000","last_change":"2024-09-16T07:29:39.866249+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866249+0000","last_undegraded":"2024-09-16T07:29:39.866249+0000","last_fullsized":"2024-09-16T07:29:39.866249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886021+0000","last_change":"2024-09-16T07:29:39.879740+0000","last_active":"2024-09-16T07:29:39.886021+0000","last_peered":"2024-09-16T07:29:39.886021+0000","last_clean":"2024-09-16T07:29:39.886021+0000","last_became_active":"2024-09-16T07:29:39.879515+0000","last_became_peered":"2024-09-16T07:29:39.879515+0000","last_unstale":"2024-09-16T07:29:39.886021+0000","last_undegraded":"2024-09-16T07:29:39.886021+0000","last_fullsized":"2024-09-16T07:29:39.886021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:18.486646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867072+0000","last_change":"2024-09-16T07:29:39.867072+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867072+0000","last_undegraded":"2024-09-16T07:29:39.867072+0000","last_fullsized":"2024-09-16T07:29:39.867072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890350+0000","last_change":"2024-09-16T07:29:39.883681+0000","last_active":"2024-09-16T07:29:39.890350+0000","last_peered":"2024-09-16T07:29:39.890350+0000","last_clean":"2024-09-16T07:29:39.890350+0000","last_became_active":"2024-09-16T07:29:39.883379+0000","last_became_peered":"2024-09-16T07:29:39.883379+0000","last_unstale":"2024-09-16T07:29:39.890350+0000","last_undegraded":"2024-09-16T07:29:39.890350+0000","last_fullsized":"2024-09-16T07:29:39.890350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874833+0000","last_change":"2024-09-16T07:29:39.874833+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874833+0000","last_undegraded":"2024-09-16T07:29:39.874833+0000","last_fullsized":"2024-09-16T07:29:39.874833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890236+0000","last_change":"2024-09-16T07:29:39.887081+0000","last_active":"2024-09-16T07:29:39.890236+0000","last_peered":"2024-09-16T07:29:39.890236+0000","last_clean":"2024-09-16T07:29:39.890236+0000","last_became_active":"2024-09-16T07:29:39.886495+0000","last_became_peered":"2024-09-16T07:29:39.886495+0000","last_unstale":"2024-09-16T07:29:39.890236+0000","last_undegraded":"2024-09-16T07:29:39.890236+0000","last_fullsized":"2024-09-16T07:29:39.890236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:41.057483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878951+0000","last_change":"2024-09-16T07:29:39.878951+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878951+0000","last_undegraded":"2024-09-16T07:29:39.878951+0000","last_fullsized":"2024-09-16T07:29:39.878951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887879+0000","last_change":"2024-09-16T07:29:39.883435+0000","last_active":"2024-09-16T07:29:39.887879+0000","last_peered":"2024-09-16T07:29:39.887879+0000","last_clean":"2024-09-16T07:29:39.887879+0000","last_became_active":"2024-09-16T07:29:39.883171+0000","last_became_peered":"2024-09-16T07:29:39.883171+0000","last_unstale":"2024-09-16T07:29:39.887879+0000","last_undegraded":"2024-09-16T07:29:39.887879+0000","last_fullsized":"2024-09-16T07:29:39.887879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:19:18.647616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877557+0000","last_change":"2024-09-16T07:29:39.877557+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877557+0000","last_undegraded":"2024-09-16T07:29:39.877557+0000","last_fullsized":"2024-09-16T07:29:39.877557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.879105+0000","last_change":"2024-09-16T07:29:39.873042+0000","last_active":"2024-09-16T07:29:39.879105+0000","last_peered":"2024-09-16T07:29:39.879105+0000","last_clean":"2024-09-16T07:29:39.879105+0000","last_became_active":"2024-09-16T07:29:39.872658+0000","last_became_peered":"2024-09-16T07:29:39.872658+0000","last_unstale":"2024-09-16T07:29:39.879105+0000","last_undegraded":"2024-09-16T07:29:39.879105+0000","last_fullsized":"2024-09-16T07:29:39.879105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:35.078592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867062+0000","last_change":"2024-09-16T07:29:39.867062+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867062+0000","last_undegraded":"2024-09-16T07:29:39.867062+0000","last_fullsized":"2024-09-16T07:29:39.867062+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892814+0000","last_change":"2024-09-16T07:29:39.888960+0000","last_active":"2024-09-16T07:29:39.892814+0000","last_peered":"2024-09-16T07:29:39.892814+0000","last_clean":"2024-09-16T07:29:39.892814+0000","last_became_active":"2024-09-16T07:29:39.888703+0000","last_became_peered":"2024-09-16T07:29:39.888703+0000","last_unstale":"2024-09-16T07:29:39.892814+0000","last_undegraded":"2024-09-16T07:29:39.892814+0000","last_fullsized":"2024-09-16T07:29:39.892814+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:46.078460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877960+0000","last_change":"2024-09-16T07:29:39.877960+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877960+0000","last_undegraded":"2024-09-16T07:29:39.877960+0000","last_fullsized":"2024-09-16T07:29:39.877960+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887868+0000","last_change":"2024-09-16T07:29:39.884308+0000","last_active":"2024-09-16T07:29:39.887868+0000","last_peered":"2024-09-16T07:29:39.887868+0000","last_clean":"2024-09-16T07:29:39.887868+0000","last_became_active":"2024-09-16T07:29:39.883979+0000","last_became_peered":"2024-09-16T07:29:39.883979+0000","last_unstale":"2024-09-16T07:29:39.887868+0000","last_undegraded":"2024-09-16T07:29:39.887868+0000","last_fullsized":"2024-09-16T07:29:39.887868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:32.206213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864953+0000","last_change":"2024-09-16T07:29:39.864953+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864953+0000","last_undegraded":"2024-09-16T07:29:39.864953+0000","last_fullsized":"2024-09-16T07:29:39.864953+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892866+0000","last_change":"2024-09-16T07:29:39.889286+0000","last_active":"2024-09-16T07:29:39.892866+0000","last_peered":"2024-09-16T07:29:39.892866+0000","last_clean":"2024-09-16T07:29:39.892866+0000","last_became_active":"2024-09-16T07:29:39.888837+0000","last_became_peered":"2024-09-16T07:29:39.888837+0000","last_unstale":"2024-09-16T07:29:39.892866+0000","last_undegraded":"2024-09-16T07:29:39.892866+0000","last_fullsized":"2024-09-16T07:29:39.892866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:56.573970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868428+0000","last_change":"2024-09-16T07:29:39.868428+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868428+0000","last_undegraded":"2024-09-16T07:29:39.868428+0000","last_fullsized":"2024-09-16T07:29:39.868428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887500+0000","last_change":"2024-09-16T07:29:39.881119+0000","last_active":"2024-09-16T07:29:39.887500+0000","last_peered":"2024-09-16T07:29:39.887500+0000","last_clean":"2024-09-16T07:29:39.887500+0000","last_became_active":"2024-09-16T07:29:39.880463+0000","last_became_peered":"2024-09-16T07:29:39.880463+0000","last_unstale":"2024-09-16T07:29:39.887500+0000","last_undegraded":"2024-09-16T07:29:39.887500+0000","last_fullsized":"2024-09-16T07:29:39.887500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:24.703174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865621+0000","last_change":"2024-09-16T07:29:39.865621+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865621+0000","last_undegraded":"2024-09-16T07:29:39.865621+0000","last_fullsized":"2024-09-16T07:29:39.865621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923072+0000","last_change":"2024-09-16T07:29:39.881374+0000","last_active":"2024-09-16T07:29:41.923072+0000","last_peered":"2024-09-16T07:29:41.923072+0000","last_clean":"2024-09-16T07:29:41.923072+0000","last_became_active":"2024-09-16T07:29:39.880798+0000","last_became_peered":"2024-09-16T07:29:39.880798+0000","last_unstale":"2024-09-16T07:29:41.923072+0000","last_undegraded":"2024-09-16T07:29:41.923072+0000","last_fullsized":"2024-09-16T07:29:41.923072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:38.543742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866086+0000","last_change":"2024-09-16T07:29:39.866086+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866086+0000","last_undegraded":"2024-09-16T07:29:39.866086+0000","last_fullsized":"2024-09-16T07:29:39.866086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888047+0000","last_change":"2024-09-16T07:29:39.885365+0000","last_active":"2024-09-16T07:29:39.888047+0000","last_peered":"2024-09-16T07:29:39.888047+0000","last_clean":"2024-09-16T07:29:39.888047+0000","last_became_active":"2024-09-16T07:29:39.884959+0000","last_became_peered":"2024-09-16T07:29:39.884959+0000","last_unstale":"2024-09-16T07:29:39.888047+0000","last_undegraded":"2024-09-16T07:29:39.888047+0000","last_fullsized":"2024-09-16T07:29:39.888047+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:17.128096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878546+0000","last_change":"2024-09-16T07:29:39.878546+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878546+0000","last_undegraded":"2024-09-16T07:29:39.878546+0000","last_fullsized":"2024-09-16T07:29:39.878546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887314+0000","last_change":"2024-09-16T07:29:39.877326+0000","last_active":"2024-09-16T07:29:39.887314+0000","last_peered":"2024-09-16T07:29:39.887314+0000","last_clean":"2024-09-16T07:29:39.887314+0000","last_became_active":"2024-09-16T07:29:39.877050+0000","last_became_peered":"2024-09-16T07:29:39.877050+0000","last_unstale":"2024-09-16T07:29:39.887314+0000","last_undegraded":"2024-09-16T07:29:39.887314+0000","last_fullsized":"2024-09-16T07:29:39.887314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:48.369661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866685+0000","last_change":"2024-09-16T07:29:39.866685+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866685+0000","last_undegraded":"2024-09-16T07:29:39.866685+0000","last_fullsized":"2024-09-16T07:29:39.866685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888072+0000","last_change":"2024-09-16T07:29:39.885291+0000","last_active":"2024-09-16T07:29:39.888072+0000","last_peered":"2024-09-16T07:29:39.888072+0000","last_clean":"2024-09-16T07:29:39.888072+0000","last_became_active":"2024-09-16T07:29:39.885042+0000","last_became_peered":"2024-09-16T07:29:39.885042+0000","last_unstale":"2024-09-16T07:29:39.888072+0000","last_undegraded":"2024-09-16T07:29:39.888072+0000","last_fullsized":"2024-09-16T07:29:39.888072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:03.118256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864736+0000","last_change":"2024-09-16T07:29:39.864736+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864736+0000","last_undegraded":"2024-09-16T07:29:39.864736+0000","last_fullsized":"2024-09-16T07:29:39.864736+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890066+0000","last_change":"2024-09-16T07:29:39.884132+0000","last_active":"2024-09-16T07:29:39.890066+0000","last_peered":"2024-09-16T07:29:39.890066+0000","last_clean":"2024-09-16T07:29:39.890066+0000","last_became_active":"2024-09-16T07:29:39.883836+0000","last_became_peered":"2024-09-16T07:29:39.883836+0000","last_unstale":"2024-09-16T07:29:39.890066+0000","last_undegraded":"2024-09-16T07:29:39.890066+0000","last_fullsized":"2024-09-16T07:29:39.890066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:40.793320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923356+0000","last_change":"2024-09-16T07:29:40.883420+0000","last_active":"2024-09-16T07:29:41.923356+0000","last_peered":"2024-09-16T07:29:41.923356+0000","last_clean":"2024-09-16T07:29:41.923356+0000","last_became_active":"2024-09-16T07:29:40.883191+0000","last_became_peered":"2024-09-16T07:29:40.883191+0000","last_unstale":"2024-09-16T07:29:41.923356+0000","last_undegraded":"2024-09-16T07:29:41.923356+0000","last_fullsized":"2024-09-16T07:29:41.923356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:31.229980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923177+0000","last_change":"2024-09-16T07:29:39.879866+0000","last_active":"2024-09-16T07:29:41.923177+0000","last_peered":"2024-09-16T07:29:41.923177+0000","last_clean":"2024-09-16T07:29:41.923177+0000","last_became_active":"2024-09-16T07:29:39.879449+0000","last_became_peered":"2024-09-16T07:29:39.879449+0000","last_unstale":"2024-09-16T07:29:41.923177+0000","last_undegraded":"2024-09-16T07:29:41.923177+0000","last_fullsized":"2024-09-16T07:29:41.923177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:11:51.597102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874640+0000","last_change":"2024-09-16T07:29:39.874640+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874640+0000","last_undegraded":"2024-09-16T07:29:39.874640+0000","last_fullsized":"2024-09-16T07:29:39.874640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.893178+0000","last_change":"2024-09-16T07:29:39.888996+0000","last_active":"2024-09-16T07:29:39.893178+0000","last_peered":"2024-09-16T07:29:39.893178+0000","last_clean":"2024-09-16T07:29:39.893178+0000","last_became_active":"2024-09-16T07:29:39.888800+0000","last_became_peered":"2024-09-16T07:29:39.888800+0000","last_unstale":"2024-09-16T07:29:39.893178+0000","last_undegraded":"2024-09-16T07:29:39.893178+0000","last_fullsized":"2024-09-16T07:29:39.893178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.839005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865792+0000","last_change":"2024-09-16T07:29:39.865792+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865792+0000","last_undegraded":"2024-09-16T07:29:39.865792+0000","last_fullsized":"2024-09-16T07:29:39.865792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.880938+0000","last_change":"2024-09-16T07:29:39.875251+0000","last_active":"2024-09-16T07:29:39.880938+0000","last_peered":"2024-09-16T07:29:39.880938+0000","last_clean":"2024-09-16T07:29:39.880938+0000","last_became_active":"2024-09-16T07:29:39.875004+0000","last_became_peered":"2024-09-16T07:29:39.875004+0000","last_unstale":"2024-09-16T07:29:39.880938+0000","last_undegraded":"2024-09-16T07:29:39.880938+0000","last_fullsized":"2024-09-16T07:29:39.880938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:45.556407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866527+0000","last_change":"2024-09-16T07:29:39.866527+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866527+0000","last_undegraded":"2024-09-16T07:29:39.866527+0000","last_fullsized":"2024-09-16T07:29:39.866527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884516+0000","last_change":"2024-09-16T07:29:39.878820+0000","last_active":"2024-09-16T07:29:39.884516+0000","last_peered":"2024-09-16T07:29:39.884516+0000","last_clean":"2024-09-16T07:29:39.884516+0000","last_became_active":"2024-09-16T07:29:39.878471+0000","last_became_peered":"2024-09-16T07:29:39.878471+0000","last_unstale":"2024-09-16T07:29:39.884516+0000","last_undegraded":"2024-09-16T07:29:39.884516+0000","last_fullsized":"2024-09-16T07:29:39.884516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:50:08.547444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867321+0000","last_change":"2024-09-16T07:29:39.867321+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867321+0000","last_undegraded":"2024-09-16T07:29:39.867321+0000","last_fullsized":"2024-09-16T07:29:39.867321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884787+0000","last_change":"2024-09-16T07:29:39.875309+0000","last_active":"2024-09-16T07:29:39.884787+0000","last_peered":"2024-09-16T07:29:39.884787+0000","last_clean":"2024-09-16T07:29:39.884787+0000","last_became_active":"2024-09-16T07:29:39.875039+0000","last_became_peered":"2024-09-16T07:29:39.875039+0000","last_unstale":"2024-09-16T07:29:39.884787+0000","last_undegraded":"2024-09-16T07:29:39.884787+0000","last_fullsized":"2024-09-16T07:29:39.884787+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869690+0000","last_change":"2024-09-16T07:29:39.869690+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869690+0000","last_undegraded":"2024-09-16T07:29:39.869690+0000","last_fullsized":"2024-09-16T07:29:39.869690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.882704+0000","last_change":"2024-09-16T07:29:39.877319+0000","last_active":"2024-09-16T07:29:39.882704+0000","last_peered":"2024-09-16T07:29:39.882704+0000","last_clean":"2024-09-16T07:29:39.882704+0000","last_became_active":"2024-09-16T07:29:39.876985+0000","last_became_peered":"2024-09-16T07:29:39.876985+0000","last_unstale":"2024-09-16T07:29:39.882704+0000","last_undegraded":"2024-09-16T07:29:39.882704+0000","last_fullsized":"2024-09-16T07:29:39.882704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:30.703785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922956+0000","last_change":"2024-09-16T07:29:40.900347+0000","last_active":"2024-09-16T07:29:41.922956+0000","last_peered":"2024-09-16T07:29:41.922956+0000","last_clean":"2024-09-16T07:29:41.922956+0000","last_became_active":"2024-09-16T07:29:40.892923+0000","last_became_peered":"2024-09-16T07:29:40.892923+0000","last_unstale":"2024-09-16T07:29:41.922956+0000","last_undegraded":"2024-09-16T07:29:41.922956+0000","last_fullsized":"2024-09-16T07:29:41.922956+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:42.855984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892832+0000","last_change":"2024-09-16T07:29:39.889122+0000","last_active":"2024-09-16T07:29:39.892832+0000","last_peered":"2024-09-16T07:29:39.892832+0000","last_clean":"2024-09-16T07:29:39.892832+0000","last_became_active":"2024-09-16T07:29:39.888890+0000","last_became_peered":"2024-09-16T07:29:39.888890+0000","last_unstale":"2024-09-16T07:29:39.892832+0000","last_undegraded":"2024-09-16T07:29:39.892832+0000","last_fullsized":"2024-09-16T07:29:39.892832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:52.147472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877065+0000","last_change":"2024-09-16T07:29:39.877065+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877065+0000","last_undegraded":"2024-09-16T07:29:39.877065+0000","last_fullsized":"2024-09-16T07:29:39.877065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890340+0000","last_change":"2024-09-16T07:29:39.883628+0000","last_active":"2024-09-16T07:29:39.890340+0000","last_peered":"2024-09-16T07:29:39.890340+0000","last_clean":"2024-09-16T07:29:39.890340+0000","last_became_active":"2024-09-16T07:29:39.883294+0000","last_became_peered":"2024-09-16T07:29:39.883294+0000","last_unstale":"2024-09-16T07:29:39.890340+0000","last_undegraded":"2024-09-16T07:29:39.890340+0000","last_fullsized":"2024-09-16T07:29:39.890340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:15:03.149984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865824+0000","last_change":"2024-09-16T07:29:39.865824+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865824+0000","last_undegraded":"2024-09-16T07:29:39.865824+0000","last_fullsized":"2024-09-16T07:29:39.865824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888472+0000","last_change":"2024-09-16T07:29:39.886269+0000","last_active":"2024-09-16T07:29:39.888472+0000","last_peered":"2024-09-16T07:29:39.888472+0000","last_clean":"2024-09-16T07:29:39.888472+0000","last_became_active":"2024-09-16T07:29:39.885929+0000","last_became_peered":"2024-09-16T07:29:39.885929+0000","last_unstale":"2024-09-16T07:29:39.888472+0000","last_undegraded":"2024-09-16T07:29:39.888472+0000","last_fullsized":"2024-09-16T07:29:39.888472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.873597+0000","last_change":"2024-09-16T07:29:39.873597+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.873597+0000","last_undegraded":"2024-09-16T07:29:39.873597+0000","last_fullsized":"2024-09-16T07:29:39.873597+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887526+0000","last_change":"2024-09-16T07:29:39.881323+0000","last_active":"2024-09-16T07:29:39.887526+0000","last_peered":"2024-09-16T07:29:39.887526+0000","last_clean":"2024-09-16T07:29:39.887526+0000","last_became_active":"2024-09-16T07:29:39.880843+0000","last_became_peered":"2024-09-16T07:29:39.880843+0000","last_unstale":"2024-09-16T07:29:39.887526+0000","last_undegraded":"2024-09-16T07:29:39.887526+0000","last_fullsized":"2024-09-16T07:29:39.887526+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:38:28.410493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864744+0000","last_change":"2024-09-16T07:29:39.864744+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864744+0000","last_undegraded":"2024-09-16T07:29:39.864744+0000","last_fullsized":"2024-09-16T07:29:39.864744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888449+0000","last_change":"2024-09-16T07:29:39.884411+0000","last_active":"2024-09-16T07:29:39.888449+0000","last_peered":"2024-09-16T07:29:39.888449+0000","last_clean":"2024-09-16T07:29:39.888449+0000","last_became_active":"2024-09-16T07:29:39.882654+0000","last_became_peered":"2024-09-16T07:29:39.882654+0000","last_unstale":"2024-09-16T07:29:39.888449+0000","last_undegraded":"2024-09-16T07:29:39.888449+0000","last_fullsized":"2024-09-16T07:29:39.888449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:55:16.541963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866691+0000","last_change":"2024-09-16T07:29:39.866691+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866691+0000","last_undegraded":"2024-09-16T07:29:39.866691+0000","last_fullsized":"2024-09-16T07:29:39.866691+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887291+0000","last_change":"2024-09-16T07:29:39.878614+0000","last_active":"2024-09-16T07:29:39.887291+0000","last_peered":"2024-09-16T07:29:39.887291+0000","last_clean":"2024-09-16T07:29:39.887291+0000","last_became_active":"2024-09-16T07:29:39.878365+0000","last_became_peered":"2024-09-16T07:29:39.878365+0000","last_unstale":"2024-09-16T07:29:39.887291+0000","last_undegraded":"2024-09-16T07:29:39.887291+0000","last_fullsized":"2024-09-16T07:29:39.887291+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:43.611481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869794+0000","last_change":"2024-09-16T07:29:39.869794+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869794+0000","last_undegraded":"2024-09-16T07:29:39.869794+0000","last_fullsized":"2024-09-16T07:29:39.869794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890518+0000","last_change":"2024-09-16T07:29:39.886820+0000","last_active":"2024-09-16T07:29:39.890518+0000","last_peered":"2024-09-16T07:29:39.890518+0000","last_clean":"2024-09-16T07:29:39.890518+0000","last_became_active":"2024-09-16T07:29:39.886480+0000","last_became_peered":"2024-09-16T07:29:39.886480+0000","last_unstale":"2024-09-16T07:29:39.890518+0000","last_undegraded":"2024-09-16T07:29:39.890518+0000","last_fullsized":"2024-09-16T07:29:39.890518+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:10.572704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864858+0000","last_change":"2024-09-16T07:29:39.864858+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864858+0000","last_undegraded":"2024-09-16T07:29:39.864858+0000","last_fullsized":"2024-09-16T07:29:39.864858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.885632+0000","last_change":"2024-09-16T07:29:39.877534+0000","last_active":"2024-09-16T07:29:39.885632+0000","last_peered":"2024-09-16T07:29:39.885632+0000","last_clean":"2024-09-16T07:29:39.885632+0000","last_became_active":"2024-09-16T07:29:39.877243+0000","last_became_peered":"2024-09-16T07:29:39.877243+0000","last_unstale":"2024-09-16T07:29:39.885632+0000","last_undegraded":"2024-09-16T07:29:39.885632+0000","last_fullsized":"2024-09-16T07:29:39.885632+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:07.629863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874229+0000","last_change":"2024-09-16T07:29:39.874229+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874229+0000","last_undegraded":"2024-09-16T07:29:39.874229+0000","last_fullsized":"2024-09-16T07:29:39.874229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892771+0000","last_change":"2024-09-16T07:29:39.887812+0000","last_active":"2024-09-16T07:29:39.892771+0000","last_peered":"2024-09-16T07:29:39.892771+0000","last_clean":"2024-09-16T07:29:39.892771+0000","last_became_active":"2024-09-16T07:29:39.886975+0000","last_became_peered":"2024-09-16T07:29:39.886975+0000","last_unstale":"2024-09-16T07:29:39.892771+0000","last_undegraded":"2024-09-16T07:29:39.892771+0000","last_fullsized":"2024-09-16T07:29:39.892771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.849005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874253+0000","last_change":"2024-09-16T07:29:39.874253+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874253+0000","last_undegraded":"2024-09-16T07:29:39.874253+0000","last_fullsized":"2024-09-16T07:29:39.874253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884961+0000","last_change":"2024-09-16T07:29:39.880008+0000","last_active":"2024-09-16T07:29:39.884961+0000","last_peered":"2024-09-16T07:29:39.884961+0000","last_clean":"2024-09-16T07:29:39.884961+0000","last_became_active":"2024-09-16T07:29:39.879765+0000","last_became_peered":"2024-09-16T07:29:39.879765+0000","last_unstale":"2024-09-16T07:29:39.884961+0000","last_undegraded":"2024-09-16T07:29:39.884961+0000","last_fullsized":"2024-09-16T07:29:39.884961+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:35.640560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.870813+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:39.870813+0000","last_peered":"2024-09-16T07:29:39.870813+0000","last_clean":"2024-09-16T07:29:39.870813+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:39.870813+0000","last_undegraded":"2024-09-16T07:29:39.870813+0000","last_fullsized":"2024-09-16T07:29:39.870813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1077248,"data_stored":779961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":773694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":524288,"data_stored":204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:45.773 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-09-16T07:29:45.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.865421+0000', 'last_change': '2024-09-16T07:29:39.865421+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.865421+0000', 'last_undegraded': '2024-09-16T07:29:39.865421+0000', 'last_fullsized': '2024-09-16T07:29:39.865421+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866535+0000', 'last_change': '2024-09-16T07:29:39.866535+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866535+0000', 'last_undegraded': '2024-09-16T07:29:39.866535+0000', 'last_fullsized': '2024-09-16T07:29:39.866535+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.876573+0000', 'last_change': '2024-09-16T07:29:39.876573+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.876573+0000', 'last_undegraded': '2024-09-16T07:29:39.876573+0000', 'last_fullsized': '2024-09-16T07:29:39.876573+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.874114+0000', 'last_change': '2024-09-16T07:29:39.874114+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.874114+0000', 'last_undegraded': '2024-09-16T07:29:39.874114+0000', 'last_fullsized': '2024-09-16T07:29:39.874114+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866051+0000', 'last_change': '2024-09-16T07:29:39.866051+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866051+0000', 'last_undegraded': '2024-09-16T07:29:39.866051+0000', 'last_fullsized': '2024-09-16T07:29:39.866051+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3a is not active+clean 2024-09-16T07:29:45.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867756+0000', 'last_change': '2024-09-16T07:29:39.867756+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867756+0000', 'last_undegraded': '2024-09-16T07:29:39.867756+0000', 'last_fullsized': '2024-09-16T07:29:39.867756+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.865262+0000', 'last_change': '2024-09-16T07:29:39.865262+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.865262+0000', 'last_undegraded': '2024-09-16T07:29:39.865262+0000', 'last_fullsized': '2024-09-16T07:29:39.865262+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.877907+0000', 'last_change': '2024-09-16T07:29:39.877907+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.877907+0000', 'last_undegraded': '2024-09-16T07:29:39.877907+0000', 'last_fullsized': '2024-09-16T07:29:39.877907+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.875034+0000', 'last_change': '2024-09-16T07:29:39.875034+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.875034+0000', 'last_undegraded': '2024-09-16T07:29:39.875034+0000', 'last_fullsized': '2024-09-16T07:29:39.875034+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.875359+0000', 'last_change': '2024-09-16T07:29:39.875359+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.875359+0000', 'last_undegraded': '2024-09-16T07:29:39.875359+0000', 'last_fullsized': '2024-09-16T07:29:39.875359+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.878663+0000', 'last_change': '2024-09-16T07:29:39.878663+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.878663+0000', 'last_undegraded': '2024-09-16T07:29:39.878663+0000', 'last_fullsized': '2024-09-16T07:29:39.878663+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.775 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867105+0000', 'last_change': '2024-09-16T07:29:39.867105+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867105+0000', 'last_undegraded': '2024-09-16T07:29:39.867105+0000', 'last_fullsized': '2024-09-16T07:29:39.867105+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.875826+0000', 'last_change': '2024-09-16T07:29:39.875826+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.875826+0000', 'last_undegraded': '2024-09-16T07:29:39.875826+0000', 'last_fullsized': '2024-09-16T07:29:39.875826+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867469+0000', 'last_change': '2024-09-16T07:29:39.867469+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867469+0000', 'last_undegraded': '2024-09-16T07:29:39.867469+0000', 'last_fullsized': '2024-09-16T07:29:39.867469+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.868646+0000', 'last_change': '2024-09-16T07:29:39.868646+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.868646+0000', 'last_undegraded': '2024-09-16T07:29:39.868646+0000', 'last_fullsized': '2024-09-16T07:29:39.868646+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.875302+0000', 'last_change': '2024-09-16T07:29:39.875302+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.875302+0000', 'last_undegraded': '2024-09-16T07:29:39.875302+0000', 'last_fullsized': '2024-09-16T07:29:39.875302+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-16T07:29:45.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.878579+0000', 'last_change': '2024-09-16T07:29:39.878579+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.878579+0000', 'last_undegraded': '2024-09-16T07:29:39.878579+0000', 'last_fullsized': '2024-09-16T07:29:39.878579+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.869105+0000', 'last_change': '2024-09-16T07:29:39.869105+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.869105+0000', 'last_undegraded': '2024-09-16T07:29:39.869105+0000', 'last_fullsized': '2024-09-16T07:29:39.869105+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.870163+0000', 'last_change': '2024-09-16T07:29:39.870163+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.870163+0000', 'last_undegraded': '2024-09-16T07:29:39.870163+0000', 'last_fullsized': '2024-09-16T07:29:39.870163+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.875466+0000', 'last_change': '2024-09-16T07:29:39.875466+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.875466+0000', 'last_undegraded': '2024-09-16T07:29:39.875466+0000', 'last_fullsized': '2024-09-16T07:29:39.875466+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.868964+0000', 'last_change': '2024-09-16T07:29:39.868964+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.868964+0000', 'last_undegraded': '2024-09-16T07:29:39.868964+0000', 'last_fullsized': '2024-09-16T07:29:39.868964+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867472+0000', 'last_change': '2024-09-16T07:29:39.867472+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867472+0000', 'last_undegraded': '2024-09-16T07:29:39.867472+0000', 'last_fullsized': '2024-09-16T07:29:39.867472+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.777 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867678+0000', 'last_change': '2024-09-16T07:29:39.867678+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867678+0000', 'last_undegraded': '2024-09-16T07:29:39.867678+0000', 'last_fullsized': '2024-09-16T07:29:39.867678+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.874644+0000', 'last_change': '2024-09-16T07:29:39.874644+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.874644+0000', 'last_undegraded': '2024-09-16T07:29:39.874644+0000', 'last_fullsized': '2024-09-16T07:29:39.874644+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866700+0000', 'last_change': '2024-09-16T07:29:39.866700+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866700+0000', 'last_undegraded': '2024-09-16T07:29:39.866700+0000', 'last_fullsized': '2024-09-16T07:29:39.866700+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.868093+0000', 'last_change': '2024-09-16T07:29:39.868093+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.868093+0000', 'last_undegraded': '2024-09-16T07:29:39.868093+0000', 'last_fullsized': '2024-09-16T07:29:39.868093+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.875529+0000', 'last_change': '2024-09-16T07:29:39.875529+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.875529+0000', 'last_undegraded': '2024-09-16T07:29:39.875529+0000', 'last_fullsized': '2024-09-16T07:29:39.875529+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:PG 7.21 is not active+clean 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866942+0000', 'last_change': '2024-09-16T07:29:39.866942+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866942+0000', 'last_undegraded': '2024-09-16T07:29:39.866942+0000', 'last_fullsized': '2024-09-16T07:29:39.866942+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.778 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867156+0000', 'last_change': '2024-09-16T07:29:39.867156+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867156+0000', 'last_undegraded': '2024-09-16T07:29:39.867156+0000', 'last_fullsized': '2024-09-16T07:29:39.867156+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867143+0000', 'last_change': '2024-09-16T07:29:39.867143+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867143+0000', 'last_undegraded': '2024-09-16T07:29:39.867143+0000', 'last_fullsized': '2024-09-16T07:29:39.867143+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866249+0000', 'last_change': '2024-09-16T07:29:39.866249+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866249+0000', 'last_undegraded': '2024-09-16T07:29:39.866249+0000', 'last_fullsized': '2024-09-16T07:29:39.866249+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867072+0000', 'last_change': '2024-09-16T07:29:39.867072+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867072+0000', 'last_undegraded': '2024-09-16T07:29:39.867072+0000', 'last_fullsized': '2024-09-16T07:29:39.867072+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.874833+0000', 'last_change': '2024-09-16T07:29:39.874833+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.874833+0000', 'last_undegraded': '2024-09-16T07:29:39.874833+0000', 'last_fullsized': '2024-09-16T07:29:39.874833+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-16T07:29:45.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.878951+0000', 'last_change': '2024-09-16T07:29:39.878951+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.878951+0000', 'last_undegraded': '2024-09-16T07:29:39.878951+0000', 'last_fullsized': '2024-09-16T07:29:39.878951+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.877557+0000', 'last_change': '2024-09-16T07:29:39.877557+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.877557+0000', 'last_undegraded': '2024-09-16T07:29:39.877557+0000', 'last_fullsized': '2024-09-16T07:29:39.877557+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867062+0000', 'last_change': '2024-09-16T07:29:39.867062+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867062+0000', 'last_undegraded': '2024-09-16T07:29:39.867062+0000', 'last_fullsized': '2024-09-16T07:29:39.867062+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.877960+0000', 'last_change': '2024-09-16T07:29:39.877960+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.877960+0000', 'last_undegraded': '2024-09-16T07:29:39.877960+0000', 'last_fullsized': '2024-09-16T07:29:39.877960+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.864953+0000', 'last_change': '2024-09-16T07:29:39.864953+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.864953+0000', 'last_undegraded': '2024-09-16T07:29:39.864953+0000', 'last_fullsized': '2024-09-16T07:29:39.864953+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.868428+0000', 'last_change': '2024-09-16T07:29:39.868428+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.868428+0000', 'last_undegraded': '2024-09-16T07:29:39.868428+0000', 'last_fullsized': '2024-09-16T07:29:39.868428+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-16T07:29:45.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.865621+0000', 'last_change': '2024-09-16T07:29:39.865621+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.865621+0000', 'last_undegraded': '2024-09-16T07:29:39.865621+0000', 'last_fullsized': '2024-09-16T07:29:39.865621+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866086+0000', 'last_change': '2024-09-16T07:29:39.866086+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866086+0000', 'last_undegraded': '2024-09-16T07:29:39.866086+0000', 'last_fullsized': '2024-09-16T07:29:39.866086+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.878546+0000', 'last_change': '2024-09-16T07:29:39.878546+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.878546+0000', 'last_undegraded': '2024-09-16T07:29:39.878546+0000', 'last_fullsized': '2024-09-16T07:29:39.878546+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866685+0000', 'last_change': '2024-09-16T07:29:39.866685+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866685+0000', 'last_undegraded': '2024-09-16T07:29:39.866685+0000', 'last_fullsized': '2024-09-16T07:29:39.866685+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.864736+0000', 'last_change': '2024-09-16T07:29:39.864736+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.864736+0000', 'last_undegraded': '2024-09-16T07:29:39.864736+0000', 'last_fullsized': '2024-09-16T07:29:39.864736+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.874640+0000', 'last_change': '2024-09-16T07:29:39.874640+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.874640+0000', 'last_undegraded': '2024-09-16T07:29:39.874640+0000', 'last_fullsized': '2024-09-16T07:29:39.874640+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.781 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.865792+0000', 'last_change': '2024-09-16T07:29:39.865792+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.865792+0000', 'last_undegraded': '2024-09-16T07:29:39.865792+0000', 'last_fullsized': '2024-09-16T07:29:39.865792+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866527+0000', 'last_change': '2024-09-16T07:29:39.866527+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866527+0000', 'last_undegraded': '2024-09-16T07:29:39.866527+0000', 'last_fullsized': '2024-09-16T07:29:39.866527+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.867321+0000', 'last_change': '2024-09-16T07:29:39.867321+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.867321+0000', 'last_undegraded': '2024-09-16T07:29:39.867321+0000', 'last_fullsized': '2024-09-16T07:29:39.867321+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.869690+0000', 'last_change': '2024-09-16T07:29:39.869690+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.869690+0000', 'last_undegraded': '2024-09-16T07:29:39.869690+0000', 'last_fullsized': '2024-09-16T07:29:39.869690+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.877065+0000', 'last_change': '2024-09-16T07:29:39.877065+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.877065+0000', 'last_undegraded': '2024-09-16T07:29:39.877065+0000', 'last_fullsized': '2024-09-16T07:29:39.877065+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-16T07:29:45.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.865824+0000', 'last_change': '2024-09-16T07:29:39.865824+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.865824+0000', 'last_undegraded': '2024-09-16T07:29:39.865824+0000', 'last_fullsized': '2024-09-16T07:29:39.865824+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.873597+0000', 'last_change': '2024-09-16T07:29:39.873597+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.873597+0000', 'last_undegraded': '2024-09-16T07:29:39.873597+0000', 'last_fullsized': '2024-09-16T07:29:39.873597+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.864744+0000', 'last_change': '2024-09-16T07:29:39.864744+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.864744+0000', 'last_undegraded': '2024-09-16T07:29:39.864744+0000', 'last_fullsized': '2024-09-16T07:29:39.864744+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.866691+0000', 'last_change': '2024-09-16T07:29:39.866691+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.866691+0000', 'last_undegraded': '2024-09-16T07:29:39.866691+0000', 'last_fullsized': '2024-09-16T07:29:39.866691+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.869794+0000', 'last_change': '2024-09-16T07:29:39.869794+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.869794+0000', 'last_undegraded': '2024-09-16T07:29:39.869794+0000', 'last_fullsized': '2024-09-16T07:29:39.869794+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.864858+0000', 'last_change': '2024-09-16T07:29:39.864858+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.864858+0000', 'last_undegraded': '2024-09-16T07:29:39.864858+0000', 'last_fullsized': '2024-09-16T07:29:39.864858+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-16T07:29:45.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.874229+0000', 'last_change': '2024-09-16T07:29:39.874229+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.874229+0000', 'last_undegraded': '2024-09-16T07:29:39.874229+0000', 'last_fullsized': '2024-09-16T07:29:39.874229+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:29:45.784 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-16T07:29:45.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:29:39.874253+0000', 'last_change': '2024-09-16T07:29:39.874253+0000', 'last_active': '2024-09-16T07:29:39.850949+0000', 'last_peered': '2024-09-16T07:29:39.850949+0000', 'last_clean': '2024-09-16T07:29:39.850949+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:29:39.874253+0000', 'last_undegraded': '2024-09-16T07:29:39.874253+0000', 'last_fullsized': '2024-09-16T07:29:39.874253+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'last_clean_scrub_stamp': '2024-09-16T07:29:39.850949+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:29:45.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:29:45.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.952+0000 7f6c4cc00640 1 -- 172.21.15.114:0/2879780252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c2c0052f0 msgr2=0x7f6c2c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.952+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/2879780252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c2c0052f0 0x7f6c2c00b9d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6c40006fd0 tx=0x7f6c4001cad0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.952+0000 7f6c4cc00640 1 -- 172.21.15.114:0/2879780252 shutdown_connections 2024-09-16T07:29:45.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.952+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/2879780252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c2c0052f0 0x7f6c2c00b9d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.952+0000 7f6c4cc00640 1 -- 172.21.15.114:0/2879780252 >> 172.21.15.114:0/2879780252 conn(0x7f6c480d1e40 msgr2=0x7f6c480d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:45.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.952+0000 7f6c4cc00640 1 -- 172.21.15.114:0/2879780252 shutdown_connections 2024-09-16T07:29:45.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.952+0000 7f6c4cc00640 1 -- 172.21.15.114:0/2879780252 wait complete. 2024-09-16T07:29:45.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 Processor -- start 2024-09-16T07:29:45.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 -- start start 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c2c0052f0 0x7f6c480c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c481f8c10 0x7f6c480b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4815ea30 0x7f6c4815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c480d0700 con 0x7f6c4815ea30 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c480d0580 con 0x7f6c481f8c10 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4815fec0 con 0x7f6c2c0052f0 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4815ea30 0x7f6c4815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4815ea30 0x7f6c4815eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33820/0 (socket says 172.21.15.114:33820) 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 -- 172.21.15.114:0/169160554 learned_addr learned my addr 172.21.15.114:0/169160554 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c45e00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c2c0052f0 0x7f6c480c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c45400640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c481f8c10 0x7f6c480b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 -- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c2c0052f0 msgr2=0x7f6c480c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c2c0052f0 0x7f6c480c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 -- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c481f8c10 msgr2=0x7f6c480b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c481f8c10 0x7f6c480b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 -- 172.21.15.114:0/169160554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c480c8520 con 0x7f6c4815ea30 2024-09-16T07:29:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c46800640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4815ea30 0x7f6c4815eeb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6c4001d370 tx=0x7f6c40004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:45.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c3e000640 1 -- 172.21.15.114:0/169160554 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40006cb0 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c3e000640 1 -- 172.21.15.114:0/169160554 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c400b5070 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c481f4d90 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c3e000640 1 -- 172.21.15.114:0/169160554 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40006520 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c481f5350 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.956+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c481603b0 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.960+0000 7f6c3e000640 1 -- 172.21.15.114:0/169160554 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f6c400066c0 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.960+0000 7f6c3e000640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c28073070 0x7f6c28075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.960+0000 7f6c3e000640 1 -- 172.21.15.114:0/169160554 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f6c4012ee30 con 0x7f6c4815ea30 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.960+0000 7f6c45e00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c28073070 0x7f6c28075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.960+0000 7f6c45e00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c28073070 0x7f6c28075530 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009470 tx=0x7f6c380091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:45.964+0000 7f6c3e000640 1 -- 172.21.15.114:0/169160554 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6c40016830 con 0x7f6c4815ea30 2024-09-16T07:29:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6c48072770 con 0x7f6c4815ea30 2024-09-16T07:29:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c3e000640 1 -- 172.21.15.114:0/169160554 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1558 (secure 0 0 0) 0x7f6c400f9710 con 0x7f6c4815ea30 2024-09-16T07:29:46.194 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:46.194 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":110,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":58},{"state_name":"active+clean","count":39}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":592002,"bytes_used":226467840,"bytes_avail":772867645440,"bytes_total":773094113280,"inactive_pgs_ratio":0.59793812036514282,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":27,"btime":"2024-09-16T07:29:43:896581+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5307}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-16T07:29:29.009656+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c28073070 msgr2=0x7f6c28075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c28073070 0x7f6c28075530 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009470 tx=0x7f6c380091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4815ea30 msgr2=0x7f6c4815eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4815ea30 0x7f6c4815eeb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6c4001d370 tx=0x7f6c40004ff0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 shutdown_connections 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c28073070 0x7f6c28075530 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c4815ea30 0x7f6c4815eeb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c481f8c10 0x7f6c480b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 --2- 172.21.15.114:0/169160554 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c2c0052f0 0x7f6c480c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 >> 172.21.15.114:0/169160554 conn(0x7f6c480d1e40 msgr2=0x7f6c480b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:46.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 shutdown_connections 2024-09-16T07:29:46.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.192+0000 7f6c4cc00640 1 -- 172.21.15.114:0/169160554 wait complete. 2024-09-16T07:29:46.217 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:29:46.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:46.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 -- 172.21.15.114:0/2422994831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 msgr2=0x7fa1700cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 --2- 172.21.15.114:0/2422994831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 0x7fa1700cc940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa158009870 tx=0x7fa15801c740 comp rx=0 tx=0).stop 2024-09-16T07:29:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 -- 172.21.15.114:0/2422994831 shutdown_connections 2024-09-16T07:29:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 --2- 172.21.15.114:0/2422994831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 0x7fa1700cc940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 -- 172.21.15.114:0/2422994831 >> 172.21.15.114:0/2422994831 conn(0x7fa1700d1ea0 msgr2=0x7fa1700d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 -- 172.21.15.114:0/2422994831 shutdown_connections 2024-09-16T07:29:46.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 -- 172.21.15.114:0/2422994831 wait complete. 2024-09-16T07:29:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 Processor -- start 2024-09-16T07:29:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.356+0000 7fa177200640 1 -- start start 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 0x7fa170155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17015bd50 0x7fa1700b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17015c130 0x7fa17014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa17016a560 con 0x7fa17015c130 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa17016a3e0 con 0x7fa17015bd50 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa17016a6e0 con 0x7fa1700cecf0 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17015c130 0x7fa17014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 0x7fa170155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17015c130 0x7fa17014efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33822/0 (socket says 172.21.15.114:33822) 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 -- 172.21.15.114:0/904140331 learned_addr learned my addr 172.21.15.114:0/904140331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa167400640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17015bd50 0x7fa1700b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:46.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 -- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 msgr2=0x7fa170155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 0x7fa170155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 -- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17015bd50 msgr2=0x7fa1700b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17015bd50 0x7fa1700b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 -- 172.21.15.114:0/904140331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1700b52f0 con 0x7fa17015c130 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa175200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17015c130 0x7fa17014efb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa16800cae0 tx=0x7fa16800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa16cc00640 1 -- 172.21.15.114:0/904140331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168016020 con 0x7fa17015c130 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa16cc00640 1 -- 172.21.15.114:0/904140331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa16800ab40 con 0x7fa17015c130 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa16cc00640 1 -- 172.21.15.114:0/904140331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16800ce20 con 0x7fa17015c130 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1700b55d0 con 0x7fa17015c130 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1700b5b90 con 0x7fa17015c130 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.360+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1700ce5e0 con 0x7fa17015c130 2024-09-16T07:29:46.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.364+0000 7fa16cc00640 1 -- 172.21.15.114:0/904140331 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fa168019020 con 0x7fa17015c130 2024-09-16T07:29:46.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.364+0000 7fa16cc00640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa14c073070 0x7fa14c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:46.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.364+0000 7fa16cc00640 1 -- 172.21.15.114:0/904140331 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fa168093fb0 con 0x7fa17015c130 2024-09-16T07:29:46.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.364+0000 7fa16fe00640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa14c073070 0x7fa14c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:46.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.364+0000 7fa16fe00640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa14c073070 0x7fa14c075530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa160000c10 tx=0x7fa160009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:46.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.368+0000 7fa16cc00640 1 -- 172.21.15.114:0/904140331 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa168020030 con 0x7fa17015c130 2024-09-16T07:29:46.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.532+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa17006ad50 con 0x7fa14c073070 2024-09-16T07:29:46.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa16cc00640 1 -- 172.21.15.114:0/904140331 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247171 (secure 0 0 0) 0x7fa17006ad50 con 0x7fa14c073070 2024-09-16T07:29:46.544 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:46.545 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:46.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa14c073070 msgr2=0x7fa14c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:46.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa14c073070 0x7fa14c075530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa160000c10 tx=0x7fa160009040 comp rx=0 tx=0).stop 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17015c130 msgr2=0x7fa17014efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17015c130 0x7fa17014efb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa16800cae0 tx=0x7fa16800cbd0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 shutdown_connections 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa14c073070 0x7fa14c075530 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa17015c130 0x7fa17014efb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa17015bd50 0x7fa1700b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 --2- 172.21.15.114:0/904140331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa1700cecf0 0x7fa170155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.540+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 >> 172.21.15.114:0/904140331 conn(0x7fa1700d1ea0 msgr2=0x7fa170153470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.544+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 shutdown_connections 2024-09-16T07:29:46.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:46.544+0000 7fa177200640 1 -- 172.21.15.114:0/904140331 wait complete. 2024-09-16T07:29:46.565 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-16T07:29:45.013401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221160,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753560,"statfs":{"total":773094113280,"available":772867645440,"internally_reserved":0,"allocated":5021696,"data_stored":2674587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001665"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865421+0000","last_change":"2024-09-16T07:29:39.865421+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865421+0000","last_undegraded":"2024-09-16T07:29:39.865421+0000","last_fullsized":"2024-09-16T07:29:39.865421+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866535+0000","last_change":"2024-09-16T07:29:39.866535+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866535+0000","last_undegraded":"2024-09-16T07:29:39.866535+0000","last_fullsized":"2024-09-16T07:29:39.866535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.876573+0000","last_change":"2024-09-16T07:29:39.876573+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.876573+0000","last_undegraded":"2024-09-16T07:29:39.876573+0000","last_fullsized":"2024-09-16T07:29:39.876573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874114+0000","last_change":"2024-09-16T07:29:39.874114+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874114+0000","last_undegraded":"2024-09-16T07:29:39.874114+0000","last_fullsized":"2024-09-16T07:29:39.874114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866051+0000","last_change":"2024-09-16T07:29:39.866051+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866051+0000","last_undegraded":"2024-09-16T07:29:39.866051+0000","last_fullsized":"2024-09-16T07:29:39.866051+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867756+0000","last_change":"2024-09-16T07:29:39.867756+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867756+0000","last_undegraded":"2024-09-16T07:29:39.867756+0000","last_fullsized":"2024-09-16T07:29:39.867756+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865262+0000","last_change":"2024-09-16T07:29:39.865262+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865262+0000","last_undegraded":"2024-09-16T07:29:39.865262+0000","last_fullsized":"2024-09-16T07:29:39.865262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877907+0000","last_change":"2024-09-16T07:29:39.877907+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877907+0000","last_undegraded":"2024-09-16T07:29:39.877907+0000","last_fullsized":"2024-09-16T07:29:39.877907+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875034+0000","last_change":"2024-09-16T07:29:39.875034+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875034+0000","last_undegraded":"2024-09-16T07:29:39.875034+0000","last_fullsized":"2024-09-16T07:29:39.875034+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875359+0000","last_change":"2024-09-16T07:29:39.875359+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875359+0000","last_undegraded":"2024-09-16T07:29:39.875359+0000","last_fullsized":"2024-09-16T07:29:39.875359+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878663+0000","last_change":"2024-09-16T07:29:39.878663+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878663+0000","last_undegraded":"2024-09-16T07:29:39.878663+0000","last_fullsized":"2024-09-16T07:29:39.878663+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867105+0000","last_change":"2024-09-16T07:29:39.867105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867105+0000","last_undegraded":"2024-09-16T07:29:39.867105+0000","last_fullsized":"2024-09-16T07:29:39.867105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923011+0000","last_change":"2024-09-16T07:29:40.900644+0000","last_active":"2024-09-16T07:29:41.923011+0000","last_peered":"2024-09-16T07:29:41.923011+0000","last_clean":"2024-09-16T07:29:41.923011+0000","last_became_active":"2024-09-16T07:29:40.892564+0000","last_became_peered":"2024-09-16T07:29:40.892564+0000","last_unstale":"2024-09-16T07:29:41.923011+0000","last_undegraded":"2024-09-16T07:29:41.923011+0000","last_fullsized":"2024-09-16T07:29:41.923011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:34.793795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875826+0000","last_change":"2024-09-16T07:29:39.875826+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875826+0000","last_undegraded":"2024-09-16T07:29:39.875826+0000","last_fullsized":"2024-09-16T07:29:39.875826+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867469+0000","last_change":"2024-09-16T07:29:39.867469+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867469+0000","last_undegraded":"2024-09-16T07:29:39.867469+0000","last_fullsized":"2024-09-16T07:29:39.867469+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868646+0000","last_change":"2024-09-16T07:29:39.868646+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868646+0000","last_undegraded":"2024-09-16T07:29:39.868646+0000","last_fullsized":"2024-09-16T07:29:39.868646+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875302+0000","last_change":"2024-09-16T07:29:39.875302+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875302+0000","last_undegraded":"2024-09-16T07:29:39.875302+0000","last_fullsized":"2024-09-16T07:29:39.875302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878579+0000","last_change":"2024-09-16T07:29:39.878579+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878579+0000","last_undegraded":"2024-09-16T07:29:39.878579+0000","last_fullsized":"2024-09-16T07:29:39.878579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869105+0000","last_change":"2024-09-16T07:29:39.869105+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869105+0000","last_undegraded":"2024-09-16T07:29:39.869105+0000","last_fullsized":"2024-09-16T07:29:39.869105+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923204+0000","last_change":"2024-09-16T07:29:40.902051+0000","last_active":"2024-09-16T07:29:41.923204+0000","last_peered":"2024-09-16T07:29:41.923204+0000","last_clean":"2024-09-16T07:29:41.923204+0000","last_became_active":"2024-09-16T07:29:40.901757+0000","last_became_peered":"2024-09-16T07:29:40.901757+0000","last_unstale":"2024-09-16T07:29:41.923204+0000","last_undegraded":"2024-09-16T07:29:41.923204+0000","last_fullsized":"2024-09-16T07:29:41.923204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:25.890937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.870163+0000","last_change":"2024-09-16T07:29:39.870163+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.870163+0000","last_undegraded":"2024-09-16T07:29:39.870163+0000","last_fullsized":"2024-09-16T07:29:39.870163+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875466+0000","last_change":"2024-09-16T07:29:39.875466+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875466+0000","last_undegraded":"2024-09-16T07:29:39.875466+0000","last_fullsized":"2024-09-16T07:29:39.875466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868964+0000","last_change":"2024-09-16T07:29:39.868964+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868964+0000","last_undegraded":"2024-09-16T07:29:39.868964+0000","last_fullsized":"2024-09-16T07:29:39.868964+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867472+0000","last_change":"2024-09-16T07:29:39.867472+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867472+0000","last_undegraded":"2024-09-16T07:29:39.867472+0000","last_fullsized":"2024-09-16T07:29:39.867472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867678+0000","last_change":"2024-09-16T07:29:39.867678+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867678+0000","last_undegraded":"2024-09-16T07:29:39.867678+0000","last_fullsized":"2024-09-16T07:29:39.867678+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923245+0000","last_change":"2024-09-16T07:29:40.905384+0000","last_active":"2024-09-16T07:29:41.923245+0000","last_peered":"2024-09-16T07:29:41.923245+0000","last_clean":"2024-09-16T07:29:41.923245+0000","last_became_active":"2024-09-16T07:29:40.904671+0000","last_became_peered":"2024-09-16T07:29:40.904671+0000","last_unstale":"2024-09-16T07:29:41.923245+0000","last_undegraded":"2024-09-16T07:29:41.923245+0000","last_fullsized":"2024-09-16T07:29:41.923245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:35.612179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874644+0000","last_change":"2024-09-16T07:29:39.874644+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874644+0000","last_undegraded":"2024-09-16T07:29:39.874644+0000","last_fullsized":"2024-09-16T07:29:39.874644+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866700+0000","last_change":"2024-09-16T07:29:39.866700+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866700+0000","last_undegraded":"2024-09-16T07:29:39.866700+0000","last_fullsized":"2024-09-16T07:29:39.866700+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868093+0000","last_change":"2024-09-16T07:29:39.868093+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868093+0000","last_undegraded":"2024-09-16T07:29:39.868093+0000","last_fullsized":"2024-09-16T07:29:39.868093+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.875529+0000","last_change":"2024-09-16T07:29:39.875529+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.875529+0000","last_undegraded":"2024-09-16T07:29:39.875529+0000","last_fullsized":"2024-09-16T07:29:39.875529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866942+0000","last_change":"2024-09-16T07:29:39.866942+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866942+0000","last_undegraded":"2024-09-16T07:29:39.866942+0000","last_fullsized":"2024-09-16T07:29:39.866942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922955+0000","last_change":"2024-09-16T07:29:40.886091+0000","last_active":"2024-09-16T07:29:41.922955+0000","last_peered":"2024-09-16T07:29:41.922955+0000","last_clean":"2024-09-16T07:29:41.922955+0000","last_became_active":"2024-09-16T07:29:40.885871+0000","last_became_peered":"2024-09-16T07:29:40.885871+0000","last_unstale":"2024-09-16T07:29:41.922955+0000","last_undegraded":"2024-09-16T07:29:41.922955+0000","last_fullsized":"2024-09-16T07:29:41.922955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:00.605118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867156+0000","last_change":"2024-09-16T07:29:39.867156+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867156+0000","last_undegraded":"2024-09-16T07:29:39.867156+0000","last_fullsized":"2024-09-16T07:29:39.867156+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886213+0000","last_change":"2024-09-16T07:29:39.879762+0000","last_active":"2024-09-16T07:29:39.886213+0000","last_peered":"2024-09-16T07:29:39.886213+0000","last_clean":"2024-09-16T07:29:39.886213+0000","last_became_active":"2024-09-16T07:29:39.879485+0000","last_became_peered":"2024-09-16T07:29:39.879485+0000","last_unstale":"2024-09-16T07:29:39.886213+0000","last_undegraded":"2024-09-16T07:29:39.886213+0000","last_fullsized":"2024-09-16T07:29:39.886213+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:26.574030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867143+0000","last_change":"2024-09-16T07:29:39.867143+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867143+0000","last_undegraded":"2024-09-16T07:29:39.867143+0000","last_fullsized":"2024-09-16T07:29:39.867143+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890481+0000","last_change":"2024-09-16T07:29:39.885953+0000","last_active":"2024-09-16T07:29:39.890481+0000","last_peered":"2024-09-16T07:29:39.890481+0000","last_clean":"2024-09-16T07:29:39.890481+0000","last_became_active":"2024-09-16T07:29:39.885790+0000","last_became_peered":"2024-09-16T07:29:39.885790+0000","last_unstale":"2024-09-16T07:29:39.890481+0000","last_undegraded":"2024-09-16T07:29:39.890481+0000","last_fullsized":"2024-09-16T07:29:39.890481+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.094051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866249+0000","last_change":"2024-09-16T07:29:39.866249+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866249+0000","last_undegraded":"2024-09-16T07:29:39.866249+0000","last_fullsized":"2024-09-16T07:29:39.866249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.886021+0000","last_change":"2024-09-16T07:29:39.879740+0000","last_active":"2024-09-16T07:29:39.886021+0000","last_peered":"2024-09-16T07:29:39.886021+0000","last_clean":"2024-09-16T07:29:39.886021+0000","last_became_active":"2024-09-16T07:29:39.879515+0000","last_became_peered":"2024-09-16T07:29:39.879515+0000","last_unstale":"2024-09-16T07:29:39.886021+0000","last_undegraded":"2024-09-16T07:29:39.886021+0000","last_fullsized":"2024-09-16T07:29:39.886021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:18.486646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867072+0000","last_change":"2024-09-16T07:29:39.867072+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867072+0000","last_undegraded":"2024-09-16T07:29:39.867072+0000","last_fullsized":"2024-09-16T07:29:39.867072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890350+0000","last_change":"2024-09-16T07:29:39.883681+0000","last_active":"2024-09-16T07:29:39.890350+0000","last_peered":"2024-09-16T07:29:39.890350+0000","last_clean":"2024-09-16T07:29:39.890350+0000","last_became_active":"2024-09-16T07:29:39.883379+0000","last_became_peered":"2024-09-16T07:29:39.883379+0000","last_unstale":"2024-09-16T07:29:39.890350+0000","last_undegraded":"2024-09-16T07:29:39.890350+0000","last_fullsized":"2024-09-16T07:29:39.890350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874833+0000","last_change":"2024-09-16T07:29:39.874833+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874833+0000","last_undegraded":"2024-09-16T07:29:39.874833+0000","last_fullsized":"2024-09-16T07:29:39.874833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890236+0000","last_change":"2024-09-16T07:29:39.887081+0000","last_active":"2024-09-16T07:29:39.890236+0000","last_peered":"2024-09-16T07:29:39.890236+0000","last_clean":"2024-09-16T07:29:39.890236+0000","last_became_active":"2024-09-16T07:29:39.886495+0000","last_became_peered":"2024-09-16T07:29:39.886495+0000","last_unstale":"2024-09-16T07:29:39.890236+0000","last_undegraded":"2024-09-16T07:29:39.890236+0000","last_fullsized":"2024-09-16T07:29:39.890236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:41.057483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878951+0000","last_change":"2024-09-16T07:29:39.878951+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878951+0000","last_undegraded":"2024-09-16T07:29:39.878951+0000","last_fullsized":"2024-09-16T07:29:39.878951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887879+0000","last_change":"2024-09-16T07:29:39.883435+0000","last_active":"2024-09-16T07:29:39.887879+0000","last_peered":"2024-09-16T07:29:39.887879+0000","last_clean":"2024-09-16T07:29:39.887879+0000","last_became_active":"2024-09-16T07:29:39.883171+0000","last_became_peered":"2024-09-16T07:29:39.883171+0000","last_unstale":"2024-09-16T07:29:39.887879+0000","last_undegraded":"2024-09-16T07:29:39.887879+0000","last_fullsized":"2024-09-16T07:29:39.887879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:19:18.647616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877557+0000","last_change":"2024-09-16T07:29:39.877557+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877557+0000","last_undegraded":"2024-09-16T07:29:39.877557+0000","last_fullsized":"2024-09-16T07:29:39.877557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.879105+0000","last_change":"2024-09-16T07:29:39.873042+0000","last_active":"2024-09-16T07:29:39.879105+0000","last_peered":"2024-09-16T07:29:39.879105+0000","last_clean":"2024-09-16T07:29:39.879105+0000","last_became_active":"2024-09-16T07:29:39.872658+0000","last_became_peered":"2024-09-16T07:29:39.872658+0000","last_unstale":"2024-09-16T07:29:39.879105+0000","last_undegraded":"2024-09-16T07:29:39.879105+0000","last_fullsized":"2024-09-16T07:29:39.879105+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:35.078592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867062+0000","last_change":"2024-09-16T07:29:39.867062+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867062+0000","last_undegraded":"2024-09-16T07:29:39.867062+0000","last_fullsized":"2024-09-16T07:29:39.867062+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892814+0000","last_change":"2024-09-16T07:29:39.888960+0000","last_active":"2024-09-16T07:29:39.892814+0000","last_peered":"2024-09-16T07:29:39.892814+0000","last_clean":"2024-09-16T07:29:39.892814+0000","last_became_active":"2024-09-16T07:29:39.888703+0000","last_became_peered":"2024-09-16T07:29:39.888703+0000","last_unstale":"2024-09-16T07:29:39.892814+0000","last_undegraded":"2024-09-16T07:29:39.892814+0000","last_fullsized":"2024-09-16T07:29:39.892814+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:46.078460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877960+0000","last_change":"2024-09-16T07:29:39.877960+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877960+0000","last_undegraded":"2024-09-16T07:29:39.877960+0000","last_fullsized":"2024-09-16T07:29:39.877960+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887868+0000","last_change":"2024-09-16T07:29:39.884308+0000","last_active":"2024-09-16T07:29:39.887868+0000","last_peered":"2024-09-16T07:29:39.887868+0000","last_clean":"2024-09-16T07:29:39.887868+0000","last_became_active":"2024-09-16T07:29:39.883979+0000","last_became_peered":"2024-09-16T07:29:39.883979+0000","last_unstale":"2024-09-16T07:29:39.887868+0000","last_undegraded":"2024-09-16T07:29:39.887868+0000","last_fullsized":"2024-09-16T07:29:39.887868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:32.206213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864953+0000","last_change":"2024-09-16T07:29:39.864953+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864953+0000","last_undegraded":"2024-09-16T07:29:39.864953+0000","last_fullsized":"2024-09-16T07:29:39.864953+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892866+0000","last_change":"2024-09-16T07:29:39.889286+0000","last_active":"2024-09-16T07:29:39.892866+0000","last_peered":"2024-09-16T07:29:39.892866+0000","last_clean":"2024-09-16T07:29:39.892866+0000","last_became_active":"2024-09-16T07:29:39.888837+0000","last_became_peered":"2024-09-16T07:29:39.888837+0000","last_unstale":"2024-09-16T07:29:39.892866+0000","last_undegraded":"2024-09-16T07:29:39.892866+0000","last_fullsized":"2024-09-16T07:29:39.892866+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:56.573970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.868428+0000","last_change":"2024-09-16T07:29:39.868428+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.868428+0000","last_undegraded":"2024-09-16T07:29:39.868428+0000","last_fullsized":"2024-09-16T07:29:39.868428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887500+0000","last_change":"2024-09-16T07:29:39.881119+0000","last_active":"2024-09-16T07:29:39.887500+0000","last_peered":"2024-09-16T07:29:39.887500+0000","last_clean":"2024-09-16T07:29:39.887500+0000","last_became_active":"2024-09-16T07:29:39.880463+0000","last_became_peered":"2024-09-16T07:29:39.880463+0000","last_unstale":"2024-09-16T07:29:39.887500+0000","last_undegraded":"2024-09-16T07:29:39.887500+0000","last_fullsized":"2024-09-16T07:29:39.887500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:24.703174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865621+0000","last_change":"2024-09-16T07:29:39.865621+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865621+0000","last_undegraded":"2024-09-16T07:29:39.865621+0000","last_fullsized":"2024-09-16T07:29:39.865621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923072+0000","last_change":"2024-09-16T07:29:39.881374+0000","last_active":"2024-09-16T07:29:41.923072+0000","last_peered":"2024-09-16T07:29:41.923072+0000","last_clean":"2024-09-16T07:29:41.923072+0000","last_became_active":"2024-09-16T07:29:39.880798+0000","last_became_peered":"2024-09-16T07:29:39.880798+0000","last_unstale":"2024-09-16T07:29:41.923072+0000","last_undegraded":"2024-09-16T07:29:41.923072+0000","last_fullsized":"2024-09-16T07:29:41.923072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:38.543742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866086+0000","last_change":"2024-09-16T07:29:39.866086+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866086+0000","last_undegraded":"2024-09-16T07:29:39.866086+0000","last_fullsized":"2024-09-16T07:29:39.866086+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888047+0000","last_change":"2024-09-16T07:29:39.885365+0000","last_active":"2024-09-16T07:29:39.888047+0000","last_peered":"2024-09-16T07:29:39.888047+0000","last_clean":"2024-09-16T07:29:39.888047+0000","last_became_active":"2024-09-16T07:29:39.884959+0000","last_became_peered":"2024-09-16T07:29:39.884959+0000","last_unstale":"2024-09-16T07:29:39.888047+0000","last_undegraded":"2024-09-16T07:29:39.888047+0000","last_fullsized":"2024-09-16T07:29:39.888047+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:17.128096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.878546+0000","last_change":"2024-09-16T07:29:39.878546+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.878546+0000","last_undegraded":"2024-09-16T07:29:39.878546+0000","last_fullsized":"2024-09-16T07:29:39.878546+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887314+0000","last_change":"2024-09-16T07:29:39.877326+0000","last_active":"2024-09-16T07:29:39.887314+0000","last_peered":"2024-09-16T07:29:39.887314+0000","last_clean":"2024-09-16T07:29:39.887314+0000","last_became_active":"2024-09-16T07:29:39.877050+0000","last_became_peered":"2024-09-16T07:29:39.877050+0000","last_unstale":"2024-09-16T07:29:39.887314+0000","last_undegraded":"2024-09-16T07:29:39.887314+0000","last_fullsized":"2024-09-16T07:29:39.887314+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:48.369661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866685+0000","last_change":"2024-09-16T07:29:39.866685+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866685+0000","last_undegraded":"2024-09-16T07:29:39.866685+0000","last_fullsized":"2024-09-16T07:29:39.866685+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888072+0000","last_change":"2024-09-16T07:29:39.885291+0000","last_active":"2024-09-16T07:29:39.888072+0000","last_peered":"2024-09-16T07:29:39.888072+0000","last_clean":"2024-09-16T07:29:39.888072+0000","last_became_active":"2024-09-16T07:29:39.885042+0000","last_became_peered":"2024-09-16T07:29:39.885042+0000","last_unstale":"2024-09-16T07:29:39.888072+0000","last_undegraded":"2024-09-16T07:29:39.888072+0000","last_fullsized":"2024-09-16T07:29:39.888072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:03.118256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864736+0000","last_change":"2024-09-16T07:29:39.864736+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864736+0000","last_undegraded":"2024-09-16T07:29:39.864736+0000","last_fullsized":"2024-09-16T07:29:39.864736+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890066+0000","last_change":"2024-09-16T07:29:39.884132+0000","last_active":"2024-09-16T07:29:39.890066+0000","last_peered":"2024-09-16T07:29:39.890066+0000","last_clean":"2024-09-16T07:29:39.890066+0000","last_became_active":"2024-09-16T07:29:39.883836+0000","last_became_peered":"2024-09-16T07:29:39.883836+0000","last_unstale":"2024-09-16T07:29:39.890066+0000","last_undegraded":"2024-09-16T07:29:39.890066+0000","last_fullsized":"2024-09-16T07:29:39.890066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:40.793320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923356+0000","last_change":"2024-09-16T07:29:40.883420+0000","last_active":"2024-09-16T07:29:41.923356+0000","last_peered":"2024-09-16T07:29:41.923356+0000","last_clean":"2024-09-16T07:29:41.923356+0000","last_became_active":"2024-09-16T07:29:40.883191+0000","last_became_peered":"2024-09-16T07:29:40.883191+0000","last_unstale":"2024-09-16T07:29:41.923356+0000","last_undegraded":"2024-09-16T07:29:41.923356+0000","last_fullsized":"2024-09-16T07:29:41.923356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:31.229980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923177+0000","last_change":"2024-09-16T07:29:39.879866+0000","last_active":"2024-09-16T07:29:41.923177+0000","last_peered":"2024-09-16T07:29:41.923177+0000","last_clean":"2024-09-16T07:29:41.923177+0000","last_became_active":"2024-09-16T07:29:39.879449+0000","last_became_peered":"2024-09-16T07:29:39.879449+0000","last_unstale":"2024-09-16T07:29:41.923177+0000","last_undegraded":"2024-09-16T07:29:41.923177+0000","last_fullsized":"2024-09-16T07:29:41.923177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:11:51.597102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874640+0000","last_change":"2024-09-16T07:29:39.874640+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874640+0000","last_undegraded":"2024-09-16T07:29:39.874640+0000","last_fullsized":"2024-09-16T07:29:39.874640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.893178+0000","last_change":"2024-09-16T07:29:39.888996+0000","last_active":"2024-09-16T07:29:39.893178+0000","last_peered":"2024-09-16T07:29:39.893178+0000","last_clean":"2024-09-16T07:29:39.893178+0000","last_became_active":"2024-09-16T07:29:39.888800+0000","last_became_peered":"2024-09-16T07:29:39.888800+0000","last_unstale":"2024-09-16T07:29:39.893178+0000","last_undegraded":"2024-09-16T07:29:39.893178+0000","last_fullsized":"2024-09-16T07:29:39.893178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.839005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865792+0000","last_change":"2024-09-16T07:29:39.865792+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865792+0000","last_undegraded":"2024-09-16T07:29:39.865792+0000","last_fullsized":"2024-09-16T07:29:39.865792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.880938+0000","last_change":"2024-09-16T07:29:39.875251+0000","last_active":"2024-09-16T07:29:39.880938+0000","last_peered":"2024-09-16T07:29:39.880938+0000","last_clean":"2024-09-16T07:29:39.880938+0000","last_became_active":"2024-09-16T07:29:39.875004+0000","last_became_peered":"2024-09-16T07:29:39.875004+0000","last_unstale":"2024-09-16T07:29:39.880938+0000","last_undegraded":"2024-09-16T07:29:39.880938+0000","last_fullsized":"2024-09-16T07:29:39.880938+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:45.556407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866527+0000","last_change":"2024-09-16T07:29:39.866527+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866527+0000","last_undegraded":"2024-09-16T07:29:39.866527+0000","last_fullsized":"2024-09-16T07:29:39.866527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884516+0000","last_change":"2024-09-16T07:29:39.878820+0000","last_active":"2024-09-16T07:29:39.884516+0000","last_peered":"2024-09-16T07:29:39.884516+0000","last_clean":"2024-09-16T07:29:39.884516+0000","last_became_active":"2024-09-16T07:29:39.878471+0000","last_became_peered":"2024-09-16T07:29:39.878471+0000","last_unstale":"2024-09-16T07:29:39.884516+0000","last_undegraded":"2024-09-16T07:29:39.884516+0000","last_fullsized":"2024-09-16T07:29:39.884516+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:50:08.547444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.867321+0000","last_change":"2024-09-16T07:29:39.867321+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.867321+0000","last_undegraded":"2024-09-16T07:29:39.867321+0000","last_fullsized":"2024-09-16T07:29:39.867321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884787+0000","last_change":"2024-09-16T07:29:39.875309+0000","last_active":"2024-09-16T07:29:39.884787+0000","last_peered":"2024-09-16T07:29:39.884787+0000","last_clean":"2024-09-16T07:29:39.884787+0000","last_became_active":"2024-09-16T07:29:39.875039+0000","last_became_peered":"2024-09-16T07:29:39.875039+0000","last_unstale":"2024-09-16T07:29:39.884787+0000","last_undegraded":"2024-09-16T07:29:39.884787+0000","last_fullsized":"2024-09-16T07:29:39.884787+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:57.650593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869690+0000","last_change":"2024-09-16T07:29:39.869690+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869690+0000","last_undegraded":"2024-09-16T07:29:39.869690+0000","last_fullsized":"2024-09-16T07:29:39.869690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.882704+0000","last_change":"2024-09-16T07:29:39.877319+0000","last_active":"2024-09-16T07:29:39.882704+0000","last_peered":"2024-09-16T07:29:39.882704+0000","last_clean":"2024-09-16T07:29:39.882704+0000","last_became_active":"2024-09-16T07:29:39.876985+0000","last_became_peered":"2024-09-16T07:29:39.876985+0000","last_unstale":"2024-09-16T07:29:39.882704+0000","last_undegraded":"2024-09-16T07:29:39.882704+0000","last_fullsized":"2024-09-16T07:29:39.882704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:30.703785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922956+0000","last_change":"2024-09-16T07:29:40.900347+0000","last_active":"2024-09-16T07:29:41.922956+0000","last_peered":"2024-09-16T07:29:41.922956+0000","last_clean":"2024-09-16T07:29:41.922956+0000","last_became_active":"2024-09-16T07:29:40.892923+0000","last_became_peered":"2024-09-16T07:29:40.892923+0000","last_unstale":"2024-09-16T07:29:41.922956+0000","last_undegraded":"2024-09-16T07:29:41.922956+0000","last_fullsized":"2024-09-16T07:29:41.922956+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:42.855984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892832+0000","last_change":"2024-09-16T07:29:39.889122+0000","last_active":"2024-09-16T07:29:39.892832+0000","last_peered":"2024-09-16T07:29:39.892832+0000","last_clean":"2024-09-16T07:29:39.892832+0000","last_became_active":"2024-09-16T07:29:39.888890+0000","last_became_peered":"2024-09-16T07:29:39.888890+0000","last_unstale":"2024-09-16T07:29:39.892832+0000","last_undegraded":"2024-09-16T07:29:39.892832+0000","last_fullsized":"2024-09-16T07:29:39.892832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:52.147472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.877065+0000","last_change":"2024-09-16T07:29:39.877065+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.877065+0000","last_undegraded":"2024-09-16T07:29:39.877065+0000","last_fullsized":"2024-09-16T07:29:39.877065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890340+0000","last_change":"2024-09-16T07:29:39.883628+0000","last_active":"2024-09-16T07:29:39.890340+0000","last_peered":"2024-09-16T07:29:39.890340+0000","last_clean":"2024-09-16T07:29:39.890340+0000","last_became_active":"2024-09-16T07:29:39.883294+0000","last_became_peered":"2024-09-16T07:29:39.883294+0000","last_unstale":"2024-09-16T07:29:39.890340+0000","last_undegraded":"2024-09-16T07:29:39.890340+0000","last_fullsized":"2024-09-16T07:29:39.890340+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:15:03.149984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.865824+0000","last_change":"2024-09-16T07:29:39.865824+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.865824+0000","last_undegraded":"2024-09-16T07:29:39.865824+0000","last_fullsized":"2024-09-16T07:29:39.865824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888472+0000","last_change":"2024-09-16T07:29:39.886269+0000","last_active":"2024-09-16T07:29:39.888472+0000","last_peered":"2024-09-16T07:29:39.888472+0000","last_clean":"2024-09-16T07:29:39.888472+0000","last_became_active":"2024-09-16T07:29:39.885929+0000","last_became_peered":"2024-09-16T07:29:39.885929+0000","last_unstale":"2024-09-16T07:29:39.888472+0000","last_undegraded":"2024-09-16T07:29:39.888472+0000","last_fullsized":"2024-09-16T07:29:39.888472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.873597+0000","last_change":"2024-09-16T07:29:39.873597+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.873597+0000","last_undegraded":"2024-09-16T07:29:39.873597+0000","last_fullsized":"2024-09-16T07:29:39.873597+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887526+0000","last_change":"2024-09-16T07:29:39.881323+0000","last_active":"2024-09-16T07:29:39.887526+0000","last_peered":"2024-09-16T07:29:39.887526+0000","last_clean":"2024-09-16T07:29:39.887526+0000","last_became_active":"2024-09-16T07:29:39.880843+0000","last_became_peered":"2024-09-16T07:29:39.880843+0000","last_unstale":"2024-09-16T07:29:39.887526+0000","last_undegraded":"2024-09-16T07:29:39.887526+0000","last_fullsized":"2024-09-16T07:29:39.887526+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:38:28.410493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864744+0000","last_change":"2024-09-16T07:29:39.864744+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864744+0000","last_undegraded":"2024-09-16T07:29:39.864744+0000","last_fullsized":"2024-09-16T07:29:39.864744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.888449+0000","last_change":"2024-09-16T07:29:39.884411+0000","last_active":"2024-09-16T07:29:39.888449+0000","last_peered":"2024-09-16T07:29:39.888449+0000","last_clean":"2024-09-16T07:29:39.888449+0000","last_became_active":"2024-09-16T07:29:39.882654+0000","last_became_peered":"2024-09-16T07:29:39.882654+0000","last_unstale":"2024-09-16T07:29:39.888449+0000","last_undegraded":"2024-09-16T07:29:39.888449+0000","last_fullsized":"2024-09-16T07:29:39.888449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:55:16.541963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.866691+0000","last_change":"2024-09-16T07:29:39.866691+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.866691+0000","last_undegraded":"2024-09-16T07:29:39.866691+0000","last_fullsized":"2024-09-16T07:29:39.866691+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.887291+0000","last_change":"2024-09-16T07:29:39.878614+0000","last_active":"2024-09-16T07:29:39.887291+0000","last_peered":"2024-09-16T07:29:39.887291+0000","last_clean":"2024-09-16T07:29:39.887291+0000","last_became_active":"2024-09-16T07:29:39.878365+0000","last_became_peered":"2024-09-16T07:29:39.878365+0000","last_unstale":"2024-09-16T07:29:39.887291+0000","last_undegraded":"2024-09-16T07:29:39.887291+0000","last_fullsized":"2024-09-16T07:29:39.887291+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:43.611481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.869794+0000","last_change":"2024-09-16T07:29:39.869794+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.869794+0000","last_undegraded":"2024-09-16T07:29:39.869794+0000","last_fullsized":"2024-09-16T07:29:39.869794+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.890518+0000","last_change":"2024-09-16T07:29:39.886820+0000","last_active":"2024-09-16T07:29:39.890518+0000","last_peered":"2024-09-16T07:29:39.890518+0000","last_clean":"2024-09-16T07:29:39.890518+0000","last_became_active":"2024-09-16T07:29:39.886480+0000","last_became_peered":"2024-09-16T07:29:39.886480+0000","last_unstale":"2024-09-16T07:29:39.890518+0000","last_undegraded":"2024-09-16T07:29:39.890518+0000","last_fullsized":"2024-09-16T07:29:39.890518+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:10.572704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.864858+0000","last_change":"2024-09-16T07:29:39.864858+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.864858+0000","last_undegraded":"2024-09-16T07:29:39.864858+0000","last_fullsized":"2024-09-16T07:29:39.864858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.885632+0000","last_change":"2024-09-16T07:29:39.877534+0000","last_active":"2024-09-16T07:29:39.885632+0000","last_peered":"2024-09-16T07:29:39.885632+0000","last_clean":"2024-09-16T07:29:39.885632+0000","last_became_active":"2024-09-16T07:29:39.877243+0000","last_became_peered":"2024-09-16T07:29:39.877243+0000","last_unstale":"2024-09-16T07:29:39.885632+0000","last_undegraded":"2024-09-16T07:29:39.885632+0000","last_fullsized":"2024-09-16T07:29:39.885632+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:07.629863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874229+0000","last_change":"2024-09-16T07:29:39.874229+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874229+0000","last_undegraded":"2024-09-16T07:29:39.874229+0000","last_fullsized":"2024-09-16T07:29:39.874229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.892771+0000","last_change":"2024-09-16T07:29:39.887812+0000","last_active":"2024-09-16T07:29:39.892771+0000","last_peered":"2024-09-16T07:29:39.892771+0000","last_clean":"2024-09-16T07:29:39.892771+0000","last_became_active":"2024-09-16T07:29:39.886975+0000","last_became_peered":"2024-09-16T07:29:39.886975+0000","last_unstale":"2024-09-16T07:29:39.892771+0000","last_undegraded":"2024-09-16T07:29:39.892771+0000","last_fullsized":"2024-09-16T07:29:39.892771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.849005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-16T07:29:39.874253+0000","last_change":"2024-09-16T07:29:39.874253+0000","last_active":"2024-09-16T07:29:39.850949+0000","last_peered":"2024-09-16T07:29:39.850949+0000","last_clean":"2024-09-16T07:29:39.850949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:29:39.874253+0000","last_undegraded":"2024-09-16T07:29:39.874253+0000","last_fullsized":"2024-09-16T07:29:39.874253+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.884961+0000","last_change":"2024-09-16T07:29:39.880008+0000","last_active":"2024-09-16T07:29:39.884961+0000","last_peered":"2024-09-16T07:29:39.884961+0000","last_clean":"2024-09-16T07:29:39.884961+0000","last_became_active":"2024-09-16T07:29:39.879765+0000","last_became_peered":"2024-09-16T07:29:39.879765+0000","last_unstale":"2024-09-16T07:29:39.884961+0000","last_undegraded":"2024-09-16T07:29:39.884961+0000","last_fullsized":"2024-09-16T07:29:39.884961+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:35.640560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":148,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-16T07:29:39.870813+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:39.870813+0000","last_peered":"2024-09-16T07:29:39.870813+0000","last_clean":"2024-09-16T07:29:39.870813+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:39.870813+0000","last_undegraded":"2024-09-16T07:29:39.870813+0000","last_fullsized":"2024-09-16T07:29:39.870813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1077248,"data_stored":779961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":471040,"data_stored":183326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1064960,"data_stored":773694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":524288,"data_stored":204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:47.598 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:29:47.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:29:49.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:29:49.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- 172.21.15.114:0/1072073022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d80b4270 msgr2=0x7f58d80af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:49.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 --2- 172.21.15.114:0/1072073022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d80b4270 0x7f58d80af900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f58d80b3fe0 tx=0x7f58d001c8c0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- 172.21.15.114:0/1072073022 shutdown_connections 2024-09-16T07:29:49.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 --2- 172.21.15.114:0/1072073022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d80b4270 0x7f58d80af900 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 --2- 172.21.15.114:0/1072073022 >> v2:172.21.15.149:3300/0 conn(0x7f58d80d0af0 0x7f58d8068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- 172.21.15.114:0/1072073022 >> 172.21.15.114:0/1072073022 conn(0x7f58d80b2240 msgr2=0x7f58d80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:49.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- 172.21.15.114:0/1072073022 shutdown_connections 2024-09-16T07:29:49.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- 172.21.15.114:0/1072073022 wait complete. 2024-09-16T07:29:49.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 Processor -- start 2024-09-16T07:29:49.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- start start 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d80b4270 0x7f58d81f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d80d0af0 0x7f58d8157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d815bde0 0x7f58d81476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58d8168f90 con 0x7f58d815bde0 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58d8168e10 con 0x7f58d80b4270 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.720+0000 7f58dd000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58d8169110 con 0x7f58d80d0af0 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d815bde0 0x7f58d81476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d815bde0 0x7f58d81476e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33834/0 (socket says 172.21.15.114:33834) 2024-09-16T07:29:49.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 -- 172.21.15.114:0/2014547932 learned_addr learned my addr 172.21.15.114:0/2014547932 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d5e00640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d80b4270 0x7f58d81f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d5400640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d80d0af0 0x7f58d8157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 -- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d80d0af0 msgr2=0x7f58d8157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d80d0af0 0x7f58d8157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 -- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d80b4270 msgr2=0x7f58d81f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d80b4270 0x7f58d81f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 -- 172.21.15.114:0/2014547932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d81f9180 con 0x7f58d815bde0 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d5400640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d80d0af0 0x7f58d8157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:49.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58d6800640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d815bde0 0x7f58d81476e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009850 tx=0x7f58d00a57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58ce000640 1 -- 172.21.15.114:0/2014547932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d00bd070 con 0x7f58d815bde0 2024-09-16T07:29:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58ce000640 1 -- 172.21.15.114:0/2014547932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58d00044d0 con 0x7f58d815bde0 2024-09-16T07:29:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58ce000640 1 -- 172.21.15.114:0/2014547932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d00b2040 con 0x7f58d815bde0 2024-09-16T07:29:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d81f9460 con 0x7f58d815bde0 2024-09-16T07:29:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d8147c20 con 0x7f58d815bde0 2024-09-16T07:29:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d80af900 con 0x7f58d815bde0 2024-09-16T07:29:49.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.724+0000 7f58ce000640 1 -- 172.21.15.114:0/2014547932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f58d0003860 con 0x7f58d815bde0 2024-09-16T07:29:49.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.728+0000 7f58ce000640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f58b8073070 0x7f58b8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:49.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.728+0000 7f58ce000640 1 -- 172.21.15.114:0/2014547932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f58d012e190 con 0x7f58d815bde0 2024-09-16T07:29:49.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.728+0000 7f58d5e00640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f58b8073070 0x7f58b8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:49.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.728+0000 7f58d5e00640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f58b8073070 0x7f58b8075530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001e40 tx=0x7f58c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:49.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.732+0000 7f58ce000640 1 -- 172.21.15.114:0/2014547932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f58d00164b0 con 0x7f58d815bde0 2024-09-16T07:29:49.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.896+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58d81f9980 con 0x7f58b8073070 2024-09-16T07:29:49.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.900+0000 7f58ce000640 1 -- 172.21.15.114:0/2014547932 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f58d81f9980 con 0x7f58b8073070 2024-09-16T07:29:49.905 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:49.906 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:29:49.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f58b8073070 msgr2=0x7f58b8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:49.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f58b8073070 0x7f58b8075530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58c8001e40 tx=0x7f58c8009040 comp rx=0 tx=0).stop 2024-09-16T07:29:49.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d815bde0 msgr2=0x7f58d81476e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:49.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d815bde0 0x7f58d81476e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009850 tx=0x7f58d00a57d0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 shutdown_connections 2024-09-16T07:29:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f58b8073070 0x7f58b8075530 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d815bde0 0x7f58d81476e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d80d0af0 0x7f58d8157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 --2- 172.21.15.114:0/2014547932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d80b4270 0x7f58d81f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 >> 172.21.15.114:0/2014547932 conn(0x7f58d80b2240 msgr2=0x7f58d815f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 shutdown_connections 2024-09-16T07:29:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:49.904+0000 7f58dd000640 1 -- 172.21.15.114:0/2014547932 wait complete. 2024-09-16T07:29:49.925 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-16T07:29:49.014465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221432,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753288,"statfs":{"total":773094113280,"available":772867366912,"internally_reserved":0,"allocated":5316608,"data_stored":2806900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.150847"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819280+0000","last_change":"2024-09-16T07:29:40.889522+0000","last_active":"2024-09-16T07:29:42.819280+0000","last_peered":"2024-09-16T07:29:42.819280+0000","last_clean":"2024-09-16T07:29:42.819280+0000","last_became_active":"2024-09-16T07:29:40.888556+0000","last_became_peered":"2024-09-16T07:29:40.888556+0000","last_unstale":"2024-09-16T07:29:42.819280+0000","last_undegraded":"2024-09-16T07:29:42.819280+0000","last_fullsized":"2024-09-16T07:29:42.819280+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:54.955014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819387+0000","last_change":"2024-09-16T07:29:40.899533+0000","last_active":"2024-09-16T07:29:42.819387+0000","last_peered":"2024-09-16T07:29:42.819387+0000","last_clean":"2024-09-16T07:29:42.819387+0000","last_became_active":"2024-09-16T07:29:40.899189+0000","last_became_peered":"2024-09-16T07:29:40.899189+0000","last_unstale":"2024-09-16T07:29:42.819387+0000","last_undegraded":"2024-09-16T07:29:42.819387+0000","last_fullsized":"2024-09-16T07:29:42.819387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:17.380281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888450+0000","last_change":"2024-09-16T07:29:40.879112+0000","last_active":"2024-09-16T07:29:41.888450+0000","last_peered":"2024-09-16T07:29:41.888450+0000","last_clean":"2024-09-16T07:29:41.888450+0000","last_became_active":"2024-09-16T07:29:40.878817+0000","last_became_peered":"2024-09-16T07:29:40.878817+0000","last_unstale":"2024-09-16T07:29:41.888450+0000","last_undegraded":"2024-09-16T07:29:41.888450+0000","last_fullsized":"2024-09-16T07:29:41.888450+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:08.715336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889959+0000","last_change":"2024-09-16T07:29:40.897388+0000","last_active":"2024-09-16T07:29:41.889959+0000","last_peered":"2024-09-16T07:29:41.889959+0000","last_clean":"2024-09-16T07:29:41.889959+0000","last_became_active":"2024-09-16T07:29:40.897104+0000","last_became_peered":"2024-09-16T07:29:40.897104+0000","last_unstale":"2024-09-16T07:29:41.889959+0000","last_undegraded":"2024-09-16T07:29:41.889959+0000","last_fullsized":"2024-09-16T07:29:41.889959+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:50:58.578102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.818820+0000","last_change":"2024-09-16T07:29:40.899847+0000","last_active":"2024-09-16T07:29:42.818820+0000","last_peered":"2024-09-16T07:29:42.818820+0000","last_clean":"2024-09-16T07:29:42.818820+0000","last_became_active":"2024-09-16T07:29:40.899388+0000","last_became_peered":"2024-09-16T07:29:40.899388+0000","last_unstale":"2024-09-16T07:29:42.818820+0000","last_undegraded":"2024-09-16T07:29:42.818820+0000","last_fullsized":"2024-09-16T07:29:42.818820+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:23.945429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819573+0000","last_change":"2024-09-16T07:29:40.890889+0000","last_active":"2024-09-16T07:29:42.819573+0000","last_peered":"2024-09-16T07:29:42.819573+0000","last_clean":"2024-09-16T07:29:42.819573+0000","last_became_active":"2024-09-16T07:29:40.890378+0000","last_became_peered":"2024-09-16T07:29:40.890378+0000","last_unstale":"2024-09-16T07:29:42.819573+0000","last_undegraded":"2024-09-16T07:29:42.819573+0000","last_fullsized":"2024-09-16T07:29:42.819573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:39.236912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819197+0000","last_change":"2024-09-16T07:29:40.892747+0000","last_active":"2024-09-16T07:29:42.819197+0000","last_peered":"2024-09-16T07:29:42.819197+0000","last_clean":"2024-09-16T07:29:42.819197+0000","last_became_active":"2024-09-16T07:29:40.892388+0000","last_became_peered":"2024-09-16T07:29:40.892388+0000","last_unstale":"2024-09-16T07:29:42.819197+0000","last_undegraded":"2024-09-16T07:29:42.819197+0000","last_fullsized":"2024-09-16T07:29:42.819197+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:14:04.028882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889343+0000","last_change":"2024-09-16T07:29:40.898765+0000","last_active":"2024-09-16T07:29:41.889343+0000","last_peered":"2024-09-16T07:29:41.889343+0000","last_clean":"2024-09-16T07:29:41.889343+0000","last_became_active":"2024-09-16T07:29:40.898119+0000","last_became_peered":"2024-09-16T07:29:40.898119+0000","last_unstale":"2024-09-16T07:29:41.889343+0000","last_undegraded":"2024-09-16T07:29:41.889343+0000","last_fullsized":"2024-09-16T07:29:41.889343+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:42.060039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889981+0000","last_change":"2024-09-16T07:29:40.896035+0000","last_active":"2024-09-16T07:29:41.889981+0000","last_peered":"2024-09-16T07:29:41.889981+0000","last_clean":"2024-09-16T07:29:41.889981+0000","last_became_active":"2024-09-16T07:29:40.895747+0000","last_became_peered":"2024-09-16T07:29:40.895747+0000","last_unstale":"2024-09-16T07:29:41.889981+0000","last_undegraded":"2024-09-16T07:29:41.889981+0000","last_fullsized":"2024-09-16T07:29:41.889981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:17.380281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.890000+0000","last_change":"2024-09-16T07:29:40.897492+0000","last_active":"2024-09-16T07:29:41.890000+0000","last_peered":"2024-09-16T07:29:41.890000+0000","last_clean":"2024-09-16T07:29:41.890000+0000","last_became_active":"2024-09-16T07:29:40.897091+0000","last_became_peered":"2024-09-16T07:29:40.897091+0000","last_unstale":"2024-09-16T07:29:41.890000+0000","last_undegraded":"2024-09-16T07:29:41.890000+0000","last_fullsized":"2024-09-16T07:29:41.890000+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:54.955014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889829+0000","last_change":"2024-09-16T07:29:40.886748+0000","last_active":"2024-09-16T07:29:41.889829+0000","last_peered":"2024-09-16T07:29:41.889829+0000","last_clean":"2024-09-16T07:29:41.889829+0000","last_became_active":"2024-09-16T07:29:40.886468+0000","last_became_peered":"2024-09-16T07:29:40.886468+0000","last_unstale":"2024-09-16T07:29:41.889829+0000","last_undegraded":"2024-09-16T07:29:41.889829+0000","last_fullsized":"2024-09-16T07:29:41.889829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:30.653423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.818891+0000","last_change":"2024-09-16T07:29:40.893476+0000","last_active":"2024-09-16T07:29:42.818891+0000","last_peered":"2024-09-16T07:29:42.818891+0000","last_clean":"2024-09-16T07:29:42.818891+0000","last_became_active":"2024-09-16T07:29:40.892869+0000","last_became_peered":"2024-09-16T07:29:40.892869+0000","last_unstale":"2024-09-16T07:29:42.818891+0000","last_undegraded":"2024-09-16T07:29:42.818891+0000","last_fullsized":"2024-09-16T07:29:42.818891+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:06.722710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923011+0000","last_change":"2024-09-16T07:29:40.900644+0000","last_active":"2024-09-16T07:29:41.923011+0000","last_peered":"2024-09-16T07:29:41.923011+0000","last_clean":"2024-09-16T07:29:41.923011+0000","last_became_active":"2024-09-16T07:29:40.892564+0000","last_became_peered":"2024-09-16T07:29:40.892564+0000","last_unstale":"2024-09-16T07:29:41.923011+0000","last_undegraded":"2024-09-16T07:29:41.923011+0000","last_fullsized":"2024-09-16T07:29:41.923011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:34.793795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889585+0000","last_change":"2024-09-16T07:29:40.894157+0000","last_active":"2024-09-16T07:29:41.889585+0000","last_peered":"2024-09-16T07:29:41.889585+0000","last_clean":"2024-09-16T07:29:41.889585+0000","last_became_active":"2024-09-16T07:29:40.893822+0000","last_became_peered":"2024-09-16T07:29:40.893822+0000","last_unstale":"2024-09-16T07:29:41.889585+0000","last_undegraded":"2024-09-16T07:29:41.889585+0000","last_fullsized":"2024-09-16T07:29:41.889585+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:19.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819518+0000","last_change":"2024-09-16T07:29:40.888326+0000","last_active":"2024-09-16T07:29:42.819518+0000","last_peered":"2024-09-16T07:29:42.819518+0000","last_clean":"2024-09-16T07:29:42.819518+0000","last_became_active":"2024-09-16T07:29:40.887818+0000","last_became_peered":"2024-09-16T07:29:40.887818+0000","last_unstale":"2024-09-16T07:29:42.819518+0000","last_undegraded":"2024-09-16T07:29:42.819518+0000","last_fullsized":"2024-09-16T07:29:42.819518+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:55.276430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232438+0000","last_change":"2024-09-16T07:29:40.896602+0000","last_active":"2024-09-16T07:29:42.232438+0000","last_peered":"2024-09-16T07:29:42.232438+0000","last_clean":"2024-09-16T07:29:42.232438+0000","last_became_active":"2024-09-16T07:29:40.896346+0000","last_became_peered":"2024-09-16T07:29:40.896346+0000","last_unstale":"2024-09-16T07:29:42.232438+0000","last_undegraded":"2024-09-16T07:29:42.232438+0000","last_fullsized":"2024-09-16T07:29:42.232438+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:38:58.132142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888675+0000","last_change":"2024-09-16T07:29:40.878240+0000","last_active":"2024-09-16T07:29:41.888675+0000","last_peered":"2024-09-16T07:29:41.888675+0000","last_clean":"2024-09-16T07:29:41.888675+0000","last_became_active":"2024-09-16T07:29:40.877889+0000","last_became_peered":"2024-09-16T07:29:40.877889+0000","last_unstale":"2024-09-16T07:29:41.888675+0000","last_undegraded":"2024-09-16T07:29:41.888675+0000","last_fullsized":"2024-09-16T07:29:41.888675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:20.867929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888340+0000","last_change":"2024-09-16T07:29:40.904181+0000","last_active":"2024-09-16T07:29:41.888340+0000","last_peered":"2024-09-16T07:29:41.888340+0000","last_clean":"2024-09-16T07:29:41.888340+0000","last_became_active":"2024-09-16T07:29:40.903950+0000","last_became_peered":"2024-09-16T07:29:40.903950+0000","last_unstale":"2024-09-16T07:29:41.888340+0000","last_undegraded":"2024-09-16T07:29:41.888340+0000","last_fullsized":"2024-09-16T07:29:41.888340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:38.844443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232968+0000","last_change":"2024-09-16T07:29:40.897435+0000","last_active":"2024-09-16T07:29:42.232968+0000","last_peered":"2024-09-16T07:29:42.232968+0000","last_clean":"2024-09-16T07:29:42.232968+0000","last_became_active":"2024-09-16T07:29:40.897229+0000","last_became_peered":"2024-09-16T07:29:40.897229+0000","last_unstale":"2024-09-16T07:29:42.232968+0000","last_undegraded":"2024-09-16T07:29:42.232968+0000","last_fullsized":"2024-09-16T07:29:42.232968+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:58.653149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923204+0000","last_change":"2024-09-16T07:29:40.902051+0000","last_active":"2024-09-16T07:29:41.923204+0000","last_peered":"2024-09-16T07:29:41.923204+0000","last_clean":"2024-09-16T07:29:41.923204+0000","last_became_active":"2024-09-16T07:29:40.901757+0000","last_became_peered":"2024-09-16T07:29:40.901757+0000","last_unstale":"2024-09-16T07:29:41.923204+0000","last_undegraded":"2024-09-16T07:29:41.923204+0000","last_fullsized":"2024-09-16T07:29:41.923204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:25.890937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819633+0000","last_change":"2024-09-16T07:29:40.890921+0000","last_active":"2024-09-16T07:29:42.819633+0000","last_peered":"2024-09-16T07:29:42.819633+0000","last_clean":"2024-09-16T07:29:42.819633+0000","last_became_active":"2024-09-16T07:29:40.890599+0000","last_became_peered":"2024-09-16T07:29:40.890599+0000","last_unstale":"2024-09-16T07:29:42.819633+0000","last_undegraded":"2024-09-16T07:29:42.819633+0000","last_fullsized":"2024-09-16T07:29:42.819633+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:18:20.253892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889623+0000","last_change":"2024-09-16T07:29:40.897313+0000","last_active":"2024-09-16T07:29:41.889623+0000","last_peered":"2024-09-16T07:29:41.889623+0000","last_clean":"2024-09-16T07:29:41.889623+0000","last_became_active":"2024-09-16T07:29:40.897085+0000","last_became_peered":"2024-09-16T07:29:40.897085+0000","last_unstale":"2024-09-16T07:29:41.889623+0000","last_undegraded":"2024-09-16T07:29:41.889623+0000","last_fullsized":"2024-09-16T07:29:41.889623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:20.867929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232483+0000","last_change":"2024-09-16T07:29:40.891023+0000","last_active":"2024-09-16T07:29:42.232483+0000","last_peered":"2024-09-16T07:29:42.232483+0000","last_clean":"2024-09-16T07:29:42.232483+0000","last_became_active":"2024-09-16T07:29:40.890539+0000","last_became_peered":"2024-09-16T07:29:40.890539+0000","last_unstale":"2024-09-16T07:29:42.232483+0000","last_undegraded":"2024-09-16T07:29:42.232483+0000","last_fullsized":"2024-09-16T07:29:42.232483+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:46.558963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232476+0000","last_change":"2024-09-16T07:29:40.884547+0000","last_active":"2024-09-16T07:29:42.232476+0000","last_peered":"2024-09-16T07:29:42.232476+0000","last_clean":"2024-09-16T07:29:42.232476+0000","last_became_active":"2024-09-16T07:29:40.883957+0000","last_became_peered":"2024-09-16T07:29:40.883957+0000","last_unstale":"2024-09-16T07:29:42.232476+0000","last_undegraded":"2024-09-16T07:29:42.232476+0000","last_fullsized":"2024-09-16T07:29:42.232476+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:43.423240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.233029+0000","last_change":"2024-09-16T07:29:40.890730+0000","last_active":"2024-09-16T07:29:42.233029+0000","last_peered":"2024-09-16T07:29:42.233029+0000","last_clean":"2024-09-16T07:29:42.233029+0000","last_became_active":"2024-09-16T07:29:40.890374+0000","last_became_peered":"2024-09-16T07:29:40.890374+0000","last_unstale":"2024-09-16T07:29:42.233029+0000","last_undegraded":"2024-09-16T07:29:42.233029+0000","last_fullsized":"2024-09-16T07:29:42.233029+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:43:16.378706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923245+0000","last_change":"2024-09-16T07:29:40.905384+0000","last_active":"2024-09-16T07:29:41.923245+0000","last_peered":"2024-09-16T07:29:41.923245+0000","last_clean":"2024-09-16T07:29:41.923245+0000","last_became_active":"2024-09-16T07:29:40.904671+0000","last_became_peered":"2024-09-16T07:29:40.904671+0000","last_unstale":"2024-09-16T07:29:41.923245+0000","last_undegraded":"2024-09-16T07:29:41.923245+0000","last_fullsized":"2024-09-16T07:29:41.923245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:35.612179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888680+0000","last_change":"2024-09-16T07:29:40.878237+0000","last_active":"2024-09-16T07:29:41.888680+0000","last_peered":"2024-09-16T07:29:41.888680+0000","last_clean":"2024-09-16T07:29:41.888680+0000","last_became_active":"2024-09-16T07:29:40.877920+0000","last_became_peered":"2024-09-16T07:29:40.877920+0000","last_unstale":"2024-09-16T07:29:41.888680+0000","last_undegraded":"2024-09-16T07:29:41.888680+0000","last_fullsized":"2024-09-16T07:29:41.888680+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:14.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819114+0000","last_change":"2024-09-16T07:29:40.893575+0000","last_active":"2024-09-16T07:29:42.819114+0000","last_peered":"2024-09-16T07:29:42.819114+0000","last_clean":"2024-09-16T07:29:42.819114+0000","last_became_active":"2024-09-16T07:29:40.893213+0000","last_became_peered":"2024-09-16T07:29:40.893213+0000","last_unstale":"2024-09-16T07:29:42.819114+0000","last_undegraded":"2024-09-16T07:29:42.819114+0000","last_fullsized":"2024-09-16T07:29:42.819114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:14:04.028882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232622+0000","last_change":"2024-09-16T07:29:40.890462+0000","last_active":"2024-09-16T07:29:42.232622+0000","last_peered":"2024-09-16T07:29:42.232622+0000","last_clean":"2024-09-16T07:29:42.232622+0000","last_became_active":"2024-09-16T07:29:40.890174+0000","last_became_peered":"2024-09-16T07:29:40.890174+0000","last_unstale":"2024-09-16T07:29:42.232622+0000","last_undegraded":"2024-09-16T07:29:42.232622+0000","last_fullsized":"2024-09-16T07:29:42.232622+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:04:37.055066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888208+0000","last_change":"2024-09-16T07:29:40.888587+0000","last_active":"2024-09-16T07:29:41.888208+0000","last_peered":"2024-09-16T07:29:41.888208+0000","last_clean":"2024-09-16T07:29:41.888208+0000","last_became_active":"2024-09-16T07:29:40.888335+0000","last_became_peered":"2024-09-16T07:29:40.888335+0000","last_unstale":"2024-09-16T07:29:41.888208+0000","last_undegraded":"2024-09-16T07:29:41.888208+0000","last_fullsized":"2024-09-16T07:29:41.888208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:24.698075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819607+0000","last_change":"2024-09-16T07:29:40.888069+0000","last_active":"2024-09-16T07:29:42.819607+0000","last_peered":"2024-09-16T07:29:42.819607+0000","last_clean":"2024-09-16T07:29:42.819607+0000","last_became_active":"2024-09-16T07:29:40.887456+0000","last_became_peered":"2024-09-16T07:29:40.887456+0000","last_unstale":"2024-09-16T07:29:42.819607+0000","last_undegraded":"2024-09-16T07:29:42.819607+0000","last_fullsized":"2024-09-16T07:29:42.819607+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:58.969772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922955+0000","last_change":"2024-09-16T07:29:40.886091+0000","last_active":"2024-09-16T07:29:41.922955+0000","last_peered":"2024-09-16T07:29:41.922955+0000","last_clean":"2024-09-16T07:29:41.922955+0000","last_became_active":"2024-09-16T07:29:40.885871+0000","last_became_peered":"2024-09-16T07:29:40.885871+0000","last_unstale":"2024-09-16T07:29:41.922955+0000","last_undegraded":"2024-09-16T07:29:41.922955+0000","last_fullsized":"2024-09-16T07:29:41.922955+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:00.605118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.891851+0000","last_change":"2024-09-16T07:29:40.906419+0000","last_active":"2024-09-16T07:29:41.891851+0000","last_peered":"2024-09-16T07:29:41.891851+0000","last_clean":"2024-09-16T07:29:41.891851+0000","last_became_active":"2024-09-16T07:29:40.906129+0000","last_became_peered":"2024-09-16T07:29:40.906129+0000","last_unstale":"2024-09-16T07:29:41.891851+0000","last_undegraded":"2024-09-16T07:29:41.891851+0000","last_fullsized":"2024-09-16T07:29:41.891851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:15:04.152540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.820274+0000","last_change":"2024-09-16T07:29:39.879762+0000","last_active":"2024-09-16T07:29:42.820274+0000","last_peered":"2024-09-16T07:29:42.820274+0000","last_clean":"2024-09-16T07:29:42.820274+0000","last_became_active":"2024-09-16T07:29:39.879485+0000","last_became_peered":"2024-09-16T07:29:39.879485+0000","last_unstale":"2024-09-16T07:29:42.820274+0000","last_undegraded":"2024-09-16T07:29:42.820274+0000","last_fullsized":"2024-09-16T07:29:42.820274+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:05.720154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.233053+0000","last_change":"2024-09-16T07:29:40.879711+0000","last_active":"2024-09-16T07:29:42.233053+0000","last_peered":"2024-09-16T07:29:42.233053+0000","last_clean":"2024-09-16T07:29:42.233053+0000","last_became_active":"2024-09-16T07:29:40.879376+0000","last_became_peered":"2024-09-16T07:29:40.879376+0000","last_unstale":"2024-09-16T07:29:42.233053+0000","last_undegraded":"2024-09-16T07:29:42.233053+0000","last_fullsized":"2024-09-16T07:29:42.233053+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:49.349203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888747+0000","last_change":"2024-09-16T07:29:39.885953+0000","last_active":"2024-09-16T07:29:41.888747+0000","last_peered":"2024-09-16T07:29:41.888747+0000","last_clean":"2024-09-16T07:29:41.888747+0000","last_became_active":"2024-09-16T07:29:39.885790+0000","last_became_peered":"2024-09-16T07:29:39.885790+0000","last_unstale":"2024-09-16T07:29:41.888747+0000","last_undegraded":"2024-09-16T07:29:41.888747+0000","last_fullsized":"2024-09-16T07:29:41.888747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:43.611481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819325+0000","last_change":"2024-09-16T07:29:40.887477+0000","last_active":"2024-09-16T07:29:42.819325+0000","last_peered":"2024-09-16T07:29:42.819325+0000","last_clean":"2024-09-16T07:29:42.819325+0000","last_became_active":"2024-09-16T07:29:40.887189+0000","last_became_peered":"2024-09-16T07:29:40.887189+0000","last_unstale":"2024-09-16T07:29:42.819325+0000","last_undegraded":"2024-09-16T07:29:42.819325+0000","last_fullsized":"2024-09-16T07:29:42.819325+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:54.955014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.891977+0000","last_change":"2024-09-16T07:29:39.879740+0000","last_active":"2024-09-16T07:29:41.891977+0000","last_peered":"2024-09-16T07:29:41.891977+0000","last_clean":"2024-09-16T07:29:41.891977+0000","last_became_active":"2024-09-16T07:29:39.879515+0000","last_became_peered":"2024-09-16T07:29:39.879515+0000","last_unstale":"2024-09-16T07:29:41.891977+0000","last_undegraded":"2024-09-16T07:29:41.891977+0000","last_fullsized":"2024-09-16T07:29:41.891977+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:17.299609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.891948+0000","last_change":"2024-09-16T07:29:40.885041+0000","last_active":"2024-09-16T07:29:41.891948+0000","last_peered":"2024-09-16T07:29:41.891948+0000","last_clean":"2024-09-16T07:29:41.891948+0000","last_became_active":"2024-09-16T07:29:40.884763+0000","last_became_peered":"2024-09-16T07:29:40.884763+0000","last_unstale":"2024-09-16T07:29:41.891948+0000","last_undegraded":"2024-09-16T07:29:41.891948+0000","last_fullsized":"2024-09-16T07:29:41.891948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:13:58.653149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819668+0000","last_change":"2024-09-16T07:29:39.883681+0000","last_active":"2024-09-16T07:29:42.819668+0000","last_peered":"2024-09-16T07:29:42.819668+0000","last_clean":"2024-09-16T07:29:42.819668+0000","last_became_active":"2024-09-16T07:29:39.883379+0000","last_became_peered":"2024-09-16T07:29:39.883379+0000","last_unstale":"2024-09-16T07:29:42.819668+0000","last_undegraded":"2024-09-16T07:29:42.819668+0000","last_fullsized":"2024-09-16T07:29:42.819668+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:19.931850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888192+0000","last_change":"2024-09-16T07:29:40.879426+0000","last_active":"2024-09-16T07:29:41.888192+0000","last_peered":"2024-09-16T07:29:41.888192+0000","last_clean":"2024-09-16T07:29:41.888192+0000","last_became_active":"2024-09-16T07:29:40.879125+0000","last_became_peered":"2024-09-16T07:29:40.879125+0000","last_unstale":"2024-09-16T07:29:41.888192+0000","last_undegraded":"2024-09-16T07:29:41.888192+0000","last_fullsized":"2024-09-16T07:29:41.888192+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:42.060039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819844+0000","last_change":"2024-09-16T07:29:39.887081+0000","last_active":"2024-09-16T07:29:42.819844+0000","last_peered":"2024-09-16T07:29:42.819844+0000","last_clean":"2024-09-16T07:29:42.819844+0000","last_became_active":"2024-09-16T07:29:39.886495+0000","last_became_peered":"2024-09-16T07:29:39.886495+0000","last_unstale":"2024-09-16T07:29:42.819844+0000","last_undegraded":"2024-09-16T07:29:42.819844+0000","last_fullsized":"2024-09-16T07:29:42.819844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:16.293083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889492+0000","last_change":"2024-09-16T07:29:40.899389+0000","last_active":"2024-09-16T07:29:41.889492+0000","last_peered":"2024-09-16T07:29:41.889492+0000","last_clean":"2024-09-16T07:29:41.889492+0000","last_became_active":"2024-09-16T07:29:40.899175+0000","last_became_peered":"2024-09-16T07:29:40.899175+0000","last_unstale":"2024-09-16T07:29:41.889492+0000","last_undegraded":"2024-09-16T07:29:41.889492+0000","last_fullsized":"2024-09-16T07:29:41.889492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:08.715336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888364+0000","last_change":"2024-09-16T07:29:39.883435+0000","last_active":"2024-09-16T07:29:41.888364+0000","last_peered":"2024-09-16T07:29:41.888364+0000","last_clean":"2024-09-16T07:29:41.888364+0000","last_became_active":"2024-09-16T07:29:39.883171+0000","last_became_peered":"2024-09-16T07:29:39.883171+0000","last_unstale":"2024-09-16T07:29:41.888364+0000","last_undegraded":"2024-09-16T07:29:41.888364+0000","last_fullsized":"2024-09-16T07:29:41.888364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:36.128502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889417+0000","last_change":"2024-09-16T07:29:40.898783+0000","last_active":"2024-09-16T07:29:41.889417+0000","last_peered":"2024-09-16T07:29:41.889417+0000","last_clean":"2024-09-16T07:29:41.889417+0000","last_became_active":"2024-09-16T07:29:40.897786+0000","last_became_peered":"2024-09-16T07:29:40.897786+0000","last_unstale":"2024-09-16T07:29:41.889417+0000","last_undegraded":"2024-09-16T07:29:41.889417+0000","last_fullsized":"2024-09-16T07:29:41.889417+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:38.844443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819524+0000","last_change":"2024-09-16T07:29:39.873042+0000","last_active":"2024-09-16T07:29:42.819524+0000","last_peered":"2024-09-16T07:29:42.819524+0000","last_clean":"2024-09-16T07:29:42.819524+0000","last_became_active":"2024-09-16T07:29:39.872658+0000","last_became_peered":"2024-09-16T07:29:39.872658+0000","last_unstale":"2024-09-16T07:29:42.819524+0000","last_undegraded":"2024-09-16T07:29:42.819524+0000","last_fullsized":"2024-09-16T07:29:42.819524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:16.449063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232606+0000","last_change":"2024-09-16T07:29:40.891113+0000","last_active":"2024-09-16T07:29:42.232606+0000","last_peered":"2024-09-16T07:29:42.232606+0000","last_clean":"2024-09-16T07:29:42.232606+0000","last_became_active":"2024-09-16T07:29:40.890848+0000","last_became_peered":"2024-09-16T07:29:40.890848+0000","last_unstale":"2024-09-16T07:29:42.232606+0000","last_undegraded":"2024-09-16T07:29:42.232606+0000","last_fullsized":"2024-09-16T07:29:42.232606+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:30:36.513927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889524+0000","last_change":"2024-09-16T07:29:39.888960+0000","last_active":"2024-09-16T07:29:41.889524+0000","last_peered":"2024-09-16T07:29:41.889524+0000","last_clean":"2024-09-16T07:29:41.889524+0000","last_became_active":"2024-09-16T07:29:39.888703+0000","last_became_peered":"2024-09-16T07:29:39.888703+0000","last_unstale":"2024-09-16T07:29:41.889524+0000","last_undegraded":"2024-09-16T07:29:41.889524+0000","last_fullsized":"2024-09-16T07:29:41.889524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:19:18.647616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888545+0000","last_change":"2024-09-16T07:29:40.897604+0000","last_active":"2024-09-16T07:29:41.888545+0000","last_peered":"2024-09-16T07:29:41.888545+0000","last_clean":"2024-09-16T07:29:41.888545+0000","last_became_active":"2024-09-16T07:29:40.897339+0000","last_became_peered":"2024-09-16T07:29:40.897339+0000","last_unstale":"2024-09-16T07:29:41.888545+0000","last_undegraded":"2024-09-16T07:29:41.888545+0000","last_fullsized":"2024-09-16T07:29:41.888545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:19.182321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888910+0000","last_change":"2024-09-16T07:29:39.884308+0000","last_active":"2024-09-16T07:29:41.888910+0000","last_peered":"2024-09-16T07:29:41.888910+0000","last_clean":"2024-09-16T07:29:41.888910+0000","last_became_active":"2024-09-16T07:29:39.883979+0000","last_became_peered":"2024-09-16T07:29:39.883979+0000","last_unstale":"2024-09-16T07:29:41.888910+0000","last_undegraded":"2024-09-16T07:29:41.888910+0000","last_fullsized":"2024-09-16T07:29:41.888910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:06:08.840732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819512+0000","last_change":"2024-09-16T07:29:40.885334+0000","last_active":"2024-09-16T07:29:42.819512+0000","last_peered":"2024-09-16T07:29:42.819512+0000","last_clean":"2024-09-16T07:29:42.819512+0000","last_became_active":"2024-09-16T07:29:40.884820+0000","last_became_peered":"2024-09-16T07:29:40.884820+0000","last_unstale":"2024-09-16T07:29:42.819512+0000","last_undegraded":"2024-09-16T07:29:42.819512+0000","last_fullsized":"2024-09-16T07:29:42.819512+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:30.520079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.890095+0000","last_change":"2024-09-16T07:29:39.889286+0000","last_active":"2024-09-16T07:29:41.890095+0000","last_peered":"2024-09-16T07:29:41.890095+0000","last_clean":"2024-09-16T07:29:41.890095+0000","last_became_active":"2024-09-16T07:29:39.888837+0000","last_became_peered":"2024-09-16T07:29:39.888837+0000","last_unstale":"2024-09-16T07:29:41.890095+0000","last_undegraded":"2024-09-16T07:29:41.890095+0000","last_fullsized":"2024-09-16T07:29:41.890095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:50:08.547444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.820097+0000","last_change":"2024-09-16T07:29:40.903913+0000","last_active":"2024-09-16T07:29:42.820097+0000","last_peered":"2024-09-16T07:29:42.820097+0000","last_clean":"2024-09-16T07:29:42.820097+0000","last_became_active":"2024-09-16T07:29:40.903675+0000","last_became_peered":"2024-09-16T07:29:40.903675+0000","last_unstale":"2024-09-16T07:29:42.820097+0000","last_undegraded":"2024-09-16T07:29:42.820097+0000","last_fullsized":"2024-09-16T07:29:42.820097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:17.313533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819805+0000","last_change":"2024-09-16T07:29:39.881119+0000","last_active":"2024-09-16T07:29:42.819805+0000","last_peered":"2024-09-16T07:29:42.819805+0000","last_clean":"2024-09-16T07:29:42.819805+0000","last_became_active":"2024-09-16T07:29:39.880463+0000","last_became_peered":"2024-09-16T07:29:39.880463+0000","last_unstale":"2024-09-16T07:29:42.819805+0000","last_undegraded":"2024-09-16T07:29:42.819805+0000","last_fullsized":"2024-09-16T07:29:42.819805+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:50:48.852407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819668+0000","last_change":"2024-09-16T07:29:40.886953+0000","last_active":"2024-09-16T07:29:42.819668+0000","last_peered":"2024-09-16T07:29:42.819668+0000","last_clean":"2024-09-16T07:29:42.819668+0000","last_became_active":"2024-09-16T07:29:40.886674+0000","last_became_peered":"2024-09-16T07:29:40.886674+0000","last_unstale":"2024-09-16T07:29:42.819668+0000","last_undegraded":"2024-09-16T07:29:42.819668+0000","last_fullsized":"2024-09-16T07:29:42.819668+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:30:20.281301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923072+0000","last_change":"2024-09-16T07:29:39.881374+0000","last_active":"2024-09-16T07:29:41.923072+0000","last_peered":"2024-09-16T07:29:41.923072+0000","last_clean":"2024-09-16T07:29:41.923072+0000","last_became_active":"2024-09-16T07:29:39.880798+0000","last_became_peered":"2024-09-16T07:29:39.880798+0000","last_unstale":"2024-09-16T07:29:41.923072+0000","last_undegraded":"2024-09-16T07:29:41.923072+0000","last_fullsized":"2024-09-16T07:29:41.923072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:38.543742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232724+0000","last_change":"2024-09-16T07:29:40.897809+0000","last_active":"2024-09-16T07:29:42.232724+0000","last_peered":"2024-09-16T07:29:42.232724+0000","last_clean":"2024-09-16T07:29:42.232724+0000","last_became_active":"2024-09-16T07:29:40.897493+0000","last_became_peered":"2024-09-16T07:29:40.897493+0000","last_unstale":"2024-09-16T07:29:42.232724+0000","last_undegraded":"2024-09-16T07:29:42.232724+0000","last_fullsized":"2024-09-16T07:29:42.232724+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:31.706341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819988+0000","last_change":"2024-09-16T07:29:39.885365+0000","last_active":"2024-09-16T07:29:42.819988+0000","last_peered":"2024-09-16T07:29:42.819988+0000","last_clean":"2024-09-16T07:29:42.819988+0000","last_became_active":"2024-09-16T07:29:39.884959+0000","last_became_peered":"2024-09-16T07:29:39.884959+0000","last_unstale":"2024-09-16T07:29:42.819988+0000","last_undegraded":"2024-09-16T07:29:42.819988+0000","last_fullsized":"2024-09-16T07:29:42.819988+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:17.234028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889723+0000","last_change":"2024-09-16T07:29:40.894031+0000","last_active":"2024-09-16T07:29:41.889723+0000","last_peered":"2024-09-16T07:29:41.889723+0000","last_clean":"2024-09-16T07:29:41.889723+0000","last_became_active":"2024-09-16T07:29:40.893764+0000","last_became_peered":"2024-09-16T07:29:40.893764+0000","last_unstale":"2024-09-16T07:29:41.889723+0000","last_undegraded":"2024-09-16T07:29:41.889723+0000","last_fullsized":"2024-09-16T07:29:41.889723+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:14.466803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819041+0000","last_change":"2024-09-16T07:29:39.877326+0000","last_active":"2024-09-16T07:29:42.819041+0000","last_peered":"2024-09-16T07:29:42.819041+0000","last_clean":"2024-09-16T07:29:42.819041+0000","last_became_active":"2024-09-16T07:29:39.877050+0000","last_became_peered":"2024-09-16T07:29:39.877050+0000","last_unstale":"2024-09-16T07:29:42.819041+0000","last_undegraded":"2024-09-16T07:29:42.819041+0000","last_fullsized":"2024-09-16T07:29:42.819041+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:03.363913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819504+0000","last_change":"2024-09-16T07:29:40.899341+0000","last_active":"2024-09-16T07:29:42.819504+0000","last_peered":"2024-09-16T07:29:42.819504+0000","last_clean":"2024-09-16T07:29:42.819504+0000","last_became_active":"2024-09-16T07:29:40.899063+0000","last_became_peered":"2024-09-16T07:29:40.899063+0000","last_unstale":"2024-09-16T07:29:42.819504+0000","last_undegraded":"2024-09-16T07:29:42.819504+0000","last_fullsized":"2024-09-16T07:29:42.819504+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:50:01.792243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819817+0000","last_change":"2024-09-16T07:29:39.885291+0000","last_active":"2024-09-16T07:29:42.819817+0000","last_peered":"2024-09-16T07:29:42.819817+0000","last_clean":"2024-09-16T07:29:42.819817+0000","last_became_active":"2024-09-16T07:29:39.885042+0000","last_became_peered":"2024-09-16T07:29:39.885042+0000","last_unstale":"2024-09-16T07:29:42.819817+0000","last_undegraded":"2024-09-16T07:29:42.819817+0000","last_fullsized":"2024-09-16T07:29:42.819817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:11:11.049801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819422+0000","last_change":"2024-09-16T07:29:40.885224+0000","last_active":"2024-09-16T07:29:42.819422+0000","last_peered":"2024-09-16T07:29:42.819422+0000","last_clean":"2024-09-16T07:29:42.819422+0000","last_became_active":"2024-09-16T07:29:40.884940+0000","last_became_peered":"2024-09-16T07:29:40.884940+0000","last_unstale":"2024-09-16T07:29:42.819422+0000","last_undegraded":"2024-09-16T07:29:42.819422+0000","last_fullsized":"2024-09-16T07:29:42.819422+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:17.380281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889626+0000","last_change":"2024-09-16T07:29:39.884132+0000","last_active":"2024-09-16T07:29:41.889626+0000","last_peered":"2024-09-16T07:29:41.889626+0000","last_clean":"2024-09-16T07:29:41.889626+0000","last_became_active":"2024-09-16T07:29:39.883836+0000","last_became_peered":"2024-09-16T07:29:39.883836+0000","last_unstale":"2024-09-16T07:29:41.889626+0000","last_undegraded":"2024-09-16T07:29:41.889626+0000","last_fullsized":"2024-09-16T07:29:41.889626+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:32.206213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923356+0000","last_change":"2024-09-16T07:29:40.883420+0000","last_active":"2024-09-16T07:29:41.923356+0000","last_peered":"2024-09-16T07:29:41.923356+0000","last_clean":"2024-09-16T07:29:41.923356+0000","last_became_active":"2024-09-16T07:29:40.883191+0000","last_became_peered":"2024-09-16T07:29:40.883191+0000","last_unstale":"2024-09-16T07:29:41.923356+0000","last_undegraded":"2024-09-16T07:29:41.923356+0000","last_fullsized":"2024-09-16T07:29:41.923356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:31.229980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.923177+0000","last_change":"2024-09-16T07:29:39.879866+0000","last_active":"2024-09-16T07:29:41.923177+0000","last_peered":"2024-09-16T07:29:41.923177+0000","last_clean":"2024-09-16T07:29:41.923177+0000","last_became_active":"2024-09-16T07:29:39.879449+0000","last_became_peered":"2024-09-16T07:29:39.879449+0000","last_unstale":"2024-09-16T07:29:41.923177+0000","last_undegraded":"2024-09-16T07:29:41.923177+0000","last_fullsized":"2024-09-16T07:29:41.923177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:11:51.597102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.890153+0000","last_change":"2024-09-16T07:29:40.907067+0000","last_active":"2024-09-16T07:29:41.890153+0000","last_peered":"2024-09-16T07:29:41.890153+0000","last_clean":"2024-09-16T07:29:41.890153+0000","last_became_active":"2024-09-16T07:29:40.906752+0000","last_became_peered":"2024-09-16T07:29:40.906752+0000","last_unstale":"2024-09-16T07:29:41.890153+0000","last_undegraded":"2024-09-16T07:29:41.890153+0000","last_fullsized":"2024-09-16T07:29:41.890153+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:28:40.018333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888690+0000","last_change":"2024-09-16T07:29:39.888996+0000","last_active":"2024-09-16T07:29:41.888690+0000","last_peered":"2024-09-16T07:29:41.888690+0000","last_clean":"2024-09-16T07:29:41.888690+0000","last_became_active":"2024-09-16T07:29:39.888800+0000","last_became_peered":"2024-09-16T07:29:39.888800+0000","last_unstale":"2024-09-16T07:29:41.888690+0000","last_undegraded":"2024-09-16T07:29:41.888690+0000","last_fullsized":"2024-09-16T07:29:41.888690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:48.369661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232667+0000","last_change":"2024-09-16T07:29:40.888997+0000","last_active":"2024-09-16T07:29:42.232667+0000","last_peered":"2024-09-16T07:29:42.232667+0000","last_clean":"2024-09-16T07:29:42.232667+0000","last_became_active":"2024-09-16T07:29:40.888034+0000","last_became_peered":"2024-09-16T07:29:40.888034+0000","last_unstale":"2024-09-16T07:29:42.232667+0000","last_undegraded":"2024-09-16T07:29:42.232667+0000","last_fullsized":"2024-09-16T07:29:42.232667+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:36.081148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819033+0000","last_change":"2024-09-16T07:29:39.875251+0000","last_active":"2024-09-16T07:29:42.819033+0000","last_peered":"2024-09-16T07:29:42.819033+0000","last_clean":"2024-09-16T07:29:42.819033+0000","last_became_active":"2024-09-16T07:29:39.875004+0000","last_became_peered":"2024-09-16T07:29:39.875004+0000","last_unstale":"2024-09-16T07:29:42.819033+0000","last_undegraded":"2024-09-16T07:29:42.819033+0000","last_fullsized":"2024-09-16T07:29:42.819033+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:48.346647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.232957+0000","last_change":"2024-09-16T07:29:40.891573+0000","last_active":"2024-09-16T07:29:42.232957+0000","last_peered":"2024-09-16T07:29:42.232957+0000","last_clean":"2024-09-16T07:29:42.232957+0000","last_became_active":"2024-09-16T07:29:40.889111+0000","last_became_peered":"2024-09-16T07:29:40.889111+0000","last_unstale":"2024-09-16T07:29:42.232957+0000","last_undegraded":"2024-09-16T07:29:42.232957+0000","last_fullsized":"2024-09-16T07:29:42.232957+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:36.643116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.820179+0000","last_change":"2024-09-16T07:29:39.878820+0000","last_active":"2024-09-16T07:29:42.820179+0000","last_peered":"2024-09-16T07:29:42.820179+0000","last_clean":"2024-09-16T07:29:42.820179+0000","last_became_active":"2024-09-16T07:29:39.878471+0000","last_became_peered":"2024-09-16T07:29:39.878471+0000","last_unstale":"2024-09-16T07:29:42.820179+0000","last_undegraded":"2024-09-16T07:29:42.820179+0000","last_fullsized":"2024-09-16T07:29:42.820179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:20.975648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819661+0000","last_change":"2024-09-16T07:29:40.904088+0000","last_active":"2024-09-16T07:29:42.819661+0000","last_peered":"2024-09-16T07:29:42.819661+0000","last_clean":"2024-09-16T07:29:42.819661+0000","last_became_active":"2024-09-16T07:29:40.903117+0000","last_became_peered":"2024-09-16T07:29:40.903117+0000","last_unstale":"2024-09-16T07:29:42.819661+0000","last_undegraded":"2024-09-16T07:29:42.819661+0000","last_fullsized":"2024-09-16T07:29:42.819661+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:47.125653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.820147+0000","last_change":"2024-09-16T07:29:39.875309+0000","last_active":"2024-09-16T07:29:42.820147+0000","last_peered":"2024-09-16T07:29:42.820147+0000","last_clean":"2024-09-16T07:29:42.820147+0000","last_became_active":"2024-09-16T07:29:39.875039+0000","last_became_peered":"2024-09-16T07:29:39.875039+0000","last_unstale":"2024-09-16T07:29:42.820147+0000","last_undegraded":"2024-09-16T07:29:42.820147+0000","last_fullsized":"2024-09-16T07:29:42.820147+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:22.942873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.891805+0000","last_change":"2024-09-16T07:29:40.890160+0000","last_active":"2024-09-16T07:29:41.891805+0000","last_peered":"2024-09-16T07:29:41.891805+0000","last_clean":"2024-09-16T07:29:41.891805+0000","last_became_active":"2024-09-16T07:29:40.889911+0000","last_became_peered":"2024-09-16T07:29:40.889911+0000","last_unstale":"2024-09-16T07:29:41.891805+0000","last_undegraded":"2024-09-16T07:29:41.891805+0000","last_fullsized":"2024-09-16T07:29:41.891805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:38:29.413049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.818568+0000","last_change":"2024-09-16T07:29:39.877319+0000","last_active":"2024-09-16T07:29:42.818568+0000","last_peered":"2024-09-16T07:29:42.818568+0000","last_clean":"2024-09-16T07:29:42.818568+0000","last_became_active":"2024-09-16T07:29:39.876985+0000","last_became_peered":"2024-09-16T07:29:39.876985+0000","last_unstale":"2024-09-16T07:29:42.818568+0000","last_undegraded":"2024-09-16T07:29:42.818568+0000","last_fullsized":"2024-09-16T07:29:42.818568+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:43:15.376150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.922956+0000","last_change":"2024-09-16T07:29:40.900347+0000","last_active":"2024-09-16T07:29:41.922956+0000","last_peered":"2024-09-16T07:29:41.922956+0000","last_clean":"2024-09-16T07:29:41.922956+0000","last_became_active":"2024-09-16T07:29:40.892923+0000","last_became_peered":"2024-09-16T07:29:40.892923+0000","last_unstale":"2024-09-16T07:29:41.922956+0000","last_undegraded":"2024-09-16T07:29:41.922956+0000","last_fullsized":"2024-09-16T07:29:41.922956+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:42.855984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889404+0000","last_change":"2024-09-16T07:29:39.889122+0000","last_active":"2024-09-16T07:29:41.889404+0000","last_peered":"2024-09-16T07:29:41.889404+0000","last_clean":"2024-09-16T07:29:41.889404+0000","last_became_active":"2024-09-16T07:29:39.888890+0000","last_became_peered":"2024-09-16T07:29:39.888890+0000","last_unstale":"2024-09-16T07:29:41.889404+0000","last_undegraded":"2024-09-16T07:29:41.889404+0000","last_fullsized":"2024-09-16T07:29:41.889404+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.839005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889393+0000","last_change":"2024-09-16T07:29:40.896060+0000","last_active":"2024-09-16T07:29:41.889393+0000","last_peered":"2024-09-16T07:29:41.889393+0000","last_clean":"2024-09-16T07:29:41.889393+0000","last_became_active":"2024-09-16T07:29:40.895877+0000","last_became_peered":"2024-09-16T07:29:40.895877+0000","last_unstale":"2024-09-16T07:29:41.889393+0000","last_undegraded":"2024-09-16T07:29:41.889393+0000","last_fullsized":"2024-09-16T07:29:41.889393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:24.698075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.818921+0000","last_change":"2024-09-16T07:29:39.883628+0000","last_active":"2024-09-16T07:29:42.818921+0000","last_peered":"2024-09-16T07:29:42.818921+0000","last_clean":"2024-09-16T07:29:42.818921+0000","last_became_active":"2024-09-16T07:29:39.883294+0000","last_became_peered":"2024-09-16T07:29:39.883294+0000","last_unstale":"2024-09-16T07:29:42.818921+0000","last_undegraded":"2024-09-16T07:29:42.818921+0000","last_fullsized":"2024-09-16T07:29:42.818921+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:43:15.376150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.233209+0000","last_change":"2024-09-16T07:29:40.898418+0000","last_active":"2024-09-16T07:29:42.233209+0000","last_peered":"2024-09-16T07:29:42.233209+0000","last_clean":"2024-09-16T07:29:42.233209+0000","last_became_active":"2024-09-16T07:29:40.898129+0000","last_became_peered":"2024-09-16T07:29:40.898129+0000","last_unstale":"2024-09-16T07:29:42.233209+0000","last_undegraded":"2024-09-16T07:29:42.233209+0000","last_fullsized":"2024-09-16T07:29:42.233209+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:20.934406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.820178+0000","last_change":"2024-09-16T07:29:39.886269+0000","last_active":"2024-09-16T07:29:42.820178+0000","last_peered":"2024-09-16T07:29:42.820178+0000","last_clean":"2024-09-16T07:29:42.820178+0000","last_became_active":"2024-09-16T07:29:39.885929+0000","last_became_peered":"2024-09-16T07:29:39.885929+0000","last_unstale":"2024-09-16T07:29:42.820178+0000","last_undegraded":"2024-09-16T07:29:42.820178+0000","last_fullsized":"2024-09-16T07:29:42.820178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:14:03.026326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.890206+0000","last_change":"2024-09-16T07:29:40.895506+0000","last_active":"2024-09-16T07:29:41.890206+0000","last_peered":"2024-09-16T07:29:41.890206+0000","last_clean":"2024-09-16T07:29:41.890206+0000","last_became_active":"2024-09-16T07:29:40.895237+0000","last_became_peered":"2024-09-16T07:29:40.895237+0000","last_unstale":"2024-09-16T07:29:41.890206+0000","last_undegraded":"2024-09-16T07:29:41.890206+0000","last_fullsized":"2024-09-16T07:29:41.890206+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:01.364758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819874+0000","last_change":"2024-09-16T07:29:39.881323+0000","last_active":"2024-09-16T07:29:42.819874+0000","last_peered":"2024-09-16T07:29:42.819874+0000","last_clean":"2024-09-16T07:29:42.819874+0000","last_became_active":"2024-09-16T07:29:39.880843+0000","last_became_peered":"2024-09-16T07:29:39.880843+0000","last_unstale":"2024-09-16T07:29:42.819874+0000","last_undegraded":"2024-09-16T07:29:42.819874+0000","last_fullsized":"2024-09-16T07:29:42.819874+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:19.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819798+0000","last_change":"2024-09-16T07:29:40.892620+0000","last_active":"2024-09-16T07:29:42.819798+0000","last_peered":"2024-09-16T07:29:42.819798+0000","last_clean":"2024-09-16T07:29:42.819798+0000","last_became_active":"2024-09-16T07:29:40.892283+0000","last_became_peered":"2024-09-16T07:29:40.892283+0000","last_unstale":"2024-09-16T07:29:42.819798+0000","last_undegraded":"2024-09-16T07:29:42.819798+0000","last_fullsized":"2024-09-16T07:29:42.819798+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:18.177900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.891681+0000","last_change":"2024-09-16T07:29:39.884411+0000","last_active":"2024-09-16T07:29:41.891681+0000","last_peered":"2024-09-16T07:29:41.891681+0000","last_clean":"2024-09-16T07:29:41.891681+0000","last_became_active":"2024-09-16T07:29:39.882654+0000","last_became_peered":"2024-09-16T07:29:39.882654+0000","last_unstale":"2024-09-16T07:29:41.891681+0000","last_undegraded":"2024-09-16T07:29:41.891681+0000","last_fullsized":"2024-09-16T07:29:41.891681+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:36.128502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819940+0000","last_change":"2024-09-16T07:29:40.890647+0000","last_active":"2024-09-16T07:29:42.819940+0000","last_peered":"2024-09-16T07:29:42.819940+0000","last_clean":"2024-09-16T07:29:42.819940+0000","last_became_active":"2024-09-16T07:29:40.890014+0000","last_became_peered":"2024-09-16T07:29:40.890014+0000","last_unstale":"2024-09-16T07:29:42.819940+0000","last_undegraded":"2024-09-16T07:29:42.819940+0000","last_fullsized":"2024-09-16T07:29:42.819940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:31:44.117785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819254+0000","last_change":"2024-09-16T07:29:39.878614+0000","last_active":"2024-09-16T07:29:42.819254+0000","last_peered":"2024-09-16T07:29:42.819254+0000","last_clean":"2024-09-16T07:29:42.819254+0000","last_became_active":"2024-09-16T07:29:39.878365+0000","last_became_peered":"2024-09-16T07:29:39.878365+0000","last_unstale":"2024-09-16T07:29:42.819254+0000","last_undegraded":"2024-09-16T07:29:42.819254+0000","last_fullsized":"2024-09-16T07:29:42.819254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:48.346647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819706+0000","last_change":"2024-09-16T07:29:40.903776+0000","last_active":"2024-09-16T07:29:42.819706+0000","last_peered":"2024-09-16T07:29:42.819706+0000","last_clean":"2024-09-16T07:29:42.819706+0000","last_became_active":"2024-09-16T07:29:40.903577+0000","last_became_peered":"2024-09-16T07:29:40.903577+0000","last_unstale":"2024-09-16T07:29:42.819706+0000","last_undegraded":"2024-09-16T07:29:42.819706+0000","last_fullsized":"2024-09-16T07:29:42.819706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:02:05.852805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888450+0000","last_change":"2024-09-16T07:29:39.886820+0000","last_active":"2024-09-16T07:29:41.888450+0000","last_peered":"2024-09-16T07:29:41.888450+0000","last_clean":"2024-09-16T07:29:41.888450+0000","last_became_active":"2024-09-16T07:29:39.886480+0000","last_became_peered":"2024-09-16T07:29:39.886480+0000","last_unstale":"2024-09-16T07:29:41.888450+0000","last_undegraded":"2024-09-16T07:29:41.888450+0000","last_fullsized":"2024-09-16T07:29:41.888450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:17.299609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.818632+0000","last_change":"2024-09-16T07:29:40.884245+0000","last_active":"2024-09-16T07:29:42.818632+0000","last_peered":"2024-09-16T07:29:42.818632+0000","last_clean":"2024-09-16T07:29:42.818632+0000","last_became_active":"2024-09-16T07:29:40.883885+0000","last_became_peered":"2024-09-16T07:29:40.883885+0000","last_unstale":"2024-09-16T07:29:42.818632+0000","last_undegraded":"2024-09-16T07:29:42.818632+0000","last_fullsized":"2024-09-16T07:29:42.818632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:18.236584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.891590+0000","last_change":"2024-09-16T07:29:39.877534+0000","last_active":"2024-09-16T07:29:41.891590+0000","last_peered":"2024-09-16T07:29:41.891590+0000","last_clean":"2024-09-16T07:29:41.891590+0000","last_became_active":"2024-09-16T07:29:39.877243+0000","last_became_peered":"2024-09-16T07:29:39.877243+0000","last_unstale":"2024-09-16T07:29:41.891590+0000","last_undegraded":"2024-09-16T07:29:41.891590+0000","last_fullsized":"2024-09-16T07:29:41.891590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:06:08.840732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.888131+0000","last_change":"2024-09-16T07:29:40.875952+0000","last_active":"2024-09-16T07:29:41.888131+0000","last_peered":"2024-09-16T07:29:41.888131+0000","last_clean":"2024-09-16T07:29:41.888131+0000","last_became_active":"2024-09-16T07:29:40.875689+0000","last_became_peered":"2024-09-16T07:29:40.875689+0000","last_unstale":"2024-09-16T07:29:41.888131+0000","last_undegraded":"2024-09-16T07:29:41.888131+0000","last_fullsized":"2024-09-16T07:29:41.888131+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:00.572639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.889633+0000","last_change":"2024-09-16T07:29:39.887812+0000","last_active":"2024-09-16T07:29:41.889633+0000","last_peered":"2024-09-16T07:29:41.889633+0000","last_clean":"2024-09-16T07:29:41.889633+0000","last_became_active":"2024-09-16T07:29:39.886975+0000","last_became_peered":"2024-09-16T07:29:39.886975+0000","last_unstale":"2024-09-16T07:29:41.889633+0000","last_undegraded":"2024-09-16T07:29:41.889633+0000","last_fullsized":"2024-09-16T07:29:41.889633+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:39.094051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:41.890067+0000","last_change":"2024-09-16T07:29:40.897203+0000","last_active":"2024-09-16T07:29:41.890067+0000","last_peered":"2024-09-16T07:29:41.890067+0000","last_clean":"2024-09-16T07:29:41.890067+0000","last_became_active":"2024-09-16T07:29:40.896814+0000","last_became_peered":"2024-09-16T07:29:40.896814+0000","last_unstale":"2024-09-16T07:29:41.890067+0000","last_undegraded":"2024-09-16T07:29:41.890067+0000","last_fullsized":"2024-09-16T07:29:41.890067+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:39.850949+0000","last_clean_scrub_stamp":"2024-09-16T07:29:39.850949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:53.908038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.820010+0000","last_change":"2024-09-16T07:29:39.880008+0000","last_active":"2024-09-16T07:29:42.820010+0000","last_peered":"2024-09-16T07:29:42.820010+0000","last_clean":"2024-09-16T07:29:42.820010+0000","last_became_active":"2024-09-16T07:29:39.879765+0000","last_became_peered":"2024-09-16T07:29:39.879765+0000","last_unstale":"2024-09-16T07:29:42.820010+0000","last_undegraded":"2024-09-16T07:29:42.820010+0000","last_fullsized":"2024-09-16T07:29:42.820010+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:29:38.848393+0000","last_clean_scrub_stamp":"2024-09-16T07:29:38.848393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:19.931850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":152,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T07:29:42.819045+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:29:42.819045+0000","last_peered":"2024-09-16T07:29:42.819045+0000","last_clean":"2024-09-16T07:29:42.819045+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:29:42.819045+0000","last_undegraded":"2024-09-16T07:29:42.819045+0000","last_fullsized":"2024-09-16T07:29:42.819045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1105920,"data_stored":793126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":516096,"data_stored":203340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":202738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":204280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":520192,"data_stored":203306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":512000,"data_stored":202738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":793070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":524288,"data_stored":204302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:29:49.929 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:29:49.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:29:50.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- 172.21.15.114:0/1426219182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015df50 msgr2=0x7f8d900d4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 --2- 172.21.15.114:0/1426219182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015df50 0x7f8d900d4990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009870 tx=0x7f8d8001c830 comp rx=0 tx=0).stop 2024-09-16T07:29:50.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- 172.21.15.114:0/1426219182 shutdown_connections 2024-09-16T07:29:50.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 --2- 172.21.15.114:0/1426219182 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015df50 0x7f8d900d4990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- 172.21.15.114:0/1426219182 >> 172.21.15.114:0/1426219182 conn(0x7f8d900d3e70 msgr2=0x7f8d900d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:50.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- 172.21.15.114:0/1426219182 shutdown_connections 2024-09-16T07:29:50.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- 172.21.15.114:0/1426219182 wait complete. 2024-09-16T07:29:50.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 Processor -- start 2024-09-16T07:29:50.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- start start 2024-09-16T07:29:50.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d900d2590 0x7f8d90160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d9015df50 0x7f8d90161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015ef20 0x7f8d900b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9016c020 con 0x7f8d9015df50 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9016bea0 con 0x7f8d900d2590 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.116+0000 7f8d95a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9016c1a0 con 0x7f8d9015ef20 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d9015df50 0x7f8d90161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d8fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d900d2590 0x7f8d90160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d9015df50 0x7f8d90161140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33838/0 (socket says 172.21.15.114:33838) 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 -- 172.21.15.114:0/2200389248 learned_addr learned my addr 172.21.15.114:0/2200389248 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d95000640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015ef20 0x7f8d900b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 -- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015ef20 msgr2=0x7f8d900b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015ef20 0x7f8d900b8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 -- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d900d2590 msgr2=0x7f8d90160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d900d2590 0x7f8d90160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 -- 172.21.15.114:0/2200389248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d900c9f90 con 0x7f8d9015df50 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d87400640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d9015df50 0x7f8d90161140 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c400 tx=0x7f8d7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d8cc00640 1 -- 172.21.15.114:0/2200389248 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78011790 con 0x7f8d9015df50 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d8cc00640 1 -- 172.21.15.114:0/2200389248 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d78017070 con 0x7f8d9015df50 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d90150eb0 con 0x7f8d9015df50 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d8cc00640 1 -- 172.21.15.114:0/2200389248 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78011cc0 con 0x7f8d9015df50 2024-09-16T07:29:50.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d900ca510 con 0x7f8d9015df50 2024-09-16T07:29:50.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d900d4990 con 0x7f8d9015df50 2024-09-16T07:29:50.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.120+0000 7f8d8cc00640 1 -- 172.21.15.114:0/2200389248 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f8d7801c460 con 0x7f8d9015df50 2024-09-16T07:29:50.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.124+0000 7f8d8cc00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d6c073070 0x7f8d6c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.124+0000 7f8d8cc00640 1 -- 172.21.15.114:0/2200389248 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f8d78093ff0 con 0x7f8d9015df50 2024-09-16T07:29:50.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.124+0000 7f8d8fe00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d6c073070 0x7f8d6c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.124+0000 7f8d8fe00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d6c073070 0x7f8d6c075530 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d800af000 tx=0x7f8d8001b070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:50.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.128+0000 7f8d8cc00640 1 -- 172.21.15.114:0/2200389248 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8d7805e7c0 con 0x7f8d9015df50 2024-09-16T07:29:50.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.352+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8d900d0660 con 0x7f8d9015df50 2024-09-16T07:29:50.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d8cc00640 1 -- 172.21.15.114:0/2200389248 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f8d780631f0 con 0x7f8d9015df50 2024-09-16T07:29:50.359 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:29:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:29:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:29:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:29:50.359 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:29:50.359 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:29:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d6c073070 msgr2=0x7f8d6c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d6c073070 0x7f8d6c075530 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d800af000 tx=0x7f8d8001b070 comp rx=0 tx=0).stop 2024-09-16T07:29:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d9015df50 msgr2=0x7f8d90161140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d9015df50 0x7f8d90161140 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c400 tx=0x7f8d7800c8c0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 shutdown_connections 2024-09-16T07:29:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8d6c073070 0x7f8d6c075530 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8d9015ef20 0x7f8d900b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d9015df50 0x7f8d90161140 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 --2- 172.21.15.114:0/2200389248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d900d2590 0x7f8d90160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 >> 172.21.15.114:0/2200389248 conn(0x7f8d900d3e70 msgr2=0x7f8d901603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 shutdown_connections 2024-09-16T07:29:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.356+0000 7f8d95a00640 1 -- 172.21.15.114:0/2200389248 wait complete. 2024-09-16T07:29:50.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 -- 172.21.15.114:0/2878595993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc0b4bd0 msgr2=0x7fb4cc0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 --2- 172.21.15.114:0/2878595993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc0b4bd0 0x7fb4cc0cf130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009840 tx=0x7fb4c401c820 comp rx=0 tx=0).stop 2024-09-16T07:29:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 -- 172.21.15.114:0/2878595993 shutdown_connections 2024-09-16T07:29:50.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 --2- 172.21.15.114:0/2878595993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc0b4bd0 0x7fb4cc0cf130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 --2- 172.21.15.114:0/2878595993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4cc15ade0 0x7fb4cc0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 -- 172.21.15.114:0/2878595993 >> 172.21.15.114:0/2878595993 conn(0x7fb4cc0b18f0 msgr2=0x7fb4cc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 -- 172.21.15.114:0/2878595993 shutdown_connections 2024-09-16T07:29:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 -- 172.21.15.114:0/2878595993 wait complete. 2024-09-16T07:29:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 Processor -- start 2024-09-16T07:29:50.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.520+0000 7fb4d2000640 1 -- start start 2024-09-16T07:29:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc06e810 0x7fb4cc15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4cc0b4bd0 0x7fb4cc074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4cc15ade0 0x7fb4cc1485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc168090 con 0x7fb4cc15ade0 2024-09-16T07:29:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc167f10 con 0x7fb4cc06e810 2024-09-16T07:29:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4cc168210 con 0x7fb4cc0b4bd0 2024-09-16T07:29:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4cc15ade0 0x7fb4cc1485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4cc15ade0 0x7fb4cc1485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33842/0 (socket says 172.21.15.114:33842) 2024-09-16T07:29:50.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 -- 172.21.15.114:0/3759847729 learned_addr learned my addr 172.21.15.114:0/3759847729 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cb400640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc06e810 0x7fb4cc15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4c2a00640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4cc0b4bd0 0x7fb4cc074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 -- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4cc0b4bd0 msgr2=0x7fb4cc074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4cc0b4bd0 0x7fb4cc074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 -- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc06e810 msgr2=0x7fb4cc15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc06e810 0x7fb4cc15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 -- 172.21.15.114:0/3759847729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc1fb270 con 0x7fb4cc15ade0 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4cbe00640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4cc15ade0 0x7fb4cc1485e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb4c401a450 tx=0x7fb4c40a66f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4c3e00640 1 -- 172.21.15.114:0/3759847729 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c40040c0 con 0x7fb4cc15ade0 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4c3e00640 1 -- 172.21.15.114:0/3759847729 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4c4004350 con 0x7fb4cc15ade0 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc074ab0 con 0x7fb4cc15ade0 2024-09-16T07:29:50.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4c3e00640 1 -- 172.21.15.114:0/3759847729 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4005260 con 0x7fb4cc15ade0 2024-09-16T07:29:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc1fb510 con 0x7fb4cc15ade0 2024-09-16T07:29:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4cc069410 con 0x7fb4cc15ade0 2024-09-16T07:29:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.524+0000 7fb4c3e00640 1 -- 172.21.15.114:0/3759847729 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fb4c40c2020 con 0x7fb4cc15ade0 2024-09-16T07:29:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.528+0000 7fb4c3e00640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4a8073070 0x7fb4a8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:50.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.528+0000 7fb4c3e00640 1 -- 172.21.15.114:0/3759847729 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb4c412ee60 con 0x7fb4cc15ade0 2024-09-16T07:29:50.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.528+0000 7fb4cb400640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4a8073070 0x7fb4a8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:50.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.528+0000 7fb4cb400640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4a8073070 0x7fb4a8075530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009b40 tx=0x7fb4bc009260 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:50.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.532+0000 7fb4c3e00640 1 -- 172.21.15.114:0/3759847729 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb4c4016410 con 0x7fb4cc15ade0 2024-09-16T07:29:50.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.772+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4cc15e900 con 0x7fb4cc15ade0 2024-09-16T07:29:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.772+0000 7fb4c3e00640 1 -- 172.21.15.114:0/3759847729 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7fb4c40f96c0 con 0x7fb4cc15ade0 2024-09-16T07:29:50.778 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:50.778 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":27,"btime":"2024-09-16T07:29:43:896581+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:29:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 27 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4a8073070 msgr2=0x7fb4a8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4a8073070 0x7fb4a8075530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009b40 tx=0x7fb4bc009260 comp rx=0 tx=0).stop 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4cc15ade0 msgr2=0x7fb4cc1485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4cc15ade0 0x7fb4cc1485e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb4c401a450 tx=0x7fb4c40a66f0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 shutdown_connections 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4a8073070 0x7fb4a8075530 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4cc15ade0 0x7fb4cc1485e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4cc0b4bd0 0x7fb4cc074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 --2- 172.21.15.114:0/3759847729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4cc06e810 0x7fb4cc15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 >> 172.21.15.114:0/3759847729 conn(0x7fb4cc0b18f0 msgr2=0x7fb4cc165180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 shutdown_connections 2024-09-16T07:29:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:50.776+0000 7fb4d2000640 1 -- 172.21.15.114:0/3759847729 wait complete. 2024-09-16T07:29:51.204 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:29:40.260879+0000', 'modified': '2024-09-16T07:29:43.287066+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5307}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5307': {'gid': 5307, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/1997583151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 1997583151}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 1997583151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5307, 'qdb_cluster': [5307]} 2024-09-16T07:29:51.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:29:51.252 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 -- 172.21.15.114:0/1112119425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 msgr2=0x7f2828074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 --2- 172.21.15.114:0/1112119425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f2828074340 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f28280ce090 tx=0x7f281001c8c0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 -- 172.21.15.114:0/1112119425 shutdown_connections 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 --2- 172.21.15.114:0/1112119425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f2828074340 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 --2- 172.21.15.114:0/1112119425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28280af240 0x7f2828074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 --2- 172.21.15.114:0/1112119425 >> v2:172.21.15.149:3300/0 conn(0x7f282815f110 0x7f28280af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 -- 172.21.15.114:0/1112119425 >> 172.21.15.114:0/1112119425 conn(0x7f2828073490 msgr2=0x7f28280d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 -- 172.21.15.114:0/1112119425 shutdown_connections 2024-09-16T07:29:51.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.392+0000 7f282cc00640 1 -- 172.21.15.114:0/1112119425 wait complete. 2024-09-16T07:29:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 Processor -- start 2024-09-16T07:29:51.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 -- start start 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28280af240 0x7f2828154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f282815f110 0x7f28281545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f28280992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f28280caec0 con 0x7f282815f4f0 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f28280cad40 con 0x7f28280af240 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f28280cb040 con 0x7f282815f110 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f28280992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f281ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f282815f110 0x7f28281545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f28280992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33866/0 (socket says 172.21.15.114:33866) 2024-09-16T07:29:51.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 -- 172.21.15.114:0/337676422 learned_addr learned my addr 172.21.15.114:0/337676422 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827400640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28280af240 0x7f2828154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 -- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f282815f110 msgr2=0x7f28281545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f282815f110 0x7f28281545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 -- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28280af240 msgr2=0x7f2828154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28280af240 0x7f2828154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 -- 172.21.15.114:0/337676422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28280aeef0 con 0x7f282815f4f0 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f281ea00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f282815f110 0x7f28281545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:29:51.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f2827e00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f28280992c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f282000daf0 tx=0x7f2820009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f281fe00640 1 -- 172.21.15.114:0/337676422 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282000be00 con 0x7f282815f4f0 2024-09-16T07:29:51.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f281fe00640 1 -- 172.21.15.114:0/337676422 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2820003980 con 0x7f282815f4f0 2024-09-16T07:29:51.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f281fe00640 1 -- 172.21.15.114:0/337676422 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820003dd0 con 0x7f282815f4f0 2024-09-16T07:29:51.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28280cd4f0 con 0x7f282815f4f0 2024-09-16T07:29:51.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.396+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28280afab0 con 0x7f282815f4f0 2024-09-16T07:29:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f281fe00640 1 -- 172.21.15.114:0/337676422 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f2820003f70 con 0x7f282815f4f0 2024-09-16T07:29:51.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f281fe00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2804073070 0x7f2804075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f2831602000 1 Processor -- start 2024-09-16T07:29:51.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f281fe00640 1 -- 172.21.15.114:0/337676422 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2820094990 con 0x7f282815f4f0 2024-09-16T07:29:51.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f2831602000 1 -- start start 2024-09-16T07:29:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f2827400640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2804073070 0x7f2804075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e1799dc0 0x5593e179a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.400+0000 7f2831602000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e174dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e174e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5593e166a3f0 con 0x5593e179a6e0 2024-09-16T07:29:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5593e15a7b20 con 0x5593e1799dc0 2024-09-16T07:29:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5593e1596f50 con 0x5593e174e220 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2827400640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2804073070 0x7f2804075530 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2828098540 tx=0x7f28180091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e174dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e174dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33870/0 (socket says 172.21.15.114:33870) 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2827400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e1799dc0 0x5593e179a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 -- 172.21.15.114:0/1598884826 learned_addr learned my addr 172.21.15.114:0/1598884826 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2827e00640 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e174e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 -- 172.21.15.114:0/1598884826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 msgr2=0x5593e174e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e174e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 -- 172.21.15.114:0/1598884826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e1799dc0 msgr2=0x5593e179a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e1799dc0 0x5593e179a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 -- 172.21.15.114:0/1598884826 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593e155e590 con 0x5593e179a6e0 2024-09-16T07:29:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f281ea00640 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e174dce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2810009230 tx=0x7f2810019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c008808fde884e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2817e00640 1 -- 172.21.15.114:0/1598884826 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100b2030 con 0x5593e179a6e0 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2817e00640 1 -- 172.21.15.114:0/1598884826 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28100b3040 con 0x5593e179a6e0 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2817e00640 1 -- 172.21.15.114:0/1598884826 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810005040 con 0x5593e179a6e0 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- 172.21.15.114:0/1598884826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 msgr2=0x5593e174dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e174dce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2810009230 tx=0x7f2810019660 comp rx=0 tx=0).stop 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- 172.21.15.114:0/1598884826 shutdown_connections 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e174e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e174dce0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- 172.21.15.114:0/1598884826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e1799dc0 0x5593e179a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- 172.21.15.114:0/1598884826 >> 172.21.15.114:0/1598884826 conn(0x5593e1633130 msgr2=0x5593e1778e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- 172.21.15.114:0/1598884826 shutdown_connections 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- 172.21.15.114:0/1598884826 wait complete. 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- start start 2024-09-16T07:29:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 Processor -- start 2024-09-16T07:29:51.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1784360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e1799dc0 0x5593e17848a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e1784de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5593e15315d0 con 0x5593e179a6e0 2024-09-16T07:29:51.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5593e159ad60 con 0x5593e174e220 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5593e153d500 con 0x5593e1799dc0 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.404+0000 7f2831602000 10 client.0 _ll_register_callbacks cb 0x5593e1541810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e1784de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e1784de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33872/0 (socket says 172.21.15.114:33872) 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 -- 172.21.15.114:0/3484769820 learned_addr learned my addr 172.21.15.114:0/3484769820 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f281ea00640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e1799dc0 0x5593e17848a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827400640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1784360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 -- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e1799dc0 msgr2=0x5593e17848a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e1799dc0 0x5593e17848a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 -- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 msgr2=0x5593e1784360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1784360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 -- 172.21.15.114:0/3484769820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593e1535170 con 0x5593e179a6e0 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f281ea00640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e1799dc0 0x5593e17848a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:51.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827e00640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e1784de0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f282000dac0 tx=0x7f2820093070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cf9cc0733c9cee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 1 -- 172.21.15.114:0/3484769820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820063c20 con 0x5593e179a6e0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 1 -- 172.21.15.114:0/3484769820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f282005e450 con 0x5593e179a6e0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5593e152f0f0 con 0x5593e179a6e0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 1 -- 172.21.15.114:0/3484769820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2820068ad0 con 0x5593e179a6e0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 10 client.5463 fetch_fsmap learned FSMap version 27 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5593e161bef0 con 0x5593e179a6e0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 1 -- 172.21.15.114:0/3484769820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5593e152f0f0 con 0x5593e179a6e0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 1 -- 172.21.15.114:0/3484769820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f282005ab40 con 0x5593e179a6e0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 10 client.5463 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 10 client.5463 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 20 client.5463 populate_metadata read hostname 'smithi114' 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17857f0 0x5593e17ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 4 client.5463 mds_command: new command op to 5307 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 --> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593e15a9a70 con 0x5593e17857f0 2024-09-16T07:29:51.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827400640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17857f0 0x5593e17ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2827400640 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17857f0 0x5593e17ab070 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91ce240722086020 server_cookie=74cf0548b38da22a in_seq=0 out_seq=0 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 10 client.5463 ms_handle_connect on v2:172.21.15.114:6833/1997583151 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 1 -- 172.21.15.114:0/3484769820 <== mds.0 v2:172.21.15.114:6833/1997583151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593e15a9a70 con 0x5593e17857f0 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 10 client.5463 handle_command_reply: tid=0 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 client.5463 shutdown 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 msgr2=0x5593e1784de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e1784de0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f282000dac0 tx=0x7f2820093070 comp rx=0 tx=0).stop 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 shutdown_connections 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e179a6e0 0x5593e1784de0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e1799dc0 0x5593e17848a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17857f0 0x5593e17ab070 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 --2- 172.21.15.114:0/3484769820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1784360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2814c00640 0 client.5463 ms_handle_reset on v2:172.21.15.114:6833/1997583151 2024-09-16T07:29:51.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 >> 172.21.15.114:0/3484769820 conn(0x5593e1633130 msgr2=0x5593e17488c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 shutdown_connections 2024-09-16T07:29:51.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 1 -- 172.21.15.114:0/3484769820 wait complete. 2024-09-16T07:29:51.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.408+0000 7f2831602000 20 client.5463 trim_cache size 0 max 16384 2024-09-16T07:29:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 Processor -- start 2024-09-16T07:29:51.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 -- start start 2024-09-16T07:29:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e1775f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1776450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e179a6e0 0x5593e17ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f28280b2230 con 0x5593e1799dc0 2024-09-16T07:29:51.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5593e159f390 con 0x5593e179a6e0 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5593e161ba60 con 0x5593e174e220 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1776450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1776450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33876/0 (socket says 172.21.15.114:33876) 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 -- 172.21.15.114:0/2898699155 learned_addr learned my addr 172.21.15.114:0/2898699155 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2827e00640 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e179a6e0 0x5593e17ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2827400640 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e1775f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 -- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 msgr2=0x5593e1775f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e1775f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 -- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e179a6e0 msgr2=0x5593e17ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e179a6e0 0x5593e17ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 -- 172.21.15.114:0/2898699155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593e15f2d90 con 0x5593e1799dc0 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2827e00640 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e179a6e0 0x5593e17ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f281ea00640 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1776450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2810009850 tx=0x7f2810009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0011738af5e488 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.428+0000 7f2817400640 1 -- 172.21.15.114:0/2898699155 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100b2030 con 0x5593e1799dc0 2024-09-16T07:29:51.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2817400640 1 -- 172.21.15.114:0/2898699155 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2810004040 con 0x5593e1799dc0 2024-09-16T07:29:51.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2817400640 1 -- 172.21.15.114:0/2898699155 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810004490 con 0x5593e1799dc0 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- 172.21.15.114:0/2898699155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 msgr2=0x5593e1776450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1776450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2810009850 tx=0x7f2810009260 comp rx=0 tx=0).stop 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- 172.21.15.114:0/2898699155 shutdown_connections 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e179a6e0 0x5593e17ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1776450 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 --2- 172.21.15.114:0/2898699155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e174e220 0x5593e1775f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- 172.21.15.114:0/2898699155 >> 172.21.15.114:0/2898699155 conn(0x5593e1633130 msgr2=0x5593e17578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- 172.21.15.114:0/2898699155 shutdown_connections 2024-09-16T07:29:51.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- 172.21.15.114:0/2898699155 wait complete. 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- start start 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 Processor -- start 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1810830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1810d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e179a6e0 0x5593e18112b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5593e1656730 con 0x5593e1799dc0 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5593e159a070 con 0x5593e174e220 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5593e1562ec0 con 0x5593e179a6e0 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 10 client.0 _ll_register_callbacks cb 0x7f282005eb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1810d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1810d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33878/0 (socket says 172.21.15.114:33878) 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 -- 172.21.15.114:0/1440979378 learned_addr learned my addr 172.21.15.114:0/1440979378 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2827400640 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1810830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2827e00640 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e179a6e0 0x5593e18112b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 -- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e179a6e0 msgr2=0x5593e18112b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e179a6e0 0x5593e18112b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 -- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 msgr2=0x5593e1810830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1810830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 -- 172.21.15.114:0/1440979378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593e155da90 con 0x5593e1799dc0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f281ea00640 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1810d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f281001af70 tx=0x7f2810005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579bafdefe0153ec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2814c00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2814c00640 1 -- 172.21.15.114:0/1440979378 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100c6020 con 0x5593e1799dc0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2814c00640 1 -- 172.21.15.114:0/1440979378 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2810005300 con 0x5593e1799dc0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2810004040 con 0x5593e1799dc0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2814c00640 1 -- 172.21.15.114:0/1440979378 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2810005500 con 0x5593e1799dc0 2024-09-16T07:29:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 10 client.5469 fetch_fsmap learned FSMap version 27 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.432+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5593e153c050 con 0x5593e1799dc0 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2814c00640 1 -- 172.21.15.114:0/1440979378 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2810004040 con 0x5593e1799dc0 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2814c00640 1 -- 172.21.15.114:0/1440979378 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f28100046d0 con 0x5593e1799dc0 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 10 client.5469 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 10 client.5469 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 20 client.5469 populate_metadata read hostname 'smithi114' 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17ae250 0x5593e17ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 4 client.5469 mds_command: new command op to 5307 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 --> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] -- command(tid 0: {"prefix": "status"}) -- 0x5593e15a5520 con 0x5593e17ae250 2024-09-16T07:29:51.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2827400640 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17ae250 0x5593e17ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2827400640 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17ae250 0x5593e17ae630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e8fff2685574cf server_cookie=4c4598ac293f7a8d in_seq=0 out_seq=0 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2814c00640 10 client.5469 ms_handle_connect on v2:172.21.15.114:6833/1997583151 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2814c00640 1 -- 172.21.15.114:0/1440979378 <== mds.0 v2:172.21.15.114:6833/1997583151 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5593e15a5520 con 0x5593e17ae250 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2814c00640 10 client.5469 handle_command_reply: tid=0 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 client.5469 shutdown 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 msgr2=0x5593e1810d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1810d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f281001af70 tx=0x7f2810005e60 comp rx=0 tx=0).stop 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 shutdown_connections 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5593e179a6e0 0x5593e18112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5593e1799dc0 0x5593e1810d70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.114:6833/1997583151,v1:172.21.15.114:6835/1997583151] conn(0x5593e17ae250 0x5593e17ae630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 --2- 172.21.15.114:0/1440979378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5593e174e220 0x5593e1810830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 >> 172.21.15.114:0/1440979378 conn(0x5593e1633130 msgr2=0x5593e1774f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2814c00640 0 client.5469 ms_handle_reset on v2:172.21.15.114:6833/1997583151 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 shutdown_connections 2024-09-16T07:29:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 1 -- 172.21.15.114:0/1440979378 wait complete. 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f2831602000 20 client.5469 trim_cache size 0 max 16384 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5307, 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.578182387, 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 27, 2024-09-16T07:29:51.444 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 44, 2024-09-16T07:29:51.445 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 44, 2024-09-16T07:29:51.445 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 15.110394299999999 2024-09-16T07:29:51.445 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:29:51.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2804073070 msgr2=0x7f2804075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2804073070 0x7f2804075530 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2828098540 tx=0x7f28180091e0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 msgr2=0x7f28280992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f28280992c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f282000daf0 tx=0x7f2820009f60 comp rx=0 tx=0).stop 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 shutdown_connections 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2804073070 0x7f2804075530 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f282815f4f0 0x7f28280992c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f282815f110 0x7f28281545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 --2- 172.21.15.114:0/337676422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28280af240 0x7f2828154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 >> 172.21.15.114:0/337676422 conn(0x7f2828073490 msgr2=0x7f2828070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 shutdown_connections 2024-09-16T07:29:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.436+0000 7f282cc00640 1 -- 172.21.15.114:0/337676422 wait complete. 2024-09-16T07:29:51.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:29:51.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.596+0000 7f8e17800640 1 -- 172.21.15.114:0/2568807027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e100b4a50 msgr2=0x7f8e100acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.596+0000 7f8e17800640 1 --2- 172.21.15.114:0/2568807027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e100b4a50 0x7f8e100acd40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009bc0 tx=0x7f8e0801ca30 comp rx=0 tx=0).stop 2024-09-16T07:29:51.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- 172.21.15.114:0/2568807027 shutdown_connections 2024-09-16T07:29:51.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 --2- 172.21.15.114:0/2568807027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e100b4a50 0x7f8e100acd40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- 172.21.15.114:0/2568807027 >> 172.21.15.114:0/2568807027 conn(0x7f8e100b18f0 msgr2=0x7f8e100b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- 172.21.15.114:0/2568807027 shutdown_connections 2024-09-16T07:29:51.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- 172.21.15.114:0/2568807027 wait complete. 2024-09-16T07:29:51.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 Processor -- start 2024-09-16T07:29:51.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- start start 2024-09-16T07:29:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1006f8b0 0x7f8e1014e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e100b4a50 0x7f8e1009d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e100cd100 0x7f8e1009b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8e101694d0 con 0x7f8e100b4a50 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e10169350 con 0x7f8e1006f8b0 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e17800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e10169650 con 0x7f8e100cd100 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e100b4a50 0x7f8e1009d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e100b4a50 0x7f8e1009d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33892/0 (socket says 172.21.15.114:33892) 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 -- 172.21.15.114:0/4207179427 learned_addr learned my addr 172.21.15.114:0/4207179427 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e14e00640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1006f8b0 0x7f8e1014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e15800640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e100cd100 0x7f8e1009b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 -- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e100cd100 msgr2=0x7f8e1009b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e100cd100 0x7f8e1009b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 -- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1006f8b0 msgr2=0x7f8e1014e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1006f8b0 0x7f8e1014e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 -- 172.21.15.114:0/4207179427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1015a7f0 con 0x7f8e100b4a50 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e07e00640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e100b4a50 0x7f8e1009d360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8df800ca70 tx=0x7f8df800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.600+0000 7f8e0d600640 1 -- 172.21.15.114:0/4207179427 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8016020 con 0x7f8e100b4a50 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e0d600640 1 -- 172.21.15.114:0/4207179427 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8df800ab00 con 0x7f8e100b4a50 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e0d600640 1 -- 172.21.15.114:0/4207179427 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8012420 con 0x7f8e100b4a50 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e10159a30 con 0x7f8e100b4a50 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e10159ff0 con 0x7f8e100b4a50 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e10069410 con 0x7f8e100b4a50 2024-09-16T07:29:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e0d600640 1 -- 172.21.15.114:0/4207179427 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f8df8019020 con 0x7f8e100b4a50 2024-09-16T07:29:51.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e0d600640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8dec073070 0x7f8dec075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:51.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e0d600640 1 -- 172.21.15.114:0/4207179427 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f8df8094130 con 0x7f8e100b4a50 2024-09-16T07:29:51.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.604+0000 7f8e14e00640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8dec073070 0x7f8dec075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:51.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.608+0000 7f8e14e00640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8dec073070 0x7f8dec075530 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e00001820 tx=0x7f8e00009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:51.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.608+0000 7f8e0d600640 1 -- 172.21.15.114:0/4207179427 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8df8020030 con 0x7f8e100b4a50 2024-09-16T07:29:51.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.812+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8e10154be0 con 0x7f8e100b4a50 2024-09-16T07:29:51.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.812+0000 7f8e0d600640 1 -- 172.21.15.114:0/4207179427 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f8e100ccd10 con 0x7f8e100b4a50 2024-09-16T07:29:51.816 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:29:51.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8dec073070 msgr2=0x7f8dec075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8dec073070 0x7f8dec075530 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e00001820 tx=0x7f8e00009040 comp rx=0 tx=0).stop 2024-09-16T07:29:51.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e100b4a50 msgr2=0x7f8e1009d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:51.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e100b4a50 0x7f8e1009d360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8df800ca70 tx=0x7f8df800cf30 comp rx=0 tx=0).stop 2024-09-16T07:29:51.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 shutdown_connections 2024-09-16T07:29:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8dec073070 0x7f8dec075530 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e100cd100 0x7f8e1009b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e100b4a50 0x7f8e1009d360 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 --2- 172.21.15.114:0/4207179427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e1006f8b0 0x7f8e1014e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 >> 172.21.15.114:0/4207179427 conn(0x7f8e100b18f0 msgr2=0x7f8e10073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 shutdown_connections 2024-09-16T07:29:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:51.816+0000 7f8e17800640 1 -- 172.21.15.114:0/4207179427 wait complete. 2024-09-16T07:29:51.836 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:29:51.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:29:51.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:29:51.837 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:29:51.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:51.837 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:29:51.837 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:29:51.837 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:29:51.837 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:29:51.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:51.837 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:51.847 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42349sec preferred_lft 42349sec 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:29:51.848 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:29:51.849 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:29:51.850 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:51.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:51.850 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:29:51.907 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:29:51.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:51.909 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:29:51.960 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:29:51.960 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:29:51.962 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:29:51.962 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:29:51.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:29:51.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:29:51.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:29:51.962 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:29:52.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:29:52.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:52.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:52.099 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:29:52.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:29:52.108 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:29:52.108 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:29:52.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:52.109 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:29:52.168 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:52.168 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:52.221 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:29:52.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:52.221 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:52.272 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:29:52.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:52.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:52.361 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:52.361 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:29:52.361 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:29:52.377 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:52.377 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:29:52.378 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:29:52.378 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:52.378 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:52.388 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:29:52.388 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:29:52.388 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:29:52.388 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:52.388 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:52.388 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:29:52.389 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:29:52.389 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:29:52.392 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:29:52.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:52.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:52.412 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:29:52.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:29:52.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:52.514 INFO:teuthology.orchestra.run.smithi114.stdout:client5350 2024-09-16T07:29:52.514 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:52.514 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:52.565 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 -- 172.21.15.114:0/3104195233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea08155080 msgr2=0x7fea080cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 --2- 172.21.15.114:0/3104195233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea08155080 0x7fea080cd510 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009900 tx=0x7fe9f801c880 comp rx=0 tx=0).stop 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 -- 172.21.15.114:0/3104195233 shutdown_connections 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 --2- 172.21.15.114:0/3104195233 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea080cda50 0x7fea080cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 --2- 172.21.15.114:0/3104195233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea08155080 0x7fea080cd510 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 -- 172.21.15.114:0/3104195233 >> 172.21.15.114:0/3104195233 conn(0x7fea0806dd30 msgr2=0x7fea0806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 -- 172.21.15.114:0/3104195233 shutdown_connections 2024-09-16T07:29:52.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 -- 172.21.15.114:0/3104195233 wait complete. 2024-09-16T07:29:52.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 Processor -- start 2024-09-16T07:29:52.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.748+0000 7fea0ca00640 1 -- start start 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea080cb8a0 0x7fea080a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea080cda50 0x7fea080af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea08155080 0x7fea080c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fea08167d40 con 0x7fea080cb8a0 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea08167bc0 con 0x7fea080cda50 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea08167ec0 con 0x7fea08155080 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea080cb8a0 0x7fea080a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:52.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea080cb8a0 0x7fea080a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33902/0 (socket says 172.21.15.114:33902) 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 -- 172.21.15.114:0/1976619713 learned_addr learned my addr 172.21.15.114:0/1976619713 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea05e00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea080cda50 0x7fea080af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea07200640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea08155080 0x7fea080c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 -- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea08155080 msgr2=0x7fea080c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea08155080 0x7fea080c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 -- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea080cda50 msgr2=0x7fea080af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea080cda50 0x7fea080af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 -- 172.21.15.114:0/1976619713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea080b4de0 con 0x7fea080cb8a0 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea05e00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea080cda50 0x7fea080af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:29:52.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea06800640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea080cb8a0 0x7fea080a1c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009850 tx=0x7fe9f8005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:52.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fe9fea00640 1 -- 172.21.15.114:0/1976619713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80bb070 con 0x7fea080cb8a0 2024-09-16T07:29:52.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fe9fea00640 1 -- 172.21.15.114:0/1976619713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9f80043f0 con 0x7fea080cb8a0 2024-09-16T07:29:52.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fe9fea00640 1 -- 172.21.15.114:0/1976619713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80b2040 con 0x7fea080cb8a0 2024-09-16T07:29:52.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea080bed00 con 0x7fea080cb8a0 2024-09-16T07:29:52.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea080b66c0 con 0x7fea080cb8a0 2024-09-16T07:29:52.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.752+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea080b4b70 con 0x7fea080cb8a0 2024-09-16T07:29:52.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.756+0000 7fe9fea00640 1 -- 172.21.15.114:0/1976619713 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fe9f8005290 con 0x7fea080cb8a0 2024-09-16T07:29:52.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.756+0000 7fe9fea00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe9e8073070 0x7fe9e8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:52.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.756+0000 7fe9fea00640 1 -- 172.21.15.114:0/1976619713 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fe9f812d830 con 0x7fea080cb8a0 2024-09-16T07:29:52.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.756+0000 7fea05e00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe9e8073070 0x7fe9e8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:52.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.756+0000 7fea05e00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe9e8073070 0x7fe9e8075530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea080b6bc0 tx=0x7fe9f4005f40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:52.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.760+0000 7fe9fea00640 1 -- 172.21.15.114:0/1976619713 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe9f80164d0 con 0x7fea080cb8a0 2024-09-16T07:29:52.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.972+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fea080beb20 con 0x7fea080cb8a0 2024-09-16T07:29:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.972+0000 7fe9fea00640 1 -- 172.21.15.114:0/1976619713 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fea080beb20 con 0x7fea080cb8a0 2024-09-16T07:29:52.977 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:29:52.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe9e8073070 msgr2=0x7fe9e8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:52.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe9e8073070 0x7fe9e8075530 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea080b6bc0 tx=0x7fe9f4005f40 comp rx=0 tx=0).stop 2024-09-16T07:29:52.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea080cb8a0 msgr2=0x7fea080a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea080cb8a0 0x7fea080a1c90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009850 tx=0x7fe9f8005e90 comp rx=0 tx=0).stop 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 shutdown_connections 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe9e8073070 0x7fe9e8075530 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea08155080 0x7fea080c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea080cda50 0x7fea080af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 --2- 172.21.15.114:0/1976619713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea080cb8a0 0x7fea080a1c90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 >> 172.21.15.114:0/1976619713 conn(0x7fea0806dd30 msgr2=0x7fea080c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 shutdown_connections 2024-09-16T07:29:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:52.976+0000 7fea0ca00640 1 -- 172.21.15.114:0/1976619713 wait complete. 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:29:52.998 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:29:52.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:52.999 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:53.009 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42357sec preferred_lft 42357sec 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.010 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:29:53.011 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:29:53.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:53.013 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:29:53.076 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:29:53.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:53.079 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:29:53.133 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:29:53.133 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:29:53.133 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:29:53.134 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:29:53.135 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:29:53.135 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:29:53.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:29:53.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:29:53.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:29:53.135 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:29:53.232 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:29:53.275 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:53.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:53.283 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:29:53.292 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:29:53.292 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:29:53.293 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:29:53.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:53.293 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:29:53.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:53.356 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:53.413 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:29:53.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:29:53.413 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:53.464 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:29:53.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:53.464 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:53.557 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:53.558 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:29:53.558 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:29:53.573 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:53.573 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:29:53.573 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:29:53.573 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:53.573 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:53.582 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:29:53.582 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:29:53.582 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:29:53.583 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:29:53.583 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:29:53.583 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:29:53.583 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:29:53.583 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:29:53.587 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:29:53.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:53.587 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:53.607 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:29:53.694 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:29:53.698 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:29:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:client5072 2024-09-16T07:29:53.704 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:53.704 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:53.713 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:29:53.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 -- 172.21.15.114:0/2618816735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 msgr2=0x7f4a500ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:53.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 --2- 172.21.15.114:0/2618816735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500ce700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4a500b0fb0 tx=0x7f4a4401f0b0 comp rx=0 tx=0).stop 2024-09-16T07:29:53.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 -- 172.21.15.114:0/2618816735 shutdown_connections 2024-09-16T07:29:53.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 --2- 172.21.15.114:0/2618816735 >> v2:172.21.15.149:3300/0 conn(0x7f4a500b0b60 0x7f4a500ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:53.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 --2- 172.21.15.114:0/2618816735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500ce700 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:53.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 -- 172.21.15.114:0/2618816735 >> 172.21.15.114:0/2618816735 conn(0x7f4a500d1da0 msgr2=0x7f4a500d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:53.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 -- 172.21.15.114:0/2618816735 shutdown_connections 2024-09-16T07:29:53.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.864+0000 7f4a57800640 1 -- 172.21.15.114:0/2618816735 wait complete. 2024-09-16T07:29:53.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 Processor -- start 2024-09-16T07:29:53.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 -- start start 2024-09-16T07:29:53.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a500b0b60 0x7f4a501575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:53.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:53.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c1f0 0x7f4a500cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:53.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4a500cd4a0 con 0x7f4a5015be10 2024-09-16T07:29:53.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4a500cd320 con 0x7f4a500b0b60 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4a500cd620 con 0x7f4a5015c1f0 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33920/0 (socket says 172.21.15.114:33920) 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 -- 172.21.15.114:0/999301862 learned_addr learned my addr 172.21.15.114:0/999301862 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a54e00640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a500b0b60 0x7f4a501575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a55800640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c1f0 0x7f4a500cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 -- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c1f0 msgr2=0x7f4a500cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c1f0 0x7f4a500cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 -- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a500b0b60 msgr2=0x7f4a501575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a500b0b60 0x7f4a501575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 -- 172.21.15.114:0/999301862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a501f8010 con 0x7f4a5015be10 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4fe00640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500b74e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00b410 tx=0x7f4a3c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:53.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4cc00640 1 -- 172.21.15.114:0/999301862 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c015030 con 0x7f4a5015be10 2024-09-16T07:29:53.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4cc00640 1 -- 172.21.15.114:0/999301862 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a3c004020 con 0x7f4a5015be10 2024-09-16T07:29:53.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a501f82f0 con 0x7f4a5015be10 2024-09-16T07:29:53.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a4cc00640 1 -- 172.21.15.114:0/999301862 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c004470 con 0x7f4a5015be10 2024-09-16T07:29:53.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.868+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a501f88b0 con 0x7f4a5015be10 2024-09-16T07:29:53.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.872+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a500cdb40 con 0x7f4a5015be10 2024-09-16T07:29:53.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.872+0000 7f4a4cc00640 1 -- 172.21.15.114:0/999301862 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f4a3c018070 con 0x7f4a5015be10 2024-09-16T07:29:53.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.872+0000 7f4a4cc00640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a300730a0 0x7f4a30075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.872+0000 7f4a4cc00640 1 -- 172.21.15.114:0/999301862 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f4a3c093c10 con 0x7f4a5015be10 2024-09-16T07:29:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.872+0000 7f4a54e00640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a300730a0 0x7f4a30075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.876+0000 7f4a54e00640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a300730a0 0x7f4a30075560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4a440b2000 tx=0x7f4a4401d8f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:53.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:53.876+0000 7f4a4cc00640 1 -- 172.21.15.114:0/999301862 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4a3c05e470 con 0x7f4a5015be10 2024-09-16T07:29:54.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.080+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4a50070350 con 0x7f4a5015be10 2024-09-16T07:29:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a4cc00640 1 -- 172.21.15.114:0/999301862 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v28) ==== 136+0+0 (secure 0 0 0) 0x7f4a3c062ea0 con 0x7f4a5015be10 2024-09-16T07:29:54.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a300730a0 msgr2=0x7f4a30075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a300730a0 0x7f4a30075560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4a440b2000 tx=0x7f4a4401d8f0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 msgr2=0x7f4a500b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500b74e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00b410 tx=0x7f4a3c00b8d0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 shutdown_connections 2024-09-16T07:29:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a300730a0 0x7f4a30075560 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c1f0 0x7f4a500cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a5015be10 0x7f4a500b74e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 --2- 172.21.15.114:0/999301862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a500b0b60 0x7f4a501575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 >> 172.21.15.114:0/999301862 conn(0x7f4a500d1da0 msgr2=0x7f4a50072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 shutdown_connections 2024-09-16T07:29:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.372+0000 7f4a57800640 1 -- 172.21.15.114:0/999301862 wait complete. 2024-09-16T07:29:54.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:29:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 -- 172.21.15.114:0/3633499127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 msgr2=0x7f06980af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 --2- 172.21.15.114:0/3633499127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06980af710 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0690009900 tx=0x7f069001f0d0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 -- 172.21.15.114:0/3633499127 shutdown_connections 2024-09-16T07:29:54.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 --2- 172.21.15.114:0/3633499127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06980af710 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 --2- 172.21.15.114:0/3633499127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069815f6e0 0x7f06980d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 -- 172.21.15.114:0/3633499127 >> 172.21.15.114:0/3633499127 conn(0x7f06980d1e30 msgr2=0x7f06980d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:54.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 -- 172.21.15.114:0/3633499127 shutdown_connections 2024-09-16T07:29:54.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.536+0000 7f069e400640 1 -- 172.21.15.114:0/3633499127 wait complete. 2024-09-16T07:29:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 Processor -- start 2024-09-16T07:29:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 -- start start 2024-09-16T07:29:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06981ea510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069815f300 0x7f069806e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069815f6e0 0x7f06980cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06980affe0 con 0x7f06980b2d60 2024-09-16T07:29:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06980afe60 con 0x7f069815f300 2024-09-16T07:29:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06980b0160 con 0x7f069815f6e0 2024-09-16T07:29:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06981ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06981ea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37590/0 (socket says 172.21.15.114:37590) 2024-09-16T07:29:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 -- 172.21.15.114:0/2615908089 learned_addr learned my addr 172.21.15.114:0/2615908089 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697e00640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069815f6e0 0x7f06980cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0696a00640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069815f300 0x7f069806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 -- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069815f6e0 msgr2=0x7f06980cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069815f6e0 0x7f06980cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 -- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069815f300 msgr2=0x7f069806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069815f300 0x7f069806e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 -- 172.21.15.114:0/2615908089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069806eeb0 con 0x7f06980b2d60 2024-09-16T07:29:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697e00640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069815f6e0 0x7f06980cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f0697400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06981ea510 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f068800c8a0 tx=0x7f068800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f068f400640 1 -- 172.21.15.114:0/2615908089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688003b80 con 0x7f06980b2d60 2024-09-16T07:29:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f068f400640 1 -- 172.21.15.114:0/2615908089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0688003d40 con 0x7f06980b2d60 2024-09-16T07:29:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f068f400640 1 -- 172.21.15.114:0/2615908089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068800aab0 con 0x7f06980b2d60 2024-09-16T07:29:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069806f190 con 0x7f06980b2d60 2024-09-16T07:29:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.540+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06980c8000 con 0x7f06980b2d60 2024-09-16T07:29:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.544+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06980c8320 con 0x7f06980b2d60 2024-09-16T07:29:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.544+0000 7f068f400640 1 -- 172.21.15.114:0/2615908089 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f068800ac50 con 0x7f06980b2d60 2024-09-16T07:29:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.544+0000 7f068f400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0678073070 0x7f0678075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.544+0000 7f068f400640 1 -- 172.21.15.114:0/2615908089 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f0688094190 con 0x7f06980b2d60 2024-09-16T07:29:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.544+0000 7f0696a00640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0678073070 0x7f0678075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.544+0000 7f0696a00640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0678073070 0x7f0678075530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0684005d90 tx=0x7f0684005c80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.548+0000 7f068f400640 1 -- 172.21.15.114:0/2615908089 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f06980c8320 con 0x7f06980b2d60 2024-09-16T07:29:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.736+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f06980af710 con 0x7f0678073070 2024-09-16T07:29:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f068f400640 1 -- 172.21.15.114:0/2615908089 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f06980af710 con 0x7f0678073070 2024-09-16T07:29:54.742 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:29:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:29:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:29:54.742 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:29:54.742 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:29:54.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0678073070 msgr2=0x7f0678075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0678073070 0x7f0678075530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0684005d90 tx=0x7f0684005c80 comp rx=0 tx=0).stop 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 msgr2=0x7f06981ea510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06981ea510 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f068800c8a0 tx=0x7f068800cd60 comp rx=0 tx=0).stop 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 shutdown_connections 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0678073070 0x7f0678075530 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f069815f6e0 0x7f06980cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f069815f300 0x7f069806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 --2- 172.21.15.114:0/2615908089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06980b2d60 0x7f06981ea510 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 >> 172.21.15.114:0/2615908089 conn(0x7f06980d1e30 msgr2=0x7f06981563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 shutdown_connections 2024-09-16T07:29:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.740+0000 7f069e400640 1 -- 172.21.15.114:0/2615908089 wait complete. 2024-09-16T07:29:54.763 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:29:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 -- 172.21.15.114:0/1691419043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6815ade0 msgr2=0x7f8c680cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 --2- 172.21.15.114:0/1691419043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6815ade0 0x7f8c680cebf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009900 tx=0x7f8c5c01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 -- 172.21.15.114:0/1691419043 shutdown_connections 2024-09-16T07:29:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 --2- 172.21.15.114:0/1691419043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c680b4bd0 0x7f8c680cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 --2- 172.21.15.114:0/1691419043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6815ade0 0x7f8c680cebf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 -- 172.21.15.114:0/1691419043 >> 172.21.15.114:0/1691419043 conn(0x7f8c680b18f0 msgr2=0x7f8c680b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 -- 172.21.15.114:0/1691419043 shutdown_connections 2024-09-16T07:29:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 -- 172.21.15.114:0/1691419043 wait complete. 2024-09-16T07:29:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 Processor -- start 2024-09-16T07:29:54.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.904+0000 7f8c70200640 1 -- start start 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6806e810 0x7f8c681f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c680b4bd0 0x7f8c681436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c6815ade0 0x7f8c68153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8c681680e0 con 0x7f8c6806e810 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c68167f60 con 0x7f8c680b4bd0 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c68168260 con 0x7f8c6815ade0 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6806e810 0x7f8c681f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6806e810 0x7f8c681f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37618/0 (socket says 172.21.15.114:37618) 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 -- 172.21.15.114:0/2717344733 learned_addr learned my addr 172.21.15.114:0/2717344733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6ce00640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c680b4bd0 0x7f8c681436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6e200640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c6815ade0 0x7f8c68153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 -- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c6815ade0 msgr2=0x7f8c68153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c6815ade0 0x7f8c68153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 -- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c680b4bd0 msgr2=0x7f8c681436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c680b4bd0 0x7f8c681436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 -- 172.21.15.114:0/2717344733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c68143bf0 con 0x7f8c6806e810 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c6d800640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6806e810 0x7f8c681f5d50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c01cdc0 tx=0x7f8c5c0a6560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c65600640 1 -- 172.21.15.114:0/2717344733 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0ac070 con 0x7f8c6806e810 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c68154150 con 0x7f8c6806e810 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c65600640 1 -- 172.21.15.114:0/2717344733 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c5c004320 con 0x7f8c6806e810 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c65600640 1 -- 172.21.15.114:0/2717344733 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0053a0 con 0x7f8c6806e810 2024-09-16T07:29:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c68154710 con 0x7f8c6806e810 2024-09-16T07:29:54.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c68069410 con 0x7f8c6806e810 2024-09-16T07:29:54.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.908+0000 7f8c65600640 1 -- 172.21.15.114:0/2717344733 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f8c5c0af070 con 0x7f8c6806e810 2024-09-16T07:29:54.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.912+0000 7f8c65600640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c48073070 0x7f8c48075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:54.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.912+0000 7f8c65600640 1 -- 172.21.15.114:0/2717344733 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f8c5c12e240 con 0x7f8c6806e810 2024-09-16T07:29:54.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.912+0000 7f8c6ce00640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c48073070 0x7f8c48075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:54.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.912+0000 7f8c6ce00640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c48073070 0x7f8c48075530 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8c68153850 tx=0x7f8c54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:54.916+0000 7f8c65600640 1 -- 172.21.15.114:0/2717344733 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8c5c0164d0 con 0x7f8c6806e810 2024-09-16T07:29:55.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8c680cf720 con 0x7f8c6806e810 2024-09-16T07:29:55.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c65600640 1 -- 172.21.15.114:0/2717344733 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f8c5c0f90a0 con 0x7f8c6806e810 2024-09-16T07:29:55.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c48073070 msgr2=0x7f8c48075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c48073070 0x7f8c48075530 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8c68153850 tx=0x7f8c54009040 comp rx=0 tx=0).stop 2024-09-16T07:29:55.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6806e810 msgr2=0x7f8c681f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6806e810 0x7f8c681f5d50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c01cdc0 tx=0x7f8c5c0a6560 comp rx=0 tx=0).stop 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 shutdown_connections 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c48073070 0x7f8c48075530 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c6815ade0 0x7f8c68153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c680b4bd0 0x7f8c681436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 --2- 172.21.15.114:0/2717344733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6806e810 0x7f8c681f5d50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 >> 172.21.15.114:0/2717344733 conn(0x7f8c680b18f0 msgr2=0x7f8c680cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 shutdown_connections 2024-09-16T07:29:55.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.084+0000 7f8c70200640 1 -- 172.21.15.114:0/2717344733 wait complete. 2024-09-16T07:29:55.109 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:55.109 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:55.117 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:29:55.117 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:55.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 -- 172.21.15.114:0/1616268195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a806e810 msgr2=0x7fb6a806f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 --2- 172.21.15.114:0/1616268195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a806e810 0x7fb6a806f1f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009c80 tx=0x7fb6a001cd70 comp rx=0 tx=0).stop 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 -- 172.21.15.114:0/1616268195 shutdown_connections 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 --2- 172.21.15.114:0/1616268195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a806e810 0x7fb6a806f1f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 --2- 172.21.15.114:0/1616268195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6a80cf300 0x7fb6a806ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 -- 172.21.15.114:0/1616268195 >> 172.21.15.114:0/1616268195 conn(0x7fb6a80b18f0 msgr2=0x7fb6a80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 -- 172.21.15.114:0/1616268195 shutdown_connections 2024-09-16T07:29:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 -- 172.21.15.114:0/1616268195 wait complete. 2024-09-16T07:29:55.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 Processor -- start 2024-09-16T07:29:55.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 -- start start 2024-09-16T07:29:55.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.352+0000 7fb6acc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6a806e810 0x7fb6a80ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6a80cf300 0x7fb6a8158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a815ade0 0x7fb6a814ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a8168840 con 0x7fb6a815ade0 2024-09-16T07:29:55.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a81686c0 con 0x7fb6a80cf300 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a81689c0 con 0x7fb6a806e810 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a815ade0 0x7fb6a814ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a815ade0 0x7fb6a814ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37650/0 (socket says 172.21.15.114:37650) 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 -- 172.21.15.114:0/3132176159 learned_addr learned my addr 172.21.15.114:0/3132176159 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a5e00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6a806e810 0x7fb6a80ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb69fe00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6a80cf300 0x7fb6a8158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 -- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6a806e810 msgr2=0x7fb6a80ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6a806e810 0x7fb6a80ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 -- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6a80cf300 msgr2=0x7fb6a8158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6a80cf300 0x7fb6a8158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 -- 172.21.15.114:0/3132176159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a80af070 con 0x7fb6a815ade0 2024-09-16T07:29:55.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6a6800640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a815ade0 0x7fb6a814ddf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009bd0 tx=0x7fb6a0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb69e000640 1 -- 172.21.15.114:0/3132176159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00bb070 con 0x7fb6a815ade0 2024-09-16T07:29:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb69e000640 1 -- 172.21.15.114:0/3132176159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6a0004d40 con 0x7fb6a815ade0 2024-09-16T07:29:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a80aeab0 con 0x7fb6a815ade0 2024-09-16T07:29:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb69e000640 1 -- 172.21.15.114:0/3132176159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00b2040 con 0x7fb6a815ade0 2024-09-16T07:29:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a8158760 con 0x7fb6a815ade0 2024-09-16T07:29:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a8069410 con 0x7fb6a815ade0 2024-09-16T07:29:55.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.356+0000 7fb69e000640 1 -- 172.21.15.114:0/3132176159 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7fb6a00be070 con 0x7fb6a815ade0 2024-09-16T07:29:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.360+0000 7fb69e000640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb684073070 0x7fb684075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.360+0000 7fb69e000640 1 -- 172.21.15.114:0/3132176159 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb6a012dd80 con 0x7fb6a815ade0 2024-09-16T07:29:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.360+0000 7fb6a5e00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb684073070 0x7fb684075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.360+0000 7fb6a5e00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb684073070 0x7fb684075530 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6980098e0 tx=0x7fb698009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:55.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.364+0000 7fb69e000640 1 -- 172.21.15.114:0/3132176159 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb6a0016990 con 0x7fb6a815ade0 2024-09-16T07:29:55.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.540+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6a80b3350 con 0x7fb6a815ade0 2024-09-16T07:29:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.540+0000 7fb69e000640 1 -- 172.21.15.114:0/3132176159 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) ==== 80+0+0 (secure 0 0 0) 0x7fb6a00f8690 con 0x7fb6a815ade0 2024-09-16T07:29:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:29:55.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb684073070 msgr2=0x7fb684075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb684073070 0x7fb684075530 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb6980098e0 tx=0x7fb698009060 comp rx=0 tx=0).stop 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a815ade0 msgr2=0x7fb6a814ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a815ade0 0x7fb6a814ddf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009bd0 tx=0x7fb6a0009300 comp rx=0 tx=0).stop 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 shutdown_connections 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb684073070 0x7fb684075530 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6a815ade0 0x7fb6a814ddf0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6a80cf300 0x7fb6a8158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 --2- 172.21.15.114:0/3132176159 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6a806e810 0x7fb6a80ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 >> 172.21.15.114:0/3132176159 conn(0x7fb6a80b18f0 msgr2=0x7fb6a80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 shutdown_connections 2024-09-16T07:29:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.544+0000 7fb6acc00640 1 -- 172.21.15.114:0/3132176159 wait complete. 2024-09-16T07:29:55.565 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:29:55.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:55.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:29:55.592 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:29:55.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:55.592 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:29:55.646 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:55.646 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:55.656 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:29:55.656 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:29:55.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:29:55.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 -- 172.21.15.114:0/3470344899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900cfe80 msgr2=0x7f51900d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 --2- 172.21.15.114:0/3470344899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900cfe80 0x7f51900d0260 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5184009900 tx=0x7f518401c850 comp rx=0 tx=0).stop 2024-09-16T07:29:55.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 -- 172.21.15.114:0/3470344899 shutdown_connections 2024-09-16T07:29:55.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 --2- 172.21.15.114:0/3470344899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51900b2d00 0x7f519015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 --2- 172.21.15.114:0/3470344899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900cfe80 0x7f51900d0260 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 -- 172.21.15.114:0/3470344899 >> 172.21.15.114:0/3470344899 conn(0x7f51900d1e40 msgr2=0x7f51900d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 -- 172.21.15.114:0/3470344899 shutdown_connections 2024-09-16T07:29:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 -- 172.21.15.114:0/3470344899 wait complete. 2024-09-16T07:29:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 Processor -- start 2024-09-16T07:29:55.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.844+0000 7f5198600640 1 -- start start 2024-09-16T07:29:55.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900b2d00 0x7f51901565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51900cfe80 0x7f51901fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5190160400 0x7f519006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5190169550 con 0x7f51900b2d00 2024-09-16T07:29:55.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51901693d0 con 0x7f51900cfe80 2024-09-16T07:29:55.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f51901696d0 con 0x7f5190160400 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900b2d00 0x7f51901565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900b2d00 0x7f51901565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37664/0 (socket says 172.21.15.114:37664) 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 -- 172.21.15.114:0/2106105550 learned_addr learned my addr 172.21.15.114:0/2106105550 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5196600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5190160400 0x7f519006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195200640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51900cfe80 0x7f51901fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 -- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5190160400 msgr2=0x7f519006e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5190160400 0x7f519006e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 -- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51900cfe80 msgr2=0x7f51901fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51900cfe80 0x7f51901fbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 -- 172.21.15.114:0/2106105550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51900b4d10 con 0x7f51900b2d00 2024-09-16T07:29:55.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5195c00640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900b2d00 0x7f51901565f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5184009850 tx=0x7f51840a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f518d600640 1 -- 172.21.15.114:0/2106105550 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51840b2040 con 0x7f51900b2d00 2024-09-16T07:29:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f518d600640 1 -- 172.21.15.114:0/2106105550 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5184004380 con 0x7f51900b2d00 2024-09-16T07:29:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f518d600640 1 -- 172.21.15.114:0/2106105550 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51840052d0 con 0x7f51900b2d00 2024-09-16T07:29:55.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51900b4fd0 con 0x7f51900b2d00 2024-09-16T07:29:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51900b5590 con 0x7f51900b2d00 2024-09-16T07:29:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f519015fec0 con 0x7f51900b2d00 2024-09-16T07:29:55.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.848+0000 7f518d600640 1 -- 172.21.15.114:0/2106105550 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f5184005470 con 0x7f51900b2d00 2024-09-16T07:29:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.852+0000 7f518d600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5170073070 0x7f5170075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.852+0000 7f518d600640 1 -- 172.21.15.114:0/2106105550 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f518412d930 con 0x7f51900b2d00 2024-09-16T07:29:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.852+0000 7f5195200640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5170073070 0x7f5170075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:55.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.852+0000 7f5195200640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5170073070 0x7f5170075530 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f517c0058d0 tx=0x7f517c005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:55.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:55.856+0000 7f518d600640 1 -- 172.21.15.114:0/2106105550 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f51840164d0 con 0x7f51900b2d00 2024-09-16T07:29:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.032+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5190072810 con 0x7f51900b2d00 2024-09-16T07:29:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.032+0000 7f518d600640 1 -- 172.21.15.114:0/2106105550 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) ==== 80+0+0 (secure 0 0 0) 0x7f51840f8760 con 0x7f51900b2d00 2024-09-16T07:29:56.037 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:29:56.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5170073070 msgr2=0x7f5170075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5170073070 0x7f5170075530 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f517c0058d0 tx=0x7f517c005860 comp rx=0 tx=0).stop 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900b2d00 msgr2=0x7f51901565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900b2d00 0x7f51901565f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5184009850 tx=0x7f51840a5590 comp rx=0 tx=0).stop 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 shutdown_connections 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5170073070 0x7f5170075530 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5190160400 0x7f519006e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51900cfe80 0x7f51901fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 --2- 172.21.15.114:0/2106105550 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51900b2d00 0x7f51901565f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 >> 172.21.15.114:0/2106105550 conn(0x7f51900d1e40 msgr2=0x7f5190072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 shutdown_connections 2024-09-16T07:29:56.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.036+0000 7f5198600640 1 -- 172.21.15.114:0/2106105550 wait complete. 2024-09-16T07:29:56.059 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:29:56.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:56.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:29:56.088 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:29:56.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:29:56.088 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:29:56.141 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:56.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.280+0000 7f2c64000640 1 -- 172.21.15.114:0/333748933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c44004810 msgr2=0x7f2c44004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.280+0000 7f2c64000640 1 --2- 172.21.15.114:0/333748933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c44004810 0x7f2c44004c90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800c310 tx=0x7f2c4801cf60 comp rx=0 tx=0).stop 2024-09-16T07:29:56.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.280+0000 7f2c64000640 1 -- 172.21.15.114:0/333748933 shutdown_connections 2024-09-16T07:29:56.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.280+0000 7f2c64000640 1 --2- 172.21.15.114:0/333748933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c44004810 0x7f2c44004c90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.280+0000 7f2c64000640 1 -- 172.21.15.114:0/333748933 >> 172.21.15.114:0/333748933 conn(0x7f2c5c0b18f0 msgr2=0x7f2c5c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:56.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.280+0000 7f2c64000640 1 -- 172.21.15.114:0/333748933 shutdown_connections 2024-09-16T07:29:56.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.280+0000 7f2c64000640 1 -- 172.21.15.114:0/333748933 wait complete. 2024-09-16T07:29:56.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 Processor -- start 2024-09-16T07:29:56.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 -- start start 2024-09-16T07:29:56.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c44004810 0x7f2c5c09d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c1585a0 0x7f2c5c09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c5c152260 0x7f2c5c0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0cebf0 con 0x7f2c5c152260 2024-09-16T07:29:56.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0cea70 con 0x7f2c5c1585a0 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5c0ced70 con 0x7f2c44004810 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c5c152260 0x7f2c5c0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c5c152260 0x7f2c5c0aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37684/0 (socket says 172.21.15.114:37684) 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 -- 172.21.15.114:0/2687072544 learned_addr learned my addr 172.21.15.114:0/2687072544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c61600640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c44004810 0x7f2c5c09d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c60c00640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c1585a0 0x7f2c5c09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 -- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c44004810 msgr2=0x7f2c5c09d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c44004810 0x7f2c5c09d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 -- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c1585a0 msgr2=0x7f2c5c09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c1585a0 0x7f2c5c09aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 -- 172.21.15.114:0/2687072544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c158a30 con 0x7f2c5c152260 2024-09-16T07:29:56.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c62000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c5c152260 0x7f2c5c0aff40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0b37a0 tx=0x7f2c540019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c59600640 1 -- 172.21.15.114:0/2687072544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54011870 con 0x7f2c5c152260 2024-09-16T07:29:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c59600640 1 -- 172.21.15.114:0/2687072544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c54017070 con 0x7f2c5c152260 2024-09-16T07:29:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c152c50 con 0x7f2c5c152260 2024-09-16T07:29:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c59600640 1 -- 172.21.15.114:0/2687072544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54011dc0 con 0x7f2c5c152260 2024-09-16T07:29:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.284+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c153210 con 0x7f2c5c152260 2024-09-16T07:29:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.288+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c069410 con 0x7f2c5c152260 2024-09-16T07:29:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.288+0000 7f2c59600640 1 -- 172.21.15.114:0/2687072544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f2c5401c460 con 0x7f2c5c152260 2024-09-16T07:29:56.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.288+0000 7f2c59600640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2c3c0730a0 0x7f2c3c075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.288+0000 7f2c59600640 1 -- 172.21.15.114:0/2687072544 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2c54094940 con 0x7f2c5c152260 2024-09-16T07:29:56.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.288+0000 7f2c61600640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2c3c0730a0 0x7f2c3c075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.288+0000 7f2c61600640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2c3c0730a0 0x7f2c3c075560 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000ad40 tx=0x7f2c50010040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:56.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.292+0000 7f2c59600640 1 -- 172.21.15.114:0/2687072544 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2c5405f110 con 0x7f2c5c152260 2024-09-16T07:29:56.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c5c0cf2d0 con 0x7f2c5c152260 2024-09-16T07:29:56.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c59600640 1 -- 172.21.15.114:0/2687072544 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f2c54063b40 con 0x7f2c5c152260 2024-09-16T07:29:56.498 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:56.498 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:29:56.499 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:29:56.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2c3c0730a0 msgr2=0x7f2c3c075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2c3c0730a0 0x7f2c3c075560 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000ad40 tx=0x7f2c50010040 comp rx=0 tx=0).stop 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c5c152260 msgr2=0x7f2c5c0aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c5c152260 0x7f2c5c0aff40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0b37a0 tx=0x7f2c540019c0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 shutdown_connections 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2c3c0730a0 0x7f2c3c075560 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c5c152260 0x7f2c5c0aff40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c5c1585a0 0x7f2c5c09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 --2- 172.21.15.114:0/2687072544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c44004810 0x7f2c5c09d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 >> 172.21.15.114:0/2687072544 conn(0x7f2c5c0b18f0 msgr2=0x7f2c5c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 shutdown_connections 2024-09-16T07:29:56.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.496+0000 7f2c64000640 1 -- 172.21.15.114:0/2687072544 wait complete. 2024-09-16T07:29:56.519 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:29:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-09-16T07:29:56.681 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-16T07:29:56.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol63680 2024-09-16T07:29:56.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- 172.21.15.114:0/2678037216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b4bd0 msgr2=0x7ff7200b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 --2- 172.21.15.114:0/2678037216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b4bd0 0x7ff7200b2bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff708009900 tx=0x7ff70801c8e0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- 172.21.15.114:0/2678037216 shutdown_connections 2024-09-16T07:29:56.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 --2- 172.21.15.114:0/2678037216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b4bd0 0x7ff7200b2bf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- 172.21.15.114:0/2678037216 >> 172.21.15.114:0/2678037216 conn(0x7ff7200b18f0 msgr2=0x7ff7200b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:56.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- 172.21.15.114:0/2678037216 shutdown_connections 2024-09-16T07:29:56.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- 172.21.15.114:0/2678037216 wait complete. 2024-09-16T07:29:56.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 Processor -- start 2024-09-16T07:29:56.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- start start 2024-09-16T07:29:56.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b3130 0x7ff72014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7200b4bd0 0x7ff72014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72015b580 0x7ff72009c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff720169000 con 0x7ff7200b3130 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff720168e80 con 0x7ff7200b4bd0 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff727a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff720169180 con 0x7ff72015b580 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff725000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b3130 0x7ff72014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff725000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b3130 0x7ff72014e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37696/0 (socket says 172.21.15.114:37696) 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff725000640 1 -- 172.21.15.114:0/2435914873 learned_addr learned my addr 172.21.15.114:0/2435914873 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff717e00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7200b4bd0 0x7ff72014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.824+0000 7ff725a00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72015b580 0x7ff72009c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff725000640 1 -- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72015b580 msgr2=0x7ff72009c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff725000640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72015b580 0x7ff72009c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff725000640 1 -- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7200b4bd0 msgr2=0x7ff72014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff725000640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7200b4bd0 0x7ff72014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff725000640 1 -- 172.21.15.114:0/2435914873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72014ab10 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff725000640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b3130 0x7ff72014e890 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff71000b410 tx=0x7ff71000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff71d600640 1 -- 172.21.15.114:0/2435914873 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710015030 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff71d600640 1 -- 172.21.15.114:0/2435914873 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff710004020 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff71d600640 1 -- 172.21.15.114:0/2435914873 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710004470 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72014adf0 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72014b3b0 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7200b2bf0 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff71d600640 1 -- 172.21.15.114:0/2435914873 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7ff710018070 con 0x7ff7200b3130 2024-09-16T07:29:56.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff71d600640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff6fc073070 0x7ff6fc075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:56.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.828+0000 7ff71d600640 1 -- 172.21.15.114:0/2435914873 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff710093c70 con 0x7ff7200b3130 2024-09-16T07:29:56.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.832+0000 7ff717e00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff6fc073070 0x7ff6fc075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:56.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.832+0000 7ff717e00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff6fc073070 0x7ff6fc075530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af000 tx=0x7ff70801b120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:56.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:56.836+0000 7ff71d600640 1 -- 172.21.15.114:0/2435914873 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff71005e4e0 con 0x7ff7200b3130 2024-09-16T07:29:57.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.032+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol63680", "target": ["mon-mgr", ""]}) -- 0x7ff72006ad30 con 0x7ff6fc073070 2024-09-16T07:29:57.043 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:57.042+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:57.043 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:57.042+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:57.043 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:57.042+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:57.044 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:57.042+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:57.044 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:29:57.042+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:29:57.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.084+0000 7ff71d600640 1 -- 172.21.15.114:0/2435914873 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff72006ad30 con 0x7ff6fc073070 2024-09-16T07:29:57.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff6fc073070 msgr2=0x7ff6fc075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff6fc073070 0x7ff6fc075530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff7080af000 tx=0x7ff70801b120 comp rx=0 tx=0).stop 2024-09-16T07:29:57.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b3130 msgr2=0x7ff72014e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b3130 0x7ff72014e890 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff71000b410 tx=0x7ff71000b8d0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 shutdown_connections 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff6fc073070 0x7ff6fc075530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff72015b580 0x7ff72009c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7200b4bd0 0x7ff72014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 --2- 172.21.15.114:0/2435914873 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7200b3130 0x7ff72014e890 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 >> 172.21.15.114:0/2435914873 conn(0x7ff7200b18f0 msgr2=0x7ff720151780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 shutdown_connections 2024-09-16T07:29:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.088+0000 7ff727a00640 1 -- 172.21.15.114:0/2435914873 wait complete. 2024-09-16T07:29:57.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:57.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.248+0000 7f224ea00640 1 -- 172.21.15.114:0/2207085123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 msgr2=0x7f22480ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.248+0000 7f224ea00640 1 --2- 172.21.15.114:0/2207085123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480ae9b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2230009900 tx=0x7f223001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.248+0000 7f224ea00640 1 -- 172.21.15.114:0/2207085123 shutdown_connections 2024-09-16T07:29:57.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.248+0000 7f224ea00640 1 --2- 172.21.15.114:0/2207085123 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480ae9b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.248+0000 7f224ea00640 1 -- 172.21.15.114:0/2207085123 >> 172.21.15.114:0/2207085123 conn(0x7f22480d1dc0 msgr2=0x7f22480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:57.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.248+0000 7f224ea00640 1 -- 172.21.15.114:0/2207085123 shutdown_connections 2024-09-16T07:29:57.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.248+0000 7f224ea00640 1 -- 172.21.15.114:0/2207085123 wait complete. 2024-09-16T07:29:57.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 Processor -- start 2024-09-16T07:29:57.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 -- start start 2024-09-16T07:29:57.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22480cdb30 0x7f224814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224815bea0 0x7f22480c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f224816a840 con 0x7f22480ced80 2024-09-16T07:29:57.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f224816a6c0 con 0x7f22480cdb30 2024-09-16T07:29:57.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f224816a9c0 con 0x7f224815bea0 2024-09-16T07:29:57.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37710/0 (socket says 172.21.15.114:37710) 2024-09-16T07:29:57.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 -- 172.21.15.114:0/2452855196 learned_addr learned my addr 172.21.15.114:0/2452855196 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:57.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f2247e00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22480cdb30 0x7f224814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ca00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224815bea0 0x7f22480c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 -- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224815bea0 msgr2=0x7f22480c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224815bea0 0x7f22480c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 -- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22480cdb30 msgr2=0x7f224814f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22480cdb30 0x7f224814f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 -- 172.21.15.114:0/2452855196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2248154ce0 con 0x7f22480ced80 2024-09-16T07:29:57.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f223f400640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480c9940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f22300b0040 tx=0x7f22300040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:57.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f2244c00640 1 -- 172.21.15.114:0/2452855196 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300b2040 con 0x7f22480ced80 2024-09-16T07:29:57.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f2244c00640 1 -- 172.21.15.114:0/2452855196 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2230003600 con 0x7f22480ced80 2024-09-16T07:29:57.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f2244c00640 1 -- 172.21.15.114:0/2452855196 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230003a30 con 0x7f22480ced80 2024-09-16T07:29:57.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2248159c80 con 0x7f22480ced80 2024-09-16T07:29:57.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.252+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2248159f20 con 0x7f22480ced80 2024-09-16T07:29:57.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.256+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22480ce670 con 0x7f22480ced80 2024-09-16T07:29:57.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.256+0000 7f2244c00640 1 -- 172.21.15.114:0/2452855196 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7f22300bf060 con 0x7f22480ced80 2024-09-16T07:29:57.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.256+0000 7f2244c00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2224073070 0x7f2224075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.256+0000 7f2244c00640 1 -- 172.21.15.114:0/2452855196 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f223012dea0 con 0x7f22480ced80 2024-09-16T07:29:57.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.256+0000 7f2247e00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2224073070 0x7f2224075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.256+0000 7f2247e00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2224073070 0x7f2224075530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f223800b810 tx=0x7f2238008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:57.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.260+0000 7f2244c00640 1 -- 172.21.15.114:0/2452855196 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f22300164d0 con 0x7f22480ced80 2024-09-16T07:29:57.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.464+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22480725f0 con 0x7f22480ced80 2024-09-16T07:29:57.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.464+0000 7f2244c00640 1 -- 172.21.15.114:0/2452855196 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f22300f8d50 con 0x7f22480ced80 2024-09-16T07:29:57.469 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:57.469 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:29:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:29:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2224073070 msgr2=0x7f2224075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2224073070 0x7f2224075530 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f223800b810 tx=0x7f2238008040 comp rx=0 tx=0).stop 2024-09-16T07:29:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 msgr2=0x7f22480c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480c9940 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f22300b0040 tx=0x7f22300040c0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 shutdown_connections 2024-09-16T07:29:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2224073070 0x7f2224075530 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224815bea0 0x7f22480c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22480ced80 0x7f22480c9940 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 --2- 172.21.15.114:0/2452855196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22480cdb30 0x7f224814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 >> 172.21.15.114:0/2452855196 conn(0x7f22480d1dc0 msgr2=0x7f22480b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 shutdown_connections 2024-09-16T07:29:57.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.468+0000 7f224ea00640 1 -- 172.21.15.114:0/2452855196 wait complete. 2024-09-16T07:29:57.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:29:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":0.58799768699999999,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.970916422870214,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:29:57.651 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.970916422870214 }, "state": "open", "uptime": 0.587997687 } ] 2024-09-16T07:29:57.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:29:57.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.788+0000 7ff6afe00640 1 -- 172.21.15.114:0/4133660496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b3300 msgr2=0x7ff6a80cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.788+0000 7ff6afe00640 1 --2- 172.21.15.114:0/4133660496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b3300 0x7ff6a80cc550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009840 tx=0x7ff6a001c820 comp rx=0 tx=0).stop 2024-09-16T07:29:57.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- 172.21.15.114:0/4133660496 shutdown_connections 2024-09-16T07:29:57.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 --2- 172.21.15.114:0/4133660496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b3300 0x7ff6a80cc550 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 --2- 172.21.15.114:0/4133660496 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6a815b580 0x7ff6a815b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- 172.21.15.114:0/4133660496 >> 172.21.15.114:0/4133660496 conn(0x7ff6a80b18f0 msgr2=0x7ff6a80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- 172.21.15.114:0/4133660496 shutdown_connections 2024-09-16T07:29:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- 172.21.15.114:0/4133660496 wait complete. 2024-09-16T07:29:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 Processor -- start 2024-09-16T07:29:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- start start 2024-09-16T07:29:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6a80b3300 0x7ff6a814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b4bd0 0x7ff6a8142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a815b580 0x7ff6a8153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8167f50 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8167dd0 con 0x7ff6a815b580 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6afe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a81680d0 con 0x7ff6a80b3300 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b4bd0 0x7ff6a8142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b4bd0 0x7ff6a8142680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37728/0 (socket says 172.21.15.114:37728) 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 -- 172.21.15.114:0/1793740929 learned_addr learned my addr 172.21.15.114:0/1793740929 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6ad400640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6a80b3300 0x7ff6a814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6ade00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a815b580 0x7ff6a8153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 -- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6a80b3300 msgr2=0x7ff6a814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6a80b3300 0x7ff6a814ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 -- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a815b580 msgr2=0x7ff6a8153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a815b580 0x7ff6a8153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 -- 172.21.15.114:0/1793740929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a81533b0 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6ade00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a815b580 0x7ff6a8153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6aca00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b4bd0 0x7ff6a8142680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c480 tx=0x7ff69400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.792+0000 7ff6a5600640 1 -- 172.21.15.114:0/1793740929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694017070 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6a5600640 1 -- 172.21.15.114:0/1793740929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff694003600 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6a5600640 1 -- 172.21.15.114:0/1793740929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694003a50 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a8154360 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a8153620 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a80cc550 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6a5600640 1 -- 172.21.15.114:0/1793740929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 7) ==== 97233+0+0 (secure 0 0 0) 0x7ff69401a070 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6a5600640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff688073070 0x7ff688075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:29:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6a5600640 1 -- 172.21.15.114:0/1793740929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7ff6940936b0 con 0x7ff6a80b4bd0 2024-09-16T07:29:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.796+0000 7ff6ad400640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff688073070 0x7ff688075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:29:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.800+0000 7ff6ad400640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff688073070 0x7ff688075530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff69c005c50 tx=0x7ff69c005be0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:29:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:57.800+0000 7ff6a5600640 1 -- 172.21.15.114:0/1793740929 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff69405e620 con 0x7ff6a80b4bd0 2024-09-16T07:29:58.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6a81555d0 con 0x7ff6a80b4bd0 2024-09-16T07:29:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6a5600640 1 -- 172.21.15.114:0/1793740929 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7ff69405df20 con 0x7ff6a80b4bd0 2024-09-16T07:29:58.007 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:29:58.007 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:29:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:29:58.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff688073070 msgr2=0x7ff688075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:58.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff688073070 0x7ff688075530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff69c005c50 tx=0x7ff69c005be0 comp rx=0 tx=0).stop 2024-09-16T07:29:58.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b4bd0 msgr2=0x7ff6a8142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:29:58.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b4bd0 0x7ff6a8142680 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c480 tx=0x7ff69400c940 comp rx=0 tx=0).stop 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 shutdown_connections 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff688073070 0x7ff688075530 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6a815b580 0x7ff6a8153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6a80b4bd0 0x7ff6a8142680 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 --2- 172.21.15.114:0/1793740929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6a80b3300 0x7ff6a814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 >> 172.21.15.114:0/1793740929 conn(0x7ff6a80b18f0 msgr2=0x7ff6a80b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 shutdown_connections 2024-09-16T07:29:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:29:58.004+0000 7ff6afe00640 1 -- 172.21.15.114:0/1793740929 wait complete. 2024-09-16T07:29:58.029 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:29:58.187 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":1.123995415,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.943724092005105,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:29:58.188 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.943724092005105 }, "state": "open", "uptime": 1.123995415 } ] 2024-09-16T07:29:58.188 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:03.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.336+0000 7f4516c00640 1 -- 172.21.15.114:0/3544819838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 msgr2=0x7f45100d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.336+0000 7f4516c00640 1 --2- 172.21.15.114:0/3544819838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 0x7f45100d0c40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f451015b030 tx=0x7f44f801c8c0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.336+0000 7f4516c00640 1 -- 172.21.15.114:0/3544819838 shutdown_connections 2024-09-16T07:30:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.336+0000 7f4516c00640 1 --2- 172.21.15.114:0/3544819838 >> v2:172.21.15.149:3300/0 conn(0x7f45100d1180 0x7f45100b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.336+0000 7f4516c00640 1 --2- 172.21.15.114:0/3544819838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 0x7f45100d0c40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.336+0000 7f4516c00640 1 -- 172.21.15.114:0/3544819838 >> 172.21.15.114:0/3544819838 conn(0x7f451006dd30 msgr2=0x7f451006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 -- 172.21.15.114:0/3544819838 shutdown_connections 2024-09-16T07:30:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 -- 172.21.15.114:0/3544819838 wait complete. 2024-09-16T07:30:03.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 Processor -- start 2024-09-16T07:30:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 -- start start 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100d1180 0x7f45101606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f451015a7e0 0x7f45101497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 0x7f45100b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4510167e40 con 0x7f451015abc0 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4510167cc0 con 0x7f45100d1180 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4516c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4510167fc0 con 0x7f451015a7e0 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f450fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100d1180 0x7f45101606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4514c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 0x7f45100b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f450fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100d1180 0x7f45101606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:43750/0 (socket says 172.21.15.114:43750) 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f450fe00640 1 -- 172.21.15.114:0/3229121657 learned_addr learned my addr 172.21.15.114:0/3229121657 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:03.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4507400640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f451015a7e0 0x7f45101497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4514c00640 1 -- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f451015a7e0 msgr2=0x7f45101497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4514c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f451015a7e0 0x7f45101497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4514c00640 1 -- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100d1180 msgr2=0x7f45101606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4514c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100d1180 0x7f45101606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4514c00640 1 -- 172.21.15.114:0/3229121657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451015f930 con 0x7f451015abc0 2024-09-16T07:30:03.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.340+0000 7f4514c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 0x7f45100b2a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f450800be20 tx=0x7f450800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f450cc00640 1 -- 172.21.15.114:0/3229121657 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508019070 con 0x7f451015abc0 2024-09-16T07:30:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f450cc00640 1 -- 172.21.15.114:0/3229121657 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4508014440 con 0x7f451015abc0 2024-09-16T07:30:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f450cc00640 1 -- 172.21.15.114:0/3229121657 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508014890 con 0x7f451015abc0 2024-09-16T07:30:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451015fc10 con 0x7f451015abc0 2024-09-16T07:30:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45100b2f80 con 0x7f451015abc0 2024-09-16T07:30:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45100b48f0 con 0x7f451015abc0 2024-09-16T07:30:03.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f450cc00640 1 -- 172.21.15.114:0/3229121657 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7f450801c070 con 0x7f451015abc0 2024-09-16T07:30:03.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f450cc00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44ec073100 0x7f44ec0755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:03.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.344+0000 7f450cc00640 1 -- 172.21.15.114:0/3229121657 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4508094150 con 0x7f451015abc0 2024-09-16T07:30:03.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.348+0000 7f450fe00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44ec073100 0x7f44ec0755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:03.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.348+0000 7f450fe00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44ec073100 0x7f44ec0755c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4500001960 tx=0x7f4500009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:03.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.348+0000 7f450cc00640 1 -- 172.21.15.114:0/3229121657 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f450805e930 con 0x7f451015abc0 2024-09-16T07:30:03.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.552+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4510164fb0 con 0x7f451015abc0 2024-09-16T07:30:03.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.552+0000 7f450cc00640 1 -- 172.21.15.114:0/3229121657 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f4508063360 con 0x7f451015abc0 2024-09-16T07:30:03.555 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:03.555 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:03.556 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44ec073100 msgr2=0x7f44ec0755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44ec073100 0x7f44ec0755c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4500001960 tx=0x7f4500009040 comp rx=0 tx=0).stop 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 msgr2=0x7f45100b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 0x7f45100b2a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f450800be20 tx=0x7f450800bf10 comp rx=0 tx=0).stop 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 shutdown_connections 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44ec073100 0x7f44ec0755c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f451015abc0 0x7f45100b2a40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f451015a7e0 0x7f45101497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 --2- 172.21.15.114:0/3229121657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45100d1180 0x7f45101606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:03.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 >> 172.21.15.114:0/3229121657 conn(0x7f451006dd30 msgr2=0x7f45100affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:03.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 shutdown_connections 2024-09-16T07:30:03.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:03.556+0000 7f4516c00640 1 -- 172.21.15.114:0/3229121657 wait complete. 2024-09-16T07:30:03.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:03.736 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":6.6720382300000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.664229266264034,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:03.737 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.664229266264034 }, "state": "open", "uptime": 6.67203823 } ] 2024-09-16T07:30:03.737 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:08.740 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 -- 172.21.15.114:0/1492235583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c06e7a0 msgr2=0x7f6a9c0ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1492235583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c06e7a0 0x7f6a9c0ce2e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009c80 tx=0x7f6a9401cd70 comp rx=0 tx=0).stop 2024-09-16T07:30:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 -- 172.21.15.114:0/1492235583 shutdown_connections 2024-09-16T07:30:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1492235583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c06e7a0 0x7f6a9c0ce2e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1492235583 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a9c0cf1d0 0x7f6a9c160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 -- 172.21.15.114:0/1492235583 >> 172.21.15.114:0/1492235583 conn(0x7f6a9c0b18f0 msgr2=0x7f6a9c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 -- 172.21.15.114:0/1492235583 shutdown_connections 2024-09-16T07:30:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.888+0000 7f6aa3400640 1 -- 172.21.15.114:0/1492235583 wait complete. 2024-09-16T07:30:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 Processor -- start 2024-09-16T07:30:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 -- start start 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c06e7a0 0x7f6a9c09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a9c0cf1d0 0x7f6a9c1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c15f9a0 0x7f6a9c0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c169200 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c169080 con 0x7f6a9c06e7a0 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c169380 con 0x7f6a9c0cf1d0 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c15f9a0 0x7f6a9c0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c15f9a0 0x7f6a9c0b42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52346/0 (socket says 172.21.15.114:52346) 2024-09-16T07:30:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 -- 172.21.15.114:0/1515225029 learned_addr learned my addr 172.21.15.114:0/1515225029 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa0a00640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c06e7a0 0x7f6a9c09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6a9be00640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a9c0cf1d0 0x7f6a9c1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 -- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a9c0cf1d0 msgr2=0x7f6a9c1486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a9c0cf1d0 0x7f6a9c1486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 -- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c06e7a0 msgr2=0x7f6a9c09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c06e7a0 0x7f6a9c09aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 -- 172.21.15.114:0/1515225029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c1f7c80 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa1400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c15f9a0 0x7f6a9c0b42e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009bd0 tx=0x7f6a940092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6a98c00640 1 -- 172.21.15.114:0/1515225029 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a940bb070 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6a98c00640 1 -- 172.21.15.114:0/1515225029 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a94004d40 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6a98c00640 1 -- 172.21.15.114:0/1515225029 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a940b2040 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9c1f7f60 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.892+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9c1f8520 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.896+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9c069410 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.896+0000 7f6a98c00640 1 -- 172.21.15.114:0/1515225029 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7f6a940ad850 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.896+0000 7f6a98c00640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a7c073100 0x7f6a7c0755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:08.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.896+0000 7f6a98c00640 1 -- 172.21.15.114:0/1515225029 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f6a9412e0e0 con 0x7f6a9c15f9a0 2024-09-16T07:30:08.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.896+0000 7f6aa0a00640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a7c073100 0x7f6a7c0755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:08.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.896+0000 7f6aa0a00640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a7c073100 0x7f6a7c0755c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:08.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:08.900+0000 7f6a98c00640 1 -- 172.21.15.114:0/1515225029 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6a94016990 con 0x7f6a9c15f9a0 2024-09-16T07:30:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a9c0ce2e0 con 0x7f6a9c15f9a0 2024-09-16T07:30:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6a98c00640 1 -- 172.21.15.114:0/1515225029 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f6a940f8860 con 0x7f6a9c15f9a0 2024-09-16T07:30:09.107 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:09.107 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a7c073100 msgr2=0x7f6a7c0755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a7c073100 0x7f6a7c0755c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).stop 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c15f9a0 msgr2=0x7f6a9c0b42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c15f9a0 0x7f6a9c0b42e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009bd0 tx=0x7f6a940092c0 comp rx=0 tx=0).stop 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 shutdown_connections 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6a7c073100 0x7f6a7c0755c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a9c15f9a0 0x7f6a9c0b42e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a9c0cf1d0 0x7f6a9c1486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 --2- 172.21.15.114:0/1515225029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a9c06e7a0 0x7f6a9c09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 >> 172.21.15.114:0/1515225029 conn(0x7f6a9c0b18f0 msgr2=0x7f6a9c1657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 shutdown_connections 2024-09-16T07:30:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:09.104+0000 7f6aa3400640 1 -- 172.21.15.114:0/1515225029 wait complete. 2024-09-16T07:30:09.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:09.286 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":12.223986761000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.388101326036296,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:09.287 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.388101326036296 }, "state": "open", "uptime": 12.223986761 } ] 2024-09-16T07:30:09.287 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:14.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:14.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.436+0000 7f915ee00640 1 -- 172.21.15.114:0/3160074871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915815bee0 msgr2=0x7f91580cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:14.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.436+0000 7f915ee00640 1 --2- 172.21.15.114:0/3160074871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915815bee0 0x7f91580cc330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9158069920 tx=0x7f914801f0b0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.436+0000 7f915ee00640 1 -- 172.21.15.114:0/3160074871 shutdown_connections 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.436+0000 7f915ee00640 1 --2- 172.21.15.114:0/3160074871 >> v2:172.21.15.149:3300/0 conn(0x7f915806ee20 0x7f915806f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.436+0000 7f915ee00640 1 --2- 172.21.15.114:0/3160074871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915815bee0 0x7f91580cc330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.436+0000 7f915ee00640 1 -- 172.21.15.114:0/3160074871 >> 172.21.15.114:0/3160074871 conn(0x7f91580b18f0 msgr2=0x7f91580b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 -- 172.21.15.114:0/3160074871 shutdown_connections 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 -- 172.21.15.114:0/3160074871 wait complete. 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 Processor -- start 2024-09-16T07:30:14.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 -- start start 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915806ee20 0x7f915815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91580cf400 0x7f915815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f915815bee0 0x7f91581f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f91580cd100 con 0x7f915806ee20 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91580ccf80 con 0x7f91580cf400 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f915806f7d0 con 0x7f915815bee0 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915806ee20 0x7f915815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:14.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915806ee20 0x7f915815f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54836/0 (socket says 172.21.15.114:54836) 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 -- 172.21.15.114:0/2247939633 learned_addr learned my addr 172.21.15.114:0/2247939633 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f914f400640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91580cf400 0x7f915815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ce00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f915815bee0 0x7f91581f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 -- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f915815bee0 msgr2=0x7f91581f8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f915815bee0 0x7f91581f8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 -- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91580cf400 msgr2=0x7f915815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91580cf400 0x7f915815cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 -- 172.21.15.114:0/2247939633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915815d700 con 0x7f915806ee20 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9157e00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915806ee20 0x7f915815f080 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f914801d760 tx=0x7f9148005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9154c00640 1 -- 172.21.15.114:0/2247939633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91480b5040 con 0x7f915806ee20 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9154c00640 1 -- 172.21.15.114:0/2247939633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9148005320 con 0x7f915806ee20 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915815d9e0 con 0x7f915806ee20 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.440+0000 7f9154c00640 1 -- 172.21.15.114:0/2247939633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91480046d0 con 0x7f915806ee20 2024-09-16T07:30:14.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.444+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915815dfa0 con 0x7f915806ee20 2024-09-16T07:30:14.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.444+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9158069410 con 0x7f915806ee20 2024-09-16T07:30:14.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.444+0000 7f9154c00640 1 -- 172.21.15.114:0/2247939633 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7f91480c1060 con 0x7f915806ee20 2024-09-16T07:30:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.444+0000 7f9154c00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9134073100 0x7f91340755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.444+0000 7f9154c00640 1 -- 172.21.15.114:0/2247939633 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f9148130ef0 con 0x7f915806ee20 2024-09-16T07:30:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.444+0000 7f914f400640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9134073100 0x7f91340755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:14.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.448+0000 7f914f400640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9134073100 0x7f91340755c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91581f9360 tx=0x7f9140009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:14.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.448+0000 7f9154c00640 1 -- 172.21.15.114:0/2247939633 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9148018c10 con 0x7f915806ee20 2024-09-16T07:30:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.648+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f915806fcf0 con 0x7f915806ee20 2024-09-16T07:30:14.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f9154c00640 1 -- 172.21.15.114:0/2247939633 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f91480fbb70 con 0x7f915806ee20 2024-09-16T07:30:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:14.653 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:14.654 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9134073100 msgr2=0x7f91340755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9134073100 0x7f91340755c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f91581f9360 tx=0x7f9140009040 comp rx=0 tx=0).stop 2024-09-16T07:30:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915806ee20 msgr2=0x7f915815f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915806ee20 0x7f915815f080 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f914801d760 tx=0x7f9148005780 comp rx=0 tx=0).stop 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 shutdown_connections 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9134073100 0x7f91340755c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f915815bee0 0x7f91581f8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91580cf400 0x7f915815cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 --2- 172.21.15.114:0/2247939633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f915806ee20 0x7f915815f080 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 >> 172.21.15.114:0/2247939633 conn(0x7f91580b18f0 msgr2=0x7f9158160390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 shutdown_connections 2024-09-16T07:30:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:14.652+0000 7f915ee00640 1 -- 172.21.15.114:0/2247939633 wait complete. 2024-09-16T07:30:14.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:14.834 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":17.771935375999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.115688002791195,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:14.835 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.115688002791195 }, "state": "open", "uptime": 17.771935376 } ] 2024-09-16T07:30:14.835 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:17.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:30:17.674 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:30:19.836 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 -- 172.21.15.114:0/1517092918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5c0004810 msgr2=0x7fa5c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 --2- 172.21.15.114:0/1517092918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5c0004810 0x7fa5c0004c90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40016f0 tx=0x7fa5c401c540 comp rx=0 tx=0).stop 2024-09-16T07:30:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 -- 172.21.15.114:0/1517092918 shutdown_connections 2024-09-16T07:30:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 --2- 172.21.15.114:0/1517092918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5c0004810 0x7fa5c0004c90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:19.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 -- 172.21.15.114:0/1517092918 >> 172.21.15.114:0/1517092918 conn(0x7fa5dc06dd30 msgr2=0x7fa5dc06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:19.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 -- 172.21.15.114:0/1517092918 shutdown_connections 2024-09-16T07:30:19.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 -- 172.21.15.114:0/1517092918 wait complete. 2024-09-16T07:30:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 Processor -- start 2024-09-16T07:30:19.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.988+0000 7fa5e3600640 1 -- start start 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5c0004810 0x7fa5dc1fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0b0870 0x7fa5dc140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc158210 0x7fa5dc158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc15ffb0 con 0x7fa5dc0b0870 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc0b03a0 con 0x7fa5dc158210 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa5dc160130 con 0x7fa5c0004810 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0b0870 0x7fa5dc140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0b0870 0x7fa5dc140740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54866/0 (socket says 172.21.15.114:54866) 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 -- 172.21.15.114:0/3374901972 learned_addr learned my addr 172.21.15.114:0/3374901972 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e0c00640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5c0004810 0x7fa5dc1fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e1600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc158210 0x7fa5dc158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 -- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5c0004810 msgr2=0x7fa5dc1fc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:19.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5c0004810 0x7fa5dc1fc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 -- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc158210 msgr2=0x7fa5dc158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc158210 0x7fa5dc158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 -- 172.21.15.114:0/3374901972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc0b18f0 con 0x7fa5dc0b0870 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e1600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc158210 0x7fa5dc158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d3e00640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0b0870 0x7fa5dc140740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4000c10 tx=0x7fa5c4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d9600640 1 -- 172.21.15.114:0/3374901972 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40a6020 con 0x7fa5dc0b0870 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d9600640 1 -- 172.21.15.114:0/3374901972 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5c4006500 con 0x7fa5dc0b0870 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc0b1050 con 0x7fa5dc0b0870 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5d9600640 1 -- 172.21.15.114:0/3374901972 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003df0 con 0x7fa5dc0b0870 2024-09-16T07:30:19.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc0b1610 con 0x7fa5dc0b0870 2024-09-16T07:30:19.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.992+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc160690 con 0x7fa5dc0b0870 2024-09-16T07:30:19.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.996+0000 7fa5d9600640 1 -- 172.21.15.114:0/3374901972 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7fa5c40bd020 con 0x7fa5dc0b0870 2024-09-16T07:30:20.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.996+0000 7fa5d9600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa5b8073100 0x7fa5b80755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:20.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.996+0000 7fa5d9600640 1 -- 172.21.15.114:0/3374901972 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fa5c412e5b0 con 0x7fa5dc0b0870 2024-09-16T07:30:20.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.996+0000 7fa5e0c00640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa5b8073100 0x7fa5b80755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:20.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:19.996+0000 7fa5e0c00640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa5b8073100 0x7fa5b80755c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc001250 tx=0x7fa5cc001120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:20.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.000+0000 7fa5d9600640 1 -- 172.21.15.114:0/3374901972 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa5dc074390 con 0x7fa5dc0b0870 2024-09-16T07:30:20.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5dc0b5620 con 0x7fa5dc0b0870 2024-09-16T07:30:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5d9600640 1 -- 172.21.15.114:0/3374901972 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7fa5c412ce20 con 0x7fa5dc0b0870 2024-09-16T07:30:20.207 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:20.207 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:20.207 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa5b8073100 msgr2=0x7fa5b80755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa5b8073100 0x7fa5b80755c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc001250 tx=0x7fa5cc001120 comp rx=0 tx=0).stop 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0b0870 msgr2=0x7fa5dc140740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0b0870 0x7fa5dc140740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4000c10 tx=0x7fa5c4003c00 comp rx=0 tx=0).stop 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 shutdown_connections 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa5b8073100 0x7fa5b80755c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5dc158210 0x7fa5dc158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc0b0870 0x7fa5dc140740 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:20.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 --2- 172.21.15.114:0/3374901972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5c0004810 0x7fa5dc1fc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:20.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 >> 172.21.15.114:0/3374901972 conn(0x7fa5dc06dd30 msgr2=0x7fa5dc0b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:20.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 shutdown_connections 2024-09-16T07:30:20.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:20.204+0000 7fa5e3600640 1 -- 172.21.15.114:0/3374901972 wait complete. 2024-09-16T07:30:20.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:20.389 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":23.327883946,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.846358995937845,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:20.389 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.846358995937845 }, "state": "open", "uptime": 23.327883946 } ] 2024-09-16T07:30:20.389 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:25.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.540+0000 7f149b400640 1 -- 172.21.15.114:0/4136602784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 msgr2=0x7f149415dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:25.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 --2- 172.21.15.114:0/4136602784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f149415dae0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1484009c80 tx=0x7f148401cc80 comp rx=0 tx=0).stop 2024-09-16T07:30:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- 172.21.15.114:0/4136602784 shutdown_connections 2024-09-16T07:30:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 --2- 172.21.15.114:0/4136602784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f149415dae0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- 172.21.15.114:0/4136602784 >> 172.21.15.114:0/4136602784 conn(0x7f14940b18f0 msgr2=0x7f14940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- 172.21.15.114:0/4136602784 shutdown_connections 2024-09-16T07:30:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- 172.21.15.114:0/4136602784 wait complete. 2024-09-16T07:30:25.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 Processor -- start 2024-09-16T07:30:25.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- start start 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f1494149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14940acd40 0x7f149414c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14940cd100 0x7f149414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f14941692c0 con 0x7f149406f8b0 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1494169140 con 0x7f14940cd100 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f149b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1494169440 con 0x7f14940acd40 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f1494149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f1494149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41222/0 (socket says 172.21.15.114:41222) 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 -- 172.21.15.114:0/2904147070 learned_addr learned my addr 172.21.15.114:0/2904147070 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1499400640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14940cd100 0x7f149414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:25.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f148be00640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14940acd40 0x7f149414c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 -- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14940acd40 msgr2=0x7f149414c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14940acd40 0x7f149414c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 -- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14940cd100 msgr2=0x7f149414c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14940cd100 0x7f149414c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 -- 172.21.15.114:0/2904147070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149414ac10 con 0x7f149406f8b0 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1498a00640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f1494149680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f148401c6f0 tx=0x7f1484009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.544+0000 7f1491600640 1 -- 172.21.15.114:0/2904147070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14840b2040 con 0x7f149406f8b0 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f1491600640 1 -- 172.21.15.114:0/2904147070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1484004d40 con 0x7f149406f8b0 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149414aef0 con 0x7f149406f8b0 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f1491600640 1 -- 172.21.15.114:0/2904147070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14840042a0 con 0x7f149406f8b0 2024-09-16T07:30:25.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1494149bc0 con 0x7f149406f8b0 2024-09-16T07:30:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1494069410 con 0x7f149406f8b0 2024-09-16T07:30:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f1491600640 1 -- 172.21.15.114:0/2904147070 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7f14840bd060 con 0x7f149406f8b0 2024-09-16T07:30:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f1491600640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1470073100 0x7f14700755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f1491600640 1 -- 172.21.15.114:0/2904147070 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f148412e1c0 con 0x7f149406f8b0 2024-09-16T07:30:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.548+0000 7f148be00640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1470073100 0x7f14700755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.552+0000 7f148be00640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1470073100 0x7f14700755c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f14941520d0 tx=0x7f147c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:25.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.552+0000 7f1491600640 1 -- 172.21.15.114:0/2904147070 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1484016990 con 0x7f149406f8b0 2024-09-16T07:30:25.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.756+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f149415dae0 con 0x7f149406f8b0 2024-09-16T07:30:25.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.756+0000 7f1491600640 1 -- 172.21.15.114:0/2904147070 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f14840f8f50 con 0x7f149406f8b0 2024-09-16T07:30:25.760 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:25.760 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:25.761 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1470073100 msgr2=0x7f14700755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1470073100 0x7f14700755c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f14941520d0 tx=0x7f147c009040 comp rx=0 tx=0).stop 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 msgr2=0x7f1494149680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f1494149680 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f148401c6f0 tx=0x7f1484009370 comp rx=0 tx=0).stop 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 shutdown_connections 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1470073100 0x7f14700755c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14940cd100 0x7f149414c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14940acd40 0x7f149414c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 --2- 172.21.15.114:0/2904147070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f149406f8b0 0x7f1494149680 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:25.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 >> 172.21.15.114:0/2904147070 conn(0x7f14940b18f0 msgr2=0x7f1494073200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 shutdown_connections 2024-09-16T07:30:25.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:25.760+0000 7f149b400640 1 -- 172.21.15.114:0/2904147070 wait complete. 2024-09-16T07:30:25.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:25.940 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":28.879832586999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.580655461629416,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:25.941 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.580655461629416 }, "state": "open", "uptime": 28.879832587 } ] 2024-09-16T07:30:25.941 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:30.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.092+0000 7fba48c00640 1 -- 172.21.15.114:0/3028553253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba28003c20 msgr2=0x7fba28004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.092+0000 7fba48c00640 1 --2- 172.21.15.114:0/3028553253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba28003c20 0x7fba28004020 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba34001860 tx=0x7fba3401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:30:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.092+0000 7fba43e00640 1 -- 172.21.15.114:0/3028553253 reap_dead start 2024-09-16T07:30:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.092+0000 7fba48c00640 1 -- 172.21.15.114:0/3028553253 shutdown_connections 2024-09-16T07:30:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.092+0000 7fba48c00640 1 -- 172.21.15.114:0/3028553253 >> 172.21.15.114:0/3028553253 conn(0x7fba4409aa10 msgr2=0x7fba4409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.092+0000 7fba48c00640 1 -- 172.21.15.114:0/3028553253 shutdown_connections 2024-09-16T07:30:31.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.092+0000 7fba48c00640 1 -- 172.21.15.114:0/3028553253 wait complete. 2024-09-16T07:30:31.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 Processor -- start 2024-09-16T07:30:31.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 -- start start 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba28003c20 0x7fba4414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4414e770 0x7fba44071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba440b6ed0 0x7fba440b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fba44167f00 con 0x7fba4414e770 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba44167d80 con 0x7fba440b6ed0 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fba44168080 con 0x7fba28003c20 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4414e770 0x7fba44071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4414e770 0x7fba44071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41234/0 (socket says 172.21.15.114:41234) 2024-09-16T07:30:31.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 -- 172.21.15.114:0/491008668 learned_addr learned my addr 172.21.15.114:0/491008668 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba43e00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba440b6ed0 0x7fba440b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba43400640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba28003c20 0x7fba4414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 -- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba28003c20 msgr2=0x7fba4414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba28003c20 0x7fba4414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 -- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba440b6ed0 msgr2=0x7fba440b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba440b6ed0 0x7fba440b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 -- 172.21.15.114:0/491008668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba440c6bb0 con 0x7fba4414e770 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba43e00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba440b6ed0 0x7fba440b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:30:31.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba42a00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4414e770 0x7fba44071580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba3000e590 tx=0x7fba3000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba3b400640 1 -- 172.21.15.114:0/491008668 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30015070 con 0x7fba4414e770 2024-09-16T07:30:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba3b400640 1 -- 172.21.15.114:0/491008668 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba30010980 con 0x7fba4414e770 2024-09-16T07:30:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba3b400640 1 -- 172.21.15.114:0/491008668 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30010dd0 con 0x7fba4414e770 2024-09-16T07:30:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba440b7890 con 0x7fba4414e770 2024-09-16T07:30:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4414b140 con 0x7fba4414e770 2024-09-16T07:30:31.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.096+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba440b2590 con 0x7fba4414e770 2024-09-16T07:30:31.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.100+0000 7fba3b400640 1 -- 172.21.15.114:0/491008668 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7fba30018070 con 0x7fba4414e770 2024-09-16T07:30:31.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.100+0000 7fba3b400640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fba24073130 0x7fba240755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:31.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.100+0000 7fba3b400640 1 -- 172.21.15.114:0/491008668 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fba300948e0 con 0x7fba4414e770 2024-09-16T07:30:31.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.100+0000 7fba43400640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fba24073130 0x7fba240755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:31.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.100+0000 7fba43400640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fba24073130 0x7fba240755f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba34001830 tx=0x7fba34019720 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:31.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.104+0000 7fba3b400640 1 -- 172.21.15.114:0/491008668 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fba3005f550 con 0x7fba4414e770 2024-09-16T07:30:31.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.304+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba44070bb0 con 0x7fba4414e770 2024-09-16T07:30:31.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.304+0000 7fba3b400640 1 -- 172.21.15.114:0/491008668 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7fba3005ee50 con 0x7fba4414e770 2024-09-16T07:30:31.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:31.308 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:31.308 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fba24073130 msgr2=0x7fba240755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fba24073130 0x7fba240755f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba34001830 tx=0x7fba34019720 comp rx=0 tx=0).stop 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4414e770 msgr2=0x7fba44071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4414e770 0x7fba44071580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba3000e590 tx=0x7fba3000ea50 comp rx=0 tx=0).stop 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 shutdown_connections 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fba24073130 0x7fba240755f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba440b6ed0 0x7fba440b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba4414e770 0x7fba44071580 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 --2- 172.21.15.114:0/491008668 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba28003c20 0x7fba4414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 >> 172.21.15.114:0/491008668 conn(0x7fba4409aa10 msgr2=0x7fba4415c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:31.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 shutdown_connections 2024-09-16T07:30:31.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:31.308+0000 7fba48c00640 1 -- 172.21.15.114:0/491008668 wait complete. 2024-09-16T07:30:31.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:31.488 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":34.423781331999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.318714092809547,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:31.488 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.318714092809547 }, "state": "open", "uptime": 34.423781332 } ] 2024-09-16T07:30:31.488 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:36.489 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:36.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 -- 172.21.15.114:0/985884872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f439015bea0 msgr2=0x7f43900ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:36.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 --2- 172.21.15.114:0/985884872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f439015bea0 0x7f43900ce670 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4384009900 tx=0x7f438401c850 comp rx=0 tx=0).stop 2024-09-16T07:30:36.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 -- 172.21.15.114:0/985884872 shutdown_connections 2024-09-16T07:30:36.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 --2- 172.21.15.114:0/985884872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f439015bea0 0x7f43900ce670 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:36.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 -- 172.21.15.114:0/985884872 >> 172.21.15.114:0/985884872 conn(0x7f43900d1dc0 msgr2=0x7f43900d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:36.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 -- 172.21.15.114:0/985884872 shutdown_connections 2024-09-16T07:30:36.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 -- 172.21.15.114:0/985884872 wait complete. 2024-09-16T07:30:36.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 Processor -- start 2024-09-16T07:30:36.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.640+0000 7f4397c00640 1 -- start start 2024-09-16T07:30:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43900cdb30 0x7f43900c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43900d28e0 0x7f43901570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f439015bea0 0x7f43901f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f439016a930 con 0x7f43900cdb30 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f439016a7b0 con 0x7f43900d28e0 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f439016aab0 con 0x7f439015bea0 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43900cdb30 0x7f43900c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43900cdb30 0x7f43900c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55436/0 (socket says 172.21.15.114:55436) 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 -- 172.21.15.114:0/1715229272 learned_addr learned my addr 172.21.15.114:0/1715229272 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f438fe00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43900d28e0 0x7f43901570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395c00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f439015bea0 0x7f43901f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 -- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f439015bea0 msgr2=0x7f43901f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f439015bea0 0x7f43901f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 -- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43900d28e0 msgr2=0x7f43901570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43900d28e0 0x7f43901570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 -- 172.21.15.114:0/1715229272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901f7770 con 0x7f43900cdb30 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f438fe00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43900d28e0 0x7f43901570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4395200640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43900cdb30 0x7f43900c95f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4384009850 tx=0x7f43840a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f438cc00640 1 -- 172.21.15.114:0/1715229272 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43840ba020 con 0x7f43900cdb30 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f438cc00640 1 -- 172.21.15.114:0/1715229272 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4384004430 con 0x7f43900cdb30 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f438cc00640 1 -- 172.21.15.114:0/1715229272 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43840b2040 con 0x7f43900cdb30 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43900c9c80 con 0x7f43900cdb30 2024-09-16T07:30:36.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4390155590 con 0x7f43900cdb30 2024-09-16T07:30:36.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43900ce670 con 0x7f43900cdb30 2024-09-16T07:30:36.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.644+0000 7f438cc00640 1 -- 172.21.15.114:0/1715229272 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7f4384003860 con 0x7f43900cdb30 2024-09-16T07:30:36.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.648+0000 7f438cc00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4370073130 0x7f43700755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:36.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.648+0000 7f438cc00640 1 -- 172.21.15.114:0/1715229272 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f438412e5e0 con 0x7f43900cdb30 2024-09-16T07:30:36.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.648+0000 7f438fe00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4370073130 0x7f43700755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:36.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.648+0000 7f438fe00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4370073130 0x7f43700755f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f437c007fd0 tx=0x7f437c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:36.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.648+0000 7f438cc00640 1 -- 172.21.15.114:0/1715229272 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f43840c4060 con 0x7f43900cdb30 2024-09-16T07:30:36.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43900b01c0 con 0x7f43900cdb30 2024-09-16T07:30:36.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f438cc00640 1 -- 172.21.15.114:0/1715229272 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f43840164d0 con 0x7f43900cdb30 2024-09-16T07:30:36.854 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:36.854 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:36.855 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:36.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4370073130 msgr2=0x7f43700755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4370073130 0x7f43700755f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f437c007fd0 tx=0x7f437c009040 comp rx=0 tx=0).stop 2024-09-16T07:30:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43900cdb30 msgr2=0x7f43900c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43900cdb30 0x7f43900c95f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4384009850 tx=0x7f43840a5620 comp rx=0 tx=0).stop 2024-09-16T07:30:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 shutdown_connections 2024-09-16T07:30:36.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4370073130 0x7f43700755f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f439015bea0 0x7f43901f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43900d28e0 0x7f43901570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 --2- 172.21.15.114:0/1715229272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43900cdb30 0x7f43900c95f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 >> 172.21.15.114:0/1715229272 conn(0x7f43900d1dc0 msgr2=0x7f43900b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 shutdown_connections 2024-09-16T07:30:36.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:36.852+0000 7f4397c00640 1 -- 172.21.15.114:0/1715229272 wait complete. 2024-09-16T07:30:36.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:37.039 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":39.975730055,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.059735811406025,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:37.040 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.059735811406025 }, "state": "open", "uptime": 39.975730055 } ] 2024-09-16T07:30:37.040 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:42.041 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:42.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 -- 172.21.15.114:0/3968692729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabb8004810 msgr2=0x7fabb8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 --2- 172.21.15.114:0/3968692729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabb8004810 0x7fabb8004c90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009940 tx=0x7fabbc01c720 comp rx=0 tx=0).stop 2024-09-16T07:30:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabd8c00640 1 -- 172.21.15.114:0/3968692729 reap_dead start 2024-09-16T07:30:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 -- 172.21.15.114:0/3968692729 shutdown_connections 2024-09-16T07:30:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 -- 172.21.15.114:0/3968692729 >> 172.21.15.114:0/3968692729 conn(0x7fabd40d1da0 msgr2=0x7fabd40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 -- 172.21.15.114:0/3968692729 shutdown_connections 2024-09-16T07:30:42.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 -- 172.21.15.114:0/3968692729 wait complete. 2024-09-16T07:30:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 Processor -- start 2024-09-16T07:30:42.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.192+0000 7fabdac00640 1 -- start start 2024-09-16T07:30:42.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabd4152230 0x7fabd4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabd4156590 0x7fabd40b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd4071a90 0x7fabd4071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40cc8b0 con 0x7fabd4156590 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fabd40d2ad0 con 0x7fabd4071a90 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fabd40cca30 con 0x7fabd4152230 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabd4156590 0x7fabd40b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabd4156590 0x7fabd40b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55448/0 (socket says 172.21.15.114:55448) 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 -- 172.21.15.114:0/2457340016 learned_addr learned my addr 172.21.15.114:0/2457340016 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabd3e00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabd4152230 0x7fabd4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabd8c00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd4071a90 0x7fabd4071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 -- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabd4152230 msgr2=0x7fabd4153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabd4152230 0x7fabd4153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:42.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 -- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd4071a90 msgr2=0x7fabd4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:42.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd4071a90 0x7fabd4071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:42.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 -- 172.21.15.114:0/2457340016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd4156e60 con 0x7fabd4156590 2024-09-16T07:30:42.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabcbe00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabd4156590 0x7fabd40b2b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fabbc01cfc0 tx=0x7fabbc004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabd0c00640 1 -- 172.21.15.114:0/2457340016 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0ac070 con 0x7fabd4156590 2024-09-16T07:30:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabd0c00640 1 -- 172.21.15.114:0/2457340016 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabbc0a6800 con 0x7fabd4156590 2024-09-16T07:30:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd4156b80 con 0x7fabd4156590 2024-09-16T07:30:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabd0c00640 1 -- 172.21.15.114:0/2457340016 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc0a6c50 con 0x7fabd4156590 2024-09-16T07:30:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd4152d50 con 0x7fabd4156590 2024-09-16T07:30:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd40ccdf0 con 0x7fabd4156590 2024-09-16T07:30:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.196+0000 7fabd0c00640 1 -- 172.21.15.114:0/2457340016 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7fabbc0af070 con 0x7fabd4156590 2024-09-16T07:30:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.200+0000 7fabd0c00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fabb0073100 0x7fabb00755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.200+0000 7fabd0c00640 1 -- 172.21.15.114:0/2457340016 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fabbc12deb0 con 0x7fabd4156590 2024-09-16T07:30:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.200+0000 7fabd3e00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fabb0073100 0x7fabb00755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.200+0000 7fabd3e00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fabb0073100 0x7fabb00755c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fabc4003680 tx=0x7fabc400c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:42.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.204+0000 7fabd0c00640 1 -- 172.21.15.114:0/2457340016 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fabbc016430 con 0x7fabd4156590 2024-09-16T07:30:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.404+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabd4071660 con 0x7fabd4156590 2024-09-16T07:30:42.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.404+0000 7fabd0c00640 1 -- 172.21.15.114:0/2457340016 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7fabbc0f86f0 con 0x7fabd4156590 2024-09-16T07:30:42.409 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:42.409 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fabb0073100 msgr2=0x7fabb00755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fabb0073100 0x7fabb00755c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fabc4003680 tx=0x7fabc400c040 comp rx=0 tx=0).stop 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabd4156590 msgr2=0x7fabd40b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabd4156590 0x7fabd40b2b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fabbc01cfc0 tx=0x7fabbc004e20 comp rx=0 tx=0).stop 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 shutdown_connections 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fabb0073100 0x7fabb00755c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd4071a90 0x7fabd4071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fabd4156590 0x7fabd40b2b50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:42.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 --2- 172.21.15.114:0/2457340016 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fabd4152230 0x7fabd4153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:42.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 >> 172.21.15.114:0/2457340016 conn(0x7fabd40d1da0 msgr2=0x7fabd40b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:42.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 shutdown_connections 2024-09-16T07:30:42.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:42.408+0000 7fabdac00640 1 -- 172.21.15.114:0/2457340016 wait complete. 2024-09-16T07:30:42.431 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:42.591 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":45.527678803999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.804058414387189,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:42.592 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.80405841438719 }, "state": "open", "uptime": 45.527678804 } ] 2024-09-16T07:30:42.592 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:47.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:47.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:30:47.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:30:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- 172.21.15.114:0/3084618830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8980004810 msgr2=0x7f8980004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3084618830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8980004810 0x7f8980004c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f898800c2e0 tx=0x7f898801f6a0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- 172.21.15.114:0/3084618830 shutdown_connections 2024-09-16T07:30:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3084618830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8980004810 0x7f8980004c90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- 172.21.15.114:0/3084618830 >> 172.21.15.114:0/3084618830 conn(0x7f899c0d1dc0 msgr2=0x7f899c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- 172.21.15.114:0/3084618830 shutdown_connections 2024-09-16T07:30:47.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- 172.21.15.114:0/3084618830 wait complete. 2024-09-16T07:30:47.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 Processor -- start 2024-09-16T07:30:47.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- start start 2024-09-16T07:30:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8980004810 0x7f899c0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f899c15e750 0x7f899c152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c1f8180 0x7f899c1f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f899c15c490 con 0x7f899c1f8180 2024-09-16T07:30:47.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0d2af0 con 0x7f8980004810 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.764+0000 7f89a1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f899c0ce670 con 0x7f899c15e750 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f899c15e750 0x7f899c152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8980004810 0x7f899c0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8980004810 0x7f899c0afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:57028/0 (socket says 172.21.15.114:57028) 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f899c15e750 0x7f899c152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:40466/0 (socket says 172.21.15.114:40466) 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 -- 172.21.15.114:0/3916478800 learned_addr learned my addr 172.21.15.114:0/3916478800 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899b400640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c1f8180 0x7f899c1f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 -- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f899c15e750 msgr2=0x7f899c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f899c15e750 0x7f899c152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 -- 172.21.15.114:0/3916478800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c1f8180 msgr2=0x7f899c1f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c1f8180 0x7f899c1f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 -- 172.21.15.114:0/3916478800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c15f480 con 0x7f8980004810 2024-09-16T07:30:47.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899a000640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f899c15e750 0x7f899c152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:30:47.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f899aa00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8980004810 0x7f899c0afc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f898c004d70 tx=0x7f898c001640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:47.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f8992a00640 1 -- 172.21.15.114:0/3916478800 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c001d50 con 0x7f8980004810 2024-09-16T07:30:47.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c15ebe0 con 0x7f8980004810 2024-09-16T07:30:47.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f8992a00640 1 -- 172.21.15.114:0/3916478800 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f898c016070 con 0x7f8980004810 2024-09-16T07:30:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f8992a00640 1 -- 172.21.15.114:0/3916478800 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c010b00 con 0x7f8980004810 2024-09-16T07:30:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c15f1a0 con 0x7f8980004810 2024-09-16T07:30:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c0cc9d0 con 0x7f8980004810 2024-09-16T07:30:47.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.768+0000 7f8992a00640 1 -- 172.21.15.114:0/3916478800 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7f898c010ca0 con 0x7f8980004810 2024-09-16T07:30:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.772+0000 7f8992a00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f897c073100 0x7f897c0755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:47.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.772+0000 7f8992a00640 1 -- 172.21.15.114:0/3916478800 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f898c094a60 con 0x7f8980004810 2024-09-16T07:30:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.772+0000 7f899a000640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f897c073100 0x7f897c0755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:47.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.772+0000 7f899a000640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f897c073100 0x7f897c0755c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89880b0000 tx=0x7f898801c4e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:47.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.776+0000 7f8992a00640 1 -- 172.21.15.114:0/3916478800 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f898c05f120 con 0x7f8980004810 2024-09-16T07:30:47.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.980+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f899c06dd30 con 0x7f8980004810 2024-09-16T07:30:47.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f8992a00640 1 -- 172.21.15.114:0/3916478800 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f898c063b50 con 0x7f8980004810 2024-09-16T07:30:47.986 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:47.986 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:47.986 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f897c073100 msgr2=0x7f897c0755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f897c073100 0x7f897c0755c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89880b0000 tx=0x7f898801c4e0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8980004810 msgr2=0x7f899c0afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8980004810 0x7f899c0afc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f898c004d70 tx=0x7f898c001640 comp rx=0 tx=0).stop 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 shutdown_connections 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f897c073100 0x7f897c0755c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f899c1f8180 0x7f899c1f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f899c15e750 0x7f899c152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 --2- 172.21.15.114:0/3916478800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8980004810 0x7f899c0afc90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:47.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 >> 172.21.15.114:0/3916478800 conn(0x7f899c0d1dc0 msgr2=0x7f899c0b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 shutdown_connections 2024-09-16T07:30:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:47.984+0000 7f89a1c00640 1 -- 172.21.15.114:0/3916478800 wait complete. 2024-09-16T07:30:48.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:48.165 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":51.103627367999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.550555695837105,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:48.166 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.550555695837105 }, "state": "open", "uptime": 51.103627368 } ] 2024-09-16T07:30:48.166 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:53.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.320+0000 7fe719800640 1 -- 172.21.15.114:0/4062745043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 msgr2=0x7fe6f8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.320+0000 7fe719800640 1 --2- 172.21.15.114:0/4062745043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 0x7fe6f8003e30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c2e0 tx=0x7fe70401cfc0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.320+0000 7fe713400640 1 -- 172.21.15.114:0/4062745043 reap_dead start 2024-09-16T07:30:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- 172.21.15.114:0/4062745043 shutdown_connections 2024-09-16T07:30:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- 172.21.15.114:0/4062745043 >> 172.21.15.114:0/4062745043 conn(0x7fe7140d3fe0 msgr2=0x7fe7140d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- 172.21.15.114:0/4062745043 shutdown_connections 2024-09-16T07:30:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- 172.21.15.114:0/4062745043 wait complete. 2024-09-16T07:30:53.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 Processor -- start 2024-09-16T07:30:53.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- start start 2024-09-16T07:30:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 0x7fe7140ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7140cdcb0 0x7fe71415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7141fc5c0 0x7fe7141600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe714169380 con 0x7fe6f8003a10 2024-09-16T07:30:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe714169200 con 0x7fe7140cdcb0 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe719800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe714169500 con 0x7fe7141fc5c0 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 0x7fe7140ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 0x7fe7140ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51702/0 (socket says 172.21.15.114:51702) 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 -- 172.21.15.114:0/4129722450 learned_addr learned my addr 172.21.15.114:0/4129722450 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe70be00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7140cdcb0 0x7fe71415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe713400640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7141fc5c0 0x7fe7141600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 -- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7141fc5c0 msgr2=0x7fe7141600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7141fc5c0 0x7fe7141600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 -- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7140cdcb0 msgr2=0x7fe71415a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7140cdcb0 0x7fe71415a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 -- 172.21.15.114:0/4129722450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7140ce450 con 0x7fe6f8003a10 2024-09-16T07:30:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe70be00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7140cdcb0 0x7fe71415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:30:53.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.324+0000 7fe712a00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 0x7fe7140ca950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe70401ca80 tx=0x7fe704001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:53.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe70aa00640 1 -- 172.21.15.114:0/4129722450 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704006090 con 0x7fe6f8003a10 2024-09-16T07:30:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe70aa00640 1 -- 172.21.15.114:0/4129722450 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe704006250 con 0x7fe6f8003a10 2024-09-16T07:30:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe70aa00640 1 -- 172.21.15.114:0/4129722450 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704003600 con 0x7fe6f8003a10 2024-09-16T07:30:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7140ce170 con 0x7fe6f8003a10 2024-09-16T07:30:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7141fbdc0 con 0x7fe6f8003a10 2024-09-16T07:30:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7140b7f00 con 0x7fe6f8003a10 2024-09-16T07:30:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe70aa00640 1 -- 172.21.15.114:0/4129722450 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7fe7040037a0 con 0x7fe6f8003a10 2024-09-16T07:30:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe70aa00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe6f0073130 0x7fe6f00755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:53.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe70aa00640 1 -- 172.21.15.114:0/4129722450 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fe70412e190 con 0x7fe6f8003a10 2024-09-16T07:30:53.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.328+0000 7fe70be00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe6f0073130 0x7fe6f00755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:53.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.332+0000 7fe70be00640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe6f0073130 0x7fe6f00755f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe71415c720 tx=0x7fe6fc0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:53.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.332+0000 7fe70aa00640 1 -- 172.21.15.114:0/4129722450 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe704016d70 con 0x7fe6f8003a10 2024-09-16T07:30:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.536+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7140d07d0 con 0x7fe6f8003a10 2024-09-16T07:30:53.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.536+0000 7fe70aa00640 1 -- 172.21.15.114:0/4129722450 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7fe7040f8e90 con 0x7fe6f8003a10 2024-09-16T07:30:53.536 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:53.536 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:53.536 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe6f0073130 msgr2=0x7fe6f00755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe6f0073130 0x7fe6f00755f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe71415c720 tx=0x7fe6fc0091e0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 msgr2=0x7fe7140ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 0x7fe7140ca950 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe70401ca80 tx=0x7fe704001d80 comp rx=0 tx=0).stop 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 shutdown_connections 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe6f0073130 0x7fe6f00755f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7141fc5c0 0x7fe7141600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7140cdcb0 0x7fe71415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 --2- 172.21.15.114:0/4129722450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6f8003a10 0x7fe7140ca950 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:53.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 >> 172.21.15.114:0/4129722450 conn(0x7fe7140d3fe0 msgr2=0x7fe71406eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:53.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 shutdown_connections 2024-09-16T07:30:53.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:53.540+0000 7fe719800640 1 -- 172.21.15.114:0/4129722450 wait complete. 2024-09-16T07:30:53.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:53.718 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":56.659576149000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.301189824027247,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:53.719 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.301189824027247 }, "state": "open", "uptime": 56.659576149 } ] 2024-09-16T07:30:53.719 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:30:58.720 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.872+0000 7ff697e00640 1 -- 172.21.15.114:0/3823844346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 msgr2=0x7ff69006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.872+0000 7ff697e00640 1 --2- 172.21.15.114:0/3823844346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff69006e7a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff6900b2680 tx=0x7ff67c01c890 comp rx=0 tx=0).stop 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.872+0000 7ff697e00640 1 -- 172.21.15.114:0/3823844346 shutdown_connections 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.872+0000 7ff697e00640 1 --2- 172.21.15.114:0/3823844346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff69006e7a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.872+0000 7ff697e00640 1 --2- 172.21.15.114:0/3823844346 >> v2:172.21.15.149:3300/0 conn(0x7ff6900b43d0 0x7ff6900b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.872+0000 7ff697e00640 1 -- 172.21.15.114:0/3823844346 >> 172.21.15.114:0/3823844346 conn(0x7ff6900b18f0 msgr2=0x7ff6900b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 -- 172.21.15.114:0/3823844346 shutdown_connections 2024-09-16T07:30:58.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 -- 172.21.15.114:0/3823844346 wait complete. 2024-09-16T07:30:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 Processor -- start 2024-09-16T07:30:58.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 -- start start 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6900b2bf0 0x7ff690144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6900b43d0 0x7ff690147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff690163430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901672c0 con 0x7ff6900cd100 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff69015b830 con 0x7ff6900b43d0 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff697e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff690167440 con 0x7ff6900b2bf0 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff690163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:58.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff690163430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55698/0 (socket says 172.21.15.114:55698) 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 -- 172.21.15.114:0/1704562702 learned_addr learned my addr 172.21.15.114:0/1704562702 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff694a00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6900b43d0 0x7ff690147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695400640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6900b2bf0 0x7ff690144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 -- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6900b2bf0 msgr2=0x7ff690144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6900b2bf0 0x7ff690144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 -- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6900b43d0 msgr2=0x7ff690147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6900b43d0 0x7ff690147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 -- 172.21.15.114:0/1704562702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff690147f00 con 0x7ff6900cd100 2024-09-16T07:30:58.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff695e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff690163430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c700 tx=0x7ff68800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.876+0000 7ff68d600640 1 -- 172.21.15.114:0/1704562702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688003b80 con 0x7ff6900cd100 2024-09-16T07:30:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff68d600640 1 -- 172.21.15.114:0/1704562702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff688003d20 con 0x7ff6900cd100 2024-09-16T07:30:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6901481e0 con 0x7ff6900cd100 2024-09-16T07:30:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff68d600640 1 -- 172.21.15.114:0/1704562702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68800aab0 con 0x7ff6900cd100 2024-09-16T07:30:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69009c870 con 0x7ff6900cd100 2024-09-16T07:30:58.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff690069410 con 0x7ff6900cd100 2024-09-16T07:30:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff68d600640 1 -- 172.21.15.114:0/1704562702 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 8) ==== 97284+0+0 (secure 0 0 0) 0x7ff68800ac50 con 0x7ff6900cd100 2024-09-16T07:30:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff68d600640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff670073100 0x7ff6700755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:30:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff68d600640 1 -- 172.21.15.114:0/1704562702 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7ff688094090 con 0x7ff6900cd100 2024-09-16T07:30:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.880+0000 7ff695400640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff670073100 0x7ff6700755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:30:58.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.884+0000 7ff695400640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff670073100 0x7ff6700755c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff68400ac50 tx=0x7ff684010040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:30:58.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:58.884+0000 7ff68d600640 1 -- 172.21.15.114:0/1704562702 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff68805e740 con 0x7ff6900cd100 2024-09-16T07:30:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.088+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6900b47b0 con 0x7ff6900cd100 2024-09-16T07:30:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.088+0000 7ff68d600640 1 -- 172.21.15.114:0/1704562702 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7ff688063170 con 0x7ff6900cd100 2024-09-16T07:30:59.089 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:30:59.089 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:30:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff670073100 msgr2=0x7ff6700755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff670073100 0x7ff6700755c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff68400ac50 tx=0x7ff684010040 comp rx=0 tx=0).stop 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 msgr2=0x7ff690163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff690163430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c700 tx=0x7ff68800cbc0 comp rx=0 tx=0).stop 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 shutdown_connections 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff670073100 0x7ff6700755c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6900cd100 0x7ff690163430 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6900b43d0 0x7ff690147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 --2- 172.21.15.114:0/1704562702 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6900b2bf0 0x7ff690144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 >> 172.21.15.114:0/1704562702 conn(0x7ff6900b18f0 msgr2=0x7ff6900af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:30:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 shutdown_connections 2024-09-16T07:30:59.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:30:59.092+0000 7ff697e00640 1 -- 172.21.15.114:0/1704562702 wait complete. 2024-09-16T07:30:59.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:30:59.269 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5389,"entity":{"name":{"type":"client","num":5389},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":193428402}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":62.211525000000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.0551806985805,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5389 172.21.15.149:0/193428402","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:30:59.269 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 193428402, "type": "any" }, "name": { "num": 5389, "type": "client" } }, "id": 5389, "inst": "client.5389 172.21.15.149:0/193428402", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.0551806985805 }, "state": "open", "uptime": 62.211525 } ] 2024-09-16T07:30:59.270 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-16T07:31:04.271 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 -- 172.21.15.114:0/1921581399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415be80 msgr2=0x7f0c440ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 --2- 172.21.15.114:0/1921581399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415be80 0x7f0c440ce4e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009900 tx=0x7f0c3401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 -- 172.21.15.114:0/1921581399 shutdown_connections 2024-09-16T07:31:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 --2- 172.21.15.114:0/1921581399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c440cd8c0 0x7f0c440cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 --2- 172.21.15.114:0/1921581399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c4415be80 0x7f0c440ce4e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 -- 172.21.15.114:0/1921581399 >> 172.21.15.114:0/1921581399 conn(0x7f0c440d1da0 msgr2=0x7f0c440d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 -- 172.21.15.114:0/1921581399 shutdown_connections 2024-09-16T07:31:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.424+0000 7f0c48c00640 1 -- 172.21.15.114:0/1921581399 wait complete. 2024-09-16T07:31:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 Processor -- start 2024-09-16T07:31:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 -- start start 2024-09-16T07:31:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c440cd8c0 0x7f0c440c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c440d28c0 0x7f0c441492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4415be80 0x7f0c4415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44168de0 con 0x7f0c440d28c0 2024-09-16T07:31:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44168c60 con 0x7f0c440cd8c0 2024-09-16T07:31:04.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0c44168f60 con 0x7f0c4415be80 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c440d28c0 0x7f0c441492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c440d28c0 0x7f0c441492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52658/0 (socket says 172.21.15.114:52658) 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 -- 172.21.15.114:0/3921606752 learned_addr learned my addr 172.21.15.114:0/3921606752 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c41e00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c440cd8c0 0x7f0c440c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c42800640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4415be80 0x7f0c4415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 -- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4415be80 msgr2=0x7f0c4415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4415be80 0x7f0c4415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 -- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c440cd8c0 msgr2=0x7f0c440c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c440cd8c0 0x7f0c440c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 -- 172.21.15.114:0/3921606752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440c99a0 con 0x7f0c440d28c0 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c42800640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4415be80 0x7f0c4415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c39400640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c440d28c0 0x7f0c441492c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00c400 tx=0x7f0c2c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c3aa00640 1 -- 172.21.15.114:0/3921606752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c017070 con 0x7f0c440d28c0 2024-09-16T07:31:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c3aa00640 1 -- 172.21.15.114:0/3921606752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c2c0053c0 con 0x7f0c440d28c0 2024-09-16T07:31:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c3aa00640 1 -- 172.21.15.114:0/3921606752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c003880 con 0x7f0c440d28c0 2024-09-16T07:31:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c440c9c40 con 0x7f0c440d28c0 2024-09-16T07:31:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.428+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c440ca1c0 con 0x7f0c440d28c0 2024-09-16T07:31:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.432+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c440b53f0 con 0x7f0c440d28c0 2024-09-16T07:31:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.432+0000 7f0c3aa00640 1 -- 172.21.15.114:0/3921606752 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f0c2c01a070 con 0x7f0c440d28c0 2024-09-16T07:31:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.432+0000 7f0c3aa00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0c20073070 0x7f0c20075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.432+0000 7f0c3aa00640 1 -- 172.21.15.114:0/3921606752 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f0c2c093690 con 0x7f0c440d28c0 2024-09-16T07:31:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.432+0000 7f0c41e00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0c20073070 0x7f0c20075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.432+0000 7f0c41e00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0c20073070 0x7f0c20075530 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c340af000 tx=0x7f0c3401b120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.436+0000 7f0c3aa00640 1 -- 172.21.15.114:0/3921606752 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0c440d0350 con 0x7f0c440d28c0 2024-09-16T07:31:04.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c44149800 con 0x7f0c440d28c0 2024-09-16T07:31:04.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c3aa00640 1 -- 172.21.15.114:0/3921606752 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f0c2c001130 con 0x7f0c440d28c0 2024-09-16T07:31:04.638 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:04.638 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:31:04.639 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:31:04.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0c20073070 msgr2=0x7f0c20075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:04.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0c20073070 0x7f0c20075530 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c340af000 tx=0x7f0c3401b120 comp rx=0 tx=0).stop 2024-09-16T07:31:04.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c440d28c0 msgr2=0x7f0c441492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:04.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c440d28c0 0x7f0c441492c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00c400 tx=0x7f0c2c00c8c0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 shutdown_connections 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0c20073070 0x7f0c20075530 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c4415be80 0x7f0c4415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c440d28c0 0x7f0c441492c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 --2- 172.21.15.114:0/3921606752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c440cd8c0 0x7f0c440c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 >> 172.21.15.114:0/3921606752 conn(0x7f0c440d1da0 msgr2=0x7f0c440719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 shutdown_connections 2024-09-16T07:31:04.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:04.640+0000 7f0c48c00640 1 -- 172.21.15.114:0/3921606752 wait complete. 2024-09-16T07:31:04.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:31:04.818 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-09-16T07:31:04.818 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-16T07:31:04.818 DEBUG:tasks.ceph_test_case:wait_until_true: success in 60s and 0 retries 2024-09-16T07:31:04.818 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:31:04.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:04.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:05.023 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:31:05.024 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:05.024 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:05.024 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:05.033 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:31:05.034 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:05.034 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:05.034 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:05.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:31:05.043 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:05.044 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:05.044 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:05.088 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:31:05.088 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:05.089 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:05.089 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:05.097 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:31:05.097 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 -- 172.21.15.114:0/586205933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c841613d0 msgr2=0x7f4c840d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 --2- 172.21.15.114:0/586205933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c841613d0 0x7f4c840d0540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009840 tx=0x7f4c7401c7f0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 -- 172.21.15.114:0/586205933 shutdown_connections 2024-09-16T07:31:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 --2- 172.21.15.114:0/586205933 >> v2:172.21.15.149:3300/0 conn(0x7f4c840d29e0 0x7f4c840b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 --2- 172.21.15.114:0/586205933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c841613d0 0x7f4c840d0540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 -- 172.21.15.114:0/586205933 >> 172.21.15.114:0/586205933 conn(0x7f4c840d3e00 msgr2=0x7f4c840d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:05.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 -- 172.21.15.114:0/586205933 shutdown_connections 2024-09-16T07:31:05.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 -- 172.21.15.114:0/586205933 wait complete. 2024-09-16T07:31:05.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.280+0000 7f4c83200640 1 Processor -- start 2024-09-16T07:31:05.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 -- start start 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840d29e0 0x7f4c840c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c841613d0 0x7f4c8414eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c841617b0 0x7f4c840b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8416acc0 con 0x7f4c841617b0 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4c840b81c0 con 0x7f4c841613d0 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8416ae40 con 0x7f4c840d29e0 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c81e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840d29e0 0x7f4c840c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c841617b0 0x7f4c840b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c81400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c841613d0 0x7f4c8414eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c841617b0 0x7f4c840b89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52672/0 (socket says 172.21.15.114:52672) 2024-09-16T07:31:05.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 -- 172.21.15.114:0/116470658 learned_addr learned my addr 172.21.15.114:0/116470658 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:05.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 -- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840d29e0 msgr2=0x7f4c840c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840d29e0 0x7f4c840c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 -- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c841613d0 msgr2=0x7f4c8414eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c841613d0 0x7f4c8414eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 -- 172.21.15.114:0/116470658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c840c8ef0 con 0x7f4c841617b0 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c82800640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c841617b0 0x7f4c840b89f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00eb20 tx=0x7f4c7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c7a000640 1 -- 172.21.15.114:0/116470658 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c004b30 con 0x7f4c841617b0 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c7a000640 1 -- 172.21.15.114:0/116470658 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c7c004cf0 con 0x7f4c841617b0 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c7a000640 1 -- 172.21.15.114:0/116470658 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c005280 con 0x7f4c841617b0 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c840c91b0 con 0x7f4c841617b0 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c840c9770 con 0x7f4c841617b0 2024-09-16T07:31:05.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.284+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c840c9970 con 0x7f4c841617b0 2024-09-16T07:31:05.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.288+0000 7f4c7a000640 1 -- 172.21.15.114:0/116470658 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f4c7c005420 con 0x7f4c841617b0 2024-09-16T07:31:05.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.288+0000 7f4c7a000640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4c64073070 0x7f4c64075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.288+0000 7f4c7a000640 1 -- 172.21.15.114:0/116470658 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4c7c094eb0 con 0x7f4c841617b0 2024-09-16T07:31:05.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.288+0000 7f4c81e00640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4c64073070 0x7f4c64075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.288+0000 7f4c81e00640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4c64073070 0x7f4c64075530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4c740af000 tx=0x7f4c7401b030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:05.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.292+0000 7f4c7a000640 1 -- 172.21.15.114:0/116470658 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4c840c9970 con 0x7f4c841617b0 2024-09-16T07:31:05.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.492+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c840b6f60 con 0x7f4c841617b0 2024-09-16T07:31:05.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.492+0000 7f4c7a000640 1 -- 172.21.15.114:0/116470658 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f4c7c05f640 con 0x7f4c841617b0 2024-09-16T07:31:05.492 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:05.492 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:31:05.492 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:31:05.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4c64073070 msgr2=0x7f4c64075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4c64073070 0x7f4c64075530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4c740af000 tx=0x7f4c7401b030 comp rx=0 tx=0).stop 2024-09-16T07:31:05.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c841617b0 msgr2=0x7f4c840b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c841617b0 0x7f4c840b89f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00eb20 tx=0x7f4c7c00c2d0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 shutdown_connections 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4c64073070 0x7f4c64075530 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c841617b0 0x7f4c840b89f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c841613d0 0x7f4c8414eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 --2- 172.21.15.114:0/116470658 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840d29e0 0x7f4c840c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 >> 172.21.15.114:0/116470658 conn(0x7f4c840d3e00 msgr2=0x7f4c8406dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 shutdown_connections 2024-09-16T07:31:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.496+0000 7f4c83200640 1 -- 172.21.15.114:0/116470658 wait complete. 2024-09-16T07:31:05.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:05.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.656+0000 7f517c400640 1 -- 172.21.15.114:0/1756045995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 msgr2=0x7f517406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.656+0000 7f517c400640 1 --2- 172.21.15.114:0/1756045995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f517406f3c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f51740cc770 tx=0x7f516c01cda0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.656+0000 7f517c400640 1 -- 172.21.15.114:0/1756045995 shutdown_connections 2024-09-16T07:31:05.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.656+0000 7f517c400640 1 --2- 172.21.15.114:0/1756045995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f517406f3c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.656+0000 7f517c400640 1 -- 172.21.15.114:0/1756045995 >> 172.21.15.114:0/1756045995 conn(0x7f51740b18f0 msgr2=0x7f51740b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:05.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.656+0000 7f517c400640 1 -- 172.21.15.114:0/1756045995 shutdown_connections 2024-09-16T07:31:05.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.656+0000 7f517c400640 1 -- 172.21.15.114:0/1756045995 wait complete. 2024-09-16T07:31:05.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 Processor -- start 2024-09-16T07:31:05.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 -- start start 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f51741fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51740cf300 0x7f5174073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517415ade0 0x7f5174145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5174169b20 con 0x7f517406e810 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51741699a0 con 0x7f517415ade0 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5174169ca0 con 0x7f51740cf300 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f51741fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f51741fa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52688/0 (socket says 172.21.15.114:52688) 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 -- 172.21.15.114:0/2856286541 learned_addr learned my addr 172.21.15.114:0/2856286541 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517a400640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517415ade0 0x7f5174145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179000640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51740cf300 0x7f5174073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 -- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51740cf300 msgr2=0x7f5174073fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51740cf300 0x7f5174073fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 -- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517415ade0 msgr2=0x7f5174145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517415ade0 0x7f5174145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 -- 172.21.15.114:0/2856286541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51741fa5c0 con 0x7f517406e810 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5179a00640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f51741fa080 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f516800c3c0 tx=0x7f516800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5171600640 1 -- 172.21.15.114:0/2856286541 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168017070 con 0x7f517406e810 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5171600640 1 -- 172.21.15.114:0/2856286541 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51680053c0 con 0x7f517406e810 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f5171600640 1 -- 172.21.15.114:0/2856286541 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168003860 con 0x7f517406e810 2024-09-16T07:31:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517409cf20 con 0x7f517406e810 2024-09-16T07:31:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.660+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f517409d4e0 con 0x7f517406e810 2024-09-16T07:31:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.664+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5174069410 con 0x7f517406e810 2024-09-16T07:31:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.664+0000 7f5171600640 1 -- 172.21.15.114:0/2856286541 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f516801a070 con 0x7f517406e810 2024-09-16T07:31:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.664+0000 7f5171600640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f51540730a0 0x7f5154075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.664+0000 7f5171600640 1 -- 172.21.15.114:0/2856286541 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f5168093540 con 0x7f517406e810 2024-09-16T07:31:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.664+0000 7f5179000640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f51540730a0 0x7f5154075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.664+0000 7f5179000640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f51540730a0 0x7f5154075560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f51740cf040 tx=0x7f5160009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:05.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.668+0000 7f5171600640 1 -- 172.21.15.114:0/2856286541 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f516805e3b0 con 0x7f517406e810 2024-09-16T07:31:05.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.872+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51740cebf0 con 0x7f517406e810 2024-09-16T07:31:05.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.872+0000 7f5171600640 1 -- 172.21.15.114:0/2856286541 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f516805dcb0 con 0x7f517406e810 2024-09-16T07:31:05.871 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:05.871 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:31:05.871 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f51540730a0 msgr2=0x7f5154075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f51540730a0 0x7f5154075560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f51740cf040 tx=0x7f5160009040 comp rx=0 tx=0).stop 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 msgr2=0x7f51741fa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f51741fa080 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f516800c3c0 tx=0x7f516800c880 comp rx=0 tx=0).stop 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 shutdown_connections 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f51540730a0 0x7f5154075560 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f517415ade0 0x7f5174145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f51740cf300 0x7f5174073fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 --2- 172.21.15.114:0/2856286541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f517406e810 0x7f51741fa080 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 >> 172.21.15.114:0/2856286541 conn(0x7f51740b18f0 msgr2=0x7f51740b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:05.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 shutdown_connections 2024-09-16T07:31:05.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:05.876+0000 7f517c400640 1 -- 172.21.15.114:0/2856286541 wait complete. 2024-09-16T07:31:05.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:06.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- 172.21.15.114:0/2186517806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 msgr2=0x7f4a34004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 --2- 172.21.15.114:0/2186517806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a34004c90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800c640 tx=0x7f4a3801d240 comp rx=0 tx=0).stop 2024-09-16T07:31:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- 172.21.15.114:0/2186517806 shutdown_connections 2024-09-16T07:31:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 --2- 172.21.15.114:0/2186517806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a34004c90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- 172.21.15.114:0/2186517806 >> 172.21.15.114:0/2186517806 conn(0x7f4a500b18f0 msgr2=0x7f4a500b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- 172.21.15.114:0/2186517806 shutdown_connections 2024-09-16T07:31:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- 172.21.15.114:0/2186517806 wait complete. 2024-09-16T07:31:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 Processor -- start 2024-09-16T07:31:06.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- start start 2024-09-16T07:31:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a500cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a501f88e0 0x7f4a500c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c180 0x7f4a5015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4a500ce810 con 0x7f4a34004810 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4a500ad0f0 con 0x7f4a501f88e0 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a56400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4a500ce990 con 0x7f4a5015c180 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a4f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a500cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a4f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a500cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52712/0 (socket says 172.21.15.114:52712) 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a4f400640 1 -- 172.21.15.114:0/4243746840 learned_addr learned my addr 172.21.15.114:0/4243746840 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a46a00640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a501f88e0 0x7f4a500c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.036+0000 7f4a4fe00640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c180 0x7f4a5015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a4f400640 1 -- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c180 msgr2=0x7f4a5015afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a4f400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c180 0x7f4a5015afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a4f400640 1 -- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a501f88e0 msgr2=0x7f4a500c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a4f400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a501f88e0 0x7f4a500c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a4f400640 1 -- 172.21.15.114:0/4243746840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a50150b80 con 0x7f4a34004810 2024-09-16T07:31:06.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a4fe00640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c180 0x7f4a5015afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:06.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a46a00640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a501f88e0 0x7f4a500c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:06.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a4f400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a500cb970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4a40003f10 tx=0x7f4a40001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a47e00640 1 -- 172.21.15.114:0/4243746840 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40015070 con 0x7f4a34004810 2024-09-16T07:31:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a47e00640 1 -- 172.21.15.114:0/4243746840 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a40011860 con 0x7f4a34004810 2024-09-16T07:31:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a47e00640 1 -- 172.21.15.114:0/4243746840 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40011cb0 con 0x7f4a34004810 2024-09-16T07:31:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a500c90f0 con 0x7f4a34004810 2024-09-16T07:31:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a500c96b0 con 0x7f4a34004810 2024-09-16T07:31:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a50069410 con 0x7f4a34004810 2024-09-16T07:31:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a47e00640 1 -- 172.21.15.114:0/4243746840 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f4a40018070 con 0x7f4a34004810 2024-09-16T07:31:06.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a47e00640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a2c073070 0x7f4a2c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.040+0000 7f4a47e00640 1 -- 172.21.15.114:0/4243746840 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4a40094fa0 con 0x7f4a34004810 2024-09-16T07:31:06.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.044+0000 7f4a46a00640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a2c073070 0x7f4a2c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.044+0000 7f4a46a00640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a2c073070 0x7f4a2c075530 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a380ab000 tx=0x7f4a380b1040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.044+0000 7f4a47e00640 1 -- 172.21.15.114:0/4243746840 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4a50150b80 con 0x7f4a34004810 2024-09-16T07:31:06.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a500ceef0 con 0x7f4a34004810 2024-09-16T07:31:06.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a47e00640 1 -- 172.21.15.114:0/4243746840 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16816 (secure 0 0 0) 0x7f4a4005fd80 con 0x7f4a34004810 2024-09-16T07:31:06.214 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:06.214 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:30:02.412952+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:37.945620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:39.216269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:06.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a2c073070 msgr2=0x7f4a2c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a2c073070 0x7f4a2c075530 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a380ab000 tx=0x7f4a380b1040 comp rx=0 tx=0).stop 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 msgr2=0x7f4a500cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a500cb970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4a40003f10 tx=0x7f4a40001720 comp rx=0 tx=0).stop 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 shutdown_connections 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4a2c073070 0x7f4a2c075530 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4a5015c180 0x7f4a5015afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4a501f88e0 0x7f4a500c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 --2- 172.21.15.114:0/4243746840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a34004810 0x7f4a500cb970 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 >> 172.21.15.114:0/4243746840 conn(0x7f4a500b18f0 msgr2=0x7f4a50072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 shutdown_connections 2024-09-16T07:31:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.216+0000 7f4a56400640 1 -- 172.21.15.114:0/4243746840 wait complete. 2024-09-16T07:31:06.236 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:31:06.236 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:06.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 -- 172.21.15.114:0/316787816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c0cd8c0 msgr2=0x7fc14c0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 --2- 172.21.15.114:0/316787816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c0cd8c0 0x7fc14c0cea20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc144009840 tx=0x7fc14401c820 comp rx=0 tx=0).stop 2024-09-16T07:31:06.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 -- 172.21.15.114:0/316787816 shutdown_connections 2024-09-16T07:31:06.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 --2- 172.21.15.114:0/316787816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c0cd8c0 0x7fc14c0cea20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 --2- 172.21.15.114:0/316787816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc14c15be80 0x7fc14c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 -- 172.21.15.114:0/316787816 >> 172.21.15.114:0/316787816 conn(0x7fc14c0d1da0 msgr2=0x7fc14c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 -- 172.21.15.114:0/316787816 shutdown_connections 2024-09-16T07:31:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 -- 172.21.15.114:0/316787816 wait complete. 2024-09-16T07:31:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 Processor -- start 2024-09-16T07:31:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.380+0000 7fc154600640 1 -- start start 2024-09-16T07:31:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc14c0cd8c0 0x7fc14c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c0d28c0 0x7fc14c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c15be80 0x7fc14c0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c168de0 con 0x7fc14c0d28c0 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c168c60 con 0x7fc14c15be80 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c168f60 con 0x7fc14c0cd8c0 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c0d28c0 0x7fc14c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c0d28c0 0x7fc14c156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52718/0 (socket says 172.21.15.114:52718) 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc14c0cd8c0 0x7fc14c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 -- 172.21.15.114:0/2716417051 learned_addr learned my addr 172.21.15.114:0/2716417051 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc152600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c15be80 0x7fc14c0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 -- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc14c0cd8c0 msgr2=0x7fc14c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc14c0cd8c0 0x7fc14c15af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 -- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c15be80 msgr2=0x7fc14c0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c15be80 0x7fc14c0b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 -- 172.21.15.114:0/2716417051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c0cafa0 con 0x7fc14c0d28c0 2024-09-16T07:31:06.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc151200640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c0d28c0 0x7fc14c156200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c500 tx=0x7fc13800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:06.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc149600640 1 -- 172.21.15.114:0/2716417051 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc138011790 con 0x7fc14c0d28c0 2024-09-16T07:31:06.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc149600640 1 -- 172.21.15.114:0/2716417051 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc138017070 con 0x7fc14c0d28c0 2024-09-16T07:31:06.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc149600640 1 -- 172.21.15.114:0/2716417051 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc138011ce0 con 0x7fc14c0d28c0 2024-09-16T07:31:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c0cb280 con 0x7fc14c0d28c0 2024-09-16T07:31:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c0cb840 con 0x7fc14c0d28c0 2024-09-16T07:31:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14c0b53f0 con 0x7fc14c0d28c0 2024-09-16T07:31:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.384+0000 7fc149600640 1 -- 172.21.15.114:0/2716417051 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fc13801c460 con 0x7fc14c0d28c0 2024-09-16T07:31:06.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.388+0000 7fc149600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc12c073070 0x7fc12c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.388+0000 7fc149600640 1 -- 172.21.15.114:0/2716417051 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fc138093f70 con 0x7fc14c0d28c0 2024-09-16T07:31:06.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.388+0000 7fc151c00640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc12c073070 0x7fc12c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.388+0000 7fc151c00640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc12c073070 0x7fc12c075530 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc140009ec0 tx=0x7fc140009500 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:06.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.392+0000 7fc149600640 1 -- 172.21.15.114:0/2716417051 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc14c0d0350 con 0x7fc14c0d28c0 2024-09-16T07:31:06.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.592+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc14c156740 con 0x7fc14c0d28c0 2024-09-16T07:31:06.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc149600640 1 -- 172.21.15.114:0/2716417051 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7fc13805e710 con 0x7fc14c0d28c0 2024-09-16T07:31:06.594 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:06.594 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:31:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:31:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc12c073070 msgr2=0x7fc12c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc12c073070 0x7fc12c075530 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc140009ec0 tx=0x7fc140009500 comp rx=0 tx=0).stop 2024-09-16T07:31:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c0d28c0 msgr2=0x7fc14c156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c0d28c0 0x7fc14c156200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc13800c500 tx=0x7fc13800c9c0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 shutdown_connections 2024-09-16T07:31:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc12c073070 0x7fc12c075530 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc14c15be80 0x7fc14c0b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc14c0d28c0 0x7fc14c156200 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 --2- 172.21.15.114:0/2716417051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc14c0cd8c0 0x7fc14c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 >> 172.21.15.114:0/2716417051 conn(0x7fc14c0d1da0 msgr2=0x7fc14c0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 shutdown_connections 2024-09-16T07:31:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.596+0000 7fc154600640 1 -- 172.21.15.114:0/2716417051 wait complete. 2024-09-16T07:31:06.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:06.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 -- 172.21.15.114:0/3736281323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e20071740 msgr2=0x7f9e200aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 --2- 172.21.15.114:0/3736281323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e20071740 0x7f9e200aeb00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009840 tx=0x7f9e0c01ef30 comp rx=0 tx=0).stop 2024-09-16T07:31:06.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 -- 172.21.15.114:0/3736281323 shutdown_connections 2024-09-16T07:31:06.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 --2- 172.21.15.114:0/3736281323 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e20071740 0x7f9e200aeb00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 --2- 172.21.15.114:0/3736281323 >> v2:172.21.15.149:3300/0 conn(0x7f9e20071360 0x7f9e2006f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 -- 172.21.15.114:0/3736281323 >> 172.21.15.114:0/3736281323 conn(0x7f9e2009aa10 msgr2=0x7f9e2009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 -- 172.21.15.114:0/3736281323 shutdown_connections 2024-09-16T07:31:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 -- 172.21.15.114:0/3736281323 wait complete. 2024-09-16T07:31:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 Processor -- start 2024-09-16T07:31:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.760+0000 7f9e25800640 1 -- start start 2024-09-16T07:31:06.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e20071360 0x7f9e201f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e20071740 0x7f9e201611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e200af040 0x7f9e201556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9e20071ce0 con 0x7f9e20071360 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e20071b60 con 0x7f9e20071740 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e200af4f0 con 0x7f9e200af040 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e20071360 0x7f9e201f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e20071360 0x7f9e201f86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52724/0 (socket says 172.21.15.114:52724) 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 -- 172.21.15.114:0/2836067385 learned_addr learned my addr 172.21.15.114:0/2836067385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 -- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e200af040 msgr2=0x7f9e201556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e200af040 0x7f9e201556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 -- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e20071740 msgr2=0x7f9e201611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e20071740 0x7f9e201611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 -- 172.21.15.114:0/2836067385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2015ebf0 con 0x7f9e20071360 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e1fe00640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e20071360 0x7f9e201f86f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000e940 tx=0x7f9e1000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e17e00640 1 -- 172.21.15.114:0/2836067385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000cd20 con 0x7f9e20071360 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e17e00640 1 -- 172.21.15.114:0/2836067385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e10005020 con 0x7f9e20071360 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e17e00640 1 -- 172.21.15.114:0/2836067385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10005450 con 0x7f9e20071360 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2015f190 con 0x7f9e20071360 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e201f7c10 con 0x7f9e20071360 2024-09-16T07:31:06.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e200aeb00 con 0x7f9e20071360 2024-09-16T07:31:06.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.764+0000 7f9e17e00640 1 -- 172.21.15.114:0/2836067385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f9e100047b0 con 0x7f9e20071360 2024-09-16T07:31:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.768+0000 7f9e17e00640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9e00073070 0x7f9e00075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.768+0000 7f9e17e00640 1 -- 172.21.15.114:0/2836067385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f9e10094dc0 con 0x7f9e20071360 2024-09-16T07:31:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.768+0000 7f9e1f400640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9e00073070 0x7f9e00075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.768+0000 7f9e1f400640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9e00073070 0x7f9e00075530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0b2000 tx=0x7f9e0c01bcd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.772+0000 7f9e17e00640 1 -- 172.21.15.114:0/2836067385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9e1005fc30 con 0x7f9e20071360 2024-09-16T07:31:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.972+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e2006df80 con 0x7f9e20071360 2024-09-16T07:31:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.972+0000 7f9e17e00640 1 -- 172.21.15.114:0/2836067385 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5232 (secure 0 0 0) 0x7f9e1005f530 con 0x7f9e20071360 2024-09-16T07:31:06.972 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:06.972 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"btime":"2024-09-16T07:29:54:373633+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:29:40.260879+0000","modified":"2024-09-16T07:29:43.287066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5307":{"gid":5307,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1997583151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1997583151},{"type":"v1","addr":"172.21.15.114:6835","nonce":1997583151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5307,"qdb_cluster":[5307]},"id":3}]} 2024-09-16T07:31:06.972 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9e00073070 msgr2=0x7f9e00075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9e00073070 0x7f9e00075530 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0b2000 tx=0x7f9e0c01bcd0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e20071360 msgr2=0x7f9e201f86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e20071360 0x7f9e201f86f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000e940 tx=0x7f9e1000ee00 comp rx=0 tx=0).stop 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 shutdown_connections 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9e00073070 0x7f9e00075530 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e200af040 0x7f9e201556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e20071740 0x7f9e201611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 --2- 172.21.15.114:0/2836067385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e20071360 0x7f9e201f86f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 >> 172.21.15.114:0/2836067385 conn(0x7f9e2009aa10 msgr2=0x7f9e200b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 shutdown_connections 2024-09-16T07:31:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:06.976+0000 7f9e25800640 1 -- 172.21.15.114:0/2836067385 wait complete. 2024-09-16T07:31:06.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:07.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 -- 172.21.15.114:0/2992919552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 msgr2=0x7fb08c0cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 --2- 172.21.15.114:0/2992919552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c0cc9d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb08c074010 tx=0x7fb08401cd80 comp rx=0 tx=0).stop 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 -- 172.21.15.114:0/2992919552 shutdown_connections 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 --2- 172.21.15.114:0/2992919552 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c0cc9d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 --2- 172.21.15.114:0/2992919552 >> v2:172.21.15.149:3300/0 conn(0x7fb08c0cdb30 0x7fb08c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 --2- 172.21.15.114:0/2992919552 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb08c15bea0 0x7fb08c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 -- 172.21.15.114:0/2992919552 >> 172.21.15.114:0/2992919552 conn(0x7fb08c0d1dc0 msgr2=0x7fb08c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 -- 172.21.15.114:0/2992919552 shutdown_connections 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 -- 172.21.15.114:0/2992919552 wait complete. 2024-09-16T07:31:07.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 Processor -- start 2024-09-16T07:31:07.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.136+0000 7fb092000640 1 -- start start 2024-09-16T07:31:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb08c0cdb30 0x7fb08c1fb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb08c15bea0 0x7fb08c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c0af1b0 con 0x7fb08c0d28e0 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c0af030 con 0x7fb08c15bea0 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb08c0af330 con 0x7fb08c0cdb30 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52748/0 (socket says 172.21.15.114:52748) 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 -- 172.21.15.114:0/3273621037 learned_addr learned my addr 172.21.15.114:0/3273621037 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb08be00640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb08c15bea0 0x7fb08c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb08b400640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb08c0cdb30 0x7fb08c1fb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 -- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb08c0cdb30 msgr2=0x7fb08c1fb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb08c0cdb30 0x7fb08c1fb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 -- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb08c15bea0 msgr2=0x7fb08c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb08c15bea0 0x7fb08c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 -- 172.21.15.114:0/3273621037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c166250 con 0x7fb08c0d28e0 2024-09-16T07:31:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb08be00640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb08c15bea0 0x7fb08c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083e00640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c152650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb07400d7a0 tx=0x7fb07400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083400640 1 -- 172.21.15.114:0/3273621037 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074017070 con 0x7fb08c0d28e0 2024-09-16T07:31:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083400640 1 -- 172.21.15.114:0/3273621037 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb074009d20 con 0x7fb08c0d28e0 2024-09-16T07:31:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083400640 1 -- 172.21.15.114:0/3273621037 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740106c0 con 0x7fb08c0d28e0 2024-09-16T07:31:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08c1664f0 con 0x7fb08c0d28e0 2024-09-16T07:31:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08c0b17a0 con 0x7fb08c0d28e0 2024-09-16T07:31:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08c0af8c0 con 0x7fb08c0d28e0 2024-09-16T07:31:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.140+0000 7fb083400640 1 -- 172.21.15.114:0/3273621037 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fb07401a070 con 0x7fb08c0d28e0 2024-09-16T07:31:07.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.144+0000 7fb083400640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb068073070 0x7fb068075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.144+0000 7fb083400640 1 -- 172.21.15.114:0/3273621037 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fb074094470 con 0x7fb08c0d28e0 2024-09-16T07:31:07.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.144+0000 7fb08b400640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb068073070 0x7fb068075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.144+0000 7fb08b400640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb068073070 0x7fb068075530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0058d0 tx=0x7fb07c005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:07.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.148+0000 7fb083400640 1 -- 172.21.15.114:0/3273621037 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb07405f270 con 0x7fb08c0d28e0 2024-09-16T07:31:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.316+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb08c15a0e0 con 0x7fb08c0d28e0 2024-09-16T07:31:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.316+0000 7fb083400640 1 -- 172.21.15.114:0/3273621037 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16816 (secure 0 0 0) 0x7fb07405eb70 con 0x7fb08c0d28e0 2024-09-16T07:31:07.315 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:07.316 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":46,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:30:02.412952+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:29:37.945620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-16T07:29:39.216269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb068073070 msgr2=0x7fb068075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb068073070 0x7fb068075530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0058d0 tx=0x7fb07c005860 comp rx=0 tx=0).stop 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 msgr2=0x7fb08c152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c152650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb07400d7a0 tx=0x7fb07400dc60 comp rx=0 tx=0).stop 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 shutdown_connections 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb068073070 0x7fb068075530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb08c15bea0 0x7fb08c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb08c0d28e0 0x7fb08c152650 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 --2- 172.21.15.114:0/3273621037 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb08c0cdb30 0x7fb08c1fb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 >> 172.21.15.114:0/3273621037 conn(0x7fb08c0d1dc0 msgr2=0x7fb08c0c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 shutdown_connections 2024-09-16T07:31:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.320+0000 7fb092000640 1 -- 172.21.15.114:0/3273621037 wait complete. 2024-09-16T07:31:07.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:31:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- 172.21.15.114:0/1938521211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 msgr2=0x7f06d40ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 --2- 172.21.15.114:0/1938521211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d40ceb20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f06d40d0a60 tx=0x7f06bc01c780 comp rx=0 tx=0).stop 2024-09-16T07:31:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- 172.21.15.114:0/1938521211 shutdown_connections 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 --2- 172.21.15.114:0/1938521211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d40ceb20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 --2- 172.21.15.114:0/1938521211 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d40cf4e0 0x7f06d40c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 --2- 172.21.15.114:0/1938521211 >> v2:172.21.15.149:3300/0 conn(0x7f06d415bd50 0x7f06d40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- 172.21.15.114:0/1938521211 >> 172.21.15.114:0/1938521211 conn(0x7f06d40d1ea0 msgr2=0x7f06d40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- 172.21.15.114:0/1938521211 shutdown_connections 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- 172.21.15.114:0/1938521211 wait complete. 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 Processor -- start 2024-09-16T07:31:07.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- start start 2024-09-16T07:31:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d40cf4e0 0x7f06d40ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d415bd50 0x7f06d40b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d41facb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40ccac0 con 0x7f06d415c130 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40cc940 con 0x7f06d40cf4e0 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f06d40ccc40 con 0x7f06d415bd50 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d41facb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d41facb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52754/0 (socket says 172.21.15.114:52754) 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 -- 172.21.15.114:0/553737731 learned_addr learned my addr 172.21.15.114:0/553737731 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d1e00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d40cf4e0 0x7f06d40ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 -- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d415bd50 msgr2=0x7f06d40b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06c9400640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d415bd50 0x7f06d40b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d415bd50 0x7f06d40b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 -- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d40cf4e0 msgr2=0x7f06d40ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d40cf4e0 0x7f06d40ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 -- 172.21.15.114:0/553737731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d40b50b0 con 0x7f06d415c130 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d1e00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d40cf4e0 0x7f06d40ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06c9400640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d415bd50 0x7f06d40b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.484+0000 7f06d2800640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d41facb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00ccb0 tx=0x7f06cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06caa00640 1 -- 172.21.15.114:0/553737731 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00f450 con 0x7f06d415c130 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06caa00640 1 -- 172.21.15.114:0/553737731 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06cc00f700 con 0x7f06d415c130 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06caa00640 1 -- 172.21.15.114:0/553737731 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00fb50 con 0x7f06d415c130 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d40b5390 con 0x7f06d415c130 2024-09-16T07:31:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d40b5950 con 0x7f06d415c130 2024-09-16T07:31:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d40c5dd0 con 0x7f06d415c130 2024-09-16T07:31:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06caa00640 1 -- 172.21.15.114:0/553737731 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f06cc00fcf0 con 0x7f06d415c130 2024-09-16T07:31:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06caa00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b0073070 0x7f06b0075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06caa00640 1 -- 172.21.15.114:0/553737731 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f06cc094db0 con 0x7f06d415c130 2024-09-16T07:31:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.488+0000 7f06d1e00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b0073070 0x7f06b0075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.492+0000 7f06d1e00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b0073070 0x7f06b0075530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06c4005fd0 tx=0x7f06c4005da0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:07.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.492+0000 7f06caa00640 1 -- 172.21.15.114:0/553737731 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f06cc014030 con 0x7f06d415c130 2024-09-16T07:31:07.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.700+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f06d406aba0 con 0x7f06d415c130 2024-09-16T07:31:07.698 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:31:07.700+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:31:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.700+0000 7f06caa00640 1 -- 172.21.15.114:0/553737731 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f06cc05f5e0 con 0x7f06d415c130 2024-09-16T07:31:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:31:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b0073070 msgr2=0x7f06b0075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b0073070 0x7f06b0075530 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06c4005fd0 tx=0x7f06c4005da0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 msgr2=0x7f06d41facb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d41facb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00ccb0 tx=0x7f06cc00a620 comp rx=0 tx=0).stop 2024-09-16T07:31:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 shutdown_connections 2024-09-16T07:31:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f06b0073070 0x7f06b0075530 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06d415c130 0x7f06d41facb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06d415bd50 0x7f06d40b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 --2- 172.21.15.114:0/553737731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06d40cf4e0 0x7f06d40ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 >> 172.21.15.114:0/553737731 conn(0x7f06d40d1ea0 msgr2=0x7f06d415a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 shutdown_connections 2024-09-16T07:31:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.704+0000 7f06d8a00640 1 -- 172.21.15.114:0/553737731 wait complete. 2024-09-16T07:31:07.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:31:07.768 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:31:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- 172.21.15.114:0/3313335756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815e730 msgr2=0x7f8c780d0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 --2- 172.21.15.114:0/3313335756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815e730 0x7f8c780d0740 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8c780cb590 tx=0x7f8c6401db30 comp rx=0 tx=0).stop 2024-09-16T07:31:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- 172.21.15.114:0/3313335756 shutdown_connections 2024-09-16T07:31:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 --2- 172.21.15.114:0/3313335756 >> v2:172.21.15.149:3300/0 conn(0x7f8c7815db20 0x7f8c7815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 --2- 172.21.15.114:0/3313335756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815e730 0x7f8c780d0740 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- 172.21.15.114:0/3313335756 >> 172.21.15.114:0/3313335756 conn(0x7f8c780cfc20 msgr2=0x7f8c780d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- 172.21.15.114:0/3313335756 shutdown_connections 2024-09-16T07:31:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- 172.21.15.114:0/3313335756 wait complete. 2024-09-16T07:31:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 Processor -- start 2024-09-16T07:31:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- start start 2024-09-16T07:31:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c78154640 0x7f8c78150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815db20 0x7f8c78147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c7815e730 0x7f8c78150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8c781670d0 con 0x7f8c7815db20 2024-09-16T07:31:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78167250 con 0x7f8c7815e730 2024-09-16T07:31:07.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c7d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c781673d0 con 0x7f8c78154640 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.876+0000 7f8c75400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815db20 0x7f8c78147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c76800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c7815e730 0x7f8c78150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815db20 0x7f8c78147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52800/0 (socket says 172.21.15.114:52800) 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 -- 172.21.15.114:0/2602776464 learned_addr learned my addr 172.21.15.114:0/2602776464 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75e00640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c78154640 0x7f8c78150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 -- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c78154640 msgr2=0x7f8c78150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c78154640 0x7f8c78150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 -- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c7815e730 msgr2=0x7f8c78150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c7815e730 0x7f8c78150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 -- 172.21.15.114:0/2602776464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c781fbdf0 con 0x7f8c7815db20 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c76800640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c7815e730 0x7f8c78150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:31:07.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c75400640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815db20 0x7f8c78147250 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8c640b1040 tx=0x7f8c64005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c6e000640 1 -- 172.21.15.114:0/2602776464 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640b3070 con 0x7f8c7815db20 2024-09-16T07:31:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c6e000640 1 -- 172.21.15.114:0/2602776464 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c64005550 con 0x7f8c7815db20 2024-09-16T07:31:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c781fc090 con 0x7f8c7815db20 2024-09-16T07:31:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c6e000640 1 -- 172.21.15.114:0/2602776464 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64004930 con 0x7f8c7815db20 2024-09-16T07:31:07.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7814faf0 con 0x7f8c7815db20 2024-09-16T07:31:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c7815df70 con 0x7f8c7815db20 2024-09-16T07:31:07.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.880+0000 7f8c6e000640 1 -- 172.21.15.114:0/2602776464 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f8c640be060 con 0x7f8c7815db20 2024-09-16T07:31:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.884+0000 7f8c6e000640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c58073070 0x7f8c58075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.884+0000 7f8c6e000640 1 -- 172.21.15.114:0/2602776464 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5853+0+0 (secure 0 0 0) 0x7f8c6412e3c0 con 0x7f8c7815db20 2024-09-16T07:31:07.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.884+0000 7f8c75e00640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c58073070 0x7f8c58075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:07.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.884+0000 7f8c75e00640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c58073070 0x7f8c58075530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c68001ee0 tx=0x7f8c68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:07.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:07.888+0000 7f8c6e000640 1 -- 172.21.15.114:0/2602776464 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8c640177e0 con 0x7f8c7815db20 2024-09-16T07:31:08.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.088+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8c781fc260 con 0x7f8c7815db20 2024-09-16T07:31:08.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.704+0000 7f8c6e000640 1 -- 172.21.15.114:0/2602776464 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7f8c640f91e0 con 0x7f8c7815db20 2024-09-16T07:31:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c58073070 msgr2=0x7f8c58075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c58073070 0x7f8c58075530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c68001ee0 tx=0x7f8c68009040 comp rx=0 tx=0).stop 2024-09-16T07:31:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815db20 msgr2=0x7f8c78147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815db20 0x7f8c78147250 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8c640b1040 tx=0x7f8c64005de0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 shutdown_connections 2024-09-16T07:31:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c58073070 0x7f8c58075530 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c7815e730 0x7f8c78150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7815db20 0x7f8c78147250 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 --2- 172.21.15.114:0/2602776464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c78154640 0x7f8c78150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 >> 172.21.15.114:0/2602776464 conn(0x7f8c780cfc20 msgr2=0x7f8c7815bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 shutdown_connections 2024-09-16T07:31:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.708+0000 7f8c7d200640 1 -- 172.21.15.114:0/2602776464 wait complete. 2024-09-16T07:31:08.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:31:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 -- 172.21.15.114:0/2106123006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c0d09f0 msgr2=0x7fb56c0d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 --2- 172.21.15.114:0/2106123006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c0d09f0 0x7fb56c0d28c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb558009870 tx=0x7fb55801c830 comp rx=0 tx=0).stop 2024-09-16T07:31:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 -- 172.21.15.114:0/2106123006 shutdown_connections 2024-09-16T07:31:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 --2- 172.21.15.114:0/2106123006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c0d09f0 0x7fb56c0d28c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 -- 172.21.15.114:0/2106123006 >> 172.21.15.114:0/2106123006 conn(0x7fb56c0d1da0 msgr2=0x7fb56c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:08.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 -- 172.21.15.114:0/2106123006 shutdown_connections 2024-09-16T07:31:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 -- 172.21.15.114:0/2106123006 wait complete. 2024-09-16T07:31:08.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.920+0000 7fb56be00640 1 Processor -- start 2024-09-16T07:31:08.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 -- start start 2024-09-16T07:31:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c0cff00 0x7fb56c14eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c15eff0 0x7fb56c1fac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb56c06f770 0x7fb56c06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c169f90 con 0x7fb56c0cff00 2024-09-16T07:31:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c169e10 con 0x7fb56c06f770 2024-09-16T07:31:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb56c16a110 con 0x7fb56c15eff0 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c0cff00 0x7fb56c14eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c0cff00 0x7fb56c14eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52814/0 (socket says 172.21.15.114:52814) 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 -- 172.21.15.114:0/2714818624 learned_addr learned my addr 172.21.15.114:0/2714818624 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56a000640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c15eff0 0x7fb56c1fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56b400640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb56c06f770 0x7fb56c06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 -- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c15eff0 msgr2=0x7fb56c1fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c15eff0 0x7fb56c1fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 -- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb56c06f770 msgr2=0x7fb56c06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb56c06f770 0x7fb56c06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 -- 172.21.15.114:0/2714818624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c1fb450 con 0x7fb56c0cff00 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56b400640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb56c06f770 0x7fb56c06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56aa00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c0cff00 0x7fb56c14eea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c3c0 tx=0x7fb55c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb562a00640 1 -- 172.21.15.114:0/2714818624 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c017070 con 0x7fb56c0cff00 2024-09-16T07:31:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb562a00640 1 -- 172.21.15.114:0/2714818624 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c0053c0 con 0x7fb56c0cff00 2024-09-16T07:31:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb562a00640 1 -- 172.21.15.114:0/2714818624 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c003860 con 0x7fb56c0cff00 2024-09-16T07:31:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c1fb730 con 0x7fb56c0cff00 2024-09-16T07:31:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c1fb140 con 0x7fb56c0cff00 2024-09-16T07:31:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.924+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c0d28c0 con 0x7fb56c0cff00 2024-09-16T07:31:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.928+0000 7fb562a00640 1 -- 172.21.15.114:0/2714818624 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fb55c01a070 con 0x7fb56c0cff00 2024-09-16T07:31:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.928+0000 7fb562a00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb54c0730a0 0x7fb54c075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.928+0000 7fb562a00640 1 -- 172.21.15.114:0/2714818624 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5853+0+0 (secure 0 0 0) 0x7fb55c0935b0 con 0x7fb56c0cff00 2024-09-16T07:31:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.928+0000 7fb56a000640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb54c0730a0 0x7fb54c075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.928+0000 7fb56a000640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb54c0730a0 0x7fb54c075560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5580af000 tx=0x7fb55801b070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:08.932+0000 7fb562a00640 1 -- 172.21.15.114:0/2714818624 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb55c05dd80 con 0x7fb56c0cff00 2024-09-16T07:31:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.100+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb56c155e90 con 0x7fb56c0cff00 2024-09-16T07:31:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb562a00640 1 -- 172.21.15.114:0/2714818624 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7fb55c0627b0 con 0x7fb56c0cff00 2024-09-16T07:31:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:31:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb54c0730a0 msgr2=0x7fb54c075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb54c0730a0 0x7fb54c075560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5580af000 tx=0x7fb55801b070 comp rx=0 tx=0).stop 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c0cff00 msgr2=0x7fb56c14eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c0cff00 0x7fb56c14eea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c3c0 tx=0x7fb55c00c880 comp rx=0 tx=0).stop 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 shutdown_connections 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb54c0730a0 0x7fb54c075560 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb56c06f770 0x7fb56c06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb56c15eff0 0x7fb56c1fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 --2- 172.21.15.114:0/2714818624 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c0cff00 0x7fb56c14eea0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.712+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 >> 172.21.15.114:0/2714818624 conn(0x7fb56c0d1da0 msgr2=0x7fb56c0709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.716+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 shutdown_connections 2024-09-16T07:31:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.716+0000 7fb56be00640 1 -- 172.21.15.114:0/2714818624 wait complete. 2024-09-16T07:31:09.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:31:09.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.892+0000 7f9204c00640 1 -- 172.21.15.114:0/451376709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91e4003a60 msgr2=0x7f91e4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.892+0000 7f9204c00640 1 --2- 172.21.15.114:0/451376709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91e4003a60 0x7f91e4003e80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009b60 tx=0x7f91f001d270 comp rx=0 tx=0).stop 2024-09-16T07:31:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- 172.21.15.114:0/451376709 shutdown_connections 2024-09-16T07:31:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 --2- 172.21.15.114:0/451376709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91e4003a60 0x7f91e4003e80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- 172.21.15.114:0/451376709 >> 172.21.15.114:0/451376709 conn(0x7f92000d1da0 msgr2=0x7f92000d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- 172.21.15.114:0/451376709 shutdown_connections 2024-09-16T07:31:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- 172.21.15.114:0/451376709 wait complete. 2024-09-16T07:31:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 Processor -- start 2024-09-16T07:31:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- start start 2024-09-16T07:31:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e4003a60 0x7f9200155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200071cd0 0x7f9200159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000c95d0 0x7f92000c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92000ced60 con 0x7f9200071cd0 2024-09-16T07:31:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f92000cebe0 con 0x7f92000c95d0 2024-09-16T07:31:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92000ceee0 con 0x7f91e4003a60 2024-09-16T07:31:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200071cd0 0x7f9200159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200071cd0 0x7f9200159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52830/0 (socket says 172.21.15.114:52830) 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 -- 172.21.15.114:0/3624576389 learned_addr learned my addr 172.21.15.114:0/3624576389 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fde00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e4003a60 0x7f9200155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fe800640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000c95d0 0x7f92000c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 -- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e4003a60 msgr2=0x7f9200155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e4003a60 0x7f9200155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 -- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000c95d0 msgr2=0x7f92000c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000c95d0 0x7f92000c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 -- 172.21.15.114:0/3624576389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9200155a50 con 0x7f9200071cd0 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91fd400640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200071cd0 0x7f9200159b90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f91ec012610 tx=0x7f91ec012a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91f6000640 1 -- 172.21.15.114:0/3624576389 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec013a40 con 0x7f9200071cd0 2024-09-16T07:31:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91f6000640 1 -- 172.21.15.114:0/3624576389 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91ec013be0 con 0x7f9200071cd0 2024-09-16T07:31:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f91f6000640 1 -- 172.21.15.114:0/3624576389 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec010480 con 0x7f9200071cd0 2024-09-16T07:31:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920015a0d0 con 0x7f9200071cd0 2024-09-16T07:31:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.896+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920015a680 con 0x7f9200071cd0 2024-09-16T07:31:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.900+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92000cf440 con 0x7f9200071cd0 2024-09-16T07:31:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.900+0000 7f91f6000640 1 -- 172.21.15.114:0/3624576389 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f91ec010620 con 0x7f9200071cd0 2024-09-16T07:31:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.900+0000 7f91f6000640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f91e00730a0 0x7f91e0075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.900+0000 7f91f6000640 1 -- 172.21.15.114:0/3624576389 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5415+0+0 (secure 0 0 0) 0x7f91ec097fe0 con 0x7f9200071cd0 2024-09-16T07:31:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.900+0000 7f91fde00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f91e00730a0 0x7f91e0075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.904+0000 7f91fde00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f91e00730a0 0x7f91e0075560 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91f00ae000 tx=0x7f91f001a010 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:09.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:09.904+0000 7f91f6000640 1 -- 172.21.15.114:0/3624576389 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f91ec062970 con 0x7f9200071cd0 2024-09-16T07:31:10.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.076+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9200070350 con 0x7f9200071cd0 2024-09-16T07:31:10.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.712+0000 7f91f6000640 1 -- 172.21.15.114:0/3624576389 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7f91ec0673a0 con 0x7f9200071cd0 2024-09-16T07:31:10.712 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:31:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f91e00730a0 msgr2=0x7f91e0075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f91e00730a0 0x7f91e0075560 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91f00ae000 tx=0x7f91f001a010 comp rx=0 tx=0).stop 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200071cd0 msgr2=0x7f9200159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200071cd0 0x7f9200159b90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f91ec012610 tx=0x7f91ec012a10 comp rx=0 tx=0).stop 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 shutdown_connections 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f91e00730a0 0x7f91e0075560 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000c95d0 0x7f92000c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9200071cd0 0x7f9200159b90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 --2- 172.21.15.114:0/3624576389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91e4003a60 0x7f9200155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 >> 172.21.15.114:0/3624576389 conn(0x7f92000d1da0 msgr2=0x7f92000af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 shutdown_connections 2024-09-16T07:31:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.716+0000 7f9204c00640 1 -- 172.21.15.114:0/3624576389 wait complete. 2024-09-16T07:31:10.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:31:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 -- 172.21.15.114:0/3126512217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 msgr2=0x7f6b080cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/3126512217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 0x7f6b080cf130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009c80 tx=0x7f6b0001cda0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 -- 172.21.15.114:0/3126512217 shutdown_connections 2024-09-16T07:31:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/3126512217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 0x7f6b080cf130 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/3126512217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b0815ade0 0x7f6b080cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 -- 172.21.15.114:0/3126512217 >> 172.21.15.114:0/3126512217 conn(0x7f6b080b18f0 msgr2=0x7f6b080b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 -- 172.21.15.114:0/3126512217 shutdown_connections 2024-09-16T07:31:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.892+0000 7f6b0ca00640 1 -- 172.21.15.114:0/3126512217 wait complete. 2024-09-16T07:31:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 Processor -- start 2024-09-16T07:31:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 -- start start 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b0806e810 0x7f6b0815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 0x7f6b08074340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b0815ade0 0x7f6b081485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b081680e0 con 0x7f6b0815ade0 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b08167f60 con 0x7f6b080b4bd0 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b08168260 con 0x7f6b0806e810 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b0815ade0 0x7f6b081485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b0815ade0 0x7f6b081485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52832/0 (socket says 172.21.15.114:52832) 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 -- 172.21.15.114:0/837267601 learned_addr learned my addr 172.21.15.114:0/837267601 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b05e00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b0806e810 0x7f6b0815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:10.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b05400640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 0x7f6b08074340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 -- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b0806e810 msgr2=0x7f6b0815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b0806e810 0x7f6b0815b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 -- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 msgr2=0x7f6b08074340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 0x7f6b08074340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 -- 172.21.15.114:0/837267601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b081fb2c0 con 0x7f6b0815ade0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b06800640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b0815ade0 0x7f6b081485e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009bd0 tx=0x7f6b000092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6afe000640 1 -- 172.21.15.114:0/837267601 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000bb070 con 0x7f6b0815ade0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6afe000640 1 -- 172.21.15.114:0/837267601 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b00004d40 con 0x7f6b0815ade0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b08074ab0 con 0x7f6b0815ade0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6afe000640 1 -- 172.21.15.114:0/837267601 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000b2040 con 0x7f6b0815ade0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b081fb560 con 0x7f6b0815ade0 2024-09-16T07:31:10.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.896+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b08069410 con 0x7f6b0815ade0 2024-09-16T07:31:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.900+0000 7f6afe000640 1 -- 172.21.15.114:0/837267601 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f6b000be070 con 0x7f6b0815ade0 2024-09-16T07:31:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.900+0000 7f6afe000640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ae8073070 0x7f6ae8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.900+0000 7f6afe000640 1 -- 172.21.15.114:0/837267601 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f6b0012ddb0 con 0x7f6b0815ade0 2024-09-16T07:31:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.900+0000 7f6b05e00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ae8073070 0x7f6ae8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:10.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.900+0000 7f6b05e00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ae8073070 0x7f6ae8075530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009600 tx=0x7f6af80091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:10.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:10.904+0000 7f6afe000640 1 -- 172.21.15.114:0/837267601 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6b00016990 con 0x7f6b0815ade0 2024-09-16T07:31:11.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.072+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f6b0815e900 con 0x7f6b0815ade0 2024-09-16T07:31:11.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.076+0000 7f6afe000640 1 -- 172.21.15.114:0/837267601 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7f6b000f89c0 con 0x7f6b0815ade0 2024-09-16T07:31:11.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ae8073070 msgr2=0x7f6ae8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ae8073070 0x7f6ae8075530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009600 tx=0x7f6af80091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b0815ade0 msgr2=0x7f6b081485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b0815ade0 0x7f6b081485e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009bd0 tx=0x7f6b000092e0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 shutdown_connections 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6ae8073070 0x7f6ae8075530 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b0815ade0 0x7f6b081485e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b080b4bd0 0x7f6b08074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 --2- 172.21.15.114:0/837267601 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b0806e810 0x7f6b0815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 >> 172.21.15.114:0/837267601 conn(0x7f6b080b18f0 msgr2=0x7f6b08165180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 shutdown_connections 2024-09-16T07:31:11.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.080+0000 7f6b0ca00640 1 -- 172.21.15.114:0/837267601 wait complete. 2024-09-16T07:31:11.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-16T07:31:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 -- 172.21.15.114:0/1027040536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb815be80 msgr2=0x7fdfb80ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1027040536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb815be80 0x7fdfb80ce4e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdfb815f940 tx=0x7fdfa801c8c0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 -- 172.21.15.114:0/1027040536 shutdown_connections 2024-09-16T07:31:11.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1027040536 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfb80b53f0 0x7fdfb80b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1027040536 >> v2:172.21.15.149:3300/0 conn(0x7fdfb80d28c0 0x7fdfb80cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1027040536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb815be80 0x7fdfb80ce4e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 -- 172.21.15.114:0/1027040536 >> 172.21.15.114:0/1027040536 conn(0x7fdfb80d1da0 msgr2=0x7fdfb80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 -- 172.21.15.114:0/1027040536 shutdown_connections 2024-09-16T07:31:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 -- 172.21.15.114:0/1027040536 wait complete. 2024-09-16T07:31:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 Processor -- start 2024-09-16T07:31:11.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.240+0000 7fdfbe600640 1 -- start start 2024-09-16T07:31:11.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb80b53f0 0x7fdfb80cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb80d28c0 0x7fdfb81491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfb815be80 0x7fdfb81fba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80ccfd0 con 0x7fdfb80d28c0 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80cce50 con 0x7fdfb80b53f0 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb80cd150 con 0x7fdfb815be80 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb80d28c0 0x7fdfb81491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb80d28c0 0x7fdfb81491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52848/0 (socket says 172.21.15.114:52848) 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 -- 172.21.15.114:0/1193112719 learned_addr learned my addr 172.21.15.114:0/1193112719 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfb7400640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb80b53f0 0x7fdfb80cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfb7e00640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfb815be80 0x7fdfb81fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 -- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfb815be80 msgr2=0x7fdfb81fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfb815be80 0x7fdfb81fba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 -- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb80b53f0 msgr2=0x7fdfb80cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb80b53f0 0x7fdfb80cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 -- 172.21.15.114:0/1193112719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb806de20 con 0x7fdfb80d28c0 2024-09-16T07:31:11.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfafe00640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb80d28c0 0x7fdfb81491a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e9f0 tx=0x7fdfa000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:11.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfaf400640 1 -- 172.21.15.114:0/1193112719 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000cd80 con 0x7fdfb80d28c0 2024-09-16T07:31:11.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb806e490 con 0x7fdfb80d28c0 2024-09-16T07:31:11.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfaf400640 1 -- 172.21.15.114:0/1193112719 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfa0010430 con 0x7fdfb80d28c0 2024-09-16T07:31:11.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfaf400640 1 -- 172.21.15.114:0/1193112719 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0010860 con 0x7fdfb80d28c0 2024-09-16T07:31:11.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb815da90 con 0x7fdfb80d28c0 2024-09-16T07:31:11.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb80b5800 con 0x7fdfb80d28c0 2024-09-16T07:31:11.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.244+0000 7fdfaf400640 1 -- 172.21.15.114:0/1193112719 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fdfa0010a00 con 0x7fdfb80d28c0 2024-09-16T07:31:11.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.248+0000 7fdfaf400640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdf940730a0 0x7fdf94075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.248+0000 7fdfaf400640 1 -- 172.21.15.114:0/1193112719 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fdfa00949b0 con 0x7fdfb80d28c0 2024-09-16T07:31:11.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.248+0000 7fdfb7400640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdf940730a0 0x7fdf94075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.248+0000 7fdfb7400640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdf940730a0 0x7fdf94075560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80af000 tx=0x7fdfa80a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:11.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.252+0000 7fdfaf400640 1 -- 172.21.15.114:0/1193112719 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdfa005f600 con 0x7fdfb80d28c0 2024-09-16T07:31:11.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.476+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7fdfb80cec80 con 0x7fdfb80d28c0 2024-09-16T07:31:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.724+0000 7fdfaf400640 1 -- 172.21.15.114:0/1193112719 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v164) ==== 140+0+0 (secure 0 0 0) 0x7fdfa0064030 con 0x7fdfb80d28c0 2024-09-16T07:31:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdf940730a0 msgr2=0x7fdf94075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdf940730a0 0x7fdf94075560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80af000 tx=0x7fdfa80a7040 comp rx=0 tx=0).stop 2024-09-16T07:31:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb80d28c0 msgr2=0x7fdfb81491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb80d28c0 0x7fdfb81491a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e9f0 tx=0x7fdfa000eeb0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 shutdown_connections 2024-09-16T07:31:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdf940730a0 0x7fdf94075560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfb815be80 0x7fdfb81fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfb80d28c0 0x7fdfb81491a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 --2- 172.21.15.114:0/1193112719 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfb80b53f0 0x7fdfb80cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 >> 172.21.15.114:0/1193112719 conn(0x7fdfb80d1da0 msgr2=0x7fdfb806e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 shutdown_connections 2024-09-16T07:31:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.728+0000 7fdfbe600640 1 -- 172.21.15.114:0/1193112719 wait complete. 2024-09-16T07:31:11.745 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-16T07:31:11.745 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2024-09-16T07:31:11.745 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:31:11.746 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 -- 172.21.15.114:0/4291318278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 msgr2=0x7f50c80d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 --2- 172.21.15.114:0/4291318278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80d0540 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f50c80c7510 tx=0x7f50b801cd50 comp rx=0 tx=0).stop 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 -- 172.21.15.114:0/4291318278 shutdown_connections 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 --2- 172.21.15.114:0/4291318278 >> v2:172.21.15.149:3300/0 conn(0x7f50c81617b0 0x7f50c80d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 --2- 172.21.15.114:0/4291318278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80d0540 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 -- 172.21.15.114:0/4291318278 >> 172.21.15.114:0/4291318278 conn(0x7f50c80d3e00 msgr2=0x7f50c80d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 -- 172.21.15.114:0/4291318278 shutdown_connections 2024-09-16T07:31:11.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.888+0000 7f50c7e00640 1 -- 172.21.15.114:0/4291318278 wait complete. 2024-09-16T07:31:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 Processor -- start 2024-09-16T07:31:11.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 -- start start 2024-09-16T07:31:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c80d0fc0 0x7f50c81fb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50c81617b0 0x7f50c81522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50c816b050 con 0x7f50c81613d0 2024-09-16T07:31:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50c816aed0 con 0x7f50c80d0fc0 2024-09-16T07:31:11.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50c816b1d0 con 0x7f50c81617b0 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52852/0 (socket says 172.21.15.114:52852) 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 -- 172.21.15.114:0/3818154259 learned_addr learned my addr 172.21.15.114:0/3818154259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c6a00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c80d0fc0 0x7f50c81fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7400640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50c81617b0 0x7f50c81522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 -- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50c81617b0 msgr2=0x7f50c81522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50c81617b0 0x7f50c81522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 -- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c80d0fc0 msgr2=0x7f50c81fb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c80d0fc0 0x7f50c81fb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 -- 172.21.15.114:0/3818154259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81fba80 con 0x7f50c81613d0 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50be000640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80c8a40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c970 tx=0x7f50b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50bf400640 1 -- 172.21.15.114:0/3818154259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0007bb0 con 0x7f50c81613d0 2024-09-16T07:31:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50bf400640 1 -- 172.21.15.114:0/3818154259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b0007e40 con 0x7f50c81613d0 2024-09-16T07:31:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50bf400640 1 -- 172.21.15.114:0/3818154259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b000f6b0 con 0x7f50c81613d0 2024-09-16T07:31:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c8159230 con 0x7f50c81613d0 2024-09-16T07:31:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.892+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c81597b0 con 0x7f50c81613d0 2024-09-16T07:31:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.896+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c80d19d0 con 0x7f50c81613d0 2024-09-16T07:31:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.896+0000 7f50bf400640 1 -- 172.21.15.114:0/3818154259 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f50b000f850 con 0x7f50c81613d0 2024-09-16T07:31:11.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.896+0000 7f50bf400640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f50a40730a0 0x7f50a4075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:11.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.896+0000 7f50bf400640 1 -- 172.21.15.114:0/3818154259 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f50b00945c0 con 0x7f50c81613d0 2024-09-16T07:31:11.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.896+0000 7f50c6a00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f50a40730a0 0x7f50a4075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:11.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.896+0000 7f50c6a00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f50a40730a0 0x7f50a4075560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f50b80af000 tx=0x7f50b801b590 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:11.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:11.900+0000 7f50bf400640 1 -- 172.21.15.114:0/3818154259 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f50c81fba80 con 0x7f50c81613d0 2024-09-16T07:31:12.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.068+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50c8160be0 con 0x7f50c81613d0 2024-09-16T07:31:12.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.068+0000 7f50bf400640 1 -- 172.21.15.114:0/3818154259 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13082 (secure 0 0 0) 0x7f50b0094070 con 0x7f50c81613d0 2024-09-16T07:31:12.068 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:12.068 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:31:10.713034+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/1997583151":"2024-09-17T07:31:07.701829+0000","172.21.15.114:6833/1997583151":"2024-09-17T07:31:07.701829+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:12.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f50a40730a0 msgr2=0x7f50a4075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f50a40730a0 0x7f50a4075560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f50b80af000 tx=0x7f50b801b590 comp rx=0 tx=0).stop 2024-09-16T07:31:12.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 msgr2=0x7f50c80c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80c8a40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c970 tx=0x7f50b000ce30 comp rx=0 tx=0).stop 2024-09-16T07:31:12.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 shutdown_connections 2024-09-16T07:31:12.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f50a40730a0 0x7f50a4075560 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50c81617b0 0x7f50c81522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c81613d0 0x7f50c80c8a40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 --2- 172.21.15.114:0/3818154259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c80d0fc0 0x7f50c81fb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 >> 172.21.15.114:0/3818154259 conn(0x7f50c80d3e00 msgr2=0x7f50c80c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:12.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 shutdown_connections 2024-09-16T07:31:12.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.072+0000 7f50c7e00640 1 -- 172.21.15.114:0/3818154259 wait complete. 2024-09-16T07:31:12.089 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:31:12.089 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:31:12.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 -- 172.21.15.114:0/2568368955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0aeb00 msgr2=0x7fbedc0aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 --2- 172.21.15.114:0/2568368955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0aeb00 0x7fbedc0aefb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbedc073d00 tx=0x7fbed401cd60 comp rx=0 tx=0).stop 2024-09-16T07:31:12.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 -- 172.21.15.114:0/2568368955 shutdown_connections 2024-09-16T07:31:12.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 --2- 172.21.15.114:0/2568368955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0aeb00 0x7fbedc0aefb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 --2- 172.21.15.114:0/2568368955 >> v2:172.21.15.149:3300/0 conn(0x7fbedc0b1650 0x7fbedc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 --2- 172.21.15.114:0/2568368955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbedc1605d0 0x7fbedc0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 -- 172.21.15.114:0/2568368955 >> 172.21.15.114:0/2568368955 conn(0x7fbedc0d1dd0 msgr2=0x7fbedc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:12.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 -- 172.21.15.114:0/2568368955 shutdown_connections 2024-09-16T07:31:12.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 -- 172.21.15.114:0/2568368955 wait complete. 2024-09-16T07:31:12.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 Processor -- start 2024-09-16T07:31:12.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.236+0000 7fbee3800640 1 -- start start 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc0aeb00 0x7fbedc155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0b1650 0x7fbedc0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbedc1605d0 0x7fbedc15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc0b13a0 con 0x7fbedc0b1650 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc0b1220 con 0x7fbedc0aeb00 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc0afd00 con 0x7fbedc1605d0 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0b1650 0x7fbedc0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0b1650 0x7fbedc0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52884/0 (socket says 172.21.15.114:52884) 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 -- 172.21.15.114:0/1007725047 learned_addr learned my addr 172.21.15.114:0/1007725047 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee0e00640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc0aeb00 0x7fbedc155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee1800640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbedc1605d0 0x7fbedc15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 -- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbedc1605d0 msgr2=0x7fbedc15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbedc1605d0 0x7fbedc15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 -- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc0aeb00 msgr2=0x7fbedc155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc0aeb00 0x7fbedc155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 -- 172.21.15.114:0/1007725047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc155c90 con 0x7fbedc0b1650 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbedbe00640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0b1650 0x7fbedc0c8400 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbec800d770 tx=0x7fbec800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbed8c00640 1 -- 172.21.15.114:0/1007725047 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8017070 con 0x7fbedc0b1650 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbed8c00640 1 -- 172.21.15.114:0/1007725047 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbec8009d20 con 0x7fbedc0b1650 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbed8c00640 1 -- 172.21.15.114:0/1007725047 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec80106c0 con 0x7fbedc0b1650 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc0c6fa0 con 0x7fbedc0b1650 2024-09-16T07:31:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc0c6cc0 con 0x7fbedc0b1650 2024-09-16T07:31:12.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbedc0b1a30 con 0x7fbedc0b1650 2024-09-16T07:31:12.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.240+0000 7fbed8c00640 1 -- 172.21.15.114:0/1007725047 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fbec801a070 con 0x7fbedc0b1650 2024-09-16T07:31:12.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.244+0000 7fbed8c00640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbebc073070 0x7fbebc075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.244+0000 7fbed8c00640 1 -- 172.21.15.114:0/1007725047 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fbec80941a0 con 0x7fbedc0b1650 2024-09-16T07:31:12.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.244+0000 7fbee0e00640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbebc073070 0x7fbebc075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.244+0000 7fbee0e00640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbebc073070 0x7fbebc075530 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbed00058d0 tx=0x7fbed0005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:12.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.248+0000 7fbed8c00640 1 -- 172.21.15.114:0/1007725047 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbedc0c6fa0 con 0x7fbedc0b1650 2024-09-16T07:31:12.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.412+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbedc0d1080 con 0x7fbedc0b1650 2024-09-16T07:31:12.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.412+0000 7fbed8c00640 1 -- 172.21.15.114:0/1007725047 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7fbec805f2c0 con 0x7fbedc0b1650 2024-09-16T07:31:12.412 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbebc073070 msgr2=0x7fbebc075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbebc073070 0x7fbebc075530 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbed00058d0 tx=0x7fbed0005860 comp rx=0 tx=0).stop 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0b1650 msgr2=0x7fbedc0c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0b1650 0x7fbedc0c8400 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbec800d770 tx=0x7fbec800dc30 comp rx=0 tx=0).stop 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 shutdown_connections 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbebc073070 0x7fbebc075530 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbedc1605d0 0x7fbedc15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbedc0b1650 0x7fbedc0c8400 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 --2- 172.21.15.114:0/1007725047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbedc0aeb00 0x7fbedc155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 >> 172.21.15.114:0/1007725047 conn(0x7fbedc0d1dd0 msgr2=0x7fbedc0b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 shutdown_connections 2024-09-16T07:31:12.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.416+0000 7fbee3800640 1 -- 172.21.15.114:0/1007725047 wait complete. 2024-09-16T07:31:12.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-16T07:31:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.576+0000 7f43a5600640 1 -- 172.21.15.114:0/1353813766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a015bea0 msgr2=0x7f43a00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.576+0000 7f43a5600640 1 --2- 172.21.15.114:0/1353813766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a015bea0 0x7f43a00ce670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4390009870 tx=0x7f439001c780 comp rx=0 tx=0).stop 2024-09-16T07:31:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.576+0000 7f43a5600640 1 -- 172.21.15.114:0/1353813766 shutdown_connections 2024-09-16T07:31:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.576+0000 7f43a5600640 1 --2- 172.21.15.114:0/1353813766 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a015bea0 0x7f43a00ce670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.576+0000 7f43a5600640 1 -- 172.21.15.114:0/1353813766 >> 172.21.15.114:0/1353813766 conn(0x7f43a00d1dc0 msgr2=0x7f43a00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.576+0000 7f43a5600640 1 -- 172.21.15.114:0/1353813766 shutdown_connections 2024-09-16T07:31:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.576+0000 7f43a5600640 1 -- 172.21.15.114:0/1353813766 wait complete. 2024-09-16T07:31:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 Processor -- start 2024-09-16T07:31:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 -- start start 2024-09-16T07:31:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43a00cdb30 0x7f43a0150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a00d28e0 0x7f43a00c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43a015bea0 0x7f43a0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f43a016a930 con 0x7f43a00cdb30 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f43a016a7b0 con 0x7f43a015bea0 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f43a016aab0 con 0x7f43a00d28e0 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43a00cdb30 0x7f43a0150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43a00cdb30 0x7f43a0150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52894/0 (socket says 172.21.15.114:52894) 2024-09-16T07:31:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 -- 172.21.15.114:0/3352789055 learned_addr learned my addr 172.21.15.114:0/3352789055 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439f400640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43a015bea0 0x7f43a0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f4396000640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a00d28e0 0x7f43a00c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 -- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a00d28e0 msgr2=0x7f43a00c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a00d28e0 0x7f43a00c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 -- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43a015bea0 msgr2=0x7f43a0156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43a015bea0 0x7f43a0156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 -- 172.21.15.114:0/3352789055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a00afd00 con 0x7f43a00cdb30 2024-09-16T07:31:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f4396000640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a00d28e0 0x7f43a00c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f439ea00640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43a00cdb30 0x7f43a0150810 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f439001cc60 tx=0x7f4390005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f4397400640 1 -- 172.21.15.114:0/3352789055 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43900be070 con 0x7f43a00cdb30 2024-09-16T07:31:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f4397400640 1 -- 172.21.15.114:0/3352789055 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43900a8a70 con 0x7f43a00cdb30 2024-09-16T07:31:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f4397400640 1 -- 172.21.15.114:0/3352789055 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390005040 con 0x7f43a00cdb30 2024-09-16T07:31:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a00b6a70 con 0x7f43a00cdb30 2024-09-16T07:31:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.580+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a0151610 con 0x7f43a00cdb30 2024-09-16T07:31:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.584+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a0156320 con 0x7f43a00cdb30 2024-09-16T07:31:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.584+0000 7f4397400640 1 -- 172.21.15.114:0/3352789055 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f43900a8670 con 0x7f43a00cdb30 2024-09-16T07:31:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.584+0000 7f4397400640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f437c0730a0 0x7f437c075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.584+0000 7f4397400640 1 -- 172.21.15.114:0/3352789055 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f439012df80 con 0x7f43a00cdb30 2024-09-16T07:31:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.584+0000 7f4396000640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f437c0730a0 0x7f437c075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.584+0000 7f4396000640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f437c0730a0 0x7f437c075560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4388000fc0 tx=0x7f4388009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:12.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.588+0000 7f4397400640 1 -- 172.21.15.114:0/3352789055 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f43900ac030 con 0x7f43a00cdb30 2024-09-16T07:31:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:12.816+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f43a00b6f20 con 0x7f43a00cdb30 2024-09-16T07:31:13.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.732+0000 7f4397400640 1 -- 172.21.15.114:0/3352789055 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v166) ==== 164+0+0 (secure 0 0 0) 0x7f4390016370 con 0x7f43a00cdb30 2024-09-16T07:31:13.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f437c0730a0 msgr2=0x7f437c075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:13.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f437c0730a0 0x7f437c075560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4388000fc0 tx=0x7f4388009040 comp rx=0 tx=0).stop 2024-09-16T07:31:13.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43a00cdb30 msgr2=0x7f43a0150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:13.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43a00cdb30 0x7f43a0150810 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f439001cc60 tx=0x7f4390005d90 comp rx=0 tx=0).stop 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 shutdown_connections 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f437c0730a0 0x7f437c075560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43a015bea0 0x7f43a0156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f43a00d28e0 0x7f43a00c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 --2- 172.21.15.114:0/3352789055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43a00cdb30 0x7f43a0150810 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 >> 172.21.15.114:0/3352789055 conn(0x7f43a00d1dc0 msgr2=0x7f43a00b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 shutdown_connections 2024-09-16T07:31:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.736+0000 7f43a5600640 1 -- 172.21.15.114:0/3352789055 wait complete. 2024-09-16T07:31:13.757 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:31:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 -- 172.21.15.114:0/2428266264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e300cdb30 msgr2=0x7f7e300aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 --2- 172.21.15.114:0/2428266264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e300cdb30 0x7f7e300aeef0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e300cc3a0 tx=0x7f7e2801cb80 comp rx=0 tx=0).stop 2024-09-16T07:31:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 -- 172.21.15.114:0/2428266264 shutdown_connections 2024-09-16T07:31:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 --2- 172.21.15.114:0/2428266264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e300cdb30 0x7f7e300aeef0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 --2- 172.21.15.114:0/2428266264 >> v2:172.21.15.149:3300/0 conn(0x7f7e300ced80 0x7f7e300ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 -- 172.21.15.114:0/2428266264 >> 172.21.15.114:0/2428266264 conn(0x7f7e300d1dc0 msgr2=0x7f7e300d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 -- 172.21.15.114:0/2428266264 shutdown_connections 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.904+0000 7f7e37e00640 1 -- 172.21.15.114:0/2428266264 wait complete. 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 Processor -- start 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 -- start start 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e300cdb30 0x7f7e3014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e300ced80 0x7f7e300cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e3015bea0 0x7f7e300cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e301692f0 con 0x7f7e3015bea0 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e30169170 con 0x7f7e300cdb30 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e30169470 con 0x7f7e300ced80 2024-09-16T07:31:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e3015bea0 0x7f7e300cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e3015bea0 0x7f7e300cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52910/0 (socket says 172.21.15.114:52910) 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 -- 172.21.15.114:0/3164083242 learned_addr learned my addr 172.21.15.114:0/3164083242 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35400640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e300cdb30 0x7f7e3014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e34a00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e300ced80 0x7f7e300cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 -- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e300ced80 msgr2=0x7f7e300cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e300ced80 0x7f7e300cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 -- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e300cdb30 msgr2=0x7f7e3014d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e300cdb30 0x7f7e3014d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 -- 172.21.15.114:0/3164083242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3015a790 con 0x7f7e3015bea0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e35e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e3015bea0 0x7f7e300cb5a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009b10 tx=0x7f7e280a58c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e2d600640 1 -- 172.21.15.114:0/3164083242 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e280bb070 con 0x7f7e3015bea0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e2d600640 1 -- 172.21.15.114:0/3164083242 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e28004d40 con 0x7f7e3015bea0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e2d600640 1 -- 172.21.15.114:0/3164083242 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e280b2040 con 0x7f7e3015bea0 2024-09-16T07:31:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e301fbcd0 con 0x7f7e3015bea0 2024-09-16T07:31:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e301f7f80 con 0x7f7e3015bea0 2024-09-16T07:31:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.908+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e301f7ad0 con 0x7f7e3015bea0 2024-09-16T07:31:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.912+0000 7f7e2d600640 1 -- 172.21.15.114:0/3164083242 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f7e280a5a30 con 0x7f7e3015bea0 2024-09-16T07:31:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.912+0000 7f7e2d600640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e10073070 0x7f7e10075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.912+0000 7f7e2d600640 1 -- 172.21.15.114:0/3164083242 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f7e2812dec0 con 0x7f7e3015bea0 2024-09-16T07:31:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.912+0000 7f7e35400640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e10073070 0x7f7e10075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:13.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.912+0000 7f7e35400640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e10073070 0x7f7e10075530 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000f70 tx=0x7f7e24009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:13.916+0000 7f7e2d600640 1 -- 172.21.15.114:0/3164083242 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7e3015a790 con 0x7f7e3015bea0 2024-09-16T07:31:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.084+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f7e300d2520 con 0x7f7e3015bea0 2024-09-16T07:31:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.084+0000 7f7e2d600640 1 -- 172.21.15.114:0/3164083242 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1998 (secure 0 0 0) 0x7f7e28016770 con 0x7f7e3015bea0 2024-09-16T07:31:14.083 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:31:14.083 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:31:14.083 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:31:14.083 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:31:14.083 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:31:14.084 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:31:14.085 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:31:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e10073070 msgr2=0x7f7e10075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e10073070 0x7f7e10075530 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000f70 tx=0x7f7e24009040 comp rx=0 tx=0).stop 2024-09-16T07:31:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e3015bea0 msgr2=0x7f7e300cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e3015bea0 0x7f7e300cb5a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009b10 tx=0x7f7e280a58c0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 shutdown_connections 2024-09-16T07:31:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7e10073070 0x7f7e10075530 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e3015bea0 0x7f7e300cb5a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e300ced80 0x7f7e300cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 --2- 172.21.15.114:0/3164083242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e300cdb30 0x7f7e3014d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 >> 172.21.15.114:0/3164083242 conn(0x7f7e300d1dc0 msgr2=0x7f7e3006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 shutdown_connections 2024-09-16T07:31:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.088+0000 7f7e37e00640 1 -- 172.21.15.114:0/3164083242 wait complete. 2024-09-16T07:31:14.104 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:31:14.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- 172.21.15.114:0/2977589715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c15ade0 msgr2=0x7f863c0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 --2- 172.21.15.114:0/2977589715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c15ade0 0x7f863c0cebf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f863c076920 tx=0x7f863001c5d0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- 172.21.15.114:0/2977589715 shutdown_connections 2024-09-16T07:31:14.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 --2- 172.21.15.114:0/2977589715 >> v2:172.21.15.149:3300/0 conn(0x7f863c0b4bd0 0x7f863c15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 --2- 172.21.15.114:0/2977589715 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c06e810 0x7f863c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 --2- 172.21.15.114:0/2977589715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c15ade0 0x7f863c0cebf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- 172.21.15.114:0/2977589715 >> 172.21.15.114:0/2977589715 conn(0x7f863c0b18f0 msgr2=0x7f863c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:14.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- 172.21.15.114:0/2977589715 shutdown_connections 2024-09-16T07:31:14.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- 172.21.15.114:0/2977589715 wait complete. 2024-09-16T07:31:14.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 Processor -- start 2024-09-16T07:31:14.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- start start 2024-09-16T07:31:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c06e810 0x7f863c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0b4bd0 0x7f863c09be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c15ade0 0x7f863c1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f863c06f150 con 0x7f863c0b4bd0 2024-09-16T07:31:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f863c06efd0 con 0x7f863c15ade0 2024-09-16T07:31:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8643e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f863c06f2d0 con 0x7f863c06e810 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8640a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0b4bd0 0x7f863c09be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8640a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0b4bd0 0x7f863c09be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43082/0 (socket says 172.21.15.114:43082) 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8640a00640 1 -- 172.21.15.114:0/3651530076 learned_addr learned my addr 172.21.15.114:0/3651530076 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8641400640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c06e810 0x7f863c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8641e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c15ade0 0x7f863c1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8640a00640 1 -- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c06e810 msgr2=0x7f863c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8640a00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c06e810 0x7f863c158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8640a00640 1 -- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c15ade0 msgr2=0x7f863c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.252+0000 7f8640a00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c15ade0 0x7f863c1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8640a00640 1 -- 172.21.15.114:0/3651530076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c09c390 con 0x7f863c0b4bd0 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8641e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c15ade0 0x7f863c1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8640a00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0b4bd0 0x7f863c09be50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f862800d770 tx=0x7f862800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8639600640 1 -- 172.21.15.114:0/3651530076 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628017070 con 0x7f863c0b4bd0 2024-09-16T07:31:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8639600640 1 -- 172.21.15.114:0/3651530076 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8628009d20 con 0x7f863c0b4bd0 2024-09-16T07:31:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c09c620 con 0x7f863c0b4bd0 2024-09-16T07:31:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8639600640 1 -- 172.21.15.114:0/3651530076 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86280106c0 con 0x7f863c0b4bd0 2024-09-16T07:31:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c15cdb0 con 0x7f863c0b4bd0 2024-09-16T07:31:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863c069410 con 0x7f863c0b4bd0 2024-09-16T07:31:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8639600640 1 -- 172.21.15.114:0/3651530076 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f862801a070 con 0x7f863c0b4bd0 2024-09-16T07:31:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8639600640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f861c073070 0x7f861c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8639600640 1 -- 172.21.15.114:0/3651530076 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f8628093ff0 con 0x7f863c0b4bd0 2024-09-16T07:31:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.256+0000 7f8641400640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f861c073070 0x7f861c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.260+0000 7f8641400640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f861c073070 0x7f861c075530 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f86300af000 tx=0x7f86300b4040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.260+0000 7f8639600640 1 -- 172.21.15.114:0/3651530076 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f862805eb50 con 0x7f863c0b4bd0 2024-09-16T07:31:14.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.428+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f863c15e900 con 0x7f863c0b4bd0 2024-09-16T07:31:14.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.432+0000 7f8639600640 1 -- 172.21.15.114:0/3651530076 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f8628063580 con 0x7f863c0b4bd0 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f861c073070 msgr2=0x7f861c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f861c073070 0x7f861c075530 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f86300af000 tx=0x7f86300b4040 comp rx=0 tx=0).stop 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0b4bd0 msgr2=0x7f863c09be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0b4bd0 0x7f863c09be50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f862800d770 tx=0x7f862800dc30 comp rx=0 tx=0).stop 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 shutdown_connections 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f861c073070 0x7f861c075530 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c15ade0 0x7f863c1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c0b4bd0 0x7f863c09be50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 --2- 172.21.15.114:0/3651530076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c06e810 0x7f863c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 >> 172.21.15.114:0/3651530076 conn(0x7f863c0b18f0 msgr2=0x7f863c163d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:14.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 shutdown_connections 2024-09-16T07:31:14.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.436+0000 7f8643e00640 1 -- 172.21.15.114:0/3651530076 wait complete. 2024-09-16T07:31:14.453 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:31:14.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:14.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:14.631 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:31:14.631 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:14.631 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:14.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:31:14.640 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:14.640 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:14.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:31:14.649 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:14.649 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:14.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:31:14.692 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:14.692 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:14.701 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:31:14.701 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:31:14.701 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:14.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- 172.21.15.114:0/2680905756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb415f490 msgr2=0x7fcbb40b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/2680905756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb415f490 0x7fcbb40b14c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4073dd0 tx=0x7fcba401c830 comp rx=0 tx=0).stop 2024-09-16T07:31:14.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- 172.21.15.114:0/2680905756 shutdown_connections 2024-09-16T07:31:14.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/2680905756 >> v2:172.21.15.149:3300/0 conn(0x7fcbb40b2e80 0x7fcbb40b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/2680905756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb415f490 0x7fcbb40b14c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- 172.21.15.114:0/2680905756 >> 172.21.15.114:0/2680905756 conn(0x7fcbb40d1e30 msgr2=0x7fcbb40d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:14.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- 172.21.15.114:0/2680905756 shutdown_connections 2024-09-16T07:31:14.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- 172.21.15.114:0/2680905756 wait complete. 2024-09-16T07:31:14.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 Processor -- start 2024-09-16T07:31:14.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- start start 2024-09-16T07:31:14.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbb40b1f40 0x7fcbb414dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb40b2e80 0x7fcbb40c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbb415f490 0x7fcbb40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb4168e90 con 0x7fcbb40b2e80 2024-09-16T07:31:14.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb415fa10 con 0x7fcbb40b1f40 2024-09-16T07:31:14.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb4169010 con 0x7fcbb415f490 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb40b2e80 0x7fcbb40c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb40b2e80 0x7fcbb40c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43108/0 (socket says 172.21.15.114:43108) 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 -- 172.21.15.114:0/1411180977 learned_addr learned my addr 172.21.15.114:0/1411180977 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb1e00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbb40b1f40 0x7fcbb414dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb2800640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbb415f490 0x7fcbb40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 -- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbb415f490 msgr2=0x7fcbb40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbb415f490 0x7fcbb40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 -- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbb40b1f40 msgr2=0x7fcbb414dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbb40b1f40 0x7fcbb414dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcba9400640 1 -- 172.21.15.114:0/1411180977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb414e320 con 0x7fcbb40b2e80 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.880+0000 7fcbb2800640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbb415f490 0x7fcbb40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:14.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcba9400640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb40b2e80 0x7fcbb40c77d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00d980 tx=0x7fcb9c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:14.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcbaaa00640 1 -- 172.21.15.114:0/1411180977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c017070 con 0x7fcbb40b2e80 2024-09-16T07:31:14.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcbaaa00640 1 -- 172.21.15.114:0/1411180977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb9c009d20 con 0x7fcbb40b2e80 2024-09-16T07:31:14.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcbaaa00640 1 -- 172.21.15.114:0/1411180977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0106c0 con 0x7fcbb40b2e80 2024-09-16T07:31:14.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb414e600 con 0x7fcbb40b2e80 2024-09-16T07:31:14.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb414ebc0 con 0x7fcbb40b2e80 2024-09-16T07:31:14.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb40cfda0 con 0x7fcbb40b2e80 2024-09-16T07:31:14.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.884+0000 7fcbaaa00640 1 -- 172.21.15.114:0/1411180977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fcb9c010860 con 0x7fcbb40b2e80 2024-09-16T07:31:14.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.888+0000 7fcbaaa00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb90073070 0x7fcb90075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:14.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.888+0000 7fcbaaa00640 1 -- 172.21.15.114:0/1411180977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fcb9c0942e0 con 0x7fcbb40b2e80 2024-09-16T07:31:14.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.888+0000 7fcbb1e00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb90073070 0x7fcb90075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:14.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.888+0000 7fcbb1e00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb90073070 0x7fcb90075530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcba40af000 tx=0x7fcba40a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:14.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:14.892+0000 7fcbaaa00640 1 -- 172.21.15.114:0/1411180977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcb9c05ee40 con 0x7fcbb40b2e80 2024-09-16T07:31:15.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbb40cdfc0 con 0x7fcbb40b2e80 2024-09-16T07:31:15.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbaaa00640 1 -- 172.21.15.114:0/1411180977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3920 (secure 0 0 0) 0x7fcb9c063870 con 0x7fcbb40b2e80 2024-09-16T07:31:15.090 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:15.090 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"btime":"2024-09-16T07:31:08:703950+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2505854873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2505854873},{"type":"v1","addr":"172.21.15.149:6835","nonce":2505854873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5209,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/794077828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":794077828},{"type":"v1","addr":"172.21.15.149:6837","nonce":794077828}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5304,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/2112718097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2112718097},{"type":"v1","addr":"172.21.15.114:6834","nonce":2112718097}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3801157133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3801157133},{"type":"v1","addr":"172.21.15.114:6835","nonce":3801157133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-09-16T07:31:15.091 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 30 2024-09-16T07:31:15.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb90073070 msgr2=0x7fcb90075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb90073070 0x7fcb90075530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcba40af000 tx=0x7fcba40a7040 comp rx=0 tx=0).stop 2024-09-16T07:31:15.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb40b2e80 msgr2=0x7fcbb40c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb40b2e80 0x7fcbb40c77d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00d980 tx=0x7fcb9c00de40 comp rx=0 tx=0).stop 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 shutdown_connections 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb90073070 0x7fcb90075530 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbb415f490 0x7fcbb40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb40b2e80 0x7fcbb40c77d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 --2- 172.21.15.114:0/1411180977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbb40b1f40 0x7fcbb414dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.092+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 >> 172.21.15.114:0/1411180977 conn(0x7fcbb40d1e30 msgr2=0x7fcbb415e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.096+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 shutdown_connections 2024-09-16T07:31:15.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.096+0000 7fcbb8a00640 1 -- 172.21.15.114:0/1411180977 wait complete. 2024-09-16T07:31:15.112 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:31:15.112 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:31:15.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:31:15.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:15.112 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:31:15.113 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:31:15.113 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:31:15.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:15.113 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:31:15.113 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:31:15.113 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:31:15.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:15.114 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:31:15.114 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:31:15.114 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:31:15.114 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:15.125 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:31:15.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:31:15.127 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:31:15.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:31:15.128 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:31:15.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:31:15.129 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:31:15.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:31:15.170 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:31:15.170 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:15.172 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:31:15.172 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:15.175 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:31:15.175 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:15.177 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:31:15.177 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:15.177 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:31:15.256 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:31:15.258 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:31:15.266 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:31:15.267 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:31:15.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.328+0000 7f606d400640 1 -- 172.21.15.114:0/4007211575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f606815bea0 msgr2=0x7f60680ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.328+0000 7f606d400640 1 --2- 172.21.15.114:0/4007211575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f606815bea0 0x7f60680ce670 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6058009840 tx=0x7f605801c790 comp rx=0 tx=0).stop 2024-09-16T07:31:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.328+0000 7f606d400640 1 -- 172.21.15.114:0/4007211575 shutdown_connections 2024-09-16T07:31:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.328+0000 7f606d400640 1 --2- 172.21.15.114:0/4007211575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f606815bea0 0x7f60680ce670 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.328+0000 7f606d400640 1 -- 172.21.15.114:0/4007211575 >> 172.21.15.114:0/4007211575 conn(0x7f60680d1dc0 msgr2=0x7f60680d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 -- 172.21.15.114:0/4007211575 shutdown_connections 2024-09-16T07:31:15.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 -- 172.21.15.114:0/4007211575 wait complete. 2024-09-16T07:31:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 Processor -- start 2024-09-16T07:31:15.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 -- start start 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60680cdb30 0x7f60681fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60680d28e0 0x7f606815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f606815bea0 0x7f606815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f606816a930 con 0x7f60680cdb30 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f606816a7b0 con 0x7f606815bea0 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f606816aab0 con 0x7f60680d28e0 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60680cdb30 0x7f60681fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60680cdb30 0x7f60681fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43128/0 (socket says 172.21.15.114:43128) 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 -- 172.21.15.114:0/2548416659 learned_addr learned my addr 172.21.15.114:0/2548416659 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f605fe00640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60680d28e0 0x7f606815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6067200640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f606815bea0 0x7f606815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 -- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60680d28e0 msgr2=0x7f606815d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60680d28e0 0x7f606815d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 -- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f606815bea0 msgr2=0x7f606815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f606815bea0 0x7f606815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 -- 172.21.15.114:0/2548416659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60681f84e0 con 0x7f60680cdb30 2024-09-16T07:31:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f605fe00640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60680d28e0 0x7f606815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:15.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f6066800640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60680cdb30 0x7f60681fc3a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f605801cc70 tx=0x7f60580a6760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f605ea00640 1 -- 172.21.15.114:0/2548416659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60580be070 con 0x7f60680cdb30 2024-09-16T07:31:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f605ea00640 1 -- 172.21.15.114:0/2548416659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6058005040 con 0x7f60680cdb30 2024-09-16T07:31:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f605ea00640 1 -- 172.21.15.114:0/2548416659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058005410 con 0x7f60680cdb30 2024-09-16T07:31:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.332+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60681f8750 con 0x7f60680cdb30 2024-09-16T07:31:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.336+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60681f8d10 con 0x7f60680cdb30 2024-09-16T07:31:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.336+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60680ce670 con 0x7f60680cdb30 2024-09-16T07:31:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.336+0000 7f605ea00640 1 -- 172.21.15.114:0/2548416659 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f60580046d0 con 0x7f60680cdb30 2024-09-16T07:31:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.336+0000 7f605ea00640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6044073070 0x7f6044075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.336+0000 7f605ea00640 1 -- 172.21.15.114:0/2548416659 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f605812dc80 con 0x7f60680cdb30 2024-09-16T07:31:15.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.336+0000 7f605fe00640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6044073070 0x7f6044075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.340+0000 7f605fe00640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6044073070 0x7f6044075530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60681586e0 tx=0x7f6050009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:15.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.340+0000 7f605ea00640 1 -- 172.21.15.114:0/2548416659 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f60580ac030 con 0x7f60680cdb30 2024-09-16T07:31:15.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.520+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f60680b72c0 con 0x7f60680cdb30 2024-09-16T07:31:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.752+0000 7f605ea00640 1 -- 172.21.15.114:0/2548416659 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f6058016410 con 0x7f60680cdb30 2024-09-16T07:31:15.749 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6044073070 msgr2=0x7f6044075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6044073070 0x7f6044075530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60681586e0 tx=0x7f6050009040 comp rx=0 tx=0).stop 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60680cdb30 msgr2=0x7f60681fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60680cdb30 0x7f60681fc3a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f605801cc70 tx=0x7f60580a6760 comp rx=0 tx=0).stop 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 shutdown_connections 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6044073070 0x7f6044075530 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f606815bea0 0x7f606815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60680d28e0 0x7f606815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 --2- 172.21.15.114:0/2548416659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60680cdb30 0x7f60681fc3a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 >> 172.21.15.114:0/2548416659 conn(0x7f60680d1dc0 msgr2=0x7f60680d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 shutdown_connections 2024-09-16T07:31:15.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.756+0000 7f606d400640 1 -- 172.21.15.114:0/2548416659 wait complete. 2024-09-16T07:31:15.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:31:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 -- 172.21.15.114:0/1013381774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f815bea0 msgr2=0x7ff8f80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 --2- 172.21.15.114:0/1013381774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f815bea0 0x7ff8f80ce670 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8073d10 tx=0x7ff8e801c830 comp rx=0 tx=0).stop 2024-09-16T07:31:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 -- 172.21.15.114:0/1013381774 shutdown_connections 2024-09-16T07:31:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 --2- 172.21.15.114:0/1013381774 >> v2:172.21.15.149:3300/0 conn(0x7ff8f80cdb30 0x7ff8f80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 --2- 172.21.15.114:0/1013381774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f815bea0 0x7ff8f80ce670 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 -- 172.21.15.114:0/1013381774 >> 172.21.15.114:0/1013381774 conn(0x7ff8f80d1dc0 msgr2=0x7ff8f80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 -- 172.21.15.114:0/1013381774 shutdown_connections 2024-09-16T07:31:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 -- 172.21.15.114:0/1013381774 wait complete. 2024-09-16T07:31:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 Processor -- start 2024-09-16T07:31:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.920+0000 7ff8fda00640 1 -- start start 2024-09-16T07:31:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f80cdb30 0x7ff8f81661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f80d28e0 0x7ff8f8155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8f815bea0 0x7ff8f8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f8168fc0 con 0x7ff8f80d28e0 2024-09-16T07:31:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f8168e40 con 0x7ff8f80cdb30 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f8169140 con 0x7ff8f815bea0 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f80d28e0 0x7ff8f8155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f80d28e0 0x7ff8f8155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43142/0 (socket says 172.21.15.114:43142) 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 -- 172.21.15.114:0/630911647 learned_addr learned my addr 172.21.15.114:0/630911647 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6a00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f80cdb30 0x7ff8f81661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f7400640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8f815bea0 0x7ff8f8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 -- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8f815bea0 msgr2=0x7ff8f8156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8f815bea0 0x7ff8f8156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 -- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f80cdb30 msgr2=0x7ff8f81661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f80cdb30 0x7ff8f81661f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 -- 172.21.15.114:0/630911647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f806dd30 con 0x7ff8f80d28e0 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8f6000640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f80d28e0 0x7ff8f8155280 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400d950 tx=0x7ff8e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8eea00640 1 -- 172.21.15.114:0/630911647 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4017070 con 0x7ff8f80d28e0 2024-09-16T07:31:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8eea00640 1 -- 172.21.15.114:0/630911647 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8e4009d20 con 0x7ff8f80d28e0 2024-09-16T07:31:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f806e010 con 0x7ff8f80d28e0 2024-09-16T07:31:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8eea00640 1 -- 172.21.15.114:0/630911647 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40106c0 con 0x7ff8f80d28e0 2024-09-16T07:31:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f806e8b0 con 0x7ff8f80d28e0 2024-09-16T07:31:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.924+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f80cc9d0 con 0x7ff8f80d28e0 2024-09-16T07:31:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.928+0000 7ff8eea00640 1 -- 172.21.15.114:0/630911647 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7ff8e4010860 con 0x7ff8f80d28e0 2024-09-16T07:31:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.928+0000 7ff8eea00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff8d8073070 0x7ff8d8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.928+0000 7ff8eea00640 1 -- 172.21.15.114:0/630911647 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7ff8e4094230 con 0x7ff8f80d28e0 2024-09-16T07:31:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.928+0000 7ff8f6a00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff8d8073070 0x7ff8d8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.928+0000 7ff8f6a00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff8d8073070 0x7ff8d8075530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80af000 tx=0x7ff8e80a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:15.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:15.932+0000 7ff8eea00640 1 -- 172.21.15.114:0/630911647 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff8e405ede0 con 0x7ff8f80d28e0 2024-09-16T07:31:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.156+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff8f806e1e0 con 0x7ff8f80d28e0 2024-09-16T07:31:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.156+0000 7ff8eea00640 1 -- 172.21.15.114:0/630911647 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7ff8e4063810 con 0x7ff8f80d28e0 2024-09-16T07:31:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:16.157 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:31:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:31:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.157 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:31:16.159 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.160 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.161 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.162 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.163 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.164 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.167 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.168 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:31:16.169 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:31:16.170 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:31:16.171 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:31:16.172 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:31:16.173 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.174 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.175 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:31:16.176 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff8d8073070 msgr2=0x7ff8d8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff8d8073070 0x7ff8d8075530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80af000 tx=0x7ff8e80a7040 comp rx=0 tx=0).stop 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f80d28e0 msgr2=0x7ff8f8155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f80d28e0 0x7ff8f8155280 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff8e400d950 tx=0x7ff8e400de10 comp rx=0 tx=0).stop 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 shutdown_connections 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7ff8d8073070 0x7ff8d8075530 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff8f815bea0 0x7ff8f8156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff8f80d28e0 0x7ff8f8155280 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 --2- 172.21.15.114:0/630911647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8f80cdb30 0x7ff8f81661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 >> 172.21.15.114:0/630911647 conn(0x7ff8f80d1dc0 msgr2=0x7ff8f80b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 shutdown_connections 2024-09-16T07:31:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.160+0000 7ff8fda00640 1 -- 172.21.15.114:0/630911647 wait complete. 2024-09-16T07:31:16.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:31:16.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- 172.21.15.114:0/2087589586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 msgr2=0x7f05b40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 --2- 172.21.15.114:0/2087589586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 0x7f05b40051d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009b60 tx=0x7f05c801d2b0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05cf400640 1 -- 172.21.15.114:0/2087589586 reap_dead start 2024-09-16T07:31:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- 172.21.15.114:0/2087589586 shutdown_connections 2024-09-16T07:31:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- 172.21.15.114:0/2087589586 >> 172.21.15.114:0/2087589586 conn(0x7f05d00d1ea0 msgr2=0x7f05d00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- 172.21.15.114:0/2087589586 shutdown_connections 2024-09-16T07:31:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- 172.21.15.114:0/2087589586 wait complete. 2024-09-16T07:31:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 Processor -- start 2024-09-16T07:31:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- start start 2024-09-16T07:31:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 0x7f05d00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d00ca720 0x7f05d01f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05d00b4db0 0x7f05d01f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05d00cecd0 con 0x7f05b4004d50 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f05d00ceb50 con 0x7f05d00ca720 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.324+0000 7f05d5c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f05d00cee50 con 0x7f05d00b4db0 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 0x7f05d00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 0x7f05d00cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43162/0 (socket says 172.21.15.114:43162) 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 -- 172.21.15.114:0/2415688755 learned_addr learned my addr 172.21.15.114:0/2415688755 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05c6000640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d00ca720 0x7f05d01f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 -- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05d00b4db0 msgr2=0x7f05d01f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05d00b4db0 0x7f05d01f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 -- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d00ca720 msgr2=0x7f05d01f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d00ca720 0x7f05d01f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 -- 172.21.15.114:0/2415688755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d00cabb0 con 0x7f05b4004d50 2024-09-16T07:31:16.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05c6000640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d00ca720 0x7f05d01f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05cea00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 0x7f05d00cbc50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f05c0011a60 tx=0x7f05c0011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05c7400640 1 -- 172.21.15.114:0/2415688755 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c001e070 con 0x7f05b4004d50 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05c7400640 1 -- 172.21.15.114:0/2415688755 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c000fe70 con 0x7f05b4004d50 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d00cae90 con 0x7f05b4004d50 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05c7400640 1 -- 172.21.15.114:0/2415688755 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c0004290 con 0x7f05b4004d50 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d00cb450 con 0x7f05b4004d50 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d00c5dd0 con 0x7f05b4004d50 2024-09-16T07:31:16.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.328+0000 7f05c7400640 1 -- 172.21.15.114:0/2415688755 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f05c0021070 con 0x7f05b4004d50 2024-09-16T07:31:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.332+0000 7f05c7400640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05ac0730a0 0x7f05ac075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.332+0000 7f05c7400640 1 -- 172.21.15.114:0/2415688755 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f05c0094910 con 0x7f05b4004d50 2024-09-16T07:31:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.332+0000 7f05c6000640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05ac0730a0 0x7f05ac075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:16.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.332+0000 7f05c6000640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05ac0730a0 0x7f05ac075560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f05b8001bf0 tx=0x7f05b80021e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:16.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.336+0000 7f05c7400640 1 -- 172.21.15.114:0/2415688755 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f05c005f580 con 0x7f05b4004d50 2024-09-16T07:31:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f05d00d2630 con 0x7f05b4004d50 2024-09-16T07:31:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05c7400640 1 -- 172.21.15.114:0/2415688755 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7f05c0063fb0 con 0x7f05b4004d50 2024-09-16T07:31:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:16.502 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:31:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:31:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:31:16.502 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:16.502 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05ac0730a0 msgr2=0x7f05ac075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05ac0730a0 0x7f05ac075560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f05b8001bf0 tx=0x7f05b80021e0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 msgr2=0x7f05d00cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 0x7f05d00cbc50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f05c0011a60 tx=0x7f05c0011f20 comp rx=0 tx=0).stop 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 shutdown_connections 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f05ac0730a0 0x7f05ac075560 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05d00b4db0 0x7f05d01f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d00ca720 0x7f05d01f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 --2- 172.21.15.114:0/2415688755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05b4004d50 0x7f05d00cbc50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 >> 172.21.15.114:0/2415688755 conn(0x7f05d00d1ea0 msgr2=0x7f05d015afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 shutdown_connections 2024-09-16T07:31:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.504+0000 7f05d5c00640 1 -- 172.21.15.114:0/2415688755 wait complete. 2024-09-16T07:31:16.522 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:31:16.523 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:31:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- 172.21.15.114:0/1004868379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 msgr2=0x7f8ee8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 --2- 172.21.15.114:0/1004868379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8ee8004c90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009b60 tx=0x7f8eec01d290 comp rx=0 tx=0).stop 2024-09-16T07:31:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- 172.21.15.114:0/1004868379 shutdown_connections 2024-09-16T07:31:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 --2- 172.21.15.114:0/1004868379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8ee8004c90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- 172.21.15.114:0/1004868379 >> 172.21.15.114:0/1004868379 conn(0x7f8f000b2140 msgr2=0x7f8f000b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- 172.21.15.114:0/1004868379 shutdown_connections 2024-09-16T07:31:16.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- 172.21.15.114:0/1004868379 wait complete. 2024-09-16T07:31:16.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 Processor -- start 2024-09-16T07:31:16.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- start start 2024-09-16T07:31:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8f001e4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f001e51d0 0x7f8f0014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f001f8d00 0x7f8f000aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0015f100 con 0x7f8ee8004810 2024-09-16T07:31:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00073380 con 0x7f8f001f8d00 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.672+0000 7f8f08600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0015f280 con 0x7f8f001e51d0 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8f001e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8f001e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43178/0 (socket says 172.21.15.114:43178) 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 -- 172.21.15.114:0/1501995711 learned_addr learned my addr 172.21.15.114:0/1501995711 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05200640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f001e51d0 0x7f8f0014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f06600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f001f8d00 0x7f8f000aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 -- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f001e51d0 msgr2=0x7f8f0014c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f001e51d0 0x7f8f0014c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 -- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f001f8d00 msgr2=0x7f8f000aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f001f8d00 0x7f8f000aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 -- 172.21.15.114:0/1501995711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f001e5740 con 0x7f8ee8004810 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f05c00640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8f001e4440 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40021d0 tx=0x7f8ef4002200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8efd600640 1 -- 172.21.15.114:0/1501995711 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4015070 con 0x7f8ee8004810 2024-09-16T07:31:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8efd600640 1 -- 172.21.15.114:0/1501995711 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ef400f9e0 con 0x7f8ee8004810 2024-09-16T07:31:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8efd600640 1 -- 172.21.15.114:0/1501995711 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400fe30 con 0x7f8ee8004810 2024-09-16T07:31:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f001e5a20 con 0x7f8ee8004810 2024-09-16T07:31:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f001f8500 con 0x7f8ee8004810 2024-09-16T07:31:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f000ce660 con 0x7f8ee8004810 2024-09-16T07:31:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.676+0000 7f8efd600640 1 -- 172.21.15.114:0/1501995711 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f8ef4011430 con 0x7f8ee8004810 2024-09-16T07:31:16.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.680+0000 7f8efd600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ee00730a0 0x7f8ee0075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:16.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.680+0000 7f8efd600640 1 -- 172.21.15.114:0/1501995711 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f8ef4094ae0 con 0x7f8ee8004810 2024-09-16T07:31:16.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.680+0000 7f8f05200640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ee00730a0 0x7f8ee0075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:16.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.680+0000 7f8f05200640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ee00730a0 0x7f8ee0075560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ae000 tx=0x7f8eec01a030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.684+0000 7f8efd600640 1 -- 172.21.15.114:0/1501995711 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8ef405f7e0 con 0x7f8ee8004810 2024-09-16T07:31:16.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:16.856+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8f000ae5c0 con 0x7f8ee8004810 2024-09-16T07:31:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8efd600640 1 -- 172.21.15.114:0/1501995711 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7f8ef4064210 con 0x7f8ee8004810 2024-09-16T07:31:17.753 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:31:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ee00730a0 msgr2=0x7f8ee0075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:17.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ee00730a0 0x7f8ee0075560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0ae000 tx=0x7f8eec01a030 comp rx=0 tx=0).stop 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 msgr2=0x7f8f001e4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8f001e4440 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40021d0 tx=0x7f8ef4002200 comp rx=0 tx=0).stop 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 shutdown_connections 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8ee00730a0 0x7f8ee0075560 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f001f8d00 0x7f8f000aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f001e51d0 0x7f8f0014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 --2- 172.21.15.114:0/1501995711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee8004810 0x7f8f001e4440 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.756+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 >> 172.21.15.114:0/1501995711 conn(0x7f8f000b2140 msgr2=0x7f8f0015e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.760+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 shutdown_connections 2024-09-16T07:31:17.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.760+0000 7f8f08600640 1 -- 172.21.15.114:0/1501995711 wait complete. 2024-09-16T07:31:17.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:31:17.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:31:17.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:31:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- 172.21.15.114:0/767847928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 msgr2=0x7f7abc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 --2- 172.21.15.114:0/767847928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7abc004c90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4001770 tx=0x7f7ac401ef70 comp rx=0 tx=0).stop 2024-09-16T07:31:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- 172.21.15.114:0/767847928 shutdown_connections 2024-09-16T07:31:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 --2- 172.21.15.114:0/767847928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7abc004c90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- 172.21.15.114:0/767847928 >> 172.21.15.114:0/767847928 conn(0x7f7ad80d0d40 msgr2=0x7f7ad80d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- 172.21.15.114:0/767847928 shutdown_connections 2024-09-16T07:31:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- 172.21.15.114:0/767847928 wait complete. 2024-09-16T07:31:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 Processor -- start 2024-09-16T07:31:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- start start 2024-09-16T07:31:17.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7ad815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:17.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad80b3bd0 0x7f7ad8151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:17.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad8158f10 0x7f7ad8159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad815bc10 con 0x7f7abc004810 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad815ba90 con 0x7f7ad8158f10 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.940+0000 7f7add400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad815bd90 con 0x7f7ad80b3bd0 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7ad815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7ad815db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43196/0 (socket says 172.21.15.114:43196) 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 -- 172.21.15.114:0/3220359487 learned_addr learned my addr 172.21.15.114:0/3220359487 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad7200640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad8158f10 0x7f7ad8159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad5e00640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad80b3bd0 0x7f7ad8151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 -- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad80b3bd0 msgr2=0x7f7ad8151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad80b3bd0 0x7f7ad8151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 -- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad8158f10 msgr2=0x7f7ad8159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad8158f10 0x7f7ad8159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 -- 172.21.15.114:0/3220359487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad80b4260 con 0x7f7abc004810 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad7200640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad8158f10 0x7f7ad8159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad5e00640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad80b3bd0 0x7f7ad8151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7ad6800640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7ad815db10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006290 tx=0x7f7ac8006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7acea00640 1 -- 172.21.15.114:0/3220359487 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8015070 con 0x7f7abc004810 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7acea00640 1 -- 172.21.15.114:0/3220359487 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ac800fb30 con 0x7f7abc004810 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7acea00640 1 -- 172.21.15.114:0/3220359487 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8011430 con 0x7f7abc004810 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad80b4540 con 0x7f7abc004810 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad80b4b00 con 0x7f7abc004810 2024-09-16T07:31:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad80d00d0 con 0x7f7abc004810 2024-09-16T07:31:17.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.944+0000 7f7acea00640 1 -- 172.21.15.114:0/3220359487 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f7ac80115d0 con 0x7f7abc004810 2024-09-16T07:31:17.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.948+0000 7f7acea00640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7ab80730a0 0x7f7ab8075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:17.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.948+0000 7f7acea00640 1 -- 172.21.15.114:0/3220359487 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7f7ac8094ff0 con 0x7f7abc004810 2024-09-16T07:31:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.948+0000 7f7ad5e00640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7ab80730a0 0x7f7ab8075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.948+0000 7f7ad5e00640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7ab80730a0 0x7f7ab8075560 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4005000 tx=0x7f7ac401bd10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:17.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:17.952+0000 7f7acea00640 1 -- 172.21.15.114:0/3220359487 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7ad815b2f0 con 0x7f7abc004810 2024-09-16T07:31:18.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.120+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7ad80b3fb0 con 0x7f7abc004810 2024-09-16T07:31:18.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.756+0000 7f7acea00640 1 -- 172.21.15.114:0/3220359487 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f7ac805fff0 con 0x7f7abc004810 2024-09-16T07:31:18.756 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:31:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7ab80730a0 msgr2=0x7f7ab8075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7ab80730a0 0x7f7ab8075560 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4005000 tx=0x7f7ac401bd10 comp rx=0 tx=0).stop 2024-09-16T07:31:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 msgr2=0x7f7ad815db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7ad815db10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006290 tx=0x7f7ac8006750 comp rx=0 tx=0).stop 2024-09-16T07:31:18.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 shutdown_connections 2024-09-16T07:31:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7ab80730a0 0x7f7ab8075560 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad8158f10 0x7f7ad8159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad80b3bd0 0x7f7ad8151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 --2- 172.21.15.114:0/3220359487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc004810 0x7f7ad815db10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 >> 172.21.15.114:0/3220359487 conn(0x7f7ad80d0d40 msgr2=0x7f7ad80d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 shutdown_connections 2024-09-16T07:31:18.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.760+0000 7f7add400640 1 -- 172.21.15.114:0/3220359487 wait complete. 2024-09-16T07:31:18.799 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:31:18.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 -- 172.21.15.114:0/1877547614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 msgr2=0x7f1ba80ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:18.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 --2- 172.21.15.114:0/1877547614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 0x7f1ba80ceb40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009900 tx=0x7f1b9401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 -- 172.21.15.114:0/1877547614 shutdown_connections 2024-09-16T07:31:18.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 --2- 172.21.15.114:0/1877547614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 0x7f1ba80ceb40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 --2- 172.21.15.114:0/1877547614 >> v2:172.21.15.149:3300/0 conn(0x7f1ba815e130 0x7f1ba806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 -- 172.21.15.114:0/1877547614 >> 172.21.15.114:0/1877547614 conn(0x7f1ba80d1ea0 msgr2=0x7f1ba80d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:18.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 -- 172.21.15.114:0/1877547614 shutdown_connections 2024-09-16T07:31:18.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.948+0000 7f1bafe00640 1 -- 172.21.15.114:0/1877547614 wait complete. 2024-09-16T07:31:18.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 Processor -- start 2024-09-16T07:31:18.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 -- start start 2024-09-16T07:31:18.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 0x7f1ba815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:18.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba80cf080 0x7f1ba8155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:18.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba815e130 0x7f1ba81505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:18.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba816b010 con 0x7f1ba80cf080 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba816ae90 con 0x7f1ba815e130 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba816b190 con 0x7f1ba80ce720 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba80cf080 0x7f1ba8155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba80cf080 0x7f1ba8155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43206/0 (socket says 172.21.15.114:43206) 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 -- 172.21.15.114:0/2747391692 learned_addr learned my addr 172.21.15.114:0/2747391692 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bad400640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 0x7f1ba815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bade00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba815e130 0x7f1ba81505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 -- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 msgr2=0x7f1ba815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 0x7f1ba815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 -- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba815e130 msgr2=0x7f1ba81505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba815e130 0x7f1ba81505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:18.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 -- 172.21.15.114:0/2747391692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba815cfc0 con 0x7f1ba80cf080 2024-09-16T07:31:18.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1baca00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba80cf080 0x7f1ba8155bb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009850 tx=0x7f1b94004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:18.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1ba5600640 1 -- 172.21.15.114:0/2747391692 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b940b2040 con 0x7f1ba80cf080 2024-09-16T07:31:18.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1ba5600640 1 -- 172.21.15.114:0/2747391692 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b94005030 con 0x7f1ba80cf080 2024-09-16T07:31:18.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1ba5600640 1 -- 172.21.15.114:0/2747391692 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94005460 con 0x7f1ba80cf080 2024-09-16T07:31:18.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba815d2a0 con 0x7f1ba80cf080 2024-09-16T07:31:18.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba80c5c70 con 0x7f1ba80cf080 2024-09-16T07:31:18.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.952+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba80ceb40 con 0x7f1ba80cf080 2024-09-16T07:31:18.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.956+0000 7f1ba5600640 1 -- 172.21.15.114:0/2747391692 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f1b940046d0 con 0x7f1ba80cf080 2024-09-16T07:31:18.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.956+0000 7f1ba5600640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b88073070 0x7f1b88075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:18.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.956+0000 7f1ba5600640 1 -- 172.21.15.114:0/2747391692 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7f1b9412cfc0 con 0x7f1ba80cf080 2024-09-16T07:31:18.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.956+0000 7f1bad400640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b88073070 0x7f1b88075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:18.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.956+0000 7f1bad400640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b88073070 0x7f1b88075530 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009600 tx=0x7f1b9c0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:18.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:18.960+0000 7f1ba5600640 1 -- 172.21.15.114:0/2747391692 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1b940164d0 con 0x7f1ba80cf080 2024-09-16T07:31:19.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.160+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1ba815d470 con 0x7f1ba80cf080 2024-09-16T07:31:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.792+0000 7f1ba5600640 1 -- 172.21.15.114:0/2747391692 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v33) ==== 172+0+0 (secure 0 0 0) 0x7f1b940f7870 con 0x7f1ba80cf080 2024-09-16T07:31:19.801 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 8 and data pool 9 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b88073070 msgr2=0x7f1b88075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b88073070 0x7f1b88075530 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009600 tx=0x7f1b9c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba80cf080 msgr2=0x7f1ba8155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba80cf080 0x7f1ba8155bb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009850 tx=0x7f1b94004040 comp rx=0 tx=0).stop 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 shutdown_connections 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b88073070 0x7f1b88075530 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba815e130 0x7f1ba81505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba80cf080 0x7f1ba8155bb0 secure :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009850 tx=0x7f1b94004040 comp rx=0 tx=0).stop 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 --2- 172.21.15.114:0/2747391692 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba80ce720 0x7f1ba815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 >> 172.21.15.114:0/2747391692 conn(0x7f1ba80d1ea0 msgr2=0x7f1ba80b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:19.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 shutdown_connections 2024-09-16T07:31:19.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.808+0000 7f1bafe00640 1 -- 172.21.15.114:0/2747391692 wait complete. 2024-09-16T07:31:19.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:19.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- 172.21.15.114:0/472834369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d815e280 msgr2=0x7f75d80ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:19.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 --2- 172.21.15.114:0/472834369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d815e280 0x7f75d80ae990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f75d80b2c30 tx=0x7f75c001c890 comp rx=0 tx=0).stop 2024-09-16T07:31:19.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- 172.21.15.114:0/472834369 shutdown_connections 2024-09-16T07:31:19.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 --2- 172.21.15.114:0/472834369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d815e280 0x7f75d80ae990 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 --2- 172.21.15.114:0/472834369 >> v2:172.21.15.149:3300/0 conn(0x7f75d80aeed0 0x7f75d806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 --2- 172.21.15.114:0/472834369 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75d815dea0 0x7f75d80b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- 172.21.15.114:0/472834369 >> 172.21.15.114:0/472834369 conn(0x7f75d80d1da0 msgr2=0x7f75d80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:19.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- 172.21.15.114:0/472834369 shutdown_connections 2024-09-16T07:31:19.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- 172.21.15.114:0/472834369 wait complete. 2024-09-16T07:31:19.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 Processor -- start 2024-09-16T07:31:19.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- start start 2024-09-16T07:31:19.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d80aeed0 0x7f75d815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75d815dea0 0x7f75d81fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75d815e280 0x7f75d815cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75d80d09e0 con 0x7f75d80aeed0 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f75d80d0860 con 0x7f75d815dea0 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75dde00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f75d80d0b60 con 0x7f75d815e280 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d80aeed0 0x7f75d815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d80aeed0 0x7f75d815b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43224/0 (socket says 172.21.15.114:43224) 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 -- 172.21.15.114:0/1147073387 learned_addr learned my addr 172.21.15.114:0/1147073387 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75ce000640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75d815dea0 0x7f75d81fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d7400640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75d815e280 0x7f75d815cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 -- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75d815e280 msgr2=0x7f75d815cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:19.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75d815e280 0x7f75d815cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 -- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75d815dea0 msgr2=0x7f75d81fafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75d815dea0 0x7f75d81fafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d6a00640 1 -- 172.21.15.114:0/1147073387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d809f660 con 0x7f75d80aeed0 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.980+0000 7f75d7400640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75d815e280 0x7f75d815cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75d6a00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d80aeed0 0x7f75d815b880 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f75c800eb30 tx=0x7f75c800c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75cfe00640 1 -- 172.21.15.114:0/1147073387 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c8011470 con 0x7f75d80aeed0 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75cfe00640 1 -- 172.21.15.114:0/1147073387 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75c8011700 con 0x7f75d80aeed0 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75cfe00640 1 -- 172.21.15.114:0/1147073387 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c8011b30 con 0x7f75d80aeed0 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d809f8e0 con 0x7f75d80aeed0 2024-09-16T07:31:19.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d81fb520 con 0x7f75d80aeed0 2024-09-16T07:31:19.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d8160e00 con 0x7f75d80aeed0 2024-09-16T07:31:19.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75cfe00640 1 -- 172.21.15.114:0/1147073387 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f75c8011cd0 con 0x7f75d80aeed0 2024-09-16T07:31:19.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75cfe00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75b40730a0 0x7f75b4075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:19.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75cfe00640 1 -- 172.21.15.114:0/1147073387 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f75c8094ef0 con 0x7f75d80aeed0 2024-09-16T07:31:19.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.984+0000 7f75ce000640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75b40730a0 0x7f75b4075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:19.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.988+0000 7f75ce000640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75b40730a0 0x7f75b4075560 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f75c00af000 tx=0x7f75c00a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:19.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:19.988+0000 7f75cfe00640 1 -- 172.21.15.114:0/1147073387 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f75d809f660 con 0x7f75d80aeed0 2024-09-16T07:31:20.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75d80d1080 con 0x7f75d80aeed0 2024-09-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75cfe00640 1 -- 172.21.15.114:0/1147073387 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16786 (secure 0 0 0) 0x7f75c8016030 con 0x7f75d80aeed0 2024-09-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:20.158 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":56,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:31:19.162714+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:31:16.866132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-16T07:31:18.131366+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75b40730a0 msgr2=0x7f75b4075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75b40730a0 0x7f75b4075560 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f75c00af000 tx=0x7f75c00a7040 comp rx=0 tx=0).stop 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d80aeed0 msgr2=0x7f75d815b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d80aeed0 0x7f75d815b880 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f75c800eb30 tx=0x7f75c800c270 comp rx=0 tx=0).stop 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 shutdown_connections 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f75b40730a0 0x7f75b4075560 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75d815e280 0x7f75d815cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75d815dea0 0x7f75d81fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 --2- 172.21.15.114:0/1147073387 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75d80aeed0 0x7f75d815b880 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 >> 172.21.15.114:0/1147073387 conn(0x7f75d80d1da0 msgr2=0x7f75d80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.160+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 shutdown_connections 2024-09-16T07:31:20.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.164+0000 7f75dde00640 1 -- 172.21.15.114:0/1147073387 wait complete. 2024-09-16T07:31:20.181 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:20.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 -- 172.21.15.114:0/3364573772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580b2590 msgr2=0x7f1c580b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/3364573772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580b2590 0x7f1c580b29e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009c80 tx=0x7f1c5001cd10 comp rx=0 tx=0).stop 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 -- 172.21.15.114:0/3364573772 shutdown_connections 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/3364573772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580b2590 0x7f1c580b29e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/3364573772 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c5815f000 0x7f1c580d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 -- 172.21.15.114:0/3364573772 >> 172.21.15.114:0/3364573772 conn(0x7f1c5809aa10 msgr2=0x7f1c5809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 -- 172.21.15.114:0/3364573772 shutdown_connections 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 -- 172.21.15.114:0/3364573772 wait complete. 2024-09-16T07:31:20.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 Processor -- start 2024-09-16T07:31:20.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.324+0000 7f1c5ce00640 1 -- start start 2024-09-16T07:31:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c580b2590 0x7f1c5814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580cefb0 0x7f1c580b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c5815f000 0x7f1c58071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1c58168f00 con 0x7f1c580cefb0 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1c58168d80 con 0x7f1c5815f000 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1c58169080 con 0x7f1c580b2590 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580cefb0 0x7f1c580b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580cefb0 0x7f1c580b5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43234/0 (socket says 172.21.15.114:43234) 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 -- 172.21.15.114:0/2139271005 learned_addr learned my addr 172.21.15.114:0/2139271005 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c57400640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c580b2590 0x7f1c5814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c57e00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c5815f000 0x7f1c58071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 -- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c580b2590 msgr2=0x7f1c5814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c580b2590 0x7f1c5814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 -- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c5815f000 msgr2=0x7f1c58071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c5815f000 0x7f1c58071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 -- 172.21.15.114:0/2139271005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c580b6aa0 con 0x7f1c580cefb0 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c57e00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c5815f000 0x7f1c58071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:20.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c56a00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580cefb0 0x7f1c580b5410 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c500 tx=0x7f1c4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:20.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c4f400640 1 -- 172.21.15.114:0/2139271005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44017070 con 0x7f1c580cefb0 2024-09-16T07:31:20.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c4f400640 1 -- 172.21.15.114:0/2139271005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c440053c0 con 0x7f1c580cefb0 2024-09-16T07:31:20.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c580b6d80 con 0x7f1c580cefb0 2024-09-16T07:31:20.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c4f400640 1 -- 172.21.15.114:0/2139271005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c44012890 con 0x7f1c580cefb0 2024-09-16T07:31:20.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c580b7340 con 0x7f1c580cefb0 2024-09-16T07:31:20.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.328+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c580c77f0 con 0x7f1c580cefb0 2024-09-16T07:31:20.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.332+0000 7f1c4f400640 1 -- 172.21.15.114:0/2139271005 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f1c4401a070 con 0x7f1c580cefb0 2024-09-16T07:31:20.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.332+0000 7f1c4f400640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c38073070 0x7f1c38075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.332+0000 7f1c4f400640 1 -- 172.21.15.114:0/2139271005 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f1c44093580 con 0x7f1c580cefb0 2024-09-16T07:31:20.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.332+0000 7f1c57400640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c38073070 0x7f1c38075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.332+0000 7f1c57400640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c38073070 0x7f1c38075530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c48004630 tx=0x7f1c4800b2e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:20.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.336+0000 7f1c4f400640 1 -- 172.21.15.114:0/2139271005 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1c4405dd60 con 0x7f1c580cefb0 2024-09-16T07:31:20.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c580b29e0 con 0x7f1c580cefb0 2024-09-16T07:31:20.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c4f400640 1 -- 172.21.15.114:0/2139271005 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16786 (secure 0 0 0) 0x7f1c44062790 con 0x7f1c580cefb0 2024-09-16T07:31:20.502 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:20.502 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":56,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:31:19.162714+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:31:16.866132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-16T07:31:18.131366+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:20.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c38073070 msgr2=0x7f1c38075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c38073070 0x7f1c38075530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c48004630 tx=0x7f1c4800b2e0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580cefb0 msgr2=0x7f1c580b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580cefb0 0x7f1c580b5410 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400c500 tx=0x7f1c4400c9c0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 shutdown_connections 2024-09-16T07:31:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1c38073070 0x7f1c38075530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c5815f000 0x7f1c58071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c580cefb0 0x7f1c580b5410 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 --2- 172.21.15.114:0/2139271005 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1c580b2590 0x7f1c5814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 >> 172.21.15.114:0/2139271005 conn(0x7f1c5809aa10 msgr2=0x7f1c5809adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 shutdown_connections 2024-09-16T07:31:20.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.504+0000 7f1c5ce00640 1 -- 172.21.15.114:0/2139271005 wait complete. 2024-09-16T07:31:20.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:31:20.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 -- 172.21.15.114:0/392404661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc004d50 msgr2=0x7f08bc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 --2- 172.21.15.114:0/392404661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08bc004d50 0x7f08bc0051d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f08d0006f90 tx=0x7f08d001f5d0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d6800640 1 -- 172.21.15.114:0/392404661 reap_dead start 2024-09-16T07:31:20.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 -- 172.21.15.114:0/392404661 shutdown_connections 2024-09-16T07:31:20.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 -- 172.21.15.114:0/392404661 >> 172.21.15.114:0/392404661 conn(0x7f08d809aa10 msgr2=0x7f08d809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:20.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 -- 172.21.15.114:0/392404661 shutdown_connections 2024-09-16T07:31:20.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 -- 172.21.15.114:0/392404661 wait complete. 2024-09-16T07:31:20.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 Processor -- start 2024-09-16T07:31:20.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.672+0000 7f08d7200640 1 -- start start 2024-09-16T07:31:20.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08bc004d50 0x7f08d81f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d80b5e70 0x7f08d815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d80c7580 0x7f08d8150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f08d80ccd30 con 0x7f08d80c7580 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f08d80d0930 con 0x7f08d80b5e70 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08d80cceb0 con 0x7f08bc004d50 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d80c7580 0x7f08d8150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d80c7580 0x7f08d8150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43252/0 (socket says 172.21.15.114:43252) 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 -- 172.21.15.114:0/1658084703 learned_addr learned my addr 172.21.15.114:0/1658084703 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d5e00640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08bc004d50 0x7f08d81f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d5400640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d80b5e70 0x7f08d815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 -- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08bc004d50 msgr2=0x7f08d81f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08bc004d50 0x7f08d81f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 -- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d80b5e70 msgr2=0x7f08d815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d80b5e70 0x7f08d815c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 -- 172.21.15.114:0/1658084703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d806acf0 con 0x7f08d80c7580 2024-09-16T07:31:20.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d6800640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d80c7580 0x7f08d8150d30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08d0006f90 tx=0x7f08d00013c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08ce000640 1 -- 172.21.15.114:0/1658084703 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d00b5040 con 0x7f08d80c7580 2024-09-16T07:31:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08ce000640 1 -- 172.21.15.114:0/1658084703 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08d0006440 con 0x7f08d80c7580 2024-09-16T07:31:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d81f5540 con 0x7f08d80c7580 2024-09-16T07:31:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08ce000640 1 -- 172.21.15.114:0/1658084703 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0000e50 con 0x7f08d80c7580 2024-09-16T07:31:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d81f5b00 con 0x7f08d80c7580 2024-09-16T07:31:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.676+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d80cd3e0 con 0x7f08d80c7580 2024-09-16T07:31:20.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.680+0000 7f08ce000640 1 -- 172.21.15.114:0/1658084703 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f08d0003840 con 0x7f08d80c7580 2024-09-16T07:31:20.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.680+0000 7f08ce000640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f08b8073070 0x7f08b8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:20.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.680+0000 7f08ce000640 1 -- 172.21.15.114:0/1658084703 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f08d0131aa0 con 0x7f08d80c7580 2024-09-16T07:31:20.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.680+0000 7f08d5e00640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f08b8073070 0x7f08b8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:20.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.680+0000 7f08d5e00640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f08b8073070 0x7f08b8075530 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009f10 tx=0x7f08c8009500 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:20.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.684+0000 7f08ce000640 1 -- 172.21.15.114:0/1658084703 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f08d00c2060 con 0x7f08d80c7580 2024-09-16T07:31:20.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:20.892+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f08d815b800 con 0x7f08d80c7580 2024-09-16T07:31:21.753 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-09-16T07:31:21.756+0000 7f981c200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:31:21.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08ce000640 1 -- 172.21.15.114:0/1658084703 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7f08d0019380 con 0x7f08d80c7580 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f08b8073070 msgr2=0x7f08b8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f08b8073070 0x7f08b8075530 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009f10 tx=0x7f08c8009500 comp rx=0 tx=0).stop 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d80c7580 msgr2=0x7f08d8150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d80c7580 0x7f08d8150d30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08d0006f90 tx=0x7f08d00013c0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 shutdown_connections 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f08b8073070 0x7f08b8075530 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d80c7580 0x7f08d8150d30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d80b5e70 0x7f08d815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 --2- 172.21.15.114:0/1658084703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08bc004d50 0x7f08d81f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 >> 172.21.15.114:0/1658084703 conn(0x7f08d809aa10 msgr2=0x7f08d80c8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 shutdown_connections 2024-09-16T07:31:21.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.800+0000 7f08d7200640 1 -- 172.21.15.114:0/1658084703 wait complete. 2024-09-16T07:31:21.822 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:31:21.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:31:21.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 -- 172.21.15.114:0/858298124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c15f340 msgr2=0x7f246c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:21.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 --2- 172.21.15.114:0/858298124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c15f340 0x7f246c0b34a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f246c0742f0 tx=0x7f245c01c890 comp rx=0 tx=0).stop 2024-09-16T07:31:21.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 -- 172.21.15.114:0/858298124 shutdown_connections 2024-09-16T07:31:21.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 --2- 172.21.15.114:0/858298124 >> v2:172.21.15.149:3300/0 conn(0x7f246c0ccf10 0x7f246c0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 --2- 172.21.15.114:0/858298124 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c0b2a00 0x7f246c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 --2- 172.21.15.114:0/858298124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c15f340 0x7f246c0b34a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 -- 172.21.15.114:0/858298124 >> 172.21.15.114:0/858298124 conn(0x7f246c0d1e00 msgr2=0x7f246c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 -- 172.21.15.114:0/858298124 shutdown_connections 2024-09-16T07:31:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.972+0000 7f2473600640 1 -- 172.21.15.114:0/858298124 wait complete. 2024-09-16T07:31:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 Processor -- start 2024-09-16T07:31:21.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 -- start start 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c0b2a00 0x7f246c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c0ccf10 0x7f246c0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c15f340 0x7f246c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f246c0b1a90 con 0x7f246c0ccf10 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f246c0b1910 con 0x7f246c0b2a00 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f246c0b1c10 con 0x7f246c15f340 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c0ccf10 0x7f246c0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c0ccf10 0x7f246c0b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43260/0 (socket says 172.21.15.114:43260) 2024-09-16T07:31:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 -- 172.21.15.114:0/1651001019 learned_addr learned my addr 172.21.15.114:0/1651001019 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2470c00640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c0b2a00 0x7f246c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2471600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c15f340 0x7f246c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 -- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c15f340 msgr2=0x7f246c157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c15f340 0x7f246c157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 -- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c0b2a00 msgr2=0x7f246c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c0b2a00 0x7f246c141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 -- 172.21.15.114:0/1651001019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246c156dc0 con 0x7f246c0ccf10 2024-09-16T07:31:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2463e00640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c0ccf10 0x7f246c0b7320 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f245400d750 tx=0x7f245400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2469600640 1 -- 172.21.15.114:0/1651001019 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454017020 con 0x7f246c0ccf10 2024-09-16T07:31:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2469600640 1 -- 172.21.15.114:0/1651001019 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24540097c0 con 0x7f246c0ccf10 2024-09-16T07:31:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2469600640 1 -- 172.21.15.114:0/1651001019 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245400de60 con 0x7f246c0ccf10 2024-09-16T07:31:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246c1570a0 con 0x7f246c0ccf10 2024-09-16T07:31:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f246c157660 con 0x7f246c0ccf10 2024-09-16T07:31:21.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.976+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246c0cd3a0 con 0x7f246c0ccf10 2024-09-16T07:31:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.980+0000 7f2469600640 1 -- 172.21.15.114:0/1651001019 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f245401a020 con 0x7f246c0ccf10 2024-09-16T07:31:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.980+0000 7f2469600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2448073070 0x7f2448075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.980+0000 7f2469600640 1 -- 172.21.15.114:0/1651001019 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f24540945a0 con 0x7f246c0ccf10 2024-09-16T07:31:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.980+0000 7f2470c00640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2448073070 0x7f2448075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.980+0000 7f2470c00640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2448073070 0x7f2448075530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f245c0af000 tx=0x7f245c0a7040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:21.984+0000 7f2469600640 1 -- 172.21.15.114:0/1651001019 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2454021020 con 0x7f246c0ccf10 2024-09-16T07:31:22.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.188+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f246c159110 con 0x7f246c0ccf10 2024-09-16T07:31:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.800+0000 7f2469600640 1 -- 172.21.15.114:0/1651001019 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f245405ed70 con 0x7f246c0ccf10 2024-09-16T07:31:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2448073070 msgr2=0x7f2448075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2448073070 0x7f2448075530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f245c0af000 tx=0x7f245c0a7040 comp rx=0 tx=0).stop 2024-09-16T07:31:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c0ccf10 msgr2=0x7f246c0b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c0ccf10 0x7f246c0b7320 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f245400d750 tx=0x7f245400dc10 comp rx=0 tx=0).stop 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 shutdown_connections 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2448073070 0x7f2448075530 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c15f340 0x7f246c157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f246c0ccf10 0x7f246c0b7320 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 --2- 172.21.15.114:0/1651001019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c0b2a00 0x7f246c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 >> 172.21.15.114:0/1651001019 conn(0x7f246c0d1e00 msgr2=0x7f246c1598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 shutdown_connections 2024-09-16T07:31:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.804+0000 7f2473600640 1 -- 172.21.15.114:0/1651001019 wait complete. 2024-09-16T07:31:22.823 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:31:22.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 -- 172.21.15.114:0/1892452917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc15dba0 msgr2=0x7f31dc0add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 --2- 172.21.15.114:0/1892452917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc15dba0 0x7f31dc0add50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009840 tx=0x7f31d001c820 comp rx=0 tx=0).stop 2024-09-16T07:31:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 -- 172.21.15.114:0/1892452917 shutdown_connections 2024-09-16T07:31:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 --2- 172.21.15.114:0/1892452917 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31dc0744c0 0x7f31dc0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 --2- 172.21.15.114:0/1892452917 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc15dba0 0x7f31dc0add50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 -- 172.21.15.114:0/1892452917 >> 172.21.15.114:0/1892452917 conn(0x7f31dc06dd30 msgr2=0x7f31dc06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 -- 172.21.15.114:0/1892452917 shutdown_connections 2024-09-16T07:31:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 -- 172.21.15.114:0/1892452917 wait complete. 2024-09-16T07:31:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.968+0000 7f31e3800640 1 Processor -- start 2024-09-16T07:31:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 -- start start 2024-09-16T07:31:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc0744c0 0x7f31dc0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31dc15dba0 0x7f31dc154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31dc15df80 0x7f31dc146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc16b0d0 con 0x7f31dc0744c0 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc16af50 con 0x7f31dc15df80 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc16b250 con 0x7f31dc15dba0 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc0744c0 0x7f31dc0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc0744c0 0x7f31dc0b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43278/0 (socket says 172.21.15.114:43278) 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 -- 172.21.15.114:0/3864350062 learned_addr learned my addr 172.21.15.114:0/3864350062 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e1800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31dc15df80 0x7f31dc146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31dbe00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31dc15dba0 0x7f31dc154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 -- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31dc15dba0 msgr2=0x7f31dc154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:22.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31dc15dba0 0x7f31dc154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 -- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31dc15df80 msgr2=0x7f31dc146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31dc15df80 0x7f31dc146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 -- 172.21.15.114:0/3864350062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc0b1b30 con 0x7f31dc0744c0 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e1800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31dc15df80 0x7f31dc146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31dbe00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31dc15dba0 0x7f31dc154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e0e00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc0744c0 0x7f31dc0b28b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009790 tx=0x7f31d00a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31d8c00640 1 -- 172.21.15.114:0/3864350062 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b2040 con 0x7f31dc0744c0 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31d8c00640 1 -- 172.21.15.114:0/3864350062 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31d00044b0 con 0x7f31dc0744c0 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc0b1dd0 con 0x7f31dc0744c0 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31d8c00640 1 -- 172.21.15.114:0/3864350062 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0005280 con 0x7f31dc0744c0 2024-09-16T07:31:22.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc0b2390 con 0x7f31dc0744c0 2024-09-16T07:31:22.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.972+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31dc0b54c0 con 0x7f31dc0744c0 2024-09-16T07:31:22.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.976+0000 7f31d8c00640 1 -- 172.21.15.114:0/3864350062 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f31d00be060 con 0x7f31dc0744c0 2024-09-16T07:31:22.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.976+0000 7f31d8c00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31bc073070 0x7f31bc075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:22.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.976+0000 7f31d8c00640 1 -- 172.21.15.114:0/3864350062 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f31d012dab0 con 0x7f31dc0744c0 2024-09-16T07:31:22.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.976+0000 7f31dbe00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31bc073070 0x7f31bc075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:22.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.976+0000 7f31dbe00640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31bc073070 0x7f31bc075530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0b0920 tx=0x7f31c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:22.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:22.980+0000 7f31d8c00640 1 -- 172.21.15.114:0/3864350062 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f31d0016410 con 0x7f31dc0744c0 2024-09-16T07:31:23.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.180+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31dc0ae670 con 0x7f31dc0744c0 2024-09-16T07:31:23.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.180+0000 7f31d8c00640 1 -- 172.21.15.114:0/3864350062 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5229 (secure 0 0 0) 0x7f31d00f8a00 con 0x7f31dc0744c0 2024-09-16T07:31:23.180 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:23.180 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"btime":"2024-09-16T07:31:22:800560+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/204209379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":204209379},{"type":"v1","addr":"172.21.15.149:6836","nonce":204209379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1846247659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1846247659},{"type":"v1","addr":"172.21.15.149:6837","nonce":1846247659}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/350567716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":350567716},{"type":"v1","addr":"172.21.15.114:6833","nonce":350567716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:31:19.162681+0000","modified":"2024-09-16T07:31:22.188961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1633021756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1633021756},{"type":"v1","addr":"172.21.15.114:6835","nonce":1633021756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5769,"qdb_cluster":[5769]},"id":4}]} 2024-09-16T07:31:23.180 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 36 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31bc073070 msgr2=0x7f31bc075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31bc073070 0x7f31bc075530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0b0920 tx=0x7f31c8009040 comp rx=0 tx=0).stop 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc0744c0 msgr2=0x7f31dc0b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc0744c0 0x7f31dc0b28b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009790 tx=0x7f31d00a5750 comp rx=0 tx=0).stop 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 shutdown_connections 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31bc073070 0x7f31bc075530 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31dc15df80 0x7f31dc146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31dc15dba0 0x7f31dc154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 --2- 172.21.15.114:0/3864350062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31dc0744c0 0x7f31dc0b28b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 >> 172.21.15.114:0/3864350062 conn(0x7f31dc06dd30 msgr2=0x7f31dc15cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 shutdown_connections 2024-09-16T07:31:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.184+0000 7f31e3800640 1 -- 172.21.15.114:0/3864350062 wait complete. 2024-09-16T07:31:23.201 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:23.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 -- 172.21.15.114:0/2789041470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b11a0 msgr2=0x7fe16c165670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 --2- 172.21.15.114:0/2789041470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b11a0 0x7fe16c165670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe164009c80 tx=0x7fe16401cda0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 -- 172.21.15.114:0/2789041470 shutdown_connections 2024-09-16T07:31:23.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 --2- 172.21.15.114:0/2789041470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b11a0 0x7fe16c165670 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 --2- 172.21.15.114:0/2789041470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c0b0ce0 0x7fe16c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 -- 172.21.15.114:0/2789041470 >> 172.21.15.114:0/2789041470 conn(0x7fe16c09aa10 msgr2=0x7fe16c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:23.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 -- 172.21.15.114:0/2789041470 shutdown_connections 2024-09-16T07:31:23.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.344+0000 7fe172200640 1 -- 172.21.15.114:0/2789041470 wait complete. 2024-09-16T07:31:23.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 Processor -- start 2024-09-16T07:31:23.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 -- start start 2024-09-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe16c0b0ce0 0x7fe16c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c0b11a0 0x7fe16c155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b4d80 0x7fe16c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c168a30 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c1688b0 con 0x7fe16c0b4d80 2024-09-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c168bb0 con 0x7fe16c0b11a0 2024-09-16T07:31:23.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe16c0b0ce0 0x7fe16c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe16c0b0ce0 0x7fe16c15aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43280/0 (socket says 172.21.15.114:43280) 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 -- 172.21.15.114:0/473690377 learned_addr learned my addr 172.21.15.114:0/473690377 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe171800640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b4d80 0x7fe16c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe16be00640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c0b11a0 0x7fe16c155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 -- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c0b11a0 msgr2=0x7fe16c155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c0b11a0 0x7fe16c155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 -- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b4d80 msgr2=0x7fe16c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b4d80 0x7fe16c155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 -- 172.21.15.114:0/473690377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c1facc0 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe170e00640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe16c0b0ce0 0x7fe16c15aee0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c3c0 tx=0x7fe16000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe168c00640 1 -- 172.21.15.114:0/473690377 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160017070 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe168c00640 1 -- 172.21.15.114:0/473690377 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1600053c0 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe168c00640 1 -- 172.21.15.114:0/473690377 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160003860 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c1fafa0 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c1fb560 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.348+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c0b5160 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.352+0000 7fe168c00640 1 -- 172.21.15.114:0/473690377 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fe16001a070 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.352+0000 7fe168c00640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe14c073070 0x7fe14c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.352+0000 7fe168c00640 1 -- 172.21.15.114:0/473690377 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe1600934a0 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.352+0000 7fe16be00640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe14c073070 0x7fe14c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.352+0000 7fe16be00640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe14c073070 0x7fe14c075530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe16c15ba00 tx=0x7fe1580091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:23.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.356+0000 7fe168c00640 1 -- 172.21.15.114:0/473690377 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe16005dd00 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.524+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe16c158150 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe168c00640 1 -- 172.21.15.114:0/473690377 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16773 (secure 0 0 0) 0x7fe160062730 con 0x7fe16c0b0ce0 2024-09-16T07:31:23.525 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:23.525 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:31:20.774072+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:31:16.866132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-16T07:31:18.131366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe14c073070 msgr2=0x7fe14c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe14c073070 0x7fe14c075530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe16c15ba00 tx=0x7fe1580091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe16c0b0ce0 msgr2=0x7fe16c15aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe16c0b0ce0 0x7fe16c15aee0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c3c0 tx=0x7fe16000c880 comp rx=0 tx=0).stop 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 shutdown_connections 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe14c073070 0x7fe14c075530 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe16c0b4d80 0x7fe16c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe16c0b11a0 0x7fe16c155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 --2- 172.21.15.114:0/473690377 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe16c0b0ce0 0x7fe16c15aee0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 >> 172.21.15.114:0/473690377 conn(0x7fe16c09aa10 msgr2=0x7fe16c14f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 shutdown_connections 2024-09-16T07:31:23.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.528+0000 7fe172200640 1 -- 172.21.15.114:0/473690377 wait complete. 2024-09-16T07:31:23.547 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:31:23.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:31:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 -- 172.21.15.114:0/3716816455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 msgr2=0x7f5b4c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 --2- 172.21.15.114:0/3716816455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 0x7f5b4c0cc940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009870 tx=0x7f5b3401c740 comp rx=0 tx=0).stop 2024-09-16T07:31:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 -- 172.21.15.114:0/3716816455 shutdown_connections 2024-09-16T07:31:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 --2- 172.21.15.114:0/3716816455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 0x7f5b4c0cc940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 -- 172.21.15.114:0/3716816455 >> 172.21.15.114:0/3716816455 conn(0x7f5b4c0d1ea0 msgr2=0x7f5b4c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 -- 172.21.15.114:0/3716816455 shutdown_connections 2024-09-16T07:31:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 -- 172.21.15.114:0/3716816455 wait complete. 2024-09-16T07:31:23.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 Processor -- start 2024-09-16T07:31:23.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.692+0000 7f5b50e00640 1 -- start start 2024-09-16T07:31:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 0x7f5b4c167220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b4c15bd50 0x7f5b4c0b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4c15c130 0x7f5b4c0b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c16a600 con 0x7f5b4c15bd50 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c16a480 con 0x7f5b4c15c130 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4c16a780 con 0x7f5b4c0cecf0 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b4c15bd50 0x7f5b4c0b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b4c15bd50 0x7f5b4c0b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43296/0 (socket says 172.21.15.114:43296) 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 -- 172.21.15.114:0/1569464736 learned_addr learned my addr 172.21.15.114:0/1569464736 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b49e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 0x7f5b4c167220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b4a800640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4c15c130 0x7f5b4c0b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 -- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 msgr2=0x7f5b4c167220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 0x7f5b4c167220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 -- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4c15c130 msgr2=0x7f5b4c0b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4c15c130 0x7f5b4c0b7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 -- 172.21.15.114:0/1569464736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4c167760 con 0x7f5b4c15bd50 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b4a800640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4c15c130 0x7f5b4c0b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b41400640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b4c15bd50 0x7f5b4c0b6c40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5b34019350 tx=0x7f5b34005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b42a00640 1 -- 172.21.15.114:0/1569464736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b340b2040 con 0x7f5b4c15bd50 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b42a00640 1 -- 172.21.15.114:0/1569464736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b34004130 con 0x7f5b4c15bd50 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4c06f340 con 0x7f5b4c15bd50 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b42a00640 1 -- 172.21.15.114:0/1569464736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34003600 con 0x7f5b4c15bd50 2024-09-16T07:31:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4c06f900 con 0x7f5b4c15bd50 2024-09-16T07:31:23.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.696+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b4c0ce5e0 con 0x7f5b4c15bd50 2024-09-16T07:31:23.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.700+0000 7f5b42a00640 1 -- 172.21.15.114:0/1569464736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f5b340bd030 con 0x7f5b4c15bd50 2024-09-16T07:31:23.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.700+0000 7f5b42a00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5b28073070 0x7f5b28075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:23.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.700+0000 7f5b42a00640 1 -- 172.21.15.114:0/1569464736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f5b3412e930 con 0x7f5b4c15bd50 2024-09-16T07:31:23.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.700+0000 7f5b49e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5b28073070 0x7f5b28075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:23.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.700+0000 7f5b49e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5b28073070 0x7f5b28075530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c007a80 tx=0x7f5b3c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:23.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.700+0000 7f5b42a00640 1 -- 172.21.15.114:0/1569464736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5b340c4020 con 0x7f5b4c15bd50 2024-09-16T07:31:23.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.868+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b4c070ef0 con 0x7f5b28073070 2024-09-16T07:31:23.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.872+0000 7f5b42a00640 1 -- 172.21.15.114:0/1569464736 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251446 (secure 0 0 0) 0x7f5b4c070ef0 con 0x7f5b28073070 2024-09-16T07:31:23.874 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:23.876 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:31:23.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5b28073070 msgr2=0x7f5b28075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5b28073070 0x7f5b28075530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c007a80 tx=0x7f5b3c009040 comp rx=0 tx=0).stop 2024-09-16T07:31:23.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b4c15bd50 msgr2=0x7f5b4c0b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b4c15bd50 0x7f5b4c0b6c40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5b34019350 tx=0x7f5b34005790 comp rx=0 tx=0).stop 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 shutdown_connections 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5b28073070 0x7f5b28075530 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b4c15c130 0x7f5b4c0b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b4c15bd50 0x7f5b4c0b6c40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 --2- 172.21.15.114:0/1569464736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b4c0cecf0 0x7f5b4c167220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 >> 172.21.15.114:0/1569464736 conn(0x7f5b4c0d1ea0 msgr2=0x7f5b4c071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 shutdown_connections 2024-09-16T07:31:23.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:23.876+0000 7f5b50e00640 1 -- 172.21.15.114:0/1569464736 wait complete. 2024-09-16T07:31:23.895 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-16T07:31:23.039515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226696,"kb_used_data":6288,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748024,"statfs":{"total":773094113280,"available":772861976576,"internally_reserved":0,"allocated":6438912,"data_stored":3315532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.283420"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.779883+0000","last_change":"2024-09-16T07:31:18.779883+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.779883+0000","last_undegraded":"2024-09-16T07:31:18.779883+0000","last_fullsized":"2024-09-16T07:31:18.779883+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806143+0000","last_change":"2024-09-16T07:31:19.795452+0000","last_active":"2024-09-16T07:31:19.806143+0000","last_peered":"2024-09-16T07:31:19.806143+0000","last_clean":"2024-09-16T07:31:19.806143+0000","last_became_active":"2024-09-16T07:31:19.794937+0000","last_became_peered":"2024-09-16T07:31:19.794937+0000","last_unstale":"2024-09-16T07:31:19.806143+0000","last_undegraded":"2024-09-16T07:31:19.806143+0000","last_fullsized":"2024-09-16T07:31:19.806143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:26.321325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799151+0000","last_change":"2024-09-16T07:31:19.792532+0000","last_active":"2024-09-16T07:31:19.799151+0000","last_peered":"2024-09-16T07:31:19.799151+0000","last_clean":"2024-09-16T07:31:19.799151+0000","last_became_active":"2024-09-16T07:31:19.792301+0000","last_became_peered":"2024-09-16T07:31:19.792301+0000","last_unstale":"2024-09-16T07:31:19.799151+0000","last_undegraded":"2024-09-16T07:31:19.799151+0000","last_fullsized":"2024-09-16T07:31:19.799151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:52.057630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795356+0000","last_change":"2024-09-16T07:31:19.789467+0000","last_active":"2024-09-16T07:31:19.795356+0000","last_peered":"2024-09-16T07:31:19.795356+0000","last_clean":"2024-09-16T07:31:19.795356+0000","last_became_active":"2024-09-16T07:31:19.789174+0000","last_became_peered":"2024-09-16T07:31:19.789174+0000","last_unstale":"2024-09-16T07:31:19.795356+0000","last_undegraded":"2024-09-16T07:31:19.795356+0000","last_fullsized":"2024-09-16T07:31:19.795356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773895+0000","last_change":"2024-09-16T07:31:18.773895+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773895+0000","last_undegraded":"2024-09-16T07:31:18.773895+0000","last_fullsized":"2024-09-16T07:31:18.773895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806161+0000","last_change":"2024-09-16T07:31:19.802298+0000","last_active":"2024-09-16T07:31:19.806161+0000","last_peered":"2024-09-16T07:31:19.806161+0000","last_clean":"2024-09-16T07:31:19.806161+0000","last_became_active":"2024-09-16T07:31:19.802043+0000","last_became_peered":"2024-09-16T07:31:19.802043+0000","last_unstale":"2024-09-16T07:31:19.806161+0000","last_undegraded":"2024-09-16T07:31:19.806161+0000","last_fullsized":"2024-09-16T07:31:19.806161+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800986+0000","last_change":"2024-09-16T07:31:19.794748+0000","last_active":"2024-09-16T07:31:19.800986+0000","last_peered":"2024-09-16T07:31:19.800986+0000","last_clean":"2024-09-16T07:31:19.800986+0000","last_became_active":"2024-09-16T07:31:19.794494+0000","last_became_peered":"2024-09-16T07:31:19.794494+0000","last_unstale":"2024-09-16T07:31:19.800986+0000","last_undegraded":"2024-09-16T07:31:19.800986+0000","last_fullsized":"2024-09-16T07:31:19.800986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.056578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806635+0000","last_change":"2024-09-16T07:31:19.796360+0000","last_active":"2024-09-16T07:31:19.806635+0000","last_peered":"2024-09-16T07:31:19.806635+0000","last_clean":"2024-09-16T07:31:19.806635+0000","last_became_active":"2024-09-16T07:31:19.796075+0000","last_became_peered":"2024-09-16T07:31:19.796075+0000","last_unstale":"2024-09-16T07:31:19.806635+0000","last_undegraded":"2024-09-16T07:31:19.806635+0000","last_fullsized":"2024-09-16T07:31:19.806635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:07:28.758872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805823+0000","last_change":"2024-09-16T07:31:19.800757+0000","last_active":"2024-09-16T07:31:19.805823+0000","last_peered":"2024-09-16T07:31:19.805823+0000","last_clean":"2024-09-16T07:31:19.805823+0000","last_became_active":"2024-09-16T07:31:19.800483+0000","last_became_peered":"2024-09-16T07:31:19.800483+0000","last_unstale":"2024-09-16T07:31:19.805823+0000","last_undegraded":"2024-09-16T07:31:19.805823+0000","last_fullsized":"2024-09-16T07:31:19.805823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:25.288132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804028+0000","last_change":"2024-09-16T07:31:19.798727+0000","last_active":"2024-09-16T07:31:19.804028+0000","last_peered":"2024-09-16T07:31:19.804028+0000","last_clean":"2024-09-16T07:31:19.804028+0000","last_became_active":"2024-09-16T07:31:19.798309+0000","last_became_peered":"2024-09-16T07:31:19.798309+0000","last_unstale":"2024-09-16T07:31:19.804028+0000","last_undegraded":"2024-09-16T07:31:19.804028+0000","last_fullsized":"2024-09-16T07:31:19.804028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:57.608168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799535+0000","last_change":"2024-09-16T07:31:19.792993+0000","last_active":"2024-09-16T07:31:19.799535+0000","last_peered":"2024-09-16T07:31:19.799535+0000","last_clean":"2024-09-16T07:31:19.799535+0000","last_became_active":"2024-09-16T07:31:19.792461+0000","last_became_peered":"2024-09-16T07:31:19.792461+0000","last_unstale":"2024-09-16T07:31:19.799535+0000","last_undegraded":"2024-09-16T07:31:19.799535+0000","last_fullsized":"2024-09-16T07:31:19.799535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:34.182317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795330+0000","last_change":"2024-09-16T07:31:19.788824+0000","last_active":"2024-09-16T07:31:19.795330+0000","last_peered":"2024-09-16T07:31:19.795330+0000","last_clean":"2024-09-16T07:31:19.795330+0000","last_became_active":"2024-09-16T07:31:19.788477+0000","last_became_peered":"2024-09-16T07:31:19.788477+0000","last_unstale":"2024-09-16T07:31:19.795330+0000","last_undegraded":"2024-09-16T07:31:19.795330+0000","last_fullsized":"2024-09-16T07:31:19.795330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801156+0000","last_change":"2024-09-16T07:31:19.795230+0000","last_active":"2024-09-16T07:31:19.801156+0000","last_peered":"2024-09-16T07:31:19.801156+0000","last_clean":"2024-09-16T07:31:19.801156+0000","last_became_active":"2024-09-16T07:31:19.794956+0000","last_became_peered":"2024-09-16T07:31:19.794956+0000","last_unstale":"2024-09-16T07:31:19.801156+0000","last_undegraded":"2024-09-16T07:31:19.801156+0000","last_fullsized":"2024-09-16T07:31:19.801156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:13.513689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797892+0000","last_change":"2024-09-16T07:31:19.789254+0000","last_active":"2024-09-16T07:31:19.797892+0000","last_peered":"2024-09-16T07:31:19.797892+0000","last_clean":"2024-09-16T07:31:19.797892+0000","last_became_active":"2024-09-16T07:31:19.788561+0000","last_became_peered":"2024-09-16T07:31:19.788561+0000","last_unstale":"2024-09-16T07:31:19.797892+0000","last_undegraded":"2024-09-16T07:31:19.797892+0000","last_fullsized":"2024-09-16T07:31:19.797892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:14.672043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799005+0000","last_change":"2024-09-16T07:31:19.790415+0000","last_active":"2024-09-16T07:31:19.799005+0000","last_peered":"2024-09-16T07:31:19.799005+0000","last_clean":"2024-09-16T07:31:19.799005+0000","last_became_active":"2024-09-16T07:31:19.789977+0000","last_became_peered":"2024-09-16T07:31:19.789977+0000","last_unstale":"2024-09-16T07:31:19.799005+0000","last_undegraded":"2024-09-16T07:31:19.799005+0000","last_fullsized":"2024-09-16T07:31:19.799005+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:52.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808322+0000","last_change":"2024-09-16T07:31:19.803450+0000","last_active":"2024-09-16T07:31:19.808322+0000","last_peered":"2024-09-16T07:31:19.808322+0000","last_clean":"2024-09-16T07:31:19.808322+0000","last_became_active":"2024-09-16T07:31:19.803117+0000","last_became_peered":"2024-09-16T07:31:19.803117+0000","last_unstale":"2024-09-16T07:31:19.808322+0000","last_undegraded":"2024-09-16T07:31:19.808322+0000","last_fullsized":"2024-09-16T07:31:19.808322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:39.017272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807576+0000","last_change":"2024-09-16T07:31:19.798737+0000","last_active":"2024-09-16T07:31:19.807576+0000","last_peered":"2024-09-16T07:31:19.807576+0000","last_clean":"2024-09-16T07:31:19.807576+0000","last_became_active":"2024-09-16T07:31:19.798489+0000","last_became_peered":"2024-09-16T07:31:19.798489+0000","last_unstale":"2024-09-16T07:31:19.807576+0000","last_undegraded":"2024-09-16T07:31:19.807576+0000","last_fullsized":"2024-09-16T07:31:19.807576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:00:25.780049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805761+0000","last_change":"2024-09-16T07:31:19.800414+0000","last_active":"2024-09-16T07:31:19.805761+0000","last_peered":"2024-09-16T07:31:19.805761+0000","last_clean":"2024-09-16T07:31:19.805761+0000","last_became_active":"2024-09-16T07:31:19.798920+0000","last_became_peered":"2024-09-16T07:31:19.798920+0000","last_unstale":"2024-09-16T07:31:19.805761+0000","last_undegraded":"2024-09-16T07:31:19.805761+0000","last_fullsized":"2024-09-16T07:31:19.805761+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773446+0000","last_change":"2024-09-16T07:31:18.773446+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773446+0000","last_undegraded":"2024-09-16T07:31:18.773446+0000","last_fullsized":"2024-09-16T07:31:18.773446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808567+0000","last_change":"2024-09-16T07:31:19.802446+0000","last_active":"2024-09-16T07:31:19.808567+0000","last_peered":"2024-09-16T07:31:19.808567+0000","last_clean":"2024-09-16T07:31:19.808567+0000","last_became_active":"2024-09-16T07:31:19.802076+0000","last_became_peered":"2024-09-16T07:31:19.802076+0000","last_unstale":"2024-09-16T07:31:19.808567+0000","last_undegraded":"2024-09-16T07:31:19.808567+0000","last_fullsized":"2024-09-16T07:31:19.808567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:08.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800544+0000","last_change":"2024-09-16T07:31:19.797580+0000","last_active":"2024-09-16T07:31:19.800544+0000","last_peered":"2024-09-16T07:31:19.800544+0000","last_clean":"2024-09-16T07:31:19.800544+0000","last_became_active":"2024-09-16T07:31:19.796587+0000","last_became_peered":"2024-09-16T07:31:19.796587+0000","last_unstale":"2024-09-16T07:31:19.800544+0000","last_undegraded":"2024-09-16T07:31:19.800544+0000","last_fullsized":"2024-09-16T07:31:19.800544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807175+0000","last_change":"2024-09-16T07:31:19.792089+0000","last_active":"2024-09-16T07:31:19.807175+0000","last_peered":"2024-09-16T07:31:19.807175+0000","last_clean":"2024-09-16T07:31:19.807175+0000","last_became_active":"2024-09-16T07:31:19.790997+0000","last_became_peered":"2024-09-16T07:31:19.790997+0000","last_unstale":"2024-09-16T07:31:19.807175+0000","last_undegraded":"2024-09-16T07:31:19.807175+0000","last_fullsized":"2024-09-16T07:31:19.807175+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:14.300883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794491+0000","last_change":"2024-09-16T07:31:19.791289+0000","last_active":"2024-09-16T07:31:19.794491+0000","last_peered":"2024-09-16T07:31:19.794491+0000","last_clean":"2024-09-16T07:31:19.794491+0000","last_became_active":"2024-09-16T07:31:19.790974+0000","last_became_peered":"2024-09-16T07:31:19.790974+0000","last_unstale":"2024-09-16T07:31:19.794491+0000","last_undegraded":"2024-09-16T07:31:19.794491+0000","last_fullsized":"2024-09-16T07:31:19.794491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:32.744007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801740+0000","last_change":"2024-09-16T07:31:19.799545+0000","last_active":"2024-09-16T07:31:19.801740+0000","last_peered":"2024-09-16T07:31:19.801740+0000","last_clean":"2024-09-16T07:31:19.801740+0000","last_became_active":"2024-09-16T07:31:19.799285+0000","last_became_peered":"2024-09-16T07:31:19.799285+0000","last_unstale":"2024-09-16T07:31:19.801740+0000","last_undegraded":"2024-09-16T07:31:19.801740+0000","last_fullsized":"2024-09-16T07:31:19.801740+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:59.159780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.779252+0000","last_change":"2024-09-16T07:31:18.779252+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.779252+0000","last_undegraded":"2024-09-16T07:31:18.779252+0000","last_fullsized":"2024-09-16T07:31:18.779252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795481+0000","last_change":"2024-09-16T07:31:19.790142+0000","last_active":"2024-09-16T07:31:19.795481+0000","last_peered":"2024-09-16T07:31:19.795481+0000","last_clean":"2024-09-16T07:31:19.795481+0000","last_became_active":"2024-09-16T07:31:19.789787+0000","last_became_peered":"2024-09-16T07:31:19.789787+0000","last_unstale":"2024-09-16T07:31:19.795481+0000","last_undegraded":"2024-09-16T07:31:19.795481+0000","last_fullsized":"2024-09-16T07:31:19.795481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811562+0000","last_change":"2024-09-16T07:31:19.807204+0000","last_active":"2024-09-16T07:31:19.811562+0000","last_peered":"2024-09-16T07:31:19.811562+0000","last_clean":"2024-09-16T07:31:19.811562+0000","last_became_active":"2024-09-16T07:31:19.805182+0000","last_became_peered":"2024-09-16T07:31:19.805182+0000","last_unstale":"2024-09-16T07:31:19.811562+0000","last_undegraded":"2024-09-16T07:31:19.811562+0000","last_fullsized":"2024-09-16T07:31:19.811562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:57.879247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.774157+0000","last_change":"2024-09-16T07:31:18.774157+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.774157+0000","last_undegraded":"2024-09-16T07:31:18.774157+0000","last_fullsized":"2024-09-16T07:31:18.774157+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807063+0000","last_change":"2024-09-16T07:31:19.797676+0000","last_active":"2024-09-16T07:31:19.807063+0000","last_peered":"2024-09-16T07:31:19.807063+0000","last_clean":"2024-09-16T07:31:19.807063+0000","last_became_active":"2024-09-16T07:31:19.797402+0000","last_became_peered":"2024-09-16T07:31:19.797402+0000","last_unstale":"2024-09-16T07:31:19.807063+0000","last_undegraded":"2024-09-16T07:31:19.807063+0000","last_fullsized":"2024-09-16T07:31:19.807063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:29.989908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798939+0000","last_change":"2024-09-16T07:31:19.792014+0000","last_active":"2024-09-16T07:31:19.798939+0000","last_peered":"2024-09-16T07:31:19.798939+0000","last_clean":"2024-09-16T07:31:19.798939+0000","last_became_active":"2024-09-16T07:31:19.791672+0000","last_became_peered":"2024-09-16T07:31:19.791672+0000","last_unstale":"2024-09-16T07:31:19.798939+0000","last_undegraded":"2024-09-16T07:31:19.798939+0000","last_fullsized":"2024-09-16T07:31:19.798939+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773588+0000","last_change":"2024-09-16T07:31:18.773588+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773588+0000","last_undegraded":"2024-09-16T07:31:18.773588+0000","last_fullsized":"2024-09-16T07:31:18.773588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811630+0000","last_change":"2024-09-16T07:31:19.809602+0000","last_active":"2024-09-16T07:31:19.811630+0000","last_peered":"2024-09-16T07:31:19.811630+0000","last_clean":"2024-09-16T07:31:19.811630+0000","last_became_active":"2024-09-16T07:31:19.809274+0000","last_became_peered":"2024-09-16T07:31:19.809274+0000","last_unstale":"2024-09-16T07:31:19.811630+0000","last_undegraded":"2024-09-16T07:31:19.811630+0000","last_fullsized":"2024-09-16T07:31:19.811630+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:38.553253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804808+0000","last_change":"2024-09-16T07:31:19.798550+0000","last_active":"2024-09-16T07:31:19.804808+0000","last_peered":"2024-09-16T07:31:19.804808+0000","last_clean":"2024-09-16T07:31:19.804808+0000","last_became_active":"2024-09-16T07:31:19.798280+0000","last_became_peered":"2024-09-16T07:31:19.798280+0000","last_unstale":"2024-09-16T07:31:19.804808+0000","last_undegraded":"2024-09-16T07:31:19.804808+0000","last_fullsized":"2024-09-16T07:31:19.804808+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822443+0000","last_change":"2024-09-16T07:31:18.788213+0000","last_active":"2024-09-16T07:31:19.822443+0000","last_peered":"2024-09-16T07:31:19.822443+0000","last_clean":"2024-09-16T07:31:19.822443+0000","last_became_active":"2024-09-16T07:31:18.787961+0000","last_became_peered":"2024-09-16T07:31:18.787961+0000","last_unstale":"2024-09-16T07:31:19.822443+0000","last_undegraded":"2024-09-16T07:31:19.822443+0000","last_fullsized":"2024-09-16T07:31:19.822443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:56.115404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797411+0000","last_change":"2024-09-16T07:31:19.789278+0000","last_active":"2024-09-16T07:31:19.797411+0000","last_peered":"2024-09-16T07:31:19.797411+0000","last_clean":"2024-09-16T07:31:19.797411+0000","last_became_active":"2024-09-16T07:31:19.789015+0000","last_became_peered":"2024-09-16T07:31:19.789015+0000","last_unstale":"2024-09-16T07:31:19.797411+0000","last_undegraded":"2024-09-16T07:31:19.797411+0000","last_fullsized":"2024-09-16T07:31:19.797411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:56.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817335+0000","last_change":"2024-09-16T07:31:18.775898+0000","last_active":"2024-09-16T07:31:19.817335+0000","last_peered":"2024-09-16T07:31:19.817335+0000","last_clean":"2024-09-16T07:31:19.817335+0000","last_became_active":"2024-09-16T07:31:18.775575+0000","last_became_peered":"2024-09-16T07:31:18.775575+0000","last_unstale":"2024-09-16T07:31:19.817335+0000","last_undegraded":"2024-09-16T07:31:19.817335+0000","last_fullsized":"2024-09-16T07:31:19.817335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:56.258821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808350+0000","last_change":"2024-09-16T07:31:19.804592+0000","last_active":"2024-09-16T07:31:19.808350+0000","last_peered":"2024-09-16T07:31:19.808350+0000","last_clean":"2024-09-16T07:31:19.808350+0000","last_became_active":"2024-09-16T07:31:19.803010+0000","last_became_peered":"2024-09-16T07:31:19.803010+0000","last_unstale":"2024-09-16T07:31:19.808350+0000","last_undegraded":"2024-09-16T07:31:19.808350+0000","last_fullsized":"2024-09-16T07:31:19.808350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:48.737794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820706+0000","last_change":"2024-09-16T07:31:18.794664+0000","last_active":"2024-09-16T07:31:19.820706+0000","last_peered":"2024-09-16T07:31:19.820706+0000","last_clean":"2024-09-16T07:31:19.820706+0000","last_became_active":"2024-09-16T07:31:18.794418+0000","last_became_peered":"2024-09-16T07:31:18.794418+0000","last_unstale":"2024-09-16T07:31:19.820706+0000","last_undegraded":"2024-09-16T07:31:19.820706+0000","last_fullsized":"2024-09-16T07:31:19.820706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811324+0000","last_change":"2024-09-16T07:31:19.805940+0000","last_active":"2024-09-16T07:31:19.811324+0000","last_peered":"2024-09-16T07:31:19.811324+0000","last_clean":"2024-09-16T07:31:19.811324+0000","last_became_active":"2024-09-16T07:31:19.804922+0000","last_became_peered":"2024-09-16T07:31:19.804922+0000","last_unstale":"2024-09-16T07:31:19.811324+0000","last_undegraded":"2024-09-16T07:31:19.811324+0000","last_fullsized":"2024-09-16T07:31:19.811324+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:10.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819227+0000","last_change":"2024-09-16T07:31:18.772762+0000","last_active":"2024-09-16T07:31:19.819227+0000","last_peered":"2024-09-16T07:31:19.819227+0000","last_clean":"2024-09-16T07:31:19.819227+0000","last_became_active":"2024-09-16T07:31:18.772483+0000","last_became_peered":"2024-09-16T07:31:18.772483+0000","last_unstale":"2024-09-16T07:31:19.819227+0000","last_undegraded":"2024-09-16T07:31:19.819227+0000","last_fullsized":"2024-09-16T07:31:19.819227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.791961+0000","last_change":"2024-09-16T07:31:19.788175+0000","last_active":"2024-09-16T07:31:19.791961+0000","last_peered":"2024-09-16T07:31:19.791961+0000","last_clean":"2024-09-16T07:31:19.791961+0000","last_became_active":"2024-09-16T07:31:19.787903+0000","last_became_peered":"2024-09-16T07:31:19.787903+0000","last_unstale":"2024-09-16T07:31:19.791961+0000","last_undegraded":"2024-09-16T07:31:19.791961+0000","last_fullsized":"2024-09-16T07:31:19.791961+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:00:10.456768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815080+0000","last_change":"2024-09-16T07:31:18.779878+0000","last_active":"2024-09-16T07:31:19.815080+0000","last_peered":"2024-09-16T07:31:19.815080+0000","last_clean":"2024-09-16T07:31:19.815080+0000","last_became_active":"2024-09-16T07:31:18.779587+0000","last_became_peered":"2024-09-16T07:31:18.779587+0000","last_unstale":"2024-09-16T07:31:19.815080+0000","last_undegraded":"2024-09-16T07:31:19.815080+0000","last_fullsized":"2024-09-16T07:31:19.815080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:12.686482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.810895+0000","last_change":"2024-09-16T07:31:19.808074+0000","last_active":"2024-09-16T07:31:19.810895+0000","last_peered":"2024-09-16T07:31:19.810895+0000","last_clean":"2024-09-16T07:31:19.810895+0000","last_became_active":"2024-09-16T07:31:19.807802+0000","last_became_peered":"2024-09-16T07:31:19.807802+0000","last_unstale":"2024-09-16T07:31:19.810895+0000","last_undegraded":"2024-09-16T07:31:19.810895+0000","last_fullsized":"2024-09-16T07:31:19.810895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:12.342419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819786+0000","last_change":"2024-09-16T07:31:18.789053+0000","last_active":"2024-09-16T07:31:19.819786+0000","last_peered":"2024-09-16T07:31:19.819786+0000","last_clean":"2024-09-16T07:31:19.819786+0000","last_became_active":"2024-09-16T07:31:18.788715+0000","last_became_peered":"2024-09-16T07:31:18.788715+0000","last_unstale":"2024-09-16T07:31:19.819786+0000","last_undegraded":"2024-09-16T07:31:19.819786+0000","last_fullsized":"2024-09-16T07:31:19.819786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:58.466722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801121+0000","last_change":"2024-09-16T07:31:19.794608+0000","last_active":"2024-09-16T07:31:19.801121+0000","last_peered":"2024-09-16T07:31:19.801121+0000","last_clean":"2024-09-16T07:31:19.801121+0000","last_became_active":"2024-09-16T07:31:19.794301+0000","last_became_peered":"2024-09-16T07:31:19.794301+0000","last_unstale":"2024-09-16T07:31:19.801121+0000","last_undegraded":"2024-09-16T07:31:19.801121+0000","last_fullsized":"2024-09-16T07:31:19.801121+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:24.874172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778682+0000","last_change":"2024-09-16T07:31:18.777720+0000","last_active":"2024-09-16T07:31:19.778682+0000","last_peered":"2024-09-16T07:31:19.778682+0000","last_clean":"2024-09-16T07:31:19.778682+0000","last_became_active":"2024-09-16T07:31:18.777300+0000","last_became_peered":"2024-09-16T07:31:18.777300+0000","last_unstale":"2024-09-16T07:31:19.778682+0000","last_undegraded":"2024-09-16T07:31:19.778682+0000","last_fullsized":"2024-09-16T07:31:19.778682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799318+0000","last_change":"2024-09-16T07:31:19.789913+0000","last_active":"2024-09-16T07:31:19.799318+0000","last_peered":"2024-09-16T07:31:19.799318+0000","last_clean":"2024-09-16T07:31:19.799318+0000","last_became_active":"2024-09-16T07:31:19.787859+0000","last_became_peered":"2024-09-16T07:31:19.787859+0000","last_unstale":"2024-09-16T07:31:19.799318+0000","last_undegraded":"2024-09-16T07:31:19.799318+0000","last_fullsized":"2024-09-16T07:31:19.799318+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:01.143423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783613+0000","last_change":"2024-09-16T07:31:18.790293+0000","last_active":"2024-09-16T07:31:19.783613+0000","last_peered":"2024-09-16T07:31:19.783613+0000","last_clean":"2024-09-16T07:31:19.783613+0000","last_became_active":"2024-09-16T07:31:18.789971+0000","last_became_peered":"2024-09-16T07:31:18.789971+0000","last_unstale":"2024-09-16T07:31:19.783613+0000","last_undegraded":"2024-09-16T07:31:19.783613+0000","last_fullsized":"2024-09-16T07:31:19.783613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:02.508386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800242+0000","last_change":"2024-09-16T07:31:19.792022+0000","last_active":"2024-09-16T07:31:19.800242+0000","last_peered":"2024-09-16T07:31:19.800242+0000","last_clean":"2024-09-16T07:31:19.800242+0000","last_became_active":"2024-09-16T07:31:19.791203+0000","last_became_peered":"2024-09-16T07:31:19.791203+0000","last_unstale":"2024-09-16T07:31:19.800242+0000","last_undegraded":"2024-09-16T07:31:19.800242+0000","last_fullsized":"2024-09-16T07:31:19.800242+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:40.399078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777660+0000","last_change":"2024-09-16T07:31:18.786810+0000","last_active":"2024-09-16T07:31:19.777660+0000","last_peered":"2024-09-16T07:31:19.777660+0000","last_clean":"2024-09-16T07:31:19.777660+0000","last_became_active":"2024-09-16T07:31:18.786465+0000","last_became_peered":"2024-09-16T07:31:18.786465+0000","last_unstale":"2024-09-16T07:31:19.777660+0000","last_undegraded":"2024-09-16T07:31:19.777660+0000","last_fullsized":"2024-09-16T07:31:19.777660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799340+0000","last_change":"2024-09-16T07:31:19.795431+0000","last_active":"2024-09-16T07:31:19.799340+0000","last_peered":"2024-09-16T07:31:19.799340+0000","last_clean":"2024-09-16T07:31:19.799340+0000","last_became_active":"2024-09-16T07:31:19.795082+0000","last_became_peered":"2024-09-16T07:31:19.795082+0000","last_unstale":"2024-09-16T07:31:19.799340+0000","last_undegraded":"2024-09-16T07:31:19.799340+0000","last_fullsized":"2024-09-16T07:31:19.799340+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.786412+0000","last_change":"2024-09-16T07:31:18.782972+0000","last_active":"2024-09-16T07:31:19.786412+0000","last_peered":"2024-09-16T07:31:19.786412+0000","last_clean":"2024-09-16T07:31:19.786412+0000","last_became_active":"2024-09-16T07:31:18.782718+0000","last_became_peered":"2024-09-16T07:31:18.782718+0000","last_unstale":"2024-09-16T07:31:19.786412+0000","last_undegraded":"2024-09-16T07:31:19.786412+0000","last_fullsized":"2024-09-16T07:31:19.786412+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:51.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801851+0000","last_change":"2024-09-16T07:31:19.797122+0000","last_active":"2024-09-16T07:31:19.801851+0000","last_peered":"2024-09-16T07:31:19.801851+0000","last_clean":"2024-09-16T07:31:19.801851+0000","last_became_active":"2024-09-16T07:31:19.796492+0000","last_became_peered":"2024-09-16T07:31:19.796492+0000","last_unstale":"2024-09-16T07:31:19.801851+0000","last_undegraded":"2024-09-16T07:31:19.801851+0000","last_fullsized":"2024-09-16T07:31:19.801851+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:03.259826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.818627+0000","last_change":"2024-09-16T07:31:18.791265+0000","last_active":"2024-09-16T07:31:19.818627+0000","last_peered":"2024-09-16T07:31:19.818627+0000","last_clean":"2024-09-16T07:31:19.818627+0000","last_became_active":"2024-09-16T07:31:18.790938+0000","last_became_peered":"2024-09-16T07:31:18.790938+0000","last_unstale":"2024-09-16T07:31:19.818627+0000","last_undegraded":"2024-09-16T07:31:19.818627+0000","last_fullsized":"2024-09-16T07:31:19.818627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.802780+0000","last_change":"2024-09-16T07:31:19.799667+0000","last_active":"2024-09-16T07:31:19.802780+0000","last_peered":"2024-09-16T07:31:19.802780+0000","last_clean":"2024-09-16T07:31:19.802780+0000","last_became_active":"2024-09-16T07:31:19.798050+0000","last_became_peered":"2024-09-16T07:31:19.798050+0000","last_unstale":"2024-09-16T07:31:19.802780+0000","last_undegraded":"2024-09-16T07:31:19.802780+0000","last_fullsized":"2024-09-16T07:31:19.802780+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.821324+0000","last_change":"2024-09-16T07:31:18.790021+0000","last_active":"2024-09-16T07:31:19.821324+0000","last_peered":"2024-09-16T07:31:19.821324+0000","last_clean":"2024-09-16T07:31:19.821324+0000","last_became_active":"2024-09-16T07:31:18.789741+0000","last_became_peered":"2024-09-16T07:31:18.789741+0000","last_unstale":"2024-09-16T07:31:19.821324+0000","last_undegraded":"2024-09-16T07:31:19.821324+0000","last_fullsized":"2024-09-16T07:31:19.821324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:21.281704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795381+0000","last_change":"2024-09-16T07:31:19.789229+0000","last_active":"2024-09-16T07:31:19.795381+0000","last_peered":"2024-09-16T07:31:19.795381+0000","last_clean":"2024-09-16T07:31:19.795381+0000","last_became_active":"2024-09-16T07:31:19.788959+0000","last_became_peered":"2024-09-16T07:31:19.788959+0000","last_unstale":"2024-09-16T07:31:19.795381+0000","last_undegraded":"2024-09-16T07:31:19.795381+0000","last_fullsized":"2024-09-16T07:31:19.795381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:59.473022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820003+0000","last_change":"2024-09-16T07:31:18.776594+0000","last_active":"2024-09-16T07:31:19.820003+0000","last_peered":"2024-09-16T07:31:19.820003+0000","last_clean":"2024-09-16T07:31:19.820003+0000","last_became_active":"2024-09-16T07:31:18.776279+0000","last_became_peered":"2024-09-16T07:31:18.776279+0000","last_unstale":"2024-09-16T07:31:19.820003+0000","last_undegraded":"2024-09-16T07:31:19.820003+0000","last_fullsized":"2024-09-16T07:31:19.820003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:25.190475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798610+0000","last_change":"2024-09-16T07:31:19.792528+0000","last_active":"2024-09-16T07:31:19.798610+0000","last_peered":"2024-09-16T07:31:19.798610+0000","last_clean":"2024-09-16T07:31:19.798610+0000","last_became_active":"2024-09-16T07:31:19.792259+0000","last_became_peered":"2024-09-16T07:31:19.792259+0000","last_unstale":"2024-09-16T07:31:19.798610+0000","last_undegraded":"2024-09-16T07:31:19.798610+0000","last_fullsized":"2024-09-16T07:31:19.798610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780485+0000","last_change":"2024-09-16T07:31:18.772988+0000","last_active":"2024-09-16T07:31:19.780485+0000","last_peered":"2024-09-16T07:31:19.780485+0000","last_clean":"2024-09-16T07:31:19.780485+0000","last_became_active":"2024-09-16T07:31:18.772533+0000","last_became_peered":"2024-09-16T07:31:18.772533+0000","last_unstale":"2024-09-16T07:31:19.780485+0000","last_undegraded":"2024-09-16T07:31:19.780485+0000","last_fullsized":"2024-09-16T07:31:19.780485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:22.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800425+0000","last_change":"2024-09-16T07:31:19.793747+0000","last_active":"2024-09-16T07:31:19.800425+0000","last_peered":"2024-09-16T07:31:19.800425+0000","last_clean":"2024-09-16T07:31:19.800425+0000","last_became_active":"2024-09-16T07:31:19.793378+0000","last_became_peered":"2024-09-16T07:31:19.793378+0000","last_unstale":"2024-09-16T07:31:19.800425+0000","last_undegraded":"2024-09-16T07:31:19.800425+0000","last_fullsized":"2024-09-16T07:31:19.800425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:22.566055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778886+0000","last_change":"2024-09-16T07:31:18.773395+0000","last_active":"2024-09-16T07:31:19.778886+0000","last_peered":"2024-09-16T07:31:19.778886+0000","last_clean":"2024-09-16T07:31:19.778886+0000","last_became_active":"2024-09-16T07:31:18.773128+0000","last_became_peered":"2024-09-16T07:31:18.773128+0000","last_unstale":"2024-09-16T07:31:19.778886+0000","last_undegraded":"2024-09-16T07:31:19.778886+0000","last_fullsized":"2024-09-16T07:31:19.778886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799186+0000","last_change":"2024-09-16T07:31:19.792038+0000","last_active":"2024-09-16T07:31:19.799186+0000","last_peered":"2024-09-16T07:31:19.799186+0000","last_clean":"2024-09-16T07:31:19.799186+0000","last_became_active":"2024-09-16T07:31:19.791722+0000","last_became_peered":"2024-09-16T07:31:19.791722+0000","last_unstale":"2024-09-16T07:31:19.799186+0000","last_undegraded":"2024-09-16T07:31:19.799186+0000","last_fullsized":"2024-09-16T07:31:19.799186+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820427+0000","last_change":"2024-09-16T07:31:18.781351+0000","last_active":"2024-09-16T07:31:19.820427+0000","last_peered":"2024-09-16T07:31:19.820427+0000","last_clean":"2024-09-16T07:31:19.820427+0000","last_became_active":"2024-09-16T07:31:18.781032+0000","last_became_peered":"2024-09-16T07:31:18.781032+0000","last_unstale":"2024-09-16T07:31:19.820427+0000","last_undegraded":"2024-09-16T07:31:19.820427+0000","last_fullsized":"2024-09-16T07:31:19.820427+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800715+0000","last_change":"2024-09-16T07:31:19.797161+0000","last_active":"2024-09-16T07:31:19.800715+0000","last_peered":"2024-09-16T07:31:19.800715+0000","last_clean":"2024-09-16T07:31:19.800715+0000","last_became_active":"2024-09-16T07:31:19.796761+0000","last_became_peered":"2024-09-16T07:31:19.796761+0000","last_unstale":"2024-09-16T07:31:19.800715+0000","last_undegraded":"2024-09-16T07:31:19.800715+0000","last_fullsized":"2024-09-16T07:31:19.800715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817665+0000","last_change":"2024-09-16T07:31:18.784339+0000","last_active":"2024-09-16T07:31:19.817665+0000","last_peered":"2024-09-16T07:31:19.817665+0000","last_clean":"2024-09-16T07:31:19.817665+0000","last_became_active":"2024-09-16T07:31:18.783476+0000","last_became_peered":"2024-09-16T07:31:18.783476+0000","last_unstale":"2024-09-16T07:31:19.817665+0000","last_undegraded":"2024-09-16T07:31:19.817665+0000","last_fullsized":"2024-09-16T07:31:19.817665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:53.213568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794691+0000","last_change":"2024-09-16T07:31:19.788247+0000","last_active":"2024-09-16T07:31:19.794691+0000","last_peered":"2024-09-16T07:31:19.794691+0000","last_clean":"2024-09-16T07:31:19.794691+0000","last_became_active":"2024-09-16T07:31:19.787994+0000","last_became_peered":"2024-09-16T07:31:19.787994+0000","last_unstale":"2024-09-16T07:31:19.794691+0000","last_undegraded":"2024-09-16T07:31:19.794691+0000","last_fullsized":"2024-09-16T07:31:19.794691+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819795+0000","last_change":"2024-09-16T07:31:18.789879+0000","last_active":"2024-09-16T07:31:19.819795+0000","last_peered":"2024-09-16T07:31:19.819795+0000","last_clean":"2024-09-16T07:31:19.819795+0000","last_became_active":"2024-09-16T07:31:18.788588+0000","last_became_peered":"2024-09-16T07:31:18.788588+0000","last_unstale":"2024-09-16T07:31:19.819795+0000","last_undegraded":"2024-09-16T07:31:19.819795+0000","last_fullsized":"2024-09-16T07:31:19.819795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:37.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807126+0000","last_change":"2024-09-16T07:31:19.794796+0000","last_active":"2024-09-16T07:31:19.807126+0000","last_peered":"2024-09-16T07:31:19.807126+0000","last_clean":"2024-09-16T07:31:19.807126+0000","last_became_active":"2024-09-16T07:31:19.794529+0000","last_became_peered":"2024-09-16T07:31:19.794529+0000","last_unstale":"2024-09-16T07:31:19.807126+0000","last_undegraded":"2024-09-16T07:31:19.807126+0000","last_fullsized":"2024-09-16T07:31:19.807126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:22:55.100874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815836+0000","last_change":"2024-09-16T07:31:18.774527+0000","last_active":"2024-09-16T07:31:19.815836+0000","last_peered":"2024-09-16T07:31:19.815836+0000","last_clean":"2024-09-16T07:31:19.815836+0000","last_became_active":"2024-09-16T07:31:18.774274+0000","last_became_peered":"2024-09-16T07:31:18.774274+0000","last_unstale":"2024-09-16T07:31:19.815836+0000","last_undegraded":"2024-09-16T07:31:19.815836+0000","last_fullsized":"2024-09-16T07:31:19.815836+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:04.070738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794261+0000","last_change":"2024-09-16T07:31:19.790939+0000","last_active":"2024-09-16T07:31:19.794261+0000","last_peered":"2024-09-16T07:31:19.794261+0000","last_clean":"2024-09-16T07:31:19.794261+0000","last_became_active":"2024-09-16T07:31:19.789693+0000","last_became_peered":"2024-09-16T07:31:19.789693+0000","last_unstale":"2024-09-16T07:31:19.794261+0000","last_undegraded":"2024-09-16T07:31:19.794261+0000","last_fullsized":"2024-09-16T07:31:19.794261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:09.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.792614+0000","last_change":"2024-09-16T07:31:18.795070+0000","last_active":"2024-09-16T07:31:19.792614+0000","last_peered":"2024-09-16T07:31:19.792614+0000","last_clean":"2024-09-16T07:31:19.792614+0000","last_became_active":"2024-09-16T07:31:18.793712+0000","last_became_peered":"2024-09-16T07:31:18.793712+0000","last_unstale":"2024-09-16T07:31:19.792614+0000","last_undegraded":"2024-09-16T07:31:19.792614+0000","last_fullsized":"2024-09-16T07:31:19.792614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795358+0000","last_change":"2024-09-16T07:31:19.789084+0000","last_active":"2024-09-16T07:31:19.795358+0000","last_peered":"2024-09-16T07:31:19.795358+0000","last_clean":"2024-09-16T07:31:19.795358+0000","last_became_active":"2024-09-16T07:31:19.788667+0000","last_became_peered":"2024-09-16T07:31:19.788667+0000","last_unstale":"2024-09-16T07:31:19.795358+0000","last_undegraded":"2024-09-16T07:31:19.795358+0000","last_fullsized":"2024-09-16T07:31:19.795358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822022+0000","last_change":"2024-09-16T07:31:18.789543+0000","last_active":"2024-09-16T07:31:19.822022+0000","last_peered":"2024-09-16T07:31:19.822022+0000","last_clean":"2024-09-16T07:31:19.822022+0000","last_became_active":"2024-09-16T07:31:18.789265+0000","last_became_peered":"2024-09-16T07:31:18.789265+0000","last_unstale":"2024-09-16T07:31:19.822022+0000","last_undegraded":"2024-09-16T07:31:19.822022+0000","last_fullsized":"2024-09-16T07:31:19.822022+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:47.674243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805813+0000","last_change":"2024-09-16T07:31:19.799276+0000","last_active":"2024-09-16T07:31:19.805813+0000","last_peered":"2024-09-16T07:31:19.805813+0000","last_clean":"2024-09-16T07:31:19.805813+0000","last_became_active":"2024-09-16T07:31:19.799034+0000","last_became_peered":"2024-09-16T07:31:19.799034+0000","last_unstale":"2024-09-16T07:31:19.805813+0000","last_undegraded":"2024-09-16T07:31:19.805813+0000","last_fullsized":"2024-09-16T07:31:19.805813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776957+0000","last_change":"2024-09-16T07:31:18.787186+0000","last_active":"2024-09-16T07:31:19.776957+0000","last_peered":"2024-09-16T07:31:19.776957+0000","last_clean":"2024-09-16T07:31:19.776957+0000","last_became_active":"2024-09-16T07:31:18.786925+0000","last_became_peered":"2024-09-16T07:31:18.786925+0000","last_unstale":"2024-09-16T07:31:19.776957+0000","last_undegraded":"2024-09-16T07:31:19.776957+0000","last_fullsized":"2024-09-16T07:31:19.776957+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:06.201636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806223+0000","last_change":"2024-09-16T07:31:19.801738+0000","last_active":"2024-09-16T07:31:19.806223+0000","last_peered":"2024-09-16T07:31:19.806223+0000","last_clean":"2024-09-16T07:31:19.806223+0000","last_became_active":"2024-09-16T07:31:19.801475+0000","last_became_peered":"2024-09-16T07:31:19.801475+0000","last_unstale":"2024-09-16T07:31:19.806223+0000","last_undegraded":"2024-09-16T07:31:19.806223+0000","last_fullsized":"2024-09-16T07:31:19.806223+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778633+0000","last_change":"2024-09-16T07:31:18.787455+0000","last_active":"2024-09-16T07:31:19.778633+0000","last_peered":"2024-09-16T07:31:19.778633+0000","last_clean":"2024-09-16T07:31:19.778633+0000","last_became_active":"2024-09-16T07:31:18.787111+0000","last_became_peered":"2024-09-16T07:31:18.787111+0000","last_unstale":"2024-09-16T07:31:19.778633+0000","last_undegraded":"2024-09-16T07:31:19.778633+0000","last_fullsized":"2024-09-16T07:31:19.778633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795458+0000","last_change":"2024-09-16T07:31:19.789411+0000","last_active":"2024-09-16T07:31:19.795458+0000","last_peered":"2024-09-16T07:31:19.795458+0000","last_clean":"2024-09-16T07:31:19.795458+0000","last_became_active":"2024-09-16T07:31:19.789063+0000","last_became_peered":"2024-09-16T07:31:19.789063+0000","last_unstale":"2024-09-16T07:31:19.795458+0000","last_undegraded":"2024-09-16T07:31:19.795458+0000","last_fullsized":"2024-09-16T07:31:19.795458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820683+0000","last_change":"2024-09-16T07:31:18.794588+0000","last_active":"2024-09-16T07:31:19.820683+0000","last_peered":"2024-09-16T07:31:19.820683+0000","last_clean":"2024-09-16T07:31:19.820683+0000","last_became_active":"2024-09-16T07:31:18.793959+0000","last_became_peered":"2024-09-16T07:31:18.793959+0000","last_unstale":"2024-09-16T07:31:19.820683+0000","last_undegraded":"2024-09-16T07:31:19.820683+0000","last_fullsized":"2024-09-16T07:31:19.820683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:40.698336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798506+0000","last_change":"2024-09-16T07:31:19.793595+0000","last_active":"2024-09-16T07:31:19.798506+0000","last_peered":"2024-09-16T07:31:19.798506+0000","last_clean":"2024-09-16T07:31:19.798506+0000","last_became_active":"2024-09-16T07:31:19.793298+0000","last_became_peered":"2024-09-16T07:31:19.793298+0000","last_unstale":"2024-09-16T07:31:19.798506+0000","last_undegraded":"2024-09-16T07:31:19.798506+0000","last_fullsized":"2024-09-16T07:31:19.798506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.793466+0000","last_change":"2024-09-16T07:31:18.788195+0000","last_active":"2024-09-16T07:31:19.793466+0000","last_peered":"2024-09-16T07:31:19.793466+0000","last_clean":"2024-09-16T07:31:19.793466+0000","last_became_active":"2024-09-16T07:31:18.787856+0000","last_became_peered":"2024-09-16T07:31:18.787856+0000","last_unstale":"2024-09-16T07:31:19.793466+0000","last_undegraded":"2024-09-16T07:31:19.793466+0000","last_fullsized":"2024-09-16T07:31:19.793466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:53.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801826+0000","last_change":"2024-09-16T07:31:19.796745+0000","last_active":"2024-09-16T07:31:19.801826+0000","last_peered":"2024-09-16T07:31:19.801826+0000","last_clean":"2024-09-16T07:31:19.801826+0000","last_became_active":"2024-09-16T07:31:19.796160+0000","last_became_peered":"2024-09-16T07:31:19.796160+0000","last_unstale":"2024-09-16T07:31:19.801826+0000","last_undegraded":"2024-09-16T07:31:19.801826+0000","last_fullsized":"2024-09-16T07:31:19.801826+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:18.142799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780648+0000","last_change":"2024-09-16T07:31:18.775590+0000","last_active":"2024-09-16T07:31:19.780648+0000","last_peered":"2024-09-16T07:31:19.780648+0000","last_clean":"2024-09-16T07:31:19.780648+0000","last_became_active":"2024-09-16T07:31:18.775372+0000","last_became_peered":"2024-09-16T07:31:18.775372+0000","last_unstale":"2024-09-16T07:31:19.780648+0000","last_undegraded":"2024-09-16T07:31:19.780648+0000","last_fullsized":"2024-09-16T07:31:19.780648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:51.048762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804769+0000","last_change":"2024-09-16T07:31:19.797206+0000","last_active":"2024-09-16T07:31:19.804769+0000","last_peered":"2024-09-16T07:31:19.804769+0000","last_clean":"2024-09-16T07:31:19.804769+0000","last_became_active":"2024-09-16T07:31:19.796955+0000","last_became_peered":"2024-09-16T07:31:19.796955+0000","last_unstale":"2024-09-16T07:31:19.804769+0000","last_undegraded":"2024-09-16T07:31:19.804769+0000","last_fullsized":"2024-09-16T07:31:19.804769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780195+0000","last_change":"2024-09-16T07:31:18.779241+0000","last_active":"2024-09-16T07:31:19.780195+0000","last_peered":"2024-09-16T07:31:19.780195+0000","last_clean":"2024-09-16T07:31:19.780195+0000","last_became_active":"2024-09-16T07:31:18.778973+0000","last_became_peered":"2024-09-16T07:31:18.778973+0000","last_unstale":"2024-09-16T07:31:19.780195+0000","last_undegraded":"2024-09-16T07:31:19.780195+0000","last_fullsized":"2024-09-16T07:31:19.780195+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799187+0000","last_change":"2024-09-16T07:31:19.791585+0000","last_active":"2024-09-16T07:31:19.799187+0000","last_peered":"2024-09-16T07:31:19.799187+0000","last_clean":"2024-09-16T07:31:19.799187+0000","last_became_active":"2024-09-16T07:31:19.791327+0000","last_became_peered":"2024-09-16T07:31:19.791327+0000","last_unstale":"2024-09-16T07:31:19.799187+0000","last_undegraded":"2024-09-16T07:31:19.799187+0000","last_fullsized":"2024-09-16T07:31:19.799187+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:27.493050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776933+0000","last_change":"2024-09-16T07:31:18.787749+0000","last_active":"2024-09-16T07:31:19.776933+0000","last_peered":"2024-09-16T07:31:19.776933+0000","last_clean":"2024-09-16T07:31:19.776933+0000","last_became_active":"2024-09-16T07:31:18.787475+0000","last_became_peered":"2024-09-16T07:31:18.787475+0000","last_unstale":"2024-09-16T07:31:19.776933+0000","last_undegraded":"2024-09-16T07:31:19.776933+0000","last_fullsized":"2024-09-16T07:31:19.776933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:20.592987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794310+0000","last_change":"2024-09-16T07:31:19.790582+0000","last_active":"2024-09-16T07:31:19.794310+0000","last_peered":"2024-09-16T07:31:19.794310+0000","last_clean":"2024-09-16T07:31:19.794310+0000","last_became_active":"2024-09-16T07:31:19.790285+0000","last_became_peered":"2024-09-16T07:31:19.790285+0000","last_unstale":"2024-09-16T07:31:19.794310+0000","last_undegraded":"2024-09-16T07:31:19.794310+0000","last_fullsized":"2024-09-16T07:31:19.794310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:05.077038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.784768+0000","last_change":"2024-09-16T07:31:18.790010+0000","last_active":"2024-09-16T07:31:19.784768+0000","last_peered":"2024-09-16T07:31:19.784768+0000","last_clean":"2024-09-16T07:31:19.784768+0000","last_became_active":"2024-09-16T07:31:18.789733+0000","last_became_peered":"2024-09-16T07:31:18.789733+0000","last_unstale":"2024-09-16T07:31:19.784768+0000","last_undegraded":"2024-09-16T07:31:19.784768+0000","last_fullsized":"2024-09-16T07:31:19.784768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:35.643472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804052+0000","last_change":"2024-09-16T07:31:19.799293+0000","last_active":"2024-09-16T07:31:19.804052+0000","last_peered":"2024-09-16T07:31:19.804052+0000","last_clean":"2024-09-16T07:31:19.804052+0000","last_became_active":"2024-09-16T07:31:19.799086+0000","last_became_peered":"2024-09-16T07:31:19.799086+0000","last_unstale":"2024-09-16T07:31:19.804052+0000","last_undegraded":"2024-09-16T07:31:19.804052+0000","last_fullsized":"2024-09-16T07:31:19.804052+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:26.031540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776937+0000","last_change":"2024-09-16T07:31:18.792232+0000","last_active":"2024-09-16T07:31:19.776937+0000","last_peered":"2024-09-16T07:31:19.776937+0000","last_clean":"2024-09-16T07:31:19.776937+0000","last_became_active":"2024-09-16T07:31:18.791920+0000","last_became_peered":"2024-09-16T07:31:18.791920+0000","last_unstale":"2024-09-16T07:31:19.776937+0000","last_undegraded":"2024-09-16T07:31:19.776937+0000","last_fullsized":"2024-09-16T07:31:19.776937+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:39.264345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807003+0000","last_change":"2024-09-16T07:31:19.794654+0000","last_active":"2024-09-16T07:31:19.807003+0000","last_peered":"2024-09-16T07:31:19.807003+0000","last_clean":"2024-09-16T07:31:19.807003+0000","last_became_active":"2024-09-16T07:31:19.794379+0000","last_became_peered":"2024-09-16T07:31:19.794379+0000","last_unstale":"2024-09-16T07:31:19.807003+0000","last_undegraded":"2024-09-16T07:31:19.807003+0000","last_fullsized":"2024-09-16T07:31:19.807003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:02.848339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783051+0000","last_change":"2024-09-16T07:31:18.789535+0000","last_active":"2024-09-16T07:31:19.783051+0000","last_peered":"2024-09-16T07:31:19.783051+0000","last_clean":"2024-09-16T07:31:19.783051+0000","last_became_active":"2024-09-16T07:31:18.789035+0000","last_became_peered":"2024-09-16T07:31:18.789035+0000","last_unstale":"2024-09-16T07:31:19.783051+0000","last_undegraded":"2024-09-16T07:31:19.783051+0000","last_fullsized":"2024-09-16T07:31:19.783051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:04.021360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808602+0000","last_change":"2024-09-16T07:31:19.801383+0000","last_active":"2024-09-16T07:31:19.808602+0000","last_peered":"2024-09-16T07:31:19.808602+0000","last_clean":"2024-09-16T07:31:19.808602+0000","last_became_active":"2024-09-16T07:31:19.801123+0000","last_became_peered":"2024-09-16T07:31:19.801123+0000","last_unstale":"2024-09-16T07:31:19.808602+0000","last_undegraded":"2024-09-16T07:31:19.808602+0000","last_fullsized":"2024-09-16T07:31:19.808602+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:31:17.995605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.781321+0000","last_change":"2024-09-16T07:31:18.774958+0000","last_active":"2024-09-16T07:31:19.781321+0000","last_peered":"2024-09-16T07:31:19.781321+0000","last_clean":"2024-09-16T07:31:19.781321+0000","last_became_active":"2024-09-16T07:31:18.774697+0000","last_became_peered":"2024-09-16T07:31:18.774697+0000","last_unstale":"2024-09-16T07:31:19.781321+0000","last_undegraded":"2024-09-16T07:31:19.781321+0000","last_fullsized":"2024-09-16T07:31:19.781321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:39.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777462+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:31:19.777462+0000","last_peered":"2024-09-16T07:31:19.777462+0000","last_clean":"2024-09-16T07:31:19.777462+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:31:19.777462+0000","last_undegraded":"2024-09-16T07:31:19.777462+0000","last_fullsized":"2024-09-16T07:31:19.777462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":675840,"data_stored":273330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":667648,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:31:23.900 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:31:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- 172.21.15.114:0/3500547738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0d2060 msgr2=0x7f2bbc0cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/3500547738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0d2060 0x7f2bbc0cf660 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009c80 tx=0x7f2bac01cda0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- 172.21.15.114:0/3500547738 shutdown_connections 2024-09-16T07:31:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/3500547738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0d2060 0x7f2bbc0cf660 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- 172.21.15.114:0/3500547738 >> 172.21.15.114:0/3500547738 conn(0x7f2bbc0d3fe0 msgr2=0x7f2bbc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- 172.21.15.114:0/3500547738 shutdown_connections 2024-09-16T07:31:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- 172.21.15.114:0/3500547738 wait complete. 2024-09-16T07:31:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 Processor -- start 2024-09-16T07:31:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- start start 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0b7ab0 0x7f2bbc15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bbc0d2060 0x7f2bbc1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bbc0d2440 0x7f2bbc159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc16c610 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc16c490 con 0x7f2bbc0d2060 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bc0c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2bbc16c790 con 0x7f2bbc0d2440 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0b7ab0 0x7f2bbc15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0b7ab0 0x7f2bbc15b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43312/0 (socket says 172.21.15.114:43312) 2024-09-16T07:31:24.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 -- 172.21.15.114:0/876524381 learned_addr learned my addr 172.21.15.114:0/876524381 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb1400640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bbc0d2060 0x7f2bbc1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bba800640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bbc0d2440 0x7f2bbc159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 -- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bbc0d2440 msgr2=0x7f2bbc159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bbc0d2440 0x7f2bbc159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 -- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bbc0d2060 msgr2=0x7f2bbc1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bbc0d2060 0x7f2bbc1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bb9e00640 1 -- 172.21.15.114:0/876524381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc0cd340 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.084+0000 7f2bba800640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bbc0d2440 0x7f2bbc159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:24.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb9e00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0b7ab0 0x7f2bbc15b490 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009bd0 tx=0x7f2bac0a5c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:24.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb2a00640 1 -- 172.21.15.114:0/876524381 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0b2040 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb2a00640 1 -- 172.21.15.114:0/876524381 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bac0042c0 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb2a00640 1 -- 172.21.15.114:0/876524381 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0046f0 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc0cd600 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc156cc0 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bbc0cf660 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb2a00640 1 -- 172.21.15.114:0/876524381 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f2bac0ad440 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb2a00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2b980730a0 0x7f2b98075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb2a00640 1 -- 172.21.15.114:0/876524381 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2bac12ec80 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.088+0000 7f2bb1400640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2b980730a0 0x7f2b98075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.092+0000 7f2bb1400640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2b980730a0 0x7f2b98075560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc1580f0 tx=0x7f2ba4009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:24.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.092+0000 7f2bb2a00640 1 -- 172.21.15.114:0/876524381 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2bac016990 con 0x7f2bbc0b7ab0 2024-09-16T07:31:24.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.260+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2bbc0d2b90 con 0x7f2b980730a0 2024-09-16T07:31:24.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.264+0000 7f2bb2a00640 1 -- 172.21.15.114:0/876524381 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251446 (secure 0 0 0) 0x7f2bbc0d2b90 con 0x7f2b980730a0 2024-09-16T07:31:24.263 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:24.265 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2b980730a0 msgr2=0x7f2b98075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2b980730a0 0x7f2b98075560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc1580f0 tx=0x7f2ba4009060 comp rx=0 tx=0).stop 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0b7ab0 msgr2=0x7f2bbc15b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0b7ab0 0x7f2bbc15b490 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009bd0 tx=0x7f2bac0a5c00 comp rx=0 tx=0).stop 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 shutdown_connections 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2b980730a0 0x7f2b98075560 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bbc0d2440 0x7f2bbc159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bbc0d2060 0x7f2bbc1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 --2- 172.21.15.114:0/876524381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2bbc0b7ab0 0x7f2bbc15b490 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 >> 172.21.15.114:0/876524381 conn(0x7f2bbc0d3fe0 msgr2=0x7f2bbc0b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:24.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 shutdown_connections 2024-09-16T07:31:24.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.268+0000 7f2bc0c00640 1 -- 172.21.15.114:0/876524381 wait complete. 2024-09-16T07:31:24.285 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-16T07:31:23.039515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226696,"kb_used_data":6288,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748024,"statfs":{"total":773094113280,"available":772861976576,"internally_reserved":0,"allocated":6438912,"data_stored":3315532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.283420"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.779883+0000","last_change":"2024-09-16T07:31:18.779883+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.779883+0000","last_undegraded":"2024-09-16T07:31:18.779883+0000","last_fullsized":"2024-09-16T07:31:18.779883+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806143+0000","last_change":"2024-09-16T07:31:19.795452+0000","last_active":"2024-09-16T07:31:19.806143+0000","last_peered":"2024-09-16T07:31:19.806143+0000","last_clean":"2024-09-16T07:31:19.806143+0000","last_became_active":"2024-09-16T07:31:19.794937+0000","last_became_peered":"2024-09-16T07:31:19.794937+0000","last_unstale":"2024-09-16T07:31:19.806143+0000","last_undegraded":"2024-09-16T07:31:19.806143+0000","last_fullsized":"2024-09-16T07:31:19.806143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:26.321325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799151+0000","last_change":"2024-09-16T07:31:19.792532+0000","last_active":"2024-09-16T07:31:19.799151+0000","last_peered":"2024-09-16T07:31:19.799151+0000","last_clean":"2024-09-16T07:31:19.799151+0000","last_became_active":"2024-09-16T07:31:19.792301+0000","last_became_peered":"2024-09-16T07:31:19.792301+0000","last_unstale":"2024-09-16T07:31:19.799151+0000","last_undegraded":"2024-09-16T07:31:19.799151+0000","last_fullsized":"2024-09-16T07:31:19.799151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:52.057630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795356+0000","last_change":"2024-09-16T07:31:19.789467+0000","last_active":"2024-09-16T07:31:19.795356+0000","last_peered":"2024-09-16T07:31:19.795356+0000","last_clean":"2024-09-16T07:31:19.795356+0000","last_became_active":"2024-09-16T07:31:19.789174+0000","last_became_peered":"2024-09-16T07:31:19.789174+0000","last_unstale":"2024-09-16T07:31:19.795356+0000","last_undegraded":"2024-09-16T07:31:19.795356+0000","last_fullsized":"2024-09-16T07:31:19.795356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773895+0000","last_change":"2024-09-16T07:31:18.773895+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773895+0000","last_undegraded":"2024-09-16T07:31:18.773895+0000","last_fullsized":"2024-09-16T07:31:18.773895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806161+0000","last_change":"2024-09-16T07:31:19.802298+0000","last_active":"2024-09-16T07:31:19.806161+0000","last_peered":"2024-09-16T07:31:19.806161+0000","last_clean":"2024-09-16T07:31:19.806161+0000","last_became_active":"2024-09-16T07:31:19.802043+0000","last_became_peered":"2024-09-16T07:31:19.802043+0000","last_unstale":"2024-09-16T07:31:19.806161+0000","last_undegraded":"2024-09-16T07:31:19.806161+0000","last_fullsized":"2024-09-16T07:31:19.806161+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800986+0000","last_change":"2024-09-16T07:31:19.794748+0000","last_active":"2024-09-16T07:31:19.800986+0000","last_peered":"2024-09-16T07:31:19.800986+0000","last_clean":"2024-09-16T07:31:19.800986+0000","last_became_active":"2024-09-16T07:31:19.794494+0000","last_became_peered":"2024-09-16T07:31:19.794494+0000","last_unstale":"2024-09-16T07:31:19.800986+0000","last_undegraded":"2024-09-16T07:31:19.800986+0000","last_fullsized":"2024-09-16T07:31:19.800986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.056578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806635+0000","last_change":"2024-09-16T07:31:19.796360+0000","last_active":"2024-09-16T07:31:19.806635+0000","last_peered":"2024-09-16T07:31:19.806635+0000","last_clean":"2024-09-16T07:31:19.806635+0000","last_became_active":"2024-09-16T07:31:19.796075+0000","last_became_peered":"2024-09-16T07:31:19.796075+0000","last_unstale":"2024-09-16T07:31:19.806635+0000","last_undegraded":"2024-09-16T07:31:19.806635+0000","last_fullsized":"2024-09-16T07:31:19.806635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:07:28.758872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805823+0000","last_change":"2024-09-16T07:31:19.800757+0000","last_active":"2024-09-16T07:31:19.805823+0000","last_peered":"2024-09-16T07:31:19.805823+0000","last_clean":"2024-09-16T07:31:19.805823+0000","last_became_active":"2024-09-16T07:31:19.800483+0000","last_became_peered":"2024-09-16T07:31:19.800483+0000","last_unstale":"2024-09-16T07:31:19.805823+0000","last_undegraded":"2024-09-16T07:31:19.805823+0000","last_fullsized":"2024-09-16T07:31:19.805823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:25.288132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804028+0000","last_change":"2024-09-16T07:31:19.798727+0000","last_active":"2024-09-16T07:31:19.804028+0000","last_peered":"2024-09-16T07:31:19.804028+0000","last_clean":"2024-09-16T07:31:19.804028+0000","last_became_active":"2024-09-16T07:31:19.798309+0000","last_became_peered":"2024-09-16T07:31:19.798309+0000","last_unstale":"2024-09-16T07:31:19.804028+0000","last_undegraded":"2024-09-16T07:31:19.804028+0000","last_fullsized":"2024-09-16T07:31:19.804028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:57.608168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799535+0000","last_change":"2024-09-16T07:31:19.792993+0000","last_active":"2024-09-16T07:31:19.799535+0000","last_peered":"2024-09-16T07:31:19.799535+0000","last_clean":"2024-09-16T07:31:19.799535+0000","last_became_active":"2024-09-16T07:31:19.792461+0000","last_became_peered":"2024-09-16T07:31:19.792461+0000","last_unstale":"2024-09-16T07:31:19.799535+0000","last_undegraded":"2024-09-16T07:31:19.799535+0000","last_fullsized":"2024-09-16T07:31:19.799535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:34.182317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795330+0000","last_change":"2024-09-16T07:31:19.788824+0000","last_active":"2024-09-16T07:31:19.795330+0000","last_peered":"2024-09-16T07:31:19.795330+0000","last_clean":"2024-09-16T07:31:19.795330+0000","last_became_active":"2024-09-16T07:31:19.788477+0000","last_became_peered":"2024-09-16T07:31:19.788477+0000","last_unstale":"2024-09-16T07:31:19.795330+0000","last_undegraded":"2024-09-16T07:31:19.795330+0000","last_fullsized":"2024-09-16T07:31:19.795330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801156+0000","last_change":"2024-09-16T07:31:19.795230+0000","last_active":"2024-09-16T07:31:19.801156+0000","last_peered":"2024-09-16T07:31:19.801156+0000","last_clean":"2024-09-16T07:31:19.801156+0000","last_became_active":"2024-09-16T07:31:19.794956+0000","last_became_peered":"2024-09-16T07:31:19.794956+0000","last_unstale":"2024-09-16T07:31:19.801156+0000","last_undegraded":"2024-09-16T07:31:19.801156+0000","last_fullsized":"2024-09-16T07:31:19.801156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:13.513689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797892+0000","last_change":"2024-09-16T07:31:19.789254+0000","last_active":"2024-09-16T07:31:19.797892+0000","last_peered":"2024-09-16T07:31:19.797892+0000","last_clean":"2024-09-16T07:31:19.797892+0000","last_became_active":"2024-09-16T07:31:19.788561+0000","last_became_peered":"2024-09-16T07:31:19.788561+0000","last_unstale":"2024-09-16T07:31:19.797892+0000","last_undegraded":"2024-09-16T07:31:19.797892+0000","last_fullsized":"2024-09-16T07:31:19.797892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:14.672043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799005+0000","last_change":"2024-09-16T07:31:19.790415+0000","last_active":"2024-09-16T07:31:19.799005+0000","last_peered":"2024-09-16T07:31:19.799005+0000","last_clean":"2024-09-16T07:31:19.799005+0000","last_became_active":"2024-09-16T07:31:19.789977+0000","last_became_peered":"2024-09-16T07:31:19.789977+0000","last_unstale":"2024-09-16T07:31:19.799005+0000","last_undegraded":"2024-09-16T07:31:19.799005+0000","last_fullsized":"2024-09-16T07:31:19.799005+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:52.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808322+0000","last_change":"2024-09-16T07:31:19.803450+0000","last_active":"2024-09-16T07:31:19.808322+0000","last_peered":"2024-09-16T07:31:19.808322+0000","last_clean":"2024-09-16T07:31:19.808322+0000","last_became_active":"2024-09-16T07:31:19.803117+0000","last_became_peered":"2024-09-16T07:31:19.803117+0000","last_unstale":"2024-09-16T07:31:19.808322+0000","last_undegraded":"2024-09-16T07:31:19.808322+0000","last_fullsized":"2024-09-16T07:31:19.808322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:39.017272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807576+0000","last_change":"2024-09-16T07:31:19.798737+0000","last_active":"2024-09-16T07:31:19.807576+0000","last_peered":"2024-09-16T07:31:19.807576+0000","last_clean":"2024-09-16T07:31:19.807576+0000","last_became_active":"2024-09-16T07:31:19.798489+0000","last_became_peered":"2024-09-16T07:31:19.798489+0000","last_unstale":"2024-09-16T07:31:19.807576+0000","last_undegraded":"2024-09-16T07:31:19.807576+0000","last_fullsized":"2024-09-16T07:31:19.807576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:00:25.780049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805761+0000","last_change":"2024-09-16T07:31:19.800414+0000","last_active":"2024-09-16T07:31:19.805761+0000","last_peered":"2024-09-16T07:31:19.805761+0000","last_clean":"2024-09-16T07:31:19.805761+0000","last_became_active":"2024-09-16T07:31:19.798920+0000","last_became_peered":"2024-09-16T07:31:19.798920+0000","last_unstale":"2024-09-16T07:31:19.805761+0000","last_undegraded":"2024-09-16T07:31:19.805761+0000","last_fullsized":"2024-09-16T07:31:19.805761+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773446+0000","last_change":"2024-09-16T07:31:18.773446+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773446+0000","last_undegraded":"2024-09-16T07:31:18.773446+0000","last_fullsized":"2024-09-16T07:31:18.773446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808567+0000","last_change":"2024-09-16T07:31:19.802446+0000","last_active":"2024-09-16T07:31:19.808567+0000","last_peered":"2024-09-16T07:31:19.808567+0000","last_clean":"2024-09-16T07:31:19.808567+0000","last_became_active":"2024-09-16T07:31:19.802076+0000","last_became_peered":"2024-09-16T07:31:19.802076+0000","last_unstale":"2024-09-16T07:31:19.808567+0000","last_undegraded":"2024-09-16T07:31:19.808567+0000","last_fullsized":"2024-09-16T07:31:19.808567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:08.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800544+0000","last_change":"2024-09-16T07:31:19.797580+0000","last_active":"2024-09-16T07:31:19.800544+0000","last_peered":"2024-09-16T07:31:19.800544+0000","last_clean":"2024-09-16T07:31:19.800544+0000","last_became_active":"2024-09-16T07:31:19.796587+0000","last_became_peered":"2024-09-16T07:31:19.796587+0000","last_unstale":"2024-09-16T07:31:19.800544+0000","last_undegraded":"2024-09-16T07:31:19.800544+0000","last_fullsized":"2024-09-16T07:31:19.800544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807175+0000","last_change":"2024-09-16T07:31:19.792089+0000","last_active":"2024-09-16T07:31:19.807175+0000","last_peered":"2024-09-16T07:31:19.807175+0000","last_clean":"2024-09-16T07:31:19.807175+0000","last_became_active":"2024-09-16T07:31:19.790997+0000","last_became_peered":"2024-09-16T07:31:19.790997+0000","last_unstale":"2024-09-16T07:31:19.807175+0000","last_undegraded":"2024-09-16T07:31:19.807175+0000","last_fullsized":"2024-09-16T07:31:19.807175+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:14.300883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794491+0000","last_change":"2024-09-16T07:31:19.791289+0000","last_active":"2024-09-16T07:31:19.794491+0000","last_peered":"2024-09-16T07:31:19.794491+0000","last_clean":"2024-09-16T07:31:19.794491+0000","last_became_active":"2024-09-16T07:31:19.790974+0000","last_became_peered":"2024-09-16T07:31:19.790974+0000","last_unstale":"2024-09-16T07:31:19.794491+0000","last_undegraded":"2024-09-16T07:31:19.794491+0000","last_fullsized":"2024-09-16T07:31:19.794491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:32.744007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801740+0000","last_change":"2024-09-16T07:31:19.799545+0000","last_active":"2024-09-16T07:31:19.801740+0000","last_peered":"2024-09-16T07:31:19.801740+0000","last_clean":"2024-09-16T07:31:19.801740+0000","last_became_active":"2024-09-16T07:31:19.799285+0000","last_became_peered":"2024-09-16T07:31:19.799285+0000","last_unstale":"2024-09-16T07:31:19.801740+0000","last_undegraded":"2024-09-16T07:31:19.801740+0000","last_fullsized":"2024-09-16T07:31:19.801740+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:59.159780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.779252+0000","last_change":"2024-09-16T07:31:18.779252+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.779252+0000","last_undegraded":"2024-09-16T07:31:18.779252+0000","last_fullsized":"2024-09-16T07:31:18.779252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795481+0000","last_change":"2024-09-16T07:31:19.790142+0000","last_active":"2024-09-16T07:31:19.795481+0000","last_peered":"2024-09-16T07:31:19.795481+0000","last_clean":"2024-09-16T07:31:19.795481+0000","last_became_active":"2024-09-16T07:31:19.789787+0000","last_became_peered":"2024-09-16T07:31:19.789787+0000","last_unstale":"2024-09-16T07:31:19.795481+0000","last_undegraded":"2024-09-16T07:31:19.795481+0000","last_fullsized":"2024-09-16T07:31:19.795481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811562+0000","last_change":"2024-09-16T07:31:19.807204+0000","last_active":"2024-09-16T07:31:19.811562+0000","last_peered":"2024-09-16T07:31:19.811562+0000","last_clean":"2024-09-16T07:31:19.811562+0000","last_became_active":"2024-09-16T07:31:19.805182+0000","last_became_peered":"2024-09-16T07:31:19.805182+0000","last_unstale":"2024-09-16T07:31:19.811562+0000","last_undegraded":"2024-09-16T07:31:19.811562+0000","last_fullsized":"2024-09-16T07:31:19.811562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:57.879247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.774157+0000","last_change":"2024-09-16T07:31:18.774157+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.774157+0000","last_undegraded":"2024-09-16T07:31:18.774157+0000","last_fullsized":"2024-09-16T07:31:18.774157+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807063+0000","last_change":"2024-09-16T07:31:19.797676+0000","last_active":"2024-09-16T07:31:19.807063+0000","last_peered":"2024-09-16T07:31:19.807063+0000","last_clean":"2024-09-16T07:31:19.807063+0000","last_became_active":"2024-09-16T07:31:19.797402+0000","last_became_peered":"2024-09-16T07:31:19.797402+0000","last_unstale":"2024-09-16T07:31:19.807063+0000","last_undegraded":"2024-09-16T07:31:19.807063+0000","last_fullsized":"2024-09-16T07:31:19.807063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:29.989908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798939+0000","last_change":"2024-09-16T07:31:19.792014+0000","last_active":"2024-09-16T07:31:19.798939+0000","last_peered":"2024-09-16T07:31:19.798939+0000","last_clean":"2024-09-16T07:31:19.798939+0000","last_became_active":"2024-09-16T07:31:19.791672+0000","last_became_peered":"2024-09-16T07:31:19.791672+0000","last_unstale":"2024-09-16T07:31:19.798939+0000","last_undegraded":"2024-09-16T07:31:19.798939+0000","last_fullsized":"2024-09-16T07:31:19.798939+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773588+0000","last_change":"2024-09-16T07:31:18.773588+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773588+0000","last_undegraded":"2024-09-16T07:31:18.773588+0000","last_fullsized":"2024-09-16T07:31:18.773588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811630+0000","last_change":"2024-09-16T07:31:19.809602+0000","last_active":"2024-09-16T07:31:19.811630+0000","last_peered":"2024-09-16T07:31:19.811630+0000","last_clean":"2024-09-16T07:31:19.811630+0000","last_became_active":"2024-09-16T07:31:19.809274+0000","last_became_peered":"2024-09-16T07:31:19.809274+0000","last_unstale":"2024-09-16T07:31:19.811630+0000","last_undegraded":"2024-09-16T07:31:19.811630+0000","last_fullsized":"2024-09-16T07:31:19.811630+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:38.553253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804808+0000","last_change":"2024-09-16T07:31:19.798550+0000","last_active":"2024-09-16T07:31:19.804808+0000","last_peered":"2024-09-16T07:31:19.804808+0000","last_clean":"2024-09-16T07:31:19.804808+0000","last_became_active":"2024-09-16T07:31:19.798280+0000","last_became_peered":"2024-09-16T07:31:19.798280+0000","last_unstale":"2024-09-16T07:31:19.804808+0000","last_undegraded":"2024-09-16T07:31:19.804808+0000","last_fullsized":"2024-09-16T07:31:19.804808+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822443+0000","last_change":"2024-09-16T07:31:18.788213+0000","last_active":"2024-09-16T07:31:19.822443+0000","last_peered":"2024-09-16T07:31:19.822443+0000","last_clean":"2024-09-16T07:31:19.822443+0000","last_became_active":"2024-09-16T07:31:18.787961+0000","last_became_peered":"2024-09-16T07:31:18.787961+0000","last_unstale":"2024-09-16T07:31:19.822443+0000","last_undegraded":"2024-09-16T07:31:19.822443+0000","last_fullsized":"2024-09-16T07:31:19.822443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:56.115404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797411+0000","last_change":"2024-09-16T07:31:19.789278+0000","last_active":"2024-09-16T07:31:19.797411+0000","last_peered":"2024-09-16T07:31:19.797411+0000","last_clean":"2024-09-16T07:31:19.797411+0000","last_became_active":"2024-09-16T07:31:19.789015+0000","last_became_peered":"2024-09-16T07:31:19.789015+0000","last_unstale":"2024-09-16T07:31:19.797411+0000","last_undegraded":"2024-09-16T07:31:19.797411+0000","last_fullsized":"2024-09-16T07:31:19.797411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:56.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817335+0000","last_change":"2024-09-16T07:31:18.775898+0000","last_active":"2024-09-16T07:31:19.817335+0000","last_peered":"2024-09-16T07:31:19.817335+0000","last_clean":"2024-09-16T07:31:19.817335+0000","last_became_active":"2024-09-16T07:31:18.775575+0000","last_became_peered":"2024-09-16T07:31:18.775575+0000","last_unstale":"2024-09-16T07:31:19.817335+0000","last_undegraded":"2024-09-16T07:31:19.817335+0000","last_fullsized":"2024-09-16T07:31:19.817335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:56.258821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808350+0000","last_change":"2024-09-16T07:31:19.804592+0000","last_active":"2024-09-16T07:31:19.808350+0000","last_peered":"2024-09-16T07:31:19.808350+0000","last_clean":"2024-09-16T07:31:19.808350+0000","last_became_active":"2024-09-16T07:31:19.803010+0000","last_became_peered":"2024-09-16T07:31:19.803010+0000","last_unstale":"2024-09-16T07:31:19.808350+0000","last_undegraded":"2024-09-16T07:31:19.808350+0000","last_fullsized":"2024-09-16T07:31:19.808350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:48.737794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820706+0000","last_change":"2024-09-16T07:31:18.794664+0000","last_active":"2024-09-16T07:31:19.820706+0000","last_peered":"2024-09-16T07:31:19.820706+0000","last_clean":"2024-09-16T07:31:19.820706+0000","last_became_active":"2024-09-16T07:31:18.794418+0000","last_became_peered":"2024-09-16T07:31:18.794418+0000","last_unstale":"2024-09-16T07:31:19.820706+0000","last_undegraded":"2024-09-16T07:31:19.820706+0000","last_fullsized":"2024-09-16T07:31:19.820706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811324+0000","last_change":"2024-09-16T07:31:19.805940+0000","last_active":"2024-09-16T07:31:19.811324+0000","last_peered":"2024-09-16T07:31:19.811324+0000","last_clean":"2024-09-16T07:31:19.811324+0000","last_became_active":"2024-09-16T07:31:19.804922+0000","last_became_peered":"2024-09-16T07:31:19.804922+0000","last_unstale":"2024-09-16T07:31:19.811324+0000","last_undegraded":"2024-09-16T07:31:19.811324+0000","last_fullsized":"2024-09-16T07:31:19.811324+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:10.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819227+0000","last_change":"2024-09-16T07:31:18.772762+0000","last_active":"2024-09-16T07:31:19.819227+0000","last_peered":"2024-09-16T07:31:19.819227+0000","last_clean":"2024-09-16T07:31:19.819227+0000","last_became_active":"2024-09-16T07:31:18.772483+0000","last_became_peered":"2024-09-16T07:31:18.772483+0000","last_unstale":"2024-09-16T07:31:19.819227+0000","last_undegraded":"2024-09-16T07:31:19.819227+0000","last_fullsized":"2024-09-16T07:31:19.819227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.791961+0000","last_change":"2024-09-16T07:31:19.788175+0000","last_active":"2024-09-16T07:31:19.791961+0000","last_peered":"2024-09-16T07:31:19.791961+0000","last_clean":"2024-09-16T07:31:19.791961+0000","last_became_active":"2024-09-16T07:31:19.787903+0000","last_became_peered":"2024-09-16T07:31:19.787903+0000","last_unstale":"2024-09-16T07:31:19.791961+0000","last_undegraded":"2024-09-16T07:31:19.791961+0000","last_fullsized":"2024-09-16T07:31:19.791961+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:00:10.456768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815080+0000","last_change":"2024-09-16T07:31:18.779878+0000","last_active":"2024-09-16T07:31:19.815080+0000","last_peered":"2024-09-16T07:31:19.815080+0000","last_clean":"2024-09-16T07:31:19.815080+0000","last_became_active":"2024-09-16T07:31:18.779587+0000","last_became_peered":"2024-09-16T07:31:18.779587+0000","last_unstale":"2024-09-16T07:31:19.815080+0000","last_undegraded":"2024-09-16T07:31:19.815080+0000","last_fullsized":"2024-09-16T07:31:19.815080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:12.686482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.810895+0000","last_change":"2024-09-16T07:31:19.808074+0000","last_active":"2024-09-16T07:31:19.810895+0000","last_peered":"2024-09-16T07:31:19.810895+0000","last_clean":"2024-09-16T07:31:19.810895+0000","last_became_active":"2024-09-16T07:31:19.807802+0000","last_became_peered":"2024-09-16T07:31:19.807802+0000","last_unstale":"2024-09-16T07:31:19.810895+0000","last_undegraded":"2024-09-16T07:31:19.810895+0000","last_fullsized":"2024-09-16T07:31:19.810895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:12.342419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819786+0000","last_change":"2024-09-16T07:31:18.789053+0000","last_active":"2024-09-16T07:31:19.819786+0000","last_peered":"2024-09-16T07:31:19.819786+0000","last_clean":"2024-09-16T07:31:19.819786+0000","last_became_active":"2024-09-16T07:31:18.788715+0000","last_became_peered":"2024-09-16T07:31:18.788715+0000","last_unstale":"2024-09-16T07:31:19.819786+0000","last_undegraded":"2024-09-16T07:31:19.819786+0000","last_fullsized":"2024-09-16T07:31:19.819786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:58.466722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801121+0000","last_change":"2024-09-16T07:31:19.794608+0000","last_active":"2024-09-16T07:31:19.801121+0000","last_peered":"2024-09-16T07:31:19.801121+0000","last_clean":"2024-09-16T07:31:19.801121+0000","last_became_active":"2024-09-16T07:31:19.794301+0000","last_became_peered":"2024-09-16T07:31:19.794301+0000","last_unstale":"2024-09-16T07:31:19.801121+0000","last_undegraded":"2024-09-16T07:31:19.801121+0000","last_fullsized":"2024-09-16T07:31:19.801121+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:24.874172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778682+0000","last_change":"2024-09-16T07:31:18.777720+0000","last_active":"2024-09-16T07:31:19.778682+0000","last_peered":"2024-09-16T07:31:19.778682+0000","last_clean":"2024-09-16T07:31:19.778682+0000","last_became_active":"2024-09-16T07:31:18.777300+0000","last_became_peered":"2024-09-16T07:31:18.777300+0000","last_unstale":"2024-09-16T07:31:19.778682+0000","last_undegraded":"2024-09-16T07:31:19.778682+0000","last_fullsized":"2024-09-16T07:31:19.778682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799318+0000","last_change":"2024-09-16T07:31:19.789913+0000","last_active":"2024-09-16T07:31:19.799318+0000","last_peered":"2024-09-16T07:31:19.799318+0000","last_clean":"2024-09-16T07:31:19.799318+0000","last_became_active":"2024-09-16T07:31:19.787859+0000","last_became_peered":"2024-09-16T07:31:19.787859+0000","last_unstale":"2024-09-16T07:31:19.799318+0000","last_undegraded":"2024-09-16T07:31:19.799318+0000","last_fullsized":"2024-09-16T07:31:19.799318+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:01.143423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783613+0000","last_change":"2024-09-16T07:31:18.790293+0000","last_active":"2024-09-16T07:31:19.783613+0000","last_peered":"2024-09-16T07:31:19.783613+0000","last_clean":"2024-09-16T07:31:19.783613+0000","last_became_active":"2024-09-16T07:31:18.789971+0000","last_became_peered":"2024-09-16T07:31:18.789971+0000","last_unstale":"2024-09-16T07:31:19.783613+0000","last_undegraded":"2024-09-16T07:31:19.783613+0000","last_fullsized":"2024-09-16T07:31:19.783613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:02.508386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800242+0000","last_change":"2024-09-16T07:31:19.792022+0000","last_active":"2024-09-16T07:31:19.800242+0000","last_peered":"2024-09-16T07:31:19.800242+0000","last_clean":"2024-09-16T07:31:19.800242+0000","last_became_active":"2024-09-16T07:31:19.791203+0000","last_became_peered":"2024-09-16T07:31:19.791203+0000","last_unstale":"2024-09-16T07:31:19.800242+0000","last_undegraded":"2024-09-16T07:31:19.800242+0000","last_fullsized":"2024-09-16T07:31:19.800242+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:40.399078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777660+0000","last_change":"2024-09-16T07:31:18.786810+0000","last_active":"2024-09-16T07:31:19.777660+0000","last_peered":"2024-09-16T07:31:19.777660+0000","last_clean":"2024-09-16T07:31:19.777660+0000","last_became_active":"2024-09-16T07:31:18.786465+0000","last_became_peered":"2024-09-16T07:31:18.786465+0000","last_unstale":"2024-09-16T07:31:19.777660+0000","last_undegraded":"2024-09-16T07:31:19.777660+0000","last_fullsized":"2024-09-16T07:31:19.777660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799340+0000","last_change":"2024-09-16T07:31:19.795431+0000","last_active":"2024-09-16T07:31:19.799340+0000","last_peered":"2024-09-16T07:31:19.799340+0000","last_clean":"2024-09-16T07:31:19.799340+0000","last_became_active":"2024-09-16T07:31:19.795082+0000","last_became_peered":"2024-09-16T07:31:19.795082+0000","last_unstale":"2024-09-16T07:31:19.799340+0000","last_undegraded":"2024-09-16T07:31:19.799340+0000","last_fullsized":"2024-09-16T07:31:19.799340+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.786412+0000","last_change":"2024-09-16T07:31:18.782972+0000","last_active":"2024-09-16T07:31:19.786412+0000","last_peered":"2024-09-16T07:31:19.786412+0000","last_clean":"2024-09-16T07:31:19.786412+0000","last_became_active":"2024-09-16T07:31:18.782718+0000","last_became_peered":"2024-09-16T07:31:18.782718+0000","last_unstale":"2024-09-16T07:31:19.786412+0000","last_undegraded":"2024-09-16T07:31:19.786412+0000","last_fullsized":"2024-09-16T07:31:19.786412+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:51.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801851+0000","last_change":"2024-09-16T07:31:19.797122+0000","last_active":"2024-09-16T07:31:19.801851+0000","last_peered":"2024-09-16T07:31:19.801851+0000","last_clean":"2024-09-16T07:31:19.801851+0000","last_became_active":"2024-09-16T07:31:19.796492+0000","last_became_peered":"2024-09-16T07:31:19.796492+0000","last_unstale":"2024-09-16T07:31:19.801851+0000","last_undegraded":"2024-09-16T07:31:19.801851+0000","last_fullsized":"2024-09-16T07:31:19.801851+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:03.259826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.818627+0000","last_change":"2024-09-16T07:31:18.791265+0000","last_active":"2024-09-16T07:31:19.818627+0000","last_peered":"2024-09-16T07:31:19.818627+0000","last_clean":"2024-09-16T07:31:19.818627+0000","last_became_active":"2024-09-16T07:31:18.790938+0000","last_became_peered":"2024-09-16T07:31:18.790938+0000","last_unstale":"2024-09-16T07:31:19.818627+0000","last_undegraded":"2024-09-16T07:31:19.818627+0000","last_fullsized":"2024-09-16T07:31:19.818627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.802780+0000","last_change":"2024-09-16T07:31:19.799667+0000","last_active":"2024-09-16T07:31:19.802780+0000","last_peered":"2024-09-16T07:31:19.802780+0000","last_clean":"2024-09-16T07:31:19.802780+0000","last_became_active":"2024-09-16T07:31:19.798050+0000","last_became_peered":"2024-09-16T07:31:19.798050+0000","last_unstale":"2024-09-16T07:31:19.802780+0000","last_undegraded":"2024-09-16T07:31:19.802780+0000","last_fullsized":"2024-09-16T07:31:19.802780+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.821324+0000","last_change":"2024-09-16T07:31:18.790021+0000","last_active":"2024-09-16T07:31:19.821324+0000","last_peered":"2024-09-16T07:31:19.821324+0000","last_clean":"2024-09-16T07:31:19.821324+0000","last_became_active":"2024-09-16T07:31:18.789741+0000","last_became_peered":"2024-09-16T07:31:18.789741+0000","last_unstale":"2024-09-16T07:31:19.821324+0000","last_undegraded":"2024-09-16T07:31:19.821324+0000","last_fullsized":"2024-09-16T07:31:19.821324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:21.281704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795381+0000","last_change":"2024-09-16T07:31:19.789229+0000","last_active":"2024-09-16T07:31:19.795381+0000","last_peered":"2024-09-16T07:31:19.795381+0000","last_clean":"2024-09-16T07:31:19.795381+0000","last_became_active":"2024-09-16T07:31:19.788959+0000","last_became_peered":"2024-09-16T07:31:19.788959+0000","last_unstale":"2024-09-16T07:31:19.795381+0000","last_undegraded":"2024-09-16T07:31:19.795381+0000","last_fullsized":"2024-09-16T07:31:19.795381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:59.473022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820003+0000","last_change":"2024-09-16T07:31:18.776594+0000","last_active":"2024-09-16T07:31:19.820003+0000","last_peered":"2024-09-16T07:31:19.820003+0000","last_clean":"2024-09-16T07:31:19.820003+0000","last_became_active":"2024-09-16T07:31:18.776279+0000","last_became_peered":"2024-09-16T07:31:18.776279+0000","last_unstale":"2024-09-16T07:31:19.820003+0000","last_undegraded":"2024-09-16T07:31:19.820003+0000","last_fullsized":"2024-09-16T07:31:19.820003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:25.190475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798610+0000","last_change":"2024-09-16T07:31:19.792528+0000","last_active":"2024-09-16T07:31:19.798610+0000","last_peered":"2024-09-16T07:31:19.798610+0000","last_clean":"2024-09-16T07:31:19.798610+0000","last_became_active":"2024-09-16T07:31:19.792259+0000","last_became_peered":"2024-09-16T07:31:19.792259+0000","last_unstale":"2024-09-16T07:31:19.798610+0000","last_undegraded":"2024-09-16T07:31:19.798610+0000","last_fullsized":"2024-09-16T07:31:19.798610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780485+0000","last_change":"2024-09-16T07:31:18.772988+0000","last_active":"2024-09-16T07:31:19.780485+0000","last_peered":"2024-09-16T07:31:19.780485+0000","last_clean":"2024-09-16T07:31:19.780485+0000","last_became_active":"2024-09-16T07:31:18.772533+0000","last_became_peered":"2024-09-16T07:31:18.772533+0000","last_unstale":"2024-09-16T07:31:19.780485+0000","last_undegraded":"2024-09-16T07:31:19.780485+0000","last_fullsized":"2024-09-16T07:31:19.780485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:22.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800425+0000","last_change":"2024-09-16T07:31:19.793747+0000","last_active":"2024-09-16T07:31:19.800425+0000","last_peered":"2024-09-16T07:31:19.800425+0000","last_clean":"2024-09-16T07:31:19.800425+0000","last_became_active":"2024-09-16T07:31:19.793378+0000","last_became_peered":"2024-09-16T07:31:19.793378+0000","last_unstale":"2024-09-16T07:31:19.800425+0000","last_undegraded":"2024-09-16T07:31:19.800425+0000","last_fullsized":"2024-09-16T07:31:19.800425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:22.566055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778886+0000","last_change":"2024-09-16T07:31:18.773395+0000","last_active":"2024-09-16T07:31:19.778886+0000","last_peered":"2024-09-16T07:31:19.778886+0000","last_clean":"2024-09-16T07:31:19.778886+0000","last_became_active":"2024-09-16T07:31:18.773128+0000","last_became_peered":"2024-09-16T07:31:18.773128+0000","last_unstale":"2024-09-16T07:31:19.778886+0000","last_undegraded":"2024-09-16T07:31:19.778886+0000","last_fullsized":"2024-09-16T07:31:19.778886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799186+0000","last_change":"2024-09-16T07:31:19.792038+0000","last_active":"2024-09-16T07:31:19.799186+0000","last_peered":"2024-09-16T07:31:19.799186+0000","last_clean":"2024-09-16T07:31:19.799186+0000","last_became_active":"2024-09-16T07:31:19.791722+0000","last_became_peered":"2024-09-16T07:31:19.791722+0000","last_unstale":"2024-09-16T07:31:19.799186+0000","last_undegraded":"2024-09-16T07:31:19.799186+0000","last_fullsized":"2024-09-16T07:31:19.799186+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820427+0000","last_change":"2024-09-16T07:31:18.781351+0000","last_active":"2024-09-16T07:31:19.820427+0000","last_peered":"2024-09-16T07:31:19.820427+0000","last_clean":"2024-09-16T07:31:19.820427+0000","last_became_active":"2024-09-16T07:31:18.781032+0000","last_became_peered":"2024-09-16T07:31:18.781032+0000","last_unstale":"2024-09-16T07:31:19.820427+0000","last_undegraded":"2024-09-16T07:31:19.820427+0000","last_fullsized":"2024-09-16T07:31:19.820427+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800715+0000","last_change":"2024-09-16T07:31:19.797161+0000","last_active":"2024-09-16T07:31:19.800715+0000","last_peered":"2024-09-16T07:31:19.800715+0000","last_clean":"2024-09-16T07:31:19.800715+0000","last_became_active":"2024-09-16T07:31:19.796761+0000","last_became_peered":"2024-09-16T07:31:19.796761+0000","last_unstale":"2024-09-16T07:31:19.800715+0000","last_undegraded":"2024-09-16T07:31:19.800715+0000","last_fullsized":"2024-09-16T07:31:19.800715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817665+0000","last_change":"2024-09-16T07:31:18.784339+0000","last_active":"2024-09-16T07:31:19.817665+0000","last_peered":"2024-09-16T07:31:19.817665+0000","last_clean":"2024-09-16T07:31:19.817665+0000","last_became_active":"2024-09-16T07:31:18.783476+0000","last_became_peered":"2024-09-16T07:31:18.783476+0000","last_unstale":"2024-09-16T07:31:19.817665+0000","last_undegraded":"2024-09-16T07:31:19.817665+0000","last_fullsized":"2024-09-16T07:31:19.817665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:53.213568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794691+0000","last_change":"2024-09-16T07:31:19.788247+0000","last_active":"2024-09-16T07:31:19.794691+0000","last_peered":"2024-09-16T07:31:19.794691+0000","last_clean":"2024-09-16T07:31:19.794691+0000","last_became_active":"2024-09-16T07:31:19.787994+0000","last_became_peered":"2024-09-16T07:31:19.787994+0000","last_unstale":"2024-09-16T07:31:19.794691+0000","last_undegraded":"2024-09-16T07:31:19.794691+0000","last_fullsized":"2024-09-16T07:31:19.794691+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819795+0000","last_change":"2024-09-16T07:31:18.789879+0000","last_active":"2024-09-16T07:31:19.819795+0000","last_peered":"2024-09-16T07:31:19.819795+0000","last_clean":"2024-09-16T07:31:19.819795+0000","last_became_active":"2024-09-16T07:31:18.788588+0000","last_became_peered":"2024-09-16T07:31:18.788588+0000","last_unstale":"2024-09-16T07:31:19.819795+0000","last_undegraded":"2024-09-16T07:31:19.819795+0000","last_fullsized":"2024-09-16T07:31:19.819795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:37.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807126+0000","last_change":"2024-09-16T07:31:19.794796+0000","last_active":"2024-09-16T07:31:19.807126+0000","last_peered":"2024-09-16T07:31:19.807126+0000","last_clean":"2024-09-16T07:31:19.807126+0000","last_became_active":"2024-09-16T07:31:19.794529+0000","last_became_peered":"2024-09-16T07:31:19.794529+0000","last_unstale":"2024-09-16T07:31:19.807126+0000","last_undegraded":"2024-09-16T07:31:19.807126+0000","last_fullsized":"2024-09-16T07:31:19.807126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:22:55.100874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815836+0000","last_change":"2024-09-16T07:31:18.774527+0000","last_active":"2024-09-16T07:31:19.815836+0000","last_peered":"2024-09-16T07:31:19.815836+0000","last_clean":"2024-09-16T07:31:19.815836+0000","last_became_active":"2024-09-16T07:31:18.774274+0000","last_became_peered":"2024-09-16T07:31:18.774274+0000","last_unstale":"2024-09-16T07:31:19.815836+0000","last_undegraded":"2024-09-16T07:31:19.815836+0000","last_fullsized":"2024-09-16T07:31:19.815836+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:04.070738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794261+0000","last_change":"2024-09-16T07:31:19.790939+0000","last_active":"2024-09-16T07:31:19.794261+0000","last_peered":"2024-09-16T07:31:19.794261+0000","last_clean":"2024-09-16T07:31:19.794261+0000","last_became_active":"2024-09-16T07:31:19.789693+0000","last_became_peered":"2024-09-16T07:31:19.789693+0000","last_unstale":"2024-09-16T07:31:19.794261+0000","last_undegraded":"2024-09-16T07:31:19.794261+0000","last_fullsized":"2024-09-16T07:31:19.794261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:09.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.792614+0000","last_change":"2024-09-16T07:31:18.795070+0000","last_active":"2024-09-16T07:31:19.792614+0000","last_peered":"2024-09-16T07:31:19.792614+0000","last_clean":"2024-09-16T07:31:19.792614+0000","last_became_active":"2024-09-16T07:31:18.793712+0000","last_became_peered":"2024-09-16T07:31:18.793712+0000","last_unstale":"2024-09-16T07:31:19.792614+0000","last_undegraded":"2024-09-16T07:31:19.792614+0000","last_fullsized":"2024-09-16T07:31:19.792614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795358+0000","last_change":"2024-09-16T07:31:19.789084+0000","last_active":"2024-09-16T07:31:19.795358+0000","last_peered":"2024-09-16T07:31:19.795358+0000","last_clean":"2024-09-16T07:31:19.795358+0000","last_became_active":"2024-09-16T07:31:19.788667+0000","last_became_peered":"2024-09-16T07:31:19.788667+0000","last_unstale":"2024-09-16T07:31:19.795358+0000","last_undegraded":"2024-09-16T07:31:19.795358+0000","last_fullsized":"2024-09-16T07:31:19.795358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822022+0000","last_change":"2024-09-16T07:31:18.789543+0000","last_active":"2024-09-16T07:31:19.822022+0000","last_peered":"2024-09-16T07:31:19.822022+0000","last_clean":"2024-09-16T07:31:19.822022+0000","last_became_active":"2024-09-16T07:31:18.789265+0000","last_became_peered":"2024-09-16T07:31:18.789265+0000","last_unstale":"2024-09-16T07:31:19.822022+0000","last_undegraded":"2024-09-16T07:31:19.822022+0000","last_fullsized":"2024-09-16T07:31:19.822022+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:47.674243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805813+0000","last_change":"2024-09-16T07:31:19.799276+0000","last_active":"2024-09-16T07:31:19.805813+0000","last_peered":"2024-09-16T07:31:19.805813+0000","last_clean":"2024-09-16T07:31:19.805813+0000","last_became_active":"2024-09-16T07:31:19.799034+0000","last_became_peered":"2024-09-16T07:31:19.799034+0000","last_unstale":"2024-09-16T07:31:19.805813+0000","last_undegraded":"2024-09-16T07:31:19.805813+0000","last_fullsized":"2024-09-16T07:31:19.805813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776957+0000","last_change":"2024-09-16T07:31:18.787186+0000","last_active":"2024-09-16T07:31:19.776957+0000","last_peered":"2024-09-16T07:31:19.776957+0000","last_clean":"2024-09-16T07:31:19.776957+0000","last_became_active":"2024-09-16T07:31:18.786925+0000","last_became_peered":"2024-09-16T07:31:18.786925+0000","last_unstale":"2024-09-16T07:31:19.776957+0000","last_undegraded":"2024-09-16T07:31:19.776957+0000","last_fullsized":"2024-09-16T07:31:19.776957+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:06.201636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806223+0000","last_change":"2024-09-16T07:31:19.801738+0000","last_active":"2024-09-16T07:31:19.806223+0000","last_peered":"2024-09-16T07:31:19.806223+0000","last_clean":"2024-09-16T07:31:19.806223+0000","last_became_active":"2024-09-16T07:31:19.801475+0000","last_became_peered":"2024-09-16T07:31:19.801475+0000","last_unstale":"2024-09-16T07:31:19.806223+0000","last_undegraded":"2024-09-16T07:31:19.806223+0000","last_fullsized":"2024-09-16T07:31:19.806223+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778633+0000","last_change":"2024-09-16T07:31:18.787455+0000","last_active":"2024-09-16T07:31:19.778633+0000","last_peered":"2024-09-16T07:31:19.778633+0000","last_clean":"2024-09-16T07:31:19.778633+0000","last_became_active":"2024-09-16T07:31:18.787111+0000","last_became_peered":"2024-09-16T07:31:18.787111+0000","last_unstale":"2024-09-16T07:31:19.778633+0000","last_undegraded":"2024-09-16T07:31:19.778633+0000","last_fullsized":"2024-09-16T07:31:19.778633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795458+0000","last_change":"2024-09-16T07:31:19.789411+0000","last_active":"2024-09-16T07:31:19.795458+0000","last_peered":"2024-09-16T07:31:19.795458+0000","last_clean":"2024-09-16T07:31:19.795458+0000","last_became_active":"2024-09-16T07:31:19.789063+0000","last_became_peered":"2024-09-16T07:31:19.789063+0000","last_unstale":"2024-09-16T07:31:19.795458+0000","last_undegraded":"2024-09-16T07:31:19.795458+0000","last_fullsized":"2024-09-16T07:31:19.795458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820683+0000","last_change":"2024-09-16T07:31:18.794588+0000","last_active":"2024-09-16T07:31:19.820683+0000","last_peered":"2024-09-16T07:31:19.820683+0000","last_clean":"2024-09-16T07:31:19.820683+0000","last_became_active":"2024-09-16T07:31:18.793959+0000","last_became_peered":"2024-09-16T07:31:18.793959+0000","last_unstale":"2024-09-16T07:31:19.820683+0000","last_undegraded":"2024-09-16T07:31:19.820683+0000","last_fullsized":"2024-09-16T07:31:19.820683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:40.698336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798506+0000","last_change":"2024-09-16T07:31:19.793595+0000","last_active":"2024-09-16T07:31:19.798506+0000","last_peered":"2024-09-16T07:31:19.798506+0000","last_clean":"2024-09-16T07:31:19.798506+0000","last_became_active":"2024-09-16T07:31:19.793298+0000","last_became_peered":"2024-09-16T07:31:19.793298+0000","last_unstale":"2024-09-16T07:31:19.798506+0000","last_undegraded":"2024-09-16T07:31:19.798506+0000","last_fullsized":"2024-09-16T07:31:19.798506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.793466+0000","last_change":"2024-09-16T07:31:18.788195+0000","last_active":"2024-09-16T07:31:19.793466+0000","last_peered":"2024-09-16T07:31:19.793466+0000","last_clean":"2024-09-16T07:31:19.793466+0000","last_became_active":"2024-09-16T07:31:18.787856+0000","last_became_peered":"2024-09-16T07:31:18.787856+0000","last_unstale":"2024-09-16T07:31:19.793466+0000","last_undegraded":"2024-09-16T07:31:19.793466+0000","last_fullsized":"2024-09-16T07:31:19.793466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:53.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801826+0000","last_change":"2024-09-16T07:31:19.796745+0000","last_active":"2024-09-16T07:31:19.801826+0000","last_peered":"2024-09-16T07:31:19.801826+0000","last_clean":"2024-09-16T07:31:19.801826+0000","last_became_active":"2024-09-16T07:31:19.796160+0000","last_became_peered":"2024-09-16T07:31:19.796160+0000","last_unstale":"2024-09-16T07:31:19.801826+0000","last_undegraded":"2024-09-16T07:31:19.801826+0000","last_fullsized":"2024-09-16T07:31:19.801826+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:18.142799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780648+0000","last_change":"2024-09-16T07:31:18.775590+0000","last_active":"2024-09-16T07:31:19.780648+0000","last_peered":"2024-09-16T07:31:19.780648+0000","last_clean":"2024-09-16T07:31:19.780648+0000","last_became_active":"2024-09-16T07:31:18.775372+0000","last_became_peered":"2024-09-16T07:31:18.775372+0000","last_unstale":"2024-09-16T07:31:19.780648+0000","last_undegraded":"2024-09-16T07:31:19.780648+0000","last_fullsized":"2024-09-16T07:31:19.780648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:51.048762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804769+0000","last_change":"2024-09-16T07:31:19.797206+0000","last_active":"2024-09-16T07:31:19.804769+0000","last_peered":"2024-09-16T07:31:19.804769+0000","last_clean":"2024-09-16T07:31:19.804769+0000","last_became_active":"2024-09-16T07:31:19.796955+0000","last_became_peered":"2024-09-16T07:31:19.796955+0000","last_unstale":"2024-09-16T07:31:19.804769+0000","last_undegraded":"2024-09-16T07:31:19.804769+0000","last_fullsized":"2024-09-16T07:31:19.804769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780195+0000","last_change":"2024-09-16T07:31:18.779241+0000","last_active":"2024-09-16T07:31:19.780195+0000","last_peered":"2024-09-16T07:31:19.780195+0000","last_clean":"2024-09-16T07:31:19.780195+0000","last_became_active":"2024-09-16T07:31:18.778973+0000","last_became_peered":"2024-09-16T07:31:18.778973+0000","last_unstale":"2024-09-16T07:31:19.780195+0000","last_undegraded":"2024-09-16T07:31:19.780195+0000","last_fullsized":"2024-09-16T07:31:19.780195+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799187+0000","last_change":"2024-09-16T07:31:19.791585+0000","last_active":"2024-09-16T07:31:19.799187+0000","last_peered":"2024-09-16T07:31:19.799187+0000","last_clean":"2024-09-16T07:31:19.799187+0000","last_became_active":"2024-09-16T07:31:19.791327+0000","last_became_peered":"2024-09-16T07:31:19.791327+0000","last_unstale":"2024-09-16T07:31:19.799187+0000","last_undegraded":"2024-09-16T07:31:19.799187+0000","last_fullsized":"2024-09-16T07:31:19.799187+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:27.493050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776933+0000","last_change":"2024-09-16T07:31:18.787749+0000","last_active":"2024-09-16T07:31:19.776933+0000","last_peered":"2024-09-16T07:31:19.776933+0000","last_clean":"2024-09-16T07:31:19.776933+0000","last_became_active":"2024-09-16T07:31:18.787475+0000","last_became_peered":"2024-09-16T07:31:18.787475+0000","last_unstale":"2024-09-16T07:31:19.776933+0000","last_undegraded":"2024-09-16T07:31:19.776933+0000","last_fullsized":"2024-09-16T07:31:19.776933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:20.592987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794310+0000","last_change":"2024-09-16T07:31:19.790582+0000","last_active":"2024-09-16T07:31:19.794310+0000","last_peered":"2024-09-16T07:31:19.794310+0000","last_clean":"2024-09-16T07:31:19.794310+0000","last_became_active":"2024-09-16T07:31:19.790285+0000","last_became_peered":"2024-09-16T07:31:19.790285+0000","last_unstale":"2024-09-16T07:31:19.794310+0000","last_undegraded":"2024-09-16T07:31:19.794310+0000","last_fullsized":"2024-09-16T07:31:19.794310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:05.077038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.784768+0000","last_change":"2024-09-16T07:31:18.790010+0000","last_active":"2024-09-16T07:31:19.784768+0000","last_peered":"2024-09-16T07:31:19.784768+0000","last_clean":"2024-09-16T07:31:19.784768+0000","last_became_active":"2024-09-16T07:31:18.789733+0000","last_became_peered":"2024-09-16T07:31:18.789733+0000","last_unstale":"2024-09-16T07:31:19.784768+0000","last_undegraded":"2024-09-16T07:31:19.784768+0000","last_fullsized":"2024-09-16T07:31:19.784768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:35.643472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804052+0000","last_change":"2024-09-16T07:31:19.799293+0000","last_active":"2024-09-16T07:31:19.804052+0000","last_peered":"2024-09-16T07:31:19.804052+0000","last_clean":"2024-09-16T07:31:19.804052+0000","last_became_active":"2024-09-16T07:31:19.799086+0000","last_became_peered":"2024-09-16T07:31:19.799086+0000","last_unstale":"2024-09-16T07:31:19.804052+0000","last_undegraded":"2024-09-16T07:31:19.804052+0000","last_fullsized":"2024-09-16T07:31:19.804052+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:26.031540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776937+0000","last_change":"2024-09-16T07:31:18.792232+0000","last_active":"2024-09-16T07:31:19.776937+0000","last_peered":"2024-09-16T07:31:19.776937+0000","last_clean":"2024-09-16T07:31:19.776937+0000","last_became_active":"2024-09-16T07:31:18.791920+0000","last_became_peered":"2024-09-16T07:31:18.791920+0000","last_unstale":"2024-09-16T07:31:19.776937+0000","last_undegraded":"2024-09-16T07:31:19.776937+0000","last_fullsized":"2024-09-16T07:31:19.776937+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:39.264345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807003+0000","last_change":"2024-09-16T07:31:19.794654+0000","last_active":"2024-09-16T07:31:19.807003+0000","last_peered":"2024-09-16T07:31:19.807003+0000","last_clean":"2024-09-16T07:31:19.807003+0000","last_became_active":"2024-09-16T07:31:19.794379+0000","last_became_peered":"2024-09-16T07:31:19.794379+0000","last_unstale":"2024-09-16T07:31:19.807003+0000","last_undegraded":"2024-09-16T07:31:19.807003+0000","last_fullsized":"2024-09-16T07:31:19.807003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:02.848339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783051+0000","last_change":"2024-09-16T07:31:18.789535+0000","last_active":"2024-09-16T07:31:19.783051+0000","last_peered":"2024-09-16T07:31:19.783051+0000","last_clean":"2024-09-16T07:31:19.783051+0000","last_became_active":"2024-09-16T07:31:18.789035+0000","last_became_peered":"2024-09-16T07:31:18.789035+0000","last_unstale":"2024-09-16T07:31:19.783051+0000","last_undegraded":"2024-09-16T07:31:19.783051+0000","last_fullsized":"2024-09-16T07:31:19.783051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:04.021360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808602+0000","last_change":"2024-09-16T07:31:19.801383+0000","last_active":"2024-09-16T07:31:19.808602+0000","last_peered":"2024-09-16T07:31:19.808602+0000","last_clean":"2024-09-16T07:31:19.808602+0000","last_became_active":"2024-09-16T07:31:19.801123+0000","last_became_peered":"2024-09-16T07:31:19.801123+0000","last_unstale":"2024-09-16T07:31:19.808602+0000","last_undegraded":"2024-09-16T07:31:19.808602+0000","last_fullsized":"2024-09-16T07:31:19.808602+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:31:17.995605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.781321+0000","last_change":"2024-09-16T07:31:18.774958+0000","last_active":"2024-09-16T07:31:19.781321+0000","last_peered":"2024-09-16T07:31:19.781321+0000","last_clean":"2024-09-16T07:31:19.781321+0000","last_became_active":"2024-09-16T07:31:18.774697+0000","last_became_peered":"2024-09-16T07:31:18.774697+0000","last_unstale":"2024-09-16T07:31:19.781321+0000","last_undegraded":"2024-09-16T07:31:19.781321+0000","last_fullsized":"2024-09-16T07:31:19.781321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:39.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777462+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:31:19.777462+0000","last_peered":"2024-09-16T07:31:19.777462+0000","last_clean":"2024-09-16T07:31:19.777462+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:31:19.777462+0000","last_undegraded":"2024-09-16T07:31:19.777462+0000","last_fullsized":"2024-09-16T07:31:19.777462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":675840,"data_stored":273330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":667648,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:31:24.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:31:24.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- 172.21.15.114:0/3697417976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc0c6250 msgr2=0x7efdcc0c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 --2- 172.21.15.114:0/3697417976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc0c6250 0x7efdcc0c6630 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009c80 tx=0x7efdbc01cd10 comp rx=0 tx=0).stop 2024-09-16T07:31:24.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- 172.21.15.114:0/3697417976 shutdown_connections 2024-09-16T07:31:24.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 --2- 172.21.15.114:0/3697417976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdcc073690 0x7efdcc073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 --2- 172.21.15.114:0/3697417976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc0c6250 0x7efdcc0c6630 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- 172.21.15.114:0/3697417976 >> 172.21.15.114:0/3697417976 conn(0x7efdcc06dd30 msgr2=0x7efdcc06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:24.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- 172.21.15.114:0/3697417976 shutdown_connections 2024-09-16T07:31:24.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- 172.21.15.114:0/3697417976 wait complete. 2024-09-16T07:31:24.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 Processor -- start 2024-09-16T07:31:24.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- start start 2024-09-16T07:31:24.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc073690 0x7efdcc13b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdcc0c6250 0x7efdcc159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdcc15e5c0 0x7efdcc159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1682f0 con 0x7efdcc073690 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc168170 con 0x7efdcc15e5c0 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efdcc168470 con 0x7efdcc0c6250 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc073690 0x7efdcc13b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc073690 0x7efdcc13b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33732/0 (socket says 172.21.15.114:33732) 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 -- 172.21.15.114:0/2196373999 learned_addr learned my addr 172.21.15.114:0/2196373999 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdc3400640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdcc0c6250 0x7efdcc159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdd1200640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdcc15e5c0 0x7efdcc159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 -- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdcc0c6250 msgr2=0x7efdcc159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdcc0c6250 0x7efdcc159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 -- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdcc15e5c0 msgr2=0x7efdcc159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdcc15e5c0 0x7efdcc159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.472+0000 7efdcbe00640 1 -- 172.21.15.114:0/2196373999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc1fbfd0 con 0x7efdcc073690 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdcbe00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc073690 0x7efdcc13b4b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009bd0 tx=0x7efdbc0a59e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdc8c00640 1 -- 172.21.15.114:0/2196373999 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0bb070 con 0x7efdcc073690 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdc8c00640 1 -- 172.21.15.114:0/2196373999 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdbc004e00 con 0x7efdcc073690 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc0b2e90 con 0x7efdcc073690 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdc8c00640 1 -- 172.21.15.114:0/2196373999 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0b2040 con 0x7efdcc073690 2024-09-16T07:31:24.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc0b3450 con 0x7efdcc073690 2024-09-16T07:31:24.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdcc073af0 con 0x7efdcc073690 2024-09-16T07:31:24.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdc8c00640 1 -- 172.21.15.114:0/2196373999 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7efdbc0be070 con 0x7efdcc073690 2024-09-16T07:31:24.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdc8c00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efda8073070 0x7efda8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdc8c00640 1 -- 172.21.15.114:0/2196373999 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7efdbc12e220 con 0x7efdcc073690 2024-09-16T07:31:24.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.476+0000 7efdc3400640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efda8073070 0x7efda8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.480+0000 7efdc3400640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efda8073070 0x7efda8075530 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efdb40058d0 tx=0x7efdb4005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:24.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.480+0000 7efdc8c00640 1 -- 172.21.15.114:0/2196373999 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efdbc016990 con 0x7efdcc073690 2024-09-16T07:31:24.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.648+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efdcc14e040 con 0x7efda8073070 2024-09-16T07:31:24.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.652+0000 7efdc8c00640 1 -- 172.21.15.114:0/2196373999 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251446 (secure 0 0 0) 0x7efdcc14e040 con 0x7efda8073070 2024-09-16T07:31:24.653 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:24.655 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efda8073070 msgr2=0x7efda8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efda8073070 0x7efda8075530 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efdb40058d0 tx=0x7efdb4005860 comp rx=0 tx=0).stop 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc073690 msgr2=0x7efdcc13b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc073690 0x7efdcc13b4b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009bd0 tx=0x7efdbc0a59e0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 shutdown_connections 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efda8073070 0x7efda8075530 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efdcc15e5c0 0x7efdcc159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efdcc0c6250 0x7efdcc159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 --2- 172.21.15.114:0/2196373999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdcc073690 0x7efdcc13b4b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 >> 172.21.15.114:0/2196373999 conn(0x7efdcc06dd30 msgr2=0x7efdcc15d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 shutdown_connections 2024-09-16T07:31:24.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.656+0000 7efdd1c00640 1 -- 172.21.15.114:0/2196373999 wait complete. 2024-09-16T07:31:24.674 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-16T07:31:23.039515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226696,"kb_used_data":6288,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748024,"statfs":{"total":773094113280,"available":772861976576,"internally_reserved":0,"allocated":6438912,"data_stored":3315532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.283420"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.779883+0000","last_change":"2024-09-16T07:31:18.779883+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.779883+0000","last_undegraded":"2024-09-16T07:31:18.779883+0000","last_fullsized":"2024-09-16T07:31:18.779883+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806143+0000","last_change":"2024-09-16T07:31:19.795452+0000","last_active":"2024-09-16T07:31:19.806143+0000","last_peered":"2024-09-16T07:31:19.806143+0000","last_clean":"2024-09-16T07:31:19.806143+0000","last_became_active":"2024-09-16T07:31:19.794937+0000","last_became_peered":"2024-09-16T07:31:19.794937+0000","last_unstale":"2024-09-16T07:31:19.806143+0000","last_undegraded":"2024-09-16T07:31:19.806143+0000","last_fullsized":"2024-09-16T07:31:19.806143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:26.321325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799151+0000","last_change":"2024-09-16T07:31:19.792532+0000","last_active":"2024-09-16T07:31:19.799151+0000","last_peered":"2024-09-16T07:31:19.799151+0000","last_clean":"2024-09-16T07:31:19.799151+0000","last_became_active":"2024-09-16T07:31:19.792301+0000","last_became_peered":"2024-09-16T07:31:19.792301+0000","last_unstale":"2024-09-16T07:31:19.799151+0000","last_undegraded":"2024-09-16T07:31:19.799151+0000","last_fullsized":"2024-09-16T07:31:19.799151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:52.057630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795356+0000","last_change":"2024-09-16T07:31:19.789467+0000","last_active":"2024-09-16T07:31:19.795356+0000","last_peered":"2024-09-16T07:31:19.795356+0000","last_clean":"2024-09-16T07:31:19.795356+0000","last_became_active":"2024-09-16T07:31:19.789174+0000","last_became_peered":"2024-09-16T07:31:19.789174+0000","last_unstale":"2024-09-16T07:31:19.795356+0000","last_undegraded":"2024-09-16T07:31:19.795356+0000","last_fullsized":"2024-09-16T07:31:19.795356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773895+0000","last_change":"2024-09-16T07:31:18.773895+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773895+0000","last_undegraded":"2024-09-16T07:31:18.773895+0000","last_fullsized":"2024-09-16T07:31:18.773895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806161+0000","last_change":"2024-09-16T07:31:19.802298+0000","last_active":"2024-09-16T07:31:19.806161+0000","last_peered":"2024-09-16T07:31:19.806161+0000","last_clean":"2024-09-16T07:31:19.806161+0000","last_became_active":"2024-09-16T07:31:19.802043+0000","last_became_peered":"2024-09-16T07:31:19.802043+0000","last_unstale":"2024-09-16T07:31:19.806161+0000","last_undegraded":"2024-09-16T07:31:19.806161+0000","last_fullsized":"2024-09-16T07:31:19.806161+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800986+0000","last_change":"2024-09-16T07:31:19.794748+0000","last_active":"2024-09-16T07:31:19.800986+0000","last_peered":"2024-09-16T07:31:19.800986+0000","last_clean":"2024-09-16T07:31:19.800986+0000","last_became_active":"2024-09-16T07:31:19.794494+0000","last_became_peered":"2024-09-16T07:31:19.794494+0000","last_unstale":"2024-09-16T07:31:19.800986+0000","last_undegraded":"2024-09-16T07:31:19.800986+0000","last_fullsized":"2024-09-16T07:31:19.800986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.056578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806635+0000","last_change":"2024-09-16T07:31:19.796360+0000","last_active":"2024-09-16T07:31:19.806635+0000","last_peered":"2024-09-16T07:31:19.806635+0000","last_clean":"2024-09-16T07:31:19.806635+0000","last_became_active":"2024-09-16T07:31:19.796075+0000","last_became_peered":"2024-09-16T07:31:19.796075+0000","last_unstale":"2024-09-16T07:31:19.806635+0000","last_undegraded":"2024-09-16T07:31:19.806635+0000","last_fullsized":"2024-09-16T07:31:19.806635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:07:28.758872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805823+0000","last_change":"2024-09-16T07:31:19.800757+0000","last_active":"2024-09-16T07:31:19.805823+0000","last_peered":"2024-09-16T07:31:19.805823+0000","last_clean":"2024-09-16T07:31:19.805823+0000","last_became_active":"2024-09-16T07:31:19.800483+0000","last_became_peered":"2024-09-16T07:31:19.800483+0000","last_unstale":"2024-09-16T07:31:19.805823+0000","last_undegraded":"2024-09-16T07:31:19.805823+0000","last_fullsized":"2024-09-16T07:31:19.805823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:25.288132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804028+0000","last_change":"2024-09-16T07:31:19.798727+0000","last_active":"2024-09-16T07:31:19.804028+0000","last_peered":"2024-09-16T07:31:19.804028+0000","last_clean":"2024-09-16T07:31:19.804028+0000","last_became_active":"2024-09-16T07:31:19.798309+0000","last_became_peered":"2024-09-16T07:31:19.798309+0000","last_unstale":"2024-09-16T07:31:19.804028+0000","last_undegraded":"2024-09-16T07:31:19.804028+0000","last_fullsized":"2024-09-16T07:31:19.804028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:57.608168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799535+0000","last_change":"2024-09-16T07:31:19.792993+0000","last_active":"2024-09-16T07:31:19.799535+0000","last_peered":"2024-09-16T07:31:19.799535+0000","last_clean":"2024-09-16T07:31:19.799535+0000","last_became_active":"2024-09-16T07:31:19.792461+0000","last_became_peered":"2024-09-16T07:31:19.792461+0000","last_unstale":"2024-09-16T07:31:19.799535+0000","last_undegraded":"2024-09-16T07:31:19.799535+0000","last_fullsized":"2024-09-16T07:31:19.799535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:34.182317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795330+0000","last_change":"2024-09-16T07:31:19.788824+0000","last_active":"2024-09-16T07:31:19.795330+0000","last_peered":"2024-09-16T07:31:19.795330+0000","last_clean":"2024-09-16T07:31:19.795330+0000","last_became_active":"2024-09-16T07:31:19.788477+0000","last_became_peered":"2024-09-16T07:31:19.788477+0000","last_unstale":"2024-09-16T07:31:19.795330+0000","last_undegraded":"2024-09-16T07:31:19.795330+0000","last_fullsized":"2024-09-16T07:31:19.795330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801156+0000","last_change":"2024-09-16T07:31:19.795230+0000","last_active":"2024-09-16T07:31:19.801156+0000","last_peered":"2024-09-16T07:31:19.801156+0000","last_clean":"2024-09-16T07:31:19.801156+0000","last_became_active":"2024-09-16T07:31:19.794956+0000","last_became_peered":"2024-09-16T07:31:19.794956+0000","last_unstale":"2024-09-16T07:31:19.801156+0000","last_undegraded":"2024-09-16T07:31:19.801156+0000","last_fullsized":"2024-09-16T07:31:19.801156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:13.513689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797892+0000","last_change":"2024-09-16T07:31:19.789254+0000","last_active":"2024-09-16T07:31:19.797892+0000","last_peered":"2024-09-16T07:31:19.797892+0000","last_clean":"2024-09-16T07:31:19.797892+0000","last_became_active":"2024-09-16T07:31:19.788561+0000","last_became_peered":"2024-09-16T07:31:19.788561+0000","last_unstale":"2024-09-16T07:31:19.797892+0000","last_undegraded":"2024-09-16T07:31:19.797892+0000","last_fullsized":"2024-09-16T07:31:19.797892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:14.672043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799005+0000","last_change":"2024-09-16T07:31:19.790415+0000","last_active":"2024-09-16T07:31:19.799005+0000","last_peered":"2024-09-16T07:31:19.799005+0000","last_clean":"2024-09-16T07:31:19.799005+0000","last_became_active":"2024-09-16T07:31:19.789977+0000","last_became_peered":"2024-09-16T07:31:19.789977+0000","last_unstale":"2024-09-16T07:31:19.799005+0000","last_undegraded":"2024-09-16T07:31:19.799005+0000","last_fullsized":"2024-09-16T07:31:19.799005+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:52.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808322+0000","last_change":"2024-09-16T07:31:19.803450+0000","last_active":"2024-09-16T07:31:19.808322+0000","last_peered":"2024-09-16T07:31:19.808322+0000","last_clean":"2024-09-16T07:31:19.808322+0000","last_became_active":"2024-09-16T07:31:19.803117+0000","last_became_peered":"2024-09-16T07:31:19.803117+0000","last_unstale":"2024-09-16T07:31:19.808322+0000","last_undegraded":"2024-09-16T07:31:19.808322+0000","last_fullsized":"2024-09-16T07:31:19.808322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:39.017272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807576+0000","last_change":"2024-09-16T07:31:19.798737+0000","last_active":"2024-09-16T07:31:19.807576+0000","last_peered":"2024-09-16T07:31:19.807576+0000","last_clean":"2024-09-16T07:31:19.807576+0000","last_became_active":"2024-09-16T07:31:19.798489+0000","last_became_peered":"2024-09-16T07:31:19.798489+0000","last_unstale":"2024-09-16T07:31:19.807576+0000","last_undegraded":"2024-09-16T07:31:19.807576+0000","last_fullsized":"2024-09-16T07:31:19.807576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:00:25.780049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805761+0000","last_change":"2024-09-16T07:31:19.800414+0000","last_active":"2024-09-16T07:31:19.805761+0000","last_peered":"2024-09-16T07:31:19.805761+0000","last_clean":"2024-09-16T07:31:19.805761+0000","last_became_active":"2024-09-16T07:31:19.798920+0000","last_became_peered":"2024-09-16T07:31:19.798920+0000","last_unstale":"2024-09-16T07:31:19.805761+0000","last_undegraded":"2024-09-16T07:31:19.805761+0000","last_fullsized":"2024-09-16T07:31:19.805761+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773446+0000","last_change":"2024-09-16T07:31:18.773446+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773446+0000","last_undegraded":"2024-09-16T07:31:18.773446+0000","last_fullsized":"2024-09-16T07:31:18.773446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808567+0000","last_change":"2024-09-16T07:31:19.802446+0000","last_active":"2024-09-16T07:31:19.808567+0000","last_peered":"2024-09-16T07:31:19.808567+0000","last_clean":"2024-09-16T07:31:19.808567+0000","last_became_active":"2024-09-16T07:31:19.802076+0000","last_became_peered":"2024-09-16T07:31:19.802076+0000","last_unstale":"2024-09-16T07:31:19.808567+0000","last_undegraded":"2024-09-16T07:31:19.808567+0000","last_fullsized":"2024-09-16T07:31:19.808567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:08.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800544+0000","last_change":"2024-09-16T07:31:19.797580+0000","last_active":"2024-09-16T07:31:19.800544+0000","last_peered":"2024-09-16T07:31:19.800544+0000","last_clean":"2024-09-16T07:31:19.800544+0000","last_became_active":"2024-09-16T07:31:19.796587+0000","last_became_peered":"2024-09-16T07:31:19.796587+0000","last_unstale":"2024-09-16T07:31:19.800544+0000","last_undegraded":"2024-09-16T07:31:19.800544+0000","last_fullsized":"2024-09-16T07:31:19.800544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807175+0000","last_change":"2024-09-16T07:31:19.792089+0000","last_active":"2024-09-16T07:31:19.807175+0000","last_peered":"2024-09-16T07:31:19.807175+0000","last_clean":"2024-09-16T07:31:19.807175+0000","last_became_active":"2024-09-16T07:31:19.790997+0000","last_became_peered":"2024-09-16T07:31:19.790997+0000","last_unstale":"2024-09-16T07:31:19.807175+0000","last_undegraded":"2024-09-16T07:31:19.807175+0000","last_fullsized":"2024-09-16T07:31:19.807175+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:14.300883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794491+0000","last_change":"2024-09-16T07:31:19.791289+0000","last_active":"2024-09-16T07:31:19.794491+0000","last_peered":"2024-09-16T07:31:19.794491+0000","last_clean":"2024-09-16T07:31:19.794491+0000","last_became_active":"2024-09-16T07:31:19.790974+0000","last_became_peered":"2024-09-16T07:31:19.790974+0000","last_unstale":"2024-09-16T07:31:19.794491+0000","last_undegraded":"2024-09-16T07:31:19.794491+0000","last_fullsized":"2024-09-16T07:31:19.794491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:32.744007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801740+0000","last_change":"2024-09-16T07:31:19.799545+0000","last_active":"2024-09-16T07:31:19.801740+0000","last_peered":"2024-09-16T07:31:19.801740+0000","last_clean":"2024-09-16T07:31:19.801740+0000","last_became_active":"2024-09-16T07:31:19.799285+0000","last_became_peered":"2024-09-16T07:31:19.799285+0000","last_unstale":"2024-09-16T07:31:19.801740+0000","last_undegraded":"2024-09-16T07:31:19.801740+0000","last_fullsized":"2024-09-16T07:31:19.801740+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:59.159780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.779252+0000","last_change":"2024-09-16T07:31:18.779252+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.779252+0000","last_undegraded":"2024-09-16T07:31:18.779252+0000","last_fullsized":"2024-09-16T07:31:18.779252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795481+0000","last_change":"2024-09-16T07:31:19.790142+0000","last_active":"2024-09-16T07:31:19.795481+0000","last_peered":"2024-09-16T07:31:19.795481+0000","last_clean":"2024-09-16T07:31:19.795481+0000","last_became_active":"2024-09-16T07:31:19.789787+0000","last_became_peered":"2024-09-16T07:31:19.789787+0000","last_unstale":"2024-09-16T07:31:19.795481+0000","last_undegraded":"2024-09-16T07:31:19.795481+0000","last_fullsized":"2024-09-16T07:31:19.795481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811562+0000","last_change":"2024-09-16T07:31:19.807204+0000","last_active":"2024-09-16T07:31:19.811562+0000","last_peered":"2024-09-16T07:31:19.811562+0000","last_clean":"2024-09-16T07:31:19.811562+0000","last_became_active":"2024-09-16T07:31:19.805182+0000","last_became_peered":"2024-09-16T07:31:19.805182+0000","last_unstale":"2024-09-16T07:31:19.811562+0000","last_undegraded":"2024-09-16T07:31:19.811562+0000","last_fullsized":"2024-09-16T07:31:19.811562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:57.879247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.774157+0000","last_change":"2024-09-16T07:31:18.774157+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.774157+0000","last_undegraded":"2024-09-16T07:31:18.774157+0000","last_fullsized":"2024-09-16T07:31:18.774157+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807063+0000","last_change":"2024-09-16T07:31:19.797676+0000","last_active":"2024-09-16T07:31:19.807063+0000","last_peered":"2024-09-16T07:31:19.807063+0000","last_clean":"2024-09-16T07:31:19.807063+0000","last_became_active":"2024-09-16T07:31:19.797402+0000","last_became_peered":"2024-09-16T07:31:19.797402+0000","last_unstale":"2024-09-16T07:31:19.807063+0000","last_undegraded":"2024-09-16T07:31:19.807063+0000","last_fullsized":"2024-09-16T07:31:19.807063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:29.989908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798939+0000","last_change":"2024-09-16T07:31:19.792014+0000","last_active":"2024-09-16T07:31:19.798939+0000","last_peered":"2024-09-16T07:31:19.798939+0000","last_clean":"2024-09-16T07:31:19.798939+0000","last_became_active":"2024-09-16T07:31:19.791672+0000","last_became_peered":"2024-09-16T07:31:19.791672+0000","last_unstale":"2024-09-16T07:31:19.798939+0000","last_undegraded":"2024-09-16T07:31:19.798939+0000","last_fullsized":"2024-09-16T07:31:19.798939+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-16T07:31:18.773588+0000","last_change":"2024-09-16T07:31:18.773588+0000","last_active":"2024-09-16T07:31:18.756836+0000","last_peered":"2024-09-16T07:31:18.756836+0000","last_clean":"2024-09-16T07:31:18.756836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:31:18.773588+0000","last_undegraded":"2024-09-16T07:31:18.773588+0000","last_fullsized":"2024-09-16T07:31:18.773588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811630+0000","last_change":"2024-09-16T07:31:19.809602+0000","last_active":"2024-09-16T07:31:19.811630+0000","last_peered":"2024-09-16T07:31:19.811630+0000","last_clean":"2024-09-16T07:31:19.811630+0000","last_became_active":"2024-09-16T07:31:19.809274+0000","last_became_peered":"2024-09-16T07:31:19.809274+0000","last_unstale":"2024-09-16T07:31:19.811630+0000","last_undegraded":"2024-09-16T07:31:19.811630+0000","last_fullsized":"2024-09-16T07:31:19.811630+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:38.553253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804808+0000","last_change":"2024-09-16T07:31:19.798550+0000","last_active":"2024-09-16T07:31:19.804808+0000","last_peered":"2024-09-16T07:31:19.804808+0000","last_clean":"2024-09-16T07:31:19.804808+0000","last_became_active":"2024-09-16T07:31:19.798280+0000","last_became_peered":"2024-09-16T07:31:19.798280+0000","last_unstale":"2024-09-16T07:31:19.804808+0000","last_undegraded":"2024-09-16T07:31:19.804808+0000","last_fullsized":"2024-09-16T07:31:19.804808+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822443+0000","last_change":"2024-09-16T07:31:18.788213+0000","last_active":"2024-09-16T07:31:19.822443+0000","last_peered":"2024-09-16T07:31:19.822443+0000","last_clean":"2024-09-16T07:31:19.822443+0000","last_became_active":"2024-09-16T07:31:18.787961+0000","last_became_peered":"2024-09-16T07:31:18.787961+0000","last_unstale":"2024-09-16T07:31:19.822443+0000","last_undegraded":"2024-09-16T07:31:19.822443+0000","last_fullsized":"2024-09-16T07:31:19.822443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:56.115404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797411+0000","last_change":"2024-09-16T07:31:19.789278+0000","last_active":"2024-09-16T07:31:19.797411+0000","last_peered":"2024-09-16T07:31:19.797411+0000","last_clean":"2024-09-16T07:31:19.797411+0000","last_became_active":"2024-09-16T07:31:19.789015+0000","last_became_peered":"2024-09-16T07:31:19.789015+0000","last_unstale":"2024-09-16T07:31:19.797411+0000","last_undegraded":"2024-09-16T07:31:19.797411+0000","last_fullsized":"2024-09-16T07:31:19.797411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:56.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817335+0000","last_change":"2024-09-16T07:31:18.775898+0000","last_active":"2024-09-16T07:31:19.817335+0000","last_peered":"2024-09-16T07:31:19.817335+0000","last_clean":"2024-09-16T07:31:19.817335+0000","last_became_active":"2024-09-16T07:31:18.775575+0000","last_became_peered":"2024-09-16T07:31:18.775575+0000","last_unstale":"2024-09-16T07:31:19.817335+0000","last_undegraded":"2024-09-16T07:31:19.817335+0000","last_fullsized":"2024-09-16T07:31:19.817335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:56.258821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808350+0000","last_change":"2024-09-16T07:31:19.804592+0000","last_active":"2024-09-16T07:31:19.808350+0000","last_peered":"2024-09-16T07:31:19.808350+0000","last_clean":"2024-09-16T07:31:19.808350+0000","last_became_active":"2024-09-16T07:31:19.803010+0000","last_became_peered":"2024-09-16T07:31:19.803010+0000","last_unstale":"2024-09-16T07:31:19.808350+0000","last_undegraded":"2024-09-16T07:31:19.808350+0000","last_fullsized":"2024-09-16T07:31:19.808350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:48.737794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820706+0000","last_change":"2024-09-16T07:31:18.794664+0000","last_active":"2024-09-16T07:31:19.820706+0000","last_peered":"2024-09-16T07:31:19.820706+0000","last_clean":"2024-09-16T07:31:19.820706+0000","last_became_active":"2024-09-16T07:31:18.794418+0000","last_became_peered":"2024-09-16T07:31:18.794418+0000","last_unstale":"2024-09-16T07:31:19.820706+0000","last_undegraded":"2024-09-16T07:31:19.820706+0000","last_fullsized":"2024-09-16T07:31:19.820706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811324+0000","last_change":"2024-09-16T07:31:19.805940+0000","last_active":"2024-09-16T07:31:19.811324+0000","last_peered":"2024-09-16T07:31:19.811324+0000","last_clean":"2024-09-16T07:31:19.811324+0000","last_became_active":"2024-09-16T07:31:19.804922+0000","last_became_peered":"2024-09-16T07:31:19.804922+0000","last_unstale":"2024-09-16T07:31:19.811324+0000","last_undegraded":"2024-09-16T07:31:19.811324+0000","last_fullsized":"2024-09-16T07:31:19.811324+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:10.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819227+0000","last_change":"2024-09-16T07:31:18.772762+0000","last_active":"2024-09-16T07:31:19.819227+0000","last_peered":"2024-09-16T07:31:19.819227+0000","last_clean":"2024-09-16T07:31:19.819227+0000","last_became_active":"2024-09-16T07:31:18.772483+0000","last_became_peered":"2024-09-16T07:31:18.772483+0000","last_unstale":"2024-09-16T07:31:19.819227+0000","last_undegraded":"2024-09-16T07:31:19.819227+0000","last_fullsized":"2024-09-16T07:31:19.819227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.791961+0000","last_change":"2024-09-16T07:31:19.788175+0000","last_active":"2024-09-16T07:31:19.791961+0000","last_peered":"2024-09-16T07:31:19.791961+0000","last_clean":"2024-09-16T07:31:19.791961+0000","last_became_active":"2024-09-16T07:31:19.787903+0000","last_became_peered":"2024-09-16T07:31:19.787903+0000","last_unstale":"2024-09-16T07:31:19.791961+0000","last_undegraded":"2024-09-16T07:31:19.791961+0000","last_fullsized":"2024-09-16T07:31:19.791961+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:00:10.456768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815080+0000","last_change":"2024-09-16T07:31:18.779878+0000","last_active":"2024-09-16T07:31:19.815080+0000","last_peered":"2024-09-16T07:31:19.815080+0000","last_clean":"2024-09-16T07:31:19.815080+0000","last_became_active":"2024-09-16T07:31:18.779587+0000","last_became_peered":"2024-09-16T07:31:18.779587+0000","last_unstale":"2024-09-16T07:31:19.815080+0000","last_undegraded":"2024-09-16T07:31:19.815080+0000","last_fullsized":"2024-09-16T07:31:19.815080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:12.686482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.810895+0000","last_change":"2024-09-16T07:31:19.808074+0000","last_active":"2024-09-16T07:31:19.810895+0000","last_peered":"2024-09-16T07:31:19.810895+0000","last_clean":"2024-09-16T07:31:19.810895+0000","last_became_active":"2024-09-16T07:31:19.807802+0000","last_became_peered":"2024-09-16T07:31:19.807802+0000","last_unstale":"2024-09-16T07:31:19.810895+0000","last_undegraded":"2024-09-16T07:31:19.810895+0000","last_fullsized":"2024-09-16T07:31:19.810895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:12.342419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819786+0000","last_change":"2024-09-16T07:31:18.789053+0000","last_active":"2024-09-16T07:31:19.819786+0000","last_peered":"2024-09-16T07:31:19.819786+0000","last_clean":"2024-09-16T07:31:19.819786+0000","last_became_active":"2024-09-16T07:31:18.788715+0000","last_became_peered":"2024-09-16T07:31:18.788715+0000","last_unstale":"2024-09-16T07:31:19.819786+0000","last_undegraded":"2024-09-16T07:31:19.819786+0000","last_fullsized":"2024-09-16T07:31:19.819786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:58.466722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801121+0000","last_change":"2024-09-16T07:31:19.794608+0000","last_active":"2024-09-16T07:31:19.801121+0000","last_peered":"2024-09-16T07:31:19.801121+0000","last_clean":"2024-09-16T07:31:19.801121+0000","last_became_active":"2024-09-16T07:31:19.794301+0000","last_became_peered":"2024-09-16T07:31:19.794301+0000","last_unstale":"2024-09-16T07:31:19.801121+0000","last_undegraded":"2024-09-16T07:31:19.801121+0000","last_fullsized":"2024-09-16T07:31:19.801121+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:24.874172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778682+0000","last_change":"2024-09-16T07:31:18.777720+0000","last_active":"2024-09-16T07:31:19.778682+0000","last_peered":"2024-09-16T07:31:19.778682+0000","last_clean":"2024-09-16T07:31:19.778682+0000","last_became_active":"2024-09-16T07:31:18.777300+0000","last_became_peered":"2024-09-16T07:31:18.777300+0000","last_unstale":"2024-09-16T07:31:19.778682+0000","last_undegraded":"2024-09-16T07:31:19.778682+0000","last_fullsized":"2024-09-16T07:31:19.778682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799318+0000","last_change":"2024-09-16T07:31:19.789913+0000","last_active":"2024-09-16T07:31:19.799318+0000","last_peered":"2024-09-16T07:31:19.799318+0000","last_clean":"2024-09-16T07:31:19.799318+0000","last_became_active":"2024-09-16T07:31:19.787859+0000","last_became_peered":"2024-09-16T07:31:19.787859+0000","last_unstale":"2024-09-16T07:31:19.799318+0000","last_undegraded":"2024-09-16T07:31:19.799318+0000","last_fullsized":"2024-09-16T07:31:19.799318+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:01.143423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783613+0000","last_change":"2024-09-16T07:31:18.790293+0000","last_active":"2024-09-16T07:31:19.783613+0000","last_peered":"2024-09-16T07:31:19.783613+0000","last_clean":"2024-09-16T07:31:19.783613+0000","last_became_active":"2024-09-16T07:31:18.789971+0000","last_became_peered":"2024-09-16T07:31:18.789971+0000","last_unstale":"2024-09-16T07:31:19.783613+0000","last_undegraded":"2024-09-16T07:31:19.783613+0000","last_fullsized":"2024-09-16T07:31:19.783613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:02.508386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800242+0000","last_change":"2024-09-16T07:31:19.792022+0000","last_active":"2024-09-16T07:31:19.800242+0000","last_peered":"2024-09-16T07:31:19.800242+0000","last_clean":"2024-09-16T07:31:19.800242+0000","last_became_active":"2024-09-16T07:31:19.791203+0000","last_became_peered":"2024-09-16T07:31:19.791203+0000","last_unstale":"2024-09-16T07:31:19.800242+0000","last_undegraded":"2024-09-16T07:31:19.800242+0000","last_fullsized":"2024-09-16T07:31:19.800242+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:40.399078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777660+0000","last_change":"2024-09-16T07:31:18.786810+0000","last_active":"2024-09-16T07:31:19.777660+0000","last_peered":"2024-09-16T07:31:19.777660+0000","last_clean":"2024-09-16T07:31:19.777660+0000","last_became_active":"2024-09-16T07:31:18.786465+0000","last_became_peered":"2024-09-16T07:31:18.786465+0000","last_unstale":"2024-09-16T07:31:19.777660+0000","last_undegraded":"2024-09-16T07:31:19.777660+0000","last_fullsized":"2024-09-16T07:31:19.777660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799340+0000","last_change":"2024-09-16T07:31:19.795431+0000","last_active":"2024-09-16T07:31:19.799340+0000","last_peered":"2024-09-16T07:31:19.799340+0000","last_clean":"2024-09-16T07:31:19.799340+0000","last_became_active":"2024-09-16T07:31:19.795082+0000","last_became_peered":"2024-09-16T07:31:19.795082+0000","last_unstale":"2024-09-16T07:31:19.799340+0000","last_undegraded":"2024-09-16T07:31:19.799340+0000","last_fullsized":"2024-09-16T07:31:19.799340+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.786412+0000","last_change":"2024-09-16T07:31:18.782972+0000","last_active":"2024-09-16T07:31:19.786412+0000","last_peered":"2024-09-16T07:31:19.786412+0000","last_clean":"2024-09-16T07:31:19.786412+0000","last_became_active":"2024-09-16T07:31:18.782718+0000","last_became_peered":"2024-09-16T07:31:18.782718+0000","last_unstale":"2024-09-16T07:31:19.786412+0000","last_undegraded":"2024-09-16T07:31:19.786412+0000","last_fullsized":"2024-09-16T07:31:19.786412+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:51.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801851+0000","last_change":"2024-09-16T07:31:19.797122+0000","last_active":"2024-09-16T07:31:19.801851+0000","last_peered":"2024-09-16T07:31:19.801851+0000","last_clean":"2024-09-16T07:31:19.801851+0000","last_became_active":"2024-09-16T07:31:19.796492+0000","last_became_peered":"2024-09-16T07:31:19.796492+0000","last_unstale":"2024-09-16T07:31:19.801851+0000","last_undegraded":"2024-09-16T07:31:19.801851+0000","last_fullsized":"2024-09-16T07:31:19.801851+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:03.259826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.818627+0000","last_change":"2024-09-16T07:31:18.791265+0000","last_active":"2024-09-16T07:31:19.818627+0000","last_peered":"2024-09-16T07:31:19.818627+0000","last_clean":"2024-09-16T07:31:19.818627+0000","last_became_active":"2024-09-16T07:31:18.790938+0000","last_became_peered":"2024-09-16T07:31:18.790938+0000","last_unstale":"2024-09-16T07:31:19.818627+0000","last_undegraded":"2024-09-16T07:31:19.818627+0000","last_fullsized":"2024-09-16T07:31:19.818627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.802780+0000","last_change":"2024-09-16T07:31:19.799667+0000","last_active":"2024-09-16T07:31:19.802780+0000","last_peered":"2024-09-16T07:31:19.802780+0000","last_clean":"2024-09-16T07:31:19.802780+0000","last_became_active":"2024-09-16T07:31:19.798050+0000","last_became_peered":"2024-09-16T07:31:19.798050+0000","last_unstale":"2024-09-16T07:31:19.802780+0000","last_undegraded":"2024-09-16T07:31:19.802780+0000","last_fullsized":"2024-09-16T07:31:19.802780+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.821324+0000","last_change":"2024-09-16T07:31:18.790021+0000","last_active":"2024-09-16T07:31:19.821324+0000","last_peered":"2024-09-16T07:31:19.821324+0000","last_clean":"2024-09-16T07:31:19.821324+0000","last_became_active":"2024-09-16T07:31:18.789741+0000","last_became_peered":"2024-09-16T07:31:18.789741+0000","last_unstale":"2024-09-16T07:31:19.821324+0000","last_undegraded":"2024-09-16T07:31:19.821324+0000","last_fullsized":"2024-09-16T07:31:19.821324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:21.281704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795381+0000","last_change":"2024-09-16T07:31:19.789229+0000","last_active":"2024-09-16T07:31:19.795381+0000","last_peered":"2024-09-16T07:31:19.795381+0000","last_clean":"2024-09-16T07:31:19.795381+0000","last_became_active":"2024-09-16T07:31:19.788959+0000","last_became_peered":"2024-09-16T07:31:19.788959+0000","last_unstale":"2024-09-16T07:31:19.795381+0000","last_undegraded":"2024-09-16T07:31:19.795381+0000","last_fullsized":"2024-09-16T07:31:19.795381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:59.473022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820003+0000","last_change":"2024-09-16T07:31:18.776594+0000","last_active":"2024-09-16T07:31:19.820003+0000","last_peered":"2024-09-16T07:31:19.820003+0000","last_clean":"2024-09-16T07:31:19.820003+0000","last_became_active":"2024-09-16T07:31:18.776279+0000","last_became_peered":"2024-09-16T07:31:18.776279+0000","last_unstale":"2024-09-16T07:31:19.820003+0000","last_undegraded":"2024-09-16T07:31:19.820003+0000","last_fullsized":"2024-09-16T07:31:19.820003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:25.190475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798610+0000","last_change":"2024-09-16T07:31:19.792528+0000","last_active":"2024-09-16T07:31:19.798610+0000","last_peered":"2024-09-16T07:31:19.798610+0000","last_clean":"2024-09-16T07:31:19.798610+0000","last_became_active":"2024-09-16T07:31:19.792259+0000","last_became_peered":"2024-09-16T07:31:19.792259+0000","last_unstale":"2024-09-16T07:31:19.798610+0000","last_undegraded":"2024-09-16T07:31:19.798610+0000","last_fullsized":"2024-09-16T07:31:19.798610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780485+0000","last_change":"2024-09-16T07:31:18.772988+0000","last_active":"2024-09-16T07:31:19.780485+0000","last_peered":"2024-09-16T07:31:19.780485+0000","last_clean":"2024-09-16T07:31:19.780485+0000","last_became_active":"2024-09-16T07:31:18.772533+0000","last_became_peered":"2024-09-16T07:31:18.772533+0000","last_unstale":"2024-09-16T07:31:19.780485+0000","last_undegraded":"2024-09-16T07:31:19.780485+0000","last_fullsized":"2024-09-16T07:31:19.780485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:22.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800425+0000","last_change":"2024-09-16T07:31:19.793747+0000","last_active":"2024-09-16T07:31:19.800425+0000","last_peered":"2024-09-16T07:31:19.800425+0000","last_clean":"2024-09-16T07:31:19.800425+0000","last_became_active":"2024-09-16T07:31:19.793378+0000","last_became_peered":"2024-09-16T07:31:19.793378+0000","last_unstale":"2024-09-16T07:31:19.800425+0000","last_undegraded":"2024-09-16T07:31:19.800425+0000","last_fullsized":"2024-09-16T07:31:19.800425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:22.566055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778886+0000","last_change":"2024-09-16T07:31:18.773395+0000","last_active":"2024-09-16T07:31:19.778886+0000","last_peered":"2024-09-16T07:31:19.778886+0000","last_clean":"2024-09-16T07:31:19.778886+0000","last_became_active":"2024-09-16T07:31:18.773128+0000","last_became_peered":"2024-09-16T07:31:18.773128+0000","last_unstale":"2024-09-16T07:31:19.778886+0000","last_undegraded":"2024-09-16T07:31:19.778886+0000","last_fullsized":"2024-09-16T07:31:19.778886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799186+0000","last_change":"2024-09-16T07:31:19.792038+0000","last_active":"2024-09-16T07:31:19.799186+0000","last_peered":"2024-09-16T07:31:19.799186+0000","last_clean":"2024-09-16T07:31:19.799186+0000","last_became_active":"2024-09-16T07:31:19.791722+0000","last_became_peered":"2024-09-16T07:31:19.791722+0000","last_unstale":"2024-09-16T07:31:19.799186+0000","last_undegraded":"2024-09-16T07:31:19.799186+0000","last_fullsized":"2024-09-16T07:31:19.799186+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820427+0000","last_change":"2024-09-16T07:31:18.781351+0000","last_active":"2024-09-16T07:31:19.820427+0000","last_peered":"2024-09-16T07:31:19.820427+0000","last_clean":"2024-09-16T07:31:19.820427+0000","last_became_active":"2024-09-16T07:31:18.781032+0000","last_became_peered":"2024-09-16T07:31:18.781032+0000","last_unstale":"2024-09-16T07:31:19.820427+0000","last_undegraded":"2024-09-16T07:31:19.820427+0000","last_fullsized":"2024-09-16T07:31:19.820427+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800715+0000","last_change":"2024-09-16T07:31:19.797161+0000","last_active":"2024-09-16T07:31:19.800715+0000","last_peered":"2024-09-16T07:31:19.800715+0000","last_clean":"2024-09-16T07:31:19.800715+0000","last_became_active":"2024-09-16T07:31:19.796761+0000","last_became_peered":"2024-09-16T07:31:19.796761+0000","last_unstale":"2024-09-16T07:31:19.800715+0000","last_undegraded":"2024-09-16T07:31:19.800715+0000","last_fullsized":"2024-09-16T07:31:19.800715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817665+0000","last_change":"2024-09-16T07:31:18.784339+0000","last_active":"2024-09-16T07:31:19.817665+0000","last_peered":"2024-09-16T07:31:19.817665+0000","last_clean":"2024-09-16T07:31:19.817665+0000","last_became_active":"2024-09-16T07:31:18.783476+0000","last_became_peered":"2024-09-16T07:31:18.783476+0000","last_unstale":"2024-09-16T07:31:19.817665+0000","last_undegraded":"2024-09-16T07:31:19.817665+0000","last_fullsized":"2024-09-16T07:31:19.817665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:53.213568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794691+0000","last_change":"2024-09-16T07:31:19.788247+0000","last_active":"2024-09-16T07:31:19.794691+0000","last_peered":"2024-09-16T07:31:19.794691+0000","last_clean":"2024-09-16T07:31:19.794691+0000","last_became_active":"2024-09-16T07:31:19.787994+0000","last_became_peered":"2024-09-16T07:31:19.787994+0000","last_unstale":"2024-09-16T07:31:19.794691+0000","last_undegraded":"2024-09-16T07:31:19.794691+0000","last_fullsized":"2024-09-16T07:31:19.794691+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819795+0000","last_change":"2024-09-16T07:31:18.789879+0000","last_active":"2024-09-16T07:31:19.819795+0000","last_peered":"2024-09-16T07:31:19.819795+0000","last_clean":"2024-09-16T07:31:19.819795+0000","last_became_active":"2024-09-16T07:31:18.788588+0000","last_became_peered":"2024-09-16T07:31:18.788588+0000","last_unstale":"2024-09-16T07:31:19.819795+0000","last_undegraded":"2024-09-16T07:31:19.819795+0000","last_fullsized":"2024-09-16T07:31:19.819795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:37.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807126+0000","last_change":"2024-09-16T07:31:19.794796+0000","last_active":"2024-09-16T07:31:19.807126+0000","last_peered":"2024-09-16T07:31:19.807126+0000","last_clean":"2024-09-16T07:31:19.807126+0000","last_became_active":"2024-09-16T07:31:19.794529+0000","last_became_peered":"2024-09-16T07:31:19.794529+0000","last_unstale":"2024-09-16T07:31:19.807126+0000","last_undegraded":"2024-09-16T07:31:19.807126+0000","last_fullsized":"2024-09-16T07:31:19.807126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:22:55.100874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815836+0000","last_change":"2024-09-16T07:31:18.774527+0000","last_active":"2024-09-16T07:31:19.815836+0000","last_peered":"2024-09-16T07:31:19.815836+0000","last_clean":"2024-09-16T07:31:19.815836+0000","last_became_active":"2024-09-16T07:31:18.774274+0000","last_became_peered":"2024-09-16T07:31:18.774274+0000","last_unstale":"2024-09-16T07:31:19.815836+0000","last_undegraded":"2024-09-16T07:31:19.815836+0000","last_fullsized":"2024-09-16T07:31:19.815836+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:04.070738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794261+0000","last_change":"2024-09-16T07:31:19.790939+0000","last_active":"2024-09-16T07:31:19.794261+0000","last_peered":"2024-09-16T07:31:19.794261+0000","last_clean":"2024-09-16T07:31:19.794261+0000","last_became_active":"2024-09-16T07:31:19.789693+0000","last_became_peered":"2024-09-16T07:31:19.789693+0000","last_unstale":"2024-09-16T07:31:19.794261+0000","last_undegraded":"2024-09-16T07:31:19.794261+0000","last_fullsized":"2024-09-16T07:31:19.794261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:09.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.792614+0000","last_change":"2024-09-16T07:31:18.795070+0000","last_active":"2024-09-16T07:31:19.792614+0000","last_peered":"2024-09-16T07:31:19.792614+0000","last_clean":"2024-09-16T07:31:19.792614+0000","last_became_active":"2024-09-16T07:31:18.793712+0000","last_became_peered":"2024-09-16T07:31:18.793712+0000","last_unstale":"2024-09-16T07:31:19.792614+0000","last_undegraded":"2024-09-16T07:31:19.792614+0000","last_fullsized":"2024-09-16T07:31:19.792614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795358+0000","last_change":"2024-09-16T07:31:19.789084+0000","last_active":"2024-09-16T07:31:19.795358+0000","last_peered":"2024-09-16T07:31:19.795358+0000","last_clean":"2024-09-16T07:31:19.795358+0000","last_became_active":"2024-09-16T07:31:19.788667+0000","last_became_peered":"2024-09-16T07:31:19.788667+0000","last_unstale":"2024-09-16T07:31:19.795358+0000","last_undegraded":"2024-09-16T07:31:19.795358+0000","last_fullsized":"2024-09-16T07:31:19.795358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822022+0000","last_change":"2024-09-16T07:31:18.789543+0000","last_active":"2024-09-16T07:31:19.822022+0000","last_peered":"2024-09-16T07:31:19.822022+0000","last_clean":"2024-09-16T07:31:19.822022+0000","last_became_active":"2024-09-16T07:31:18.789265+0000","last_became_peered":"2024-09-16T07:31:18.789265+0000","last_unstale":"2024-09-16T07:31:19.822022+0000","last_undegraded":"2024-09-16T07:31:19.822022+0000","last_fullsized":"2024-09-16T07:31:19.822022+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:47.674243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805813+0000","last_change":"2024-09-16T07:31:19.799276+0000","last_active":"2024-09-16T07:31:19.805813+0000","last_peered":"2024-09-16T07:31:19.805813+0000","last_clean":"2024-09-16T07:31:19.805813+0000","last_became_active":"2024-09-16T07:31:19.799034+0000","last_became_peered":"2024-09-16T07:31:19.799034+0000","last_unstale":"2024-09-16T07:31:19.805813+0000","last_undegraded":"2024-09-16T07:31:19.805813+0000","last_fullsized":"2024-09-16T07:31:19.805813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776957+0000","last_change":"2024-09-16T07:31:18.787186+0000","last_active":"2024-09-16T07:31:19.776957+0000","last_peered":"2024-09-16T07:31:19.776957+0000","last_clean":"2024-09-16T07:31:19.776957+0000","last_became_active":"2024-09-16T07:31:18.786925+0000","last_became_peered":"2024-09-16T07:31:18.786925+0000","last_unstale":"2024-09-16T07:31:19.776957+0000","last_undegraded":"2024-09-16T07:31:19.776957+0000","last_fullsized":"2024-09-16T07:31:19.776957+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:06.201636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806223+0000","last_change":"2024-09-16T07:31:19.801738+0000","last_active":"2024-09-16T07:31:19.806223+0000","last_peered":"2024-09-16T07:31:19.806223+0000","last_clean":"2024-09-16T07:31:19.806223+0000","last_became_active":"2024-09-16T07:31:19.801475+0000","last_became_peered":"2024-09-16T07:31:19.801475+0000","last_unstale":"2024-09-16T07:31:19.806223+0000","last_undegraded":"2024-09-16T07:31:19.806223+0000","last_fullsized":"2024-09-16T07:31:19.806223+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778633+0000","last_change":"2024-09-16T07:31:18.787455+0000","last_active":"2024-09-16T07:31:19.778633+0000","last_peered":"2024-09-16T07:31:19.778633+0000","last_clean":"2024-09-16T07:31:19.778633+0000","last_became_active":"2024-09-16T07:31:18.787111+0000","last_became_peered":"2024-09-16T07:31:18.787111+0000","last_unstale":"2024-09-16T07:31:19.778633+0000","last_undegraded":"2024-09-16T07:31:19.778633+0000","last_fullsized":"2024-09-16T07:31:19.778633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795458+0000","last_change":"2024-09-16T07:31:19.789411+0000","last_active":"2024-09-16T07:31:19.795458+0000","last_peered":"2024-09-16T07:31:19.795458+0000","last_clean":"2024-09-16T07:31:19.795458+0000","last_became_active":"2024-09-16T07:31:19.789063+0000","last_became_peered":"2024-09-16T07:31:19.789063+0000","last_unstale":"2024-09-16T07:31:19.795458+0000","last_undegraded":"2024-09-16T07:31:19.795458+0000","last_fullsized":"2024-09-16T07:31:19.795458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820683+0000","last_change":"2024-09-16T07:31:18.794588+0000","last_active":"2024-09-16T07:31:19.820683+0000","last_peered":"2024-09-16T07:31:19.820683+0000","last_clean":"2024-09-16T07:31:19.820683+0000","last_became_active":"2024-09-16T07:31:18.793959+0000","last_became_peered":"2024-09-16T07:31:18.793959+0000","last_unstale":"2024-09-16T07:31:19.820683+0000","last_undegraded":"2024-09-16T07:31:19.820683+0000","last_fullsized":"2024-09-16T07:31:19.820683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:40.698336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798506+0000","last_change":"2024-09-16T07:31:19.793595+0000","last_active":"2024-09-16T07:31:19.798506+0000","last_peered":"2024-09-16T07:31:19.798506+0000","last_clean":"2024-09-16T07:31:19.798506+0000","last_became_active":"2024-09-16T07:31:19.793298+0000","last_became_peered":"2024-09-16T07:31:19.793298+0000","last_unstale":"2024-09-16T07:31:19.798506+0000","last_undegraded":"2024-09-16T07:31:19.798506+0000","last_fullsized":"2024-09-16T07:31:19.798506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.793466+0000","last_change":"2024-09-16T07:31:18.788195+0000","last_active":"2024-09-16T07:31:19.793466+0000","last_peered":"2024-09-16T07:31:19.793466+0000","last_clean":"2024-09-16T07:31:19.793466+0000","last_became_active":"2024-09-16T07:31:18.787856+0000","last_became_peered":"2024-09-16T07:31:18.787856+0000","last_unstale":"2024-09-16T07:31:19.793466+0000","last_undegraded":"2024-09-16T07:31:19.793466+0000","last_fullsized":"2024-09-16T07:31:19.793466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:53.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801826+0000","last_change":"2024-09-16T07:31:19.796745+0000","last_active":"2024-09-16T07:31:19.801826+0000","last_peered":"2024-09-16T07:31:19.801826+0000","last_clean":"2024-09-16T07:31:19.801826+0000","last_became_active":"2024-09-16T07:31:19.796160+0000","last_became_peered":"2024-09-16T07:31:19.796160+0000","last_unstale":"2024-09-16T07:31:19.801826+0000","last_undegraded":"2024-09-16T07:31:19.801826+0000","last_fullsized":"2024-09-16T07:31:19.801826+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:18.142799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780648+0000","last_change":"2024-09-16T07:31:18.775590+0000","last_active":"2024-09-16T07:31:19.780648+0000","last_peered":"2024-09-16T07:31:19.780648+0000","last_clean":"2024-09-16T07:31:19.780648+0000","last_became_active":"2024-09-16T07:31:18.775372+0000","last_became_peered":"2024-09-16T07:31:18.775372+0000","last_unstale":"2024-09-16T07:31:19.780648+0000","last_undegraded":"2024-09-16T07:31:19.780648+0000","last_fullsized":"2024-09-16T07:31:19.780648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:51.048762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804769+0000","last_change":"2024-09-16T07:31:19.797206+0000","last_active":"2024-09-16T07:31:19.804769+0000","last_peered":"2024-09-16T07:31:19.804769+0000","last_clean":"2024-09-16T07:31:19.804769+0000","last_became_active":"2024-09-16T07:31:19.796955+0000","last_became_peered":"2024-09-16T07:31:19.796955+0000","last_unstale":"2024-09-16T07:31:19.804769+0000","last_undegraded":"2024-09-16T07:31:19.804769+0000","last_fullsized":"2024-09-16T07:31:19.804769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780195+0000","last_change":"2024-09-16T07:31:18.779241+0000","last_active":"2024-09-16T07:31:19.780195+0000","last_peered":"2024-09-16T07:31:19.780195+0000","last_clean":"2024-09-16T07:31:19.780195+0000","last_became_active":"2024-09-16T07:31:18.778973+0000","last_became_peered":"2024-09-16T07:31:18.778973+0000","last_unstale":"2024-09-16T07:31:19.780195+0000","last_undegraded":"2024-09-16T07:31:19.780195+0000","last_fullsized":"2024-09-16T07:31:19.780195+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799187+0000","last_change":"2024-09-16T07:31:19.791585+0000","last_active":"2024-09-16T07:31:19.799187+0000","last_peered":"2024-09-16T07:31:19.799187+0000","last_clean":"2024-09-16T07:31:19.799187+0000","last_became_active":"2024-09-16T07:31:19.791327+0000","last_became_peered":"2024-09-16T07:31:19.791327+0000","last_unstale":"2024-09-16T07:31:19.799187+0000","last_undegraded":"2024-09-16T07:31:19.799187+0000","last_fullsized":"2024-09-16T07:31:19.799187+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:27.493050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776933+0000","last_change":"2024-09-16T07:31:18.787749+0000","last_active":"2024-09-16T07:31:19.776933+0000","last_peered":"2024-09-16T07:31:19.776933+0000","last_clean":"2024-09-16T07:31:19.776933+0000","last_became_active":"2024-09-16T07:31:18.787475+0000","last_became_peered":"2024-09-16T07:31:18.787475+0000","last_unstale":"2024-09-16T07:31:19.776933+0000","last_undegraded":"2024-09-16T07:31:19.776933+0000","last_fullsized":"2024-09-16T07:31:19.776933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:20.592987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794310+0000","last_change":"2024-09-16T07:31:19.790582+0000","last_active":"2024-09-16T07:31:19.794310+0000","last_peered":"2024-09-16T07:31:19.794310+0000","last_clean":"2024-09-16T07:31:19.794310+0000","last_became_active":"2024-09-16T07:31:19.790285+0000","last_became_peered":"2024-09-16T07:31:19.790285+0000","last_unstale":"2024-09-16T07:31:19.794310+0000","last_undegraded":"2024-09-16T07:31:19.794310+0000","last_fullsized":"2024-09-16T07:31:19.794310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:05.077038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.784768+0000","last_change":"2024-09-16T07:31:18.790010+0000","last_active":"2024-09-16T07:31:19.784768+0000","last_peered":"2024-09-16T07:31:19.784768+0000","last_clean":"2024-09-16T07:31:19.784768+0000","last_became_active":"2024-09-16T07:31:18.789733+0000","last_became_peered":"2024-09-16T07:31:18.789733+0000","last_unstale":"2024-09-16T07:31:19.784768+0000","last_undegraded":"2024-09-16T07:31:19.784768+0000","last_fullsized":"2024-09-16T07:31:19.784768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:35.643472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804052+0000","last_change":"2024-09-16T07:31:19.799293+0000","last_active":"2024-09-16T07:31:19.804052+0000","last_peered":"2024-09-16T07:31:19.804052+0000","last_clean":"2024-09-16T07:31:19.804052+0000","last_became_active":"2024-09-16T07:31:19.799086+0000","last_became_peered":"2024-09-16T07:31:19.799086+0000","last_unstale":"2024-09-16T07:31:19.804052+0000","last_undegraded":"2024-09-16T07:31:19.804052+0000","last_fullsized":"2024-09-16T07:31:19.804052+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:26.031540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776937+0000","last_change":"2024-09-16T07:31:18.792232+0000","last_active":"2024-09-16T07:31:19.776937+0000","last_peered":"2024-09-16T07:31:19.776937+0000","last_clean":"2024-09-16T07:31:19.776937+0000","last_became_active":"2024-09-16T07:31:18.791920+0000","last_became_peered":"2024-09-16T07:31:18.791920+0000","last_unstale":"2024-09-16T07:31:19.776937+0000","last_undegraded":"2024-09-16T07:31:19.776937+0000","last_fullsized":"2024-09-16T07:31:19.776937+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:39.264345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807003+0000","last_change":"2024-09-16T07:31:19.794654+0000","last_active":"2024-09-16T07:31:19.807003+0000","last_peered":"2024-09-16T07:31:19.807003+0000","last_clean":"2024-09-16T07:31:19.807003+0000","last_became_active":"2024-09-16T07:31:19.794379+0000","last_became_peered":"2024-09-16T07:31:19.794379+0000","last_unstale":"2024-09-16T07:31:19.807003+0000","last_undegraded":"2024-09-16T07:31:19.807003+0000","last_fullsized":"2024-09-16T07:31:19.807003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:02.848339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783051+0000","last_change":"2024-09-16T07:31:18.789535+0000","last_active":"2024-09-16T07:31:19.783051+0000","last_peered":"2024-09-16T07:31:19.783051+0000","last_clean":"2024-09-16T07:31:19.783051+0000","last_became_active":"2024-09-16T07:31:18.789035+0000","last_became_peered":"2024-09-16T07:31:18.789035+0000","last_unstale":"2024-09-16T07:31:19.783051+0000","last_undegraded":"2024-09-16T07:31:19.783051+0000","last_fullsized":"2024-09-16T07:31:19.783051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:04.021360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808602+0000","last_change":"2024-09-16T07:31:19.801383+0000","last_active":"2024-09-16T07:31:19.808602+0000","last_peered":"2024-09-16T07:31:19.808602+0000","last_clean":"2024-09-16T07:31:19.808602+0000","last_became_active":"2024-09-16T07:31:19.801123+0000","last_became_peered":"2024-09-16T07:31:19.801123+0000","last_unstale":"2024-09-16T07:31:19.808602+0000","last_undegraded":"2024-09-16T07:31:19.808602+0000","last_fullsized":"2024-09-16T07:31:19.808602+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:31:17.995605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.781321+0000","last_change":"2024-09-16T07:31:18.774958+0000","last_active":"2024-09-16T07:31:19.781321+0000","last_peered":"2024-09-16T07:31:19.781321+0000","last_clean":"2024-09-16T07:31:19.781321+0000","last_became_active":"2024-09-16T07:31:18.774697+0000","last_became_peered":"2024-09-16T07:31:18.774697+0000","last_unstale":"2024-09-16T07:31:19.781321+0000","last_undegraded":"2024-09-16T07:31:19.781321+0000","last_fullsized":"2024-09-16T07:31:19.781321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:39.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777462+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:31:19.777462+0000","last_peered":"2024-09-16T07:31:19.777462+0000","last_clean":"2024-09-16T07:31:19.777462+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:31:19.777462+0000","last_undegraded":"2024-09-16T07:31:19.777462+0000","last_fullsized":"2024-09-16T07:31:19.777462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":675840,"data_stored":273330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":667648,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:31:18.779883+0000', 'last_change': '2024-09-16T07:31:18.779883+0000', 'last_active': '2024-09-16T07:31:18.756836+0000', 'last_peered': '2024-09-16T07:31:18.756836+0000', 'last_clean': '2024-09-16T07:31:18.756836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:31:18.779883+0000', 'last_undegraded': '2024-09-16T07:31:18.779883+0000', 'last_fullsized': '2024-09-16T07:31:18.779883+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_clean_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:31:18.773895+0000', 'last_change': '2024-09-16T07:31:18.773895+0000', 'last_active': '2024-09-16T07:31:18.756836+0000', 'last_peered': '2024-09-16T07:31:18.756836+0000', 'last_clean': '2024-09-16T07:31:18.756836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:31:18.773895+0000', 'last_undegraded': '2024-09-16T07:31:18.773895+0000', 'last_fullsized': '2024-09-16T07:31:18.773895+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_clean_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:31:18.773446+0000', 'last_change': '2024-09-16T07:31:18.773446+0000', 'last_active': '2024-09-16T07:31:18.756836+0000', 'last_peered': '2024-09-16T07:31:18.756836+0000', 'last_clean': '2024-09-16T07:31:18.756836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:31:18.773446+0000', 'last_undegraded': '2024-09-16T07:31:18.773446+0000', 'last_fullsized': '2024-09-16T07:31:18.773446+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_clean_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:31:18.779252+0000', 'last_change': '2024-09-16T07:31:18.779252+0000', 'last_active': '2024-09-16T07:31:18.756836+0000', 'last_peered': '2024-09-16T07:31:18.756836+0000', 'last_clean': '2024-09-16T07:31:18.756836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:31:18.779252+0000', 'last_undegraded': '2024-09-16T07:31:18.779252+0000', 'last_fullsized': '2024-09-16T07:31:18.779252+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_clean_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:31:24.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-16T07:31:24.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:31:18.774157+0000', 'last_change': '2024-09-16T07:31:18.774157+0000', 'last_active': '2024-09-16T07:31:18.756836+0000', 'last_peered': '2024-09-16T07:31:18.756836+0000', 'last_clean': '2024-09-16T07:31:18.756836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:31:18.774157+0000', 'last_undegraded': '2024-09-16T07:31:18.774157+0000', 'last_fullsized': '2024-09-16T07:31:18.774157+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_clean_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:31:24.680 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-16T07:31:24.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:31:18.773588+0000', 'last_change': '2024-09-16T07:31:18.773588+0000', 'last_active': '2024-09-16T07:31:18.756836+0000', 'last_peered': '2024-09-16T07:31:18.756836+0000', 'last_clean': '2024-09-16T07:31:18.756836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:31:18.773588+0000', 'last_undegraded': '2024-09-16T07:31:18.773588+0000', 'last_fullsized': '2024-09-16T07:31:18.773588+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'last_clean_scrub_stamp': '2024-09-16T07:31:18.756836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:31:24.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:31:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- 172.21.15.114:0/2354359314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df80b0b60 msgr2=0x7f5df80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/2354359314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df80b0b60 0x7f5df80ccbd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5df8073e00 tx=0x7f5df001f0b0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- 172.21.15.114:0/2354359314 shutdown_connections 2024-09-16T07:31:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/2354359314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df80b0b60 0x7f5df80ccbd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/2354359314 >> v2:172.21.15.149:3300/0 conn(0x7f5df815be10 0x7f5df80ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- 172.21.15.114:0/2354359314 >> 172.21.15.114:0/2354359314 conn(0x7f5df80d1da0 msgr2=0x7f5df80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- 172.21.15.114:0/2354359314 shutdown_connections 2024-09-16T07:31:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- 172.21.15.114:0/2354359314 wait complete. 2024-09-16T07:31:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 Processor -- start 2024-09-16T07:31:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- start start 2024-09-16T07:31:24.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5df80b0b60 0x7f5df80c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df815be10 0x7f5df80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5df815c1f0 0x7f5df80af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80cd4a0 con 0x7f5df815be10 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80cd320 con 0x7f5df80b0b60 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5dfdc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5df80cd620 con 0x7f5df815c1f0 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.864+0000 7f5df6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df815be10 0x7f5df80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df815be10 0x7f5df80b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33748/0 (socket says 172.21.15.114:33748) 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 -- 172.21.15.114:0/3235477812 learned_addr learned my addr 172.21.15.114:0/3235477812 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df7400640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5df815c1f0 0x7f5df80af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6a00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5df80b0b60 0x7f5df80c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 -- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5df815c1f0 msgr2=0x7f5df80af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5df815c1f0 0x7f5df80af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 -- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5df80b0b60 msgr2=0x7f5df80c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5df80b0b60 0x7f5df80c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 -- 172.21.15.114:0/3235477812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80b7c30 con 0x7f5df815be10 2024-09-16T07:31:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6a00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5df80b0b60 0x7f5df80c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:24.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5df6000640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df815be10 0x7f5df80b4bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c3c0 tx=0x7f5de400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5deea00640 1 -- 172.21.15.114:0/3235477812 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4017070 con 0x7f5df815be10 2024-09-16T07:31:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5deea00640 1 -- 172.21.15.114:0/3235477812 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5de40053c0 con 0x7f5df815be10 2024-09-16T07:31:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df80b7670 con 0x7f5df815be10 2024-09-16T07:31:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5deea00640 1 -- 172.21.15.114:0/3235477812 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4003860 con 0x7f5df815be10 2024-09-16T07:31:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df81f2f30 con 0x7f5df815be10 2024-09-16T07:31:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df81f3130 con 0x7f5df815be10 2024-09-16T07:31:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.868+0000 7f5deea00640 1 -- 172.21.15.114:0/3235477812 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f5de401a070 con 0x7f5df815be10 2024-09-16T07:31:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.872+0000 7f5deea00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5dd8073070 0x7f5dd8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.872+0000 7f5deea00640 1 -- 172.21.15.114:0/3235477812 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f5de4093460 con 0x7f5df815be10 2024-09-16T07:31:24.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.872+0000 7f5df6a00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5dd8073070 0x7f5dd8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:24.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.872+0000 7f5df6a00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5dd8073070 0x7f5dd8075530 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009f10 tx=0x7f5de80098f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:24.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:24.876+0000 7f5deea00640 1 -- 172.21.15.114:0/3235477812 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5df81f3130 con 0x7f5df815be10 2024-09-16T07:31:25.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.100+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5df80b0940 con 0x7f5df815be10 2024-09-16T07:31:25.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.100+0000 7f5deea00640 1 -- 172.21.15.114:0/3235477812 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7f5de405dcd0 con 0x7f5df815be10 2024-09-16T07:31:25.099 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:25.099 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":209,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":232136704,"bytes_avail":772861976576,"bytes_total":773094113280,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":2713,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":36,"btime":"2024-09-16T07:31:22:800560+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5769}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-16T07:30:49.031261+0000","services":{}},"progress_events":{}} 2024-09-16T07:31:25.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5dd8073070 msgr2=0x7f5dd8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:25.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5dd8073070 0x7f5dd8075530 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009f10 tx=0x7f5de80098f0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df815be10 msgr2=0x7f5df80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:25.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df815be10 0x7f5df80b4bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c3c0 tx=0x7f5de400c880 comp rx=0 tx=0).stop 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 shutdown_connections 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5dd8073070 0x7f5dd8075530 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5df815c1f0 0x7f5df80af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5df815be10 0x7f5df80b4bf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 --2- 172.21.15.114:0/3235477812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5df80b0b60 0x7f5df80c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 >> 172.21.15.114:0/3235477812 conn(0x7f5df80d1da0 msgr2=0x7f5df80cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 shutdown_connections 2024-09-16T07:31:25.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.104+0000 7f5dfdc00640 1 -- 172.21.15.114:0/3235477812 wait complete. 2024-09-16T07:31:25.120 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:31:25.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:31:25.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 -- 172.21.15.114:0/580063428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15e330 msgr2=0x7fd94c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:25.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 --2- 172.21.15.114:0/580063428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15e330 0x7fd94c06ec80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd938009900 tx=0x7fd93801c7c0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 -- 172.21.15.114:0/580063428 shutdown_connections 2024-09-16T07:31:25.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 --2- 172.21.15.114:0/580063428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15e330 0x7fd94c06ec80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 --2- 172.21.15.114:0/580063428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd94c15df50 0x7fd94c06e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 -- 172.21.15.114:0/580063428 >> 172.21.15.114:0/580063428 conn(0x7fd94c0d1dc0 msgr2=0x7fd94c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:25.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 -- 172.21.15.114:0/580063428 shutdown_connections 2024-09-16T07:31:25.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.264+0000 7fd952800640 1 -- 172.21.15.114:0/580063428 wait complete. 2024-09-16T07:31:25.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 Processor -- start 2024-09-16T07:31:25.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 -- start start 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd94c0b11d0 0x7fd94c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15df50 0x7fd94c15b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd94c15e330 0x7fd94c0c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0d0790 con 0x7fd94c15df50 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0d0610 con 0x7fd94c15e330 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c0d0910 con 0x7fd94c0b11d0 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15df50 0x7fd94c15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15df50 0x7fd94c15b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33754/0 (socket says 172.21.15.114:33754) 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 -- 172.21.15.114:0/3451108367 learned_addr learned my addr 172.21.15.114:0/3451108367 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:25.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94b400640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd94c0b11d0 0x7fd94c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94be00640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd94c15e330 0x7fd94c0c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 -- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd94c0b11d0 msgr2=0x7fd94c0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd94c0b11d0 0x7fd94c0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 -- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd94c15e330 msgr2=0x7fd94c0c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd94c15e330 0x7fd94c0c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 -- 172.21.15.114:0/3451108367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c15c840 con 0x7fd94c15df50 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd94aa00640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15df50 0x7fd94c15b050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd938009850 tx=0x7fd9380a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd943400640 1 -- 172.21.15.114:0/3451108367 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380b2040 con 0x7fd94c15df50 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd943400640 1 -- 172.21.15.114:0/3451108367 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd938004430 con 0x7fd94c15df50 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd943400640 1 -- 172.21.15.114:0/3451108367 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938003860 con 0x7fd94c15df50 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c15b590 con 0x7fd94c15df50 2024-09-16T07:31:25.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c15bb40 con 0x7fd94c15df50 2024-09-16T07:31:25.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.268+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94c0afcd0 con 0x7fd94c15df50 2024-09-16T07:31:25.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.272+0000 7fd943400640 1 -- 172.21.15.114:0/3451108367 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fd9380bd060 con 0x7fd94c15df50 2024-09-16T07:31:25.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.272+0000 7fd943400640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd92c0730a0 0x7fd92c075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:25.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.272+0000 7fd943400640 1 -- 172.21.15.114:0/3451108367 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd93812d9b0 con 0x7fd94c15df50 2024-09-16T07:31:25.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.272+0000 7fd94b400640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd92c0730a0 0x7fd92c075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:25.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.272+0000 7fd94b400640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd92c0730a0 0x7fd92c075560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00bc00 tx=0x7fd93c00b390 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:25.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.276+0000 7fd943400640 1 -- 172.21.15.114:0/3451108367 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd9380164d0 con 0x7fd94c15df50 2024-09-16T07:31:25.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.440+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd94c159fc0 con 0x7fd92c0730a0 2024-09-16T07:31:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.448+0000 7fd943400640 1 -- 172.21.15.114:0/3451108367 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7fd94c159fc0 con 0x7fd92c0730a0 2024-09-16T07:31:25.447 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:25.449 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd92c0730a0 msgr2=0x7fd92c075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd92c0730a0 0x7fd92c075560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00bc00 tx=0x7fd93c00b390 comp rx=0 tx=0).stop 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15df50 msgr2=0x7fd94c15b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15df50 0x7fd94c15b050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd938009850 tx=0x7fd9380a5790 comp rx=0 tx=0).stop 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 shutdown_connections 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd92c0730a0 0x7fd92c075560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd94c15e330 0x7fd94c0c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd94c15df50 0x7fd94c15b050 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 --2- 172.21.15.114:0/3451108367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd94c0b11d0 0x7fd94c0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 >> 172.21.15.114:0/3451108367 conn(0x7fd94c0d1dc0 msgr2=0x7fd94c15a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:25.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 shutdown_connections 2024-09-16T07:31:25.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:25.452+0000 7fd952800640 1 -- 172.21.15.114:0/3451108367 wait complete. 2024-09-16T07:31:25.468 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-16T07:31:25.039951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226728,"kb_used_data":6320,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747992,"statfs":{"total":773094113280,"available":772861943808,"internally_reserved":0,"allocated":6471680,"data_stored":3328663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.279931"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834547+0000","last_change":"2024-09-16T07:31:19.797257+0000","last_active":"2024-09-16T07:31:20.834547+0000","last_peered":"2024-09-16T07:31:20.834547+0000","last_clean":"2024-09-16T07:31:20.834547+0000","last_became_active":"2024-09-16T07:31:19.794480+0000","last_became_peered":"2024-09-16T07:31:19.794480+0000","last_unstale":"2024-09-16T07:31:20.834547+0000","last_undegraded":"2024-09-16T07:31:20.834547+0000","last_fullsized":"2024-09-16T07:31:20.834547+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:31.077561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806143+0000","last_change":"2024-09-16T07:31:19.795452+0000","last_active":"2024-09-16T07:31:19.806143+0000","last_peered":"2024-09-16T07:31:19.806143+0000","last_clean":"2024-09-16T07:31:19.806143+0000","last_became_active":"2024-09-16T07:31:19.794937+0000","last_became_peered":"2024-09-16T07:31:19.794937+0000","last_unstale":"2024-09-16T07:31:19.806143+0000","last_undegraded":"2024-09-16T07:31:19.806143+0000","last_fullsized":"2024-09-16T07:31:19.806143+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:26.321325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799151+0000","last_change":"2024-09-16T07:31:19.792532+0000","last_active":"2024-09-16T07:31:19.799151+0000","last_peered":"2024-09-16T07:31:19.799151+0000","last_clean":"2024-09-16T07:31:19.799151+0000","last_became_active":"2024-09-16T07:31:19.792301+0000","last_became_peered":"2024-09-16T07:31:19.792301+0000","last_unstale":"2024-09-16T07:31:19.799151+0000","last_undegraded":"2024-09-16T07:31:19.799151+0000","last_fullsized":"2024-09-16T07:31:19.799151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:52.057630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795356+0000","last_change":"2024-09-16T07:31:19.789467+0000","last_active":"2024-09-16T07:31:19.795356+0000","last_peered":"2024-09-16T07:31:19.795356+0000","last_clean":"2024-09-16T07:31:19.795356+0000","last_became_active":"2024-09-16T07:31:19.789174+0000","last_became_peered":"2024-09-16T07:31:19.789174+0000","last_unstale":"2024-09-16T07:31:19.795356+0000","last_undegraded":"2024-09-16T07:31:19.795356+0000","last_fullsized":"2024-09-16T07:31:19.795356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.833817+0000","last_change":"2024-09-16T07:31:19.799632+0000","last_active":"2024-09-16T07:31:20.833817+0000","last_peered":"2024-09-16T07:31:20.833817+0000","last_clean":"2024-09-16T07:31:20.833817+0000","last_became_active":"2024-09-16T07:31:19.799341+0000","last_became_peered":"2024-09-16T07:31:19.799341+0000","last_unstale":"2024-09-16T07:31:20.833817+0000","last_undegraded":"2024-09-16T07:31:20.833817+0000","last_fullsized":"2024-09-16T07:31:20.833817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:19.828124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806161+0000","last_change":"2024-09-16T07:31:19.802298+0000","last_active":"2024-09-16T07:31:19.806161+0000","last_peered":"2024-09-16T07:31:19.806161+0000","last_clean":"2024-09-16T07:31:19.806161+0000","last_became_active":"2024-09-16T07:31:19.802043+0000","last_became_peered":"2024-09-16T07:31:19.802043+0000","last_unstale":"2024-09-16T07:31:19.806161+0000","last_undegraded":"2024-09-16T07:31:19.806161+0000","last_fullsized":"2024-09-16T07:31:19.806161+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800986+0000","last_change":"2024-09-16T07:31:19.794748+0000","last_active":"2024-09-16T07:31:19.800986+0000","last_peered":"2024-09-16T07:31:19.800986+0000","last_clean":"2024-09-16T07:31:19.800986+0000","last_became_active":"2024-09-16T07:31:19.794494+0000","last_became_peered":"2024-09-16T07:31:19.794494+0000","last_unstale":"2024-09-16T07:31:19.800986+0000","last_undegraded":"2024-09-16T07:31:19.800986+0000","last_fullsized":"2024-09-16T07:31:19.800986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:14.056578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806635+0000","last_change":"2024-09-16T07:31:19.796360+0000","last_active":"2024-09-16T07:31:19.806635+0000","last_peered":"2024-09-16T07:31:19.806635+0000","last_clean":"2024-09-16T07:31:19.806635+0000","last_became_active":"2024-09-16T07:31:19.796075+0000","last_became_peered":"2024-09-16T07:31:19.796075+0000","last_unstale":"2024-09-16T07:31:19.806635+0000","last_undegraded":"2024-09-16T07:31:19.806635+0000","last_fullsized":"2024-09-16T07:31:19.806635+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:07:28.758872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805823+0000","last_change":"2024-09-16T07:31:19.800757+0000","last_active":"2024-09-16T07:31:19.805823+0000","last_peered":"2024-09-16T07:31:19.805823+0000","last_clean":"2024-09-16T07:31:19.805823+0000","last_became_active":"2024-09-16T07:31:19.800483+0000","last_became_peered":"2024-09-16T07:31:19.800483+0000","last_unstale":"2024-09-16T07:31:19.805823+0000","last_undegraded":"2024-09-16T07:31:19.805823+0000","last_fullsized":"2024-09-16T07:31:19.805823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:25.288132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804028+0000","last_change":"2024-09-16T07:31:19.798727+0000","last_active":"2024-09-16T07:31:19.804028+0000","last_peered":"2024-09-16T07:31:19.804028+0000","last_clean":"2024-09-16T07:31:19.804028+0000","last_became_active":"2024-09-16T07:31:19.798309+0000","last_became_peered":"2024-09-16T07:31:19.798309+0000","last_unstale":"2024-09-16T07:31:19.804028+0000","last_undegraded":"2024-09-16T07:31:19.804028+0000","last_fullsized":"2024-09-16T07:31:19.804028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:57.608168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799535+0000","last_change":"2024-09-16T07:31:19.792993+0000","last_active":"2024-09-16T07:31:19.799535+0000","last_peered":"2024-09-16T07:31:19.799535+0000","last_clean":"2024-09-16T07:31:19.799535+0000","last_became_active":"2024-09-16T07:31:19.792461+0000","last_became_peered":"2024-09-16T07:31:19.792461+0000","last_unstale":"2024-09-16T07:31:19.799535+0000","last_undegraded":"2024-09-16T07:31:19.799535+0000","last_fullsized":"2024-09-16T07:31:19.799535+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:44:34.182317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795330+0000","last_change":"2024-09-16T07:31:19.788824+0000","last_active":"2024-09-16T07:31:19.795330+0000","last_peered":"2024-09-16T07:31:19.795330+0000","last_clean":"2024-09-16T07:31:19.795330+0000","last_became_active":"2024-09-16T07:31:19.788477+0000","last_became_peered":"2024-09-16T07:31:19.788477+0000","last_unstale":"2024-09-16T07:31:19.795330+0000","last_undegraded":"2024-09-16T07:31:19.795330+0000","last_fullsized":"2024-09-16T07:31:19.795330+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801156+0000","last_change":"2024-09-16T07:31:19.795230+0000","last_active":"2024-09-16T07:31:19.801156+0000","last_peered":"2024-09-16T07:31:19.801156+0000","last_clean":"2024-09-16T07:31:19.801156+0000","last_became_active":"2024-09-16T07:31:19.794956+0000","last_became_peered":"2024-09-16T07:31:19.794956+0000","last_unstale":"2024-09-16T07:31:19.801156+0000","last_undegraded":"2024-09-16T07:31:19.801156+0000","last_fullsized":"2024-09-16T07:31:19.801156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:13.513689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797892+0000","last_change":"2024-09-16T07:31:19.789254+0000","last_active":"2024-09-16T07:31:19.797892+0000","last_peered":"2024-09-16T07:31:19.797892+0000","last_clean":"2024-09-16T07:31:19.797892+0000","last_became_active":"2024-09-16T07:31:19.788561+0000","last_became_peered":"2024-09-16T07:31:19.788561+0000","last_unstale":"2024-09-16T07:31:19.797892+0000","last_undegraded":"2024-09-16T07:31:19.797892+0000","last_fullsized":"2024-09-16T07:31:19.797892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:14.672043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799005+0000","last_change":"2024-09-16T07:31:19.790415+0000","last_active":"2024-09-16T07:31:19.799005+0000","last_peered":"2024-09-16T07:31:19.799005+0000","last_clean":"2024-09-16T07:31:19.799005+0000","last_became_active":"2024-09-16T07:31:19.789977+0000","last_became_peered":"2024-09-16T07:31:19.789977+0000","last_unstale":"2024-09-16T07:31:19.799005+0000","last_undegraded":"2024-09-16T07:31:19.799005+0000","last_fullsized":"2024-09-16T07:31:19.799005+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:52.307252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808322+0000","last_change":"2024-09-16T07:31:19.803450+0000","last_active":"2024-09-16T07:31:19.808322+0000","last_peered":"2024-09-16T07:31:19.808322+0000","last_clean":"2024-09-16T07:31:19.808322+0000","last_became_active":"2024-09-16T07:31:19.803117+0000","last_became_peered":"2024-09-16T07:31:19.803117+0000","last_unstale":"2024-09-16T07:31:19.808322+0000","last_undegraded":"2024-09-16T07:31:19.808322+0000","last_fullsized":"2024-09-16T07:31:19.808322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:39.017272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807576+0000","last_change":"2024-09-16T07:31:19.798737+0000","last_active":"2024-09-16T07:31:19.807576+0000","last_peered":"2024-09-16T07:31:19.807576+0000","last_clean":"2024-09-16T07:31:19.807576+0000","last_became_active":"2024-09-16T07:31:19.798489+0000","last_became_peered":"2024-09-16T07:31:19.798489+0000","last_unstale":"2024-09-16T07:31:19.807576+0000","last_undegraded":"2024-09-16T07:31:19.807576+0000","last_fullsized":"2024-09-16T07:31:19.807576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:00:25.780049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805761+0000","last_change":"2024-09-16T07:31:19.800414+0000","last_active":"2024-09-16T07:31:19.805761+0000","last_peered":"2024-09-16T07:31:19.805761+0000","last_clean":"2024-09-16T07:31:19.805761+0000","last_became_active":"2024-09-16T07:31:19.798920+0000","last_became_peered":"2024-09-16T07:31:19.798920+0000","last_unstale":"2024-09-16T07:31:19.805761+0000","last_undegraded":"2024-09-16T07:31:19.805761+0000","last_fullsized":"2024-09-16T07:31:19.805761+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834339+0000","last_change":"2024-09-16T07:31:19.793968+0000","last_active":"2024-09-16T07:31:20.834339+0000","last_peered":"2024-09-16T07:31:20.834339+0000","last_clean":"2024-09-16T07:31:20.834339+0000","last_became_active":"2024-09-16T07:31:19.793707+0000","last_became_peered":"2024-09-16T07:31:19.793707+0000","last_unstale":"2024-09-16T07:31:20.834339+0000","last_undegraded":"2024-09-16T07:31:20.834339+0000","last_fullsized":"2024-09-16T07:31:20.834339+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:15:09.790721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808567+0000","last_change":"2024-09-16T07:31:19.802446+0000","last_active":"2024-09-16T07:31:19.808567+0000","last_peered":"2024-09-16T07:31:19.808567+0000","last_clean":"2024-09-16T07:31:19.808567+0000","last_became_active":"2024-09-16T07:31:19.802076+0000","last_became_peered":"2024-09-16T07:31:19.802076+0000","last_unstale":"2024-09-16T07:31:19.808567+0000","last_undegraded":"2024-09-16T07:31:19.808567+0000","last_fullsized":"2024-09-16T07:31:19.808567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:08.448795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800544+0000","last_change":"2024-09-16T07:31:19.797580+0000","last_active":"2024-09-16T07:31:19.800544+0000","last_peered":"2024-09-16T07:31:19.800544+0000","last_clean":"2024-09-16T07:31:19.800544+0000","last_became_active":"2024-09-16T07:31:19.796587+0000","last_became_peered":"2024-09-16T07:31:19.796587+0000","last_unstale":"2024-09-16T07:31:19.800544+0000","last_undegraded":"2024-09-16T07:31:19.800544+0000","last_fullsized":"2024-09-16T07:31:19.800544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807175+0000","last_change":"2024-09-16T07:31:19.792089+0000","last_active":"2024-09-16T07:31:19.807175+0000","last_peered":"2024-09-16T07:31:19.807175+0000","last_clean":"2024-09-16T07:31:19.807175+0000","last_became_active":"2024-09-16T07:31:19.790997+0000","last_became_peered":"2024-09-16T07:31:19.790997+0000","last_unstale":"2024-09-16T07:31:19.807175+0000","last_undegraded":"2024-09-16T07:31:19.807175+0000","last_fullsized":"2024-09-16T07:31:19.807175+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:14.300883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794491+0000","last_change":"2024-09-16T07:31:19.791289+0000","last_active":"2024-09-16T07:31:19.794491+0000","last_peered":"2024-09-16T07:31:19.794491+0000","last_clean":"2024-09-16T07:31:19.794491+0000","last_became_active":"2024-09-16T07:31:19.790974+0000","last_became_peered":"2024-09-16T07:31:19.790974+0000","last_unstale":"2024-09-16T07:31:19.794491+0000","last_undegraded":"2024-09-16T07:31:19.794491+0000","last_fullsized":"2024-09-16T07:31:19.794491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:32.744007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801740+0000","last_change":"2024-09-16T07:31:19.799545+0000","last_active":"2024-09-16T07:31:19.801740+0000","last_peered":"2024-09-16T07:31:19.801740+0000","last_clean":"2024-09-16T07:31:19.801740+0000","last_became_active":"2024-09-16T07:31:19.799285+0000","last_became_peered":"2024-09-16T07:31:19.799285+0000","last_unstale":"2024-09-16T07:31:19.801740+0000","last_undegraded":"2024-09-16T07:31:19.801740+0000","last_fullsized":"2024-09-16T07:31:19.801740+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:59.159780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834785+0000","last_change":"2024-09-16T07:31:19.791265+0000","last_active":"2024-09-16T07:31:20.834785+0000","last_peered":"2024-09-16T07:31:20.834785+0000","last_clean":"2024-09-16T07:31:20.834785+0000","last_became_active":"2024-09-16T07:31:19.790963+0000","last_became_peered":"2024-09-16T07:31:19.790963+0000","last_unstale":"2024-09-16T07:31:20.834785+0000","last_undegraded":"2024-09-16T07:31:20.834785+0000","last_fullsized":"2024-09-16T07:31:20.834785+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:19.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795481+0000","last_change":"2024-09-16T07:31:19.790142+0000","last_active":"2024-09-16T07:31:19.795481+0000","last_peered":"2024-09-16T07:31:19.795481+0000","last_clean":"2024-09-16T07:31:19.795481+0000","last_became_active":"2024-09-16T07:31:19.789787+0000","last_became_peered":"2024-09-16T07:31:19.789787+0000","last_unstale":"2024-09-16T07:31:19.795481+0000","last_undegraded":"2024-09-16T07:31:19.795481+0000","last_fullsized":"2024-09-16T07:31:19.795481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811562+0000","last_change":"2024-09-16T07:31:19.807204+0000","last_active":"2024-09-16T07:31:19.811562+0000","last_peered":"2024-09-16T07:31:19.811562+0000","last_clean":"2024-09-16T07:31:19.811562+0000","last_became_active":"2024-09-16T07:31:19.805182+0000","last_became_peered":"2024-09-16T07:31:19.805182+0000","last_unstale":"2024-09-16T07:31:19.811562+0000","last_undegraded":"2024-09-16T07:31:19.811562+0000","last_fullsized":"2024-09-16T07:31:19.811562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:57.879247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834103+0000","last_change":"2024-09-16T07:31:19.800532+0000","last_active":"2024-09-16T07:31:20.834103+0000","last_peered":"2024-09-16T07:31:20.834103+0000","last_clean":"2024-09-16T07:31:20.834103+0000","last_became_active":"2024-09-16T07:31:19.797836+0000","last_became_peered":"2024-09-16T07:31:19.797836+0000","last_unstale":"2024-09-16T07:31:20.834103+0000","last_undegraded":"2024-09-16T07:31:20.834103+0000","last_fullsized":"2024-09-16T07:31:20.834103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:08.019298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807063+0000","last_change":"2024-09-16T07:31:19.797676+0000","last_active":"2024-09-16T07:31:19.807063+0000","last_peered":"2024-09-16T07:31:19.807063+0000","last_clean":"2024-09-16T07:31:19.807063+0000","last_became_active":"2024-09-16T07:31:19.797402+0000","last_became_peered":"2024-09-16T07:31:19.797402+0000","last_unstale":"2024-09-16T07:31:19.807063+0000","last_undegraded":"2024-09-16T07:31:19.807063+0000","last_fullsized":"2024-09-16T07:31:19.807063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:29.989908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798939+0000","last_change":"2024-09-16T07:31:19.792014+0000","last_active":"2024-09-16T07:31:19.798939+0000","last_peered":"2024-09-16T07:31:19.798939+0000","last_clean":"2024-09-16T07:31:19.798939+0000","last_became_active":"2024-09-16T07:31:19.791672+0000","last_became_peered":"2024-09-16T07:31:19.791672+0000","last_unstale":"2024-09-16T07:31:19.798939+0000","last_undegraded":"2024-09-16T07:31:19.798939+0000","last_fullsized":"2024-09-16T07:31:19.798939+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.833710+0000","last_change":"2024-09-16T07:31:19.786937+0000","last_active":"2024-09-16T07:31:20.833710+0000","last_peered":"2024-09-16T07:31:20.833710+0000","last_clean":"2024-09-16T07:31:20.833710+0000","last_became_active":"2024-09-16T07:31:19.786629+0000","last_became_peered":"2024-09-16T07:31:19.786629+0000","last_unstale":"2024-09-16T07:31:20.833710+0000","last_undegraded":"2024-09-16T07:31:20.833710+0000","last_fullsized":"2024-09-16T07:31:20.833710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:06:06.385935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811630+0000","last_change":"2024-09-16T07:31:19.809602+0000","last_active":"2024-09-16T07:31:19.811630+0000","last_peered":"2024-09-16T07:31:19.811630+0000","last_clean":"2024-09-16T07:31:19.811630+0000","last_became_active":"2024-09-16T07:31:19.809274+0000","last_became_peered":"2024-09-16T07:31:19.809274+0000","last_unstale":"2024-09-16T07:31:19.811630+0000","last_undegraded":"2024-09-16T07:31:19.811630+0000","last_fullsized":"2024-09-16T07:31:19.811630+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:38.553253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804808+0000","last_change":"2024-09-16T07:31:19.798550+0000","last_active":"2024-09-16T07:31:19.804808+0000","last_peered":"2024-09-16T07:31:19.804808+0000","last_clean":"2024-09-16T07:31:19.804808+0000","last_became_active":"2024-09-16T07:31:19.798280+0000","last_became_peered":"2024-09-16T07:31:19.798280+0000","last_unstale":"2024-09-16T07:31:19.804808+0000","last_undegraded":"2024-09-16T07:31:19.804808+0000","last_fullsized":"2024-09-16T07:31:19.804808+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822443+0000","last_change":"2024-09-16T07:31:18.788213+0000","last_active":"2024-09-16T07:31:19.822443+0000","last_peered":"2024-09-16T07:31:19.822443+0000","last_clean":"2024-09-16T07:31:19.822443+0000","last_became_active":"2024-09-16T07:31:18.787961+0000","last_became_peered":"2024-09-16T07:31:18.787961+0000","last_unstale":"2024-09-16T07:31:19.822443+0000","last_undegraded":"2024-09-16T07:31:19.822443+0000","last_fullsized":"2024-09-16T07:31:19.822443+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:56.115404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.797411+0000","last_change":"2024-09-16T07:31:19.789278+0000","last_active":"2024-09-16T07:31:19.797411+0000","last_peered":"2024-09-16T07:31:19.797411+0000","last_clean":"2024-09-16T07:31:19.797411+0000","last_became_active":"2024-09-16T07:31:19.789015+0000","last_became_peered":"2024-09-16T07:31:19.789015+0000","last_unstale":"2024-09-16T07:31:19.797411+0000","last_undegraded":"2024-09-16T07:31:19.797411+0000","last_fullsized":"2024-09-16T07:31:19.797411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:56.009785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817335+0000","last_change":"2024-09-16T07:31:18.775898+0000","last_active":"2024-09-16T07:31:19.817335+0000","last_peered":"2024-09-16T07:31:19.817335+0000","last_clean":"2024-09-16T07:31:19.817335+0000","last_became_active":"2024-09-16T07:31:18.775575+0000","last_became_peered":"2024-09-16T07:31:18.775575+0000","last_unstale":"2024-09-16T07:31:19.817335+0000","last_undegraded":"2024-09-16T07:31:19.817335+0000","last_fullsized":"2024-09-16T07:31:19.817335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:56.258821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808350+0000","last_change":"2024-09-16T07:31:19.804592+0000","last_active":"2024-09-16T07:31:19.808350+0000","last_peered":"2024-09-16T07:31:19.808350+0000","last_clean":"2024-09-16T07:31:19.808350+0000","last_became_active":"2024-09-16T07:31:19.803010+0000","last_became_peered":"2024-09-16T07:31:19.803010+0000","last_unstale":"2024-09-16T07:31:19.808350+0000","last_undegraded":"2024-09-16T07:31:19.808350+0000","last_fullsized":"2024-09-16T07:31:19.808350+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:48.737794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820706+0000","last_change":"2024-09-16T07:31:18.794664+0000","last_active":"2024-09-16T07:31:19.820706+0000","last_peered":"2024-09-16T07:31:19.820706+0000","last_clean":"2024-09-16T07:31:19.820706+0000","last_became_active":"2024-09-16T07:31:18.794418+0000","last_became_peered":"2024-09-16T07:31:18.794418+0000","last_unstale":"2024-09-16T07:31:19.820706+0000","last_undegraded":"2024-09-16T07:31:19.820706+0000","last_fullsized":"2024-09-16T07:31:19.820706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.811324+0000","last_change":"2024-09-16T07:31:19.805940+0000","last_active":"2024-09-16T07:31:19.811324+0000","last_peered":"2024-09-16T07:31:19.811324+0000","last_clean":"2024-09-16T07:31:19.811324+0000","last_became_active":"2024-09-16T07:31:19.804922+0000","last_became_peered":"2024-09-16T07:31:19.804922+0000","last_unstale":"2024-09-16T07:31:19.811324+0000","last_undegraded":"2024-09-16T07:31:19.811324+0000","last_fullsized":"2024-09-16T07:31:19.811324+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:10.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819227+0000","last_change":"2024-09-16T07:31:18.772762+0000","last_active":"2024-09-16T07:31:19.819227+0000","last_peered":"2024-09-16T07:31:19.819227+0000","last_clean":"2024-09-16T07:31:19.819227+0000","last_became_active":"2024-09-16T07:31:18.772483+0000","last_became_peered":"2024-09-16T07:31:18.772483+0000","last_unstale":"2024-09-16T07:31:19.819227+0000","last_undegraded":"2024-09-16T07:31:19.819227+0000","last_fullsized":"2024-09-16T07:31:19.819227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.791961+0000","last_change":"2024-09-16T07:31:19.788175+0000","last_active":"2024-09-16T07:31:19.791961+0000","last_peered":"2024-09-16T07:31:19.791961+0000","last_clean":"2024-09-16T07:31:19.791961+0000","last_became_active":"2024-09-16T07:31:19.787903+0000","last_became_peered":"2024-09-16T07:31:19.787903+0000","last_unstale":"2024-09-16T07:31:19.791961+0000","last_undegraded":"2024-09-16T07:31:19.791961+0000","last_fullsized":"2024-09-16T07:31:19.791961+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:00:10.456768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815080+0000","last_change":"2024-09-16T07:31:18.779878+0000","last_active":"2024-09-16T07:31:19.815080+0000","last_peered":"2024-09-16T07:31:19.815080+0000","last_clean":"2024-09-16T07:31:19.815080+0000","last_became_active":"2024-09-16T07:31:18.779587+0000","last_became_peered":"2024-09-16T07:31:18.779587+0000","last_unstale":"2024-09-16T07:31:19.815080+0000","last_undegraded":"2024-09-16T07:31:19.815080+0000","last_fullsized":"2024-09-16T07:31:19.815080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:12.686482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.810895+0000","last_change":"2024-09-16T07:31:19.808074+0000","last_active":"2024-09-16T07:31:19.810895+0000","last_peered":"2024-09-16T07:31:19.810895+0000","last_clean":"2024-09-16T07:31:19.810895+0000","last_became_active":"2024-09-16T07:31:19.807802+0000","last_became_peered":"2024-09-16T07:31:19.807802+0000","last_unstale":"2024-09-16T07:31:19.810895+0000","last_undegraded":"2024-09-16T07:31:19.810895+0000","last_fullsized":"2024-09-16T07:31:19.810895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:12.342419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819786+0000","last_change":"2024-09-16T07:31:18.789053+0000","last_active":"2024-09-16T07:31:19.819786+0000","last_peered":"2024-09-16T07:31:19.819786+0000","last_clean":"2024-09-16T07:31:19.819786+0000","last_became_active":"2024-09-16T07:31:18.788715+0000","last_became_peered":"2024-09-16T07:31:18.788715+0000","last_unstale":"2024-09-16T07:31:19.819786+0000","last_undegraded":"2024-09-16T07:31:19.819786+0000","last_fullsized":"2024-09-16T07:31:19.819786+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:58.466722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801121+0000","last_change":"2024-09-16T07:31:19.794608+0000","last_active":"2024-09-16T07:31:19.801121+0000","last_peered":"2024-09-16T07:31:19.801121+0000","last_clean":"2024-09-16T07:31:19.801121+0000","last_became_active":"2024-09-16T07:31:19.794301+0000","last_became_peered":"2024-09-16T07:31:19.794301+0000","last_unstale":"2024-09-16T07:31:19.801121+0000","last_undegraded":"2024-09-16T07:31:19.801121+0000","last_fullsized":"2024-09-16T07:31:19.801121+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:24.874172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778682+0000","last_change":"2024-09-16T07:31:18.777720+0000","last_active":"2024-09-16T07:31:19.778682+0000","last_peered":"2024-09-16T07:31:19.778682+0000","last_clean":"2024-09-16T07:31:19.778682+0000","last_became_active":"2024-09-16T07:31:18.777300+0000","last_became_peered":"2024-09-16T07:31:18.777300+0000","last_unstale":"2024-09-16T07:31:19.778682+0000","last_undegraded":"2024-09-16T07:31:19.778682+0000","last_fullsized":"2024-09-16T07:31:19.778682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799318+0000","last_change":"2024-09-16T07:31:19.789913+0000","last_active":"2024-09-16T07:31:19.799318+0000","last_peered":"2024-09-16T07:31:19.799318+0000","last_clean":"2024-09-16T07:31:19.799318+0000","last_became_active":"2024-09-16T07:31:19.787859+0000","last_became_peered":"2024-09-16T07:31:19.787859+0000","last_unstale":"2024-09-16T07:31:19.799318+0000","last_undegraded":"2024-09-16T07:31:19.799318+0000","last_fullsized":"2024-09-16T07:31:19.799318+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:01.143423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783613+0000","last_change":"2024-09-16T07:31:18.790293+0000","last_active":"2024-09-16T07:31:19.783613+0000","last_peered":"2024-09-16T07:31:19.783613+0000","last_clean":"2024-09-16T07:31:19.783613+0000","last_became_active":"2024-09-16T07:31:18.789971+0000","last_became_peered":"2024-09-16T07:31:18.789971+0000","last_unstale":"2024-09-16T07:31:19.783613+0000","last_undegraded":"2024-09-16T07:31:19.783613+0000","last_fullsized":"2024-09-16T07:31:19.783613+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:02.508386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800242+0000","last_change":"2024-09-16T07:31:19.792022+0000","last_active":"2024-09-16T07:31:19.800242+0000","last_peered":"2024-09-16T07:31:19.800242+0000","last_clean":"2024-09-16T07:31:19.800242+0000","last_became_active":"2024-09-16T07:31:19.791203+0000","last_became_peered":"2024-09-16T07:31:19.791203+0000","last_unstale":"2024-09-16T07:31:19.800242+0000","last_undegraded":"2024-09-16T07:31:19.800242+0000","last_fullsized":"2024-09-16T07:31:19.800242+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:40.399078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777660+0000","last_change":"2024-09-16T07:31:18.786810+0000","last_active":"2024-09-16T07:31:19.777660+0000","last_peered":"2024-09-16T07:31:19.777660+0000","last_clean":"2024-09-16T07:31:19.777660+0000","last_became_active":"2024-09-16T07:31:18.786465+0000","last_became_peered":"2024-09-16T07:31:18.786465+0000","last_unstale":"2024-09-16T07:31:19.777660+0000","last_undegraded":"2024-09-16T07:31:19.777660+0000","last_fullsized":"2024-09-16T07:31:19.777660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799340+0000","last_change":"2024-09-16T07:31:19.795431+0000","last_active":"2024-09-16T07:31:19.799340+0000","last_peered":"2024-09-16T07:31:19.799340+0000","last_clean":"2024-09-16T07:31:19.799340+0000","last_became_active":"2024-09-16T07:31:19.795082+0000","last_became_peered":"2024-09-16T07:31:19.795082+0000","last_unstale":"2024-09-16T07:31:19.799340+0000","last_undegraded":"2024-09-16T07:31:19.799340+0000","last_fullsized":"2024-09-16T07:31:19.799340+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.786412+0000","last_change":"2024-09-16T07:31:18.782972+0000","last_active":"2024-09-16T07:31:19.786412+0000","last_peered":"2024-09-16T07:31:19.786412+0000","last_clean":"2024-09-16T07:31:19.786412+0000","last_became_active":"2024-09-16T07:31:18.782718+0000","last_became_peered":"2024-09-16T07:31:18.782718+0000","last_unstale":"2024-09-16T07:31:19.786412+0000","last_undegraded":"2024-09-16T07:31:19.786412+0000","last_fullsized":"2024-09-16T07:31:19.786412+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:51.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801851+0000","last_change":"2024-09-16T07:31:19.797122+0000","last_active":"2024-09-16T07:31:19.801851+0000","last_peered":"2024-09-16T07:31:19.801851+0000","last_clean":"2024-09-16T07:31:19.801851+0000","last_became_active":"2024-09-16T07:31:19.796492+0000","last_became_peered":"2024-09-16T07:31:19.796492+0000","last_unstale":"2024-09-16T07:31:19.801851+0000","last_undegraded":"2024-09-16T07:31:19.801851+0000","last_fullsized":"2024-09-16T07:31:19.801851+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:03.259826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.818627+0000","last_change":"2024-09-16T07:31:18.791265+0000","last_active":"2024-09-16T07:31:19.818627+0000","last_peered":"2024-09-16T07:31:19.818627+0000","last_clean":"2024-09-16T07:31:19.818627+0000","last_became_active":"2024-09-16T07:31:18.790938+0000","last_became_peered":"2024-09-16T07:31:18.790938+0000","last_unstale":"2024-09-16T07:31:19.818627+0000","last_undegraded":"2024-09-16T07:31:19.818627+0000","last_fullsized":"2024-09-16T07:31:19.818627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.802780+0000","last_change":"2024-09-16T07:31:19.799667+0000","last_active":"2024-09-16T07:31:19.802780+0000","last_peered":"2024-09-16T07:31:19.802780+0000","last_clean":"2024-09-16T07:31:19.802780+0000","last_became_active":"2024-09-16T07:31:19.798050+0000","last_became_peered":"2024-09-16T07:31:19.798050+0000","last_unstale":"2024-09-16T07:31:19.802780+0000","last_undegraded":"2024-09-16T07:31:19.802780+0000","last_fullsized":"2024-09-16T07:31:19.802780+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.821324+0000","last_change":"2024-09-16T07:31:18.790021+0000","last_active":"2024-09-16T07:31:19.821324+0000","last_peered":"2024-09-16T07:31:19.821324+0000","last_clean":"2024-09-16T07:31:19.821324+0000","last_became_active":"2024-09-16T07:31:18.789741+0000","last_became_peered":"2024-09-16T07:31:18.789741+0000","last_unstale":"2024-09-16T07:31:19.821324+0000","last_undegraded":"2024-09-16T07:31:19.821324+0000","last_fullsized":"2024-09-16T07:31:19.821324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:21.281704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795381+0000","last_change":"2024-09-16T07:31:19.789229+0000","last_active":"2024-09-16T07:31:19.795381+0000","last_peered":"2024-09-16T07:31:19.795381+0000","last_clean":"2024-09-16T07:31:19.795381+0000","last_became_active":"2024-09-16T07:31:19.788959+0000","last_became_peered":"2024-09-16T07:31:19.788959+0000","last_unstale":"2024-09-16T07:31:19.795381+0000","last_undegraded":"2024-09-16T07:31:19.795381+0000","last_fullsized":"2024-09-16T07:31:19.795381+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:59.473022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820003+0000","last_change":"2024-09-16T07:31:18.776594+0000","last_active":"2024-09-16T07:31:19.820003+0000","last_peered":"2024-09-16T07:31:19.820003+0000","last_clean":"2024-09-16T07:31:19.820003+0000","last_became_active":"2024-09-16T07:31:18.776279+0000","last_became_peered":"2024-09-16T07:31:18.776279+0000","last_unstale":"2024-09-16T07:31:19.820003+0000","last_undegraded":"2024-09-16T07:31:19.820003+0000","last_fullsized":"2024-09-16T07:31:19.820003+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:25.190475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798610+0000","last_change":"2024-09-16T07:31:19.792528+0000","last_active":"2024-09-16T07:31:19.798610+0000","last_peered":"2024-09-16T07:31:19.798610+0000","last_clean":"2024-09-16T07:31:19.798610+0000","last_became_active":"2024-09-16T07:31:19.792259+0000","last_became_peered":"2024-09-16T07:31:19.792259+0000","last_unstale":"2024-09-16T07:31:19.798610+0000","last_undegraded":"2024-09-16T07:31:19.798610+0000","last_fullsized":"2024-09-16T07:31:19.798610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780485+0000","last_change":"2024-09-16T07:31:18.772988+0000","last_active":"2024-09-16T07:31:19.780485+0000","last_peered":"2024-09-16T07:31:19.780485+0000","last_clean":"2024-09-16T07:31:19.780485+0000","last_became_active":"2024-09-16T07:31:18.772533+0000","last_became_peered":"2024-09-16T07:31:18.772533+0000","last_unstale":"2024-09-16T07:31:19.780485+0000","last_undegraded":"2024-09-16T07:31:19.780485+0000","last_fullsized":"2024-09-16T07:31:19.780485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:22.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800425+0000","last_change":"2024-09-16T07:31:19.793747+0000","last_active":"2024-09-16T07:31:19.800425+0000","last_peered":"2024-09-16T07:31:19.800425+0000","last_clean":"2024-09-16T07:31:19.800425+0000","last_became_active":"2024-09-16T07:31:19.793378+0000","last_became_peered":"2024-09-16T07:31:19.793378+0000","last_unstale":"2024-09-16T07:31:19.800425+0000","last_undegraded":"2024-09-16T07:31:19.800425+0000","last_fullsized":"2024-09-16T07:31:19.800425+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:22.566055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778886+0000","last_change":"2024-09-16T07:31:18.773395+0000","last_active":"2024-09-16T07:31:19.778886+0000","last_peered":"2024-09-16T07:31:19.778886+0000","last_clean":"2024-09-16T07:31:19.778886+0000","last_became_active":"2024-09-16T07:31:18.773128+0000","last_became_peered":"2024-09-16T07:31:18.773128+0000","last_unstale":"2024-09-16T07:31:19.778886+0000","last_undegraded":"2024-09-16T07:31:19.778886+0000","last_fullsized":"2024-09-16T07:31:19.778886+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799186+0000","last_change":"2024-09-16T07:31:19.792038+0000","last_active":"2024-09-16T07:31:19.799186+0000","last_peered":"2024-09-16T07:31:19.799186+0000","last_clean":"2024-09-16T07:31:19.799186+0000","last_became_active":"2024-09-16T07:31:19.791722+0000","last_became_peered":"2024-09-16T07:31:19.791722+0000","last_unstale":"2024-09-16T07:31:19.799186+0000","last_undegraded":"2024-09-16T07:31:19.799186+0000","last_fullsized":"2024-09-16T07:31:19.799186+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:57.121704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":21,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820427+0000","last_change":"2024-09-16T07:31:18.781351+0000","last_active":"2024-09-16T07:31:19.820427+0000","last_peered":"2024-09-16T07:31:19.820427+0000","last_clean":"2024-09-16T07:31:19.820427+0000","last_became_active":"2024-09-16T07:31:18.781032+0000","last_became_peered":"2024-09-16T07:31:18.781032+0000","last_unstale":"2024-09-16T07:31:19.820427+0000","last_undegraded":"2024-09-16T07:31:19.820427+0000","last_fullsized":"2024-09-16T07:31:19.820427+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.800715+0000","last_change":"2024-09-16T07:31:19.797161+0000","last_active":"2024-09-16T07:31:19.800715+0000","last_peered":"2024-09-16T07:31:19.800715+0000","last_clean":"2024-09-16T07:31:19.800715+0000","last_became_active":"2024-09-16T07:31:19.796761+0000","last_became_peered":"2024-09-16T07:31:19.796761+0000","last_unstale":"2024-09-16T07:31:19.800715+0000","last_undegraded":"2024-09-16T07:31:19.800715+0000","last_fullsized":"2024-09-16T07:31:19.800715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:52.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.817665+0000","last_change":"2024-09-16T07:31:18.784339+0000","last_active":"2024-09-16T07:31:19.817665+0000","last_peered":"2024-09-16T07:31:19.817665+0000","last_clean":"2024-09-16T07:31:19.817665+0000","last_became_active":"2024-09-16T07:31:18.783476+0000","last_became_peered":"2024-09-16T07:31:18.783476+0000","last_unstale":"2024-09-16T07:31:19.817665+0000","last_undegraded":"2024-09-16T07:31:19.817665+0000","last_fullsized":"2024-09-16T07:31:19.817665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:53.213568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794691+0000","last_change":"2024-09-16T07:31:19.788247+0000","last_active":"2024-09-16T07:31:19.794691+0000","last_peered":"2024-09-16T07:31:19.794691+0000","last_clean":"2024-09-16T07:31:19.794691+0000","last_became_active":"2024-09-16T07:31:19.787994+0000","last_became_peered":"2024-09-16T07:31:19.787994+0000","last_unstale":"2024-09-16T07:31:19.794691+0000","last_undegraded":"2024-09-16T07:31:19.794691+0000","last_fullsized":"2024-09-16T07:31:19.794691+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.819795+0000","last_change":"2024-09-16T07:31:18.789879+0000","last_active":"2024-09-16T07:31:19.819795+0000","last_peered":"2024-09-16T07:31:19.819795+0000","last_clean":"2024-09-16T07:31:19.819795+0000","last_became_active":"2024-09-16T07:31:18.788588+0000","last_became_peered":"2024-09-16T07:31:18.788588+0000","last_unstale":"2024-09-16T07:31:19.819795+0000","last_undegraded":"2024-09-16T07:31:19.819795+0000","last_fullsized":"2024-09-16T07:31:19.819795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:37.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807126+0000","last_change":"2024-09-16T07:31:19.794796+0000","last_active":"2024-09-16T07:31:19.807126+0000","last_peered":"2024-09-16T07:31:19.807126+0000","last_clean":"2024-09-16T07:31:19.807126+0000","last_became_active":"2024-09-16T07:31:19.794529+0000","last_became_peered":"2024-09-16T07:31:19.794529+0000","last_unstale":"2024-09-16T07:31:19.807126+0000","last_undegraded":"2024-09-16T07:31:19.807126+0000","last_fullsized":"2024-09-16T07:31:19.807126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:22:55.100874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.815836+0000","last_change":"2024-09-16T07:31:18.774527+0000","last_active":"2024-09-16T07:31:19.815836+0000","last_peered":"2024-09-16T07:31:19.815836+0000","last_clean":"2024-09-16T07:31:19.815836+0000","last_became_active":"2024-09-16T07:31:18.774274+0000","last_became_peered":"2024-09-16T07:31:18.774274+0000","last_unstale":"2024-09-16T07:31:19.815836+0000","last_undegraded":"2024-09-16T07:31:19.815836+0000","last_fullsized":"2024-09-16T07:31:19.815836+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:04.070738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794261+0000","last_change":"2024-09-16T07:31:19.790939+0000","last_active":"2024-09-16T07:31:19.794261+0000","last_peered":"2024-09-16T07:31:19.794261+0000","last_clean":"2024-09-16T07:31:19.794261+0000","last_became_active":"2024-09-16T07:31:19.789693+0000","last_became_peered":"2024-09-16T07:31:19.789693+0000","last_unstale":"2024-09-16T07:31:19.794261+0000","last_undegraded":"2024-09-16T07:31:19.794261+0000","last_fullsized":"2024-09-16T07:31:19.794261+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:09.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.792614+0000","last_change":"2024-09-16T07:31:18.795070+0000","last_active":"2024-09-16T07:31:19.792614+0000","last_peered":"2024-09-16T07:31:19.792614+0000","last_clean":"2024-09-16T07:31:19.792614+0000","last_became_active":"2024-09-16T07:31:18.793712+0000","last_became_peered":"2024-09-16T07:31:18.793712+0000","last_unstale":"2024-09-16T07:31:19.792614+0000","last_undegraded":"2024-09-16T07:31:19.792614+0000","last_fullsized":"2024-09-16T07:31:19.792614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795358+0000","last_change":"2024-09-16T07:31:19.789084+0000","last_active":"2024-09-16T07:31:19.795358+0000","last_peered":"2024-09-16T07:31:19.795358+0000","last_clean":"2024-09-16T07:31:19.795358+0000","last_became_active":"2024-09-16T07:31:19.788667+0000","last_became_peered":"2024-09-16T07:31:19.788667+0000","last_unstale":"2024-09-16T07:31:19.795358+0000","last_undegraded":"2024-09-16T07:31:19.795358+0000","last_fullsized":"2024-09-16T07:31:19.795358+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:54.964441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.822022+0000","last_change":"2024-09-16T07:31:18.789543+0000","last_active":"2024-09-16T07:31:19.822022+0000","last_peered":"2024-09-16T07:31:19.822022+0000","last_clean":"2024-09-16T07:31:19.822022+0000","last_became_active":"2024-09-16T07:31:18.789265+0000","last_became_peered":"2024-09-16T07:31:18.789265+0000","last_unstale":"2024-09-16T07:31:19.822022+0000","last_undegraded":"2024-09-16T07:31:19.822022+0000","last_fullsized":"2024-09-16T07:31:19.822022+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:47.674243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.805813+0000","last_change":"2024-09-16T07:31:19.799276+0000","last_active":"2024-09-16T07:31:19.805813+0000","last_peered":"2024-09-16T07:31:19.805813+0000","last_clean":"2024-09-16T07:31:19.805813+0000","last_became_active":"2024-09-16T07:31:19.799034+0000","last_became_peered":"2024-09-16T07:31:19.799034+0000","last_unstale":"2024-09-16T07:31:19.805813+0000","last_undegraded":"2024-09-16T07:31:19.805813+0000","last_fullsized":"2024-09-16T07:31:19.805813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:54.145906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776957+0000","last_change":"2024-09-16T07:31:18.787186+0000","last_active":"2024-09-16T07:31:19.776957+0000","last_peered":"2024-09-16T07:31:19.776957+0000","last_clean":"2024-09-16T07:31:19.776957+0000","last_became_active":"2024-09-16T07:31:18.786925+0000","last_became_peered":"2024-09-16T07:31:18.786925+0000","last_unstale":"2024-09-16T07:31:19.776957+0000","last_undegraded":"2024-09-16T07:31:19.776957+0000","last_fullsized":"2024-09-16T07:31:19.776957+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:06.201636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.806223+0000","last_change":"2024-09-16T07:31:19.801738+0000","last_active":"2024-09-16T07:31:19.806223+0000","last_peered":"2024-09-16T07:31:19.806223+0000","last_clean":"2024-09-16T07:31:19.806223+0000","last_became_active":"2024-09-16T07:31:19.801475+0000","last_became_peered":"2024-09-16T07:31:19.801475+0000","last_unstale":"2024-09-16T07:31:19.806223+0000","last_undegraded":"2024-09-16T07:31:19.806223+0000","last_fullsized":"2024-09-16T07:31:19.806223+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.778633+0000","last_change":"2024-09-16T07:31:18.787455+0000","last_active":"2024-09-16T07:31:19.778633+0000","last_peered":"2024-09-16T07:31:19.778633+0000","last_clean":"2024-09-16T07:31:19.778633+0000","last_became_active":"2024-09-16T07:31:18.787111+0000","last_became_peered":"2024-09-16T07:31:18.787111+0000","last_unstale":"2024-09-16T07:31:19.778633+0000","last_undegraded":"2024-09-16T07:31:19.778633+0000","last_fullsized":"2024-09-16T07:31:19.778633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.795458+0000","last_change":"2024-09-16T07:31:19.789411+0000","last_active":"2024-09-16T07:31:19.795458+0000","last_peered":"2024-09-16T07:31:19.795458+0000","last_clean":"2024-09-16T07:31:19.795458+0000","last_became_active":"2024-09-16T07:31:19.789063+0000","last_became_peered":"2024-09-16T07:31:19.789063+0000","last_unstale":"2024-09-16T07:31:19.795458+0000","last_undegraded":"2024-09-16T07:31:19.795458+0000","last_fullsized":"2024-09-16T07:31:19.795458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.820683+0000","last_change":"2024-09-16T07:31:18.794588+0000","last_active":"2024-09-16T07:31:19.820683+0000","last_peered":"2024-09-16T07:31:19.820683+0000","last_clean":"2024-09-16T07:31:19.820683+0000","last_became_active":"2024-09-16T07:31:18.793959+0000","last_became_peered":"2024-09-16T07:31:18.793959+0000","last_unstale":"2024-09-16T07:31:19.820683+0000","last_undegraded":"2024-09-16T07:31:19.820683+0000","last_fullsized":"2024-09-16T07:31:19.820683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:40.698336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.798506+0000","last_change":"2024-09-16T07:31:19.793595+0000","last_active":"2024-09-16T07:31:19.798506+0000","last_peered":"2024-09-16T07:31:19.798506+0000","last_clean":"2024-09-16T07:31:19.798506+0000","last_became_active":"2024-09-16T07:31:19.793298+0000","last_became_peered":"2024-09-16T07:31:19.793298+0000","last_unstale":"2024-09-16T07:31:19.798506+0000","last_undegraded":"2024-09-16T07:31:19.798506+0000","last_fullsized":"2024-09-16T07:31:19.798506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:42.712871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.793466+0000","last_change":"2024-09-16T07:31:18.788195+0000","last_active":"2024-09-16T07:31:19.793466+0000","last_peered":"2024-09-16T07:31:19.793466+0000","last_clean":"2024-09-16T07:31:19.793466+0000","last_became_active":"2024-09-16T07:31:18.787856+0000","last_became_peered":"2024-09-16T07:31:18.787856+0000","last_unstale":"2024-09-16T07:31:19.793466+0000","last_undegraded":"2024-09-16T07:31:19.793466+0000","last_fullsized":"2024-09-16T07:31:19.793466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:53.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.801826+0000","last_change":"2024-09-16T07:31:19.796745+0000","last_active":"2024-09-16T07:31:19.801826+0000","last_peered":"2024-09-16T07:31:19.801826+0000","last_clean":"2024-09-16T07:31:19.801826+0000","last_became_active":"2024-09-16T07:31:19.796160+0000","last_became_peered":"2024-09-16T07:31:19.796160+0000","last_unstale":"2024-09-16T07:31:19.801826+0000","last_undegraded":"2024-09-16T07:31:19.801826+0000","last_fullsized":"2024-09-16T07:31:19.801826+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:18.142799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780648+0000","last_change":"2024-09-16T07:31:18.775590+0000","last_active":"2024-09-16T07:31:19.780648+0000","last_peered":"2024-09-16T07:31:19.780648+0000","last_clean":"2024-09-16T07:31:19.780648+0000","last_became_active":"2024-09-16T07:31:18.775372+0000","last_became_peered":"2024-09-16T07:31:18.775372+0000","last_unstale":"2024-09-16T07:31:19.780648+0000","last_undegraded":"2024-09-16T07:31:19.780648+0000","last_fullsized":"2024-09-16T07:31:19.780648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:51.048762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804769+0000","last_change":"2024-09-16T07:31:19.797206+0000","last_active":"2024-09-16T07:31:19.804769+0000","last_peered":"2024-09-16T07:31:19.804769+0000","last_clean":"2024-09-16T07:31:19.804769+0000","last_became_active":"2024-09-16T07:31:19.796955+0000","last_became_peered":"2024-09-16T07:31:19.796955+0000","last_unstale":"2024-09-16T07:31:19.804769+0000","last_undegraded":"2024-09-16T07:31:19.804769+0000","last_fullsized":"2024-09-16T07:31:19.804769+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:47.160959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.780195+0000","last_change":"2024-09-16T07:31:18.779241+0000","last_active":"2024-09-16T07:31:19.780195+0000","last_peered":"2024-09-16T07:31:19.780195+0000","last_clean":"2024-09-16T07:31:19.780195+0000","last_became_active":"2024-09-16T07:31:18.778973+0000","last_became_peered":"2024-09-16T07:31:18.778973+0000","last_unstale":"2024-09-16T07:31:19.780195+0000","last_undegraded":"2024-09-16T07:31:19.780195+0000","last_fullsized":"2024-09-16T07:31:19.780195+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.799187+0000","last_change":"2024-09-16T07:31:19.791585+0000","last_active":"2024-09-16T07:31:19.799187+0000","last_peered":"2024-09-16T07:31:19.799187+0000","last_clean":"2024-09-16T07:31:19.799187+0000","last_became_active":"2024-09-16T07:31:19.791327+0000","last_became_peered":"2024-09-16T07:31:19.791327+0000","last_unstale":"2024-09-16T07:31:19.799187+0000","last_undegraded":"2024-09-16T07:31:19.799187+0000","last_fullsized":"2024-09-16T07:31:19.799187+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:27.493050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776933+0000","last_change":"2024-09-16T07:31:18.787749+0000","last_active":"2024-09-16T07:31:19.776933+0000","last_peered":"2024-09-16T07:31:19.776933+0000","last_clean":"2024-09-16T07:31:19.776933+0000","last_became_active":"2024-09-16T07:31:18.787475+0000","last_became_peered":"2024-09-16T07:31:18.787475+0000","last_unstale":"2024-09-16T07:31:19.776933+0000","last_undegraded":"2024-09-16T07:31:19.776933+0000","last_fullsized":"2024-09-16T07:31:19.776933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:20.592987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.794310+0000","last_change":"2024-09-16T07:31:19.790582+0000","last_active":"2024-09-16T07:31:19.794310+0000","last_peered":"2024-09-16T07:31:19.794310+0000","last_clean":"2024-09-16T07:31:19.794310+0000","last_became_active":"2024-09-16T07:31:19.790285+0000","last_became_peered":"2024-09-16T07:31:19.790285+0000","last_unstale":"2024-09-16T07:31:19.794310+0000","last_undegraded":"2024-09-16T07:31:19.794310+0000","last_fullsized":"2024-09-16T07:31:19.794310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:05.077038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.784768+0000","last_change":"2024-09-16T07:31:18.790010+0000","last_active":"2024-09-16T07:31:19.784768+0000","last_peered":"2024-09-16T07:31:19.784768+0000","last_clean":"2024-09-16T07:31:19.784768+0000","last_became_active":"2024-09-16T07:31:18.789733+0000","last_became_peered":"2024-09-16T07:31:18.789733+0000","last_unstale":"2024-09-16T07:31:19.784768+0000","last_undegraded":"2024-09-16T07:31:19.784768+0000","last_fullsized":"2024-09-16T07:31:19.784768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:35.643472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.804052+0000","last_change":"2024-09-16T07:31:19.799293+0000","last_active":"2024-09-16T07:31:19.804052+0000","last_peered":"2024-09-16T07:31:19.804052+0000","last_clean":"2024-09-16T07:31:19.804052+0000","last_became_active":"2024-09-16T07:31:19.799086+0000","last_became_peered":"2024-09-16T07:31:19.799086+0000","last_unstale":"2024-09-16T07:31:19.804052+0000","last_undegraded":"2024-09-16T07:31:19.804052+0000","last_fullsized":"2024-09-16T07:31:19.804052+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:26.031540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.776937+0000","last_change":"2024-09-16T07:31:18.792232+0000","last_active":"2024-09-16T07:31:19.776937+0000","last_peered":"2024-09-16T07:31:19.776937+0000","last_clean":"2024-09-16T07:31:19.776937+0000","last_became_active":"2024-09-16T07:31:18.791920+0000","last_became_peered":"2024-09-16T07:31:18.791920+0000","last_unstale":"2024-09-16T07:31:19.776937+0000","last_undegraded":"2024-09-16T07:31:19.776937+0000","last_fullsized":"2024-09-16T07:31:19.776937+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:39.264345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.807003+0000","last_change":"2024-09-16T07:31:19.794654+0000","last_active":"2024-09-16T07:31:19.807003+0000","last_peered":"2024-09-16T07:31:19.807003+0000","last_clean":"2024-09-16T07:31:19.807003+0000","last_became_active":"2024-09-16T07:31:19.794379+0000","last_became_peered":"2024-09-16T07:31:19.794379+0000","last_unstale":"2024-09-16T07:31:19.807003+0000","last_undegraded":"2024-09-16T07:31:19.807003+0000","last_fullsized":"2024-09-16T07:31:19.807003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:02.848339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.783051+0000","last_change":"2024-09-16T07:31:18.789535+0000","last_active":"2024-09-16T07:31:19.783051+0000","last_peered":"2024-09-16T07:31:19.783051+0000","last_clean":"2024-09-16T07:31:19.783051+0000","last_became_active":"2024-09-16T07:31:18.789035+0000","last_became_peered":"2024-09-16T07:31:18.789035+0000","last_unstale":"2024-09-16T07:31:19.783051+0000","last_undegraded":"2024-09-16T07:31:19.783051+0000","last_fullsized":"2024-09-16T07:31:19.783051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:04.021360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.808602+0000","last_change":"2024-09-16T07:31:19.801383+0000","last_active":"2024-09-16T07:31:19.808602+0000","last_peered":"2024-09-16T07:31:19.808602+0000","last_clean":"2024-09-16T07:31:19.808602+0000","last_became_active":"2024-09-16T07:31:19.801123+0000","last_became_peered":"2024-09-16T07:31:19.801123+0000","last_unstale":"2024-09-16T07:31:19.808602+0000","last_undegraded":"2024-09-16T07:31:19.808602+0000","last_fullsized":"2024-09-16T07:31:19.808602+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:31:17.995605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.781321+0000","last_change":"2024-09-16T07:31:18.774958+0000","last_active":"2024-09-16T07:31:19.781321+0000","last_peered":"2024-09-16T07:31:19.781321+0000","last_clean":"2024-09-16T07:31:19.781321+0000","last_became_active":"2024-09-16T07:31:18.774697+0000","last_became_peered":"2024-09-16T07:31:18.774697+0000","last_unstale":"2024-09-16T07:31:19.781321+0000","last_undegraded":"2024-09-16T07:31:19.781321+0000","last_fullsized":"2024-09-16T07:31:19.781321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:39.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:31:19.777462+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:31:19.777462+0000","last_peered":"2024-09-16T07:31:19.777462+0000","last_clean":"2024-09-16T07:31:19.777462+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:31:19.777462+0000","last_undegraded":"2024-09-16T07:31:19.777462+0000","last_fullsized":"2024-09-16T07:31:19.777462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":675840,"data_stored":273330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":264943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":667648,"data_stored":271808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":855311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":684032,"data_stored":278074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:31:28.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:31:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 -- 172.21.15.114:0/3981160332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c15ce40 msgr2=0x7f2f7c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 --2- 172.21.15.114:0/3981160332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c15ce40 0x7f2f7c0b5a90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009bc0 tx=0x7f2f7401cba0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 -- 172.21.15.114:0/3981160332 shutdown_connections 2024-09-16T07:31:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 --2- 172.21.15.114:0/3981160332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c15ce40 0x7f2f7c0b5a90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 -- 172.21.15.114:0/3981160332 >> 172.21.15.114:0/3981160332 conn(0x7f2f7c06dd30 msgr2=0x7f2f7c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 -- 172.21.15.114:0/3981160332 shutdown_connections 2024-09-16T07:31:28.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 -- 172.21.15.114:0/3981160332 wait complete. 2024-09-16T07:31:28.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 Processor -- start 2024-09-16T07:31:28.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.628+0000 7f2f82400640 1 -- start start 2024-09-16T07:31:28.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c152cd0 0x7f2f7c1469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:28.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f7c15ce40 0x7f2f7c13f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:28.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f7c15f6f0 0x7f2f7c13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c16a090 con 0x7f2f7c152cd0 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c169f10 con 0x7f2f7c15f6f0 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c16a210 con 0x7f2f7c15ce40 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c152cd0 0x7f2f7c1469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c152cd0 0x7f2f7c1469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33774/0 (socket says 172.21.15.114:33774) 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 -- 172.21.15.114:0/2479403685 learned_addr learned my addr 172.21.15.114:0/2479403685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7be00640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f7c15f6f0 0x7f2f7c13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7aa00640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f7c15ce40 0x7f2f7c13f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 -- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f7c15ce40 msgr2=0x7f2f7c13f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f7c15ce40 0x7f2f7c13f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 -- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f7c15f6f0 msgr2=0x7f2f7c13f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f7c15f6f0 0x7f2f7c13f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 -- 172.21.15.114:0/2479403685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c141f30 con 0x7f2f7c152cd0 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7aa00640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f7c15ce40 0x7f2f7c13f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f7b400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c152cd0 0x7f2f7c1469a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c420 tx=0x7f2f6c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f73400640 1 -- 172.21.15.114:0/2479403685 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c017070 con 0x7f2f7c152cd0 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f73400640 1 -- 172.21.15.114:0/2479403685 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f6c003600 con 0x7f2f7c152cd0 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f73400640 1 -- 172.21.15.114:0/2479403685 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c003a90 con 0x7f2f7c152cd0 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7c142210 con 0x7f2f7c152cd0 2024-09-16T07:31:28.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7c145ec0 con 0x7f2f7c152cd0 2024-09-16T07:31:28.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f7c0b5a90 con 0x7f2f7c152cd0 2024-09-16T07:31:28.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.632+0000 7f2f73400640 1 -- 172.21.15.114:0/2479403685 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f2f6c01a070 con 0x7f2f7c152cd0 2024-09-16T07:31:28.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.636+0000 7f2f73400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f5c0730a0 0x7f2f5c075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:28.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.636+0000 7f2f73400640 1 -- 172.21.15.114:0/2479403685 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2f6c0934f0 con 0x7f2f7c152cd0 2024-09-16T07:31:28.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.636+0000 7f2f7aa00640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f5c0730a0 0x7f2f5c075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:28.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.636+0000 7f2f7aa00640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f5c0730a0 0x7f2f5c075560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f68000f70 tx=0x7f2f68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:28.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.640+0000 7f2f73400640 1 -- 172.21.15.114:0/2479403685 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2f6c05dcc0 con 0x7f2f7c152cd0 2024-09-16T07:31:28.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.804+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f7c0b5260 con 0x7f2f5c0730a0 2024-09-16T07:31:28.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.808+0000 7f2f73400640 1 -- 172.21.15.114:0/2479403685 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f2f7c0b5260 con 0x7f2f5c0730a0 2024-09-16T07:31:28.809 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:28.810 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:31:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f5c0730a0 msgr2=0x7f2f5c075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f5c0730a0 0x7f2f5c075560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2f68000f70 tx=0x7f2f68009040 comp rx=0 tx=0).stop 2024-09-16T07:31:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c152cd0 msgr2=0x7f2f7c1469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c152cd0 0x7f2f7c1469a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00c420 tx=0x7f2f6c00c8e0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 shutdown_connections 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f5c0730a0 0x7f2f5c075560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f7c15f6f0 0x7f2f7c13f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f7c15ce40 0x7f2f7c13f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 --2- 172.21.15.114:0/2479403685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f7c152cd0 0x7f2f7c1469a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 >> 172.21.15.114:0/2479403685 conn(0x7f2f7c06dd30 msgr2=0x7f2f7c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 shutdown_connections 2024-09-16T07:31:28.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:28.812+0000 7f2f82400640 1 -- 172.21.15.114:0/2479403685 wait complete. 2024-09-16T07:31:28.828 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-16T07:31:27.040471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226924,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747796,"statfs":{"total":773094113280,"available":772861743104,"internally_reserved":0,"allocated":6660096,"data_stored":3409700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001841"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834547+0000","last_change":"2024-09-16T07:31:19.797257+0000","last_active":"2024-09-16T07:31:20.834547+0000","last_peered":"2024-09-16T07:31:20.834547+0000","last_clean":"2024-09-16T07:31:20.834547+0000","last_became_active":"2024-09-16T07:31:19.794480+0000","last_became_peered":"2024-09-16T07:31:19.794480+0000","last_unstale":"2024-09-16T07:31:20.834547+0000","last_undegraded":"2024-09-16T07:31:20.834547+0000","last_fullsized":"2024-09-16T07:31:20.834547+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:31.077561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835171+0000","last_change":"2024-09-16T07:31:19.795452+0000","last_active":"2024-09-16T07:31:20.835171+0000","last_peered":"2024-09-16T07:31:20.835171+0000","last_clean":"2024-09-16T07:31:20.835171+0000","last_became_active":"2024-09-16T07:31:19.794937+0000","last_became_peered":"2024-09-16T07:31:19.794937+0000","last_unstale":"2024-09-16T07:31:20.835171+0000","last_undegraded":"2024-09-16T07:31:20.835171+0000","last_fullsized":"2024-09-16T07:31:20.835171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:54.658007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832064+0000","last_change":"2024-09-16T07:31:19.792532+0000","last_active":"2024-09-16T07:31:20.832064+0000","last_peered":"2024-09-16T07:31:20.832064+0000","last_clean":"2024-09-16T07:31:20.832064+0000","last_became_active":"2024-09-16T07:31:19.792301+0000","last_became_peered":"2024-09-16T07:31:19.792301+0000","last_unstale":"2024-09-16T07:31:20.832064+0000","last_undegraded":"2024-09-16T07:31:20.832064+0000","last_fullsized":"2024-09-16T07:31:20.832064+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:51.285445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778458+0000","last_change":"2024-09-16T07:31:19.789467+0000","last_active":"2024-09-16T07:31:20.778458+0000","last_peered":"2024-09-16T07:31:20.778458+0000","last_clean":"2024-09-16T07:31:20.778458+0000","last_became_active":"2024-09-16T07:31:19.789174+0000","last_became_peered":"2024-09-16T07:31:19.789174+0000","last_unstale":"2024-09-16T07:31:20.778458+0000","last_undegraded":"2024-09-16T07:31:20.778458+0000","last_fullsized":"2024-09-16T07:31:20.778458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:58.496364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.833817+0000","last_change":"2024-09-16T07:31:19.799632+0000","last_active":"2024-09-16T07:31:20.833817+0000","last_peered":"2024-09-16T07:31:20.833817+0000","last_clean":"2024-09-16T07:31:20.833817+0000","last_became_active":"2024-09-16T07:31:19.799341+0000","last_became_peered":"2024-09-16T07:31:19.799341+0000","last_unstale":"2024-09-16T07:31:20.833817+0000","last_undegraded":"2024-09-16T07:31:20.833817+0000","last_fullsized":"2024-09-16T07:31:20.833817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:19.828124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813360+0000","last_change":"2024-09-16T07:31:19.802298+0000","last_active":"2024-09-16T07:31:20.813360+0000","last_peered":"2024-09-16T07:31:20.813360+0000","last_clean":"2024-09-16T07:31:20.813360+0000","last_became_active":"2024-09-16T07:31:19.802043+0000","last_became_peered":"2024-09-16T07:31:19.802043+0000","last_unstale":"2024-09-16T07:31:20.813360+0000","last_undegraded":"2024-09-16T07:31:20.813360+0000","last_fullsized":"2024-09-16T07:31:20.813360+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:15:33.584698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.777727+0000","last_change":"2024-09-16T07:31:19.794748+0000","last_active":"2024-09-16T07:31:20.777727+0000","last_peered":"2024-09-16T07:31:20.777727+0000","last_clean":"2024-09-16T07:31:20.777727+0000","last_became_active":"2024-09-16T07:31:19.794494+0000","last_became_peered":"2024-09-16T07:31:19.794494+0000","last_unstale":"2024-09-16T07:31:20.777727+0000","last_undegraded":"2024-09-16T07:31:20.777727+0000","last_fullsized":"2024-09-16T07:31:20.777727+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:24.238910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.833997+0000","last_change":"2024-09-16T07:31:19.796360+0000","last_active":"2024-09-16T07:31:20.833997+0000","last_peered":"2024-09-16T07:31:20.833997+0000","last_clean":"2024-09-16T07:31:20.833997+0000","last_became_active":"2024-09-16T07:31:19.796075+0000","last_became_peered":"2024-09-16T07:31:19.796075+0000","last_unstale":"2024-09-16T07:31:20.833997+0000","last_undegraded":"2024-09-16T07:31:20.833997+0000","last_fullsized":"2024-09-16T07:31:20.833997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:42.266106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778867+0000","last_change":"2024-09-16T07:31:19.800757+0000","last_active":"2024-09-16T07:31:20.778867+0000","last_peered":"2024-09-16T07:31:20.778867+0000","last_clean":"2024-09-16T07:31:20.778867+0000","last_became_active":"2024-09-16T07:31:19.800483+0000","last_became_peered":"2024-09-16T07:31:19.800483+0000","last_unstale":"2024-09-16T07:31:20.778867+0000","last_undegraded":"2024-09-16T07:31:20.778867+0000","last_fullsized":"2024-09-16T07:31:20.778867+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:05.077038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835899+0000","last_change":"2024-09-16T07:31:19.798727+0000","last_active":"2024-09-16T07:31:20.835899+0000","last_peered":"2024-09-16T07:31:20.835899+0000","last_clean":"2024-09-16T07:31:20.835899+0000","last_became_active":"2024-09-16T07:31:19.798309+0000","last_became_peered":"2024-09-16T07:31:19.798309+0000","last_unstale":"2024-09-16T07:31:20.835899+0000","last_undegraded":"2024-09-16T07:31:20.835899+0000","last_fullsized":"2024-09-16T07:31:20.835899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:36.649772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835878+0000","last_change":"2024-09-16T07:31:19.792993+0000","last_active":"2024-09-16T07:31:20.835878+0000","last_peered":"2024-09-16T07:31:20.835878+0000","last_clean":"2024-09-16T07:31:20.835878+0000","last_became_active":"2024-09-16T07:31:19.792461+0000","last_became_peered":"2024-09-16T07:31:19.792461+0000","last_unstale":"2024-09-16T07:31:20.835878+0000","last_undegraded":"2024-09-16T07:31:20.835878+0000","last_fullsized":"2024-09-16T07:31:20.835878+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:13.692782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778691+0000","last_change":"2024-09-16T07:31:19.788824+0000","last_active":"2024-09-16T07:31:20.778691+0000","last_peered":"2024-09-16T07:31:20.778691+0000","last_clean":"2024-09-16T07:31:20.778691+0000","last_became_active":"2024-09-16T07:31:19.788477+0000","last_became_peered":"2024-09-16T07:31:19.788477+0000","last_unstale":"2024-09-16T07:31:20.778691+0000","last_undegraded":"2024-09-16T07:31:20.778691+0000","last_fullsized":"2024-09-16T07:31:20.778691+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:48.737794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.776771+0000","last_change":"2024-09-16T07:31:19.795230+0000","last_active":"2024-09-16T07:31:20.776771+0000","last_peered":"2024-09-16T07:31:20.776771+0000","last_clean":"2024-09-16T07:31:20.776771+0000","last_became_active":"2024-09-16T07:31:19.794956+0000","last_became_peered":"2024-09-16T07:31:19.794956+0000","last_unstale":"2024-09-16T07:31:20.776771+0000","last_undegraded":"2024-09-16T07:31:20.776771+0000","last_fullsized":"2024-09-16T07:31:20.776771+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:03:44.758692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.779114+0000","last_change":"2024-09-16T07:31:19.789254+0000","last_active":"2024-09-16T07:31:20.779114+0000","last_peered":"2024-09-16T07:31:20.779114+0000","last_clean":"2024-09-16T07:31:20.779114+0000","last_became_active":"2024-09-16T07:31:19.788561+0000","last_became_peered":"2024-09-16T07:31:19.788561+0000","last_unstale":"2024-09-16T07:31:20.779114+0000","last_undegraded":"2024-09-16T07:31:20.779114+0000","last_fullsized":"2024-09-16T07:31:20.779114+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:32.744007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778163+0000","last_change":"2024-09-16T07:31:19.790415+0000","last_active":"2024-09-16T07:31:20.778163+0000","last_peered":"2024-09-16T07:31:20.778163+0000","last_clean":"2024-09-16T07:31:20.778163+0000","last_became_active":"2024-09-16T07:31:19.789977+0000","last_became_peered":"2024-09-16T07:31:19.789977+0000","last_unstale":"2024-09-16T07:31:20.778163+0000","last_undegraded":"2024-09-16T07:31:20.778163+0000","last_fullsized":"2024-09-16T07:31:20.778163+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:38.353578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813273+0000","last_change":"2024-09-16T07:31:19.803450+0000","last_active":"2024-09-16T07:31:20.813273+0000","last_peered":"2024-09-16T07:31:20.813273+0000","last_clean":"2024-09-16T07:31:20.813273+0000","last_became_active":"2024-09-16T07:31:19.803117+0000","last_became_peered":"2024-09-16T07:31:19.803117+0000","last_unstale":"2024-09-16T07:31:20.813273+0000","last_undegraded":"2024-09-16T07:31:20.813273+0000","last_fullsized":"2024-09-16T07:31:20.813273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:52.540424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835337+0000","last_change":"2024-09-16T07:31:19.798737+0000","last_active":"2024-09-16T07:31:20.835337+0000","last_peered":"2024-09-16T07:31:20.835337+0000","last_clean":"2024-09-16T07:31:20.835337+0000","last_became_active":"2024-09-16T07:31:19.798489+0000","last_became_peered":"2024-09-16T07:31:19.798489+0000","last_unstale":"2024-09-16T07:31:20.835337+0000","last_undegraded":"2024-09-16T07:31:20.835337+0000","last_fullsized":"2024-09-16T07:31:20.835337+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:52.997913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832272+0000","last_change":"2024-09-16T07:31:19.800414+0000","last_active":"2024-09-16T07:31:20.832272+0000","last_peered":"2024-09-16T07:31:20.832272+0000","last_clean":"2024-09-16T07:31:20.832272+0000","last_became_active":"2024-09-16T07:31:19.798920+0000","last_became_peered":"2024-09-16T07:31:19.798920+0000","last_unstale":"2024-09-16T07:31:20.832272+0000","last_undegraded":"2024-09-16T07:31:20.832272+0000","last_fullsized":"2024-09-16T07:31:20.832272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:15:33.584698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834339+0000","last_change":"2024-09-16T07:31:19.793968+0000","last_active":"2024-09-16T07:31:20.834339+0000","last_peered":"2024-09-16T07:31:20.834339+0000","last_clean":"2024-09-16T07:31:20.834339+0000","last_became_active":"2024-09-16T07:31:19.793707+0000","last_became_peered":"2024-09-16T07:31:19.793707+0000","last_unstale":"2024-09-16T07:31:20.834339+0000","last_undegraded":"2024-09-16T07:31:20.834339+0000","last_fullsized":"2024-09-16T07:31:20.834339+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:15:09.790721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834839+0000","last_change":"2024-09-16T07:31:19.802446+0000","last_active":"2024-09-16T07:31:20.834839+0000","last_peered":"2024-09-16T07:31:20.834839+0000","last_clean":"2024-09-16T07:31:20.834839+0000","last_became_active":"2024-09-16T07:31:19.802076+0000","last_became_peered":"2024-09-16T07:31:19.802076+0000","last_unstale":"2024-09-16T07:31:20.834839+0000","last_undegraded":"2024-09-16T07:31:20.834839+0000","last_fullsized":"2024-09-16T07:31:20.834839+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:38.977719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.831801+0000","last_change":"2024-09-16T07:31:19.797580+0000","last_active":"2024-09-16T07:31:20.831801+0000","last_peered":"2024-09-16T07:31:20.831801+0000","last_clean":"2024-09-16T07:31:20.831801+0000","last_became_active":"2024-09-16T07:31:19.796587+0000","last_became_peered":"2024-09-16T07:31:19.796587+0000","last_unstale":"2024-09-16T07:31:20.831801+0000","last_undegraded":"2024-09-16T07:31:20.831801+0000","last_fullsized":"2024-09-16T07:31:20.831801+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:48.737794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834367+0000","last_change":"2024-09-16T07:31:19.792089+0000","last_active":"2024-09-16T07:31:20.834367+0000","last_peered":"2024-09-16T07:31:20.834367+0000","last_clean":"2024-09-16T07:31:20.834367+0000","last_became_active":"2024-09-16T07:31:19.790997+0000","last_became_peered":"2024-09-16T07:31:19.790997+0000","last_unstale":"2024-09-16T07:31:20.834367+0000","last_undegraded":"2024-09-16T07:31:20.834367+0000","last_fullsized":"2024-09-16T07:31:20.834367+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:12:28.303424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.831750+0000","last_change":"2024-09-16T07:31:19.791289+0000","last_active":"2024-09-16T07:31:20.831750+0000","last_peered":"2024-09-16T07:31:20.831750+0000","last_clean":"2024-09-16T07:31:20.831750+0000","last_became_active":"2024-09-16T07:31:19.790974+0000","last_became_peered":"2024-09-16T07:31:19.790974+0000","last_unstale":"2024-09-16T07:31:20.831750+0000","last_undegraded":"2024-09-16T07:31:20.831750+0000","last_fullsized":"2024-09-16T07:31:20.831750+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:39.017272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.776228+0000","last_change":"2024-09-16T07:31:19.799545+0000","last_active":"2024-09-16T07:31:20.776228+0000","last_peered":"2024-09-16T07:31:20.776228+0000","last_clean":"2024-09-16T07:31:20.776228+0000","last_became_active":"2024-09-16T07:31:19.799285+0000","last_became_peered":"2024-09-16T07:31:19.799285+0000","last_unstale":"2024-09-16T07:31:20.776228+0000","last_undegraded":"2024-09-16T07:31:20.776228+0000","last_fullsized":"2024-09-16T07:31:20.776228+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:20:37.875660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834785+0000","last_change":"2024-09-16T07:31:19.791265+0000","last_active":"2024-09-16T07:31:20.834785+0000","last_peered":"2024-09-16T07:31:20.834785+0000","last_clean":"2024-09-16T07:31:20.834785+0000","last_became_active":"2024-09-16T07:31:19.790963+0000","last_became_peered":"2024-09-16T07:31:19.790963+0000","last_unstale":"2024-09-16T07:31:20.834785+0000","last_undegraded":"2024-09-16T07:31:20.834785+0000","last_fullsized":"2024-09-16T07:31:20.834785+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:19.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778551+0000","last_change":"2024-09-16T07:31:19.790142+0000","last_active":"2024-09-16T07:31:20.778551+0000","last_peered":"2024-09-16T07:31:20.778551+0000","last_clean":"2024-09-16T07:31:20.778551+0000","last_became_active":"2024-09-16T07:31:19.789787+0000","last_became_peered":"2024-09-16T07:31:19.789787+0000","last_unstale":"2024-09-16T07:31:20.778551+0000","last_undegraded":"2024-09-16T07:31:20.778551+0000","last_fullsized":"2024-09-16T07:31:20.778551+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:39.017272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813548+0000","last_change":"2024-09-16T07:31:19.807204+0000","last_active":"2024-09-16T07:31:20.813548+0000","last_peered":"2024-09-16T07:31:20.813548+0000","last_clean":"2024-09-16T07:31:20.813548+0000","last_became_active":"2024-09-16T07:31:19.805182+0000","last_became_peered":"2024-09-16T07:31:19.805182+0000","last_unstale":"2024-09-16T07:31:20.813548+0000","last_undegraded":"2024-09-16T07:31:20.813548+0000","last_fullsized":"2024-09-16T07:31:20.813548+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:07:34.444217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834103+0000","last_change":"2024-09-16T07:31:19.800532+0000","last_active":"2024-09-16T07:31:20.834103+0000","last_peered":"2024-09-16T07:31:20.834103+0000","last_clean":"2024-09-16T07:31:20.834103+0000","last_became_active":"2024-09-16T07:31:19.797836+0000","last_became_peered":"2024-09-16T07:31:19.797836+0000","last_unstale":"2024-09-16T07:31:20.834103+0000","last_undegraded":"2024-09-16T07:31:20.834103+0000","last_fullsized":"2024-09-16T07:31:20.834103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:08.019298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834827+0000","last_change":"2024-09-16T07:31:19.797676+0000","last_active":"2024-09-16T07:31:20.834827+0000","last_peered":"2024-09-16T07:31:20.834827+0000","last_clean":"2024-09-16T07:31:20.834827+0000","last_became_active":"2024-09-16T07:31:19.797402+0000","last_became_peered":"2024-09-16T07:31:19.797402+0000","last_unstale":"2024-09-16T07:31:20.834827+0000","last_undegraded":"2024-09-16T07:31:20.834827+0000","last_fullsized":"2024-09-16T07:31:20.834827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:56:00.872018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.831882+0000","last_change":"2024-09-16T07:31:19.792014+0000","last_active":"2024-09-16T07:31:20.831882+0000","last_peered":"2024-09-16T07:31:20.831882+0000","last_clean":"2024-09-16T07:31:20.831882+0000","last_became_active":"2024-09-16T07:31:19.791672+0000","last_became_peered":"2024-09-16T07:31:19.791672+0000","last_unstale":"2024-09-16T07:31:20.831882+0000","last_undegraded":"2024-09-16T07:31:20.831882+0000","last_fullsized":"2024-09-16T07:31:20.831882+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:10.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.833710+0000","last_change":"2024-09-16T07:31:19.786937+0000","last_active":"2024-09-16T07:31:20.833710+0000","last_peered":"2024-09-16T07:31:20.833710+0000","last_clean":"2024-09-16T07:31:20.833710+0000","last_became_active":"2024-09-16T07:31:19.786629+0000","last_became_peered":"2024-09-16T07:31:19.786629+0000","last_unstale":"2024-09-16T07:31:20.833710+0000","last_undegraded":"2024-09-16T07:31:20.833710+0000","last_fullsized":"2024-09-16T07:31:20.833710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:06:06.385935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813354+0000","last_change":"2024-09-16T07:31:19.809602+0000","last_active":"2024-09-16T07:31:20.813354+0000","last_peered":"2024-09-16T07:31:20.813354+0000","last_clean":"2024-09-16T07:31:20.813354+0000","last_became_active":"2024-09-16T07:31:19.809274+0000","last_became_peered":"2024-09-16T07:31:19.809274+0000","last_unstale":"2024-09-16T07:31:20.813354+0000","last_undegraded":"2024-09-16T07:31:20.813354+0000","last_fullsized":"2024-09-16T07:31:20.813354+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:51.285445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813817+0000","last_change":"2024-09-16T07:31:19.798550+0000","last_active":"2024-09-16T07:31:20.813817+0000","last_peered":"2024-09-16T07:31:20.813817+0000","last_clean":"2024-09-16T07:31:20.813817+0000","last_became_active":"2024-09-16T07:31:19.798280+0000","last_became_peered":"2024-09-16T07:31:19.798280+0000","last_unstale":"2024-09-16T07:31:20.813817+0000","last_undegraded":"2024-09-16T07:31:20.813817+0000","last_fullsized":"2024-09-16T07:31:20.813817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:50:50.250380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813699+0000","last_change":"2024-09-16T07:31:18.788213+0000","last_active":"2024-09-16T07:31:20.813699+0000","last_peered":"2024-09-16T07:31:20.813699+0000","last_clean":"2024-09-16T07:31:20.813699+0000","last_became_active":"2024-09-16T07:31:18.787961+0000","last_became_peered":"2024-09-16T07:31:18.787961+0000","last_unstale":"2024-09-16T07:31:20.813699+0000","last_undegraded":"2024-09-16T07:31:20.813699+0000","last_fullsized":"2024-09-16T07:31:20.813699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:56.115404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.836037+0000","last_change":"2024-09-16T07:31:19.789278+0000","last_active":"2024-09-16T07:31:20.836037+0000","last_peered":"2024-09-16T07:31:20.836037+0000","last_clean":"2024-09-16T07:31:20.836037+0000","last_became_active":"2024-09-16T07:31:19.789015+0000","last_became_peered":"2024-09-16T07:31:19.789015+0000","last_unstale":"2024-09-16T07:31:20.836037+0000","last_undegraded":"2024-09-16T07:31:20.836037+0000","last_fullsized":"2024-09-16T07:31:20.836037+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:14.672043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835135+0000","last_change":"2024-09-16T07:31:18.775898+0000","last_active":"2024-09-16T07:31:20.835135+0000","last_peered":"2024-09-16T07:31:20.835135+0000","last_clean":"2024-09-16T07:31:20.835135+0000","last_became_active":"2024-09-16T07:31:18.775575+0000","last_became_peered":"2024-09-16T07:31:18.775575+0000","last_unstale":"2024-09-16T07:31:20.835135+0000","last_undegraded":"2024-09-16T07:31:20.835135+0000","last_fullsized":"2024-09-16T07:31:20.835135+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:56.258821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813908+0000","last_change":"2024-09-16T07:31:19.804592+0000","last_active":"2024-09-16T07:31:20.813908+0000","last_peered":"2024-09-16T07:31:20.813908+0000","last_clean":"2024-09-16T07:31:20.813908+0000","last_became_active":"2024-09-16T07:31:19.803010+0000","last_became_peered":"2024-09-16T07:31:19.803010+0000","last_unstale":"2024-09-16T07:31:20.813908+0000","last_undegraded":"2024-09-16T07:31:20.813908+0000","last_fullsized":"2024-09-16T07:31:20.813908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.519613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813780+0000","last_change":"2024-09-16T07:31:18.794664+0000","last_active":"2024-09-16T07:31:20.813780+0000","last_peered":"2024-09-16T07:31:20.813780+0000","last_clean":"2024-09-16T07:31:20.813780+0000","last_became_active":"2024-09-16T07:31:18.794418+0000","last_became_peered":"2024-09-16T07:31:18.794418+0000","last_unstale":"2024-09-16T07:31:20.813780+0000","last_undegraded":"2024-09-16T07:31:20.813780+0000","last_fullsized":"2024-09-16T07:31:20.813780+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813624+0000","last_change":"2024-09-16T07:31:19.805940+0000","last_active":"2024-09-16T07:31:20.813624+0000","last_peered":"2024-09-16T07:31:20.813624+0000","last_clean":"2024-09-16T07:31:20.813624+0000","last_became_active":"2024-09-16T07:31:19.804922+0000","last_became_peered":"2024-09-16T07:31:19.804922+0000","last_unstale":"2024-09-16T07:31:20.813624+0000","last_undegraded":"2024-09-16T07:31:20.813624+0000","last_fullsized":"2024-09-16T07:31:20.813624+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:15:50.932275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778848+0000","last_change":"2024-09-16T07:31:18.772762+0000","last_active":"2024-09-16T07:31:20.778848+0000","last_peered":"2024-09-16T07:31:20.778848+0000","last_clean":"2024-09-16T07:31:20.778848+0000","last_became_active":"2024-09-16T07:31:18.772483+0000","last_became_peered":"2024-09-16T07:31:18.772483+0000","last_unstale":"2024-09-16T07:31:20.778848+0000","last_undegraded":"2024-09-16T07:31:20.778848+0000","last_fullsized":"2024-09-16T07:31:20.778848+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834362+0000","last_change":"2024-09-16T07:31:19.788175+0000","last_active":"2024-09-16T07:31:20.834362+0000","last_peered":"2024-09-16T07:31:20.834362+0000","last_clean":"2024-09-16T07:31:20.834362+0000","last_became_active":"2024-09-16T07:31:19.787903+0000","last_became_peered":"2024-09-16T07:31:19.787903+0000","last_unstale":"2024-09-16T07:31:20.834362+0000","last_undegraded":"2024-09-16T07:31:20.834362+0000","last_fullsized":"2024-09-16T07:31:20.834362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:28.674431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778541+0000","last_change":"2024-09-16T07:31:18.779878+0000","last_active":"2024-09-16T07:31:20.778541+0000","last_peered":"2024-09-16T07:31:20.778541+0000","last_clean":"2024-09-16T07:31:20.778541+0000","last_became_active":"2024-09-16T07:31:18.779587+0000","last_became_peered":"2024-09-16T07:31:18.779587+0000","last_unstale":"2024-09-16T07:31:20.778541+0000","last_undegraded":"2024-09-16T07:31:20.778541+0000","last_fullsized":"2024-09-16T07:31:20.778541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:22:12.686482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834669+0000","last_change":"2024-09-16T07:31:19.808074+0000","last_active":"2024-09-16T07:31:20.834669+0000","last_peered":"2024-09-16T07:31:20.834669+0000","last_clean":"2024-09-16T07:31:20.834669+0000","last_became_active":"2024-09-16T07:31:19.807802+0000","last_became_peered":"2024-09-16T07:31:19.807802+0000","last_unstale":"2024-09-16T07:31:20.834669+0000","last_undegraded":"2024-09-16T07:31:20.834669+0000","last_fullsized":"2024-09-16T07:31:20.834669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:07.484195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813323+0000","last_change":"2024-09-16T07:31:18.789053+0000","last_active":"2024-09-16T07:31:20.813323+0000","last_peered":"2024-09-16T07:31:20.813323+0000","last_clean":"2024-09-16T07:31:20.813323+0000","last_became_active":"2024-09-16T07:31:18.788715+0000","last_became_peered":"2024-09-16T07:31:18.788715+0000","last_unstale":"2024-09-16T07:31:20.813323+0000","last_undegraded":"2024-09-16T07:31:20.813323+0000","last_fullsized":"2024-09-16T07:31:20.813323+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:58.466722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.776272+0000","last_change":"2024-09-16T07:31:19.794608+0000","last_active":"2024-09-16T07:31:20.776272+0000","last_peered":"2024-09-16T07:31:20.776272+0000","last_clean":"2024-09-16T07:31:20.776272+0000","last_became_active":"2024-09-16T07:31:19.794301+0000","last_became_peered":"2024-09-16T07:31:19.794301+0000","last_unstale":"2024-09-16T07:31:20.776272+0000","last_undegraded":"2024-09-16T07:31:20.776272+0000","last_fullsized":"2024-09-16T07:31:20.776272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:26.031540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.777963+0000","last_change":"2024-09-16T07:31:18.777720+0000","last_active":"2024-09-16T07:31:20.777963+0000","last_peered":"2024-09-16T07:31:20.777963+0000","last_clean":"2024-09-16T07:31:20.777963+0000","last_became_active":"2024-09-16T07:31:18.777300+0000","last_became_peered":"2024-09-16T07:31:18.777300+0000","last_unstale":"2024-09-16T07:31:20.777963+0000","last_undegraded":"2024-09-16T07:31:20.777963+0000","last_fullsized":"2024-09-16T07:31:20.777963+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834327+0000","last_change":"2024-09-16T07:31:19.789913+0000","last_active":"2024-09-16T07:31:20.834327+0000","last_peered":"2024-09-16T07:31:20.834327+0000","last_clean":"2024-09-16T07:31:20.834327+0000","last_became_active":"2024-09-16T07:31:19.787859+0000","last_became_peered":"2024-09-16T07:31:19.787859+0000","last_unstale":"2024-09-16T07:31:20.834327+0000","last_undegraded":"2024-09-16T07:31:20.834327+0000","last_fullsized":"2024-09-16T07:31:20.834327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:06:10.760202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.777673+0000","last_change":"2024-09-16T07:31:18.790293+0000","last_active":"2024-09-16T07:31:20.777673+0000","last_peered":"2024-09-16T07:31:20.777673+0000","last_clean":"2024-09-16T07:31:20.777673+0000","last_became_active":"2024-09-16T07:31:18.789971+0000","last_became_peered":"2024-09-16T07:31:18.789971+0000","last_unstale":"2024-09-16T07:31:20.777673+0000","last_undegraded":"2024-09-16T07:31:20.777673+0000","last_fullsized":"2024-09-16T07:31:20.777673+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:02.508386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778914+0000","last_change":"2024-09-16T07:31:19.792022+0000","last_active":"2024-09-16T07:31:20.778914+0000","last_peered":"2024-09-16T07:31:20.778914+0000","last_clean":"2024-09-16T07:31:20.778914+0000","last_became_active":"2024-09-16T07:31:19.791203+0000","last_became_peered":"2024-09-16T07:31:19.791203+0000","last_unstale":"2024-09-16T07:31:20.778914+0000","last_undegraded":"2024-09-16T07:31:20.778914+0000","last_fullsized":"2024-09-16T07:31:20.778914+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:09.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832460+0000","last_change":"2024-09-16T07:31:18.786810+0000","last_active":"2024-09-16T07:31:20.832460+0000","last_peered":"2024-09-16T07:31:20.832460+0000","last_clean":"2024-09-16T07:31:20.832460+0000","last_became_active":"2024-09-16T07:31:18.786465+0000","last_became_peered":"2024-09-16T07:31:18.786465+0000","last_unstale":"2024-09-16T07:31:20.832460+0000","last_undegraded":"2024-09-16T07:31:20.832460+0000","last_fullsized":"2024-09-16T07:31:20.832460+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:04.930039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832428+0000","last_change":"2024-09-16T07:31:19.795431+0000","last_active":"2024-09-16T07:31:20.832428+0000","last_peered":"2024-09-16T07:31:20.832428+0000","last_clean":"2024-09-16T07:31:20.832428+0000","last_became_active":"2024-09-16T07:31:19.795082+0000","last_became_peered":"2024-09-16T07:31:19.795082+0000","last_unstale":"2024-09-16T07:31:20.832428+0000","last_undegraded":"2024-09-16T07:31:20.832428+0000","last_fullsized":"2024-09-16T07:31:20.832428+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:15:50.932275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835193+0000","last_change":"2024-09-16T07:31:18.782972+0000","last_active":"2024-09-16T07:31:20.835193+0000","last_peered":"2024-09-16T07:31:20.835193+0000","last_clean":"2024-09-16T07:31:20.835193+0000","last_became_active":"2024-09-16T07:31:18.782718+0000","last_became_peered":"2024-09-16T07:31:18.782718+0000","last_unstale":"2024-09-16T07:31:20.835193+0000","last_undegraded":"2024-09-16T07:31:20.835193+0000","last_fullsized":"2024-09-16T07:31:20.835193+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:51.534124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835610+0000","last_change":"2024-09-16T07:31:19.797122+0000","last_active":"2024-09-16T07:31:20.835610+0000","last_peered":"2024-09-16T07:31:20.835610+0000","last_clean":"2024-09-16T07:31:20.835610+0000","last_became_active":"2024-09-16T07:31:19.796492+0000","last_became_peered":"2024-09-16T07:31:19.796492+0000","last_unstale":"2024-09-16T07:31:20.835610+0000","last_undegraded":"2024-09-16T07:31:20.835610+0000","last_fullsized":"2024-09-16T07:31:20.835610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:03.514686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832436+0000","last_change":"2024-09-16T07:31:18.791265+0000","last_active":"2024-09-16T07:31:20.832436+0000","last_peered":"2024-09-16T07:31:20.832436+0000","last_clean":"2024-09-16T07:31:20.832436+0000","last_became_active":"2024-09-16T07:31:18.790938+0000","last_became_peered":"2024-09-16T07:31:18.790938+0000","last_unstale":"2024-09-16T07:31:20.832436+0000","last_undegraded":"2024-09-16T07:31:20.832436+0000","last_fullsized":"2024-09-16T07:31:20.832436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832005+0000","last_change":"2024-09-16T07:31:19.799667+0000","last_active":"2024-09-16T07:31:20.832005+0000","last_peered":"2024-09-16T07:31:20.832005+0000","last_clean":"2024-09-16T07:31:20.832005+0000","last_became_active":"2024-09-16T07:31:19.798050+0000","last_became_peered":"2024-09-16T07:31:19.798050+0000","last_unstale":"2024-09-16T07:31:20.832005+0000","last_undegraded":"2024-09-16T07:31:20.832005+0000","last_fullsized":"2024-09-16T07:31:20.832005+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:38.553253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778708+0000","last_change":"2024-09-16T07:31:18.790021+0000","last_active":"2024-09-16T07:31:20.778708+0000","last_peered":"2024-09-16T07:31:20.778708+0000","last_clean":"2024-09-16T07:31:20.778708+0000","last_became_active":"2024-09-16T07:31:18.789741+0000","last_became_peered":"2024-09-16T07:31:18.789741+0000","last_unstale":"2024-09-16T07:31:20.778708+0000","last_undegraded":"2024-09-16T07:31:20.778708+0000","last_fullsized":"2024-09-16T07:31:20.778708+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:21.281704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.779127+0000","last_change":"2024-09-16T07:31:19.789229+0000","last_active":"2024-09-16T07:31:20.779127+0000","last_peered":"2024-09-16T07:31:20.779127+0000","last_clean":"2024-09-16T07:31:20.779127+0000","last_became_active":"2024-09-16T07:31:19.788959+0000","last_became_peered":"2024-09-16T07:31:19.788959+0000","last_unstale":"2024-09-16T07:31:20.779127+0000","last_undegraded":"2024-09-16T07:31:20.779127+0000","last_fullsized":"2024-09-16T07:31:20.779127+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:38.553253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834689+0000","last_change":"2024-09-16T07:31:18.776594+0000","last_active":"2024-09-16T07:31:20.834689+0000","last_peered":"2024-09-16T07:31:20.834689+0000","last_clean":"2024-09-16T07:31:20.834689+0000","last_became_active":"2024-09-16T07:31:18.776279+0000","last_became_peered":"2024-09-16T07:31:18.776279+0000","last_unstale":"2024-09-16T07:31:20.834689+0000","last_undegraded":"2024-09-16T07:31:20.834689+0000","last_fullsized":"2024-09-16T07:31:20.834689+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:25.190475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.831944+0000","last_change":"2024-09-16T07:31:19.792528+0000","last_active":"2024-09-16T07:31:20.831944+0000","last_peered":"2024-09-16T07:31:20.831944+0000","last_clean":"2024-09-16T07:31:20.831944+0000","last_became_active":"2024-09-16T07:31:19.792259+0000","last_became_peered":"2024-09-16T07:31:19.792259+0000","last_unstale":"2024-09-16T07:31:20.831944+0000","last_undegraded":"2024-09-16T07:31:20.831944+0000","last_fullsized":"2024-09-16T07:31:20.831944+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:57.879247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.776483+0000","last_change":"2024-09-16T07:31:18.772988+0000","last_active":"2024-09-16T07:31:20.776483+0000","last_peered":"2024-09-16T07:31:20.776483+0000","last_clean":"2024-09-16T07:31:20.776483+0000","last_became_active":"2024-09-16T07:31:18.772533+0000","last_became_peered":"2024-09-16T07:31:18.772533+0000","last_unstale":"2024-09-16T07:31:20.776483+0000","last_undegraded":"2024-09-16T07:31:20.776483+0000","last_fullsized":"2024-09-16T07:31:20.776483+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:22.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.777710+0000","last_change":"2024-09-16T07:31:19.793747+0000","last_active":"2024-09-16T07:31:20.777710+0000","last_peered":"2024-09-16T07:31:20.777710+0000","last_clean":"2024-09-16T07:31:20.777710+0000","last_became_active":"2024-09-16T07:31:19.793378+0000","last_became_peered":"2024-09-16T07:31:19.793378+0000","last_unstale":"2024-09-16T07:31:20.777710+0000","last_undegraded":"2024-09-16T07:31:20.777710+0000","last_fullsized":"2024-09-16T07:31:20.777710+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:35:05.936339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778042+0000","last_change":"2024-09-16T07:31:18.773395+0000","last_active":"2024-09-16T07:31:20.778042+0000","last_peered":"2024-09-16T07:31:20.778042+0000","last_clean":"2024-09-16T07:31:20.778042+0000","last_became_active":"2024-09-16T07:31:18.773128+0000","last_became_peered":"2024-09-16T07:31:18.773128+0000","last_unstale":"2024-09-16T07:31:20.778042+0000","last_undegraded":"2024-09-16T07:31:20.778042+0000","last_fullsized":"2024-09-16T07:31:20.778042+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:23.232610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832067+0000","last_change":"2024-09-16T07:31:19.792038+0000","last_active":"2024-09-16T07:31:20.832067+0000","last_peered":"2024-09-16T07:31:20.832067+0000","last_clean":"2024-09-16T07:31:20.832067+0000","last_became_active":"2024-09-16T07:31:19.791722+0000","last_became_peered":"2024-09-16T07:31:19.791722+0000","last_unstale":"2024-09-16T07:31:20.832067+0000","last_undegraded":"2024-09-16T07:31:20.832067+0000","last_fullsized":"2024-09-16T07:31:20.832067+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:50.860027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.831839+0000","last_change":"2024-09-16T07:31:18.781351+0000","last_active":"2024-09-16T07:31:20.831839+0000","last_peered":"2024-09-16T07:31:20.831839+0000","last_clean":"2024-09-16T07:31:20.831839+0000","last_became_active":"2024-09-16T07:31:18.781032+0000","last_became_peered":"2024-09-16T07:31:18.781032+0000","last_unstale":"2024-09-16T07:31:20.831839+0000","last_undegraded":"2024-09-16T07:31:20.831839+0000","last_fullsized":"2024-09-16T07:31:20.831839+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832318+0000","last_change":"2024-09-16T07:31:19.797161+0000","last_active":"2024-09-16T07:31:20.832318+0000","last_peered":"2024-09-16T07:31:20.832318+0000","last_clean":"2024-09-16T07:31:20.832318+0000","last_became_active":"2024-09-16T07:31:19.796761+0000","last_became_peered":"2024-09-16T07:31:19.796761+0000","last_unstale":"2024-09-16T07:31:20.832318+0000","last_undegraded":"2024-09-16T07:31:20.832318+0000","last_fullsized":"2024-09-16T07:31:20.832318+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:21.593590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835349+0000","last_change":"2024-09-16T07:31:18.784339+0000","last_active":"2024-09-16T07:31:20.835349+0000","last_peered":"2024-09-16T07:31:20.835349+0000","last_clean":"2024-09-16T07:31:20.835349+0000","last_became_active":"2024-09-16T07:31:18.783476+0000","last_became_peered":"2024-09-16T07:31:18.783476+0000","last_unstale":"2024-09-16T07:31:20.835349+0000","last_undegraded":"2024-09-16T07:31:20.835349+0000","last_fullsized":"2024-09-16T07:31:20.835349+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:53.213568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.779095+0000","last_change":"2024-09-16T07:31:19.788247+0000","last_active":"2024-09-16T07:31:20.779095+0000","last_peered":"2024-09-16T07:31:20.779095+0000","last_clean":"2024-09-16T07:31:20.779095+0000","last_became_active":"2024-09-16T07:31:19.787994+0000","last_became_peered":"2024-09-16T07:31:19.787994+0000","last_unstale":"2024-09-16T07:31:20.779095+0000","last_undegraded":"2024-09-16T07:31:20.779095+0000","last_fullsized":"2024-09-16T07:31:20.779095+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:57.879247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813801+0000","last_change":"2024-09-16T07:31:18.789879+0000","last_active":"2024-09-16T07:31:20.813801+0000","last_peered":"2024-09-16T07:31:20.813801+0000","last_clean":"2024-09-16T07:31:20.813801+0000","last_became_active":"2024-09-16T07:31:18.788588+0000","last_became_peered":"2024-09-16T07:31:18.788588+0000","last_unstale":"2024-09-16T07:31:20.813801+0000","last_undegraded":"2024-09-16T07:31:20.813801+0000","last_fullsized":"2024-09-16T07:31:20.813801+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:37.347278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834866+0000","last_change":"2024-09-16T07:31:19.794796+0000","last_active":"2024-09-16T07:31:20.834866+0000","last_peered":"2024-09-16T07:31:20.834866+0000","last_clean":"2024-09-16T07:31:20.834866+0000","last_became_active":"2024-09-16T07:31:19.794529+0000","last_became_peered":"2024-09-16T07:31:19.794529+0000","last_unstale":"2024-09-16T07:31:20.834866+0000","last_undegraded":"2024-09-16T07:31:20.834866+0000","last_fullsized":"2024-09-16T07:31:20.834866+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:06:50.210791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778440+0000","last_change":"2024-09-16T07:31:18.774527+0000","last_active":"2024-09-16T07:31:20.778440+0000","last_peered":"2024-09-16T07:31:20.778440+0000","last_clean":"2024-09-16T07:31:20.778440+0000","last_became_active":"2024-09-16T07:31:18.774274+0000","last_became_peered":"2024-09-16T07:31:18.774274+0000","last_unstale":"2024-09-16T07:31:20.778440+0000","last_undegraded":"2024-09-16T07:31:20.778440+0000","last_fullsized":"2024-09-16T07:31:20.778440+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:25:04.070738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832318+0000","last_change":"2024-09-16T07:31:19.790939+0000","last_active":"2024-09-16T07:31:20.832318+0000","last_peered":"2024-09-16T07:31:20.832318+0000","last_clean":"2024-09-16T07:31:20.832318+0000","last_became_active":"2024-09-16T07:31:19.789693+0000","last_became_peered":"2024-09-16T07:31:19.789693+0000","last_unstale":"2024-09-16T07:31:20.832318+0000","last_undegraded":"2024-09-16T07:31:20.832318+0000","last_fullsized":"2024-09-16T07:31:20.832318+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:07:34.444217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813950+0000","last_change":"2024-09-16T07:31:18.795070+0000","last_active":"2024-09-16T07:31:20.813950+0000","last_peered":"2024-09-16T07:31:20.813950+0000","last_clean":"2024-09-16T07:31:20.813950+0000","last_became_active":"2024-09-16T07:31:18.793712+0000","last_became_peered":"2024-09-16T07:31:18.793712+0000","last_unstale":"2024-09-16T07:31:20.813950+0000","last_undegraded":"2024-09-16T07:31:20.813950+0000","last_fullsized":"2024-09-16T07:31:20.813950+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:38:08.551832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.779331+0000","last_change":"2024-09-16T07:31:19.789084+0000","last_active":"2024-09-16T07:31:20.779331+0000","last_peered":"2024-09-16T07:31:20.779331+0000","last_clean":"2024-09-16T07:31:20.779331+0000","last_became_active":"2024-09-16T07:31:19.788667+0000","last_became_peered":"2024-09-16T07:31:19.788667+0000","last_unstale":"2024-09-16T07:31:20.779331+0000","last_undegraded":"2024-09-16T07:31:20.779331+0000","last_fullsized":"2024-09-16T07:31:20.779331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:22.778575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834814+0000","last_change":"2024-09-16T07:31:18.789543+0000","last_active":"2024-09-16T07:31:20.834814+0000","last_peered":"2024-09-16T07:31:20.834814+0000","last_clean":"2024-09-16T07:31:20.834814+0000","last_became_active":"2024-09-16T07:31:18.789265+0000","last_became_peered":"2024-09-16T07:31:18.789265+0000","last_unstale":"2024-09-16T07:31:20.834814+0000","last_undegraded":"2024-09-16T07:31:20.834814+0000","last_fullsized":"2024-09-16T07:31:20.834814+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:47.674243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813605+0000","last_change":"2024-09-16T07:31:19.799276+0000","last_active":"2024-09-16T07:31:20.813605+0000","last_peered":"2024-09-16T07:31:20.813605+0000","last_clean":"2024-09-16T07:31:20.813605+0000","last_became_active":"2024-09-16T07:31:19.799034+0000","last_became_peered":"2024-09-16T07:31:19.799034+0000","last_unstale":"2024-09-16T07:31:20.813605+0000","last_undegraded":"2024-09-16T07:31:20.813605+0000","last_fullsized":"2024-09-16T07:31:20.813605+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:21.593590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835587+0000","last_change":"2024-09-16T07:31:18.787186+0000","last_active":"2024-09-16T07:31:20.835587+0000","last_peered":"2024-09-16T07:31:20.835587+0000","last_clean":"2024-09-16T07:31:20.835587+0000","last_became_active":"2024-09-16T07:31:18.786925+0000","last_became_peered":"2024-09-16T07:31:18.786925+0000","last_unstale":"2024-09-16T07:31:20.835587+0000","last_undegraded":"2024-09-16T07:31:20.835587+0000","last_fullsized":"2024-09-16T07:31:20.835587+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:06.201636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813301+0000","last_change":"2024-09-16T07:31:19.801738+0000","last_active":"2024-09-16T07:31:20.813301+0000","last_peered":"2024-09-16T07:31:20.813301+0000","last_clean":"2024-09-16T07:31:20.813301+0000","last_became_active":"2024-09-16T07:31:19.801475+0000","last_became_peered":"2024-09-16T07:31:19.801475+0000","last_unstale":"2024-09-16T07:31:20.813301+0000","last_undegraded":"2024-09-16T07:31:20.813301+0000","last_fullsized":"2024-09-16T07:31:20.813301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:50.860027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778042+0000","last_change":"2024-09-16T07:31:18.787455+0000","last_active":"2024-09-16T07:31:20.778042+0000","last_peered":"2024-09-16T07:31:20.778042+0000","last_clean":"2024-09-16T07:31:20.778042+0000","last_became_active":"2024-09-16T07:31:18.787111+0000","last_became_peered":"2024-09-16T07:31:18.787111+0000","last_unstale":"2024-09-16T07:31:20.778042+0000","last_undegraded":"2024-09-16T07:31:20.778042+0000","last_fullsized":"2024-09-16T07:31:20.778042+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:24.281832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778770+0000","last_change":"2024-09-16T07:31:19.789411+0000","last_active":"2024-09-16T07:31:20.778770+0000","last_peered":"2024-09-16T07:31:20.778770+0000","last_clean":"2024-09-16T07:31:20.778770+0000","last_became_active":"2024-09-16T07:31:19.789063+0000","last_became_peered":"2024-09-16T07:31:19.789063+0000","last_unstale":"2024-09-16T07:31:20.778770+0000","last_undegraded":"2024-09-16T07:31:20.778770+0000","last_fullsized":"2024-09-16T07:31:20.778770+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:10.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.836122+0000","last_change":"2024-09-16T07:31:18.794588+0000","last_active":"2024-09-16T07:31:20.836122+0000","last_peered":"2024-09-16T07:31:20.836122+0000","last_clean":"2024-09-16T07:31:20.836122+0000","last_became_active":"2024-09-16T07:31:18.793959+0000","last_became_peered":"2024-09-16T07:31:18.793959+0000","last_unstale":"2024-09-16T07:31:20.836122+0000","last_undegraded":"2024-09-16T07:31:20.836122+0000","last_fullsized":"2024-09-16T07:31:20.836122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:40.698336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.779264+0000","last_change":"2024-09-16T07:31:19.793595+0000","last_active":"2024-09-16T07:31:20.779264+0000","last_peered":"2024-09-16T07:31:20.779264+0000","last_clean":"2024-09-16T07:31:20.779264+0000","last_became_active":"2024-09-16T07:31:19.793298+0000","last_became_peered":"2024-09-16T07:31:19.793298+0000","last_unstale":"2024-09-16T07:31:20.779264+0000","last_undegraded":"2024-09-16T07:31:20.779264+0000","last_fullsized":"2024-09-16T07:31:20.779264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:50.860027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813926+0000","last_change":"2024-09-16T07:31:18.788195+0000","last_active":"2024-09-16T07:31:20.813926+0000","last_peered":"2024-09-16T07:31:20.813926+0000","last_clean":"2024-09-16T07:31:20.813926+0000","last_became_active":"2024-09-16T07:31:18.787856+0000","last_became_peered":"2024-09-16T07:31:18.787856+0000","last_unstale":"2024-09-16T07:31:20.813926+0000","last_undegraded":"2024-09-16T07:31:20.813926+0000","last_fullsized":"2024-09-16T07:31:20.813926+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:35:53.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835644+0000","last_change":"2024-09-16T07:31:19.796745+0000","last_active":"2024-09-16T07:31:20.835644+0000","last_peered":"2024-09-16T07:31:20.835644+0000","last_clean":"2024-09-16T07:31:20.835644+0000","last_became_active":"2024-09-16T07:31:19.796160+0000","last_became_peered":"2024-09-16T07:31:19.796160+0000","last_unstale":"2024-09-16T07:31:20.835644+0000","last_undegraded":"2024-09-16T07:31:20.835644+0000","last_fullsized":"2024-09-16T07:31:20.835644+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:22.288004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.776811+0000","last_change":"2024-09-16T07:31:18.775590+0000","last_active":"2024-09-16T07:31:20.776811+0000","last_peered":"2024-09-16T07:31:20.776811+0000","last_clean":"2024-09-16T07:31:20.776811+0000","last_became_active":"2024-09-16T07:31:18.775372+0000","last_became_peered":"2024-09-16T07:31:18.775372+0000","last_unstale":"2024-09-16T07:31:20.776811+0000","last_undegraded":"2024-09-16T07:31:20.776811+0000","last_fullsized":"2024-09-16T07:31:20.776811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:51.048762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.813773+0000","last_change":"2024-09-16T07:31:19.797206+0000","last_active":"2024-09-16T07:31:20.813773+0000","last_peered":"2024-09-16T07:31:20.813773+0000","last_clean":"2024-09-16T07:31:20.813773+0000","last_became_active":"2024-09-16T07:31:19.796955+0000","last_became_peered":"2024-09-16T07:31:19.796955+0000","last_unstale":"2024-09-16T07:31:20.813773+0000","last_undegraded":"2024-09-16T07:31:20.813773+0000","last_fullsized":"2024-09-16T07:31:20.813773+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:59:04.802858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.778920+0000","last_change":"2024-09-16T07:31:18.779241+0000","last_active":"2024-09-16T07:31:20.778920+0000","last_peered":"2024-09-16T07:31:20.778920+0000","last_clean":"2024-09-16T07:31:20.778920+0000","last_became_active":"2024-09-16T07:31:18.778973+0000","last_became_peered":"2024-09-16T07:31:18.778973+0000","last_unstale":"2024-09-16T07:31:20.778920+0000","last_undegraded":"2024-09-16T07:31:20.778920+0000","last_fullsized":"2024-09-16T07:31:20.778920+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:31.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834577+0000","last_change":"2024-09-16T07:31:19.791585+0000","last_active":"2024-09-16T07:31:20.834577+0000","last_peered":"2024-09-16T07:31:20.834577+0000","last_clean":"2024-09-16T07:31:20.834577+0000","last_became_active":"2024-09-16T07:31:19.791327+0000","last_became_peered":"2024-09-16T07:31:19.791327+0000","last_unstale":"2024-09-16T07:31:20.834577+0000","last_undegraded":"2024-09-16T07:31:20.834577+0000","last_fullsized":"2024-09-16T07:31:20.834577+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:28.453315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835470+0000","last_change":"2024-09-16T07:31:18.787749+0000","last_active":"2024-09-16T07:31:20.835470+0000","last_peered":"2024-09-16T07:31:20.835470+0000","last_clean":"2024-09-16T07:31:20.835470+0000","last_became_active":"2024-09-16T07:31:18.787475+0000","last_became_peered":"2024-09-16T07:31:18.787475+0000","last_unstale":"2024-09-16T07:31:20.835470+0000","last_undegraded":"2024-09-16T07:31:20.835470+0000","last_fullsized":"2024-09-16T07:31:20.835470+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:20.592987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.832095+0000","last_change":"2024-09-16T07:31:19.790582+0000","last_active":"2024-09-16T07:31:20.832095+0000","last_peered":"2024-09-16T07:31:20.832095+0000","last_clean":"2024-09-16T07:31:20.832095+0000","last_became_active":"2024-09-16T07:31:19.790285+0000","last_became_peered":"2024-09-16T07:31:19.790285+0000","last_unstale":"2024-09-16T07:31:20.832095+0000","last_undegraded":"2024-09-16T07:31:20.832095+0000","last_fullsized":"2024-09-16T07:31:20.832095+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:22.778575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.779053+0000","last_change":"2024-09-16T07:31:18.790010+0000","last_active":"2024-09-16T07:31:20.779053+0000","last_peered":"2024-09-16T07:31:20.779053+0000","last_clean":"2024-09-16T07:31:20.779053+0000","last_became_active":"2024-09-16T07:31:18.789733+0000","last_became_peered":"2024-09-16T07:31:18.789733+0000","last_unstale":"2024-09-16T07:31:20.779053+0000","last_undegraded":"2024-09-16T07:31:20.779053+0000","last_fullsized":"2024-09-16T07:31:20.779053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:35.643472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.833792+0000","last_change":"2024-09-16T07:31:19.799293+0000","last_active":"2024-09-16T07:31:20.833792+0000","last_peered":"2024-09-16T07:31:20.833792+0000","last_clean":"2024-09-16T07:31:20.833792+0000","last_became_active":"2024-09-16T07:31:19.799086+0000","last_became_peered":"2024-09-16T07:31:19.799086+0000","last_unstale":"2024-09-16T07:31:20.833792+0000","last_undegraded":"2024-09-16T07:31:20.833792+0000","last_fullsized":"2024-09-16T07:31:20.833792+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:02.053572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.835322+0000","last_change":"2024-09-16T07:31:18.792232+0000","last_active":"2024-09-16T07:31:20.835322+0000","last_peered":"2024-09-16T07:31:20.835322+0000","last_clean":"2024-09-16T07:31:20.835322+0000","last_became_active":"2024-09-16T07:31:18.791920+0000","last_became_peered":"2024-09-16T07:31:18.791920+0000","last_unstale":"2024-09-16T07:31:20.835322+0000","last_undegraded":"2024-09-16T07:31:20.835322+0000","last_fullsized":"2024-09-16T07:31:20.835322+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:17:39.264345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834528+0000","last_change":"2024-09-16T07:31:19.794654+0000","last_active":"2024-09-16T07:31:20.834528+0000","last_peered":"2024-09-16T07:31:20.834528+0000","last_clean":"2024-09-16T07:31:20.834528+0000","last_became_active":"2024-09-16T07:31:19.794379+0000","last_became_peered":"2024-09-16T07:31:19.794379+0000","last_unstale":"2024-09-16T07:31:20.834528+0000","last_undegraded":"2024-09-16T07:31:20.834528+0000","last_fullsized":"2024-09-16T07:31:20.834528+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:21.132090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834147+0000","last_change":"2024-09-16T07:31:18.789535+0000","last_active":"2024-09-16T07:31:20.834147+0000","last_peered":"2024-09-16T07:31:20.834147+0000","last_clean":"2024-09-16T07:31:20.834147+0000","last_became_active":"2024-09-16T07:31:18.789035+0000","last_became_peered":"2024-09-16T07:31:18.789035+0000","last_unstale":"2024-09-16T07:31:20.834147+0000","last_undegraded":"2024-09-16T07:31:20.834147+0000","last_fullsized":"2024-09-16T07:31:20.834147+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:04.021360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.834074+0000","last_change":"2024-09-16T07:31:19.801383+0000","last_active":"2024-09-16T07:31:20.834074+0000","last_peered":"2024-09-16T07:31:20.834074+0000","last_clean":"2024-09-16T07:31:20.834074+0000","last_became_active":"2024-09-16T07:31:19.801123+0000","last_became_peered":"2024-09-16T07:31:19.801123+0000","last_unstale":"2024-09-16T07:31:20.834074+0000","last_undegraded":"2024-09-16T07:31:20.834074+0000","last_fullsized":"2024-09-16T07:31:20.834074+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:18.756836+0000","last_clean_scrub_stamp":"2024-09-16T07:31:18.756836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:47.038602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.776623+0000","last_change":"2024-09-16T07:31:18.774958+0000","last_active":"2024-09-16T07:31:20.776623+0000","last_peered":"2024-09-16T07:31:20.776623+0000","last_clean":"2024-09-16T07:31:20.776623+0000","last_became_active":"2024-09-16T07:31:18.774697+0000","last_became_peered":"2024-09-16T07:31:18.774697+0000","last_unstale":"2024-09-16T07:31:20.776623+0000","last_undegraded":"2024-09-16T07:31:20.776623+0000","last_fullsized":"2024-09-16T07:31:20.776623+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:31:17.750536+0000","last_clean_scrub_stamp":"2024-09-16T07:31:17.750536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:39.691830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":176,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:31:20.831722+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:31:20.831722+0000","last_peered":"2024-09-16T07:31:20.831722+0000","last_clean":"2024-09-16T07:31:20.831722+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:31:20.831722+0000","last_undegraded":"2024-09-16T07:31:20.831722+0000","last_fullsized":"2024-09-16T07:31:20.831722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1277952,"data_stored":868546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":278018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":684032,"data_stored":278670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":279630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":278074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":679936,"data_stored":278108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1286144,"data_stored":870580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":684032,"data_stored":278074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:31:28.833 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:31:28.834 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:31:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.020+0000 7f3bc6c00640 1 -- 172.21.15.114:0/2222784743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 msgr2=0x7f3bc00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.020+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/2222784743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc00d0300 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009c80 tx=0x7f3bb001f5a0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.020+0000 7f3bc6c00640 1 -- 172.21.15.114:0/2222784743 shutdown_connections 2024-09-16T07:31:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.020+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/2222784743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc00d0300 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.020+0000 7f3bc6c00640 1 -- 172.21.15.114:0/2222784743 >> 172.21.15.114:0/2222784743 conn(0x7f3bc00d1dc0 msgr2=0x7f3bc00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.020+0000 7f3bc6c00640 1 -- 172.21.15.114:0/2222784743 shutdown_connections 2024-09-16T07:31:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.020+0000 7f3bc6c00640 1 -- 172.21.15.114:0/2222784743 wait complete. 2024-09-16T07:31:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 Processor -- start 2024-09-16T07:31:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 -- start start 2024-09-16T07:31:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc00b2d80 0x7f3bc014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc00d0840 0x7f3bc01575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc01671c0 con 0x7f3bc00cff20 2024-09-16T07:31:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc0167040 con 0x7f3bc00b2d80 2024-09-16T07:31:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc0167340 con 0x7f3bc00d0840 2024-09-16T07:31:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc014f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33782/0 (socket says 172.21.15.114:33782) 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 -- 172.21.15.114:0/3421071562 learned_addr learned my addr 172.21.15.114:0/3421071562 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 -- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc00d0840 msgr2=0x7f3bc01575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc00d0840 0x7f3bc01575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 -- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc00b2d80 msgr2=0x7f3bc014ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc00b2d80 0x7f3bc014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 -- 172.21.15.114:0/3421071562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc01f5dc0 con 0x7f3bc00cff20 2024-09-16T07:31:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bb7400640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc014f3d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800c490 tx=0x7f3ba8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bbcc00640 1 -- 172.21.15.114:0/3421071562 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8017070 con 0x7f3bc00cff20 2024-09-16T07:31:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bbcc00640 1 -- 172.21.15.114:0/3421071562 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ba8003600 con 0x7f3bc00cff20 2024-09-16T07:31:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bbcc00640 1 -- 172.21.15.114:0/3421071562 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8003a90 con 0x7f3bc00cff20 2024-09-16T07:31:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc01f6060 con 0x7f3bc00cff20 2024-09-16T07:31:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.024+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc01f6620 con 0x7f3bc00cff20 2024-09-16T07:31:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.028+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc00d0300 con 0x7f3bc00cff20 2024-09-16T07:31:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.028+0000 7f3bbcc00640 1 -- 172.21.15.114:0/3421071562 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f3ba8003c30 con 0x7f3bc00cff20 2024-09-16T07:31:29.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.028+0000 7f3bbcc00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b9c073070 0x7f3b9c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.028+0000 7f3bbcc00640 1 -- 172.21.15.114:0/3421071562 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f3ba80934b0 con 0x7f3bc00cff20 2024-09-16T07:31:29.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.028+0000 7f3bbfe00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b9c073070 0x7f3b9c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:29.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.028+0000 7f3bbfe00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b9c073070 0x7f3b9c075530 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00b3000 tx=0x7f3bb001c340 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.032+0000 7f3bbcc00640 1 -- 172.21.15.114:0/3421071562 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3ba805e2d0 con 0x7f3bc00cff20 2024-09-16T07:31:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.260+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3bc015fa80 con 0x7f3bc00cff20 2024-09-16T07:31:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bbcc00640 1 -- 172.21.15.114:0/3421071562 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f3ba805dbd0 con 0x7f3bc00cff20 2024-09-16T07:31:29.261 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:31:29.261 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:31:29.261 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:31:29.261 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:31:29.261 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:31:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:31:29.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b9c073070 msgr2=0x7f3b9c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b9c073070 0x7f3b9c075530 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00b3000 tx=0x7f3bb001c340 comp rx=0 tx=0).stop 2024-09-16T07:31:29.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 msgr2=0x7f3bc014f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc014f3d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800c490 tx=0x7f3ba8001e80 comp rx=0 tx=0).stop 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 shutdown_connections 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b9c073070 0x7f3b9c075530 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3bc00d0840 0x7f3bc01575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3bc00cff20 0x7f3bc014f3d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 --2- 172.21.15.114:0/3421071562 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bc00b2d80 0x7f3bc014ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 >> 172.21.15.114:0/3421071562 conn(0x7f3bc00d1dc0 msgr2=0x7f3bc0158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 shutdown_connections 2024-09-16T07:31:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.264+0000 7f3bc6c00640 1 -- 172.21.15.114:0/3421071562 wait complete. 2024-09-16T07:31:29.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:29.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2727371907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a00afca0 msgr2=0x7fd5a00b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/2727371907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a00afca0 0x7fd5a00b00d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00cfb60 tx=0x7fd59801ccc0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2727371907 shutdown_connections 2024-09-16T07:31:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/2727371907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a00afca0 0x7fd5a00b00d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/2727371907 >> v2:172.21.15.149:3300/0 conn(0x7fd5a015f490 0x7fd5a00b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2727371907 >> 172.21.15.114:0/2727371907 conn(0x7fd5a00d1e30 msgr2=0x7fd5a00d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2727371907 shutdown_connections 2024-09-16T07:31:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.424+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2727371907 wait complete. 2024-09-16T07:31:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 Processor -- start 2024-09-16T07:31:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 -- start start 2024-09-16T07:31:29.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5a00afca0 0x7fd5a01fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a00b2e80 0x7fd5a006e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a015f490 0x7fd5a01f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a0168e00 con 0x7fd5a015f490 2024-09-16T07:31:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a0168c80 con 0x7fd5a00b2e80 2024-09-16T07:31:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a0168f80 con 0x7fd5a00afca0 2024-09-16T07:31:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a015f490 0x7fd5a01f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5a00afca0 0x7fd5a01fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd597400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a00b2e80 0x7fd5a006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a015f490 0x7fd5a01f8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33798/0 (socket says 172.21.15.114:33798) 2024-09-16T07:31:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 -- 172.21.15.114:0/3246986505 learned_addr learned my addr 172.21.15.114:0/3246986505 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:29.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 -- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5a00afca0 msgr2=0x7fd5a01fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5a00afca0 0x7fd5a01fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 -- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a00b2e80 msgr2=0x7fd5a006e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a00b2e80 0x7fd5a006e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 -- 172.21.15.114:0/3246986505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a01fb7e0 con 0x7fd5a015f490 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd597400640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a00b2e80 0x7fd5a006e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a4a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a015f490 0x7fd5a01f8220 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd59801b370 tx=0x7fd598003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd59cc00640 1 -- 172.21.15.114:0/3246986505 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980bb070 con 0x7fd5a015f490 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd59cc00640 1 -- 172.21.15.114:0/3246986505 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd598004e00 con 0x7fd5a015f490 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd59cc00640 1 -- 172.21.15.114:0/3246986505 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980b2040 con 0x7fd5a015f490 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a01fbac0 con 0x7fd5a015f490 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.428+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a01f7d00 con 0x7fd5a015f490 2024-09-16T07:31:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.432+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a01f7af0 con 0x7fd5a015f490 2024-09-16T07:31:29.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.432+0000 7fd59cc00640 1 -- 172.21.15.114:0/3246986505 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7fd5980ad810 con 0x7fd5a015f490 2024-09-16T07:31:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.432+0000 7fd59cc00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd57c073070 0x7fd57c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.432+0000 7fd59cc00640 1 -- 172.21.15.114:0/3246986505 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd59812dfc0 con 0x7fd5a015f490 2024-09-16T07:31:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.432+0000 7fd59fe00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd57c073070 0x7fd57c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:29.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.436+0000 7fd59fe00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd57c073070 0x7fd57c075530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd590004630 tx=0x7fd59000b2e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.436+0000 7fd59cc00640 1 -- 172.21.15.114:0/3246986505 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd598016970 con 0x7fd5a015f490 2024-09-16T07:31:29.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5a00b00d0 con 0x7fd5a015f490 2024-09-16T07:31:29.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd59cc00640 1 -- 172.21.15.114:0/3246986505 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5229 (secure 0 0 0) 0x7fd5980f88d0 con 0x7fd5a015f490 2024-09-16T07:31:29.638 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:29.638 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":36,"btime":"2024-09-16T07:31:22:800560+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/204209379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":204209379},{"type":"v1","addr":"172.21.15.149:6836","nonce":204209379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1846247659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1846247659},{"type":"v1","addr":"172.21.15.149:6837","nonce":1846247659}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/350567716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":350567716},{"type":"v1","addr":"172.21.15.114:6833","nonce":350567716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:31:19.162681+0000","modified":"2024-09-16T07:31:22.188961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1633021756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1633021756},{"type":"v1","addr":"172.21.15.114:6835","nonce":1633021756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5769,"qdb_cluster":[5769]},"id":4}]} 2024-09-16T07:31:29.638 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 36 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd57c073070 msgr2=0x7fd57c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd57c073070 0x7fd57c075530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd590004630 tx=0x7fd59000b2e0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a015f490 msgr2=0x7fd5a01f8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a015f490 0x7fd5a01f8220 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd59801b370 tx=0x7fd598003f60 comp rx=0 tx=0).stop 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 shutdown_connections 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fd57c073070 0x7fd57c075530 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5a015f490 0x7fd5a01f8220 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a00b2e80 0x7fd5a006e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/3246986505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5a00afca0 0x7fd5a01fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 >> 172.21.15.114:0/3246986505 conn(0x7fd5a00d1e30 msgr2=0x7fd5a0158780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:29.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 shutdown_connections 2024-09-16T07:31:29.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:29.640+0000 7fd5a6a00640 1 -- 172.21.15.114:0/3246986505 wait complete. 2024-09-16T07:31:30.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:31:19.162681+0000', 'modified': '2024-09-16T07:31:22.188961+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5769}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5769': {'gid': 5769, 'name': 'c', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/1633021756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 1633021756}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 1633021756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5769, 'qdb_cluster': [5769]} 2024-09-16T07:31:30.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:31:30.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T07:31:30.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- 172.21.15.114:0/1563168849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415bfa0 msgr2=0x7f11440cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 --2- 172.21.15.114:0/1563168849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415bfa0 0x7f11440cd000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f11440708b0 tx=0x7f113001f0b0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- 172.21.15.114:0/1563168849 shutdown_connections 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 --2- 172.21.15.114:0/1563168849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415bfa0 0x7f11440cd000 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 --2- 172.21.15.114:0/1563168849 >> v2:172.21.15.149:3300/0 conn(0x7f11440cd540 0x7f114415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 --2- 172.21.15.114:0/1563168849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f114415c3e0 0x7f114415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- 172.21.15.114:0/1563168849 >> 172.21.15.114:0/1563168849 conn(0x7f11440b18f0 msgr2=0x7f11440b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- 172.21.15.114:0/1563168849 shutdown_connections 2024-09-16T07:31:30.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- 172.21.15.114:0/1563168849 wait complete. 2024-09-16T07:31:30.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 Processor -- start 2024-09-16T07:31:30.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- start start 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11440cd540 0x7f11441547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f114415bfa0 0x7f11440b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415c3e0 0x7f11440b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f11441601e0 con 0x7f114415c3e0 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1144160060 con 0x7f11440cd540 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.212+0000 7f114be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1144160360 con 0x7f114415bfa0 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415c3e0 0x7f11440b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415c3e0 0x7f11440b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33804/0 (socket says 172.21.15.114:33804) 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 -- 172.21.15.114:0/2085238965 learned_addr learned my addr 172.21.15.114:0/2085238965 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149400640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11440cd540 0x7f11441547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1148a00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f114415bfa0 0x7f11440b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 -- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f114415bfa0 msgr2=0x7f11440b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f114415bfa0 0x7f11440b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 -- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11440cd540 msgr2=0x7f11441547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11440cd540 0x7f11441547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 -- 172.21.15.114:0/2085238965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11440c9bd0 con 0x7f114415c3e0 2024-09-16T07:31:30.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1149e00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415c3e0 0x7f11440b3720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f113c00eab0 tx=0x7f113c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1141600640 1 -- 172.21.15.114:0/2085238965 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c00ce40 con 0x7f114415c3e0 2024-09-16T07:31:30.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1141600640 1 -- 172.21.15.114:0/2085238965 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f113c004b30 con 0x7f114415c3e0 2024-09-16T07:31:30.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11440c9eb0 con 0x7f114415c3e0 2024-09-16T07:31:30.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f1141600640 1 -- 172.21.15.114:0/2085238965 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c005020 con 0x7f114415c3e0 2024-09-16T07:31:30.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.216+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11440ca470 con 0x7f114415c3e0 2024-09-16T07:31:30.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1141600640 1 -- 172.21.15.114:0/2085238965 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f113c0051c0 con 0x7f114415c3e0 2024-09-16T07:31:30.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 Processor -- start 2024-09-16T07:31:30.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1141600640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1124073070 0x7f1124075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 -- start start 2024-09-16T07:31:30.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1141600640 1 -- 172.21.15.114:0/2085238965 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f113c094da0 con 0x7f114415c3e0 2024-09-16T07:31:30.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1148a00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1124073070 0x7f1124075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fc9d0 0x55c2303fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c2303b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303b0e10 0x55c2303b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55c2302d13f0 con 0x55c2303fc9d0 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c23020eb20 con 0x55c2303b0e10 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55c2301fdf50 con 0x55c2303fd2f0 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1148a00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1124073070 0x7f1124075530 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f11300b2000 tx=0x7f113001d8f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1148a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c2303b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303b0e10 0x55c2303b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fc9d0 0x55c2303fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303b0e10 0x55c2303b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:57882/0 (socket says 172.21.15.114:57882) 2024-09-16T07:31:30.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 -- 172.21.15.114:0/506095084 learned_addr learned my addr 172.21.15.114:0/506095084 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 -- 172.21.15.114:0/506095084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 msgr2=0x55c2303b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 --2- 172.21.15.114:0/506095084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c2303b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 -- 172.21.15.114:0/506095084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fc9d0 msgr2=0x55c2303fcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 --2- 172.21.15.114:0/506095084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fc9d0 0x55c2303fcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 -- 172.21.15.114:0/506095084 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2301c5590 con 0x55c2303b0e10 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1149e00640 1 --2- 172.21.15.114:0/506095084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303b0e10 0x55c2303b11f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f113c05f310 tx=0x7f113c05ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c759c01a8d4dfe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1136000640 1 -- 172.21.15.114:0/506095084 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c064040 con 0x55c2303b0e10 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1136000640 1 -- 172.21.15.114:0/506095084 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f113c068ef0 con 0x55c2303b0e10 2024-09-16T07:31:30.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f1136000640 1 -- 172.21.15.114:0/506095084 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c068a60 con 0x55c2303b0e10 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 -- 172.21.15.114:0/506095084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303b0e10 msgr2=0x55c2303b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 --2- 172.21.15.114:0/506095084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303b0e10 0x55c2303b11f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f113c05f310 tx=0x7f113c05ed80 comp rx=0 tx=0).stop 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 -- 172.21.15.114:0/506095084 shutdown_connections 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 --2- 172.21.15.114:0/506095084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303b0e10 0x55c2303b11f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 --2- 172.21.15.114:0/506095084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c2303b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 --2- 172.21.15.114:0/506095084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fc9d0 0x55c2303fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.220+0000 7f114f1b2000 1 -- 172.21.15.114:0/506095084 >> 172.21.15.114:0/506095084 conn(0x55c23029a130 msgr2=0x55c2303dfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- 172.21.15.114:0/506095084 shutdown_connections 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- 172.21.15.114:0/506095084 wait complete. 2024-09-16T07:31:30.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- start start 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 Processor -- start 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303b0e10 0x55c2303b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c2303b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fd2f0 0x55c2303b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55c2301985d0 con 0x55c2303fd2f0 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c230201d60 con 0x55c2303fc9d0 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55c2301a4500 con 0x55c2303b0e10 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 10 client.0 _ll_register_callbacks cb 0x55c2301a8810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fd2f0 0x55c2303b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1148a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c2303b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303b0e10 0x55c2303b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fd2f0 0x55c2303b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33808/0 (socket says 172.21.15.114:33808) 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 -- 172.21.15.114:0/492022431 learned_addr learned my addr 172.21.15.114:0/492022431 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1148a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c2303b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:57888/0 (socket says 172.21.15.114:57888) 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 -- 172.21.15.114:0/492022431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303b0e10 msgr2=0x55c2303b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303b0e10 0x55c2303b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 -- 172.21.15.114:0/492022431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 msgr2=0x55c2303b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c2303b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 -- 172.21.15.114:0/492022431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c23019c170 con 0x55c2303fd2f0 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149e00640 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fd2f0 0x55c2303b2cc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f113c05f310 tx=0x7f113c068cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0b674f912b428d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f112aa00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f112aa00640 1 -- 172.21.15.114:0/492022431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c092f50 con 0x55c2303fd2f0 2024-09-16T07:31:30.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f112aa00640 1 -- 172.21.15.114:0/492022431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f113c05af60 con 0x55c2303fd2f0 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2301960f0 con 0x55c2303fd2f0 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f112aa00640 1 -- 172.21.15.114:0/492022431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f113c064040 con 0x55c2303fd2f0 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 10 client.5928 fetch_fsmap learned FSMap version 36 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55c230282ef0 con 0x55c2303fd2f0 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f112aa00640 1 -- 172.21.15.114:0/492022431 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c2301960f0 con 0x55c2303fd2f0 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f112aa00640 1 -- 172.21.15.114:0/492022431 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f113c066220 con 0x55c2303fd2f0 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 10 client.5928 fetch_fsmap finished waiting for FSMap version 36 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 10 client.5928 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 20 client.5928 populate_metadata read hostname 'smithi114' 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23040bc70 0x55c23040e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 4 client.5928 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:31:30.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 --> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c230210a70 con 0x55c23040bc70 2024-09-16T07:31:30.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.224+0000 7f1149400640 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23040bc70 0x55c23040e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f1149400640 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23040bc70 0x55c23040e060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae97d386292cb26 server_cookie=558a6f899118f896 in_seq=0 out_seq=0 2024-09-16T07:31:30.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f112aa00640 10 client.5928 ms_handle_connect on v2:172.21.15.114:6834/1633021756 2024-09-16T07:31:30.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f112aa00640 1 -- 172.21.15.114:0/492022431 <== mds.0 v2:172.21.15.114:6834/1633021756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c230210a70 con 0x55c23040bc70 2024-09-16T07:31:30.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f112aa00640 10 client.5928 handle_command_reply: tid=0 2024-09-16T07:31:30.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 client.5928 shutdown 2024-09-16T07:31:30.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fd2f0 msgr2=0x55c2303b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fd2f0 0x55c2303b2cc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f113c05f310 tx=0x7f113c068cf0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 shutdown_connections 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23040bc70 0x55c23040e060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303fd2f0 0x55c2303b2cc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c2303b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 --2- 172.21.15.114:0/492022431 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303b0e10 0x55c2303b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f112aa00640 0 client.5928 ms_handle_reset on v2:172.21.15.114:6834/1633021756 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 >> 172.21.15.114:0/492022431 conn(0x55c23029a130 msgr2=0x55c2303affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 shutdown_connections 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 1 -- 172.21.15.114:0/492022431 wait complete. 2024-09-16T07:31:30.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.228+0000 7f114f1b2000 20 client.5928 trim_cache size 0 max 16384 2024-09-16T07:31:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 Processor -- start 2024-09-16T07:31:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- start start 2024-09-16T07:31:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c23046e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23046eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23046f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f11441578b0 con 0x55c2303b0e10 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c2301c9ec0 con 0x55c2303fc9d0 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55c2301985d0 con 0x55c2303fd2f0 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c23046e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c23046e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33810/0 (socket says 172.21.15.114:33810) 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 -- 172.21.15.114:0/1508587100 learned_addr learned my addr 172.21.15.114:0/1508587100 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149e00640 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23046f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1148a00640 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23046eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 -- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 msgr2=0x55c23046f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23046f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 -- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 msgr2=0x55c23046eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23046eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 -- 172.21.15.114:0/1508587100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c230259d90 con 0x55c2303b0e10 2024-09-16T07:31:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149e00640 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23046f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1149400640 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c23046e5d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55c2301a3af0 tx=0x7f11380091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcb2b9a140b0a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1135600640 1 -- 172.21.15.114:0/1508587100 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138004310 con 0x55c2303b0e10 2024-09-16T07:31:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1135600640 1 -- 172.21.15.114:0/1508587100 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11380044d0 con 0x55c2303b0e10 2024-09-16T07:31:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f1135600640 1 -- 172.21.15.114:0/1508587100 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138003840 con 0x55c2303b0e10 2024-09-16T07:31:30.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- 172.21.15.114:0/1508587100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 msgr2=0x55c23046e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c23046e5d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55c2301a3af0 tx=0x7f11380091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- 172.21.15.114:0/1508587100 shutdown_connections 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23046f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23046eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 --2- 172.21.15.114:0/1508587100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c23046e5d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- 172.21.15.114:0/1508587100 >> 172.21.15.114:0/1508587100 conn(0x55c23029a130 msgr2=0x55c2303b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- 172.21.15.114:0/1508587100 shutdown_connections 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- 172.21.15.114:0/1508587100 wait complete. 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 -- start start 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.248+0000 7f114f1b2000 1 Processor -- start 2024-09-16T07:31:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c230412c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23042e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23042eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55c230282a60 con 0x55c2303b0e10 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c230201d60 con 0x55c2303fc9d0 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55c230201070 con 0x55c2303fd2f0 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 10 client.0 _ll_register_callbacks cb 0x7f11380096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c230412c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c230412c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33818/0 (socket says 172.21.15.114:33818) 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 -- 172.21.15.114:0/378593430 learned_addr learned my addr 172.21.15.114:0/378593430 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1148a00640 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23042e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149e00640 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23042eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 -- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 msgr2=0x55c23042eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23042eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 -- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 msgr2=0x55c23042e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23042e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 -- 172.21.15.114:0/378593430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2301c4a90 con 0x55c2303b0e10 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1149400640 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c230412c50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55c2302cfc60 tx=0x7f1138004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfe87e2d71dd594 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 1 -- 172.21.15.114:0/378593430 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138033060 con 0x55c2303b0e10 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 1 -- 172.21.15.114:0/378593430 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1138003600 con 0x55c2303b0e10 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c23020c520 con 0x55c2303b0e10 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 1 -- 172.21.15.114:0/378593430 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1138039050 con 0x55c2303b0e10 2024-09-16T07:31:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 10 client.5934 fetch_fsmap learned FSMap version 36 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55c2301a3050 con 0x55c2303b0e10 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 1 -- 172.21.15.114:0/378593430 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c23020c520 con 0x55c2303b0e10 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 1 -- 172.21.15.114:0/378593430 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f113803c020 con 0x55c2303b0e10 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 10 client.5934 fetch_fsmap finished waiting for FSMap version 36 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 10 client.5934 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 20 client.5934 populate_metadata read hostname 'smithi114' 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23042f000 0x55c23047a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 4 client.5934 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 --> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] -- command(tid 0: {"prefix": "status"}) -- 0x55c230209950 con 0x55c23042f000 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1148a00640 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23042f000 0x55c23047a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f1148a00640 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23042f000 0x55c23047a650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50ff035d68712b35 server_cookie=d2a55a508106b554 in_seq=0 out_seq=0 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 10 client.5934 ms_handle_connect on v2:172.21.15.114:6834/1633021756 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 1 -- 172.21.15.114:0/378593430 <== mds.0 v2:172.21.15.114:6834/1633021756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c230209950 con 0x55c23042f000 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 10 client.5934 handle_command_reply: tid=0 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 client.5934 shutdown 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 msgr2=0x55c230412c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c230412c50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x55c2302cfc60 tx=0x7f1138004200 comp rx=0 tx=0).stop 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 shutdown_connections 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:6834/1633021756,v1:172.21.15.114:6835/1633021756] conn(0x55c23042f000 0x55c23047a650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55c2303fd2f0 0x55c23042eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c2303fc9d0 0x55c23042e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 --2- 172.21.15.114:0/378593430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2303b0e10 0x55c230412c50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f112aa00640 0 client.5934 ms_handle_reset on v2:172.21.15.114:6834/1633021756 2024-09-16T07:31:30.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.252+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 >> 172.21.15.114:0/378593430 conn(0x55c23029a130 msgr2=0x55c23040e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 shutdown_connections 2024-09-16T07:31:30.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114f1b2000 1 -- 172.21.15.114:0/378593430 wait complete. 2024-09-16T07:31:30.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114f1b2000 20 client.5934 trim_cache size 0 max 16384 2024-09-16T07:31:30.258 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5769, 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.459705022, 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 36, 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 57, 2024-09-16T07:31:30.259 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 57, 2024-09-16T07:31:30.260 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 14.989059085999999 2024-09-16T07:31:30.260 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:31:30.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1124073070 msgr2=0x7f1124075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1124073070 0x7f1124075530 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f11300b2000 tx=0x7f113001d8f0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415c3e0 msgr2=0x7f11440b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415c3e0 0x7f11440b3720 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f113c00eab0 tx=0x7f113c00ef70 comp rx=0 tx=0).stop 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 shutdown_connections 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1124073070 0x7f1124075530 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f114415c3e0 0x7f11440b3720 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f114415bfa0 0x7f11440b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 --2- 172.21.15.114:0/2085238965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11440cd540 0x7f11441547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 >> 172.21.15.114:0/2085238965 conn(0x7f11440b18f0 msgr2=0x7f11440b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 shutdown_connections 2024-09-16T07:31:30.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.256+0000 7f114be00640 1 -- 172.21.15.114:0/2085238965 wait complete. 2024-09-16T07:31:30.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- 172.21.15.114:0/2982473301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f6015be80 msgr2=0x7f2f600ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 --2- 172.21.15.114:0/2982473301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f6015be80 0x7f2f600ce4e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009900 tx=0x7f2f5001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- 172.21.15.114:0/2982473301 shutdown_connections 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 --2- 172.21.15.114:0/2982473301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f600d28c0 0x7f2f600cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 --2- 172.21.15.114:0/2982473301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f6015be80 0x7f2f600ce4e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- 172.21.15.114:0/2982473301 >> 172.21.15.114:0/2982473301 conn(0x7f2f600d1da0 msgr2=0x7f2f600d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- 172.21.15.114:0/2982473301 shutdown_connections 2024-09-16T07:31:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- 172.21.15.114:0/2982473301 wait complete. 2024-09-16T07:31:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 Processor -- start 2024-09-16T07:31:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- start start 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f600b53f0 0x7f2f60070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600d28c0 0x7f2f60150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f6015be80 0x7f2f60150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60169160 con 0x7f2f600d28c0 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60168fe0 con 0x7f2f6015be80 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f65e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f601692e0 con 0x7f2f600b53f0 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f56000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600d28c0 0x7f2f60150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f56000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600d28c0 0x7f2f60150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33830/0 (socket says 172.21.15.114:33830) 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f56000640 1 -- 172.21.15.114:0/538915446 learned_addr learned my addr 172.21.15.114:0/538915446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f5ea00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f600b53f0 0x7f2f60070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f5f400640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f6015be80 0x7f2f60150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f56000640 1 -- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f600b53f0 msgr2=0x7f2f60070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.416+0000 7f2f56000640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f600b53f0 0x7f2f60070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f56000640 1 -- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f6015be80 msgr2=0x7f2f60150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f56000640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f6015be80 0x7f2f60150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f56000640 1 -- 172.21.15.114:0/538915446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f60158990 con 0x7f2f600d28c0 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f5f400640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f6015be80 0x7f2f60150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f56000640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600d28c0 0x7f2f60150dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800e9f0 tx=0x7f2f4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f57e00640 1 -- 172.21.15.114:0/538915446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800cd80 con 0x7f2f600d28c0 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f57e00640 1 -- 172.21.15.114:0/538915446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f48010430 con 0x7f2f600d28c0 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f57e00640 1 -- 172.21.15.114:0/538915446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48010860 con 0x7f2f600d28c0 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f60158c70 con 0x7f2f600d28c0 2024-09-16T07:31:30.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f60159230 con 0x7f2f600d28c0 2024-09-16T07:31:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f600b5860 con 0x7f2f600d28c0 2024-09-16T07:31:30.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f57e00640 1 -- 172.21.15.114:0/538915446 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f2f48010a00 con 0x7f2f600d28c0 2024-09-16T07:31:30.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f57e00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f3c073070 0x7f2f3c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:30.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f57e00640 1 -- 172.21.15.114:0/538915446 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2f48094dc0 con 0x7f2f600d28c0 2024-09-16T07:31:30.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.420+0000 7f2f5ea00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f3c073070 0x7f2f3c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:30.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.424+0000 7f2f5ea00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f3c073070 0x7f2f3c075530 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f500af000 tx=0x7f2f5001b120 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:30.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.424+0000 7f2f57e00640 1 -- 172.21.15.114:0/538915446 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2f4805f650 con 0x7f2f600d28c0 2024-09-16T07:31:30.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.628+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2f60076410 con 0x7f2f600d28c0 2024-09-16T07:31:30.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f57e00640 1 -- 172.21.15.114:0/538915446 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f2f48064080 con 0x7f2f600d28c0 2024-09-16T07:31:30.629 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:31:30.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f3c073070 msgr2=0x7f2f3c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f3c073070 0x7f2f3c075530 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f500af000 tx=0x7f2f5001b120 comp rx=0 tx=0).stop 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600d28c0 msgr2=0x7f2f60150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600d28c0 0x7f2f60150dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800e9f0 tx=0x7f2f4800eeb0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 shutdown_connections 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f3c073070 0x7f2f3c075530 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f6015be80 0x7f2f60150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f600d28c0 0x7f2f60150dd0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 --2- 172.21.15.114:0/538915446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f600b53f0 0x7f2f60070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:30.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 >> 172.21.15.114:0/538915446 conn(0x7f2f600d1da0 msgr2=0x7f2f6006f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:30.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 shutdown_connections 2024-09-16T07:31:30.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30.632+0000 7f2f65e00640 1 -- 172.21.15.114:0/538915446 wait complete. 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:31:30.650 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:31:30.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:30.651 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:31:30.660 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:31:30.660 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:31:30.660 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:31:30.660 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.660 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:31:30.661 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.661 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:31:30.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:30.661 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:31:30.661 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:31:30.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:30.661 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42250sec preferred_lft 42250sec 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.662 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:31:30.663 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:30.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:30.664 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:31:30.725 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:31:30.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:30.727 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:31:30.783 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:31:30.783 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:31:30.784 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:31:30.785 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:31:30.785 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:31:30.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:31:30.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:31:30.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:31:30.785 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:31:30.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:31:30.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:31:30.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:30.917 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:31:30.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:31:30.925 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:31:30.926 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:31:30.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:30.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:31:30.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:31:30.987 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:31:31.036 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:31:31.036 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:31:31.036 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:31:31.087 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:31:31.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:31.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:31:31.175 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:31:31.175 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:31:31.176 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:31:31.190 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:31:31.190 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:31:31.191 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:31:31.191 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:31:31.191 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:31:31.200 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:31:31.201 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:31:31.201 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:31:31.201 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:31:31.201 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:31:31.201 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:31:31.201 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:31:31.201 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:31:31.205 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:31:31.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:31.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:31:31.267 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:31:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:31:31.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:31:31.369 INFO:teuthology.orchestra.run.smithi114.stdout:client5728 2024-09-16T07:31:31.370 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:31.370 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:31.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:31:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- 172.21.15.114:0/1266910930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c15d3d0 msgr2=0x7f3b7c06cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 --2- 172.21.15.114:0/1266910930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c15d3d0 0x7f3b7c06cc20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009840 tx=0x7f3b6c01d250 comp rx=0 tx=0).stop 2024-09-16T07:31:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- 172.21.15.114:0/1266910930 shutdown_connections 2024-09-16T07:31:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 --2- 172.21.15.114:0/1266910930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c15d3d0 0x7f3b7c06cc20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- 172.21.15.114:0/1266910930 >> 172.21.15.114:0/1266910930 conn(0x7f3b7c06dd30 msgr2=0x7f3b7c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- 172.21.15.114:0/1266910930 shutdown_connections 2024-09-16T07:31:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- 172.21.15.114:0/1266910930 wait complete. 2024-09-16T07:31:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 Processor -- start 2024-09-16T07:31:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- start start 2024-09-16T07:31:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b7c06d160 0x7f3b7c14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c1563e0 0x7f3b7c147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b7c15d3d0 0x7f3b7c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c169db0 con 0x7f3b7c1563e0 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c169c30 con 0x7f3b7c15d3d0 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.568+0000 7f3b84800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c169f30 con 0x7f3b7c06d160 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c1563e0 0x7f3b7c147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c1563e0 0x7f3b7c147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33844/0 (socket says 172.21.15.114:33844) 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 -- 172.21.15.114:0/4174382974 learned_addr learned my addr 172.21.15.114:0/4174382974 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81e00640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b7c06d160 0x7f3b7c14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b82800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b7c15d3d0 0x7f3b7c14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 -- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b7c06d160 msgr2=0x7f3b7c14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b7c06d160 0x7f3b7c14c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 -- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b7c15d3d0 msgr2=0x7f3b7c14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b7c15d3d0 0x7f3b7c14b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 -- 172.21.15.114:0/4174382974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c148850 con 0x7f3b7c1563e0 2024-09-16T07:31:31.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b82800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b7c15d3d0 0x7f3b7c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b81400640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c1563e0 0x7f3b7c147e70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009790 tx=0x7f3b6c005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b76000640 1 -- 172.21.15.114:0/4174382974 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0b2040 con 0x7f3b7c1563e0 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b76000640 1 -- 172.21.15.114:0/4174382974 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b6c004330 con 0x7f3b7c1563e0 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b76000640 1 -- 172.21.15.114:0/4174382974 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c003800 con 0x7f3b7c1563e0 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c148570 con 0x7f3b7c1563e0 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c14fe30 con 0x7f3b7c1563e0 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7c06cc20 con 0x7f3b7c1563e0 2024-09-16T07:31:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.572+0000 7f3b76000640 1 -- 172.21.15.114:0/4174382974 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f3b6c0bd060 con 0x7f3b7c1563e0 2024-09-16T07:31:31.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.576+0000 7f3b76000640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b60073070 0x7f3b60075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:31.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.576+0000 7f3b76000640 1 -- 172.21.15.114:0/4174382974 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f3b6c12db30 con 0x7f3b7c1563e0 2024-09-16T07:31:31.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.576+0000 7f3b81e00640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b60073070 0x7f3b60075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:31.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.576+0000 7f3b81e00640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b60073070 0x7f3b60075530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b70007fd0 tx=0x7f3b70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:31.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.576+0000 7f3b76000640 1 -- 172.21.15.114:0/4174382974 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3b6c016410 con 0x7f3b7c1563e0 2024-09-16T07:31:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3b7c152a60 con 0x7f3b7c1563e0 2024-09-16T07:31:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b76000640 1 -- 172.21.15.114:0/4174382974 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f3b6c0f89d0 con 0x7f3b7c1563e0 2024-09-16T07:31:31.782 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b60073070 msgr2=0x7f3b60075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b60073070 0x7f3b60075530 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3b70007fd0 tx=0x7f3b70009040 comp rx=0 tx=0).stop 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c1563e0 msgr2=0x7f3b7c147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c1563e0 0x7f3b7c147e70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009790 tx=0x7f3b6c005ca0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 shutdown_connections 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3b60073070 0x7f3b60075530 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b7c15d3d0 0x7f3b7c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b7c1563e0 0x7f3b7c147e70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 --2- 172.21.15.114:0/4174382974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b7c06d160 0x7f3b7c14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 >> 172.21.15.114:0/4174382974 conn(0x7f3b7c06dd30 msgr2=0x7f3b7c15d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:31.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 shutdown_connections 2024-09-16T07:31:31.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:31.784+0000 7f3b84800640 1 -- 172.21.15.114:0/4174382974 wait complete. 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:31:31.803 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:31:31.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:31.804 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:31:31.815 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:31:31.815 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:31.816 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42258sec preferred_lft 42258sec 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:31:31.817 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:31:31.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:31.819 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:31:31.875 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:31:31.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:31.878 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:31:31.932 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:31:31.932 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:31:31.932 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:31:31.932 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:31:31.933 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:31:31.933 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:31:31.933 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:31:31.933 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:31:31.933 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:31:31.933 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:31:31.933 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:31:31.933 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:31:31.934 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:31:31.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:31:31.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:31:31.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:31:31.934 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:31:32.027 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:31:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:31:32.070 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:31:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:31:32.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:32.077 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:31:32.086 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:31:32.086 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:31:32.087 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:31:32.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:32.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:31:32.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:31:32.152 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:31:32.204 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:31:32.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:31:32.204 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:31:32.255 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:31:32.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:32.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:31:32.348 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:31:32.348 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:31:32.348 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:31:32.363 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:31:32.364 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:31:32.364 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:31:32.364 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:31:32.364 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:31:32.373 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:31:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:31:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:31:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:31:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:31:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:31:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:31:32.374 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:31:32.378 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:31:32.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:32.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:31:32.397 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:31:32.490 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:31:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:31:32.493 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:31:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:31:32.499 INFO:teuthology.orchestra.run.smithi149.stdout:client5737 2024-09-16T07:31:32.500 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:32.500 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:32.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 -- 172.21.15.114:0/2997380657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600cea60 msgr2=0x7f446006eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 --2- 172.21.15.114:0/2997380657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600cea60 0x7f446006eb40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4458009c80 tx=0x7f445801cce0 comp rx=0 tx=0).stop 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 -- 172.21.15.114:0/2997380657 shutdown_connections 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 --2- 172.21.15.114:0/2997380657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600cea60 0x7f446006eb40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 --2- 172.21.15.114:0/2997380657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44600734f0 0x7f446015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 -- 172.21.15.114:0/2997380657 >> 172.21.15.114:0/2997380657 conn(0x7f44600cfbc0 msgr2=0x7f44600cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 -- 172.21.15.114:0/2997380657 shutdown_connections 2024-09-16T07:31:32.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 -- 172.21.15.114:0/2997380657 wait complete. 2024-09-16T07:31:32.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 Processor -- start 2024-09-16T07:31:32.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.704+0000 7f4467400640 1 -- start start 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600734f0 0x7f4460149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44600cea60 0x7f44600cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44600cf440 0x7f44600cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f446006fbe0 con 0x7f44600734f0 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f446006fa60 con 0x7f44600cf440 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f446006fd60 con 0x7f44600cea60 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600734f0 0x7f4460149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600734f0 0x7f4460149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33874/0 (socket says 172.21.15.114:33874) 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 -- 172.21.15.114:0/61853553 learned_addr learned my addr 172.21.15.114:0/61853553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:32.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4457e00640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44600cea60 0x7f44600cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4465400640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44600cf440 0x7f44600cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 -- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44600cea60 msgr2=0x7f44600cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44600cea60 0x7f44600cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 -- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44600cf440 msgr2=0x7f44600cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44600cf440 0x7f44600cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 -- 172.21.15.114:0/61853553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44600aeb90 con 0x7f44600734f0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4464a00640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600734f0 0x7f4460149cb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f44500058d0 tx=0x7f445000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f445d600640 1 -- 172.21.15.114:0/61853553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445001b070 con 0x7f44600734f0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f445d600640 1 -- 172.21.15.114:0/61853553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f445000ae50 con 0x7f44600734f0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f445d600640 1 -- 172.21.15.114:0/61853553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445000e9c0 con 0x7f44600734f0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44600b3f70 con 0x7f44600734f0 2024-09-16T07:31:32.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44600b4530 con 0x7f44600734f0 2024-09-16T07:31:32.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4460069410 con 0x7f44600734f0 2024-09-16T07:31:32.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.708+0000 7f445d600640 1 -- 172.21.15.114:0/61853553 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f445001e070 con 0x7f44600734f0 2024-09-16T07:31:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.712+0000 7f445d600640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f443c073070 0x7f443c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.712+0000 7f445d600640 1 -- 172.21.15.114:0/61853553 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4450094550 con 0x7f44600734f0 2024-09-16T07:31:32.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.712+0000 7f4457e00640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f443c073070 0x7f443c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:32.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.712+0000 7f4457e00640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f443c073070 0x7f443c075530 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f44600ae400 tx=0x7f4448009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:32.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.716+0000 7f445d600640 1 -- 172.21.15.114:0/61853553 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f445000de60 con 0x7f44600734f0 2024-09-16T07:31:32.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:32.916+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f44600b3d60 con 0x7f44600734f0 2024-09-16T07:31:33.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f445d600640 1 -- 172.21.15.114:0/61853553 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v37) ==== 136+0+0 (secure 0 0 0) 0x7f445005edd0 con 0x7f44600734f0 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f443c073070 msgr2=0x7f443c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f443c073070 0x7f443c075530 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f44600ae400 tx=0x7f4448009040 comp rx=0 tx=0).stop 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600734f0 msgr2=0x7f4460149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600734f0 0x7f4460149cb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f44500058d0 tx=0x7f445000a620 comp rx=0 tx=0).stop 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 shutdown_connections 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f443c073070 0x7f443c075530 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44600cf440 0x7f44600cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44600cea60 0x7f44600cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 --2- 172.21.15.114:0/61853553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44600734f0 0x7f4460149cb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 >> 172.21.15.114:0/61853553 conn(0x7f44600cfbc0 msgr2=0x7f44600cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 shutdown_connections 2024-09-16T07:31:33.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.115+0000 7f4467400640 1 -- 172.21.15.114:0/61853553 wait complete. 2024-09-16T07:31:33.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:31:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 -- 172.21.15.114:0/1493351045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 msgr2=0x7f99640ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 --2- 172.21.15.114:0/1493351045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 0x7f99640ccdf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f995c009c80 tx=0x7f995c01cda0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 -- 172.21.15.114:0/1493351045 shutdown_connections 2024-09-16T07:31:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 --2- 172.21.15.114:0/1493351045 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 0x7f99640ccdf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 --2- 172.21.15.114:0/1493351045 >> v2:172.21.15.149:3300/0 conn(0x7f99640cebf0 0x7f99640cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 -- 172.21.15.114:0/1493351045 >> 172.21.15.114:0/1493351045 conn(0x7f99640d1da0 msgr2=0x7f99640d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 -- 172.21.15.114:0/1493351045 shutdown_connections 2024-09-16T07:31:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 -- 172.21.15.114:0/1493351045 wait complete. 2024-09-16T07:31:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 Processor -- start 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.279+0000 7f996b200640 1 -- start start 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 0x7f9964154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640cebf0 0x7f99640c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996415be80 0x7f99641faf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99641692b0 con 0x7f99640cebf0 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9964169130 con 0x7f996415be80 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9964169430 con 0x7f99640b6400 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640cebf0 0x7f99640c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640cebf0 0x7f99640c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33882/0 (socket says 172.21.15.114:33882) 2024-09-16T07:31:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 -- 172.21.15.114:0/3714047100 learned_addr learned my addr 172.21.15.114:0/3714047100 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963e00640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 0x7f9964154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9969200640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996415be80 0x7f99641faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 -- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 msgr2=0x7f9964154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 0x7f9964154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 -- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996415be80 msgr2=0x7f99641faf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996415be80 0x7f99641faf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 -- 172.21.15.114:0/3714047100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9964152800 con 0x7f99640cebf0 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f9963400640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640cebf0 0x7f99640c4af0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f995000e9f0 tx=0x7f995000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f995be00640 1 -- 172.21.15.114:0/3714047100 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995000cd80 con 0x7f99640cebf0 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f995be00640 1 -- 172.21.15.114:0/3714047100 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9950010430 con 0x7f99640cebf0 2024-09-16T07:31:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f995be00640 1 -- 172.21.15.114:0/3714047100 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950010860 con 0x7f99640cebf0 2024-09-16T07:31:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9964154800 con 0x7f99640cebf0 2024-09-16T07:31:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99641fbce0 con 0x7f99640cebf0 2024-09-16T07:31:33.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.283+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99640ce4e0 con 0x7f99640cebf0 2024-09-16T07:31:33.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.287+0000 7f995be00640 1 -- 172.21.15.114:0/3714047100 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f9950010a00 con 0x7f99640cebf0 2024-09-16T07:31:33.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.287+0000 7f995be00640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f99440730a0 0x7f9944075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.287+0000 7f995be00640 1 -- 172.21.15.114:0/3714047100 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f9950094ce0 con 0x7f99640cebf0 2024-09-16T07:31:33.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.287+0000 7f9963e00640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f99440730a0 0x7f9944075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.287+0000 7f9963e00640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f99440730a0 0x7f9944075560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f99640d22f0 tx=0x7f9954009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:33.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.291+0000 7f995be00640 1 -- 172.21.15.114:0/3714047100 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f995005f6b0 con 0x7f99640cebf0 2024-09-16T07:31:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.483+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f99640d2320 con 0x7f99440730a0 2024-09-16T07:31:33.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.483+0000 7f995be00640 1 -- 172.21.15.114:0/3714047100 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f99640d2320 con 0x7f99440730a0 2024-09-16T07:31:33.483 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:31:33.483 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:33.483 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:31:33.483 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:33.483 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:31:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f99440730a0 msgr2=0x7f9944075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f99440730a0 0x7f9944075560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f99640d22f0 tx=0x7f9954009040 comp rx=0 tx=0).stop 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640cebf0 msgr2=0x7f99640c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640cebf0 0x7f99640c4af0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f995000e9f0 tx=0x7f995000eeb0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 shutdown_connections 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f99440730a0 0x7f9944075560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f996415be80 0x7f99641faf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99640cebf0 0x7f99640c4af0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 --2- 172.21.15.114:0/3714047100 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99640b6400 0x7f9964154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 >> 172.21.15.114:0/3714047100 conn(0x7f99640d1da0 msgr2=0x7f996415a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 shutdown_connections 2024-09-16T07:31:33.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.487+0000 7f996b200640 1 -- 172.21.15.114:0/3714047100 wait complete. 2024-09-16T07:31:33.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:31:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.651+0000 7f8c87200640 1 -- 172.21.15.114:0/459198010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 msgr2=0x7f8c880d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.651+0000 7f8c87200640 1 --2- 172.21.15.114:0/459198010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c880d0240 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009840 tx=0x7f8c7801c820 comp rx=0 tx=0).stop 2024-09-16T07:31:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.651+0000 7f8c87200640 1 -- 172.21.15.114:0/459198010 shutdown_connections 2024-09-16T07:31:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.651+0000 7f8c87200640 1 --2- 172.21.15.114:0/459198010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c880d0240 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.651+0000 7f8c87200640 1 -- 172.21.15.114:0/459198010 >> 172.21.15.114:0/459198010 conn(0x7f8c8809aa10 msgr2=0x7f8c8809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.651+0000 7f8c87200640 1 -- 172.21.15.114:0/459198010 shutdown_connections 2024-09-16T07:31:33.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.651+0000 7f8c87200640 1 -- 172.21.15.114:0/459198010 wait complete. 2024-09-16T07:31:33.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 Processor -- start 2024-09-16T07:31:33.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 -- start start 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c880b0d10 0x7f8c881faea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c880d22c0 0x7f8c881f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c88153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88169e20 con 0x7f8c8815bd40 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88169ca0 con 0x7f8c880d22c0 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c88169fa0 con 0x7f8c880b0d10 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c88153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c88153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33904/0 (socket says 172.21.15.114:33904) 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 -- 172.21.15.114:0/1179031816 learned_addr learned my addr 172.21.15.114:0/1179031816 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c85e00640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c880b0d10 0x7f8c881faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c85400640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c880d22c0 0x7f8c881f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 -- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c880b0d10 msgr2=0x7f8c881faea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c880b0d10 0x7f8c881faea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 -- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c880d22c0 msgr2=0x7f8c881f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c880d22c0 0x7f8c881f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 -- 172.21.15.114:0/1179031816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c881fbe00 con 0x7f8c8815bd40 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c85e00640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c880b0d10 0x7f8c881faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c86800640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c88153290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c7f0 tx=0x7f8c8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c7e000640 1 -- 172.21.15.114:0/1179031816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80003b80 con 0x7f8c8815bd40 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c7e000640 1 -- 172.21.15.114:0/1179031816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c80003d20 con 0x7f8c8815bd40 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c7e000640 1 -- 172.21.15.114:0/1179031816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000aab0 con 0x7f8c8815bd40 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c881fb560 con 0x7f8c8815bd40 2024-09-16T07:31:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.655+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c881fbb20 con 0x7f8c8815bd40 2024-09-16T07:31:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.659+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c880cc220 con 0x7f8c8815bd40 2024-09-16T07:31:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.659+0000 7f8c7e000640 1 -- 172.21.15.114:0/1179031816 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f8c8000ac50 con 0x7f8c8815bd40 2024-09-16T07:31:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.659+0000 7f8c7e000640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c680730a0 0x7f8c68075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.659+0000 7f8c7e000640 1 -- 172.21.15.114:0/1179031816 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8c80094120 con 0x7f8c8815bd40 2024-09-16T07:31:33.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.659+0000 7f8c85e00640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c680730a0 0x7f8c68075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:33.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.659+0000 7f8c85e00640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c680730a0 0x7f8c68075560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8c780af000 tx=0x7f8c7801b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.663+0000 7f8c7e000640 1 -- 172.21.15.114:0/1179031816 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8c8005ef40 con 0x7f8c8815bd40 2024-09-16T07:31:33.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.831+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8c880cded0 con 0x7f8c8815bd40 2024-09-16T07:31:33.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.831+0000 7f8c7e000640 1 -- 172.21.15.114:0/1179031816 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f8c8005e840 con 0x7f8c8815bd40 2024-09-16T07:31:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c680730a0 msgr2=0x7f8c68075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c680730a0 0x7f8c68075560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8c780af000 tx=0x7f8c7801b060 comp rx=0 tx=0).stop 2024-09-16T07:31:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 msgr2=0x7f8c88153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c88153290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c7f0 tx=0x7f8c8000ccb0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 shutdown_connections 2024-09-16T07:31:33.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8c680730a0 0x7f8c68075560 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c8815bd40 0x7f8c88153290 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c880d22c0 0x7f8c881f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 --2- 172.21.15.114:0/1179031816 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c880b0d10 0x7f8c881faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 >> 172.21.15.114:0/1179031816 conn(0x7f8c8809aa10 msgr2=0x7f8c880af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 shutdown_connections 2024-09-16T07:31:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:33.835+0000 7f8c87200640 1 -- 172.21.15.114:0/1179031816 wait complete. 2024-09-16T07:31:33.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:33.855 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol2800) 2024-09-16T07:31:33.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:33.883 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:31:33.937 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:31:33.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:33.938 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/_nogroup/subvol2800) 2024-09-16T07:31:34.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol97961 2024-09-16T07:31:34.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.191+0000 7f76f5200640 1 -- 172.21.15.114:0/3136769738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00b1650 msgr2=0x7f76f00b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:34.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.191+0000 7f76f5200640 1 --2- 172.21.15.114:0/3136769738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00b1650 0x7f76f00b1a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009840 tx=0x7f76dc01c820 comp rx=0 tx=0).stop 2024-09-16T07:31:34.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.191+0000 7f76f5200640 1 -- 172.21.15.114:0/3136769738 shutdown_connections 2024-09-16T07:31:34.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.191+0000 7f76f5200640 1 --2- 172.21.15.114:0/3136769738 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00b1650 0x7f76f00b1a30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:34.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.191+0000 7f76f5200640 1 -- 172.21.15.114:0/3136769738 >> 172.21.15.114:0/3136769738 conn(0x7f76f00d1dd0 msgr2=0x7f76f00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:34.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.191+0000 7f76f5200640 1 -- 172.21.15.114:0/3136769738 shutdown_connections 2024-09-16T07:31:34.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.191+0000 7f76f5200640 1 -- 172.21.15.114:0/3136769738 wait complete. 2024-09-16T07:31:34.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 Processor -- start 2024-09-16T07:31:34.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 -- start start 2024-09-16T07:31:34.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00afb10 0x7f76f015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76f00b1650 0x7f76f01674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76f01605d0 0x7f76f01fb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00b13a0 con 0x7f76f00afb10 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00b1220 con 0x7f76f01605d0 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76f016a550 con 0x7f76f00b1650 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00afb10 0x7f76f015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00afb10 0x7f76f015bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42988/0 (socket says 172.21.15.114:42988) 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 -- 172.21.15.114:0/2623068422 learned_addr learned my addr 172.21.15.114:0/2623068422 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 -- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76f00b1650 msgr2=0x7f76f01674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ed400640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76f00b1650 0x7f76f01674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76f00b1650 0x7f76f01674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:34.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 -- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76f01605d0 msgr2=0x7f76f01fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ee800640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76f01605d0 0x7f76f01fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76f01605d0 0x7f76f01fb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 -- 172.21.15.114:0/2623068422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f015c4a0 con 0x7f76f00afb10 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ed400640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76f00b1650 0x7f76f01674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ee800640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76f01605d0 0x7f76f01fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76ede00640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00afb10 0x7f76f015bf60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c3c0 tx=0x7f76e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76e6000640 1 -- 172.21.15.114:0/2623068422 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0017070 con 0x7f76f00afb10 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76e6000640 1 -- 172.21.15.114:0/2623068422 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76e00053c0 con 0x7f76f00afb10 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76e6000640 1 -- 172.21.15.114:0/2623068422 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0003860 con 0x7f76f00afb10 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f01545d0 con 0x7f76f00afb10 2024-09-16T07:31:34.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f00ce090 con 0x7f76f00afb10 2024-09-16T07:31:34.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.195+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f00d0690 con 0x7f76f00afb10 2024-09-16T07:31:34.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.199+0000 7f76e6000640 1 -- 172.21.15.114:0/2623068422 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 9) ==== 97233+0+0 (secure 0 0 0) 0x7f76e001a070 con 0x7f76f00afb10 2024-09-16T07:31:34.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.199+0000 7f76e6000640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d0073070 0x7f76d0075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:34.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.199+0000 7f76e6000640 1 -- 172.21.15.114:0/2623068422 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f76e0093510 con 0x7f76f00afb10 2024-09-16T07:31:34.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.199+0000 7f76ed400640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d0073070 0x7f76d0075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:34.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.199+0000 7f76ed400640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d0073070 0x7f76d0075530 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0af000 tx=0x7f76dc01b060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:34.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.203+0000 7f76e6000640 1 -- 172.21.15.114:0/2623068422 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f76e005e3c0 con 0x7f76f00afb10 2024-09-16T07:31:34.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.395+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol97961", "target": ["mon-mgr", ""]}) -- 0x7f76f00d1080 con 0x7f76d0073070 2024-09-16T07:31:34.400 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:34.396+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:34.400 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:34.396+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:34.400 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:34.396+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:34.400 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:34.396+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:34.400 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:34.396+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.443+0000 7f76e6000640 1 -- 172.21.15.114:0/2623068422 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f76f00d1080 con 0x7f76d0073070 2024-09-16T07:31:34.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d0073070 msgr2=0x7f76d0075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d0073070 0x7f76d0075530 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0af000 tx=0x7f76dc01b060 comp rx=0 tx=0).stop 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00afb10 msgr2=0x7f76f015bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00afb10 0x7f76f015bf60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c3c0 tx=0x7f76e000c880 comp rx=0 tx=0).stop 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 shutdown_connections 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f76d0073070 0x7f76d0075530 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76f01605d0 0x7f76f01fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76f00b1650 0x7f76f01674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 --2- 172.21.15.114:0/2623068422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76f00afb10 0x7f76f015bf60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 >> 172.21.15.114:0/2623068422 conn(0x7f76f00d1dd0 msgr2=0x7f76f015caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 shutdown_connections 2024-09-16T07:31:34.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:34.447+0000 7f76f5200640 1 -- 172.21.15.114:0/2623068422 wait complete. 2024-09-16T07:31:34.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:34.463 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp ./volumes/_nogroup/subvol97961/.meta ./volumes/_nogroup/subvol2800) 2024-09-16T07:31:35.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol2800 2024-09-16T07:31:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 -- 172.21.15.114:0/3057797433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c15af90 msgr2=0x7f184c15f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 --2- 172.21.15.114:0/3057797433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c15af90 0x7f184c15f4e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f183c009840 tx=0x7f183c01c7f0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 -- 172.21.15.114:0/3057797433 shutdown_connections 2024-09-16T07:31:35.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 --2- 172.21.15.114:0/3057797433 >> v2:172.21.15.149:3300/0 conn(0x7f184c0b3300 0x7f184c0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 --2- 172.21.15.114:0/3057797433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c15af90 0x7f184c15f4e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 -- 172.21.15.114:0/3057797433 >> 172.21.15.114:0/3057797433 conn(0x7f184c0b18f0 msgr2=0x7f184c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 -- 172.21.15.114:0/3057797433 shutdown_connections 2024-09-16T07:31:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.423+0000 7f1852a00640 1 -- 172.21.15.114:0/3057797433 wait complete. 2024-09-16T07:31:35.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 Processor -- start 2024-09-16T07:31:35.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 -- start start 2024-09-16T07:31:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c0b3300 0x7f184c15e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f184c0cd0d0 0x7f184c1f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f184c15af90 0x7f184c13cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f184c167d50 con 0x7f184c15af90 2024-09-16T07:31:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f184c06f6a0 con 0x7f184c0cd0d0 2024-09-16T07:31:35.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f184c167ed0 con 0x7f184c0b3300 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c0b3300 0x7f184c15e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c0b3300 0x7f184c15e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:56184/0 (socket says 172.21.15.114:56184) 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 -- 172.21.15.114:0/182521079 learned_addr learned my addr 172.21.15.114:0/182521079 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1843400640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f184c0cd0d0 0x7f184c1f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1850a00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f184c15af90 0x7f184c13cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 -- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f184c0cd0d0 msgr2=0x7f184c1f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f184c0cd0d0 0x7f184c1f9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 -- 172.21.15.114:0/182521079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f184c15af90 msgr2=0x7f184c13cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f184c15af90 0x7f184c13cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 -- 172.21.15.114:0/182521079 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c15eb80 con 0x7f184c0b3300 2024-09-16T07:31:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f184be00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c0b3300 0x7f184c15e4a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f183c009790 tx=0x7f183c0a57a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1848c00640 1 -- 172.21.15.114:0/182521079 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c0b2040 con 0x7f184c0b3300 2024-09-16T07:31:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1848c00640 1 -- 172.21.15.114:0/182521079 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f183c005020 con 0x7f184c0b3300 2024-09-16T07:31:35.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184c15ee60 con 0x7f184c0b3300 2024-09-16T07:31:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1848c00640 1 -- 172.21.15.114:0/182521079 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c0044f0 con 0x7f184c0b3300 2024-09-16T07:31:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f184c15f420 con 0x7f184c0b3300 2024-09-16T07:31:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.427+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184c069410 con 0x7f184c0b3300 2024-09-16T07:31:35.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.431+0000 7f1848c00640 1 -- 172.21.15.114:0/182521079 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 10) ==== 97284+0+0 (secure 0 0 0) 0x7f183c005430 con 0x7f184c0b3300 2024-09-16T07:31:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.431+0000 7f1848c00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1828073100 0x7f18280755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.431+0000 7f1848c00640 1 -- 172.21.15.114:0/182521079 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f183c12dc90 con 0x7f184c0b3300 2024-09-16T07:31:35.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.431+0000 7f1843400640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1828073100 0x7f18280755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.431+0000 7f1843400640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1828073100 0x7f18280755c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f184c155eb0 tx=0x7f1834009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:35.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.435+0000 7f1848c00640 1 -- 172.21.15.114:0/182521079 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f183c0bc060 con 0x7f184c0b3300 2024-09-16T07:31:35.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.631+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol2800", "target": ["mon-mgr", ""]}) -- 0x7f184c0cebf0 con 0x7f1828073100 2024-09-16T07:31:35.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.667+0000 7f1848c00640 1 -- 172.21.15.114:0/182521079 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+29 (secure 0 0 0) 0x7f184c0cebf0 con 0x7f1828073100 2024-09-16T07:31:35.666 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol2800 2024-09-16T07:31:35.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1828073100 msgr2=0x7f18280755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1828073100 0x7f18280755c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f184c155eb0 tx=0x7f1834009040 comp rx=0 tx=0).stop 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c0b3300 msgr2=0x7f184c15e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c0b3300 0x7f184c15e4a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f183c009790 tx=0x7f183c0a57a0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 shutdown_connections 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1828073100 0x7f18280755c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f184c15af90 0x7f184c13cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f184c0cd0d0 0x7f184c1f9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 --2- 172.21.15.114:0/182521079 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f184c0b3300 0x7f184c15e4a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 >> 172.21.15.114:0/182521079 conn(0x7f184c0b18f0 msgr2=0x7f184c0cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 shutdown_connections 2024-09-16T07:31:35.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.671+0000 7f1852a00640 1 -- 172.21.15.114:0/182521079 wait complete. 2024-09-16T07:31:35.687 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol2800 2024-09-16T07:31:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.835+0000 7f85c2a00640 1 -- 172.21.15.114:0/185296280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 msgr2=0x7f85bc165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.835+0000 7f85c2a00640 1 --2- 172.21.15.114:0/185296280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc165950 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009bc0 tx=0x7f85b401cba0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.835+0000 7f85c2a00640 1 -- 172.21.15.114:0/185296280 shutdown_connections 2024-09-16T07:31:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.835+0000 7f85c2a00640 1 --2- 172.21.15.114:0/185296280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc165950 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.835+0000 7f85c2a00640 1 -- 172.21.15.114:0/185296280 >> 172.21.15.114:0/185296280 conn(0x7f85bc0b18f0 msgr2=0x7f85bc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- 172.21.15.114:0/185296280 shutdown_connections 2024-09-16T07:31:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- 172.21.15.114:0/185296280 wait complete. 2024-09-16T07:31:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 Processor -- start 2024-09-16T07:31:35.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- start start 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc0b4bd0 0x7f85bc14e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc15b580 0x7f85bc09c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc168b50 con 0x7f85bc0b3300 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1689d0 con 0x7f85bc15b580 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85bc168cd0 con 0x7f85bc0b4bd0 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43012/0 (socket says 172.21.15.114:43012) 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 -- 172.21.15.114:0/3854492364 learned_addr learned my addr 172.21.15.114:0/3854492364 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c0a00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc15b580 0x7f85bc09c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85b3400640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc0b4bd0 0x7f85bc14e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 -- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc0b4bd0 msgr2=0x7f85bc14e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc0b4bd0 0x7f85bc14e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 -- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc15b580 msgr2=0x7f85bc09c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc15b580 0x7f85bc09c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 -- 172.21.15.114:0/3854492364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc14e9e0 con 0x7f85bc0b3300 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85bbe00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc152fc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c430 tx=0x7f85ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85b8c00640 1 -- 172.21.15.114:0/3854492364 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac011790 con 0x7f85bc0b3300 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85b8c00640 1 -- 172.21.15.114:0/3854492364 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85ac017070 con 0x7f85bc0b3300 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85b8c00640 1 -- 172.21.15.114:0/3854492364 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac011ce0 con 0x7f85bc0b3300 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc14ecb0 con 0x7f85bc0b3300 2024-09-16T07:31:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.839+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc14f270 con 0x7f85bc0b3300 2024-09-16T07:31:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.843+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85bc0b2bf0 con 0x7f85bc0b3300 2024-09-16T07:31:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.843+0000 7f85b8c00640 1 -- 172.21.15.114:0/3854492364 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 10) ==== 97284+0+0 (secure 0 0 0) 0x7f85ac01c460 con 0x7f85bc0b3300 2024-09-16T07:31:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.843+0000 7f85b8c00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8598073100 0x7f85980755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.843+0000 7f85b8c00640 1 -- 172.21.15.114:0/3854492364 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f85ac093ed0 con 0x7f85bc0b3300 2024-09-16T07:31:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.843+0000 7f85b3400640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8598073100 0x7f85980755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.843+0000 7f85b3400640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8598073100 0x7f85980755c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f85bc153be0 tx=0x7f85a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:35.847+0000 7f85b8c00640 1 -- 172.21.15.114:0/3854492364 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f85ac05e7e0 con 0x7f85bc0b3300 2024-09-16T07:31:36.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.039+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol2800", "target": ["mon-mgr", ""]}) -- 0x7f85bc069b00 con 0x7f8598073100 2024-09-16T07:31:36.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85b8c00640 1 -- 172.21.15.114:0/3854492364 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+29 (secure 0 0 0) 0x7f85bc069b00 con 0x7f8598073100 2024-09-16T07:31:36.046 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol2800 2024-09-16T07:31:36.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8598073100 msgr2=0x7f85980755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:36.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8598073100 0x7f85980755c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f85bc153be0 tx=0x7f85a4009040 comp rx=0 tx=0).stop 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 msgr2=0x7f85bc152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc152fc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00c430 tx=0x7f85ac00c8f0 comp rx=0 tx=0).stop 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 shutdown_connections 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8598073100 0x7f85980755c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85bc15b580 0x7f85bc09c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f85bc0b4bd0 0x7f85bc14e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 --2- 172.21.15.114:0/3854492364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85bc0b3300 0x7f85bc152fc0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 >> 172.21.15.114:0/3854492364 conn(0x7f85bc0b18f0 msgr2=0x7f85bc15b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 shutdown_connections 2024-09-16T07:31:36.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:36.047+0000 7f85c2a00640 1 -- 172.21.15.114:0/3854492364 wait complete. 2024-09-16T07:31:36.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:36.067 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/8255955475eb92130fdefeaddd84902a.meta) 2024-09-16T07:31:40.273 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:31:40.273 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:31:40.274 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:31:40.274 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol2800 2024-09-16T07:31:40.274 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:31:40.274 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:40.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume authorize cephfs subvol2800 alice 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 -- 172.21.15.114:0/3639877518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d24d0 msgr2=0x7f2f140d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3639877518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d24d0 0x7f2f140d2980 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009c80 tx=0x7f2f0c01cd10 comp rx=0 tx=0).stop 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 -- 172.21.15.114:0/3639877518 shutdown_connections 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3639877518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d24d0 0x7f2f140d2980 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3639877518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f140d1ae0 0x7f2f140d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 -- 172.21.15.114:0/3639877518 >> 172.21.15.114:0/3639877518 conn(0x7f2f140d3f10 msgr2=0x7f2f140d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 -- 172.21.15.114:0/3639877518 shutdown_connections 2024-09-16T07:31:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 -- 172.21.15.114:0/3639877518 wait complete. 2024-09-16T07:31:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 Processor -- start 2024-09-16T07:31:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.435+0000 7f2f1a400640 1 -- start start 2024-09-16T07:31:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d1ae0 0x7f2f140ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f140d24d0 0x7f2f1414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f1415dff0 0x7f2f141fb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1416b030 con 0x7f2f140d1ae0 2024-09-16T07:31:40.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1416aeb0 con 0x7f2f1415dff0 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1416b1b0 con 0x7f2f140d24d0 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d1ae0 0x7f2f140ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d1ae0 0x7f2f140ca400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43028/0 (socket says 172.21.15.114:43028) 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 -- 172.21.15.114:0/3016716366 learned_addr learned my addr 172.21.15.114:0/3016716366 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f0be00640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f140d24d0 0x7f2f1414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19a00640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f1415dff0 0x7f2f141fb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 -- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f140d24d0 msgr2=0x7f2f1414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f140d24d0 0x7f2f1414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 -- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f1415dff0 msgr2=0x7f2f141fb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f1415dff0 0x7f2f141fb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 -- 172.21.15.114:0/3016716366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f140c84f0 con 0x7f2f140d1ae0 2024-09-16T07:31:40.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19a00640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f1415dff0 0x7f2f141fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f19000640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d1ae0 0x7f2f140ca400 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400b410 tx=0x7f2f0400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f11600640 1 -- 172.21.15.114:0/3016716366 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04015030 con 0x7f2f140d1ae0 2024-09-16T07:31:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f11600640 1 -- 172.21.15.114:0/3016716366 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f04004020 con 0x7f2f140d1ae0 2024-09-16T07:31:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f11600640 1 -- 172.21.15.114:0/3016716366 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f040044b0 con 0x7f2f140d1ae0 2024-09-16T07:31:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f140ca940 con 0x7f2f140d1ae0 2024-09-16T07:31:40.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f140c8760 con 0x7f2f140d1ae0 2024-09-16T07:31:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1415b2e0 con 0x7f2f140d1ae0 2024-09-16T07:31:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.439+0000 7f2f11600640 1 -- 172.21.15.114:0/3016716366 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 10) ==== 97284+0+0 (secure 0 0 0) 0x7f2f04018070 con 0x7f2f140d1ae0 2024-09-16T07:31:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.443+0000 7f2f11600640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ef0073130 0x7f2ef00755f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.443+0000 7f2f11600640 1 -- 172.21.15.114:0/3016716366 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2f04093f10 con 0x7f2f140d1ae0 2024-09-16T07:31:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.443+0000 7f2f0be00640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ef0073130 0x7f2ef00755f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.443+0000 7f2f0be00640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ef0073130 0x7f2ef00755f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0058d0 tx=0x7f2efc005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:40.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.447+0000 7f2f11600640 1 -- 172.21.15.114:0/3016716366 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2f0405ece0 con 0x7f2f140d1ae0 2024-09-16T07:31:40.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.635+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume authorize", "vol_name": "cephfs", "sub_name": "subvol2800", "auth_id": "alice", "target": ["mon-mgr", ""]}) -- 0x7f2f14069e60 con 0x7f2ef0073130 2024-09-16T07:31:40.647 INFO:tasks.ceph.mgr.x.smithi149.stderr:Creating meta for ID alice with tenant None 2024-09-16T07:31:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.683+0000 7f2f11600640 1 -- 172.21.15.114:0/3016716366 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2efc00fae0 con 0x7f2ef0073130 2024-09-16T07:31:40.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ef0073130 msgr2=0x7f2ef00755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ef0073130 0x7f2ef00755f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0058d0 tx=0x7f2efc005860 comp rx=0 tx=0).stop 2024-09-16T07:31:40.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d1ae0 msgr2=0x7f2f140ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d1ae0 0x7f2f140ca400 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400b410 tx=0x7f2f0400b8d0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 shutdown_connections 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2ef0073130 0x7f2ef00755f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f1415dff0 0x7f2f141fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f140d24d0 0x7f2f1414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 --2- 172.21.15.114:0/3016716366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f140d1ae0 0x7f2f140ca400 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 >> 172.21.15.114:0/3016716366 conn(0x7f2f140d3f10 msgr2=0x7f2f1406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 shutdown_connections 2024-09-16T07:31:40.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.687+0000 7f2f1a400640 1 -- 172.21.15.114:0/3016716366 wait complete. 2024-09-16T07:31:40.705 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.alice --format=json-pretty 2024-09-16T07:31:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 -- 172.21.15.114:0/2334159708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 msgr2=0x7f0ae4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 --2- 172.21.15.114:0/2334159708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 0x7f0ae4004c90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800c310 tx=0x7f0ae801cfc0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0affe00640 1 -- 172.21.15.114:0/2334159708 reap_dead start 2024-09-16T07:31:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 -- 172.21.15.114:0/2334159708 shutdown_connections 2024-09-16T07:31:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 -- 172.21.15.114:0/2334159708 >> 172.21.15.114:0/2334159708 conn(0x7f0b0009aa10 msgr2=0x7f0b0009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 -- 172.21.15.114:0/2334159708 shutdown_connections 2024-09-16T07:31:40.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 -- 172.21.15.114:0/2334159708 wait complete. 2024-09-16T07:31:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 Processor -- start 2024-09-16T07:31:40.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.851+0000 7f0b04a00640 1 -- start start 2024-09-16T07:31:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 0x7f0b001f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b00162870 0x7f0b000b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b00163580 0x7f0b000cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00166d30 con 0x7f0ae4004810 2024-09-16T07:31:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00166bb0 con 0x7f0b00163580 2024-09-16T07:31:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0b00166eb0 con 0x7f0b00162870 2024-09-16T07:31:40.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 0x7f0b001f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 0x7f0b001f7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43050/0 (socket says 172.21.15.114:43050) 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 -- 172.21.15.114:0/1469679280 learned_addr learned my addr 172.21.15.114:0/1469679280 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0affe00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b00163580 0x7f0b000cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0af6a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b00162870 0x7f0b000b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 -- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b00162870 msgr2=0x7f0b000b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b00162870 0x7f0b000b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 -- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b00163580 msgr2=0x7f0b000cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b00163580 0x7f0b000cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 -- 172.21.15.114:0/1469679280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000b5af0 con 0x7f0ae4004810 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0affe00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b00163580 0x7f0b000cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0af6a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b00162870 0x7f0b000b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0aff400640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 0x7f0b001f7ec0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0af0011ae0 tx=0x7f0af0009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:40.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0af7e00640 1 -- 172.21.15.114:0/1469679280 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af001e070 con 0x7f0ae4004810 2024-09-16T07:31:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0af7e00640 1 -- 172.21.15.114:0/1469679280 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0af0004460 con 0x7f0ae4004810 2024-09-16T07:31:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0af7e00640 1 -- 172.21.15.114:0/1469679280 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000fc40 con 0x7f0ae4004810 2024-09-16T07:31:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b001f84e0 con 0x7f0ae4004810 2024-09-16T07:31:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b001f8aa0 con 0x7f0ae4004810 2024-09-16T07:31:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.855+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b000b29e0 con 0x7f0ae4004810 2024-09-16T07:31:40.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.859+0000 7f0af7e00640 1 -- 172.21.15.114:0/1469679280 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 10) ==== 97284+0+0 (secure 0 0 0) 0x7f0af0021070 con 0x7f0ae4004810 2024-09-16T07:31:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.859+0000 7f0af7e00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0adc073100 0x7f0adc0755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.859+0000 7f0af7e00640 1 -- 172.21.15.114:0/1469679280 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f0af0094b70 con 0x7f0ae4004810 2024-09-16T07:31:40.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.859+0000 7f0af6a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0adc073100 0x7f0adc0755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:40.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.859+0000 7f0af6a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0adc073100 0x7f0adc0755c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ac000 tx=0x7f0ae8019e00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:40.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:40.863+0000 7f0af7e00640 1 -- 172.21.15.114:0/1469679280 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0af005f390 con 0x7f0ae4004810 2024-09-16T07:31:41.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.087+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"} v 0) -- 0x7f0b000ce770 con 0x7f0ae4004810 2024-09-16T07:31:41.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.087+0000 7f0af7e00640 1 -- 172.21.15.114:0/1469679280 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"}]=0 v18) ==== 107+0+279 (secure 0 0 0) 0x7f0af0063dc0 con 0x7f0ae4004810 2024-09-16T07:31:41.087 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:41.087 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:31:41.087 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:31:41.087 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.alice", 2024-09-16T07:31:41.087 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDc3udmMzejJxAAN3hR9csBBL2+8gqVQyNtfQ==", 2024-09-16T07:31:41.088 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:31:41.088 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol2800", 2024-09-16T07:31:41.088 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:31:41.088 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-16T07:31:41.088 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:41.088 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:31:41.088 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:31:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0adc073100 msgr2=0x7f0adc0755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0adc073100 0x7f0adc0755c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ac000 tx=0x7f0ae8019e00 comp rx=0 tx=0).stop 2024-09-16T07:31:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 msgr2=0x7f0b001f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 0x7f0b001f7ec0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0af0011ae0 tx=0x7f0af0009e50 comp rx=0 tx=0).stop 2024-09-16T07:31:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 shutdown_connections 2024-09-16T07:31:41.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f0adc073100 0x7f0adc0755c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0b00163580 0x7f0b000cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0b00162870 0x7f0b000b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 --2- 172.21.15.114:0/1469679280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ae4004810 0x7f0b001f7ec0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 >> 172.21.15.114:0/1469679280 conn(0x7f0b0009aa10 msgr2=0x7f0b000b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 shutdown_connections 2024-09-16T07:31:41.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.091+0000 7f0b04a00640 1 -- 172.21.15.114:0/1469679280 wait complete. 2024-09-16T07:31:41.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol2800 2024-09-16T07:31:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 -- 172.21.15.114:0/3342232177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71900cd100 msgr2=0x7f71900b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 --2- 172.21.15.114:0/3342232177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71900cd100 0x7f71900b42d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7190070d30 tx=0x7f717801c830 comp rx=0 tx=0).stop 2024-09-16T07:31:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 -- 172.21.15.114:0/3342232177 shutdown_connections 2024-09-16T07:31:41.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 --2- 172.21.15.114:0/3342232177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71900cd100 0x7f71900b42d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 --2- 172.21.15.114:0/3342232177 >> v2:172.21.15.149:3300/0 conn(0x7f71900b4810 0x7f71900ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 --2- 172.21.15.114:0/3342232177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f719015dae0 0x7f71900acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 -- 172.21.15.114:0/3342232177 >> 172.21.15.114:0/3342232177 conn(0x7f71900b18f0 msgr2=0x7f71900b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 -- 172.21.15.114:0/3342232177 shutdown_connections 2024-09-16T07:31:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.255+0000 7f7197600640 1 -- 172.21.15.114:0/3342232177 wait complete. 2024-09-16T07:31:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 Processor -- start 2024-09-16T07:31:41.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 -- start start 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71900b4810 0x7f719014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71900cd100 0x7f719014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719015dae0 0x7f71900af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71900cf440 con 0x7f719015dae0 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71900cf2c0 con 0x7f71900cd100 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f719006e7a0 con 0x7f71900b4810 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719015dae0 0x7f71900af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719015dae0 0x7f71900af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43072/0 (socket says 172.21.15.114:43072) 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 -- 172.21.15.114:0/3620391918 learned_addr learned my addr 172.21.15.114:0/3620391918 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7187e00640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71900cd100 0x7f719014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7194c00640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71900b4810 0x7f719014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 -- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71900b4810 msgr2=0x7f719014d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71900b4810 0x7f719014d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 -- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71900cd100 msgr2=0x7f719014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71900cd100 0x7f719014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 -- 172.21.15.114:0/3620391918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719014d7b0 con 0x7f719015dae0 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7194c00640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71900b4810 0x7f719014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7195600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719015dae0 0x7f71900af860 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f718800ddb0 tx=0x7f718800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f718d600640 1 -- 172.21.15.114:0/3620391918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188004d30 con 0x7f719015dae0 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f718d600640 1 -- 172.21.15.114:0/3620391918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f718800be40 con 0x7f719015dae0 2024-09-16T07:31:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f718d600640 1 -- 172.21.15.114:0/3620391918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718800e8c0 con 0x7f719015dae0 2024-09-16T07:31:41.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.259+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719014fce0 con 0x7f719015dae0 2024-09-16T07:31:41.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.263+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719014fa00 con 0x7f719015dae0 2024-09-16T07:31:41.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.263+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71900b42d0 con 0x7f719015dae0 2024-09-16T07:31:41.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.263+0000 7f718d600640 1 -- 172.21.15.114:0/3620391918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 10) ==== 97284+0+0 (secure 0 0 0) 0x7f718800ea60 con 0x7f719015dae0 2024-09-16T07:31:41.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.263+0000 7f718d600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f716c073100 0x7f716c0755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.263+0000 7f718d600640 1 -- 172.21.15.114:0/3620391918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f7188094ef0 con 0x7f719015dae0 2024-09-16T07:31:41.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.263+0000 7f7194c00640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f716c073100 0x7f716c0755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.263+0000 7f7194c00640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f716c073100 0x7f716c0755c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7180005fd0 tx=0x7f7180005d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.267+0000 7f718d600640 1 -- 172.21.15.114:0/3620391918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f718805fcc0 con 0x7f719015dae0 2024-09-16T07:31:41.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.459+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol2800", "target": ["mon-mgr", ""]}) -- 0x7f719009d6d0 con 0x7f716c073100 2024-09-16T07:31:41.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.487+0000 7f718d600640 1 -- 172.21.15.114:0/3620391918 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f719009d6d0 con 0x7f716c073100 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f716c073100 msgr2=0x7f716c0755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f716c073100 0x7f716c0755c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7180005fd0 tx=0x7f7180005d10 comp rx=0 tx=0).stop 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719015dae0 msgr2=0x7f71900af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719015dae0 0x7f71900af860 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f718800ddb0 tx=0x7f718800b730 comp rx=0 tx=0).stop 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 shutdown_connections 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f716c073100 0x7f716c0755c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719015dae0 0x7f71900af860 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71900cd100 0x7f719014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 --2- 172.21.15.114:0/3620391918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71900b4810 0x7f719014d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 >> 172.21.15.114:0/3620391918 conn(0x7f71900b18f0 msgr2=0x7f719015c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 shutdown_connections 2024-09-16T07:31:41.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.491+0000 7f7197600640 1 -- 172.21.15.114:0/3620391918 wait complete. 2024-09-16T07:31:41.492 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.491+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.492 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.491+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.492 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.491+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.493 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.491+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.493 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.491+0000 7f182c800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.510 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol97961 2024-09-16T07:31:41.511 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.507+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.511 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.507+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.511 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.507+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.511 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.507+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.511 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:31:41.507+0000 7f182d200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:31:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- 172.21.15.114:0/2595230846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b39e0 msgr2=0x7f446c0b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 --2- 172.21.15.114:0/2595230846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b39e0 0x7f446c0b2330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4464009bc0 tx=0x7f446401cba0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- 172.21.15.114:0/2595230846 shutdown_connections 2024-09-16T07:31:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 --2- 172.21.15.114:0/2595230846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b39e0 0x7f446c0b2330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 --2- 172.21.15.114:0/2595230846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f446c15f340 0x7f446c0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- 172.21.15.114:0/2595230846 >> 172.21.15.114:0/2595230846 conn(0x7f446c0d1e00 msgr2=0x7f446c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- 172.21.15.114:0/2595230846 shutdown_connections 2024-09-16T07:31:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- 172.21.15.114:0/2595230846 wait complete. 2024-09-16T07:31:41.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 Processor -- start 2024-09-16T07:31:41.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- start start 2024-09-16T07:31:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b2a00 0x7f446c1f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f446c0b39e0 0x7f446c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f446c15f340 0x7f446c0b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f446c168d60 con 0x7f446c15f340 2024-09-16T07:31:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f446c0ce1e0 con 0x7f446c0b2a00 2024-09-16T07:31:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4472c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f446c168ee0 con 0x7f446c0b39e0 2024-09-16T07:31:41.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4470c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f446c15f340 0x7f446c0b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4470c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f446c15f340 0x7f446c0b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43076/0 (socket says 172.21.15.114:43076) 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f446be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b2a00 0x7f446c1f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4470c00640 1 -- 172.21.15.114:0/634587213 learned_addr learned my addr 172.21.15.114:0/634587213 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.659+0000 7f4463e00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f446c0b39e0 0x7f446c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4470c00640 1 -- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f446c0b39e0 msgr2=0x7f446c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4470c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f446c0b39e0 0x7f446c0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4470c00640 1 -- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b2a00 msgr2=0x7f446c1f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4470c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b2a00 0x7f446c1f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4470c00640 1 -- 172.21.15.114:0/634587213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c0b5ca0 con 0x7f446c15f340 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f446be00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b2a00 0x7f446c1f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:31:41.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4470c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f446c15f340 0x7f446c0b7020 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f446401a7d0 tx=0x7f4464009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44640b2040 con 0x7f446c15f340 2024-09-16T07:31:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4464004d40 con 0x7f446c15f340 2024-09-16T07:31:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464004240 con 0x7f446c15f340 2024-09-16T07:31:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c0b5f80 con 0x7f446c15f340 2024-09-16T07:31:41.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c0b6540 con 0x7f446c15f340 2024-09-16T07:31:41.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c0b34a0 con 0x7f446c15f340 2024-09-16T07:31:41.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.663+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 10) ==== 97284+0+0 (secure 0 0 0) 0x7f44640be060 con 0x7f446c15f340 2024-09-16T07:31:41.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.667+0000 7f4468c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4448073100 0x7f44480755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:41.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.667+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f446412dec0 con 0x7f446c15f340 2024-09-16T07:31:41.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.667+0000 7f446be00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4448073100 0x7f44480755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:41.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.667+0000 7f446be00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4448073100 0x7f44480755c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f446c0718d0 tx=0x7f445c0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:41.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.671+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4464016790 con 0x7f446c15f340 2024-09-16T07:31:41.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:41.863+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol97961", "target": ["mon-mgr", ""]}) -- 0x7f446c0d18c0 con 0x7f4448073100 2024-09-16T07:31:43.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:43.683+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f44640a5d10 con 0x7f446c15f340 2024-09-16T07:31:45.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4468c00640 1 -- 172.21.15.114:0/634587213 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f446c0d18c0 con 0x7f4448073100 2024-09-16T07:31:45.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4448073100 msgr2=0x7f44480755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:45.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4448073100 0x7f44480755c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f446c0718d0 tx=0x7f445c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f446c15f340 msgr2=0x7f446c0b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:45.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f446c15f340 0x7f446c0b7020 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f446401a7d0 tx=0x7f4464009300 comp rx=0 tx=0).stop 2024-09-16T07:31:45.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 shutdown_connections 2024-09-16T07:31:45.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4448073100 0x7f44480755c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f446c15f340 0x7f446c0b7020 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f446c0b39e0 0x7f446c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 --2- 172.21.15.114:0/634587213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f446c0b2a00 0x7f446c1f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.287+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 >> 172.21.15.114:0/634587213 conn(0x7f446c0d1e00 msgr2=0x7f446c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:45.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.291+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 shutdown_connections 2024-09-16T07:31:45.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.291+0000 7f4472c00640 1 -- 172.21.15.114:0/634587213 wait complete. 2024-09-16T07:31:45.314 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T07:31:45.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:31:45.370 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-09-16T07:31:45.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:31:45.378 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:31:45.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:45.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:45.551 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:31:45.551 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:45.551 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:45.551 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:45.560 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:45.560 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:45.612 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:31:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 -- 172.21.15.114:0/1231322440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b80d0550 msgr2=0x7fc3b80cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 --2- 172.21.15.114:0/1231322440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b80d0550 0x7fc3b80cdb40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80b5bc0 tx=0x7fc3b001ccf0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 -- 172.21.15.114:0/1231322440 shutdown_connections 2024-09-16T07:31:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 --2- 172.21.15.114:0/1231322440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b80d0550 0x7fc3b80cdb40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 --2- 172.21.15.114:0/1231322440 >> v2:172.21.15.149:3300/0 conn(0x7fc3b8073ce0 0x7fc3b80cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 -- 172.21.15.114:0/1231322440 >> 172.21.15.114:0/1231322440 conn(0x7fc3b80cfa30 msgr2=0x7fc3b80cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:45.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 -- 172.21.15.114:0/1231322440 shutdown_connections 2024-09-16T07:31:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.803+0000 7fc3be000640 1 -- 172.21.15.114:0/1231322440 wait complete. 2024-09-16T07:31:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 Processor -- start 2024-09-16T07:31:45.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 -- start start 2024-09-16T07:31:45.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3b806ef70 0x7fc3b81f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:45.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b8073ce0 0x7fc3b8154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3b80d0550 0x7fc3b815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b80ce630 con 0x7fc3b8073ce0 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b80ce4b0 con 0x7fc3b80d0550 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b80ce7b0 con 0x7fc3b806ef70 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b8073ce0 0x7fc3b8154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b8073ce0 0x7fc3b8154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41704/0 (socket says 172.21.15.114:41704) 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 -- 172.21.15.114:0/1054336794 learned_addr learned my addr 172.21.15.114:0/1054336794 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 -- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3b806ef70 msgr2=0x7fc3b81f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3b806ef70 0x7fc3b81f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 -- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3b80d0550 msgr2=0x7fc3b815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3b80d0550 0x7fc3b815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 -- 172.21.15.114:0/1054336794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81f5db0 con 0x7fc3b8073ce0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3afe00640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b8073ce0 0x7fc3b8154e20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000ddc0 tx=0x7fc3a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3b5600640 1 -- 172.21.15.114:0/1054336794 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a001b070 con 0x7fc3b8073ce0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3b5600640 1 -- 172.21.15.114:0/1054336794 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3a000e740 con 0x7fc3b8073ce0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3b5600640 1 -- 172.21.15.114:0/1054336794 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000eb90 con 0x7fc3b8073ce0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b81f6090 con 0x7fc3b8073ce0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.807+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b8154620 con 0x7fc3b8073ce0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.811+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b806f350 con 0x7fc3b8073ce0 2024-09-16T07:31:45.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.811+0000 7fc3b5600640 1 -- 172.21.15.114:0/1054336794 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fc3a001e070 con 0x7fc3b8073ce0 2024-09-16T07:31:45.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.811+0000 7fc3b5600640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc394073220 0x7fc3940756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.811+0000 7fc3b5600640 1 -- 172.21.15.114:0/1054336794 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc3a00948c0 con 0x7fc3b8073ce0 2024-09-16T07:31:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.811+0000 7fc3bcc00640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc394073220 0x7fc3940756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:45.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.811+0000 7fc3bcc00640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc394073220 0x7fc3940756e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000f70 tx=0x7fc3a80079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:45.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.815+0000 7fc3b5600640 1 -- 172.21.15.114:0/1054336794 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc3a005eef0 con 0x7fc3b8073ce0 2024-09-16T07:31:45.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3b806add0 con 0x7fc3b8073ce0 2024-09-16T07:31:45.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3b5600640 1 -- 172.21.15.114:0/1054336794 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7fc3a0063920 con 0x7fc3b8073ce0 2024-09-16T07:31:45.993 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:31:45.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc394073220 msgr2=0x7fc3940756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:45.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc394073220 0x7fc3940756e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000f70 tx=0x7fc3a80079c0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b8073ce0 msgr2=0x7fc3b8154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b8073ce0 0x7fc3b8154e20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000ddc0 tx=0x7fc3a000a620 comp rx=0 tx=0).stop 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 shutdown_connections 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc394073220 0x7fc3940756e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3b80d0550 0x7fc3b815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3b8073ce0 0x7fc3b8154e20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 --2- 172.21.15.114:0/1054336794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3b806ef70 0x7fc3b81f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 >> 172.21.15.114:0/1054336794 conn(0x7fc3b80cfa30 msgr2=0x7fc3b814d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 shutdown_connections 2024-09-16T07:31:45.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:45.995+0000 7fc3be000640 1 -- 172.21.15.114:0/1054336794 wait complete. 2024-09-16T07:31:46.014 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:31:46.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:46.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:31:46.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:31:46.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:46.062 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:31:46.083 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:46.083 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:46.083 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:46.093 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:46.094 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:46.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:31:46.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.287+0000 7f2e62400640 1 -- 172.21.15.114:0/758510305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 msgr2=0x7f2e5c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.287+0000 7f2e62400640 1 --2- 172.21.15.114:0/758510305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 0x7f2e5c068c00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009bf0 tx=0x7f2e4c01cbe0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.287+0000 7f2e62400640 1 -- 172.21.15.114:0/758510305 shutdown_connections 2024-09-16T07:31:46.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.287+0000 7f2e62400640 1 --2- 172.21.15.114:0/758510305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 0x7f2e5c068c00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.287+0000 7f2e62400640 1 -- 172.21.15.114:0/758510305 >> 172.21.15.114:0/758510305 conn(0x7f2e5c0b2240 msgr2=0x7f2e5c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:46.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.287+0000 7f2e62400640 1 -- 172.21.15.114:0/758510305 shutdown_connections 2024-09-16T07:31:46.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.287+0000 7f2e62400640 1 -- 172.21.15.114:0/758510305 wait complete. 2024-09-16T07:31:46.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 Processor -- start 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 -- start start 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e5c0b4270 0x7f2e5c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e5c0d0af0 0x7f2e5c146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 0x7f2e5c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c16a6a0 con 0x7f2e5c0b4270 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c16a520 con 0x7f2e5c0d0af0 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5c16a820 con 0x7f2e5c15bde0 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e5c0b4270 0x7f2e5c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e5c0b4270 0x7f2e5c0ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41714/0 (socket says 172.21.15.114:41714) 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 -- 172.21.15.114:0/2380572969 learned_addr learned my addr 172.21.15.114:0/2380572969 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5be00640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 0x7f2e5c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5aa00640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e5c0d0af0 0x7f2e5c146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 -- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 msgr2=0x7f2e5c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 0x7f2e5c0ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 -- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e5c0d0af0 msgr2=0x7f2e5c146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e5c0d0af0 0x7f2e5c146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 -- 172.21.15.114:0/2380572969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c1fb9c0 con 0x7f2e5c0b4270 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e5b400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e5c0b4270 0x7f2e5c0ad880 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0197f0 tx=0x7f2e4c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e53400640 1 -- 172.21.15.114:0/2380572969 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0b2040 con 0x7f2e5c0b4270 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e53400640 1 -- 172.21.15.114:0/2380572969 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e4c004040 con 0x7f2e5c0b4270 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e53400640 1 -- 172.21.15.114:0/2380572969 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c004430 con 0x7f2e5c0b4270 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c1fbca0 con 0x7f2e5c0b4270 2024-09-16T07:31:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.291+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c1fc260 con 0x7f2e5c0b4270 2024-09-16T07:31:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.295+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c068c00 con 0x7f2e5c0b4270 2024-09-16T07:31:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.295+0000 7f2e53400640 1 -- 172.21.15.114:0/2380572969 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f2e4c0bd030 con 0x7f2e5c0b4270 2024-09-16T07:31:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.295+0000 7f2e53400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2e3c073220 0x7f2e3c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.295+0000 7f2e53400640 1 -- 172.21.15.114:0/2380572969 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2e4c12e230 con 0x7f2e5c0b4270 2024-09-16T07:31:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.295+0000 7f2e5aa00640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2e3c073220 0x7f2e3c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.295+0000 7f2e5aa00640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2e3c073220 0x7f2e3c0756e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007fd0 tx=0x7f2e48009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.299+0000 7f2e53400640 1 -- 172.21.15.114:0/2380572969 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2e4c0c4020 con 0x7f2e5c0b4270 2024-09-16T07:31:46.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2e5c151370 con 0x7f2e5c0b4270 2024-09-16T07:31:46.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e53400640 1 -- 172.21.15.114:0/2380572969 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f2e4c0167d0 con 0x7f2e5c0b4270 2024-09-16T07:31:46.477 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:31:46.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2e3c073220 msgr2=0x7f2e3c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2e3c073220 0x7f2e3c0756e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007fd0 tx=0x7f2e48009040 comp rx=0 tx=0).stop 2024-09-16T07:31:46.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e5c0b4270 msgr2=0x7f2e5c0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e5c0b4270 0x7f2e5c0ad880 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0197f0 tx=0x7f2e4c003f60 comp rx=0 tx=0).stop 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 shutdown_connections 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2e3c073220 0x7f2e3c0756e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e5c15bde0 0x7f2e5c0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e5c0d0af0 0x7f2e5c146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 --2- 172.21.15.114:0/2380572969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e5c0b4270 0x7f2e5c0ad880 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 >> 172.21.15.114:0/2380572969 conn(0x7f2e5c0b2240 msgr2=0x7f2e5c0b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 shutdown_connections 2024-09-16T07:31:46.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.479+0000 7f2e62400640 1 -- 172.21.15.114:0/2380572969 wait complete. 2024-09-16T07:31:46.498 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:31:46.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:46.499 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:31:46.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:31:46.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:31:46.526 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:31:46.580 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:46.581 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:46.581 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:46.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:31:46.589 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:31:46.589 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:46.590 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:46.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:31:46.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:46.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 -- 172.21.15.114:0/2956777178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb815f000 msgr2=0x7efcb80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 --2- 172.21.15.114:0/2956777178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb815f000 0x7efcb80d01b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efca8009840 tx=0x7efca801c790 comp rx=0 tx=0).stop 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 -- 172.21.15.114:0/2956777178 shutdown_connections 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 --2- 172.21.15.114:0/2956777178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb80cefb0 0x7efcb80cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 --2- 172.21.15.114:0/2956777178 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb815f000 0x7efcb80d01b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 -- 172.21.15.114:0/2956777178 >> 172.21.15.114:0/2956777178 conn(0x7efcb809aa10 msgr2=0x7efcb809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 -- 172.21.15.114:0/2956777178 shutdown_connections 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 -- 172.21.15.114:0/2956777178 wait complete. 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 Processor -- start 2024-09-16T07:31:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.775+0000 7efcb7200640 1 -- start start 2024-09-16T07:31:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb80ccaf0 0x7efcb81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb80cefb0 0x7efcb81f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb815f000 0x7efcb81f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efcb8169240 con 0x7efcb80ccaf0 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efcb81690c0 con 0x7efcb80cefb0 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efcb81693c0 con 0x7efcb815f000 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb80ccaf0 0x7efcb81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb80ccaf0 0x7efcb81544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41726/0 (socket says 172.21.15.114:41726) 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 -- 172.21.15.114:0/422557209 learned_addr learned my addr 172.21.15.114:0/422557209 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb6800640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb815f000 0x7efcb81f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5400640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb80cefb0 0x7efcb81f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 -- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb815f000 msgr2=0x7efcb81f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb815f000 0x7efcb81f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 -- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb80cefb0 msgr2=0x7efcb81f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb80cefb0 0x7efcb81f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 -- 172.21.15.114:0/422557209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb81f68e0 con 0x7efcb80ccaf0 2024-09-16T07:31:46.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb5e00640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb80ccaf0 0x7efcb81544a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efca801cc70 tx=0x7efca80a6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:46.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcae000640 1 -- 172.21.15.114:0/422557209 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca80ac070 con 0x7efcb80ccaf0 2024-09-16T07:31:46.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcae000640 1 -- 172.21.15.114:0/422557209 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efca8005130 con 0x7efcb80ccaf0 2024-09-16T07:31:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcae000640 1 -- 172.21.15.114:0/422557209 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca8005540 con 0x7efcb80ccaf0 2024-09-16T07:31:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb81f9960 con 0x7efcb80ccaf0 2024-09-16T07:31:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb81f5ba0 con 0x7efcb80ccaf0 2024-09-16T07:31:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.779+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb80cc5b0 con 0x7efcb80ccaf0 2024-09-16T07:31:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.783+0000 7efcae000640 1 -- 172.21.15.114:0/422557209 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7efca80af070 con 0x7efcb80ccaf0 2024-09-16T07:31:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.783+0000 7efcae000640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc98073220 0x7efc980756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.783+0000 7efcae000640 1 -- 172.21.15.114:0/422557209 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7efca812e240 con 0x7efcb80ccaf0 2024-09-16T07:31:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.783+0000 7efcb5400640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc98073220 0x7efc980756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.783+0000 7efcb5400640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc98073220 0x7efc980756e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efca4009600 tx=0x7efca40091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:46.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.787+0000 7efcae000640 1 -- 172.21.15.114:0/422557209 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efca80c1030 con 0x7efcb80ccaf0 2024-09-16T07:31:46.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcb81f9e10 con 0x7efcb80ccaf0 2024-09-16T07:31:46.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcae000640 1 -- 172.21.15.114:0/422557209 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5229 (secure 0 0 0) 0x7efca8016410 con 0x7efcb80ccaf0 2024-09-16T07:31:46.989 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:46.989 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"btime":"2024-09-16T07:31:33:111265+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/204209379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":204209379},{"type":"v1","addr":"172.21.15.149:6836","nonce":204209379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1846247659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1846247659},{"type":"v1","addr":"172.21.15.149:6837","nonce":1846247659}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/350567716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":350567716},{"type":"v1","addr":"172.21.15.114:6833","nonce":350567716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:31:19.162681+0000","modified":"2024-09-16T07:31:22.188961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1633021756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1633021756},{"type":"v1","addr":"172.21.15.114:6835","nonce":1633021756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5769,"qdb_cluster":[5769]},"id":4}]} 2024-09-16T07:31:46.990 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-09-16T07:31:46.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc98073220 msgr2=0x7efc980756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc98073220 0x7efc980756e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efca4009600 tx=0x7efca40091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb80ccaf0 msgr2=0x7efcb81544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:46.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb80ccaf0 0x7efcb81544a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efca801cc70 tx=0x7efca80a6f90 comp rx=0 tx=0).stop 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 shutdown_connections 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc98073220 0x7efc980756e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efcb815f000 0x7efcb81f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efcb80cefb0 0x7efcb81f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 --2- 172.21.15.114:0/422557209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efcb80ccaf0 0x7efcb81544a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 >> 172.21.15.114:0/422557209 conn(0x7efcb809aa10 msgr2=0x7efcb80ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 shutdown_connections 2024-09-16T07:31:46.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:46.991+0000 7efcb7200640 1 -- 172.21.15.114:0/422557209 wait complete. 2024-09-16T07:31:47.011 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:47.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- 172.21.15.114:0/729337627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e400afca0 msgr2=0x7f3e400b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 --2- 172.21.15.114:0/729337627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e400afca0 0x7f3e400b0110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009840 tx=0x7f3e3801c760 comp rx=0 tx=0).stop 2024-09-16T07:31:47.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- 172.21.15.114:0/729337627 shutdown_connections 2024-09-16T07:31:47.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 --2- 172.21.15.114:0/729337627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e400afca0 0x7f3e400b0110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 --2- 172.21.15.114:0/729337627 >> v2:172.21.15.149:3300/0 conn(0x7f3e400b2e80 0x7f3e400b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- 172.21.15.114:0/729337627 >> 172.21.15.114:0/729337627 conn(0x7f3e400d1e30 msgr2=0x7f3e400d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:47.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- 172.21.15.114:0/729337627 shutdown_connections 2024-09-16T07:31:47.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- 172.21.15.114:0/729337627 wait complete. 2024-09-16T07:31:47.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 Processor -- start 2024-09-16T07:31:47.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- start start 2024-09-16T07:31:47.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e400afca0 0x7f3e40166430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400b2e80 0x7f3e401576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e4015f490 0x7f3e40157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3e40168e00 con 0x7f3e400afca0 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3e40168c80 con 0x7f3e400b2e80 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.155+0000 7f3e45800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3e40168f80 con 0x7f3e4015f490 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e400afca0 0x7f3e40166430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400b2e80 0x7f3e401576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e400afca0 0x7f3e40166430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41732/0 (socket says 172.21.15.114:41732) 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e4015f490 0x7f3e40157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 -- 172.21.15.114:0/272913649 learned_addr learned my addr 172.21.15.114:0/272913649 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 -- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e4015f490 msgr2=0x7f3e40157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e4015f490 0x7f3e40157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 -- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400b2e80 msgr2=0x7f3e401576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400b2e80 0x7f3e401576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 -- 172.21.15.114:0/272913649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e400b6110 con 0x7f3e400afca0 2024-09-16T07:31:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e3ea00640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e400afca0 0x7f3e40166430 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cb40 tx=0x7f3e3000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e36a00640 1 -- 172.21.15.114:0/272913649 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30016020 con 0x7f3e400afca0 2024-09-16T07:31:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e36a00640 1 -- 172.21.15.114:0/272913649 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e3000ab60 con 0x7f3e400afca0 2024-09-16T07:31:47.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e400b63f0 con 0x7f3e400afca0 2024-09-16T07:31:47.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e36a00640 1 -- 172.21.15.114:0/272913649 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30012420 con 0x7f3e400afca0 2024-09-16T07:31:47.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e400b69b0 con 0x7f3e400afca0 2024-09-16T07:31:47.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e400b0110 con 0x7f3e400afca0 2024-09-16T07:31:47.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.159+0000 7f3e36a00640 1 -- 172.21.15.114:0/272913649 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f3e30019020 con 0x7f3e400afca0 2024-09-16T07:31:47.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.163+0000 7f3e36a00640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3e20073220 0x7f3e200756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.163+0000 7f3e36a00640 1 -- 172.21.15.114:0/272913649 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f3e300945e0 con 0x7f3e400afca0 2024-09-16T07:31:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.163+0000 7f3e3e000640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3e20073220 0x7f3e200756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.163+0000 7f3e3e000640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3e20073220 0x7f3e200756e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3e400cd410 tx=0x7f3e2c0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:47.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.167+0000 7f3e36a00640 1 -- 172.21.15.114:0/272913649 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3e30020020 con 0x7f3e400afca0 2024-09-16T07:31:47.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e40159220 con 0x7f3e400afca0 2024-09-16T07:31:47.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e36a00640 1 -- 172.21.15.114:0/272913649 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5229 (secure 0 0 0) 0x7f3e3005ecc0 con 0x7f3e400afca0 2024-09-16T07:31:47.365 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:47.366 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"btime":"2024-09-16T07:31:33:111265+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/204209379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":204209379},{"type":"v1","addr":"172.21.15.149:6836","nonce":204209379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1846247659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1846247659},{"type":"v1","addr":"172.21.15.149:6837","nonce":1846247659}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/350567716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":350567716},{"type":"v1","addr":"172.21.15.114:6833","nonce":350567716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:31:19.162681+0000","modified":"2024-09-16T07:31:22.188961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1633021756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1633021756},{"type":"v1","addr":"172.21.15.114:6835","nonce":1633021756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5769,"qdb_cluster":[5769]},"id":4}]} 2024-09-16T07:31:47.366 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3e20073220 msgr2=0x7f3e200756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3e20073220 0x7f3e200756e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3e400cd410 tx=0x7f3e2c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e400afca0 msgr2=0x7f3e40166430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e400afca0 0x7f3e40166430 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cb40 tx=0x7f3e3000cc30 comp rx=0 tx=0).stop 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 shutdown_connections 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3e20073220 0x7f3e200756e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3e4015f490 0x7f3e40157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e400b2e80 0x7f3e401576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 --2- 172.21.15.114:0/272913649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e400afca0 0x7f3e40166430 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 >> 172.21.15.114:0/272913649 conn(0x7f3e400d1e30 msgr2=0x7f3e400cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 shutdown_connections 2024-09-16T07:31:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.367+0000 7f3e45800640 1 -- 172.21.15.114:0/272913649 wait complete. 2024-09-16T07:31:47.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 -- 172.21.15.114:0/3739875143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2674004810 msgr2=0x7f2674004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 --2- 172.21.15.114:0/3739875143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2674004810 0x7f2674004c90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f269015f890 tx=0x7f267c01c6f0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 -- 172.21.15.114:0/3739875143 shutdown_connections 2024-09-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 --2- 172.21.15.114:0/3739875143 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2674004810 0x7f2674004c90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 -- 172.21.15.114:0/3739875143 >> 172.21.15.114:0/3739875143 conn(0x7f26900b18f0 msgr2=0x7f26900b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 -- 172.21.15.114:0/3739875143 shutdown_connections 2024-09-16T07:31:47.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 -- 172.21.15.114:0/3739875143 wait complete. 2024-09-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 Processor -- start 2024-09-16T07:31:47.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.531+0000 7f2696600640 1 -- start start 2024-09-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2674004810 0x7f2690143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26901438e0 0x7f2690143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26901595a0 0x7f2690159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f269015f120 con 0x7f26901438e0 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f269015efa0 con 0x7f26901595a0 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f269015f2a0 con 0x7f2674004810 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26901438e0 0x7f2690143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26901438e0 0x7f2690143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41750/0 (socket says 172.21.15.114:41750) 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 -- 172.21.15.114:0/276799910 learned_addr learned my addr 172.21.15.114:0/276799910 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268f400640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2674004810 0x7f2690143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268fe00640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26901595a0 0x7f2690159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 -- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2674004810 msgr2=0x7f2690143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2674004810 0x7f2690143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 -- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26901595a0 msgr2=0x7f2690159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26901595a0 0x7f2690159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 -- 172.21.15.114:0/276799910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2690150c80 con 0x7f26901438e0 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268f400640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2674004810 0x7f2690143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268fe00640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26901595a0 0x7f2690159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f268ea00640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26901438e0 0x7f2690143d60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f267c01afc0 tx=0x7f267c001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2687400640 1 -- 172.21.15.114:0/276799910 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0036c0 con 0x7f26901438e0 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2687400640 1 -- 172.21.15.114:0/276799910 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f267c003950 con 0x7f26901438e0 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26901464e0 con 0x7f26901438e0 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2687400640 1 -- 172.21.15.114:0/276799910 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c003d00 con 0x7f26901438e0 2024-09-16T07:31:47.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2690158ac0 con 0x7f26901438e0 2024-09-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269006eca0 con 0x7f26901438e0 2024-09-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.535+0000 7f2687400640 1 -- 172.21.15.114:0/276799910 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f267c0a5530 con 0x7f26901438e0 2024-09-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.539+0000 7f2687400640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2670073250 0x7f2670075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.539+0000 7f2687400640 1 -- 172.21.15.114:0/276799910 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f267c12dab0 con 0x7f26901438e0 2024-09-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.539+0000 7f268f400640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2670073250 0x7f2670075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.539+0000 7f268f400640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2670073250 0x7f2670075710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2690052940 tx=0x7f2680009500 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:47.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.543+0000 7f2687400640 1 -- 172.21.15.114:0/276799910 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f267c0b3070 con 0x7f26901438e0 2024-09-16T07:31:47.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.711+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f269006f950 con 0x7f26901438e0 2024-09-16T07:31:47.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.711+0000 7f2687400640 1 -- 172.21.15.114:0/276799910 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16773 (secure 0 0 0) 0x7f267c016450 con 0x7f26901438e0 2024-09-16T07:31:47.711 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:47.711 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:31:20.774072+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:31:16.866132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-16T07:31:18.131366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2670073250 msgr2=0x7f2670075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2670073250 0x7f2670075710 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2690052940 tx=0x7f2680009500 comp rx=0 tx=0).stop 2024-09-16T07:31:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26901438e0 msgr2=0x7f2690143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26901438e0 0x7f2690143d60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f267c01afc0 tx=0x7f267c001440 comp rx=0 tx=0).stop 2024-09-16T07:31:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 shutdown_connections 2024-09-16T07:31:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2670073250 0x7f2670075710 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26901595a0 0x7f2690159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26901438e0 0x7f2690143d60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 --2- 172.21.15.114:0/276799910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2674004810 0x7f2690143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 >> 172.21.15.114:0/276799910 conn(0x7f26900b18f0 msgr2=0x7f26900ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 shutdown_connections 2024-09-16T07:31:47.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.715+0000 7f2696600640 1 -- 172.21.15.114:0/276799910 wait complete. 2024-09-16T07:31:47.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:31:47.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:47.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.875+0000 7fbd9b800640 1 -- 172.21.15.114:0/2269352611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9415bd50 msgr2=0x7fbd940ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.875+0000 7fbd9b800640 1 --2- 172.21.15.114:0/2269352611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9415bd50 0x7fbd940ce5e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009900 tx=0x7fbd8401c7c0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- 172.21.15.114:0/2269352611 shutdown_connections 2024-09-16T07:31:47.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 --2- 172.21.15.114:0/2269352611 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd9415c130 0x7fbd940ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 --2- 172.21.15.114:0/2269352611 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd9415bd50 0x7fbd940ce5e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- 172.21.15.114:0/2269352611 >> 172.21.15.114:0/2269352611 conn(0x7fbd940d1ea0 msgr2=0x7fbd940d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:47.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- 172.21.15.114:0/2269352611 shutdown_connections 2024-09-16T07:31:47.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- 172.21.15.114:0/2269352611 wait complete. 2024-09-16T07:31:47.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 Processor -- start 2024-09-16T07:31:47.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- start start 2024-09-16T07:31:47.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd940cf4e0 0x7fbd9414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd9415bd50 0x7fbd94150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd9415c130 0x7fbd94153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94168ea0 con 0x7fbd940cf4e0 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94168d20 con 0x7fbd9415bd50 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbd94169020 con 0x7fbd9415c130 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd940cf4e0 0x7fbd9414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd940cf4e0 0x7fbd9414f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41780/0 (socket says 172.21.15.114:41780) 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 -- 172.21.15.114:0/171712114 learned_addr learned my addr 172.21.15.114:0/171712114 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd99800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd9415c130 0x7fbd94153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 -- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd9415c130 msgr2=0x7fbd94153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd9415c130 0x7fbd94153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 -- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd9415bd50 msgr2=0x7fbd94150d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd9415bd50 0x7fbd94150d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 -- 172.21.15.114:0/171712114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd940cbb90 con 0x7fbd940cf4e0 2024-09-16T07:31:47.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd99800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd9415c130 0x7fbd94153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd98e00640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd940cf4e0 0x7fbd9414f060 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009850 tx=0x7fbd840a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd91600640 1 -- 172.21.15.114:0/171712114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd840b2040 con 0x7fbd940cf4e0 2024-09-16T07:31:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd91600640 1 -- 172.21.15.114:0/171712114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd84004340 con 0x7fbd940cf4e0 2024-09-16T07:31:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd940cbe70 con 0x7fbd940cf4e0 2024-09-16T07:31:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.879+0000 7fbd91600640 1 -- 172.21.15.114:0/171712114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84005280 con 0x7fbd940cf4e0 2024-09-16T07:31:47.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.883+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd941512a0 con 0x7fbd940cf4e0 2024-09-16T07:31:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.883+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd940c5dd0 con 0x7fbd940cf4e0 2024-09-16T07:31:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.883+0000 7fbd91600640 1 -- 172.21.15.114:0/171712114 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fbd84005420 con 0x7fbd940cf4e0 2024-09-16T07:31:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.883+0000 7fbd91600640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd70073220 0x7fbd700756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.883+0000 7fbd91600640 1 -- 172.21.15.114:0/171712114 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fbd8412e120 con 0x7fbd940cf4e0 2024-09-16T07:31:47.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.883+0000 7fbd8be00640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd70073220 0x7fbd700756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:47.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.887+0000 7fbd8be00640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd70073220 0x7fbd700756e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd94071ac0 tx=0x7fbd7c005b70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:47.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:47.887+0000 7fbd91600640 1 -- 172.21.15.114:0/171712114 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbd840164d0 con 0x7fbd940cf4e0 2024-09-16T07:31:47.989 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:31:47.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:31:48.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd940cfaf0 con 0x7fbd940cf4e0 2024-09-16T07:31:48.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd91600640 1 -- 172.21.15.114:0/171712114 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5229 (secure 0 0 0) 0x7fbd840f8da0 con 0x7fbd940cf4e0 2024-09-16T07:31:48.090 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:48.090 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"btime":"2024-09-16T07:31:33:111265+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/204209379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":204209379},{"type":"v1","addr":"172.21.15.149:6836","nonce":204209379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1846247659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1846247659},{"type":"v1","addr":"172.21.15.149:6837","nonce":1846247659}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/350567716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":350567716},{"type":"v1","addr":"172.21.15.114:6833","nonce":350567716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:31:19.162681+0000","modified":"2024-09-16T07:31:22.188961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1633021756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1633021756},{"type":"v1","addr":"172.21.15.114:6835","nonce":1633021756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5769,"qdb_cluster":[5769]},"id":4}]} 2024-09-16T07:31:48.091 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-09-16T07:31:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd70073220 msgr2=0x7fbd700756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd70073220 0x7fbd700756e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd94071ac0 tx=0x7fbd7c005b70 comp rx=0 tx=0).stop 2024-09-16T07:31:48.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd940cf4e0 msgr2=0x7fbd9414f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd940cf4e0 0x7fbd9414f060 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009850 tx=0x7fbd840a5620 comp rx=0 tx=0).stop 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 shutdown_connections 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd70073220 0x7fbd700756e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd9415c130 0x7fbd94153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd9415bd50 0x7fbd94150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 --2- 172.21.15.114:0/171712114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd940cf4e0 0x7fbd9414f060 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.091+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 >> 172.21.15.114:0/171712114 conn(0x7fbd940d1ea0 msgr2=0x7fbd940d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.095+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 shutdown_connections 2024-09-16T07:31:48.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.095+0000 7fbd9b800640 1 -- 172.21.15.114:0/171712114 wait complete. 2024-09-16T07:31:48.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:48.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.251+0000 7f7662400640 1 -- 172.21.15.114:0/3438353402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c0cd100 msgr2=0x7f765c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.251+0000 7f7662400640 1 --2- 172.21.15.114:0/3438353402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c0cd100 0x7f765c0acd40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f765c06aab0 tx=0x7f764401c7a0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- 172.21.15.114:0/3438353402 shutdown_connections 2024-09-16T07:31:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 --2- 172.21.15.114:0/3438353402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c0cd100 0x7f765c0acd40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 --2- 172.21.15.114:0/3438353402 >> v2:172.21.15.149:3300/0 conn(0x7f765c06f8b0 0x7f765c15dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- 172.21.15.114:0/3438353402 >> 172.21.15.114:0/3438353402 conn(0x7f765c0b18f0 msgr2=0x7f765c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- 172.21.15.114:0/3438353402 shutdown_connections 2024-09-16T07:31:48.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- 172.21.15.114:0/3438353402 wait complete. 2024-09-16T07:31:48.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 Processor -- start 2024-09-16T07:31:48.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- start start 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06f8b0 0x7f765c143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cc620 0x7f765c09ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c0cd100 0x7f765c15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1684c0 con 0x7f765c06f8b0 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f765c168340 con 0x7f765c0cc620 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f765c168640 con 0x7f765c0cd100 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06f8b0 0x7f765c143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06f8b0 0x7f765c143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41794/0 (socket says 172.21.15.114:41794) 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 -- 172.21.15.114:0/3923323906 learned_addr learned my addr 172.21.15.114:0/3923323906 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7652a00640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cc620 0x7f765c09ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765be00640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c0cd100 0x7f765c15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 -- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c0cd100 msgr2=0x7f765c15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c0cd100 0x7f765c15c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 -- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cc620 msgr2=0x7f765c09ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cc620 0x7f765c09ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 -- 172.21.15.114:0/3923323906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c1444d0 con 0x7f765c06f8b0 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765be00640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c0cd100 0x7f765c15c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f765b400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06f8b0 0x7f765c143f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d980 tx=0x7f764c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7653e00640 1 -- 172.21.15.114:0/3923323906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c017070 con 0x7f765c06f8b0 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7653e00640 1 -- 172.21.15.114:0/3923323906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f764c009d60 con 0x7f765c06f8b0 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7653e00640 1 -- 172.21.15.114:0/3923323906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c005280 con 0x7f765c06f8b0 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c1469d0 con 0x7f765c06f8b0 2024-09-16T07:31:48.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.255+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c146f90 con 0x7f765c06f8b0 2024-09-16T07:31:48.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.259+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765c15dae0 con 0x7f765c06f8b0 2024-09-16T07:31:48.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.259+0000 7f7653e00640 1 -- 172.21.15.114:0/3923323906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f764c005420 con 0x7f765c06f8b0 2024-09-16T07:31:48.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.259+0000 7f7653e00640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7638073250 0x7f7638075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.259+0000 7f7653e00640 1 -- 172.21.15.114:0/3923323906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f764c094720 con 0x7f765c06f8b0 2024-09-16T07:31:48.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.259+0000 7f7652a00640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7638073250 0x7f7638075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.263+0000 7f7652a00640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7638073250 0x7f7638075710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76440ae000 tx=0x7f764401afe0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:48.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.263+0000 7f7653e00640 1 -- 172.21.15.114:0/3923323906 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f764c05f330 con 0x7f765c06f8b0 2024-09-16T07:31:48.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.463+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f765c0702b0 con 0x7f765c06f8b0 2024-09-16T07:31:48.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7653e00640 1 -- 172.21.15.114:0/3923323906 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5229 (secure 0 0 0) 0x7f764c05ec30 con 0x7f765c06f8b0 2024-09-16T07:31:48.464 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:48.465 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":37,"btime":"2024-09-16T07:31:33:111265+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/204209379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":204209379},{"type":"v1","addr":"172.21.15.149:6836","nonce":204209379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1846247659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1846247659},{"type":"v1","addr":"172.21.15.149:6837","nonce":1846247659}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/350567716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":350567716},{"type":"v1","addr":"172.21.15.114:6833","nonce":350567716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:31:19.162681+0000","modified":"2024-09-16T07:31:22.188961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1633021756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1633021756},{"type":"v1","addr":"172.21.15.114:6835","nonce":1633021756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5769,"qdb_cluster":[5769]},"id":4}]} 2024-09-16T07:31:48.465 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 37 2024-09-16T07:31:48.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7638073250 msgr2=0x7f7638075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7638073250 0x7f7638075710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76440ae000 tx=0x7f764401afe0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06f8b0 msgr2=0x7f765c143f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06f8b0 0x7f765c143f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f764c00d980 tx=0x7f764c00de40 comp rx=0 tx=0).stop 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 shutdown_connections 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7638073250 0x7f7638075710 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c0cd100 0x7f765c15c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cc620 0x7f765c09ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 --2- 172.21.15.114:0/3923323906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06f8b0 0x7f765c143f90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 >> 172.21.15.114:0/3923323906 conn(0x7f765c0b18f0 msgr2=0x7f765c158690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 shutdown_connections 2024-09-16T07:31:48.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.467+0000 7f7662400640 1 -- 172.21.15.114:0/3923323906 wait complete. 2024-09-16T07:31:48.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 -- 172.21.15.114:0/2732107509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a815bea0 msgr2=0x7f29a80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 --2- 172.21.15.114:0/2732107509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a815bea0 0x7f29a80ce670 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f29a8073d10 tx=0x7f299c01c830 comp rx=0 tx=0).stop 2024-09-16T07:31:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 -- 172.21.15.114:0/2732107509 shutdown_connections 2024-09-16T07:31:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 --2- 172.21.15.114:0/2732107509 >> v2:172.21.15.149:3300/0 conn(0x7f29a80cdb30 0x7f29a80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 --2- 172.21.15.114:0/2732107509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a815bea0 0x7f29a80ce670 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 -- 172.21.15.114:0/2732107509 >> 172.21.15.114:0/2732107509 conn(0x7f29a80d1dc0 msgr2=0x7f29a80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 -- 172.21.15.114:0/2732107509 shutdown_connections 2024-09-16T07:31:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.627+0000 7f29b0600640 1 -- 172.21.15.114:0/2732107509 wait complete. 2024-09-16T07:31:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 Processor -- start 2024-09-16T07:31:48.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 -- start start 2024-09-16T07:31:48.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a80cdb30 0x7f29a80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80d28e0 0x7f29a8159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29a815bea0 0x7f29a80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8168fc0 con 0x7f29a80cdb30 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8168e40 con 0x7f29a80d28e0 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29a8169140 con 0x7f29a815bea0 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a80cdb30 0x7f29a80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a80cdb30 0x7f29a80c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41812/0 (socket says 172.21.15.114:41812) 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 -- 172.21.15.114:0/1212409291 learned_addr learned my addr 172.21.15.114:0/1212409291 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29ad200640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80d28e0 0x7f29a8159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29ae600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29a815bea0 0x7f29a80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 -- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29a815bea0 msgr2=0x7f29a80c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29a815bea0 0x7f29a80c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 -- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80d28e0 msgr2=0x7f29a8159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80d28e0 0x7f29a8159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 -- 172.21.15.114:0/1212409291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a806fd70 con 0x7f29a80cdb30 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29ae600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29a815bea0 0x7f29a80c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29adc00640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a80cdb30 0x7f29a80c5590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f299c0b0040 tx=0x7f299c0a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29a5600640 1 -- 172.21.15.114:0/1212409291 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c0b2040 con 0x7f29a80cdb30 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29a5600640 1 -- 172.21.15.114:0/1212409291 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f299c0043b0 con 0x7f29a80cdb30 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29a5600640 1 -- 172.21.15.114:0/1212409291 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c005280 con 0x7f29a80cdb30 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a8159140 con 0x7f29a80cdb30 2024-09-16T07:31:48.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.631+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a80c89f0 con 0x7f29a80cdb30 2024-09-16T07:31:48.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.635+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a80b3a70 con 0x7f29a80cdb30 2024-09-16T07:31:48.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.635+0000 7f29a5600640 1 -- 172.21.15.114:0/1212409291 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f299c005420 con 0x7f29a80cdb30 2024-09-16T07:31:48.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.635+0000 7f29a5600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2988073220 0x7f29880756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.635+0000 7f29a5600640 1 -- 172.21.15.114:0/1212409291 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f299c12dfd0 con 0x7f29a80cdb30 2024-09-16T07:31:48.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.635+0000 7f29ad200640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2988073220 0x7f29880756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.635+0000 7f29ad200640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2988073220 0x7f29880756e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2994005d90 tx=0x7f2994005c60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:48.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.639+0000 7f29a5600640 1 -- 172.21.15.114:0/1212409291 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f29a80b3a70 con 0x7f29a80cdb30 2024-09-16T07:31:48.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29a806e740 con 0x7f29a80cdb30 2024-09-16T07:31:48.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29a5600640 1 -- 172.21.15.114:0/1212409291 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16773 (secure 0 0 0) 0x7f299c0164b0 con 0x7f29a80cdb30 2024-09-16T07:31:48.810 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:48.810 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:31:20.774072+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:31:16.866132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-16T07:31:18.131366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:48.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2988073220 msgr2=0x7f29880756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2988073220 0x7f29880756e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2994005d90 tx=0x7f2994005c60 comp rx=0 tx=0).stop 2024-09-16T07:31:48.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a80cdb30 msgr2=0x7f29a80c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a80cdb30 0x7f29a80c5590 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f299c0b0040 tx=0x7f299c0a5680 comp rx=0 tx=0).stop 2024-09-16T07:31:48.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 shutdown_connections 2024-09-16T07:31:48.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2988073220 0x7f29880756e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29a815bea0 0x7f29a80c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29a80d28e0 0x7f29a8159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 --2- 172.21.15.114:0/1212409291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29a80cdb30 0x7f29a80c5590 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.811+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 >> 172.21.15.114:0/1212409291 conn(0x7f29a80d1dc0 msgr2=0x7f29a80cb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:48.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.815+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 shutdown_connections 2024-09-16T07:31:48.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.815+0000 7f29b0600640 1 -- 172.21.15.114:0/1212409291 wait complete. 2024-09-16T07:31:48.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:31:48.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.975+0000 7f5dac200640 1 -- 172.21.15.114:0/3726633470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d8c004810 msgr2=0x7f5d8c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.975+0000 7f5dac200640 1 --2- 172.21.15.114:0/3726633470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d8c004810 0x7f5d8c004c90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009b60 tx=0x7f5d9001d240 comp rx=0 tx=0).stop 2024-09-16T07:31:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.975+0000 7f5dac200640 1 -- 172.21.15.114:0/3726633470 shutdown_connections 2024-09-16T07:31:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.975+0000 7f5dac200640 1 --2- 172.21.15.114:0/3726633470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d8c004810 0x7f5d8c004c90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.975+0000 7f5dac200640 1 -- 172.21.15.114:0/3726633470 >> 172.21.15.114:0/3726633470 conn(0x7f5da40d1e30 msgr2=0x7f5da40d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.975+0000 7f5dac200640 1 -- 172.21.15.114:0/3726633470 shutdown_connections 2024-09-16T07:31:48.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.975+0000 7f5dac200640 1 -- 172.21.15.114:0/3726633470 wait complete. 2024-09-16T07:31:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 Processor -- start 2024-09-16T07:31:48.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 -- start start 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d8c004810 0x7f5da41eb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5da40b53c0 0x7f5da40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5da41fb520 0x7f5da40cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5da40b0c20 con 0x7f5da41fb520 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5da40b0aa0 con 0x7f5d8c004810 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5da40b0da0 con 0x7f5da40b53c0 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5da41fb520 0x7f5da40cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5da41fb520 0x7f5da40cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41834/0 (socket says 172.21.15.114:41834) 2024-09-16T07:31:48.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 -- 172.21.15.114:0/3773777561 learned_addr learned my addr 172.21.15.114:0/3773777561 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5da9800640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d8c004810 0x7f5da41eb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5da8e00640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5da40b53c0 0x7f5da40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 -- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5da40b53c0 msgr2=0x7f5da40b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5da40b53c0 0x7f5da40b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 -- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d8c004810 msgr2=0x7f5da41eb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d8c004810 0x7f5da41eb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 -- 172.21.15.114:0/3773777561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da41ec250 con 0x7f5da41fb520 2024-09-16T07:31:48.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5daa200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5da41fb520 0x7f5da40cb1e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5da4069e60 tx=0x7f5d9c00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:48.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5da1600640 1 -- 172.21.15.114:0/3773777561 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c015020 con 0x7f5da41fb520 2024-09-16T07:31:48.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5da1600640 1 -- 172.21.15.114:0/3773777561 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d9c010980 con 0x7f5da41fb520 2024-09-16T07:31:48.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5da1600640 1 -- 172.21.15.114:0/3773777561 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c010dd0 con 0x7f5da41fb520 2024-09-16T07:31:48.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da41ec530 con 0x7f5da41fb520 2024-09-16T07:31:48.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.979+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da41fb000 con 0x7f5da41fb520 2024-09-16T07:31:48.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.983+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da40b1840 con 0x7f5da41fb520 2024-09-16T07:31:48.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.983+0000 7f5da1600640 1 -- 172.21.15.114:0/3773777561 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f5d9c018020 con 0x7f5da41fb520 2024-09-16T07:31:48.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.983+0000 7f5da1600640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d84073250 0x7f5d84075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:48.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.983+0000 7f5da1600640 1 -- 172.21.15.114:0/3773777561 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f5d9c094610 con 0x7f5da41fb520 2024-09-16T07:31:48.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.983+0000 7f5da9800640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d84073250 0x7f5d84075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:48.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.983+0000 7f5da9800640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d84073250 0x7f5d84075710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5da4052940 tx=0x7f5d980049c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:48.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:48.987+0000 7f5da1600640 1 -- 172.21.15.114:0/3773777561 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5d9c01f030 con 0x7f5da41fb520 2024-09-16T07:31:49.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.191+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5da40cea30 con 0x7f5da41fb520 2024-09-16T07:31:49.189 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:31:49.191+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:31:49.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.191+0000 7f5da1600640 1 -- 172.21.15.114:0/3773777561 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7f5d9c05ed40 con 0x7f5da41fb520 2024-09-16T07:31:49.191 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:31:49.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d84073250 msgr2=0x7f5d84075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d84073250 0x7f5d84075710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5da4052940 tx=0x7f5d980049c0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5da41fb520 msgr2=0x7f5da40cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5da41fb520 0x7f5da40cb1e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5da4069e60 tx=0x7f5d9c00ea20 comp rx=0 tx=0).stop 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 shutdown_connections 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f5d84073250 0x7f5d84075710 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5da41fb520 0x7f5da40cb1e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5da40b53c0 0x7f5da40b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 --2- 172.21.15.114:0/3773777561 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d8c004810 0x7f5da41eb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 >> 172.21.15.114:0/3773777561 conn(0x7f5da40d1e30 msgr2=0x7f5da40b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 shutdown_connections 2024-09-16T07:31:49.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.195+0000 7f5dac200640 1 -- 172.21.15.114:0/3773777561 wait complete. 2024-09-16T07:31:49.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:31:49.260 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:31:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.363+0000 7f4c11800640 1 -- 172.21.15.114:0/3385432465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bf0003a60 msgr2=0x7f4bf0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.363+0000 7f4c11800640 1 --2- 172.21.15.114:0/3385432465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bf0003a60 0x7f4bf0003e80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c2e0 tx=0x7f4bfc01cee0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.363+0000 7f4c11800640 1 -- 172.21.15.114:0/3385432465 shutdown_connections 2024-09-16T07:31:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.363+0000 7f4c11800640 1 --2- 172.21.15.114:0/3385432465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bf0003a60 0x7f4bf0003e80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.363+0000 7f4c11800640 1 -- 172.21.15.114:0/3385432465 >> 172.21.15.114:0/3385432465 conn(0x7f4c0c0d1e00 msgr2=0x7f4c0c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.363+0000 7f4c11800640 1 -- 172.21.15.114:0/3385432465 shutdown_connections 2024-09-16T07:31:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.363+0000 7f4c11800640 1 -- 172.21.15.114:0/3385432465 wait complete. 2024-09-16T07:31:49.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 Processor -- start 2024-09-16T07:31:49.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 -- start start 2024-09-16T07:31:49.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf0003a60 0x7f4c0c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c0c0c5930 0x7f4c0c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c0c15e630 0x7f4c0c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:49.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0cd6b0 con 0x7f4c0c0c5930 2024-09-16T07:31:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0cd530 con 0x7f4bf0003a60 2024-09-16T07:31:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c0aeb50 con 0x7f4c0c15e630 2024-09-16T07:31:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c0c0c5930 0x7f4c0c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c0c0c5930 0x7f4c0c0c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41858/0 (socket says 172.21.15.114:41858) 2024-09-16T07:31:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 -- 172.21.15.114:0/2093023264 learned_addr learned my addr 172.21.15.114:0/2093023264 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c0aa00640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf0003a60 0x7f4c0c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c0b400640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c0c15e630 0x7f4c0c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 -- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c0c15e630 msgr2=0x7f4c0c15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c0c15e630 0x7f4c0c15eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 -- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf0003a60 msgr2=0x7f4c0c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf0003a60 0x7f4c0c15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 -- 172.21.15.114:0/2093023264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c1f8390 con 0x7f4c0c0c5930 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c02000640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c0c0c5930 0x7f4c0c0c5db0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4003e50 tx=0x7f4bf4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c03400640 1 -- 172.21.15.114:0/2093023264 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4015070 con 0x7f4c0c0c5930 2024-09-16T07:31:49.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c03400640 1 -- 172.21.15.114:0/2093023264 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bf4011840 con 0x7f4c0c0c5930 2024-09-16T07:31:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c03400640 1 -- 172.21.15.114:0/2093023264 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4001d50 con 0x7f4c0c0c5930 2024-09-16T07:31:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c15ad10 con 0x7f4c0c0c5930 2024-09-16T07:31:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c0c66d0 con 0x7f4c0c0c5930 2024-09-16T07:31:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.367+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c0af0b0 con 0x7f4c0c0c5930 2024-09-16T07:31:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.371+0000 7f4c03400640 1 -- 172.21.15.114:0/2093023264 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f4bf4018070 con 0x7f4c0c0c5930 2024-09-16T07:31:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.371+0000 7f4c03400640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4be8073250 0x7f4be8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.371+0000 7f4c03400640 1 -- 172.21.15.114:0/2093023264 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f4bf4094e40 con 0x7f4c0c0c5930 2024-09-16T07:31:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.371+0000 7f4c0aa00640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4be8073250 0x7f4be8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.371+0000 7f4c0aa00640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4be8073250 0x7f4be8075710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0ab000 tx=0x7f4bfc019d20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:49.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.375+0000 7f4c03400640 1 -- 172.21.15.114:0/2093023264 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4bf405fa50 con 0x7f4c0c0c5930 2024-09-16T07:31:49.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:49.579+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4c0c0b6cb0 con 0x7f4c0c0c5930 2024-09-16T07:31:50.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c03400640 1 -- 172.21.15.114:0/2093023264 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f4bf405f350 con 0x7f4c0c0c5930 2024-09-16T07:31:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4be8073250 msgr2=0x7f4be8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4be8073250 0x7f4be8075710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0ab000 tx=0x7f4bfc019d20 comp rx=0 tx=0).stop 2024-09-16T07:31:50.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c0c0c5930 msgr2=0x7f4c0c0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c0c0c5930 0x7f4c0c0c5db0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4003e50 tx=0x7f4bf4001640 comp rx=0 tx=0).stop 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 shutdown_connections 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4be8073250 0x7f4be8075710 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c0c15e630 0x7f4c0c15eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c0c0c5930 0x7f4c0c0c5db0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 --2- 172.21.15.114:0/2093023264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bf0003a60 0x7f4c0c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 >> 172.21.15.114:0/2093023264 conn(0x7f4c0c0d1e00 msgr2=0x7f4c0c0c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 shutdown_connections 2024-09-16T07:31:50.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.195+0000 7f4c11800640 1 -- 172.21.15.114:0/2093023264 wait complete. 2024-09-16T07:31:50.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 -- 172.21.15.114:0/811075422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0af330 msgr2=0x7f450c0cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 --2- 172.21.15.114:0/811075422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0af330 0x7f450c0cdac0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4504009900 tx=0x7f450401c850 comp rx=0 tx=0).stop 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 -- 172.21.15.114:0/811075422 shutdown_connections 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 --2- 172.21.15.114:0/811075422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c0af330 0x7f450c0cdac0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 --2- 172.21.15.114:0/811075422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450c0b5170 0x7f450c0aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 -- 172.21.15.114:0/811075422 >> 172.21.15.114:0/811075422 conn(0x7f450c0cfbc0 msgr2=0x7f450c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 -- 172.21.15.114:0/811075422 shutdown_connections 2024-09-16T07:31:50.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 -- 172.21.15.114:0/811075422 wait complete. 2024-09-16T07:31:50.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 Processor -- start 2024-09-16T07:31:50.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.407+0000 7f4512200640 1 -- start start 2024-09-16T07:31:50.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450c0af330 0x7f450c0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:50.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450c0b5170 0x7f450c155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:50.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c15bf60 0x7f450c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f450c169240 con 0x7f450c15bf60 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f450c1690c0 con 0x7f450c0b5170 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f450c1693c0 con 0x7f450c0af330 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c15bf60 0x7f450c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450c0af330 0x7f450c0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c15bf60 0x7f450c152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41880/0 (socket says 172.21.15.114:41880) 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 -- 172.21.15.114:0/3788879800 learned_addr learned my addr 172.21.15.114:0/3788879800 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4502a00640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450c0b5170 0x7f450c155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 -- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450c0af330 msgr2=0x7f450c0b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450c0af330 0x7f450c0b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 -- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450c0b5170 msgr2=0x7f450c155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450c0b5170 0x7f450c155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:50.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 -- 172.21.15.114:0/3788879800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c0b0750 con 0x7f450c15bf60 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f450be00640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c15bf60 0x7f450c152fb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f45040b0040 tx=0x7f4504004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4503e00640 1 -- 172.21.15.114:0/3788879800 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45040ba020 con 0x7f450c15bf60 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4503e00640 1 -- 172.21.15.114:0/3788879800 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4504005030 con 0x7f450c15bf60 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4503e00640 1 -- 172.21.15.114:0/3788879800 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45040b2040 con 0x7f450c15bf60 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c0afbd0 con 0x7f450c15bf60 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c0b0190 con 0x7f450c15bf60 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c069410 con 0x7f450c15bf60 2024-09-16T07:31:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.411+0000 7f4503e00640 1 -- 172.21.15.114:0/3788879800 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f4504005480 con 0x7f450c15bf60 2024-09-16T07:31:50.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.415+0000 7f4503e00640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44e8073220 0x7f44e80756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:50.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.415+0000 7f4503e00640 1 -- 172.21.15.114:0/3788879800 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f450412e0d0 con 0x7f450c15bf60 2024-09-16T07:31:50.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.415+0000 7f450b400640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44e8073220 0x7f44e80756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:50.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.415+0000 7f450b400640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44e8073220 0x7f44e80756e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f44fc001e40 tx=0x7f44fc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.419+0000 7f4503e00640 1 -- 172.21.15.114:0/3788879800 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f45040c4060 con 0x7f450c15bf60 2024-09-16T07:31:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:50.587+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f450c0b47f0 con 0x7f450c15bf60 2024-09-16T07:31:51.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.195+0000 7f4503e00640 1 -- 172.21.15.114:0/3788879800 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f45040164d0 con 0x7f450c15bf60 2024-09-16T07:31:51.195 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:31:51.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44e8073220 msgr2=0x7f44e80756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:51.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44e8073220 0x7f44e80756e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f44fc001e40 tx=0x7f44fc009040 comp rx=0 tx=0).stop 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c15bf60 msgr2=0x7f450c152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c15bf60 0x7f450c152fb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f45040b0040 tx=0x7f4504004040 comp rx=0 tx=0).stop 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 shutdown_connections 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f44e8073220 0x7f44e80756e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450c15bf60 0x7f450c152fb0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f450c0b5170 0x7f450c155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 --2- 172.21.15.114:0/3788879800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f450c0af330 0x7f450c0b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 >> 172.21.15.114:0/3788879800 conn(0x7f450c0cfbc0 msgr2=0x7f450c072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 shutdown_connections 2024-09-16T07:31:51.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.199+0000 7f4512200640 1 -- 172.21.15.114:0/3788879800 wait complete. 2024-09-16T07:31:51.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:31:51.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 -- 172.21.15.114:0/2832416969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 msgr2=0x7fdcac15fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:51.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 --2- 172.21.15.114:0/2832416969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 0x7fdcac15fc30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009c80 tx=0x7fdca401cd70 comp rx=0 tx=0).stop 2024-09-16T07:31:51.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 -- 172.21.15.114:0/2832416969 shutdown_connections 2024-09-16T07:31:51.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 --2- 172.21.15.114:0/2832416969 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 0x7fdcac15fc30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 --2- 172.21.15.114:0/2832416969 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcac15bcb0 0x7fdcac0b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 -- 172.21.15.114:0/2832416969 >> 172.21.15.114:0/2832416969 conn(0x7fdcac06dd30 msgr2=0x7fdcac06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:51.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 -- 172.21.15.114:0/2832416969 shutdown_connections 2024-09-16T07:31:51.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 -- 172.21.15.114:0/2832416969 wait complete. 2024-09-16T07:31:51.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 Processor -- start 2024-09-16T07:31:51.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.367+0000 7fdcb4000640 1 -- start start 2024-09-16T07:31:51.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 0x7fdcac155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:51.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcac15bcb0 0x7fdcac148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcac15f7f0 0x7fdcac1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac168d10 con 0x7fdcac15f7f0 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac168b90 con 0x7fdcac06d330 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdcac168e90 con 0x7fdcac15bcb0 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcac15f7f0 0x7fdcac1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcac15f7f0 0x7fdcac1571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41884/0 (socket says 172.21.15.114:41884) 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 -- 172.21.15.114:0/4167651155 learned_addr learned my addr 172.21.15.114:0/4167651155 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb0c00640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcac15bcb0 0x7fdcac148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb1600640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 0x7fdcac155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 -- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcac15bcb0 msgr2=0x7fdcac148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcac15bcb0 0x7fdcac148630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 -- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 msgr2=0x7fdcac155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:51.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 0x7fdcac155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 -- 172.21.15.114:0/4167651155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac09db30 con 0x7fdcac15f7f0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb2000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcac15f7f0 0x7fdcac1571d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdca40b0040 tx=0x7fdca4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdca9600640 1 -- 172.21.15.114:0/4167651155 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca40b2040 con 0x7fdcac15f7f0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdca9600640 1 -- 172.21.15.114:0/4167651155 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdca40ad7f0 con 0x7fdcac15f7f0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac09de10 con 0x7fdcac15f7f0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdca9600640 1 -- 172.21.15.114:0/4167651155 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca40adc20 con 0x7fdcac15f7f0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac09e3d0 con 0x7fdcac15f7f0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcac15fc30 con 0x7fdcac15f7f0 2024-09-16T07:31:51.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.371+0000 7fdca9600640 1 -- 172.21.15.114:0/4167651155 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fdca4003fd0 con 0x7fdcac15f7f0 2024-09-16T07:31:51.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.375+0000 7fdca9600640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc8c073220 0x7fdc8c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:51.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.375+0000 7fdca9600640 1 -- 172.21.15.114:0/4167651155 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5357+0+0 (secure 0 0 0) 0x7fdca412e960 con 0x7fdcac15f7f0 2024-09-16T07:31:51.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.375+0000 7fdcb1600640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc8c073220 0x7fdc8c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:51.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.375+0000 7fdcb1600640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc8c073220 0x7fdc8c0756e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009be0 tx=0x7fdca00091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:51.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.379+0000 7fdca9600640 1 -- 172.21.15.114:0/4167651155 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdca4016990 con 0x7fdcac15f7f0 2024-09-16T07:31:51.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:51.547+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdcac15de30 con 0x7fdcac15f7f0 2024-09-16T07:31:52.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.199+0000 7fdca9600640 1 -- 172.21.15.114:0/4167651155 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7fdca40f9240 con 0x7fdcac15f7f0 2024-09-16T07:31:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:31:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.199+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc8c073220 msgr2=0x7fdc8c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.199+0000 7fdcb4000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc8c073220 0x7fdc8c0756e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009be0 tx=0x7fdca00091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.199+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcac15f7f0 msgr2=0x7fdcac1571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.199+0000 7fdcb4000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcac15f7f0 0x7fdcac1571d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdca40b0040 tx=0x7fdca4003f60 comp rx=0 tx=0).stop 2024-09-16T07:31:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 shutdown_connections 2024-09-16T07:31:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc8c073220 0x7fdc8c0756e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcac15f7f0 0x7fdcac1571d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdcac15bcb0 0x7fdcac148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 --2- 172.21.15.114:0/4167651155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdcac06d330 0x7fdcac155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 >> 172.21.15.114:0/4167651155 conn(0x7fdcac06dd30 msgr2=0x7fdcac070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:52.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 shutdown_connections 2024-09-16T07:31:52.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.203+0000 7fdcb4000640 1 -- 172.21.15.114:0/4167651155 wait complete. 2024-09-16T07:31:52.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:31:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 -- 172.21.15.114:0/1051623286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0cdb30 msgr2=0x7f6cdc0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1051623286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0cdb30 0x7f6cdc0cebb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009840 tx=0x7f6cc801c820 comp rx=0 tx=0).stop 2024-09-16T07:31:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 -- 172.21.15.114:0/1051623286 shutdown_connections 2024-09-16T07:31:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1051623286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0cdb30 0x7f6cdc0cebb0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1051623286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cdc15bea0 0x7f6cdc0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 -- 172.21.15.114:0/1051623286 >> 172.21.15.114:0/1051623286 conn(0x7f6cdc0d1dc0 msgr2=0x7f6cdc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 -- 172.21.15.114:0/1051623286 shutdown_connections 2024-09-16T07:31:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.371+0000 7f6ce3800640 1 -- 172.21.15.114:0/1051623286 wait complete. 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 Processor -- start 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 -- start start 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cdc0cdb30 0x7f6cdc154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0d28e0 0x7f6cdc0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cdc15bea0 0x7f6cdc0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc168f10 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc168d90 con 0x7f6cdc15bea0 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc169090 con 0x7f6cdc0cdb30 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0d28e0 0x7f6cdc0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0d28e0 0x7f6cdc0b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41912/0 (socket says 172.21.15.114:41912) 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 -- 172.21.15.114:0/1468715846 learned_addr learned my addr 172.21.15.114:0/1468715846 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce0e00640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cdc0cdb30 0x7f6cdc154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce1800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cdc15bea0 0x7f6cdc0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 -- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cdc0cdb30 msgr2=0x7f6cdc154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cdc0cdb30 0x7f6cdc154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 -- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cdc15bea0 msgr2=0x7f6cdc0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cdc15bea0 0x7f6cdc0b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 -- 172.21.15.114:0/1468715846 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc0b16d0 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce1800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cdc15bea0 0x7f6cdc0b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cdbe00640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0d28e0 0x7f6cdc0b3140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009790 tx=0x7f6cc80a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cd8c00640 1 -- 172.21.15.114:0/1468715846 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80b2040 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cd8c00640 1 -- 172.21.15.114:0/1468715846 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc80043b0 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6cd8c00640 1 -- 172.21.15.114:0/1468715846 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8005240 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc0b1970 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.375+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc0b1f30 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.379+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc0cc9d0 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.379+0000 7f6cd8c00640 1 -- 172.21.15.114:0/1468715846 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f6cc80053e0 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.379+0000 7f6cd8c00640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cbc073220 0x7f6cbc0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.379+0000 7f6cd8c00640 1 -- 172.21.15.114:0/1468715846 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f6cc812d8a0 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.379+0000 7f6ce0e00640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cbc073220 0x7f6cbc0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.379+0000 7f6ce0e00640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cbc073220 0x7f6cbc0756e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009f20 tx=0x7f6ccc009630 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:52.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.383+0000 7f6cd8c00640 1 -- 172.21.15.114:0/1468715846 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6cc8016410 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.551+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f6cdc0b2100 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6cd8c00640 1 -- 172.21.15.114:0/1468715846 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f6cc80f8820 con 0x7f6cdc0d28e0 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cbc073220 msgr2=0x7f6cbc0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cbc073220 0x7f6cbc0756e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009f20 tx=0x7f6ccc009630 comp rx=0 tx=0).stop 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0d28e0 msgr2=0x7f6cdc0b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0d28e0 0x7f6cdc0b3140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009790 tx=0x7f6cc80a55f0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 shutdown_connections 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6cbc073220 0x7f6cbc0756e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cdc15bea0 0x7f6cdc0b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cdc0d28e0 0x7f6cdc0b3140 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 --2- 172.21.15.114:0/1468715846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cdc0cdb30 0x7f6cdc154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 >> 172.21.15.114:0/1468715846 conn(0x7f6cdc0d1dc0 msgr2=0x7f6cdc0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:52.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 shutdown_connections 2024-09-16T07:31:52.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.555+0000 7f6ce3800640 1 -- 172.21.15.114:0/1468715846 wait complete. 2024-09-16T07:31:52.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-16T07:31:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- 172.21.15.114:0/1029670602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40b2bf0 msgr2=0x7fdca40b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 --2- 172.21.15.114:0/1029670602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40b2bf0 0x7fdca40b30a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdca40d0c90 tx=0x7fdc9c01cd80 comp rx=0 tx=0).stop 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- 172.21.15.114:0/1029670602 shutdown_connections 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 --2- 172.21.15.114:0/1029670602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca40b2bf0 0x7fdca40b30a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 --2- 172.21.15.114:0/1029670602 >> v2:172.21.15.149:3300/0 conn(0x7fdca40cd0d0 0x7fdca40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 --2- 172.21.15.114:0/1029670602 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdca415af90 0x7fdca415f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- 172.21.15.114:0/1029670602 >> 172.21.15.114:0/1029670602 conn(0x7fdca40b18f0 msgr2=0x7fdca40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- 172.21.15.114:0/1029670602 shutdown_connections 2024-09-16T07:31:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- 172.21.15.114:0/1029670602 wait complete. 2024-09-16T07:31:52.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 Processor -- start 2024-09-16T07:31:52.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- start start 2024-09-16T07:31:52.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca40b2bf0 0x7fdca40ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdca40cd0d0 0x7fdca41faf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca415af90 0x7fdca41fb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdca415b4f0 con 0x7fdca415af90 2024-09-16T07:31:52.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdca415b370 con 0x7fdca40b2bf0 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdcaae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdca415b670 con 0x7fdca40cd0d0 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca415af90 0x7fdca41fb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca415af90 0x7fdca41fb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41928/0 (socket says 172.21.15.114:41928) 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 -- 172.21.15.114:0/860044262 learned_addr learned my addr 172.21.15.114:0/860044262 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca3e00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca40b2bf0 0x7fdca40ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdc9b400640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdca40cd0d0 0x7fdca41faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 -- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdca40cd0d0 msgr2=0x7fdca41faf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdca40cd0d0 0x7fdca41faf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 -- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca40b2bf0 msgr2=0x7fdca40ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca40b2bf0 0x7fdca40ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 -- 172.21.15.114:0/860044262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca41fbde0 con 0x7fdca415af90 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.727+0000 7fdca8e00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca415af90 0x7fdca41fb4a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009bd0 tx=0x7fdc9c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdca0c00640 1 -- 172.21.15.114:0/860044262 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0bb070 con 0x7fdca415af90 2024-09-16T07:31:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdca0c00640 1 -- 172.21.15.114:0/860044262 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc9c004e00 con 0x7fdca415af90 2024-09-16T07:31:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdca0c00640 1 -- 172.21.15.114:0/860044262 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0b2040 con 0x7fdca415af90 2024-09-16T07:31:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca409c5e0 con 0x7fdca415af90 2024-09-16T07:31:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca409cba0 con 0x7fdca415af90 2024-09-16T07:31:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca4069410 con 0x7fdca415af90 2024-09-16T07:31:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdca0c00640 1 -- 172.21.15.114:0/860044262 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fdc9c0be070 con 0x7fdca415af90 2024-09-16T07:31:52.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdca0c00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc80073220 0x7fdc800756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:52.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.731+0000 7fdca0c00640 1 -- 172.21.15.114:0/860044262 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fdc9c12dff0 con 0x7fdca415af90 2024-09-16T07:31:52.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.735+0000 7fdca3e00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc80073220 0x7fdc800756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:52.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.735+0000 7fdca3e00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc80073220 0x7fdc800756e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdc94004630 tx=0x7fdc9400b2e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:52.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.735+0000 7fdca0c00640 1 -- 172.21.15.114:0/860044262 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdc9c016970 con 0x7fdca415af90 2024-09-16T07:31:52.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:52.963+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fdca40aea40 con 0x7fdca415af90 2024-09-16T07:31:53.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdca0c00640 1 -- 172.21.15.114:0/860044262 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v200) ==== 161+0+0 (secure 0 0 0) 0x7fdc9c0f8920 con 0x7fdca415af90 2024-09-16T07:31:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc80073220 msgr2=0x7fdc800756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc80073220 0x7fdc800756e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdc94004630 tx=0x7fdc9400b2e0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca415af90 msgr2=0x7fdca41fb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca415af90 0x7fdca41fb4a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009bd0 tx=0x7fdc9c003f60 comp rx=0 tx=0).stop 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 shutdown_connections 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fdc80073220 0x7fdc800756e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdca415af90 0x7fdca41fb4a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdca40cd0d0 0x7fdca41faf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 --2- 172.21.15.114:0/860044262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdca40b2bf0 0x7fdca40ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 >> 172.21.15.114:0/860044262 conn(0x7fdca40b18f0 msgr2=0x7fdca4156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 shutdown_connections 2024-09-16T07:31:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.207+0000 7fdcaae00640 1 -- 172.21.15.114:0/860044262 wait complete. 2024-09-16T07:31:53.227 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ok 2024-09-16T07:31:53.228 INFO:tasks.cephfs_test_runner:Starting test: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:31:53.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 -- 172.21.15.114:0/159417878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e006e7a0 msgr2=0x7fb4e00ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 --2- 172.21.15.114:0/159417878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e006e7a0 0x7fb4e00ce2e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00b2c50 tx=0x7fb4d801cb50 comp rx=0 tx=0).stop 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 -- 172.21.15.114:0/159417878 shutdown_connections 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 --2- 172.21.15.114:0/159417878 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e006e7a0 0x7fb4e00ce2e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 --2- 172.21.15.114:0/159417878 >> v2:172.21.15.149:3300/0 conn(0x7fb4e00cf1d0 0x7fb4e0160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 -- 172.21.15.114:0/159417878 >> 172.21.15.114:0/159417878 conn(0x7fb4e00b18f0 msgr2=0x7fb4e00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 -- 172.21.15.114:0/159417878 shutdown_connections 2024-09-16T07:31:53.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 -- 172.21.15.114:0/159417878 wait complete. 2024-09-16T07:31:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 Processor -- start 2024-09-16T07:31:53.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.371+0000 7fb4e8400640 1 -- start start 2024-09-16T07:31:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4e006e7a0 0x7fb4e01fb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e00cf1d0 0x7fb4e0152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4e015f9a0 0x7fb4e00aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0169120 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0168fa0 con 0x7fb4e015f9a0 2024-09-16T07:31:53.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e01692a0 con 0x7fb4e006e7a0 2024-09-16T07:31:53.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e00cf1d0 0x7fb4e0152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:53.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e00cf1d0 0x7fb4e0152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41944/0 (socket says 172.21.15.114:41944) 2024-09-16T07:31:53.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 -- 172.21.15.114:0/1055196144 learned_addr learned my addr 172.21.15.114:0/1055196144 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 -- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4e006e7a0 msgr2=0x7fb4e01fb870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4e006e7a0 0x7fb4e01fb870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 -- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4e015f9a0 msgr2=0x7fb4e00aeb20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4e015f9a0 0x7fb4e00aeb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 -- 172.21.15.114:0/1055196144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e00b0880 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e5000640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e00cf1d0 0x7fb4e0152b30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00b550 tx=0x7fb4cc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4dd600640 1 -- 172.21.15.114:0/1055196144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc014070 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4dd600640 1 -- 172.21.15.114:0/1055196144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4cc010980 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4dd600640 1 -- 172.21.15.114:0/1055196144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc010dd0 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e00b0b60 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01fb070 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e00ce2e0 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.375+0000 7fb4dd600640 1 -- 172.21.15.114:0/1055196144 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fb4cc017070 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.379+0000 7fb4dd600640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4c0073220 0x7fb4c00756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.379+0000 7fb4dd600640 1 -- 172.21.15.114:0/1055196144 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fb4cc094010 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.379+0000 7fb4e5a00640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4c0073220 0x7fb4c00756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:53.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.379+0000 7fb4e5a00640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4c0073220 0x7fb4c00756e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4007fd0 tx=0x7fb4d4007940 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:53.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.383+0000 7fb4dd600640 1 -- 172.21.15.114:0/1055196144 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb4cc05efd0 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4e00cc740 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4dd600640 1 -- 172.21.15.114:0/1055196144 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13082 (secure 0 0 0) 0x7fb4cc05e8d0 con 0x7fb4e00cf1d0 2024-09-16T07:31:53.549 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:53.550 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:31:52.199188+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/1633021756":"2024-09-17T07:31:49.193482+0000","172.21.15.114:6834/1633021756":"2024-09-17T07:31:49.193482+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:31:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4c0073220 msgr2=0x7fb4c00756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4c0073220 0x7fb4c00756e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4007fd0 tx=0x7fb4d4007940 comp rx=0 tx=0).stop 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e00cf1d0 msgr2=0x7fb4e0152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e00cf1d0 0x7fb4e0152b30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00b550 tx=0x7fb4cc00ba10 comp rx=0 tx=0).stop 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 shutdown_connections 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb4c0073220 0x7fb4c00756e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4e015f9a0 0x7fb4e00aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e00cf1d0 0x7fb4e0152b30 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 --2- 172.21.15.114:0/1055196144 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4e006e7a0 0x7fb4e01fb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 >> 172.21.15.114:0/1055196144 conn(0x7fb4e00b18f0 msgr2=0x7fb4e00d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 shutdown_connections 2024-09-16T07:31:53.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.551+0000 7fb4e8400640 1 -- 172.21.15.114:0/1055196144 wait complete. 2024-09-16T07:31:53.571 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:31:53.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:31:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.715+0000 7f30b1a00640 1 -- 172.21.15.114:0/2243049173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3090003fe0 msgr2=0x7f3090004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.715+0000 7f30b1a00640 1 --2- 172.21.15.114:0/2243049173 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3090003fe0 0x7f3090004810 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3094009b60 tx=0x7f309401d270 comp rx=0 tx=0).stop 2024-09-16T07:31:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.715+0000 7f30b1000640 1 -- 172.21.15.114:0/2243049173 reap_dead start 2024-09-16T07:31:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- 172.21.15.114:0/2243049173 shutdown_connections 2024-09-16T07:31:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- 172.21.15.114:0/2243049173 >> 172.21.15.114:0/2243049173 conn(0x7f30ac0742f0 msgr2=0x7f30ac074700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- 172.21.15.114:0/2243049173 shutdown_connections 2024-09-16T07:31:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- 172.21.15.114:0/2243049173 wait complete. 2024-09-16T07:31:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 Processor -- start 2024-09-16T07:31:53.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- start start 2024-09-16T07:31:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3090003fe0 0x7f30ac0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30ac15c770 0x7f30ac15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30ac0c5e60 0x7f30ac0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac15f760 con 0x7f30ac0c5e60 2024-09-16T07:31:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0cf5d0 con 0x7f3090003fe0 2024-09-16T07:31:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac15f8e0 con 0x7f30ac15c770 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30ac0c5e60 0x7f30ac0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30ac0c5e60 0x7f30ac0c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41972/0 (socket says 172.21.15.114:41972) 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 -- 172.21.15.114:0/1138887656 learned_addr learned my addr 172.21.15.114:0/1138887656 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30abe00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3090003fe0 0x7f30ac0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30a3400640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30ac15c770 0x7f30ac15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 -- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30ac15c770 msgr2=0x7f30ac15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30ac15c770 0x7f30ac15bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 -- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3090003fe0 msgr2=0x7f30ac0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3090003fe0 0x7f30ac0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 -- 172.21.15.114:0/1138887656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac0b0150 con 0x7f30ac0c5e60 2024-09-16T07:31:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30b1000640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30ac0c5e60 0x7f30ac0c62e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0711a0 tx=0x7f30a4006410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.719+0000 7f30a8c00640 1 -- 172.21.15.114:0/1138887656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4003b80 con 0x7f30ac0c5e60 2024-09-16T07:31:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30a8c00640 1 -- 172.21.15.114:0/1138887656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30a4003d20 con 0x7f30ac0c5e60 2024-09-16T07:31:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30a8c00640 1 -- 172.21.15.114:0/1138887656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4005370 con 0x7f30ac0c5e60 2024-09-16T07:31:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac0afb90 con 0x7f30ac0c5e60 2024-09-16T07:31:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac0c73a0 con 0x7f30ac0c5e60 2024-09-16T07:31:53.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac0cd4e0 con 0x7f30ac0c5e60 2024-09-16T07:31:53.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30a8c00640 1 -- 172.21.15.114:0/1138887656 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f30a4005510 con 0x7f30ac0c5e60 2024-09-16T07:31:53.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30a8c00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3088073250 0x7f3088075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:53.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30a8c00640 1 -- 172.21.15.114:0/1138887656 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f30a4097540 con 0x7f30ac0c5e60 2024-09-16T07:31:53.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.723+0000 7f30abe00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3088073250 0x7f3088075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:53.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.727+0000 7f30abe00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3088073250 0x7f3088075710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f309c009b80 tx=0x7f309c0091e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:53.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.727+0000 7f30a8c00640 1 -- 172.21.15.114:0/1138887656 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f30ac0d0e20 con 0x7f30ac0c5e60 2024-09-16T07:31:53.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.895+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f30ac0731e0 con 0x7f30ac0c5e60 2024-09-16T07:31:53.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.895+0000 7f30a8c00640 1 -- 172.21.15.114:0/1138887656 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f30a4062500 con 0x7f30ac0c5e60 2024-09-16T07:31:53.894 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:31:53.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.895+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3088073250 msgr2=0x7f3088075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.895+0000 7f30b1a00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3088073250 0x7f3088075710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f309c009b80 tx=0x7f309c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.895+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30ac0c5e60 msgr2=0x7f30ac0c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:53.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.895+0000 7f30b1a00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30ac0c5e60 0x7f30ac0c62e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0711a0 tx=0x7f30a4006410 comp rx=0 tx=0).stop 2024-09-16T07:31:53.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 shutdown_connections 2024-09-16T07:31:53.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f3088073250 0x7f3088075710 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30ac0c5e60 0x7f30ac0c62e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30ac15c770 0x7f30ac15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 --2- 172.21.15.114:0/1138887656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3090003fe0 0x7f30ac0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 >> 172.21.15.114:0/1138887656 conn(0x7f30ac0742f0 msgr2=0x7f30ac15fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 shutdown_connections 2024-09-16T07:31:53.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:53.899+0000 7f30b1a00640 1 -- 172.21.15.114:0/1138887656 wait complete. 2024-09-16T07:31:53.916 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-16T07:31:54.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- 172.21.15.114:0/1554671707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 msgr2=0x7fb11c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:54.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1554671707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb11c004810 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb128009b60 tx=0x7fb12801d250 comp rx=0 tx=0).stop 2024-09-16T07:31:54.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- 172.21.15.114:0/1554671707 shutdown_connections 2024-09-16T07:31:54.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1554671707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb11c004810 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:54.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- 172.21.15.114:0/1554671707 >> 172.21.15.114:0/1554671707 conn(0x7fb1380b18f0 msgr2=0x7fb1380b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:54.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- 172.21.15.114:0/1554671707 shutdown_connections 2024-09-16T07:31:54.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- 172.21.15.114:0/1554671707 wait complete. 2024-09-16T07:31:54.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 Processor -- start 2024-09-16T07:31:54.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- start start 2024-09-16T07:31:54.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb1382095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:54.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13815d3a0 0x7fb138169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:54.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb138162cb0 0x7fb138167010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:54.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1380b49e0 con 0x7fb11c0039c0 2024-09-16T07:31:54.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1380b4860 con 0x7fb138162cb0 2024-09-16T07:31:54.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb13dc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1380b4b60 con 0x7fb13815d3a0 2024-09-16T07:31:54.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb1382095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:54.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb1382095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41986/0 (socket says 172.21.15.114:41986) 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136a00640 1 -- 172.21.15.114:0/1211238022 learned_addr learned my addr 172.21.15.114:0/1211238022 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb137400640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb138162cb0 0x7fb138167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136000640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13815d3a0 0x7fb138169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136a00640 1 -- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13815d3a0 msgr2=0x7fb138169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136a00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13815d3a0 0x7fb138169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136a00640 1 -- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb138162cb0 msgr2=0x7fb138167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.107+0000 7fb136a00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb138162cb0 0x7fb138167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:54.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb136a00640 1 -- 172.21.15.114:0/1211238022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1380cecd0 con 0x7fb11c0039c0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb136000640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13815d3a0 0x7fb138169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb137400640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb138162cb0 0x7fb138167010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb136a00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb1382095c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb1280af040 tx=0x7fb128005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb12ea00640 1 -- 172.21.15.114:0/1211238022 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1280b1040 con 0x7fb11c0039c0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb12ea00640 1 -- 172.21.15.114:0/1211238022 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb128004120 con 0x7fb11c0039c0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1380cefb0 con 0x7fb11c0039c0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb12ea00640 1 -- 172.21.15.114:0/1211238022 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1280ac7b0 con 0x7fb11c0039c0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13816a050 con 0x7fb11c0039c0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb13806eb80 con 0x7fb11c0039c0 2024-09-16T07:31:54.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb12ea00640 1 -- 172.21.15.114:0/1211238022 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fb1280ac950 con 0x7fb11c0039c0 2024-09-16T07:31:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb12ea00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb118073220 0x7fb1180756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb12ea00640 1 -- 172.21.15.114:0/1211238022 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fb12812f1a0 con 0x7fb11c0039c0 2024-09-16T07:31:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.111+0000 7fb136000640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb118073220 0x7fb1180756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:54.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.115+0000 7fb136000640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb118073220 0x7fb1180756e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb1380b1840 tx=0x7fb124006bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:54.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.115+0000 7fb12ea00640 1 -- 172.21.15.114:0/1211238022 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb128016f60 con 0x7fb11c0039c0 2024-09-16T07:31:54.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:54.343+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7fb1380b14e0 con 0x7fb11c0039c0 2024-09-16T07:31:55.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.215+0000 7fb12ea00640 1 -- 172.21.15.114:0/1211238022 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v202) ==== 134+0+0 (secure 0 0 0) 0x7fb1280fa120 con 0x7fb11c0039c0 2024-09-16T07:31:55.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb118073220 msgr2=0x7fb1180756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb118073220 0x7fb1180756e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb1380b1840 tx=0x7fb124006bb0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 msgr2=0x7fb1382095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb1382095c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb1280af040 tx=0x7fb128005520 comp rx=0 tx=0).stop 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 shutdown_connections 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb118073220 0x7fb1180756e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb138162cb0 0x7fb138167010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13815d3a0 0x7fb138169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 --2- 172.21.15.114:0/1211238022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb11c0039c0 0x7fb1382095c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 >> 172.21.15.114:0/1211238022 conn(0x7fb1380b18f0 msgr2=0x7fb13816d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 shutdown_connections 2024-09-16T07:31:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.219+0000 7fb13dc00640 1 -- 172.21.15.114:0/1211238022 wait complete. 2024-09-16T07:31:55.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:31:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.387+0000 7fbe66400640 1 -- 172.21.15.114:0/4109320805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe48004d50 msgr2=0x7fbe480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.387+0000 7fbe66400640 1 --2- 172.21.15.114:0/4109320805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe48004d50 0x7fbe480051d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c640 tx=0x7fbe5801d260 comp rx=0 tx=0).stop 2024-09-16T07:31:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.387+0000 7fbe65a00640 1 -- 172.21.15.114:0/4109320805 reap_dead start 2024-09-16T07:31:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.387+0000 7fbe66400640 1 -- 172.21.15.114:0/4109320805 shutdown_connections 2024-09-16T07:31:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.387+0000 7fbe66400640 1 -- 172.21.15.114:0/4109320805 >> 172.21.15.114:0/4109320805 conn(0x7fbe6009aa10 msgr2=0x7fbe6009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.387+0000 7fbe66400640 1 -- 172.21.15.114:0/4109320805 shutdown_connections 2024-09-16T07:31:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.387+0000 7fbe66400640 1 -- 172.21.15.114:0/4109320805 wait complete. 2024-09-16T07:31:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 Processor -- start 2024-09-16T07:31:55.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 -- start start 2024-09-16T07:31:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe48004d50 0x7fbe60156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe60153540 0x7fbe600c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe601f3a80 0x7fbe600b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600cf340 con 0x7fbe60153540 2024-09-16T07:31:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600cf1c0 con 0x7fbe48004d50 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe600d19d0 con 0x7fbe601f3a80 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe60153540 0x7fbe600c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe60153540 0x7fbe600c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49690/0 (socket says 172.21.15.114:49690) 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 -- 172.21.15.114:0/3956431582 learned_addr learned my addr 172.21.15.114:0/3956431582 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe65000640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe48004d50 0x7fbe60156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe65a00640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe601f3a80 0x7fbe600b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 -- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe601f3a80 msgr2=0x7fbe600b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe601f3a80 0x7fbe600b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 -- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe48004d50 msgr2=0x7fbe60156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe48004d50 0x7fbe60156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 -- 172.21.15.114:0/3956431582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe600c9d90 con 0x7fbe60153540 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5fe00640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe60153540 0x7fbe600c69c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c011ae0 tx=0x7fbe4c009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5cc00640 1 -- 172.21.15.114:0/3956431582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c01e070 con 0x7fbe60153540 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5cc00640 1 -- 172.21.15.114:0/3956431582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe4c00fe40 con 0x7fbe60153540 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe5cc00640 1 -- 172.21.15.114:0/3956431582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0042b0 con 0x7fbe60153540 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe600ca030 con 0x7fbe60153540 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe600ca5f0 con 0x7fbe60153540 2024-09-16T07:31:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.391+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe600d1f30 con 0x7fbe60153540 2024-09-16T07:31:55.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.395+0000 7fbe5cc00640 1 -- 172.21.15.114:0/3956431582 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fbe4c021070 con 0x7fbe60153540 2024-09-16T07:31:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.395+0000 7fbe5cc00640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbe40073220 0x7fbe400756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.395+0000 7fbe5cc00640 1 -- 172.21.15.114:0/3956431582 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fbe4c094cd0 con 0x7fbe60153540 2024-09-16T07:31:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.395+0000 7fbe65000640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbe40073220 0x7fbe400756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.395+0000 7fbe65000640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbe40073220 0x7fbe400756e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe54000c10 tx=0x7fbe54006b20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.399+0000 7fbe5cc00640 1 -- 172.21.15.114:0/3956431582 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbe4c05f630 con 0x7fbe60153540 2024-09-16T07:31:55.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbe600715a0 con 0x7fbe60153540 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe5cc00640 1 -- 172.21.15.114:0/3956431582 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+1998 (secure 0 0 0) 0x7fbe4c064060 con 0x7fbe60153540 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:31:55.566 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:31:55.567 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:31:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:31:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:31:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:31:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:31:55.568 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbe40073220 msgr2=0x7fbe400756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbe40073220 0x7fbe400756e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe54000c10 tx=0x7fbe54006b20 comp rx=0 tx=0).stop 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe60153540 msgr2=0x7fbe600c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe60153540 0x7fbe600c69c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c011ae0 tx=0x7fbe4c009ea0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 shutdown_connections 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbe40073220 0x7fbe400756e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe601f3a80 0x7fbe600b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe60153540 0x7fbe600c69c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 --2- 172.21.15.114:0/3956431582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe48004d50 0x7fbe60156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.567+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 >> 172.21.15.114:0/3956431582 conn(0x7fbe6009aa10 msgr2=0x7fbe6006de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:55.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.571+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 shutdown_connections 2024-09-16T07:31:55.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.571+0000 7fbe66400640 1 -- 172.21.15.114:0/3956431582 wait complete. 2024-09-16T07:31:55.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:31:55.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.731+0000 7f5a13800640 1 -- 172.21.15.114:0/3977469281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c164ab0 msgr2=0x7f5a0c166ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.731+0000 7f5a13800640 1 --2- 172.21.15.114:0/3977469281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c166ea0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009bf0 tx=0x7f5a0401f2b0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.731+0000 7f5a13800640 1 -- 172.21.15.114:0/3977469281 shutdown_connections 2024-09-16T07:31:55.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.731+0000 7f5a13800640 1 --2- 172.21.15.114:0/3977469281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c166ea0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.731+0000 7f5a13800640 1 -- 172.21.15.114:0/3977469281 >> 172.21.15.114:0/3977469281 conn(0x7f5a0c0b18f0 msgr2=0x7f5a0c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:55.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.731+0000 7f5a13800640 1 -- 172.21.15.114:0/3977469281 shutdown_connections 2024-09-16T07:31:55.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.731+0000 7f5a13800640 1 -- 172.21.15.114:0/3977469281 wait complete. 2024-09-16T07:31:55.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 Processor -- start 2024-09-16T07:31:55.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 -- start start 2024-09-16T07:31:55.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a0c15bfa0 0x7f5a0c14a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c15c3e0 0x7f5a0c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c1673e0 con 0x7f5a0c164ab0 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c06f860 con 0x7f5a0c15c3e0 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0c167560 con 0x7f5a0c15bfa0 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c06e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49698/0 (socket says 172.21.15.114:49698) 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 -- 172.21.15.114:0/647713059 learned_addr learned my addr 172.21.15.114:0/647713059 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a03e00640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c15c3e0 0x7f5a0c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a10e00640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a0c15bfa0 0x7f5a0c14a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 -- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a0c15bfa0 msgr2=0x7f5a0c14a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a0c15bfa0 0x7f5a0c14a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 -- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c15c3e0 msgr2=0x7f5a0c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c15c3e0 0x7f5a0c0b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 -- 172.21.15.114:0/647713059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c0b0990 con 0x7f5a0c164ab0 2024-09-16T07:31:55.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a11800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c06e5f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5a0401cee0 tx=0x7f5a04005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:55.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a09600640 1 -- 172.21.15.114:0/647713059 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a040b4040 con 0x7f5a0c164ab0 2024-09-16T07:31:55.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a09600640 1 -- 172.21.15.114:0/647713059 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a04004b40 con 0x7f5a0c164ab0 2024-09-16T07:31:55.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a09600640 1 -- 172.21.15.114:0/647713059 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a040af6a0 con 0x7f5a0c164ab0 2024-09-16T07:31:55.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0c0b0c70 con 0x7f5a0c164ab0 2024-09-16T07:31:55.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.735+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0c0b1230 con 0x7f5a0c164ab0 2024-09-16T07:31:55.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.739+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0c069410 con 0x7f5a0c164ab0 2024-09-16T07:31:55.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.739+0000 7f5a09600640 1 -- 172.21.15.114:0/647713059 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f5a040c1020 con 0x7f5a0c164ab0 2024-09-16T07:31:55.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.739+0000 7f5a09600640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f59e8073220 0x7f59e80756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:55.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.739+0000 7f5a09600640 1 -- 172.21.15.114:0/647713059 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f5a041319e0 con 0x7f5a0c164ab0 2024-09-16T07:31:55.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.739+0000 7f5a10e00640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f59e8073220 0x7f59e80756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:55.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.739+0000 7f5a10e00640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f59e8073220 0x7f59e80756e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59fc000fc0 tx=0x7f59fc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:55.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.743+0000 7f5a09600640 1 -- 172.21.15.114:0/647713059 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5a04018e50 con 0x7f5a0c164ab0 2024-09-16T07:31:55.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.915+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5a0c0cd000 con 0x7f5a0c164ab0 2024-09-16T07:31:55.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.915+0000 7f5a09600640 1 -- 172.21.15.114:0/647713059 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f5a040fc9d0 con 0x7f5a0c164ab0 2024-09-16T07:31:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f59e8073220 msgr2=0x7f59e80756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f59e8073220 0x7f59e80756e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f59fc000fc0 tx=0x7f59fc009040 comp rx=0 tx=0).stop 2024-09-16T07:31:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a0c164ab0 msgr2=0x7f5a0c06e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c06e5f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5a0401cee0 tx=0x7f5a04005aa0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 shutdown_connections 2024-09-16T07:31:55.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f59e8073220 0x7f59e80756e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a0c164ab0 0x7f5a0c06e5f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a0c15c3e0 0x7f5a0c0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 --2- 172.21.15.114:0/647713059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a0c15bfa0 0x7f5a0c14a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 >> 172.21.15.114:0/647713059 conn(0x7f5a0c0b18f0 msgr2=0x7f5a0c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 shutdown_connections 2024-09-16T07:31:55.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:55.919+0000 7f5a13800640 1 -- 172.21.15.114:0/647713059 wait complete. 2024-09-16T07:31:55.937 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:31:55.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:56.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:31:56.126 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:31:56.127 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:56.127 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:56.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:31:56.135 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:56.136 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:56.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:31:56.145 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:31:56.145 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:56.189 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:31:56.189 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:31:56.189 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:31:56.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:31:56.198 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:31:56.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:31:56.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- 172.21.15.114:0/513934859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c0d28c0 msgr2=0x7f224c0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 --2- 172.21.15.114:0/513934859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c0d28c0 0x7f224c0cea20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f224c073d80 tx=0x7f223401c8c0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- 172.21.15.114:0/513934859 shutdown_connections 2024-09-16T07:31:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 --2- 172.21.15.114:0/513934859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c0d28c0 0x7f224c0cea20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 --2- 172.21.15.114:0/513934859 >> v2:172.21.15.149:3300/0 conn(0x7f224c15be80 0x7f224c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- 172.21.15.114:0/513934859 >> 172.21.15.114:0/513934859 conn(0x7f224c0d1da0 msgr2=0x7f224c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- 172.21.15.114:0/513934859 shutdown_connections 2024-09-16T07:31:56.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- 172.21.15.114:0/513934859 wait complete. 2024-09-16T07:31:56.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 Processor -- start 2024-09-16T07:31:56.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- start start 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f224c0b53f0 0x7f224c155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224c0d28c0 0x7f224c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c15be80 0x7f224c06f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f224c169220 con 0x7f224c15be80 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f224c1690a0 con 0x7f224c0b53f0 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.375+0000 7f2252600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f224c1693a0 con 0x7f224c0d28c0 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c15be80 0x7f224c06f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:56.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c15be80 0x7f224c06f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49718/0 (socket says 172.21.15.114:49718) 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 -- 172.21.15.114:0/977401433 learned_addr learned my addr 172.21.15.114:0/977401433 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224b400640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f224c0b53f0 0x7f224c155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2242a00640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224c0d28c0 0x7f224c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 -- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224c0d28c0 msgr2=0x7f224c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224c0d28c0 0x7f224c06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 -- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f224c0b53f0 msgr2=0x7f224c155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f224c0b53f0 0x7f224c155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 -- 172.21.15.114:0/977401433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c06e790 con 0x7f224c15be80 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f224be00640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c15be80 0x7f224c06f490 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f224400c4d0 tx=0x7f224400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2243e00640 1 -- 172.21.15.114:0/977401433 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440052d0 con 0x7f224c15be80 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2243e00640 1 -- 172.21.15.114:0/977401433 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2244005470 con 0x7f224c15be80 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2243e00640 1 -- 172.21.15.114:0/977401433 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244012870 con 0x7f224c15be80 2024-09-16T07:31:56.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224c165220 con 0x7f224c15be80 2024-09-16T07:31:56.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f224c156360 con 0x7f224c15be80 2024-09-16T07:31:56.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c0b57f0 con 0x7f224c15be80 2024-09-16T07:31:56.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.379+0000 7f2243e00640 1 -- 172.21.15.114:0/977401433 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f2244003600 con 0x7f224c15be80 2024-09-16T07:31:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.383+0000 7f2243e00640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2228073220 0x7f22280756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:31:56.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.383+0000 7f2243e00640 1 -- 172.21.15.114:0/977401433 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f2244093c90 con 0x7f224c15be80 2024-09-16T07:31:56.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.383+0000 7f224b400640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2228073220 0x7f22280756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:31:56.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.383+0000 7f224b400640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2228073220 0x7f22280756e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f223c009f30 tx=0x7f223c0096a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:31:56.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.387+0000 7f2243e00640 1 -- 172.21.15.114:0/977401433 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f224c165220 con 0x7f224c15be80 2024-09-16T07:31:56.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f224c06ec00 con 0x7f224c15be80 2024-09-16T07:31:56.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2243e00640 1 -- 172.21.15.114:0/977401433 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+3917 (secure 0 0 0) 0x7f224c0d0350 con 0x7f224c15be80 2024-09-16T07:31:56.585 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:31:56.585 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"btime":"2024-09-16T07:31:50:195504+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/204209379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":204209379},{"type":"v1","addr":"172.21.15.149:6836","nonce":204209379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1846247659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":1846247659},{"type":"v1","addr":"172.21.15.149:6837","nonce":1846247659}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5757,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/350567716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":350567716},{"type":"v1","addr":"172.21.15.114:6833","nonce":350567716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1723822591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1723822591},{"type":"v1","addr":"172.21.15.114:6835","nonce":1723822591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[]} 2024-09-16T07:31:56.586 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 39 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2228073220 msgr2=0x7f22280756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2228073220 0x7f22280756e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f223c009f30 tx=0x7f223c0096a0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c15be80 msgr2=0x7f224c06f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c15be80 0x7f224c06f490 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f224400c4d0 tx=0x7f224400c990 comp rx=0 tx=0).stop 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 shutdown_connections 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2228073220 0x7f22280756e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f224c15be80 0x7f224c06f490 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f224c0d28c0 0x7f224c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 --2- 172.21.15.114:0/977401433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f224c0b53f0 0x7f224c155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 >> 172.21.15.114:0/977401433 conn(0x7f224c0d1da0 msgr2=0x7f224c15e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:31:56.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 shutdown_connections 2024-09-16T07:31:56.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:31:56.587+0000 7f2252600640 1 -- 172.21.15.114:0/977401433 wait complete. 2024-09-16T07:31:56.608 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:31:56.608 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:31:56.608 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:31:56.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:56.609 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:31:56.609 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:31:56.609 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:31:56.609 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:56.609 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:31:56.609 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:31:56.609 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:31:56.610 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:56.610 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:31:56.610 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:31:56.610 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:31:56.610 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:31:56.621 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:31:56.621 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:31:56.622 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:31:56.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:31:56.624 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:31:56.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:31:56.670 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:31:56.670 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:56.672 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:31:56.672 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:56.674 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:31:56.675 DEBUG:teuthology.parallel:result is None 2024-09-16T07:31:56.754 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:31:56.754 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:31:56.764 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:32:00.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-16T07:32:02.624 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:32:02.624 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:32:02.628 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:32:02.629 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:02.629 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:32:02.721 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:32:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- 172.21.15.114:0/1403934644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 msgr2=0x7fcb580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 --2- 172.21.15.114:0/1403934644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 0x7fcb580051d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009ef0 tx=0x7fcb6c01d1d0 comp rx=0 tx=0).stop 2024-09-16T07:32:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb76800640 1 -- 172.21.15.114:0/1403934644 reap_dead start 2024-09-16T07:32:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- 172.21.15.114:0/1403934644 shutdown_connections 2024-09-16T07:32:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- 172.21.15.114:0/1403934644 >> 172.21.15.114:0/1403934644 conn(0x7fcb7009aa10 msgr2=0x7fcb7009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- 172.21.15.114:0/1403934644 shutdown_connections 2024-09-16T07:32:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- 172.21.15.114:0/1403934644 wait complete. 2024-09-16T07:32:02.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 Processor -- start 2024-09-16T07:32:02.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- start start 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 0x7fcb700c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb700b7550 0x7fcb70152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb70156160 0x7fcb701565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcb700cf340 con 0x7fcb58004d50 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb700cf1c0 con 0x7fcb70156160 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb77200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcb700d19d0 con 0x7fcb700b7550 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb75e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 0x7fcb700c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb75e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 0x7fcb700c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49756/0 (socket says 172.21.15.114:49756) 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb75e00640 1 -- 172.21.15.114:0/2667953514 learned_addr learned my addr 172.21.15.114:0/2667953514 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb76800640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb70156160 0x7fcb701565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.787+0000 7fcb75400640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb700b7550 0x7fcb70152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb75e00640 1 -- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb700b7550 msgr2=0x7fcb70152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb75e00640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb700b7550 0x7fcb70152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb75e00640 1 -- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb70156160 msgr2=0x7fcb701565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb75e00640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb70156160 0x7fcb701565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb75e00640 1 -- 172.21.15.114:0/2667953514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb700b7ac0 con 0x7fcb58004d50 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb76800640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb70156160 0x7fcb701565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb75e00640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 0x7fcb700c8ca0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcb64003f30 tx=0x7fcb64001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb6a000640 1 -- 172.21.15.114:0/2667953514 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64011640 con 0x7fcb58004d50 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb6a000640 1 -- 172.21.15.114:0/2667953514 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb64016020 con 0x7fcb58004d50 2024-09-16T07:32:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb70157120 con 0x7fcb58004d50 2024-09-16T07:32:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb6a000640 1 -- 172.21.15.114:0/2667953514 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64011a80 con 0x7fcb58004d50 2024-09-16T07:32:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb700cb500 con 0x7fcb58004d50 2024-09-16T07:32:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb700d0780 con 0x7fcb58004d50 2024-09-16T07:32:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb6a000640 1 -- 172.21.15.114:0/2667953514 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fcb64011c20 con 0x7fcb58004d50 2024-09-16T07:32:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb6a000640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb54073250 0x7fcb54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb6a000640 1 -- 172.21.15.114:0/2667953514 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fcb64094da0 con 0x7fcb58004d50 2024-09-16T07:32:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.791+0000 7fcb75400640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb54073250 0x7fcb54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.795+0000 7fcb75400640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb54073250 0x7fcb54075710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb700c8260 tx=0x7fcb600067b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:02.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.795+0000 7fcb6a000640 1 -- 172.21.15.114:0/2667953514 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcb64020020 con 0x7fcb58004d50 2024-09-16T07:32:02.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:02.971+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcb70076210 con 0x7fcb58004d50 2024-09-16T07:32:04.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.259+0000 7fcb6a000640 1 -- 172.21.15.114:0/2667953514 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) ==== 97+0+0 (secure 0 0 0) 0x7fcb6405fe20 con 0x7fcb58004d50 2024-09-16T07:32:04.257 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb54073250 msgr2=0x7fcb54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb54073250 0x7fcb54075710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb700c8260 tx=0x7fcb600067b0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 msgr2=0x7fcb700c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 0x7fcb700c8ca0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcb64003f30 tx=0x7fcb64001700 comp rx=0 tx=0).stop 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 shutdown_connections 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcb54073250 0x7fcb54075710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb70156160 0x7fcb701565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb700b7550 0x7fcb70152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 --2- 172.21.15.114:0/2667953514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb58004d50 0x7fcb700c8ca0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 >> 172.21.15.114:0/2667953514 conn(0x7fcb7009aa10 msgr2=0x7fcb70071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 shutdown_connections 2024-09-16T07:32:04.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.263+0000 7fcb77200640 1 -- 172.21.15.114:0/2667953514 wait complete. 2024-09-16T07:32:04.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:32:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- 172.21.15.114:0/4217966351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8940cd8c0 msgr2=0x7fa8940cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 --2- 172.21.15.114:0/4217966351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8940cd8c0 0x7fa8940cea20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009840 tx=0x7fa88c01c820 comp rx=0 tx=0).stop 2024-09-16T07:32:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- 172.21.15.114:0/4217966351 shutdown_connections 2024-09-16T07:32:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 --2- 172.21.15.114:0/4217966351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8940cd8c0 0x7fa8940cea20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 --2- 172.21.15.114:0/4217966351 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa89415be80 0x7fa8940ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- 172.21.15.114:0/4217966351 >> 172.21.15.114:0/4217966351 conn(0x7fa8940d1da0 msgr2=0x7fa8940d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- 172.21.15.114:0/4217966351 shutdown_connections 2024-09-16T07:32:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- 172.21.15.114:0/4217966351 wait complete. 2024-09-16T07:32:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 Processor -- start 2024-09-16T07:32:04.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- start start 2024-09-16T07:32:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8940cd8c0 0x7fa894158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940d28c0 0x7fa894165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89415be80 0x7fa894165870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa894168de0 con 0x7fa8940cd8c0 2024-09-16T07:32:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa894168c60 con 0x7fa89415be80 2024-09-16T07:32:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.431+0000 7fa89b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa894168f60 con 0x7fa8940d28c0 2024-09-16T07:32:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8940cd8c0 0x7fa894158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8940cd8c0 0x7fa894158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55602/0 (socket says 172.21.15.114:55602) 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 -- 172.21.15.114:0/3696799423 learned_addr learned my addr 172.21.15.114:0/3696799423 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa899000640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89415be80 0x7fa894165870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893400640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940d28c0 0x7fa894165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 -- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940d28c0 msgr2=0x7fa894165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940d28c0 0x7fa894165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 -- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89415be80 msgr2=0x7fa894165870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89415be80 0x7fa894165870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 -- 172.21.15.114:0/3696799423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89406dd30 con 0x7fa8940cd8c0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa893e00640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8940cd8c0 0x7fa894158520 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa88400ebf0 tx=0x7fa88400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa88be00640 1 -- 172.21.15.114:0/3696799423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884010630 con 0x7fa8940cd8c0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa88be00640 1 -- 172.21.15.114:0/3696799423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8840108c0 con 0x7fa8940cd8c0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89406e010 con 0x7fa8940cd8c0 2024-09-16T07:32:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa88be00640 1 -- 172.21.15.114:0/3696799423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884010cf0 con 0x7fa8940cd8c0 2024-09-16T07:32:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89406e5d0 con 0x7fa8940cd8c0 2024-09-16T07:32:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8940b53f0 con 0x7fa8940cd8c0 2024-09-16T07:32:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.435+0000 7fa88be00640 1 -- 172.21.15.114:0/3696799423 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fa884018420 con 0x7fa8940cd8c0 2024-09-16T07:32:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.439+0000 7fa88be00640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa874073220 0x7fa8740756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.439+0000 7fa88be00640 1 -- 172.21.15.114:0/3696799423 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fa884094f00 con 0x7fa8940cd8c0 2024-09-16T07:32:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.439+0000 7fa893400640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa874073220 0x7fa8740756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.439+0000 7fa893400640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa874073220 0x7fa8740756e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa880007fd0 tx=0x7fa880007f60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:04.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.443+0000 7fa88be00640 1 -- 172.21.15.114:0/3696799423 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa88405f870 con 0x7fa8940cd8c0 2024-09-16T07:32:04.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa8940b7470 con 0x7fa8940cd8c0 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa88be00640 1 -- 172.21.15.114:0/3696799423 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5616 (secure 0 0 0) 0x7fa8840642a0 con 0x7fa8940cd8c0 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:32:04.665 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:04.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.668 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.671 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.673 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.674 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:32:04.675 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:04.676 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.677 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.alice", 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDc3udmMzejJxAAN3hR9csBBL2+8gqVQyNtfQ==", 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol2800", 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:32:04.678 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:04.679 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.680 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:04.680 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:04.680 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa874073220 msgr2=0x7fa8740756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa874073220 0x7fa8740756e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa880007fd0 tx=0x7fa880007f60 comp rx=0 tx=0).stop 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8940cd8c0 msgr2=0x7fa894158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8940cd8c0 0x7fa894158520 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa88400ebf0 tx=0x7fa88400c6a0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 shutdown_connections 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa874073220 0x7fa8740756e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa89415be80 0x7fa894165870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8940d28c0 0x7fa894165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 --2- 172.21.15.114:0/3696799423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8940cd8c0 0x7fa894158520 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 >> 172.21.15.114:0/3696799423 conn(0x7fa8940d1da0 msgr2=0x7fa8940712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 shutdown_connections 2024-09-16T07:32:04.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.667+0000 7fa89b000640 1 -- 172.21.15.114:0/3696799423 wait complete. 2024-09-16T07:32:04.687 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.alice 2024-09-16T07:32:04.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 -- 172.21.15.114:0/3171116615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734015e260 msgr2=0x7f73400b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 --2- 172.21.15.114:0/3171116615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734015e260 0x7f73400b2bf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f73400af700 tx=0x7f733401c830 comp rx=0 tx=0).stop 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 -- 172.21.15.114:0/3171116615 shutdown_connections 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 --2- 172.21.15.114:0/3171116615 >> v2:172.21.15.149:3300/0 conn(0x7f73400b4cf0 0x7f734015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 --2- 172.21.15.114:0/3171116615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73400cc2a0 0x7f73400b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 --2- 172.21.15.114:0/3171116615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734015e260 0x7f73400b2bf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 -- 172.21.15.114:0/3171116615 >> 172.21.15.114:0/3171116615 conn(0x7f73400b18f0 msgr2=0x7f73400b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 -- 172.21.15.114:0/3171116615 shutdown_connections 2024-09-16T07:32:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 -- 172.21.15.114:0/3171116615 wait complete. 2024-09-16T07:32:04.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.831+0000 7f7348400640 1 Processor -- start 2024-09-16T07:32:04.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 -- start start 2024-09-16T07:32:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73400b4cf0 0x7f73401f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734015e260 0x7f7340154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73400adc60 0x7f7340163d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f734006f460 con 0x7f73400b4cf0 2024-09-16T07:32:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f734006f2e0 con 0x7f73400adc60 2024-09-16T07:32:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f734006f5e0 con 0x7f734015e260 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73400b4cf0 0x7f73401f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73400b4cf0 0x7f73401f85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55622/0 (socket says 172.21.15.114:55622) 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 -- 172.21.15.114:0/704980607 learned_addr learned my addr 172.21.15.114:0/704980607 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345000640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734015e260 0x7f7340154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7346400640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73400adc60 0x7f7340163d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 -- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734015e260 msgr2=0x7f7340154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734015e260 0x7f7340154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 -- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73400adc60 msgr2=0x7f7340163d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73400adc60 0x7f7340163d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 -- 172.21.15.114:0/704980607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7340145570 con 0x7f73400b4cf0 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7345a00640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73400b4cf0 0x7f73401f85d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f73340b0040 tx=0x7f73340a5830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f733d600640 1 -- 172.21.15.114:0/704980607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73340b2040 con 0x7f73400b4cf0 2024-09-16T07:32:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f733d600640 1 -- 172.21.15.114:0/704980607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73340043c0 con 0x7f73400b4cf0 2024-09-16T07:32:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f733d600640 1 -- 172.21.15.114:0/704980607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334005290 con 0x7f73400b4cf0 2024-09-16T07:32:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7340145850 con 0x7f73400b4cf0 2024-09-16T07:32:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7340145e10 con 0x7f73400b4cf0 2024-09-16T07:32:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.835+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7340069410 con 0x7f73400b4cf0 2024-09-16T07:32:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.839+0000 7f733d600640 1 -- 172.21.15.114:0/704980607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f7334005430 con 0x7f73400b4cf0 2024-09-16T07:32:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.839+0000 7f733d600640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7320073220 0x7f73200756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.839+0000 7f733d600640 1 -- 172.21.15.114:0/704980607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f733412dc20 con 0x7f73400b4cf0 2024-09-16T07:32:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.839+0000 7f7345000640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7320073220 0x7f73200756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:04.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.839+0000 7f7345000640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7320073220 0x7f73200756e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f732c0058d0 tx=0x7f732c005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:04.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:04.843+0000 7f733d600640 1 -- 172.21.15.114:0/704980607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f73340164b0 con 0x7f73400b4cf0 2024-09-16T07:32:05.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.067+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.alice"} v 0) -- 0x7f7340156b20 con 0x7f73400b4cf0 2024-09-16T07:32:05.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.071+0000 7f733d600640 1 -- 172.21.15.114:0/704980607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.alice"}]=0 v19) ==== 82+0+0 (secure 0 0 0) 0x7f73340f8bf0 con 0x7f73400b4cf0 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7320073220 msgr2=0x7f73200756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7320073220 0x7f73200756e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f732c0058d0 tx=0x7f732c005860 comp rx=0 tx=0).stop 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73400b4cf0 msgr2=0x7f73401f85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73400b4cf0 0x7f73401f85d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f73340b0040 tx=0x7f73340a5830 comp rx=0 tx=0).stop 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 shutdown_connections 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f7320073220 0x7f73200756e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73400adc60 0x7f7340163d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734015e260 0x7f7340154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 --2- 172.21.15.114:0/704980607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73400b4cf0 0x7f73401f85d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 >> 172.21.15.114:0/704980607 conn(0x7f73400b18f0 msgr2=0x7f73400cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 shutdown_connections 2024-09-16T07:32:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.075+0000 7f7348400640 1 -- 172.21.15.114:0/704980607 wait complete. 2024-09-16T07:32:05.093 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:32:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- 172.21.15.114:0/907092750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce881602c0 msgr2=0x7fce880ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 --2- 172.21.15.114:0/907092750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce881602c0 0x7fce880ce2e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fce880d0ce0 tx=0x7fce8001cd50 comp rx=0 tx=0).stop 2024-09-16T07:32:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- 172.21.15.114:0/907092750 shutdown_connections 2024-09-16T07:32:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 --2- 172.21.15.114:0/907092750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce881602c0 0x7fce880ce2e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 --2- 172.21.15.114:0/907092750 >> v2:172.21.15.149:3300/0 conn(0x7fce880cf1d0 0x7fce8815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 --2- 172.21.15.114:0/907092750 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce8815f9a0 0x7fce8806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- 172.21.15.114:0/907092750 >> 172.21.15.114:0/907092750 conn(0x7fce880b18f0 msgr2=0x7fce880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- 172.21.15.114:0/907092750 shutdown_connections 2024-09-16T07:32:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- 172.21.15.114:0/907092750 wait complete. 2024-09-16T07:32:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 Processor -- start 2024-09-16T07:32:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- start start 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce880cf1d0 0x7fce881548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8815f9a0 0x7fce8815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce881602c0 0x7fce8815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce8815c790 con 0x7fce880cf1d0 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce8815c610 con 0x7fce8815f9a0 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce8cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce8815c910 con 0x7fce881602c0 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce880cf1d0 0x7fce881548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce880cf1d0 0x7fce881548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55650/0 (socket says 172.21.15.114:55650) 2024-09-16T07:32:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.239+0000 7fce85e00640 1 -- 172.21.15.114:0/623734263 learned_addr learned my addr 172.21.15.114:0/623734263 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce86800640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce881602c0 0x7fce8815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce7d400640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8815f9a0 0x7fce8815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce85e00640 1 -- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce881602c0 msgr2=0x7fce8815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce85e00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce881602c0 0x7fce8815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce85e00640 1 -- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8815f9a0 msgr2=0x7fce8815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce85e00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8815f9a0 0x7fce8815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce85e00640 1 -- 172.21.15.114:0/623734263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8815c1a0 con 0x7fce880cf1d0 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce85e00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce880cf1d0 0x7fce881548c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d9b0 tx=0x7fce7800de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce7ea00640 1 -- 172.21.15.114:0/623734263 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78017070 con 0x7fce880cf1d0 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce7ea00640 1 -- 172.21.15.114:0/623734263 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce78004310 con 0x7fce880cf1d0 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce881f9170 con 0x7fce880cf1d0 2024-09-16T07:32:05.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce7ea00640 1 -- 172.21.15.114:0/623734263 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78009c30 con 0x7fce880cf1d0 2024-09-16T07:32:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce881f9730 con 0x7fce880cf1d0 2024-09-16T07:32:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce88069410 con 0x7fce880cf1d0 2024-09-16T07:32:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce7ea00640 1 -- 172.21.15.114:0/623734263 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fce78003600 con 0x7fce880cf1d0 2024-09-16T07:32:05.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.243+0000 7fce7ea00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce64073250 0x7fce64075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.247+0000 7fce7ea00640 1 -- 172.21.15.114:0/623734263 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fce78094020 con 0x7fce880cf1d0 2024-09-16T07:32:05.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.247+0000 7fce7d400640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce64073250 0x7fce64075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.247+0000 7fce7d400640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce64073250 0x7fce64075710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fce70005fd0 tx=0x7fce70005e60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.247+0000 7fce7ea00640 1 -- 172.21.15.114:0/623734263 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fce7805ef60 con 0x7fce880cf1d0 2024-09-16T07:32:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.419+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fce8806e7a0 con 0x7fce880cf1d0 2024-09-16T07:32:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.419+0000 7fce7ea00640 1 -- 172.21.15.114:0/623734263 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7fce7805e860 con 0x7fce880cf1d0 2024-09-16T07:32:05.419 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:05.419 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:32:05.420 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:05.420 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:32:05.420 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:32:05.420 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:05.420 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:32:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce64073250 msgr2=0x7fce64075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce64073250 0x7fce64075710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fce70005fd0 tx=0x7fce70005e60 comp rx=0 tx=0).stop 2024-09-16T07:32:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce880cf1d0 msgr2=0x7fce881548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce880cf1d0 0x7fce881548c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d9b0 tx=0x7fce7800de70 comp rx=0 tx=0).stop 2024-09-16T07:32:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 shutdown_connections 2024-09-16T07:32:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fce64073250 0x7fce64075710 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce881602c0 0x7fce8815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce8815f9a0 0x7fce8815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 --2- 172.21.15.114:0/623734263 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce880cf1d0 0x7fce881548c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 >> 172.21.15.114:0/623734263 conn(0x7fce880b18f0 msgr2=0x7fce88073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 shutdown_connections 2024-09-16T07:32:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.423+0000 7fce8cc00640 1 -- 172.21.15.114:0/623734263 wait complete. 2024-09-16T07:32:05.441 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:32:05.441 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:32:05.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 -- 172.21.15.114:0/1443520105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 msgr2=0x7fbb7c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 --2- 172.21.15.114:0/1443520105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15c070 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c073040 tx=0x7fbb6801c770 comp rx=0 tx=0).stop 2024-09-16T07:32:05.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 -- 172.21.15.114:0/1443520105 shutdown_connections 2024-09-16T07:32:05.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 --2- 172.21.15.114:0/1443520105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15c070 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 --2- 172.21.15.114:0/1443520105 >> v2:172.21.15.149:3300/0 conn(0x7fbb7c15bc90 0x7fbb7c074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 -- 172.21.15.114:0/1443520105 >> 172.21.15.114:0/1443520105 conn(0x7fbb7c06dd30 msgr2=0x7fbb7c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:05.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 -- 172.21.15.114:0/1443520105 shutdown_connections 2024-09-16T07:32:05.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 -- 172.21.15.114:0/1443520105 wait complete. 2024-09-16T07:32:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.587+0000 7fbb84400640 1 Processor -- start 2024-09-16T07:32:05.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 -- start start 2024-09-16T07:32:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c15bc90 0x7fbb7c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb7c15c5b0 0x7fbb7c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c168b30 con 0x7fbb7c1601a0 2024-09-16T07:32:05.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c0b0710 con 0x7fbb7c15bc90 2024-09-16T07:32:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbb7c168cb0 con 0x7fbb7c15c5b0 2024-09-16T07:32:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55678/0 (socket says 172.21.15.114:55678) 2024-09-16T07:32:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 -- 172.21.15.114:0/3124714736 learned_addr learned my addr 172.21.15.114:0/3124714736 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:05.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb81000640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb7c15c5b0 0x7fbb7c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb81a00640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c15bc90 0x7fbb7c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 -- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb7c15c5b0 msgr2=0x7fbb7c14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb7c15c5b0 0x7fbb7c14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 -- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c15bc90 msgr2=0x7fbb7c14e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:05.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c15bc90 0x7fbb7c14e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:05.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 -- 172.21.15.114:0/3124714736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c137510 con 0x7fbb7c1601a0 2024-09-16T07:32:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb81a00640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c15bc90 0x7fbb7c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb82400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15ca60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c730 tx=0x7fbb7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb79600640 1 -- 172.21.15.114:0/3124714736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74003b80 con 0x7fbb7c1601a0 2024-09-16T07:32:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb79600640 1 -- 172.21.15.114:0/3124714736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb74003d40 con 0x7fbb7c1601a0 2024-09-16T07:32:05.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb79600640 1 -- 172.21.15.114:0/3124714736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74005330 con 0x7fbb7c1601a0 2024-09-16T07:32:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7c1377f0 con 0x7fbb7c1601a0 2024-09-16T07:32:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7c137db0 con 0x7fbb7c1601a0 2024-09-16T07:32:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.591+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7c074580 con 0x7fbb7c1601a0 2024-09-16T07:32:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.595+0000 7fbb79600640 1 -- 172.21.15.114:0/3124714736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fbb740056e0 con 0x7fbb7c1601a0 2024-09-16T07:32:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.595+0000 7fbb79600640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbb5c073220 0x7fbb5c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:05.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.595+0000 7fbb79600640 1 -- 172.21.15.114:0/3124714736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fbb74094170 con 0x7fbb7c1601a0 2024-09-16T07:32:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.595+0000 7fbb81a00640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbb5c073220 0x7fbb5c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:05.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.595+0000 7fbb81a00640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbb5c073220 0x7fbb5c0756e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb700058d0 tx=0x7fbb70005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:05.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.599+0000 7fbb79600640 1 -- 172.21.15.114:0/3124714736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbb7c0ae000 con 0x7fbb7c1601a0 2024-09-16T07:32:05.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:05.767+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbb7c15a7c0 con 0x7fbb7c1601a0 2024-09-16T07:32:06.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.271+0000 7fbb79600640 1 -- 172.21.15.114:0/3124714736 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7fbb7405f140 con 0x7fbb7c1601a0 2024-09-16T07:32:06.270 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:32:06.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbb5c073220 msgr2=0x7fbb5c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbb5c073220 0x7fbb5c0756e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbb700058d0 tx=0x7fbb70005860 comp rx=0 tx=0).stop 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 msgr2=0x7fbb7c15ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15ca60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c730 tx=0x7fbb7400cbf0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 shutdown_connections 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbb5c073220 0x7fbb5c0756e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb7c1601a0 0x7fbb7c15ca60 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbb7c15c5b0 0x7fbb7c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 --2- 172.21.15.114:0/3124714736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbb7c15bc90 0x7fbb7c14e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 >> 172.21.15.114:0/3124714736 conn(0x7fbb7c06dd30 msgr2=0x7fbb7c156730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 shutdown_connections 2024-09-16T07:32:06.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.275+0000 7fbb84400640 1 -- 172.21.15.114:0/3124714736 wait complete. 2024-09-16T07:32:06.297 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:32:06.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.447+0000 7f7443e00640 1 -- 172.21.15.114:0/1405720324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c15ade0 msgr2=0x7f743c0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:06.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.447+0000 7f7443e00640 1 --2- 172.21.15.114:0/1405720324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c15ade0 0x7f743c0cebf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f743c0708e0 tx=0x7f743001c8c0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- 172.21.15.114:0/1405720324 shutdown_connections 2024-09-16T07:32:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 --2- 172.21.15.114:0/1405720324 >> v2:172.21.15.149:3300/0 conn(0x7f743c0b4bd0 0x7f743c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 --2- 172.21.15.114:0/1405720324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c15ade0 0x7f743c0cebf0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- 172.21.15.114:0/1405720324 >> 172.21.15.114:0/1405720324 conn(0x7f743c0b18f0 msgr2=0x7f743c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- 172.21.15.114:0/1405720324 shutdown_connections 2024-09-16T07:32:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- 172.21.15.114:0/1405720324 wait complete. 2024-09-16T07:32:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 Processor -- start 2024-09-16T07:32:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- start start 2024-09-16T07:32:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c06e810 0x7f743c14e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c0b4bd0 0x7f743c153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f743c15ade0 0x7f743c156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1680e0 con 0x7f743c06e810 2024-09-16T07:32:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f743c167f60 con 0x7f743c0b4bd0 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7443e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f743c168260 con 0x7f743c15ade0 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c06e810 0x7f743c14e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c06e810 0x7f743c14e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55694/0 (socket says 172.21.15.114:55694) 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 -- 172.21.15.114:0/3765938976 learned_addr learned my addr 172.21.15.114:0/3765938976 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7440a00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c0b4bd0 0x7f743c153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f743c15ade0 0x7f743c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 -- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f743c15ade0 msgr2=0x7f743c156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f743c15ade0 0x7f743c156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 -- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c0b4bd0 msgr2=0x7f743c153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c0b4bd0 0x7f743c153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 -- 172.21.15.114:0/3765938976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c152d90 con 0x7f743c06e810 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f743c15ade0 0x7f743c156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7441400640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c06e810 0x7f743c14e8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7430009850 tx=0x7f74300a64d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.451+0000 7f7439600640 1 -- 172.21.15.114:0/3765938976 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74300ac070 con 0x7f743c06e810 2024-09-16T07:32:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.455+0000 7f7439600640 1 -- 172.21.15.114:0/3765938976 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7430004320 con 0x7f743c06e810 2024-09-16T07:32:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.455+0000 7f7439600640 1 -- 172.21.15.114:0/3765938976 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7430005320 con 0x7f743c06e810 2024-09-16T07:32:06.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.455+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c153070 con 0x7f743c06e810 2024-09-16T07:32:06.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.455+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c153630 con 0x7f743c06e810 2024-09-16T07:32:06.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.455+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743c069410 con 0x7f743c06e810 2024-09-16T07:32:06.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.455+0000 7f7439600640 1 -- 172.21.15.114:0/3765938976 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f74300af070 con 0x7f743c06e810 2024-09-16T07:32:06.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.459+0000 7f7439600640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f741c073220 0x7f741c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:06.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.459+0000 7f7439600640 1 -- 172.21.15.114:0/3765938976 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5227+0+0 (secure 0 0 0) 0x7f743012ed00 con 0x7f743c06e810 2024-09-16T07:32:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.459+0000 7f7440a00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f741c073220 0x7f741c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.459+0000 7f7440a00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f741c073220 0x7f741c0756e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f743c165c10 tx=0x7f7428007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:06.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.459+0000 7f7439600640 1 -- 172.21.15.114:0/3765938976 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f74300164b0 con 0x7f743c06e810 2024-09-16T07:32:06.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:06.627+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f743c15e900 con 0x7f743c06e810 2024-09-16T07:32:06.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-16T07:32:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.279+0000 7f7439600640 1 -- 172.21.15.114:0/3765938976 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7f74300f9b60 con 0x7f743c06e810 2024-09-16T07:32:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:32:07.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f741c073220 msgr2=0x7f741c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f741c073220 0x7f741c0756e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f743c165c10 tx=0x7f7428007e40 comp rx=0 tx=0).stop 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c06e810 msgr2=0x7f743c14e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c06e810 0x7f743c14e8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7430009850 tx=0x7f74300a64d0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 shutdown_connections 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f741c073220 0x7f741c0756e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f743c15ade0 0x7f743c156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c0b4bd0 0x7f743c153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 --2- 172.21.15.114:0/3765938976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f743c06e810 0x7f743c14e8f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 >> 172.21.15.114:0/3765938976 conn(0x7f743c0b18f0 msgr2=0x7f743c0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 shutdown_connections 2024-09-16T07:32:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.283+0000 7f7443e00640 1 -- 172.21.15.114:0/3765938976 wait complete. 2024-09-16T07:32:07.319 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:32:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 -- 172.21.15.114:0/3010814104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80aeb00 msgr2=0x7fa6c80aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 --2- 172.21.15.114:0/3010814104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80aeb00 0x7fa6c80aefb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8073810 tx=0x7fa6c001c8a0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 -- 172.21.15.114:0/3010814104 shutdown_connections 2024-09-16T07:32:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 --2- 172.21.15.114:0/3010814104 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80aeb00 0x7fa6c80aefb0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 --2- 172.21.15.114:0/3010814104 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c80b1650 0x7fa6c80b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 --2- 172.21.15.114:0/3010814104 >> v2:172.21.15.149:3300/0 conn(0x7fa6c81605d0 0x7fa6c80d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 -- 172.21.15.114:0/3010814104 >> 172.21.15.114:0/3010814104 conn(0x7fa6c80d1dd0 msgr2=0x7fa6c80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 -- 172.21.15.114:0/3010814104 shutdown_connections 2024-09-16T07:32:07.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.467+0000 7fa6cda00640 1 -- 172.21.15.114:0/3010814104 wait complete. 2024-09-16T07:32:07.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 Processor -- start 2024-09-16T07:32:07.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 -- start start 2024-09-16T07:32:07.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c80aeb00 0x7fa6c81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80b1650 0x7fa6c806f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81605d0 0x7fa6c815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c80b13a0 con 0x7fa6c80b1650 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c80b1220 con 0x7fa6c81605d0 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c80afd00 con 0x7fa6c80aeb00 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80b1650 0x7fa6c806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80b1650 0x7fa6c806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55720/0 (socket says 172.21.15.114:55720) 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 -- 172.21.15.114:0/2905700267 learned_addr learned my addr 172.21.15.114:0/2905700267 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6c6a00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c80aeb00 0x7fa6c81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6c7400640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81605d0 0x7fa6c815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 -- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c80aeb00 msgr2=0x7fa6c81562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c80aeb00 0x7fa6c81562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 -- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81605d0 msgr2=0x7fa6c815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81605d0 0x7fa6c815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 -- 172.21.15.114:0/2905700267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c81f78b0 con 0x7fa6c80b1650 2024-09-16T07:32:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6be000640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80b1650 0x7fa6c806f700 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000d750 tx=0x7fa6b000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6bf400640 1 -- 172.21.15.114:0/2905700267 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0017070 con 0x7fa6c80b1650 2024-09-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6bf400640 1 -- 172.21.15.114:0/2905700267 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6b0009cc0 con 0x7fa6c80b1650 2024-09-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6bf400640 1 -- 172.21.15.114:0/2905700267 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000de60 con 0x7fa6c80b1650 2024-09-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c81f7b90 con 0x7fa6c80b1650 2024-09-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.471+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c81f8150 con 0x7fa6c80b1650 2024-09-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.475+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c80b1a30 con 0x7fa6c80b1650 2024-09-16T07:32:07.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.475+0000 7fa6bf400640 1 -- 172.21.15.114:0/2905700267 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fa6b0005280 con 0x7fa6c80b1650 2024-09-16T07:32:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.475+0000 7fa6bf400640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa6a4073220 0x7fa6a40756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:07.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.475+0000 7fa6bf400640 1 -- 172.21.15.114:0/2905700267 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5609+0+0 (secure 0 0 0) 0x7fa6b0094580 con 0x7fa6c80b1650 2024-09-16T07:32:07.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.475+0000 7fa6c6a00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa6a4073220 0x7fa6a40756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:07.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.475+0000 7fa6c6a00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa6a4073220 0x7fa6a40756e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8159320 tx=0x7fa6b80095e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.479+0000 7fa6bf400640 1 -- 172.21.15.114:0/2905700267 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa6b005eb80 con 0x7fa6c80b1650 2024-09-16T07:32:07.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:07.679+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa6c80d1080 con 0x7fa6c80b1650 2024-09-16T07:32:08.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.279+0000 7fa6bf400640 1 -- 172.21.15.114:0/2905700267 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v43) ==== 174+0+0 (secure 0 0 0) 0x7fa6b00635b0 con 0x7fa6c80b1650 2024-09-16T07:32:08.279 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 10 and data pool 11 2024-09-16T07:32:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa6a4073220 msgr2=0x7fa6a40756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa6a4073220 0x7fa6a40756e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8159320 tx=0x7fa6b80095e0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80b1650 msgr2=0x7fa6c806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80b1650 0x7fa6c806f700 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000d750 tx=0x7fa6b000dc10 comp rx=0 tx=0).stop 2024-09-16T07:32:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 shutdown_connections 2024-09-16T07:32:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fa6a4073220 0x7fa6a40756e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6c81605d0 0x7fa6c815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6c80b1650 0x7fa6c806f700 secure :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000d750 tx=0x7fa6b000dc10 comp rx=0 tx=0).stop 2024-09-16T07:32:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 --2- 172.21.15.114:0/2905700267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6c80aeb00 0x7fa6c81562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 >> 172.21.15.114:0/2905700267 conn(0x7fa6c80d1dd0 msgr2=0x7fa6c8071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:08.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 shutdown_connections 2024-09-16T07:32:08.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.287+0000 7fa6cda00640 1 -- 172.21.15.114:0/2905700267 wait complete. 2024-09-16T07:32:08.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:08.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- 172.21.15.114:0/2902556238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800cd100 msgr2=0x7f2d8006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 --2- 172.21.15.114:0/2902556238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800cd100 0x7f2d8006f7b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2d800af830 tx=0x7f2d6801dad0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- 172.21.15.114:0/2902556238 shutdown_connections 2024-09-16T07:32:08.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 --2- 172.21.15.114:0/2902556238 >> v2:172.21.15.149:3300/0 conn(0x7f2d800b49e0 0x7f2d800acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 --2- 172.21.15.114:0/2902556238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800cd100 0x7f2d8006f7b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- 172.21.15.114:0/2902556238 >> 172.21.15.114:0/2902556238 conn(0x7f2d800b18f0 msgr2=0x7f2d800b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:08.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- 172.21.15.114:0/2902556238 shutdown_connections 2024-09-16T07:32:08.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- 172.21.15.114:0/2902556238 wait complete. 2024-09-16T07:32:08.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 Processor -- start 2024-09-16T07:32:08.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- start start 2024-09-16T07:32:08.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800b49e0 0x7f2d8009db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d800cd100 0x7f2d8006e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d8015dae0 0x7f2d8006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d800cf0f0 con 0x7f2d800b49e0 2024-09-16T07:32:08.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2d800cef70 con 0x7f2d8015dae0 2024-09-16T07:32:08.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d85400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2d800cf270 con 0x7f2d800cd100 2024-09-16T07:32:08.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800b49e0 0x7f2d8009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800b49e0 0x7f2d8009db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55742/0 (socket says 172.21.15.114:55742) 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7e800640 1 -- 172.21.15.114:0/1286445842 learned_addr learned my addr 172.21.15.114:0/1286445842 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7f200640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d8015dae0 0x7f2d8006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d75e00640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d800cd100 0x7f2d8006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7f200640 1 -- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d800cd100 msgr2=0x7f2d8006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7f200640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d800cd100 0x7f2d8006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7f200640 1 -- 172.21.15.114:0/1286445842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800b49e0 msgr2=0x7f2d8009db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.475+0000 7f2d7f200640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800b49e0 0x7f2d8009db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d7f200640 1 -- 172.21.15.114:0/1286445842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8014b520 con 0x7f2d8015dae0 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d7f200640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d8015dae0 0x7f2d8006ee80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800e970 tx=0x7f2d7800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:08.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d77400640 1 -- 172.21.15.114:0/1286445842 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800ccc0 con 0x7f2d8015dae0 2024-09-16T07:32:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d77400640 1 -- 172.21.15.114:0/1286445842 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d78004020 con 0x7f2d8015dae0 2024-09-16T07:32:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d800b0110 con 0x7f2d8015dae0 2024-09-16T07:32:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d77400640 1 -- 172.21.15.114:0/1286445842 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d78004470 con 0x7f2d8015dae0 2024-09-16T07:32:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d800b06d0 con 0x7f2d8015dae0 2024-09-16T07:32:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d800acd40 con 0x7f2d8015dae0 2024-09-16T07:32:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d77400640 1 -- 172.21.15.114:0/1286445842 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f2d78005020 con 0x7f2d8015dae0 2024-09-16T07:32:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.479+0000 7f2d77400640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2d5c073220 0x7f2d5c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.483+0000 7f2d77400640 1 -- 172.21.15.114:0/1286445842 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f2d78094f60 con 0x7f2d8015dae0 2024-09-16T07:32:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.483+0000 7f2d7e800640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2d5c073220 0x7f2d5c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.483+0000 7f2d7e800640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2d5c073220 0x7f2d5c0756e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2d70001f00 tx=0x7f2d70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.483+0000 7f2d77400640 1 -- 172.21.15.114:0/1286445842 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2d7805f610 con 0x7f2d8015dae0 2024-09-16T07:32:08.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.651+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d8015bc20 con 0x7f2d8015dae0 2024-09-16T07:32:08.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.651+0000 7f2d77400640 1 -- 172.21.15.114:0/1286445842 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16789 (secure 0 0 0) 0x7f2d78064040 con 0x7f2d8015dae0 2024-09-16T07:32:08.652 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:08.652 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":68,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:07.684653+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:05.778772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:06.639884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:08.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2d5c073220 msgr2=0x7f2d5c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2d5c073220 0x7f2d5c0756e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2d70001f00 tx=0x7f2d70009040 comp rx=0 tx=0).stop 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d8015dae0 msgr2=0x7f2d8006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d8015dae0 0x7f2d8006ee80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800e970 tx=0x7f2d7800ee30 comp rx=0 tx=0).stop 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 shutdown_connections 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2d5c073220 0x7f2d5c0756e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d8015dae0 0x7f2d8006ee80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d800cd100 0x7f2d8006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 --2- 172.21.15.114:0/1286445842 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d800b49e0 0x7f2d8009db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 >> 172.21.15.114:0/1286445842 conn(0x7f2d800b18f0 msgr2=0x7f2d8015afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 shutdown_connections 2024-09-16T07:32:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.655+0000 7f2d85400640 1 -- 172.21.15.114:0/1286445842 wait complete. 2024-09-16T07:32:08.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.815+0000 7eff87e00640 1 -- 172.21.15.114:0/2547849600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 msgr2=0x7eff801605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.815+0000 7eff87e00640 1 --2- 172.21.15.114:0/2547849600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff801605d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7eff800c5910 tx=0x7eff7801cb10 comp rx=0 tx=0).stop 2024-09-16T07:32:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.815+0000 7eff87e00640 1 -- 172.21.15.114:0/2547849600 shutdown_connections 2024-09-16T07:32:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.815+0000 7eff87e00640 1 --2- 172.21.15.114:0/2547849600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff801605d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.815+0000 7eff87e00640 1 --2- 172.21.15.114:0/2547849600 >> v2:172.21.15.149:3300/0 conn(0x7eff800b2760 0x7eff800d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.815+0000 7eff87e00640 1 -- 172.21.15.114:0/2547849600 >> 172.21.15.114:0/2547849600 conn(0x7eff800d1e40 msgr2=0x7eff800d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 -- 172.21.15.114:0/2547849600 shutdown_connections 2024-09-16T07:32:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 -- 172.21.15.114:0/2547849600 wait complete. 2024-09-16T07:32:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 Processor -- start 2024-09-16T07:32:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 -- start start 2024-09-16T07:32:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff800b2760 0x7eff800cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff8015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff800cfe80 0x7eff801f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7eff800b0990 con 0x7eff800b2d00 2024-09-16T07:32:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7eff800b0810 con 0x7eff800cfe80 2024-09-16T07:32:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7eff800b0b10 con 0x7eff800b2760 2024-09-16T07:32:08.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff8015dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff8015dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55766/0 (socket says 172.21.15.114:55766) 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 -- 172.21.15.114:0/1290268276 learned_addr learned my addr 172.21.15.114:0/1290268276 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff85e00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff800cfe80 0x7eff801f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff85400640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff800b2760 0x7eff800cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 -- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff800b2760 msgr2=0x7eff800cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff800b2760 0x7eff800cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 -- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff800cfe80 msgr2=0x7eff801f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff800cfe80 0x7eff801f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 -- 172.21.15.114:0/1290268276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8015e1d0 con 0x7eff800b2d00 2024-09-16T07:32:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff84a00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff8015dc90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00b4b0 tx=0x7eff6c00b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff7d600640 1 -- 172.21.15.114:0/1290268276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c014070 con 0x7eff800b2d00 2024-09-16T07:32:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff7d600640 1 -- 172.21.15.114:0/1290268276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff6c010610 con 0x7eff800b2d00 2024-09-16T07:32:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff800ccfb0 con 0x7eff800b2d00 2024-09-16T07:32:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.819+0000 7eff7d600640 1 -- 172.21.15.114:0/1290268276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c010a60 con 0x7eff800b2d00 2024-09-16T07:32:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.823+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff800cd570 con 0x7eff800b2d00 2024-09-16T07:32:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.823+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff800d0260 con 0x7eff800b2d00 2024-09-16T07:32:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.823+0000 7eff7d600640 1 -- 172.21.15.114:0/1290268276 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7eff6c017070 con 0x7eff800b2d00 2024-09-16T07:32:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.823+0000 7eff7d600640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7eff60073220 0x7eff600756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.823+0000 7eff7d600640 1 -- 172.21.15.114:0/1290268276 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7eff6c093ec0 con 0x7eff800b2d00 2024-09-16T07:32:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.823+0000 7eff85400640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7eff60073220 0x7eff600756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.827+0000 7eff85400640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7eff60073220 0x7eff600756e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff740098e0 tx=0x7eff74009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:08.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.827+0000 7eff7d600640 1 -- 172.21.15.114:0/1290268276 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7eff6c05e4f0 con 0x7eff800b2d00 2024-09-16T07:32:08.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.999+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff800cdce0 con 0x7eff800b2d00 2024-09-16T07:32:08.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:08.999+0000 7eff7d600640 1 -- 172.21.15.114:0/1290268276 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16789 (secure 0 0 0) 0x7eff6c062f20 con 0x7eff800b2d00 2024-09-16T07:32:08.998 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:08.998 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":68,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:07.684653+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:05.778772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:06.639884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7eff60073220 msgr2=0x7eff600756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7eff60073220 0x7eff600756e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff740098e0 tx=0x7eff74009060 comp rx=0 tx=0).stop 2024-09-16T07:32:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 msgr2=0x7eff8015dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff8015dc90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00b4b0 tx=0x7eff6c00b970 comp rx=0 tx=0).stop 2024-09-16T07:32:09.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 shutdown_connections 2024-09-16T07:32:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7eff60073220 0x7eff600756e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7eff800cfe80 0x7eff801f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff800b2d00 0x7eff8015dc90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 --2- 172.21.15.114:0/1290268276 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff800b2760 0x7eff800cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 >> 172.21.15.114:0/1290268276 conn(0x7eff800d1e40 msgr2=0x7eff8006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 shutdown_connections 2024-09-16T07:32:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.003+0000 7eff87e00640 1 -- 172.21.15.114:0/1290268276 wait complete. 2024-09-16T07:32:09.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:32:09.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 -- 172.21.15.114:0/811039754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45841617a0 msgr2=0x7f4584162130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 --2- 172.21.15.114:0/811039754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45841617a0 0x7f4584162130 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4584073990 tx=0x7f456c01c770 comp rx=0 tx=0).stop 2024-09-16T07:32:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 -- 172.21.15.114:0/811039754 shutdown_connections 2024-09-16T07:32:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 --2- 172.21.15.114:0/811039754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45841617a0 0x7f4584162130 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 --2- 172.21.15.114:0/811039754 >> v2:172.21.15.149:3300/0 conn(0x7f45841613c0 0x7f4584161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 -- 172.21.15.114:0/811039754 >> 172.21.15.114:0/811039754 conn(0x7f45840d1dd0 msgr2=0x7f45840d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 -- 172.21.15.114:0/811039754 shutdown_connections 2024-09-16T07:32:09.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.163+0000 7f4589e00640 1 -- 172.21.15.114:0/811039754 wait complete. 2024-09-16T07:32:09.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 Processor -- start 2024-09-16T07:32:09.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 -- start start 2024-09-16T07:32:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45840b3190 0x7f4584149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45841613c0 0x7f45841fbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45841617a0 0x7f45840b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f458416b480 con 0x7f45840b3190 2024-09-16T07:32:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f458416b300 con 0x7f45841617a0 2024-09-16T07:32:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f458416b600 con 0x7f45841613c0 2024-09-16T07:32:09.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45840b3190 0x7f4584149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45840b3190 0x7f4584149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55776/0 (socket says 172.21.15.114:55776) 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 -- 172.21.15.114:0/1886661383 learned_addr learned my addr 172.21.15.114:0/1886661383 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f457a000640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45841613c0 0x7f45841fbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 -- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45841613c0 msgr2=0x7f45841fbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45841613c0 0x7f45841fbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 -- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45841617a0 msgr2=0x7f45840b6780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45841617a0 0x7f45840b6780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 -- 172.21.15.114:0/1886661383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45840b6cc0 con 0x7f45840b3190 2024-09-16T07:32:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4582a00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45840b3190 0x7f4584149390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f457400d950 tx=0x7f457400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f457be00640 1 -- 172.21.15.114:0/1886661383 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574017070 con 0x7f45840b3190 2024-09-16T07:32:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f457be00640 1 -- 172.21.15.114:0/1886661383 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4574009d20 con 0x7f45840b3190 2024-09-16T07:32:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f457be00640 1 -- 172.21.15.114:0/1886661383 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45740106c0 con 0x7f45840b3190 2024-09-16T07:32:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4584149a90 con 0x7f45840b3190 2024-09-16T07:32:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458414a050 con 0x7f45840b3190 2024-09-16T07:32:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.167+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458414a290 con 0x7f45840b3190 2024-09-16T07:32:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.171+0000 7f457be00640 1 -- 172.21.15.114:0/1886661383 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f4574010860 con 0x7f45840b3190 2024-09-16T07:32:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.171+0000 7f457be00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4560073220 0x7f45600756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.171+0000 7f457be00640 1 -- 172.21.15.114:0/1886661383 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f4574094980 con 0x7f45840b3190 2024-09-16T07:32:09.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.171+0000 7f457a000640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4560073220 0x7f45600756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.171+0000 7f457a000640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4560073220 0x7f45600756e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f456c0af000 tx=0x7f456c01afb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.175+0000 7f457be00640 1 -- 172.21.15.114:0/1886661383 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f458414a290 con 0x7f45840b3190 2024-09-16T07:32:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:09.379+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4584168cd0 con 0x7f45840b3190 2024-09-16T07:32:10.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f457be00640 1 -- 172.21.15.114:0/1886661383 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) ==== 118+0+0 (secure 0 0 0) 0x7f457405f570 con 0x7f45840b3190 2024-09-16T07:32:10.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4560073220 msgr2=0x7f45600756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:10.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4560073220 0x7f45600756e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f456c0af000 tx=0x7f456c01afb0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45840b3190 msgr2=0x7f4584149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:10.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45840b3190 0x7f4584149390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f457400d950 tx=0x7f457400de10 comp rx=0 tx=0).stop 2024-09-16T07:32:10.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 shutdown_connections 2024-09-16T07:32:10.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4560073220 0x7f45600756e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45841617a0 0x7f45840b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f45841613c0 0x7f45841fbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 --2- 172.21.15.114:0/1886661383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45840b3190 0x7f4584149390 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 >> 172.21.15.114:0/1886661383 conn(0x7f45840d1dd0 msgr2=0x7f45840cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:10.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 shutdown_connections 2024-09-16T07:32:10.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.307+0000 7f4589e00640 1 -- 172.21.15.114:0/1886661383 wait complete. 2024-09-16T07:32:10.329 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:32:10.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:32:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 -- 172.21.15.114:0/4212078540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f01602c0 msgr2=0x7f94f00ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 --2- 172.21.15.114:0/4212078540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f01602c0 0x7f94f00ce2e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f94f00d0ce0 tx=0x7f94e801cd50 comp rx=0 tx=0).stop 2024-09-16T07:32:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 -- 172.21.15.114:0/4212078540 shutdown_connections 2024-09-16T07:32:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 --2- 172.21.15.114:0/4212078540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f01602c0 0x7f94f00ce2e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 --2- 172.21.15.114:0/4212078540 >> v2:172.21.15.149:3300/0 conn(0x7f94f00cf1d0 0x7f94f015fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 --2- 172.21.15.114:0/4212078540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f015f9a0 0x7f94f006e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 -- 172.21.15.114:0/4212078540 >> 172.21.15.114:0/4212078540 conn(0x7f94f00b18f0 msgr2=0x7f94f00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:10.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 -- 172.21.15.114:0/4212078540 shutdown_connections 2024-09-16T07:32:10.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.479+0000 7f94f8200640 1 -- 172.21.15.114:0/4212078540 wait complete. 2024-09-16T07:32:10.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 Processor -- start 2024-09-16T07:32:10.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 -- start start 2024-09-16T07:32:10.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f00cf1d0 0x7f94f01fb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:10.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f015f9a0 0x7f94f0145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:10.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f01602c0 0x7f94f015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:10.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f94f015c790 con 0x7f94f00cf1d0 2024-09-16T07:32:10.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94f015c610 con 0x7f94f015f9a0 2024-09-16T07:32:10.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f94f015c910 con 0x7f94f01602c0 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f00cf1d0 0x7f94f01fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f00cf1d0 0x7f94f01fb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55800/0 (socket says 172.21.15.114:55800) 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 -- 172.21.15.114:0/4124417146 learned_addr learned my addr 172.21.15.114:0/4124417146 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f4e00640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f015f9a0 0x7f94f0145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f6200640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f01602c0 0x7f94f015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 -- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f01602c0 msgr2=0x7f94f015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f01602c0 0x7f94f015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 -- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f015f9a0 msgr2=0x7f94f0145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f015f9a0 0x7f94f0145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 -- 172.21.15.114:0/4124417146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f01fbcc0 con 0x7f94f00cf1d0 2024-09-16T07:32:10.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f5800640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f00cf1d0 0x7f94f01fb780 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f94e400d980 tx=0x7f94e400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:10.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94ed600640 1 -- 172.21.15.114:0/4124417146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4017070 con 0x7f94f00cf1d0 2024-09-16T07:32:10.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94ed600640 1 -- 172.21.15.114:0/4124417146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94e4009d60 con 0x7f94f00cf1d0 2024-09-16T07:32:10.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94ed600640 1 -- 172.21.15.114:0/4124417146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4005280 con 0x7f94f00cf1d0 2024-09-16T07:32:10.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f015adb0 con 0x7f94f00cf1d0 2024-09-16T07:32:10.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f0154e00 con 0x7f94f00cf1d0 2024-09-16T07:32:10.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.483+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f0069410 con 0x7f94f00cf1d0 2024-09-16T07:32:10.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.487+0000 7f94ed600640 1 -- 172.21.15.114:0/4124417146 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f94e4005420 con 0x7f94f00cf1d0 2024-09-16T07:32:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.487+0000 7f94ed600640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94d0073220 0x7f94d00756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.487+0000 7f94ed600640 1 -- 172.21.15.114:0/4124417146 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f94e40947d0 con 0x7f94f00cf1d0 2024-09-16T07:32:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.487+0000 7f94f4e00640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94d0073220 0x7f94d00756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.487+0000 7f94f4e00640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94d0073220 0x7f94d00756e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f94dc005fd0 tx=0x7f94dc005e60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.491+0000 7f94ed600640 1 -- 172.21.15.114:0/4124417146 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f94f01fbcc0 con 0x7f94f00cf1d0 2024-09-16T07:32:10.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:10.691+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f94f0070a60 con 0x7f94f00cf1d0 2024-09-16T07:32:11.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.311+0000 7f94ed600640 1 -- 172.21.15.114:0/4124417146 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) ==== 122+0+0 (secure 0 0 0) 0x7f94e405f400 con 0x7f94f00cf1d0 2024-09-16T07:32:11.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94d0073220 msgr2=0x7f94d00756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94d0073220 0x7f94d00756e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f94dc005fd0 tx=0x7f94dc005e60 comp rx=0 tx=0).stop 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f00cf1d0 msgr2=0x7f94f01fb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f00cf1d0 0x7f94f01fb780 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f94e400d980 tx=0x7f94e400de40 comp rx=0 tx=0).stop 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 shutdown_connections 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f94d0073220 0x7f94d00756e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94f01602c0 0x7f94f015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f015f9a0 0x7f94f0145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 --2- 172.21.15.114:0/4124417146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94f00cf1d0 0x7f94f01fb780 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 >> 172.21.15.114:0/4124417146 conn(0x7f94f00b18f0 msgr2=0x7f94f006f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 shutdown_connections 2024-09-16T07:32:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.315+0000 7f94f8200640 1 -- 172.21.15.114:0/4124417146 wait complete. 2024-09-16T07:32:11.333 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:32:11.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:11.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- 172.21.15.114:0/2012939244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc88004810 msgr2=0x7efc88004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 --2- 172.21.15.114:0/2012939244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc88004810 0x7efc88004c90 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7efc9000c2e0 tx=0x7efc9001cf60 comp rx=0 tx=0).stop 2024-09-16T07:32:11.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- 172.21.15.114:0/2012939244 shutdown_connections 2024-09-16T07:32:11.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 --2- 172.21.15.114:0/2012939244 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc88004810 0x7efc88004c90 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- 172.21.15.114:0/2012939244 >> 172.21.15.114:0/2012939244 conn(0x7efca409aa10 msgr2=0x7efca409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:11.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- 172.21.15.114:0/2012939244 shutdown_connections 2024-09-16T07:32:11.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- 172.21.15.114:0/2012939244 wait complete. 2024-09-16T07:32:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 Processor -- start 2024-09-16T07:32:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- start start 2024-09-16T07:32:11.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc88004810 0x7efca40c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca40c8d50 0x7efca40c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca415e010 0x7efca406e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efca40d1d60 con 0x7efca415e010 2024-09-16T07:32:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efca40d1be0 con 0x7efca40c8d50 2024-09-16T07:32:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efca40d1ee0 con 0x7efc88004810 2024-09-16T07:32:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca415e010 0x7efca406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca415e010 0x7efca406e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55814/0 (socket says 172.21.15.114:55814) 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.479+0000 7efca3400640 1 -- 172.21.15.114:0/3195487177 learned_addr learned my addr 172.21.15.114:0/3195487177 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca2000640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca40c8d50 0x7efca40c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3400640 1 -- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc88004810 msgr2=0x7efca40c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3400640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc88004810 0x7efca40c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3400640 1 -- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca40c8d50 msgr2=0x7efca40c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3400640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca40c8d50 0x7efca40c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3400640 1 -- 172.21.15.114:0/3195487177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40cbc00 con 0x7efca415e010 2024-09-16T07:32:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3400640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca415e010 0x7efca406e010 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7efca40b1640 tx=0x7efc9c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efc9aa00640 1 -- 172.21.15.114:0/3195487177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c019070 con 0x7efca415e010 2024-09-16T07:32:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efc9aa00640 1 -- 172.21.15.114:0/3195487177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc9c00ce20 con 0x7efca415e010 2024-09-16T07:32:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efc9aa00640 1 -- 172.21.15.114:0/3195487177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c014680 con 0x7efca415e010 2024-09-16T07:32:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca40cbea0 con 0x7efca415e010 2024-09-16T07:32:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca40c7220 con 0x7efca415e010 2024-09-16T07:32:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca415f730 con 0x7efca415e010 2024-09-16T07:32:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efc9aa00640 1 -- 172.21.15.114:0/3195487177 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7efc9c01c070 con 0x7efca415e010 2024-09-16T07:32:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efc9aa00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc84073250 0x7efc84075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.483+0000 7efc9aa00640 1 -- 172.21.15.114:0/3195487177 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7efc9c0940f0 con 0x7efca415e010 2024-09-16T07:32:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.487+0000 7efca2a00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc84073250 0x7efc84075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.487+0000 7efca2a00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc84073250 0x7efc84075710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efc94007fd0 tx=0x7efc940079a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.487+0000 7efc9aa00640 1 -- 172.21.15.114:0/3195487177 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efc9c05ee70 con 0x7efca415e010 2024-09-16T07:32:11.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efca406f990 con 0x7efca415e010 2024-09-16T07:32:11.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efc9aa00640 1 -- 172.21.15.114:0/3195487177 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7efc9c05e770 con 0x7efca415e010 2024-09-16T07:32:11.689 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:11.689 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"btime":"2024-09-16T07:32:11:309113+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:11.689 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-09-16T07:32:11.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc84073250 msgr2=0x7efc84075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc84073250 0x7efc84075710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efc94007fd0 tx=0x7efc940079a0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca415e010 msgr2=0x7efca406e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca415e010 0x7efca406e010 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7efca40b1640 tx=0x7efc9c00be60 comp rx=0 tx=0).stop 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 shutdown_connections 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc84073250 0x7efc84075710 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca415e010 0x7efca406e010 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca40c8d50 0x7efca40c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 --2- 172.21.15.114:0/3195487177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc88004810 0x7efca40c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 >> 172.21.15.114:0/3195487177 conn(0x7efca409aa10 msgr2=0x7efca40708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 shutdown_connections 2024-09-16T07:32:11.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.691+0000 7efca3e00640 1 -- 172.21.15.114:0/3195487177 wait complete. 2024-09-16T07:32:11.710 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.851+0000 7f8fdfa00640 1 -- 172.21.15.114:0/2169045180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 msgr2=0x7f8fd80cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.851+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/2169045180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80cebf0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009c80 tx=0x7f8fc801cda0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- 172.21.15.114:0/2169045180 shutdown_connections 2024-09-16T07:32:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/2169045180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80cebf0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- 172.21.15.114:0/2169045180 >> 172.21.15.114:0/2169045180 conn(0x7f8fd80b18f0 msgr2=0x7f8fd80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- 172.21.15.114:0/2169045180 shutdown_connections 2024-09-16T07:32:11.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- 172.21.15.114:0/2169045180 wait complete. 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 Processor -- start 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- start start 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd806e810 0x7f8fd81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8fd80b4bd0 0x7f8fd814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd80cde70 con 0x7f8fd815ade0 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd80cdcf0 con 0x7f8fd806e810 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd80cdff0 con 0x7f8fd80b4bd0 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:11.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55846/0 (socket says 172.21.15.114:55846) 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 -- 172.21.15.114:0/3817850756 learned_addr learned my addr 172.21.15.114:0/3817850756 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdd000640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd806e810 0x7f8fd81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 -- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8fd80b4bd0 msgr2=0x7f8fd814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fd7e00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8fd80b4bd0 0x7f8fd814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8fd80b4bd0 0x7f8fd814e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 -- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd806e810 msgr2=0x7f8fd81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd806e810 0x7f8fd81583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 -- 172.21.15.114:0/3817850756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd8157350 con 0x7f8fd815ade0 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdd000640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd806e810 0x7f8fd81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fd7e00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8fd80b4bd0 0x7f8fd814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdda00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80ae130 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000c3c0 tx=0x7f8fd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fd4c00640 1 -- 172.21.15.114:0/3817850756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011790 con 0x7f8fd815ade0 2024-09-16T07:32:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fd4c00640 1 -- 172.21.15.114:0/3817850756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fd0017070 con 0x7f8fd815ade0 2024-09-16T07:32:11.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fd4c00640 1 -- 172.21.15.114:0/3817850756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011cc0 con 0x7f8fd815ade0 2024-09-16T07:32:11.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd8157630 con 0x7f8fd815ade0 2024-09-16T07:32:11.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.855+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd8157bf0 con 0x7f8fd815ade0 2024-09-16T07:32:11.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.859+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd8069410 con 0x7f8fd815ade0 2024-09-16T07:32:11.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.859+0000 7f8fd4c00640 1 -- 172.21.15.114:0/3817850756 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f8fd001c460 con 0x7f8fd815ade0 2024-09-16T07:32:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.859+0000 7f8fd4c00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8fb8073220 0x7f8fb80756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.859+0000 7f8fd4c00640 1 -- 172.21.15.114:0/3817850756 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8fd0094250 con 0x7f8fd815ade0 2024-09-16T07:32:11.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.859+0000 7f8fdd000640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8fb8073220 0x7f8fb80756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:11.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.863+0000 7f8fdd000640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8fb8073220 0x7f8fb80756e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80af000 tx=0x7f8fc801b5e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:11.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:11.863+0000 7f8fd4c00640 1 -- 172.21.15.114:0/3817850756 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8fd005efd0 con 0x7f8fd815ade0 2024-09-16T07:32:12.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.031+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fd80cf720 con 0x7f8fd815ade0 2024-09-16T07:32:12.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.031+0000 7f8fd4c00640 1 -- 172.21.15.114:0/3817850756 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16776 (secure 0 0 0) 0x7f8fd005e8d0 con 0x7f8fd815ade0 2024-09-16T07:32:12.032 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:12.032 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":69,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:09.283442+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:05.778772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:06.639884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8fb8073220 msgr2=0x7f8fb80756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8fb8073220 0x7f8fb80756e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80af000 tx=0x7f8fc801b5e0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 msgr2=0x7f8fd80ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80ae130 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000c3c0 tx=0x7f8fd000c880 comp rx=0 tx=0).stop 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 shutdown_connections 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8fb8073220 0x7f8fb80756e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fd815ade0 0x7f8fd80ae130 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8fd80b4bd0 0x7f8fd814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 --2- 172.21.15.114:0/3817850756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fd806e810 0x7f8fd81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 >> 172.21.15.114:0/3817850756 conn(0x7f8fd80b18f0 msgr2=0x7f8fd8073a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 shutdown_connections 2024-09-16T07:32:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.035+0000 7f8fdfa00640 1 -- 172.21.15.114:0/3817850756 wait complete. 2024-09-16T07:32:12.054 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:32:12.054 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:32:12.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- 172.21.15.114:0/3977384931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 msgr2=0x7fcbc8003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 --2- 172.21.15.114:0/3977384931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbc8003ed0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009ee0 tx=0x7fcbd401d5f0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- 172.21.15.114:0/3977384931 shutdown_connections 2024-09-16T07:32:12.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 --2- 172.21.15.114:0/3977384931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbc8003ed0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- 172.21.15.114:0/3977384931 >> 172.21.15.114:0/3977384931 conn(0x7fcbe009aa10 msgr2=0x7fcbe009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:12.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- 172.21.15.114:0/3977384931 shutdown_connections 2024-09-16T07:32:12.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- 172.21.15.114:0/3977384931 wait complete. 2024-09-16T07:32:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 Processor -- start 2024-09-16T07:32:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- start start 2024-09-16T07:32:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbe0157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbe0157120 0x7fcbe0070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbe00b5bc0 0x7fcbe015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d1d60 con 0x7fcbc8003ab0 2024-09-16T07:32:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d1be0 con 0x7fcbe0157120 2024-09-16T07:32:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00d1ee0 con 0x7fcbe00b5bc0 2024-09-16T07:32:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbe0157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbe0157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55864/0 (socket says 172.21.15.114:55864) 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe5c00640 1 -- 172.21.15.114:0/4182965652 learned_addr learned my addr 172.21.15.114:0/4182965652 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe5200640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbe0157120 0x7fcbe0070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.199+0000 7fcbe6600640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbe00b5bc0 0x7fcbe015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe5c00640 1 -- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbe00b5bc0 msgr2=0x7fcbe015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe5c00640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbe00b5bc0 0x7fcbe015a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe5c00640 1 -- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbe0157120 msgr2=0x7fcbe0070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe5c00640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbe0157120 0x7fcbe0070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe5c00640 1 -- 172.21.15.114:0/4182965652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00cbcb0 con 0x7fcbc8003ab0 2024-09-16T07:32:12.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe5c00640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbe0157730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009e00 tx=0x7fcbd4009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:12.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbdd600640 1 -- 172.21.15.114:0/4182965652 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4005040 con 0x7fcbc8003ab0 2024-09-16T07:32:12.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbdd600640 1 -- 172.21.15.114:0/4182965652 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbd40051e0 con 0x7fcbc8003ab0 2024-09-16T07:32:12.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbdd600640 1 -- 172.21.15.114:0/4182965652 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40055b0 con 0x7fcbc8003ab0 2024-09-16T07:32:12.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe00cbf90 con 0x7fcbc8003ab0 2024-09-16T07:32:12.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe00b6070 con 0x7fcbc8003ab0 2024-09-16T07:32:12.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe015f730 con 0x7fcbc8003ab0 2024-09-16T07:32:12.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbdd600640 1 -- 172.21.15.114:0/4182965652 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fcbd4005750 con 0x7fcbc8003ab0 2024-09-16T07:32:12.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.203+0000 7fcbdd600640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcbc0073220 0x7fcbc00756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.207+0000 7fcbdd600640 1 -- 172.21.15.114:0/4182965652 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fcbd412f650 con 0x7fcbc8003ab0 2024-09-16T07:32:12.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.207+0000 7fcbe5200640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcbc0073220 0x7fcbc00756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.207+0000 7fcbe5200640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcbc0073220 0x7fcbc00756e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc006fd0 tx=0x7fcbcc006cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.207+0000 7fcbdd600640 1 -- 172.21.15.114:0/4182965652 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcbd4017300 con 0x7fcbc8003ab0 2024-09-16T07:32:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.375+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcbe0159fa0 con 0x7fcbc0073220 2024-09-16T07:32:12.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbdd600640 1 -- 172.21.15.114:0/4182965652 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252052 (secure 0 0 0) 0x7fcbcc012560 con 0x7fcbc0073220 2024-09-16T07:32:12.383 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:12.385 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcbc0073220 msgr2=0x7fcbc00756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcbc0073220 0x7fcbc00756e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc006fd0 tx=0x7fcbcc006cf0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 msgr2=0x7fcbe0157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbe0157730 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009e00 tx=0x7fcbd4009ba0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 shutdown_connections 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fcbc0073220 0x7fcbc00756e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcbe00b5bc0 0x7fcbe015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcbe0157120 0x7fcbe0070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 --2- 172.21.15.114:0/4182965652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbc8003ab0 0x7fcbe0157730 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 >> 172.21.15.114:0/4182965652 conn(0x7fcbe009aa10 msgr2=0x7fcbe0159320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:12.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 shutdown_connections 2024-09-16T07:32:12.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.383+0000 7fcbe7000640 1 -- 172.21.15.114:0/4182965652 wait complete. 2024-09-16T07:32:12.402 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-16T07:32:11.051812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253048,"kb_used_data":7696,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721672,"statfs":{"total":773094113280,"available":772834992128,"internally_reserved":0,"allocated":7880704,"data_stored":3945220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.778675"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288552+0000","last_change":"2024-09-16T07:32:08.299682+0000","last_active":"2024-09-16T07:32:09.288552+0000","last_peered":"2024-09-16T07:32:09.288552+0000","last_clean":"2024-09-16T07:32:09.288552+0000","last_became_active":"2024-09-16T07:32:08.299374+0000","last_became_peered":"2024-09-16T07:32:08.299374+0000","last_unstale":"2024-09-16T07:32:09.288552+0000","last_undegraded":"2024-09-16T07:32:09.288552+0000","last_fullsized":"2024-09-16T07:32:09.288552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:30.188656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287417+0000","last_change":"2024-09-16T07:32:08.310570+0000","last_active":"2024-09-16T07:32:09.287417+0000","last_peered":"2024-09-16T07:32:09.287417+0000","last_clean":"2024-09-16T07:32:09.287417+0000","last_became_active":"2024-09-16T07:32:08.310319+0000","last_became_peered":"2024-09-16T07:32:08.310319+0000","last_unstale":"2024-09-16T07:32:09.287417+0000","last_undegraded":"2024-09-16T07:32:09.287417+0000","last_fullsized":"2024-09-16T07:32:09.287417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:34.805739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302801+0000","last_change":"2024-09-16T07:32:08.310414+0000","last_active":"2024-09-16T07:32:09.302801+0000","last_peered":"2024-09-16T07:32:09.302801+0000","last_clean":"2024-09-16T07:32:09.302801+0000","last_became_active":"2024-09-16T07:32:08.310147+0000","last_became_peered":"2024-09-16T07:32:08.310147+0000","last_unstale":"2024-09-16T07:32:09.302801+0000","last_undegraded":"2024-09-16T07:32:09.302801+0000","last_fullsized":"2024-09-16T07:32:09.302801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:27:40.172996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803106+0000","last_change":"2024-09-16T07:32:08.306731+0000","last_active":"2024-09-16T07:32:09.803106+0000","last_peered":"2024-09-16T07:32:09.803106+0000","last_clean":"2024-09-16T07:32:09.803106+0000","last_became_active":"2024-09-16T07:32:08.306467+0000","last_became_peered":"2024-09-16T07:32:08.306467+0000","last_unstale":"2024-09-16T07:32:09.803106+0000","last_undegraded":"2024-09-16T07:32:09.803106+0000","last_fullsized":"2024-09-16T07:32:09.803106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:14.714669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.314229+0000","last_change":"2024-09-16T07:32:08.301362+0000","last_active":"2024-09-16T07:32:08.314229+0000","last_peered":"2024-09-16T07:32:08.314229+0000","last_clean":"2024-09-16T07:32:08.314229+0000","last_became_active":"2024-09-16T07:32:08.301089+0000","last_became_peered":"2024-09-16T07:32:08.301089+0000","last_unstale":"2024-09-16T07:32:08.314229+0000","last_undegraded":"2024-09-16T07:32:08.314229+0000","last_fullsized":"2024-09-16T07:32:08.314229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:38:19.861733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286393+0000","last_change":"2024-09-16T07:32:08.309383+0000","last_active":"2024-09-16T07:32:09.286393+0000","last_peered":"2024-09-16T07:32:09.286393+0000","last_clean":"2024-09-16T07:32:09.286393+0000","last_became_active":"2024-09-16T07:32:08.309152+0000","last_became_peered":"2024-09-16T07:32:08.309152+0000","last_unstale":"2024-09-16T07:32:09.286393+0000","last_undegraded":"2024-09-16T07:32:09.286393+0000","last_fullsized":"2024-09-16T07:32:09.286393+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:19:18.507802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288817+0000","last_change":"2024-09-16T07:32:08.297358+0000","last_active":"2024-09-16T07:32:09.288817+0000","last_peered":"2024-09-16T07:32:09.288817+0000","last_clean":"2024-09-16T07:32:09.288817+0000","last_became_active":"2024-09-16T07:32:08.297050+0000","last_became_peered":"2024-09-16T07:32:08.297050+0000","last_unstale":"2024-09-16T07:32:09.288817+0000","last_undegraded":"2024-09-16T07:32:09.288817+0000","last_fullsized":"2024-09-16T07:32:09.288817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:27.495613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286439+0000","last_change":"2024-09-16T07:32:08.312156+0000","last_active":"2024-09-16T07:32:09.286439+0000","last_peered":"2024-09-16T07:32:09.286439+0000","last_clean":"2024-09-16T07:32:09.286439+0000","last_became_active":"2024-09-16T07:32:08.311877+0000","last_became_peered":"2024-09-16T07:32:08.311877+0000","last_unstale":"2024-09-16T07:32:09.286439+0000","last_undegraded":"2024-09-16T07:32:09.286439+0000","last_fullsized":"2024-09-16T07:32:09.286439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:14.297943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317938+0000","last_change":"2024-09-16T07:32:08.307436+0000","last_active":"2024-09-16T07:32:08.317938+0000","last_peered":"2024-09-16T07:32:08.317938+0000","last_clean":"2024-09-16T07:32:08.317938+0000","last_became_active":"2024-09-16T07:32:08.303813+0000","last_became_peered":"2024-09-16T07:32:08.303813+0000","last_unstale":"2024-09-16T07:32:08.317938+0000","last_undegraded":"2024-09-16T07:32:08.317938+0000","last_fullsized":"2024-09-16T07:32:08.317938+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:10.542387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801593+0000","last_change":"2024-09-16T07:32:08.297356+0000","last_active":"2024-09-16T07:32:09.801593+0000","last_peered":"2024-09-16T07:32:09.801593+0000","last_clean":"2024-09-16T07:32:09.801593+0000","last_became_active":"2024-09-16T07:32:08.297087+0000","last_became_peered":"2024-09-16T07:32:08.297087+0000","last_unstale":"2024-09-16T07:32:09.801593+0000","last_undegraded":"2024-09-16T07:32:09.801593+0000","last_fullsized":"2024-09-16T07:32:09.801593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:35.556496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288510+0000","last_change":"2024-09-16T07:32:08.311834+0000","last_active":"2024-09-16T07:32:09.288510+0000","last_peered":"2024-09-16T07:32:09.288510+0000","last_clean":"2024-09-16T07:32:09.288510+0000","last_became_active":"2024-09-16T07:32:08.311457+0000","last_became_peered":"2024-09-16T07:32:08.311457+0000","last_unstale":"2024-09-16T07:32:09.288510+0000","last_undegraded":"2024-09-16T07:32:09.288510+0000","last_fullsized":"2024-09-16T07:32:09.288510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:17.787443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803274+0000","last_change":"2024-09-16T07:32:08.305233+0000","last_active":"2024-09-16T07:32:09.803274+0000","last_peered":"2024-09-16T07:32:09.803274+0000","last_clean":"2024-09-16T07:32:09.803274+0000","last_became_active":"2024-09-16T07:32:08.305001+0000","last_became_peered":"2024-09-16T07:32:08.305001+0000","last_unstale":"2024-09-16T07:32:09.803274+0000","last_undegraded":"2024-09-16T07:32:09.803274+0000","last_fullsized":"2024-09-16T07:32:09.803274+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:04:42.737762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803533+0000","last_change":"2024-09-16T07:32:08.306549+0000","last_active":"2024-09-16T07:32:09.803533+0000","last_peered":"2024-09-16T07:32:09.803533+0000","last_clean":"2024-09-16T07:32:09.803533+0000","last_became_active":"2024-09-16T07:32:08.306264+0000","last_became_peered":"2024-09-16T07:32:08.306264+0000","last_unstale":"2024-09-16T07:32:09.803533+0000","last_undegraded":"2024-09-16T07:32:09.803533+0000","last_fullsized":"2024-09-16T07:32:09.803533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:38.997570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317949+0000","last_change":"2024-09-16T07:32:08.302166+0000","last_active":"2024-09-16T07:32:08.317949+0000","last_peered":"2024-09-16T07:32:08.317949+0000","last_clean":"2024-09-16T07:32:08.317949+0000","last_became_active":"2024-09-16T07:32:08.301772+0000","last_became_peered":"2024-09-16T07:32:08.301772+0000","last_unstale":"2024-09-16T07:32:08.317949+0000","last_undegraded":"2024-09-16T07:32:08.317949+0000","last_fullsized":"2024-09-16T07:32:08.317949+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:47.113647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803655+0000","last_change":"2024-09-16T07:32:08.313875+0000","last_active":"2024-09-16T07:32:09.803655+0000","last_peered":"2024-09-16T07:32:09.803655+0000","last_clean":"2024-09-16T07:32:09.803655+0000","last_became_active":"2024-09-16T07:32:08.313584+0000","last_became_peered":"2024-09-16T07:32:08.313584+0000","last_unstale":"2024-09-16T07:32:09.803655+0000","last_undegraded":"2024-09-16T07:32:09.803655+0000","last_fullsized":"2024-09-16T07:32:09.803655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:46.431522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801353+0000","last_change":"2024-09-16T07:32:08.308480+0000","last_active":"2024-09-16T07:32:09.801353+0000","last_peered":"2024-09-16T07:32:09.801353+0000","last_clean":"2024-09-16T07:32:09.801353+0000","last_became_active":"2024-09-16T07:32:08.308174+0000","last_became_peered":"2024-09-16T07:32:08.308174+0000","last_unstale":"2024-09-16T07:32:09.801353+0000","last_undegraded":"2024-09-16T07:32:09.801353+0000","last_fullsized":"2024-09-16T07:32:09.801353+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:04:41.976531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.321053+0000","last_change":"2024-09-16T07:32:08.304091+0000","last_active":"2024-09-16T07:32:08.321053+0000","last_peered":"2024-09-16T07:32:08.321053+0000","last_clean":"2024-09-16T07:32:08.321053+0000","last_became_active":"2024-09-16T07:32:08.303394+0000","last_became_peered":"2024-09-16T07:32:08.303394+0000","last_unstale":"2024-09-16T07:32:08.321053+0000","last_undegraded":"2024-09-16T07:32:08.321053+0000","last_fullsized":"2024-09-16T07:32:08.321053+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:44.459590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803547+0000","last_change":"2024-09-16T07:32:08.316101+0000","last_active":"2024-09-16T07:32:09.803547+0000","last_peered":"2024-09-16T07:32:09.803547+0000","last_clean":"2024-09-16T07:32:09.803547+0000","last_became_active":"2024-09-16T07:32:08.315805+0000","last_became_peered":"2024-09-16T07:32:08.315805+0000","last_unstale":"2024-09-16T07:32:09.803547+0000","last_undegraded":"2024-09-16T07:32:09.803547+0000","last_fullsized":"2024-09-16T07:32:09.803547+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:37.198437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286976+0000","last_change":"2024-09-16T07:32:08.314897+0000","last_active":"2024-09-16T07:32:09.286976+0000","last_peered":"2024-09-16T07:32:09.286976+0000","last_clean":"2024-09-16T07:32:09.286976+0000","last_became_active":"2024-09-16T07:32:08.311349+0000","last_became_peered":"2024-09-16T07:32:08.311349+0000","last_unstale":"2024-09-16T07:32:09.286976+0000","last_undegraded":"2024-09-16T07:32:09.286976+0000","last_fullsized":"2024-09-16T07:32:09.286976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:58:01.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803150+0000","last_change":"2024-09-16T07:32:08.305302+0000","last_active":"2024-09-16T07:32:09.803150+0000","last_peered":"2024-09-16T07:32:09.803150+0000","last_clean":"2024-09-16T07:32:09.803150+0000","last_became_active":"2024-09-16T07:32:08.305015+0000","last_became_peered":"2024-09-16T07:32:08.305015+0000","last_unstale":"2024-09-16T07:32:09.803150+0000","last_undegraded":"2024-09-16T07:32:09.803150+0000","last_fullsized":"2024-09-16T07:32:09.803150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:14.733885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801629+0000","last_change":"2024-09-16T07:32:08.305933+0000","last_active":"2024-09-16T07:32:09.801629+0000","last_peered":"2024-09-16T07:32:09.801629+0000","last_clean":"2024-09-16T07:32:09.801629+0000","last_became_active":"2024-09-16T07:32:08.305571+0000","last_became_peered":"2024-09-16T07:32:08.305571+0000","last_unstale":"2024-09-16T07:32:09.801629+0000","last_undegraded":"2024-09-16T07:32:09.801629+0000","last_fullsized":"2024-09-16T07:32:09.801629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:34.805739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801368+0000","last_change":"2024-09-16T07:32:08.298013+0000","last_active":"2024-09-16T07:32:09.801368+0000","last_peered":"2024-09-16T07:32:09.801368+0000","last_clean":"2024-09-16T07:32:09.801368+0000","last_became_active":"2024-09-16T07:32:08.297058+0000","last_became_peered":"2024-09-16T07:32:08.297058+0000","last_unstale":"2024-09-16T07:32:09.801368+0000","last_undegraded":"2024-09-16T07:32:09.801368+0000","last_fullsized":"2024-09-16T07:32:09.801368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:46:35.474974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287925+0000","last_change":"2024-09-16T07:32:08.302213+0000","last_active":"2024-09-16T07:32:09.287925+0000","last_peered":"2024-09-16T07:32:09.287925+0000","last_clean":"2024-09-16T07:32:09.287925+0000","last_became_active":"2024-09-16T07:32:08.301925+0000","last_became_peered":"2024-09-16T07:32:08.301925+0000","last_unstale":"2024-09-16T07:32:09.287925+0000","last_undegraded":"2024-09-16T07:32:09.287925+0000","last_fullsized":"2024-09-16T07:32:09.287925+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:30:54.428177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287692+0000","last_change":"2024-09-16T07:32:08.319875+0000","last_active":"2024-09-16T07:32:09.287692+0000","last_peered":"2024-09-16T07:32:09.287692+0000","last_clean":"2024-09-16T07:32:09.287692+0000","last_became_active":"2024-09-16T07:32:08.319586+0000","last_became_peered":"2024-09-16T07:32:08.319586+0000","last_unstale":"2024-09-16T07:32:09.287692+0000","last_undegraded":"2024-09-16T07:32:09.287692+0000","last_fullsized":"2024-09-16T07:32:09.287692+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:51.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801794+0000","last_change":"2024-09-16T07:32:08.293885+0000","last_active":"2024-09-16T07:32:09.801794+0000","last_peered":"2024-09-16T07:32:09.801794+0000","last_clean":"2024-09-16T07:32:09.801794+0000","last_became_active":"2024-09-16T07:32:08.293605+0000","last_became_peered":"2024-09-16T07:32:08.293605+0000","last_unstale":"2024-09-16T07:32:09.801794+0000","last_undegraded":"2024-09-16T07:32:09.801794+0000","last_fullsized":"2024-09-16T07:32:09.801794+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:09.649984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289504+0000","last_change":"2024-09-16T07:32:08.307126+0000","last_active":"2024-09-16T07:32:09.289504+0000","last_peered":"2024-09-16T07:32:09.289504+0000","last_clean":"2024-09-16T07:32:09.289504+0000","last_became_active":"2024-09-16T07:32:08.306781+0000","last_became_peered":"2024-09-16T07:32:08.306781+0000","last_unstale":"2024-09-16T07:32:09.289504+0000","last_undegraded":"2024-09-16T07:32:09.289504+0000","last_fullsized":"2024-09-16T07:32:09.289504+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:14.733885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302976+0000","last_change":"2024-09-16T07:32:08.314818+0000","last_active":"2024-09-16T07:32:09.302976+0000","last_peered":"2024-09-16T07:32:09.302976+0000","last_clean":"2024-09-16T07:32:09.302976+0000","last_became_active":"2024-09-16T07:32:08.314499+0000","last_became_peered":"2024-09-16T07:32:08.314499+0000","last_unstale":"2024-09-16T07:32:09.302976+0000","last_undegraded":"2024-09-16T07:32:09.302976+0000","last_fullsized":"2024-09-16T07:32:09.302976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:05.427763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801667+0000","last_change":"2024-09-16T07:32:08.298105+0000","last_active":"2024-09-16T07:32:09.801667+0000","last_peered":"2024-09-16T07:32:09.801667+0000","last_clean":"2024-09-16T07:32:09.801667+0000","last_became_active":"2024-09-16T07:32:08.297824+0000","last_became_peered":"2024-09-16T07:32:08.297824+0000","last_unstale":"2024-09-16T07:32:09.801667+0000","last_undegraded":"2024-09-16T07:32:09.801667+0000","last_fullsized":"2024-09-16T07:32:09.801667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:17.192325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302657+0000","last_change":"2024-09-16T07:32:08.303569+0000","last_active":"2024-09-16T07:32:09.302657+0000","last_peered":"2024-09-16T07:32:09.302657+0000","last_clean":"2024-09-16T07:32:09.302657+0000","last_became_active":"2024-09-16T07:32:08.303308+0000","last_became_peered":"2024-09-16T07:32:08.303308+0000","last_unstale":"2024-09-16T07:32:09.302657+0000","last_undegraded":"2024-09-16T07:32:09.302657+0000","last_fullsized":"2024-09-16T07:32:09.302657+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:08:29.266901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288929+0000","last_change":"2024-09-16T07:32:08.304376+0000","last_active":"2024-09-16T07:32:09.288929+0000","last_peered":"2024-09-16T07:32:09.288929+0000","last_clean":"2024-09-16T07:32:09.288929+0000","last_became_active":"2024-09-16T07:32:08.302667+0000","last_became_peered":"2024-09-16T07:32:08.302667+0000","last_unstale":"2024-09-16T07:32:09.288929+0000","last_undegraded":"2024-09-16T07:32:09.288929+0000","last_fullsized":"2024-09-16T07:32:09.288929+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:36.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289067+0000","last_change":"2024-09-16T07:32:08.313317+0000","last_active":"2024-09-16T07:32:09.289067+0000","last_peered":"2024-09-16T07:32:09.289067+0000","last_clean":"2024-09-16T07:32:09.289067+0000","last_became_active":"2024-09-16T07:32:08.313020+0000","last_became_peered":"2024-09-16T07:32:08.313020+0000","last_unstale":"2024-09-16T07:32:09.289067+0000","last_undegraded":"2024-09-16T07:32:09.289067+0000","last_fullsized":"2024-09-16T07:32:09.289067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:42.277058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286628+0000","last_change":"2024-09-16T07:32:08.319370+0000","last_active":"2024-09-16T07:32:09.286628+0000","last_peered":"2024-09-16T07:32:09.286628+0000","last_clean":"2024-09-16T07:32:09.286628+0000","last_became_active":"2024-09-16T07:32:08.318062+0000","last_became_peered":"2024-09-16T07:32:08.318062+0000","last_unstale":"2024-09-16T07:32:09.286628+0000","last_undegraded":"2024-09-16T07:32:09.286628+0000","last_fullsized":"2024-09-16T07:32:09.286628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:32:06.513499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288145+0000","last_change":"2024-09-16T07:32:08.320264+0000","last_active":"2024-09-16T07:32:09.288145+0000","last_peered":"2024-09-16T07:32:09.288145+0000","last_clean":"2024-09-16T07:32:09.288145+0000","last_became_active":"2024-09-16T07:32:08.319920+0000","last_became_peered":"2024-09-16T07:32:08.319920+0000","last_unstale":"2024-09-16T07:32:09.288145+0000","last_undegraded":"2024-09-16T07:32:09.288145+0000","last_fullsized":"2024-09-16T07:32:09.288145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:42.264873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288647+0000","last_change":"2024-09-16T07:32:07.308740+0000","last_active":"2024-09-16T07:32:09.288647+0000","last_peered":"2024-09-16T07:32:09.288647+0000","last_clean":"2024-09-16T07:32:09.288647+0000","last_became_active":"2024-09-16T07:32:07.308434+0000","last_became_peered":"2024-09-16T07:32:07.308434+0000","last_unstale":"2024-09-16T07:32:09.288647+0000","last_undegraded":"2024-09-16T07:32:09.288647+0000","last_fullsized":"2024-09-16T07:32:09.288647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:34.548797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.321080+0000","last_change":"2024-09-16T07:32:08.314821+0000","last_active":"2024-09-16T07:32:08.321080+0000","last_peered":"2024-09-16T07:32:08.321080+0000","last_clean":"2024-09-16T07:32:08.321080+0000","last_became_active":"2024-09-16T07:32:08.314490+0000","last_became_peered":"2024-09-16T07:32:08.314490+0000","last_unstale":"2024-09-16T07:32:08.321080+0000","last_undegraded":"2024-09-16T07:32:08.321080+0000","last_fullsized":"2024-09-16T07:32:08.321080+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:39.418821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803778+0000","last_change":"2024-09-16T07:32:07.306542+0000","last_active":"2024-09-16T07:32:09.803778+0000","last_peered":"2024-09-16T07:32:09.803778+0000","last_clean":"2024-09-16T07:32:09.803778+0000","last_became_active":"2024-09-16T07:32:07.306241+0000","last_became_peered":"2024-09-16T07:32:07.306241+0000","last_unstale":"2024-09-16T07:32:09.803778+0000","last_undegraded":"2024-09-16T07:32:09.803778+0000","last_fullsized":"2024-09-16T07:32:09.803778+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:09:18.650373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286943+0000","last_change":"2024-09-16T07:32:08.313629+0000","last_active":"2024-09-16T07:32:09.286943+0000","last_peered":"2024-09-16T07:32:09.286943+0000","last_clean":"2024-09-16T07:32:09.286943+0000","last_became_active":"2024-09-16T07:32:08.313380+0000","last_became_peered":"2024-09-16T07:32:08.313380+0000","last_unstale":"2024-09-16T07:32:09.286943+0000","last_undegraded":"2024-09-16T07:32:09.286943+0000","last_fullsized":"2024-09-16T07:32:09.286943+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:00.860313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801485+0000","last_change":"2024-09-16T07:32:07.296547+0000","last_active":"2024-09-16T07:32:09.801485+0000","last_peered":"2024-09-16T07:32:09.801485+0000","last_clean":"2024-09-16T07:32:09.801485+0000","last_became_active":"2024-09-16T07:32:07.296297+0000","last_became_peered":"2024-09-16T07:32:07.296297+0000","last_unstale":"2024-09-16T07:32:09.801485+0000","last_undegraded":"2024-09-16T07:32:09.801485+0000","last_fullsized":"2024-09-16T07:32:09.801485+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:10.288771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288293+0000","last_change":"2024-09-16T07:32:08.311108+0000","last_active":"2024-09-16T07:32:09.288293+0000","last_peered":"2024-09-16T07:32:09.288293+0000","last_clean":"2024-09-16T07:32:09.288293+0000","last_became_active":"2024-09-16T07:32:08.310727+0000","last_became_peered":"2024-09-16T07:32:08.310727+0000","last_unstale":"2024-09-16T07:32:09.288293+0000","last_undegraded":"2024-09-16T07:32:09.288293+0000","last_fullsized":"2024-09-16T07:32:09.288293+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:39.807964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287083+0000","last_change":"2024-09-16T07:32:07.304451+0000","last_active":"2024-09-16T07:32:09.287083+0000","last_peered":"2024-09-16T07:32:09.287083+0000","last_clean":"2024-09-16T07:32:09.287083+0000","last_became_active":"2024-09-16T07:32:07.302975+0000","last_became_peered":"2024-09-16T07:32:07.302975+0000","last_unstale":"2024-09-16T07:32:09.287083+0000","last_undegraded":"2024-09-16T07:32:09.287083+0000","last_fullsized":"2024-09-16T07:32:09.287083+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:46.006560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289106+0000","last_change":"2024-09-16T07:32:08.298511+0000","last_active":"2024-09-16T07:32:09.289106+0000","last_peered":"2024-09-16T07:32:09.289106+0000","last_clean":"2024-09-16T07:32:09.289106+0000","last_became_active":"2024-09-16T07:32:08.298254+0000","last_became_peered":"2024-09-16T07:32:08.298254+0000","last_unstale":"2024-09-16T07:32:09.289106+0000","last_undegraded":"2024-09-16T07:32:09.289106+0000","last_fullsized":"2024-09-16T07:32:09.289106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:42:36.232561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302767+0000","last_change":"2024-09-16T07:32:07.303440+0000","last_active":"2024-09-16T07:32:09.302767+0000","last_peered":"2024-09-16T07:32:09.302767+0000","last_clean":"2024-09-16T07:32:09.302767+0000","last_became_active":"2024-09-16T07:32:07.303136+0000","last_became_peered":"2024-09-16T07:32:07.303136+0000","last_unstale":"2024-09-16T07:32:09.302767+0000","last_undegraded":"2024-09-16T07:32:09.302767+0000","last_fullsized":"2024-09-16T07:32:09.302767+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.218703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801556+0000","last_change":"2024-09-16T07:32:08.294279+0000","last_active":"2024-09-16T07:32:09.801556+0000","last_peered":"2024-09-16T07:32:09.801556+0000","last_clean":"2024-09-16T07:32:09.801556+0000","last_became_active":"2024-09-16T07:32:08.293927+0000","last_became_peered":"2024-09-16T07:32:08.293927+0000","last_unstale":"2024-09-16T07:32:09.801556+0000","last_undegraded":"2024-09-16T07:32:09.801556+0000","last_fullsized":"2024-09-16T07:32:09.801556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:30.784000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286406+0000","last_change":"2024-09-16T07:32:07.300573+0000","last_active":"2024-09-16T07:32:09.286406+0000","last_peered":"2024-09-16T07:32:09.286406+0000","last_clean":"2024-09-16T07:32:09.286406+0000","last_became_active":"2024-09-16T07:32:07.300228+0000","last_became_peered":"2024-09-16T07:32:07.300228+0000","last_unstale":"2024-09-16T07:32:09.286406+0000","last_undegraded":"2024-09-16T07:32:09.286406+0000","last_fullsized":"2024-09-16T07:32:09.286406+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:34.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.303117+0000","last_change":"2024-09-16T07:32:08.293625+0000","last_active":"2024-09-16T07:32:08.303117+0000","last_peered":"2024-09-16T07:32:08.303117+0000","last_clean":"2024-09-16T07:32:08.303117+0000","last_became_active":"2024-09-16T07:32:08.293342+0000","last_became_peered":"2024-09-16T07:32:08.293342+0000","last_unstale":"2024-09-16T07:32:08.303117+0000","last_undegraded":"2024-09-16T07:32:08.303117+0000","last_fullsized":"2024-09-16T07:32:08.303117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:39.672422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802836+0000","last_change":"2024-09-16T07:32:07.298421+0000","last_active":"2024-09-16T07:32:09.802836+0000","last_peered":"2024-09-16T07:32:09.802836+0000","last_clean":"2024-09-16T07:32:09.802836+0000","last_became_active":"2024-09-16T07:32:07.298115+0000","last_became_peered":"2024-09-16T07:32:07.298115+0000","last_unstale":"2024-09-16T07:32:09.802836+0000","last_undegraded":"2024-09-16T07:32:09.802836+0000","last_fullsized":"2024-09-16T07:32:09.802836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.394961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803458+0000","last_change":"2024-09-16T07:32:08.306788+0000","last_active":"2024-09-16T07:32:09.803458+0000","last_peered":"2024-09-16T07:32:09.803458+0000","last_clean":"2024-09-16T07:32:09.803458+0000","last_became_active":"2024-09-16T07:32:08.306507+0000","last_became_peered":"2024-09-16T07:32:08.306507+0000","last_unstale":"2024-09-16T07:32:09.803458+0000","last_undegraded":"2024-09-16T07:32:09.803458+0000","last_fullsized":"2024-09-16T07:32:09.803458+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:54.124743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.287524+0000","last_change":"2024-09-16T07:32:07.298592+0000","last_active":"2024-09-16T07:32:08.287524+0000","last_peered":"2024-09-16T07:32:08.287524+0000","last_clean":"2024-09-16T07:32:08.287524+0000","last_became_active":"2024-09-16T07:32:07.298248+0000","last_became_peered":"2024-09-16T07:32:07.298248+0000","last_unstale":"2024-09-16T07:32:08.287524+0000","last_undegraded":"2024-09-16T07:32:08.287524+0000","last_fullsized":"2024-09-16T07:32:08.287524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:07.421184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289434+0000","last_change":"2024-09-16T07:32:08.294543+0000","last_active":"2024-09-16T07:32:09.289434+0000","last_peered":"2024-09-16T07:32:09.289434+0000","last_clean":"2024-09-16T07:32:09.289434+0000","last_became_active":"2024-09-16T07:32:08.294282+0000","last_became_peered":"2024-09-16T07:32:08.294282+0000","last_unstale":"2024-09-16T07:32:09.289434+0000","last_undegraded":"2024-09-16T07:32:09.289434+0000","last_fullsized":"2024-09-16T07:32:09.289434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:16.217607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801708+0000","last_change":"2024-09-16T07:32:07.293017+0000","last_active":"2024-09-16T07:32:09.801708+0000","last_peered":"2024-09-16T07:32:09.801708+0000","last_clean":"2024-09-16T07:32:09.801708+0000","last_became_active":"2024-09-16T07:32:07.292191+0000","last_became_peered":"2024-09-16T07:32:07.292191+0000","last_unstale":"2024-09-16T07:32:09.801708+0000","last_undegraded":"2024-09-16T07:32:09.801708+0000","last_fullsized":"2024-09-16T07:32:09.801708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:38.795641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288359+0000","last_change":"2024-09-16T07:32:08.308148+0000","last_active":"2024-09-16T07:32:09.288359+0000","last_peered":"2024-09-16T07:32:09.288359+0000","last_clean":"2024-09-16T07:32:09.288359+0000","last_became_active":"2024-09-16T07:32:08.307874+0000","last_became_peered":"2024-09-16T07:32:08.307874+0000","last_unstale":"2024-09-16T07:32:09.288359+0000","last_undegraded":"2024-09-16T07:32:09.288359+0000","last_fullsized":"2024-09-16T07:32:09.288359+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:53.262709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287380+0000","last_change":"2024-09-16T07:32:07.295876+0000","last_active":"2024-09-16T07:32:09.287380+0000","last_peered":"2024-09-16T07:32:09.287380+0000","last_clean":"2024-09-16T07:32:09.287380+0000","last_became_active":"2024-09-16T07:32:07.295566+0000","last_became_peered":"2024-09-16T07:32:07.295566+0000","last_unstale":"2024-09-16T07:32:09.287380+0000","last_undegraded":"2024-09-16T07:32:09.287380+0000","last_fullsized":"2024-09-16T07:32:09.287380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:58.455115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287003+0000","last_change":"2024-09-16T07:32:08.312019+0000","last_active":"2024-09-16T07:32:09.287003+0000","last_peered":"2024-09-16T07:32:09.287003+0000","last_clean":"2024-09-16T07:32:09.287003+0000","last_became_active":"2024-09-16T07:32:08.311741+0000","last_became_peered":"2024-09-16T07:32:08.311741+0000","last_unstale":"2024-09-16T07:32:09.287003+0000","last_undegraded":"2024-09-16T07:32:09.287003+0000","last_fullsized":"2024-09-16T07:32:09.287003+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:07.578144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302951+0000","last_change":"2024-09-16T07:32:07.302428+0000","last_active":"2024-09-16T07:32:09.302951+0000","last_peered":"2024-09-16T07:32:09.302951+0000","last_clean":"2024-09-16T07:32:09.302951+0000","last_became_active":"2024-09-16T07:32:07.300250+0000","last_became_peered":"2024-09-16T07:32:07.300250+0000","last_unstale":"2024-09-16T07:32:09.302951+0000","last_undegraded":"2024-09-16T07:32:09.302951+0000","last_fullsized":"2024-09-16T07:32:09.302951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:27:09.678395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.303468+0000","last_change":"2024-09-16T07:32:08.299261+0000","last_active":"2024-09-16T07:32:08.303468+0000","last_peered":"2024-09-16T07:32:08.303468+0000","last_clean":"2024-09-16T07:32:08.303468+0000","last_became_active":"2024-09-16T07:32:08.298980+0000","last_became_peered":"2024-09-16T07:32:08.298980+0000","last_unstale":"2024-09-16T07:32:08.303468+0000","last_undegraded":"2024-09-16T07:32:08.303468+0000","last_fullsized":"2024-09-16T07:32:08.303468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:03:01.326658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803340+0000","last_change":"2024-09-16T07:32:07.302787+0000","last_active":"2024-09-16T07:32:09.803340+0000","last_peered":"2024-09-16T07:32:09.803340+0000","last_clean":"2024-09-16T07:32:09.803340+0000","last_became_active":"2024-09-16T07:32:07.302449+0000","last_became_peered":"2024-09-16T07:32:07.302449+0000","last_unstale":"2024-09-16T07:32:09.803340+0000","last_undegraded":"2024-09-16T07:32:09.803340+0000","last_fullsized":"2024-09-16T07:32:09.803340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:00.367572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287772+0000","last_change":"2024-09-16T07:32:08.302632+0000","last_active":"2024-09-16T07:32:09.287772+0000","last_peered":"2024-09-16T07:32:09.287772+0000","last_clean":"2024-09-16T07:32:09.287772+0000","last_became_active":"2024-09-16T07:32:08.302339+0000","last_became_peered":"2024-09-16T07:32:08.302339+0000","last_unstale":"2024-09-16T07:32:09.287772+0000","last_undegraded":"2024-09-16T07:32:09.287772+0000","last_fullsized":"2024-09-16T07:32:09.287772+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:10.715805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803112+0000","last_change":"2024-09-16T07:32:07.305719+0000","last_active":"2024-09-16T07:32:09.803112+0000","last_peered":"2024-09-16T07:32:09.803112+0000","last_clean":"2024-09-16T07:32:09.803112+0000","last_became_active":"2024-09-16T07:32:07.305434+0000","last_became_peered":"2024-09-16T07:32:07.305434+0000","last_unstale":"2024-09-16T07:32:09.803112+0000","last_undegraded":"2024-09-16T07:32:09.803112+0000","last_fullsized":"2024-09-16T07:32:09.803112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:05.012073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289214+0000","last_change":"2024-09-16T07:32:08.291976+0000","last_active":"2024-09-16T07:32:09.289214+0000","last_peered":"2024-09-16T07:32:09.289214+0000","last_clean":"2024-09-16T07:32:09.289214+0000","last_became_active":"2024-09-16T07:32:08.291246+0000","last_became_peered":"2024-09-16T07:32:08.291246+0000","last_unstale":"2024-09-16T07:32:09.289214+0000","last_undegraded":"2024-09-16T07:32:09.289214+0000","last_fullsized":"2024-09-16T07:32:09.289214+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:57.639053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286746+0000","last_change":"2024-09-16T07:32:07.306242+0000","last_active":"2024-09-16T07:32:09.286746+0000","last_peered":"2024-09-16T07:32:09.286746+0000","last_clean":"2024-09-16T07:32:09.286746+0000","last_became_active":"2024-09-16T07:32:07.305908+0000","last_became_peered":"2024-09-16T07:32:07.305908+0000","last_unstale":"2024-09-16T07:32:09.286746+0000","last_undegraded":"2024-09-16T07:32:09.286746+0000","last_fullsized":"2024-09-16T07:32:09.286746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:39.774316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802837+0000","last_change":"2024-09-16T07:32:08.319014+0000","last_active":"2024-09-16T07:32:09.802837+0000","last_peered":"2024-09-16T07:32:09.802837+0000","last_clean":"2024-09-16T07:32:09.802837+0000","last_became_active":"2024-09-16T07:32:08.318726+0000","last_became_peered":"2024-09-16T07:32:08.318726+0000","last_unstale":"2024-09-16T07:32:09.802837+0000","last_undegraded":"2024-09-16T07:32:09.802837+0000","last_fullsized":"2024-09-16T07:32:09.802837+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:16.217607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288807+0000","last_change":"2024-09-16T07:32:07.303394+0000","last_active":"2024-09-16T07:32:09.288807+0000","last_peered":"2024-09-16T07:32:09.288807+0000","last_clean":"2024-09-16T07:32:09.288807+0000","last_became_active":"2024-09-16T07:32:07.301931+0000","last_became_peered":"2024-09-16T07:32:07.301931+0000","last_unstale":"2024-09-16T07:32:09.288807+0000","last_undegraded":"2024-09-16T07:32:09.288807+0000","last_fullsized":"2024-09-16T07:32:09.288807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:55.958990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317905+0000","last_change":"2024-09-16T07:32:08.304216+0000","last_active":"2024-09-16T07:32:08.317905+0000","last_peered":"2024-09-16T07:32:08.317905+0000","last_clean":"2024-09-16T07:32:08.317905+0000","last_became_active":"2024-09-16T07:32:08.303910+0000","last_became_peered":"2024-09-16T07:32:08.303910+0000","last_unstale":"2024-09-16T07:32:08.317905+0000","last_undegraded":"2024-09-16T07:32:08.317905+0000","last_fullsized":"2024-09-16T07:32:08.317905+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:14:54.269859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801224+0000","last_change":"2024-09-16T07:32:07.304199+0000","last_active":"2024-09-16T07:32:09.801224+0000","last_peered":"2024-09-16T07:32:09.801224+0000","last_clean":"2024-09-16T07:32:09.801224+0000","last_became_active":"2024-09-16T07:32:07.303864+0000","last_became_peered":"2024-09-16T07:32:07.303864+0000","last_unstale":"2024-09-16T07:32:09.801224+0000","last_undegraded":"2024-09-16T07:32:09.801224+0000","last_fullsized":"2024-09-16T07:32:09.801224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:38.370222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801739+0000","last_change":"2024-09-16T07:32:08.299020+0000","last_active":"2024-09-16T07:32:09.801739+0000","last_peered":"2024-09-16T07:32:09.801739+0000","last_clean":"2024-09-16T07:32:09.801739+0000","last_became_active":"2024-09-16T07:32:08.298768+0000","last_became_peered":"2024-09-16T07:32:08.298768+0000","last_unstale":"2024-09-16T07:32:09.801739+0000","last_undegraded":"2024-09-16T07:32:09.801739+0000","last_fullsized":"2024-09-16T07:32:09.801739+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:16.821318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287041+0000","last_change":"2024-09-16T07:32:07.305683+0000","last_active":"2024-09-16T07:32:09.287041+0000","last_peered":"2024-09-16T07:32:09.287041+0000","last_clean":"2024-09-16T07:32:09.287041+0000","last_became_active":"2024-09-16T07:32:07.305348+0000","last_became_peered":"2024-09-16T07:32:07.305348+0000","last_unstale":"2024-09-16T07:32:09.287041+0000","last_undegraded":"2024-09-16T07:32:09.287041+0000","last_fullsized":"2024-09-16T07:32:09.287041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:26.527468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288599+0000","last_change":"2024-09-16T07:32:08.305698+0000","last_active":"2024-09-16T07:32:09.288599+0000","last_peered":"2024-09-16T07:32:09.288599+0000","last_clean":"2024-09-16T07:32:09.288599+0000","last_became_active":"2024-09-16T07:32:08.304989+0000","last_became_peered":"2024-09-16T07:32:08.304989+0000","last_unstale":"2024-09-16T07:32:09.288599+0000","last_undegraded":"2024-09-16T07:32:09.288599+0000","last_fullsized":"2024-09-16T07:32:09.288599+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:27:10.686094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801784+0000","last_change":"2024-09-16T07:32:07.300822+0000","last_active":"2024-09-16T07:32:09.801784+0000","last_peered":"2024-09-16T07:32:09.801784+0000","last_clean":"2024-09-16T07:32:09.801784+0000","last_became_active":"2024-09-16T07:32:07.299917+0000","last_became_peered":"2024-09-16T07:32:07.299917+0000","last_unstale":"2024-09-16T07:32:09.801784+0000","last_undegraded":"2024-09-16T07:32:09.801784+0000","last_fullsized":"2024-09-16T07:32:09.801784+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:21.094893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803376+0000","last_change":"2024-09-16T07:32:08.305161+0000","last_active":"2024-09-16T07:32:09.803376+0000","last_peered":"2024-09-16T07:32:09.803376+0000","last_clean":"2024-09-16T07:32:09.803376+0000","last_became_active":"2024-09-16T07:32:08.304812+0000","last_became_peered":"2024-09-16T07:32:08.304812+0000","last_unstale":"2024-09-16T07:32:09.803376+0000","last_undegraded":"2024-09-16T07:32:09.803376+0000","last_fullsized":"2024-09-16T07:32:09.803376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:45.783015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287093+0000","last_change":"2024-09-16T07:32:07.300447+0000","last_active":"2024-09-16T07:32:09.287093+0000","last_peered":"2024-09-16T07:32:09.287093+0000","last_clean":"2024-09-16T07:32:09.287093+0000","last_became_active":"2024-09-16T07:32:07.299741+0000","last_became_peered":"2024-09-16T07:32:07.299741+0000","last_unstale":"2024-09-16T07:32:09.287093+0000","last_undegraded":"2024-09-16T07:32:09.287093+0000","last_fullsized":"2024-09-16T07:32:09.287093+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:10.288771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317857+0000","last_change":"2024-09-16T07:32:08.303263+0000","last_active":"2024-09-16T07:32:08.317857+0000","last_peered":"2024-09-16T07:32:08.317857+0000","last_clean":"2024-09-16T07:32:08.317857+0000","last_became_active":"2024-09-16T07:32:08.302981+0000","last_became_peered":"2024-09-16T07:32:08.302981+0000","last_unstale":"2024-09-16T07:32:08.317857+0000","last_undegraded":"2024-09-16T07:32:08.317857+0000","last_fullsized":"2024-09-16T07:32:08.317857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:47.755951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288416+0000","last_change":"2024-09-16T07:32:07.308730+0000","last_active":"2024-09-16T07:32:09.288416+0000","last_peered":"2024-09-16T07:32:09.288416+0000","last_clean":"2024-09-16T07:32:09.288416+0000","last_became_active":"2024-09-16T07:32:07.308398+0000","last_became_peered":"2024-09-16T07:32:07.308398+0000","last_unstale":"2024-09-16T07:32:09.288416+0000","last_undegraded":"2024-09-16T07:32:09.288416+0000","last_fullsized":"2024-09-16T07:32:09.288416+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:06:58.270398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302668+0000","last_change":"2024-09-16T07:32:08.310285+0000","last_active":"2024-09-16T07:32:09.302668+0000","last_peered":"2024-09-16T07:32:09.302668+0000","last_clean":"2024-09-16T07:32:09.302668+0000","last_became_active":"2024-09-16T07:32:08.310020+0000","last_became_peered":"2024-09-16T07:32:08.310020+0000","last_unstale":"2024-09-16T07:32:09.302668+0000","last_undegraded":"2024-09-16T07:32:09.302668+0000","last_fullsized":"2024-09-16T07:32:09.302668+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:31.397267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286582+0000","last_change":"2024-09-16T07:32:07.300914+0000","last_active":"2024-09-16T07:32:09.286582+0000","last_peered":"2024-09-16T07:32:09.286582+0000","last_clean":"2024-09-16T07:32:09.286582+0000","last_became_active":"2024-09-16T07:32:07.299885+0000","last_became_peered":"2024-09-16T07:32:07.299885+0000","last_unstale":"2024-09-16T07:32:09.286582+0000","last_undegraded":"2024-09-16T07:32:09.286582+0000","last_fullsized":"2024-09-16T07:32:09.286582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:40:30.223066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302334+0000","last_change":"2024-09-16T07:32:08.320654+0000","last_active":"2024-09-16T07:32:09.302334+0000","last_peered":"2024-09-16T07:32:09.302334+0000","last_clean":"2024-09-16T07:32:09.302334+0000","last_became_active":"2024-09-16T07:32:08.319915+0000","last_became_peered":"2024-09-16T07:32:08.319915+0000","last_unstale":"2024-09-16T07:32:09.302334+0000","last_undegraded":"2024-09-16T07:32:09.302334+0000","last_fullsized":"2024-09-16T07:32:09.302334+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:33.846471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288917+0000","last_change":"2024-09-16T07:32:07.298679+0000","last_active":"2024-09-16T07:32:09.288917+0000","last_peered":"2024-09-16T07:32:09.288917+0000","last_clean":"2024-09-16T07:32:09.288917+0000","last_became_active":"2024-09-16T07:32:07.298404+0000","last_became_peered":"2024-09-16T07:32:07.298404+0000","last_unstale":"2024-09-16T07:32:09.288917+0000","last_undegraded":"2024-09-16T07:32:09.288917+0000","last_fullsized":"2024-09-16T07:32:09.288917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:59.852615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302459+0000","last_change":"2024-09-16T07:32:08.323598+0000","last_active":"2024-09-16T07:32:09.302459+0000","last_peered":"2024-09-16T07:32:09.302459+0000","last_clean":"2024-09-16T07:32:09.302459+0000","last_became_active":"2024-09-16T07:32:08.323384+0000","last_became_peered":"2024-09-16T07:32:08.323384+0000","last_unstale":"2024-09-16T07:32:09.302459+0000","last_undegraded":"2024-09-16T07:32:09.302459+0000","last_fullsized":"2024-09-16T07:32:09.302459+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:54.854344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802711+0000","last_change":"2024-09-16T07:32:07.308353+0000","last_active":"2024-09-16T07:32:09.802711+0000","last_peered":"2024-09-16T07:32:09.802711+0000","last_clean":"2024-09-16T07:32:09.802711+0000","last_became_active":"2024-09-16T07:32:07.307974+0000","last_became_peered":"2024-09-16T07:32:07.307974+0000","last_unstale":"2024-09-16T07:32:09.802711+0000","last_undegraded":"2024-09-16T07:32:09.802711+0000","last_fullsized":"2024-09-16T07:32:09.802711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:27:31.872007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803811+0000","last_change":"2024-09-16T07:32:08.315950+0000","last_active":"2024-09-16T07:32:09.803811+0000","last_peered":"2024-09-16T07:32:09.803811+0000","last_clean":"2024-09-16T07:32:09.803811+0000","last_became_active":"2024-09-16T07:32:08.315630+0000","last_became_peered":"2024-09-16T07:32:08.315630+0000","last_unstale":"2024-09-16T07:32:09.803811+0000","last_undegraded":"2024-09-16T07:32:09.803811+0000","last_fullsized":"2024-09-16T07:32:09.803811+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:16:52.182468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287494+0000","last_change":"2024-09-16T07:32:07.304902+0000","last_active":"2024-09-16T07:32:09.287494+0000","last_peered":"2024-09-16T07:32:09.287494+0000","last_clean":"2024-09-16T07:32:09.287494+0000","last_became_active":"2024-09-16T07:32:07.304211+0000","last_became_peered":"2024-09-16T07:32:07.304211+0000","last_unstale":"2024-09-16T07:32:09.287494+0000","last_undegraded":"2024-09-16T07:32:09.287494+0000","last_fullsized":"2024-09-16T07:32:09.287494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:36.247989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289433+0000","last_change":"2024-09-16T07:32:08.296750+0000","last_active":"2024-09-16T07:32:09.289433+0000","last_peered":"2024-09-16T07:32:09.289433+0000","last_clean":"2024-09-16T07:32:09.289433+0000","last_became_active":"2024-09-16T07:32:08.296460+0000","last_became_peered":"2024-09-16T07:32:08.296460+0000","last_unstale":"2024-09-16T07:32:09.289433+0000","last_undegraded":"2024-09-16T07:32:09.289433+0000","last_fullsized":"2024-09-16T07:32:09.289433+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:51.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289517+0000","last_change":"2024-09-16T07:32:07.301045+0000","last_active":"2024-09-16T07:32:09.289517+0000","last_peered":"2024-09-16T07:32:09.289517+0000","last_clean":"2024-09-16T07:32:09.289517+0000","last_became_active":"2024-09-16T07:32:07.300776+0000","last_became_peered":"2024-09-16T07:32:07.300776+0000","last_unstale":"2024-09-16T07:32:09.289517+0000","last_undegraded":"2024-09-16T07:32:09.289517+0000","last_fullsized":"2024-09-16T07:32:09.289517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:58:00.765229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288544+0000","last_change":"2024-09-16T07:32:08.317461+0000","last_active":"2024-09-16T07:32:09.288544+0000","last_peered":"2024-09-16T07:32:09.288544+0000","last_clean":"2024-09-16T07:32:09.288544+0000","last_became_active":"2024-09-16T07:32:08.317173+0000","last_became_peered":"2024-09-16T07:32:08.317173+0000","last_unstale":"2024-09-16T07:32:09.288544+0000","last_undegraded":"2024-09-16T07:32:09.288544+0000","last_fullsized":"2024-09-16T07:32:09.288544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:50.465211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.291816+0000","last_change":"2024-09-16T07:32:07.304201+0000","last_active":"2024-09-16T07:32:08.291816+0000","last_peered":"2024-09-16T07:32:08.291816+0000","last_clean":"2024-09-16T07:32:08.291816+0000","last_became_active":"2024-09-16T07:32:07.303494+0000","last_became_peered":"2024-09-16T07:32:07.303494+0000","last_unstale":"2024-09-16T07:32:08.291816+0000","last_undegraded":"2024-09-16T07:32:08.291816+0000","last_fullsized":"2024-09-16T07:32:08.291816+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:09:44.431476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288512+0000","last_change":"2024-09-16T07:32:08.303325+0000","last_active":"2024-09-16T07:32:09.288512+0000","last_peered":"2024-09-16T07:32:09.288512+0000","last_clean":"2024-09-16T07:32:09.288512+0000","last_became_active":"2024-09-16T07:32:08.303079+0000","last_became_peered":"2024-09-16T07:32:08.303079+0000","last_unstale":"2024-09-16T07:32:09.288512+0000","last_undegraded":"2024-09-16T07:32:09.288512+0000","last_fullsized":"2024-09-16T07:32:09.288512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:40:55.637983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803237+0000","last_change":"2024-09-16T07:32:07.303170+0000","last_active":"2024-09-16T07:32:09.803237+0000","last_peered":"2024-09-16T07:32:09.803237+0000","last_clean":"2024-09-16T07:32:09.803237+0000","last_became_active":"2024-09-16T07:32:07.302917+0000","last_became_peered":"2024-09-16T07:32:07.302917+0000","last_unstale":"2024-09-16T07:32:09.803237+0000","last_undegraded":"2024-09-16T07:32:09.803237+0000","last_fullsized":"2024-09-16T07:32:09.803237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:40.817725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317676+0000","last_change":"2024-09-16T07:32:08.301991+0000","last_active":"2024-09-16T07:32:08.317676+0000","last_peered":"2024-09-16T07:32:08.317676+0000","last_clean":"2024-09-16T07:32:08.317676+0000","last_became_active":"2024-09-16T07:32:08.301723+0000","last_became_peered":"2024-09-16T07:32:08.301723+0000","last_unstale":"2024-09-16T07:32:08.317676+0000","last_undegraded":"2024-09-16T07:32:08.317676+0000","last_fullsized":"2024-09-16T07:32:08.317676+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:58.170728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.289504+0000","last_change":"2024-09-16T07:32:07.302760+0000","last_active":"2024-09-16T07:32:08.289504+0000","last_peered":"2024-09-16T07:32:08.289504+0000","last_clean":"2024-09-16T07:32:08.289504+0000","last_became_active":"2024-09-16T07:32:07.302481+0000","last_became_peered":"2024-09-16T07:32:07.302481+0000","last_unstale":"2024-09-16T07:32:08.289504+0000","last_undegraded":"2024-09-16T07:32:08.289504+0000","last_fullsized":"2024-09-16T07:32:08.289504+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.679303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286800+0000","last_change":"2024-09-16T07:32:08.304086+0000","last_active":"2024-09-16T07:32:09.286800+0000","last_peered":"2024-09-16T07:32:09.286800+0000","last_clean":"2024-09-16T07:32:09.286800+0000","last_became_active":"2024-09-16T07:32:08.303774+0000","last_became_peered":"2024-09-16T07:32:08.303774+0000","last_unstale":"2024-09-16T07:32:09.286800+0000","last_undegraded":"2024-09-16T07:32:09.286800+0000","last_fullsized":"2024-09-16T07:32:09.286800+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:56.966689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803087+0000","last_change":"2024-09-16T07:32:07.301495+0000","last_active":"2024-09-16T07:32:09.803087+0000","last_peered":"2024-09-16T07:32:09.803087+0000","last_clean":"2024-09-16T07:32:09.803087+0000","last_became_active":"2024-09-16T07:32:07.299755+0000","last_became_peered":"2024-09-16T07:32:07.299755+0000","last_unstale":"2024-09-16T07:32:09.803087+0000","last_undegraded":"2024-09-16T07:32:09.803087+0000","last_fullsized":"2024-09-16T07:32:09.803087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:39.567826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802930+0000","last_change":"2024-09-16T07:32:08.306049+0000","last_active":"2024-09-16T07:32:09.802930+0000","last_peered":"2024-09-16T07:32:09.802930+0000","last_clean":"2024-09-16T07:32:09.802930+0000","last_became_active":"2024-09-16T07:32:08.305578+0000","last_became_peered":"2024-09-16T07:32:08.305578+0000","last_unstale":"2024-09-16T07:32:09.802930+0000","last_undegraded":"2024-09-16T07:32:09.802930+0000","last_fullsized":"2024-09-16T07:32:09.802930+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:53.545554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801223+0000","last_change":"2024-09-16T07:32:07.305238+0000","last_active":"2024-09-16T07:32:09.801223+0000","last_peered":"2024-09-16T07:32:09.801223+0000","last_clean":"2024-09-16T07:32:09.801223+0000","last_became_active":"2024-09-16T07:32:07.304644+0000","last_became_peered":"2024-09-16T07:32:07.304644+0000","last_unstale":"2024-09-16T07:32:09.801223+0000","last_undegraded":"2024-09-16T07:32:09.801223+0000","last_fullsized":"2024-09-16T07:32:09.801223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:21.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286370+0000","last_change":"2024-09-16T07:32:08.318877+0000","last_active":"2024-09-16T07:32:09.286370+0000","last_peered":"2024-09-16T07:32:09.286370+0000","last_clean":"2024-09-16T07:32:09.286370+0000","last_became_active":"2024-09-16T07:32:08.318522+0000","last_became_peered":"2024-09-16T07:32:08.318522+0000","last_unstale":"2024-09-16T07:32:09.286370+0000","last_undegraded":"2024-09-16T07:32:09.286370+0000","last_fullsized":"2024-09-16T07:32:09.286370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:17.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287226+0000","last_change":"2024-09-16T07:32:07.301496+0000","last_active":"2024-09-16T07:32:09.287226+0000","last_peered":"2024-09-16T07:32:09.287226+0000","last_clean":"2024-09-16T07:32:09.287226+0000","last_became_active":"2024-09-16T07:32:07.301228+0000","last_became_peered":"2024-09-16T07:32:07.301228+0000","last_unstale":"2024-09-16T07:32:09.287226+0000","last_undegraded":"2024-09-16T07:32:09.287226+0000","last_fullsized":"2024-09-16T07:32:09.287226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:25:26.063449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302534+0000","last_change":"2024-09-16T07:32:08.320214+0000","last_active":"2024-09-16T07:32:09.302534+0000","last_peered":"2024-09-16T07:32:09.302534+0000","last_clean":"2024-09-16T07:32:09.302534+0000","last_became_active":"2024-09-16T07:32:08.319951+0000","last_became_peered":"2024-09-16T07:32:08.319951+0000","last_unstale":"2024-09-16T07:32:09.302534+0000","last_undegraded":"2024-09-16T07:32:09.302534+0000","last_fullsized":"2024-09-16T07:32:09.302534+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:28.895837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286658+0000","last_change":"2024-09-16T07:32:07.301284+0000","last_active":"2024-09-16T07:32:09.286658+0000","last_peered":"2024-09-16T07:32:09.286658+0000","last_clean":"2024-09-16T07:32:09.286658+0000","last_became_active":"2024-09-16T07:32:07.300952+0000","last_became_peered":"2024-09-16T07:32:07.300952+0000","last_unstale":"2024-09-16T07:32:09.286658+0000","last_undegraded":"2024-09-16T07:32:09.286658+0000","last_fullsized":"2024-09-16T07:32:09.286658+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:11:41.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":198,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287894+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:32:09.287894+0000","last_peered":"2024-09-16T07:32:09.287894+0000","last_clean":"2024-09-16T07:32:09.287894+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:32:09.287894+0000","last_undegraded":"2024-09-16T07:32:09.287894+0000","last_fullsized":"2024-09-16T07:32:09.287894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1433600,"data_stored":937517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":346625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":835584,"data_stored":346623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":835584,"data_stored":346603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":346645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":348761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":930601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":831488,"data_stored":341845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:32:12.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:32:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 -- 172.21.15.114:0/3723823090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 msgr2=0x7fc8900ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 --2- 172.21.15.114:0/3723823090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc8900ce2e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc888009c80 tx=0x7fc88801cda0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 -- 172.21.15.114:0/3723823090 shutdown_connections 2024-09-16T07:32:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 --2- 172.21.15.114:0/3723823090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc8900ce2e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 --2- 172.21.15.114:0/3723823090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc89015f9a0 0x7fc89006e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 -- 172.21.15.114:0/3723823090 >> 172.21.15.114:0/3723823090 conn(0x7fc8900b18f0 msgr2=0x7fc8900b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 -- 172.21.15.114:0/3723823090 shutdown_connections 2024-09-16T07:32:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.583+0000 7fc897e00640 1 -- 172.21.15.114:0/3723823090 wait complete. 2024-09-16T07:32:12.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 Processor -- start 2024-09-16T07:32:12.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 -- start start 2024-09-16T07:32:12.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8900cf1d0 0x7fc890153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89015f9a0 0x7fc89009ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc89015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc8901693c0 con 0x7fc890160490 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc890169240 con 0x7fc89015f9a0 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc890169540 con 0x7fc8900cf1d0 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc89015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc89015eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55868/0 (socket says 172.21.15.114:55868) 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 -- 172.21.15.114:0/3542253556 learned_addr learned my addr 172.21.15.114:0/3542253556 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895400640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8900cf1d0 0x7fc890153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc894a00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89015f9a0 0x7fc89009ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 -- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8900cf1d0 msgr2=0x7fc890153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8900cf1d0 0x7fc890153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 -- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89015f9a0 msgr2=0x7fc89009ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89015f9a0 0x7fc89009ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 -- 172.21.15.114:0/3542253556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89009d390 con 0x7fc890160490 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895400640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8900cf1d0 0x7fc890153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc894a00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89015f9a0 0x7fc89009ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc895e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc89015eb80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc888009bd0 tx=0x7fc888003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc88d600640 1 -- 172.21.15.114:0/3542253556 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8880bb070 con 0x7fc890160490 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc88d600640 1 -- 172.21.15.114:0/3542253556 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc888004e00 con 0x7fc890160490 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89009d670 con 0x7fc890160490 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc88d600640 1 -- 172.21.15.114:0/3542253556 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8880b2040 con 0x7fc890160490 2024-09-16T07:32:12.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.587+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89009dc30 con 0x7fc890160490 2024-09-16T07:32:12.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.591+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc890069410 con 0x7fc890160490 2024-09-16T07:32:12.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.591+0000 7fc88d600640 1 -- 172.21.15.114:0/3542253556 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fc8880be070 con 0x7fc890160490 2024-09-16T07:32:12.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.591+0000 7fc88d600640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc870073220 0x7fc8700756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.591+0000 7fc88d600640 1 -- 172.21.15.114:0/3542253556 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fc88812e340 con 0x7fc890160490 2024-09-16T07:32:12.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.591+0000 7fc895400640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc870073220 0x7fc8700756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.591+0000 7fc895400640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc870073220 0x7fc8700756e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc8900aebb0 tx=0x7fc884005f50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:12.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.595+0000 7fc88d600640 1 -- 172.21.15.114:0/3542253556 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc888016990 con 0x7fc890160490 2024-09-16T07:32:12.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.759+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc89006ae30 con 0x7fc870073220 2024-09-16T07:32:12.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.763+0000 7fc88d600640 1 -- 172.21.15.114:0/3542253556 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252052 (secure 0 0 0) 0x7fc88400a800 con 0x7fc870073220 2024-09-16T07:32:12.763 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:12.765 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc870073220 msgr2=0x7fc8700756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc870073220 0x7fc8700756e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc8900aebb0 tx=0x7fc884005f50 comp rx=0 tx=0).stop 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 msgr2=0x7fc89015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc89015eb80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc888009bd0 tx=0x7fc888003f60 comp rx=0 tx=0).stop 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 shutdown_connections 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fc870073220 0x7fc8700756e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc890160490 0x7fc89015eb80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc89015f9a0 0x7fc89009ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 --2- 172.21.15.114:0/3542253556 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8900cf1d0 0x7fc890153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 >> 172.21.15.114:0/3542253556 conn(0x7fc8900b18f0 msgr2=0x7fc890155180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:12.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 shutdown_connections 2024-09-16T07:32:12.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.767+0000 7fc897e00640 1 -- 172.21.15.114:0/3542253556 wait complete. 2024-09-16T07:32:12.784 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-16T07:32:11.051812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253048,"kb_used_data":7696,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721672,"statfs":{"total":773094113280,"available":772834992128,"internally_reserved":0,"allocated":7880704,"data_stored":3945220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.778675"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288552+0000","last_change":"2024-09-16T07:32:08.299682+0000","last_active":"2024-09-16T07:32:09.288552+0000","last_peered":"2024-09-16T07:32:09.288552+0000","last_clean":"2024-09-16T07:32:09.288552+0000","last_became_active":"2024-09-16T07:32:08.299374+0000","last_became_peered":"2024-09-16T07:32:08.299374+0000","last_unstale":"2024-09-16T07:32:09.288552+0000","last_undegraded":"2024-09-16T07:32:09.288552+0000","last_fullsized":"2024-09-16T07:32:09.288552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:30.188656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287417+0000","last_change":"2024-09-16T07:32:08.310570+0000","last_active":"2024-09-16T07:32:09.287417+0000","last_peered":"2024-09-16T07:32:09.287417+0000","last_clean":"2024-09-16T07:32:09.287417+0000","last_became_active":"2024-09-16T07:32:08.310319+0000","last_became_peered":"2024-09-16T07:32:08.310319+0000","last_unstale":"2024-09-16T07:32:09.287417+0000","last_undegraded":"2024-09-16T07:32:09.287417+0000","last_fullsized":"2024-09-16T07:32:09.287417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:34.805739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302801+0000","last_change":"2024-09-16T07:32:08.310414+0000","last_active":"2024-09-16T07:32:09.302801+0000","last_peered":"2024-09-16T07:32:09.302801+0000","last_clean":"2024-09-16T07:32:09.302801+0000","last_became_active":"2024-09-16T07:32:08.310147+0000","last_became_peered":"2024-09-16T07:32:08.310147+0000","last_unstale":"2024-09-16T07:32:09.302801+0000","last_undegraded":"2024-09-16T07:32:09.302801+0000","last_fullsized":"2024-09-16T07:32:09.302801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:27:40.172996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803106+0000","last_change":"2024-09-16T07:32:08.306731+0000","last_active":"2024-09-16T07:32:09.803106+0000","last_peered":"2024-09-16T07:32:09.803106+0000","last_clean":"2024-09-16T07:32:09.803106+0000","last_became_active":"2024-09-16T07:32:08.306467+0000","last_became_peered":"2024-09-16T07:32:08.306467+0000","last_unstale":"2024-09-16T07:32:09.803106+0000","last_undegraded":"2024-09-16T07:32:09.803106+0000","last_fullsized":"2024-09-16T07:32:09.803106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:14.714669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.314229+0000","last_change":"2024-09-16T07:32:08.301362+0000","last_active":"2024-09-16T07:32:08.314229+0000","last_peered":"2024-09-16T07:32:08.314229+0000","last_clean":"2024-09-16T07:32:08.314229+0000","last_became_active":"2024-09-16T07:32:08.301089+0000","last_became_peered":"2024-09-16T07:32:08.301089+0000","last_unstale":"2024-09-16T07:32:08.314229+0000","last_undegraded":"2024-09-16T07:32:08.314229+0000","last_fullsized":"2024-09-16T07:32:08.314229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:38:19.861733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286393+0000","last_change":"2024-09-16T07:32:08.309383+0000","last_active":"2024-09-16T07:32:09.286393+0000","last_peered":"2024-09-16T07:32:09.286393+0000","last_clean":"2024-09-16T07:32:09.286393+0000","last_became_active":"2024-09-16T07:32:08.309152+0000","last_became_peered":"2024-09-16T07:32:08.309152+0000","last_unstale":"2024-09-16T07:32:09.286393+0000","last_undegraded":"2024-09-16T07:32:09.286393+0000","last_fullsized":"2024-09-16T07:32:09.286393+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:19:18.507802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288817+0000","last_change":"2024-09-16T07:32:08.297358+0000","last_active":"2024-09-16T07:32:09.288817+0000","last_peered":"2024-09-16T07:32:09.288817+0000","last_clean":"2024-09-16T07:32:09.288817+0000","last_became_active":"2024-09-16T07:32:08.297050+0000","last_became_peered":"2024-09-16T07:32:08.297050+0000","last_unstale":"2024-09-16T07:32:09.288817+0000","last_undegraded":"2024-09-16T07:32:09.288817+0000","last_fullsized":"2024-09-16T07:32:09.288817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:27.495613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286439+0000","last_change":"2024-09-16T07:32:08.312156+0000","last_active":"2024-09-16T07:32:09.286439+0000","last_peered":"2024-09-16T07:32:09.286439+0000","last_clean":"2024-09-16T07:32:09.286439+0000","last_became_active":"2024-09-16T07:32:08.311877+0000","last_became_peered":"2024-09-16T07:32:08.311877+0000","last_unstale":"2024-09-16T07:32:09.286439+0000","last_undegraded":"2024-09-16T07:32:09.286439+0000","last_fullsized":"2024-09-16T07:32:09.286439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:14.297943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317938+0000","last_change":"2024-09-16T07:32:08.307436+0000","last_active":"2024-09-16T07:32:08.317938+0000","last_peered":"2024-09-16T07:32:08.317938+0000","last_clean":"2024-09-16T07:32:08.317938+0000","last_became_active":"2024-09-16T07:32:08.303813+0000","last_became_peered":"2024-09-16T07:32:08.303813+0000","last_unstale":"2024-09-16T07:32:08.317938+0000","last_undegraded":"2024-09-16T07:32:08.317938+0000","last_fullsized":"2024-09-16T07:32:08.317938+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:10.542387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801593+0000","last_change":"2024-09-16T07:32:08.297356+0000","last_active":"2024-09-16T07:32:09.801593+0000","last_peered":"2024-09-16T07:32:09.801593+0000","last_clean":"2024-09-16T07:32:09.801593+0000","last_became_active":"2024-09-16T07:32:08.297087+0000","last_became_peered":"2024-09-16T07:32:08.297087+0000","last_unstale":"2024-09-16T07:32:09.801593+0000","last_undegraded":"2024-09-16T07:32:09.801593+0000","last_fullsized":"2024-09-16T07:32:09.801593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:35.556496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288510+0000","last_change":"2024-09-16T07:32:08.311834+0000","last_active":"2024-09-16T07:32:09.288510+0000","last_peered":"2024-09-16T07:32:09.288510+0000","last_clean":"2024-09-16T07:32:09.288510+0000","last_became_active":"2024-09-16T07:32:08.311457+0000","last_became_peered":"2024-09-16T07:32:08.311457+0000","last_unstale":"2024-09-16T07:32:09.288510+0000","last_undegraded":"2024-09-16T07:32:09.288510+0000","last_fullsized":"2024-09-16T07:32:09.288510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:17.787443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803274+0000","last_change":"2024-09-16T07:32:08.305233+0000","last_active":"2024-09-16T07:32:09.803274+0000","last_peered":"2024-09-16T07:32:09.803274+0000","last_clean":"2024-09-16T07:32:09.803274+0000","last_became_active":"2024-09-16T07:32:08.305001+0000","last_became_peered":"2024-09-16T07:32:08.305001+0000","last_unstale":"2024-09-16T07:32:09.803274+0000","last_undegraded":"2024-09-16T07:32:09.803274+0000","last_fullsized":"2024-09-16T07:32:09.803274+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:04:42.737762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803533+0000","last_change":"2024-09-16T07:32:08.306549+0000","last_active":"2024-09-16T07:32:09.803533+0000","last_peered":"2024-09-16T07:32:09.803533+0000","last_clean":"2024-09-16T07:32:09.803533+0000","last_became_active":"2024-09-16T07:32:08.306264+0000","last_became_peered":"2024-09-16T07:32:08.306264+0000","last_unstale":"2024-09-16T07:32:09.803533+0000","last_undegraded":"2024-09-16T07:32:09.803533+0000","last_fullsized":"2024-09-16T07:32:09.803533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:38.997570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317949+0000","last_change":"2024-09-16T07:32:08.302166+0000","last_active":"2024-09-16T07:32:08.317949+0000","last_peered":"2024-09-16T07:32:08.317949+0000","last_clean":"2024-09-16T07:32:08.317949+0000","last_became_active":"2024-09-16T07:32:08.301772+0000","last_became_peered":"2024-09-16T07:32:08.301772+0000","last_unstale":"2024-09-16T07:32:08.317949+0000","last_undegraded":"2024-09-16T07:32:08.317949+0000","last_fullsized":"2024-09-16T07:32:08.317949+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:47.113647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803655+0000","last_change":"2024-09-16T07:32:08.313875+0000","last_active":"2024-09-16T07:32:09.803655+0000","last_peered":"2024-09-16T07:32:09.803655+0000","last_clean":"2024-09-16T07:32:09.803655+0000","last_became_active":"2024-09-16T07:32:08.313584+0000","last_became_peered":"2024-09-16T07:32:08.313584+0000","last_unstale":"2024-09-16T07:32:09.803655+0000","last_undegraded":"2024-09-16T07:32:09.803655+0000","last_fullsized":"2024-09-16T07:32:09.803655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:46.431522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801353+0000","last_change":"2024-09-16T07:32:08.308480+0000","last_active":"2024-09-16T07:32:09.801353+0000","last_peered":"2024-09-16T07:32:09.801353+0000","last_clean":"2024-09-16T07:32:09.801353+0000","last_became_active":"2024-09-16T07:32:08.308174+0000","last_became_peered":"2024-09-16T07:32:08.308174+0000","last_unstale":"2024-09-16T07:32:09.801353+0000","last_undegraded":"2024-09-16T07:32:09.801353+0000","last_fullsized":"2024-09-16T07:32:09.801353+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:04:41.976531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.321053+0000","last_change":"2024-09-16T07:32:08.304091+0000","last_active":"2024-09-16T07:32:08.321053+0000","last_peered":"2024-09-16T07:32:08.321053+0000","last_clean":"2024-09-16T07:32:08.321053+0000","last_became_active":"2024-09-16T07:32:08.303394+0000","last_became_peered":"2024-09-16T07:32:08.303394+0000","last_unstale":"2024-09-16T07:32:08.321053+0000","last_undegraded":"2024-09-16T07:32:08.321053+0000","last_fullsized":"2024-09-16T07:32:08.321053+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:44.459590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803547+0000","last_change":"2024-09-16T07:32:08.316101+0000","last_active":"2024-09-16T07:32:09.803547+0000","last_peered":"2024-09-16T07:32:09.803547+0000","last_clean":"2024-09-16T07:32:09.803547+0000","last_became_active":"2024-09-16T07:32:08.315805+0000","last_became_peered":"2024-09-16T07:32:08.315805+0000","last_unstale":"2024-09-16T07:32:09.803547+0000","last_undegraded":"2024-09-16T07:32:09.803547+0000","last_fullsized":"2024-09-16T07:32:09.803547+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:37.198437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286976+0000","last_change":"2024-09-16T07:32:08.314897+0000","last_active":"2024-09-16T07:32:09.286976+0000","last_peered":"2024-09-16T07:32:09.286976+0000","last_clean":"2024-09-16T07:32:09.286976+0000","last_became_active":"2024-09-16T07:32:08.311349+0000","last_became_peered":"2024-09-16T07:32:08.311349+0000","last_unstale":"2024-09-16T07:32:09.286976+0000","last_undegraded":"2024-09-16T07:32:09.286976+0000","last_fullsized":"2024-09-16T07:32:09.286976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:58:01.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803150+0000","last_change":"2024-09-16T07:32:08.305302+0000","last_active":"2024-09-16T07:32:09.803150+0000","last_peered":"2024-09-16T07:32:09.803150+0000","last_clean":"2024-09-16T07:32:09.803150+0000","last_became_active":"2024-09-16T07:32:08.305015+0000","last_became_peered":"2024-09-16T07:32:08.305015+0000","last_unstale":"2024-09-16T07:32:09.803150+0000","last_undegraded":"2024-09-16T07:32:09.803150+0000","last_fullsized":"2024-09-16T07:32:09.803150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:14.733885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801629+0000","last_change":"2024-09-16T07:32:08.305933+0000","last_active":"2024-09-16T07:32:09.801629+0000","last_peered":"2024-09-16T07:32:09.801629+0000","last_clean":"2024-09-16T07:32:09.801629+0000","last_became_active":"2024-09-16T07:32:08.305571+0000","last_became_peered":"2024-09-16T07:32:08.305571+0000","last_unstale":"2024-09-16T07:32:09.801629+0000","last_undegraded":"2024-09-16T07:32:09.801629+0000","last_fullsized":"2024-09-16T07:32:09.801629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:34.805739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801368+0000","last_change":"2024-09-16T07:32:08.298013+0000","last_active":"2024-09-16T07:32:09.801368+0000","last_peered":"2024-09-16T07:32:09.801368+0000","last_clean":"2024-09-16T07:32:09.801368+0000","last_became_active":"2024-09-16T07:32:08.297058+0000","last_became_peered":"2024-09-16T07:32:08.297058+0000","last_unstale":"2024-09-16T07:32:09.801368+0000","last_undegraded":"2024-09-16T07:32:09.801368+0000","last_fullsized":"2024-09-16T07:32:09.801368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:46:35.474974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287925+0000","last_change":"2024-09-16T07:32:08.302213+0000","last_active":"2024-09-16T07:32:09.287925+0000","last_peered":"2024-09-16T07:32:09.287925+0000","last_clean":"2024-09-16T07:32:09.287925+0000","last_became_active":"2024-09-16T07:32:08.301925+0000","last_became_peered":"2024-09-16T07:32:08.301925+0000","last_unstale":"2024-09-16T07:32:09.287925+0000","last_undegraded":"2024-09-16T07:32:09.287925+0000","last_fullsized":"2024-09-16T07:32:09.287925+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:30:54.428177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287692+0000","last_change":"2024-09-16T07:32:08.319875+0000","last_active":"2024-09-16T07:32:09.287692+0000","last_peered":"2024-09-16T07:32:09.287692+0000","last_clean":"2024-09-16T07:32:09.287692+0000","last_became_active":"2024-09-16T07:32:08.319586+0000","last_became_peered":"2024-09-16T07:32:08.319586+0000","last_unstale":"2024-09-16T07:32:09.287692+0000","last_undegraded":"2024-09-16T07:32:09.287692+0000","last_fullsized":"2024-09-16T07:32:09.287692+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:51.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801794+0000","last_change":"2024-09-16T07:32:08.293885+0000","last_active":"2024-09-16T07:32:09.801794+0000","last_peered":"2024-09-16T07:32:09.801794+0000","last_clean":"2024-09-16T07:32:09.801794+0000","last_became_active":"2024-09-16T07:32:08.293605+0000","last_became_peered":"2024-09-16T07:32:08.293605+0000","last_unstale":"2024-09-16T07:32:09.801794+0000","last_undegraded":"2024-09-16T07:32:09.801794+0000","last_fullsized":"2024-09-16T07:32:09.801794+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:09.649984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289504+0000","last_change":"2024-09-16T07:32:08.307126+0000","last_active":"2024-09-16T07:32:09.289504+0000","last_peered":"2024-09-16T07:32:09.289504+0000","last_clean":"2024-09-16T07:32:09.289504+0000","last_became_active":"2024-09-16T07:32:08.306781+0000","last_became_peered":"2024-09-16T07:32:08.306781+0000","last_unstale":"2024-09-16T07:32:09.289504+0000","last_undegraded":"2024-09-16T07:32:09.289504+0000","last_fullsized":"2024-09-16T07:32:09.289504+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:14.733885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302976+0000","last_change":"2024-09-16T07:32:08.314818+0000","last_active":"2024-09-16T07:32:09.302976+0000","last_peered":"2024-09-16T07:32:09.302976+0000","last_clean":"2024-09-16T07:32:09.302976+0000","last_became_active":"2024-09-16T07:32:08.314499+0000","last_became_peered":"2024-09-16T07:32:08.314499+0000","last_unstale":"2024-09-16T07:32:09.302976+0000","last_undegraded":"2024-09-16T07:32:09.302976+0000","last_fullsized":"2024-09-16T07:32:09.302976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:05.427763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801667+0000","last_change":"2024-09-16T07:32:08.298105+0000","last_active":"2024-09-16T07:32:09.801667+0000","last_peered":"2024-09-16T07:32:09.801667+0000","last_clean":"2024-09-16T07:32:09.801667+0000","last_became_active":"2024-09-16T07:32:08.297824+0000","last_became_peered":"2024-09-16T07:32:08.297824+0000","last_unstale":"2024-09-16T07:32:09.801667+0000","last_undegraded":"2024-09-16T07:32:09.801667+0000","last_fullsized":"2024-09-16T07:32:09.801667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:17.192325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302657+0000","last_change":"2024-09-16T07:32:08.303569+0000","last_active":"2024-09-16T07:32:09.302657+0000","last_peered":"2024-09-16T07:32:09.302657+0000","last_clean":"2024-09-16T07:32:09.302657+0000","last_became_active":"2024-09-16T07:32:08.303308+0000","last_became_peered":"2024-09-16T07:32:08.303308+0000","last_unstale":"2024-09-16T07:32:09.302657+0000","last_undegraded":"2024-09-16T07:32:09.302657+0000","last_fullsized":"2024-09-16T07:32:09.302657+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:08:29.266901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288929+0000","last_change":"2024-09-16T07:32:08.304376+0000","last_active":"2024-09-16T07:32:09.288929+0000","last_peered":"2024-09-16T07:32:09.288929+0000","last_clean":"2024-09-16T07:32:09.288929+0000","last_became_active":"2024-09-16T07:32:08.302667+0000","last_became_peered":"2024-09-16T07:32:08.302667+0000","last_unstale":"2024-09-16T07:32:09.288929+0000","last_undegraded":"2024-09-16T07:32:09.288929+0000","last_fullsized":"2024-09-16T07:32:09.288929+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:36.152689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289067+0000","last_change":"2024-09-16T07:32:08.313317+0000","last_active":"2024-09-16T07:32:09.289067+0000","last_peered":"2024-09-16T07:32:09.289067+0000","last_clean":"2024-09-16T07:32:09.289067+0000","last_became_active":"2024-09-16T07:32:08.313020+0000","last_became_peered":"2024-09-16T07:32:08.313020+0000","last_unstale":"2024-09-16T07:32:09.289067+0000","last_undegraded":"2024-09-16T07:32:09.289067+0000","last_fullsized":"2024-09-16T07:32:09.289067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:42.277058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286628+0000","last_change":"2024-09-16T07:32:08.319370+0000","last_active":"2024-09-16T07:32:09.286628+0000","last_peered":"2024-09-16T07:32:09.286628+0000","last_clean":"2024-09-16T07:32:09.286628+0000","last_became_active":"2024-09-16T07:32:08.318062+0000","last_became_peered":"2024-09-16T07:32:08.318062+0000","last_unstale":"2024-09-16T07:32:09.286628+0000","last_undegraded":"2024-09-16T07:32:09.286628+0000","last_fullsized":"2024-09-16T07:32:09.286628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:32:06.513499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288145+0000","last_change":"2024-09-16T07:32:08.320264+0000","last_active":"2024-09-16T07:32:09.288145+0000","last_peered":"2024-09-16T07:32:09.288145+0000","last_clean":"2024-09-16T07:32:09.288145+0000","last_became_active":"2024-09-16T07:32:08.319920+0000","last_became_peered":"2024-09-16T07:32:08.319920+0000","last_unstale":"2024-09-16T07:32:09.288145+0000","last_undegraded":"2024-09-16T07:32:09.288145+0000","last_fullsized":"2024-09-16T07:32:09.288145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:42.264873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288647+0000","last_change":"2024-09-16T07:32:07.308740+0000","last_active":"2024-09-16T07:32:09.288647+0000","last_peered":"2024-09-16T07:32:09.288647+0000","last_clean":"2024-09-16T07:32:09.288647+0000","last_became_active":"2024-09-16T07:32:07.308434+0000","last_became_peered":"2024-09-16T07:32:07.308434+0000","last_unstale":"2024-09-16T07:32:09.288647+0000","last_undegraded":"2024-09-16T07:32:09.288647+0000","last_fullsized":"2024-09-16T07:32:09.288647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:34.548797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.321080+0000","last_change":"2024-09-16T07:32:08.314821+0000","last_active":"2024-09-16T07:32:08.321080+0000","last_peered":"2024-09-16T07:32:08.321080+0000","last_clean":"2024-09-16T07:32:08.321080+0000","last_became_active":"2024-09-16T07:32:08.314490+0000","last_became_peered":"2024-09-16T07:32:08.314490+0000","last_unstale":"2024-09-16T07:32:08.321080+0000","last_undegraded":"2024-09-16T07:32:08.321080+0000","last_fullsized":"2024-09-16T07:32:08.321080+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:39.418821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803778+0000","last_change":"2024-09-16T07:32:07.306542+0000","last_active":"2024-09-16T07:32:09.803778+0000","last_peered":"2024-09-16T07:32:09.803778+0000","last_clean":"2024-09-16T07:32:09.803778+0000","last_became_active":"2024-09-16T07:32:07.306241+0000","last_became_peered":"2024-09-16T07:32:07.306241+0000","last_unstale":"2024-09-16T07:32:09.803778+0000","last_undegraded":"2024-09-16T07:32:09.803778+0000","last_fullsized":"2024-09-16T07:32:09.803778+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:09:18.650373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286943+0000","last_change":"2024-09-16T07:32:08.313629+0000","last_active":"2024-09-16T07:32:09.286943+0000","last_peered":"2024-09-16T07:32:09.286943+0000","last_clean":"2024-09-16T07:32:09.286943+0000","last_became_active":"2024-09-16T07:32:08.313380+0000","last_became_peered":"2024-09-16T07:32:08.313380+0000","last_unstale":"2024-09-16T07:32:09.286943+0000","last_undegraded":"2024-09-16T07:32:09.286943+0000","last_fullsized":"2024-09-16T07:32:09.286943+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:00.860313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801485+0000","last_change":"2024-09-16T07:32:07.296547+0000","last_active":"2024-09-16T07:32:09.801485+0000","last_peered":"2024-09-16T07:32:09.801485+0000","last_clean":"2024-09-16T07:32:09.801485+0000","last_became_active":"2024-09-16T07:32:07.296297+0000","last_became_peered":"2024-09-16T07:32:07.296297+0000","last_unstale":"2024-09-16T07:32:09.801485+0000","last_undegraded":"2024-09-16T07:32:09.801485+0000","last_fullsized":"2024-09-16T07:32:09.801485+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:10.288771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288293+0000","last_change":"2024-09-16T07:32:08.311108+0000","last_active":"2024-09-16T07:32:09.288293+0000","last_peered":"2024-09-16T07:32:09.288293+0000","last_clean":"2024-09-16T07:32:09.288293+0000","last_became_active":"2024-09-16T07:32:08.310727+0000","last_became_peered":"2024-09-16T07:32:08.310727+0000","last_unstale":"2024-09-16T07:32:09.288293+0000","last_undegraded":"2024-09-16T07:32:09.288293+0000","last_fullsized":"2024-09-16T07:32:09.288293+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:39.807964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287083+0000","last_change":"2024-09-16T07:32:07.304451+0000","last_active":"2024-09-16T07:32:09.287083+0000","last_peered":"2024-09-16T07:32:09.287083+0000","last_clean":"2024-09-16T07:32:09.287083+0000","last_became_active":"2024-09-16T07:32:07.302975+0000","last_became_peered":"2024-09-16T07:32:07.302975+0000","last_unstale":"2024-09-16T07:32:09.287083+0000","last_undegraded":"2024-09-16T07:32:09.287083+0000","last_fullsized":"2024-09-16T07:32:09.287083+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:46.006560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289106+0000","last_change":"2024-09-16T07:32:08.298511+0000","last_active":"2024-09-16T07:32:09.289106+0000","last_peered":"2024-09-16T07:32:09.289106+0000","last_clean":"2024-09-16T07:32:09.289106+0000","last_became_active":"2024-09-16T07:32:08.298254+0000","last_became_peered":"2024-09-16T07:32:08.298254+0000","last_unstale":"2024-09-16T07:32:09.289106+0000","last_undegraded":"2024-09-16T07:32:09.289106+0000","last_fullsized":"2024-09-16T07:32:09.289106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:42:36.232561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302767+0000","last_change":"2024-09-16T07:32:07.303440+0000","last_active":"2024-09-16T07:32:09.302767+0000","last_peered":"2024-09-16T07:32:09.302767+0000","last_clean":"2024-09-16T07:32:09.302767+0000","last_became_active":"2024-09-16T07:32:07.303136+0000","last_became_peered":"2024-09-16T07:32:07.303136+0000","last_unstale":"2024-09-16T07:32:09.302767+0000","last_undegraded":"2024-09-16T07:32:09.302767+0000","last_fullsized":"2024-09-16T07:32:09.302767+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:30:22.218703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801556+0000","last_change":"2024-09-16T07:32:08.294279+0000","last_active":"2024-09-16T07:32:09.801556+0000","last_peered":"2024-09-16T07:32:09.801556+0000","last_clean":"2024-09-16T07:32:09.801556+0000","last_became_active":"2024-09-16T07:32:08.293927+0000","last_became_peered":"2024-09-16T07:32:08.293927+0000","last_unstale":"2024-09-16T07:32:09.801556+0000","last_undegraded":"2024-09-16T07:32:09.801556+0000","last_fullsized":"2024-09-16T07:32:09.801556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:30.784000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286406+0000","last_change":"2024-09-16T07:32:07.300573+0000","last_active":"2024-09-16T07:32:09.286406+0000","last_peered":"2024-09-16T07:32:09.286406+0000","last_clean":"2024-09-16T07:32:09.286406+0000","last_became_active":"2024-09-16T07:32:07.300228+0000","last_became_peered":"2024-09-16T07:32:07.300228+0000","last_unstale":"2024-09-16T07:32:09.286406+0000","last_undegraded":"2024-09-16T07:32:09.286406+0000","last_fullsized":"2024-09-16T07:32:09.286406+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:34.671155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.303117+0000","last_change":"2024-09-16T07:32:08.293625+0000","last_active":"2024-09-16T07:32:08.303117+0000","last_peered":"2024-09-16T07:32:08.303117+0000","last_clean":"2024-09-16T07:32:08.303117+0000","last_became_active":"2024-09-16T07:32:08.293342+0000","last_became_peered":"2024-09-16T07:32:08.293342+0000","last_unstale":"2024-09-16T07:32:08.303117+0000","last_undegraded":"2024-09-16T07:32:08.303117+0000","last_fullsized":"2024-09-16T07:32:08.303117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:52:39.672422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802836+0000","last_change":"2024-09-16T07:32:07.298421+0000","last_active":"2024-09-16T07:32:09.802836+0000","last_peered":"2024-09-16T07:32:09.802836+0000","last_clean":"2024-09-16T07:32:09.802836+0000","last_became_active":"2024-09-16T07:32:07.298115+0000","last_became_peered":"2024-09-16T07:32:07.298115+0000","last_unstale":"2024-09-16T07:32:09.802836+0000","last_undegraded":"2024-09-16T07:32:09.802836+0000","last_fullsized":"2024-09-16T07:32:09.802836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.394961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803458+0000","last_change":"2024-09-16T07:32:08.306788+0000","last_active":"2024-09-16T07:32:09.803458+0000","last_peered":"2024-09-16T07:32:09.803458+0000","last_clean":"2024-09-16T07:32:09.803458+0000","last_became_active":"2024-09-16T07:32:08.306507+0000","last_became_peered":"2024-09-16T07:32:08.306507+0000","last_unstale":"2024-09-16T07:32:09.803458+0000","last_undegraded":"2024-09-16T07:32:09.803458+0000","last_fullsized":"2024-09-16T07:32:09.803458+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:54.124743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.287524+0000","last_change":"2024-09-16T07:32:07.298592+0000","last_active":"2024-09-16T07:32:08.287524+0000","last_peered":"2024-09-16T07:32:08.287524+0000","last_clean":"2024-09-16T07:32:08.287524+0000","last_became_active":"2024-09-16T07:32:07.298248+0000","last_became_peered":"2024-09-16T07:32:07.298248+0000","last_unstale":"2024-09-16T07:32:08.287524+0000","last_undegraded":"2024-09-16T07:32:08.287524+0000","last_fullsized":"2024-09-16T07:32:08.287524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:07.421184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289434+0000","last_change":"2024-09-16T07:32:08.294543+0000","last_active":"2024-09-16T07:32:09.289434+0000","last_peered":"2024-09-16T07:32:09.289434+0000","last_clean":"2024-09-16T07:32:09.289434+0000","last_became_active":"2024-09-16T07:32:08.294282+0000","last_became_peered":"2024-09-16T07:32:08.294282+0000","last_unstale":"2024-09-16T07:32:09.289434+0000","last_undegraded":"2024-09-16T07:32:09.289434+0000","last_fullsized":"2024-09-16T07:32:09.289434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:16.217607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801708+0000","last_change":"2024-09-16T07:32:07.293017+0000","last_active":"2024-09-16T07:32:09.801708+0000","last_peered":"2024-09-16T07:32:09.801708+0000","last_clean":"2024-09-16T07:32:09.801708+0000","last_became_active":"2024-09-16T07:32:07.292191+0000","last_became_peered":"2024-09-16T07:32:07.292191+0000","last_unstale":"2024-09-16T07:32:09.801708+0000","last_undegraded":"2024-09-16T07:32:09.801708+0000","last_fullsized":"2024-09-16T07:32:09.801708+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:38.795641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288359+0000","last_change":"2024-09-16T07:32:08.308148+0000","last_active":"2024-09-16T07:32:09.288359+0000","last_peered":"2024-09-16T07:32:09.288359+0000","last_clean":"2024-09-16T07:32:09.288359+0000","last_became_active":"2024-09-16T07:32:08.307874+0000","last_became_peered":"2024-09-16T07:32:08.307874+0000","last_unstale":"2024-09-16T07:32:09.288359+0000","last_undegraded":"2024-09-16T07:32:09.288359+0000","last_fullsized":"2024-09-16T07:32:09.288359+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:53.262709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287380+0000","last_change":"2024-09-16T07:32:07.295876+0000","last_active":"2024-09-16T07:32:09.287380+0000","last_peered":"2024-09-16T07:32:09.287380+0000","last_clean":"2024-09-16T07:32:09.287380+0000","last_became_active":"2024-09-16T07:32:07.295566+0000","last_became_peered":"2024-09-16T07:32:07.295566+0000","last_unstale":"2024-09-16T07:32:09.287380+0000","last_undegraded":"2024-09-16T07:32:09.287380+0000","last_fullsized":"2024-09-16T07:32:09.287380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:58.455115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287003+0000","last_change":"2024-09-16T07:32:08.312019+0000","last_active":"2024-09-16T07:32:09.287003+0000","last_peered":"2024-09-16T07:32:09.287003+0000","last_clean":"2024-09-16T07:32:09.287003+0000","last_became_active":"2024-09-16T07:32:08.311741+0000","last_became_peered":"2024-09-16T07:32:08.311741+0000","last_unstale":"2024-09-16T07:32:09.287003+0000","last_undegraded":"2024-09-16T07:32:09.287003+0000","last_fullsized":"2024-09-16T07:32:09.287003+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:07.578144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302951+0000","last_change":"2024-09-16T07:32:07.302428+0000","last_active":"2024-09-16T07:32:09.302951+0000","last_peered":"2024-09-16T07:32:09.302951+0000","last_clean":"2024-09-16T07:32:09.302951+0000","last_became_active":"2024-09-16T07:32:07.300250+0000","last_became_peered":"2024-09-16T07:32:07.300250+0000","last_unstale":"2024-09-16T07:32:09.302951+0000","last_undegraded":"2024-09-16T07:32:09.302951+0000","last_fullsized":"2024-09-16T07:32:09.302951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:27:09.678395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.303468+0000","last_change":"2024-09-16T07:32:08.299261+0000","last_active":"2024-09-16T07:32:08.303468+0000","last_peered":"2024-09-16T07:32:08.303468+0000","last_clean":"2024-09-16T07:32:08.303468+0000","last_became_active":"2024-09-16T07:32:08.298980+0000","last_became_peered":"2024-09-16T07:32:08.298980+0000","last_unstale":"2024-09-16T07:32:08.303468+0000","last_undegraded":"2024-09-16T07:32:08.303468+0000","last_fullsized":"2024-09-16T07:32:08.303468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:03:01.326658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803340+0000","last_change":"2024-09-16T07:32:07.302787+0000","last_active":"2024-09-16T07:32:09.803340+0000","last_peered":"2024-09-16T07:32:09.803340+0000","last_clean":"2024-09-16T07:32:09.803340+0000","last_became_active":"2024-09-16T07:32:07.302449+0000","last_became_peered":"2024-09-16T07:32:07.302449+0000","last_unstale":"2024-09-16T07:32:09.803340+0000","last_undegraded":"2024-09-16T07:32:09.803340+0000","last_fullsized":"2024-09-16T07:32:09.803340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:00.367572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287772+0000","last_change":"2024-09-16T07:32:08.302632+0000","last_active":"2024-09-16T07:32:09.287772+0000","last_peered":"2024-09-16T07:32:09.287772+0000","last_clean":"2024-09-16T07:32:09.287772+0000","last_became_active":"2024-09-16T07:32:08.302339+0000","last_became_peered":"2024-09-16T07:32:08.302339+0000","last_unstale":"2024-09-16T07:32:09.287772+0000","last_undegraded":"2024-09-16T07:32:09.287772+0000","last_fullsized":"2024-09-16T07:32:09.287772+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:10.715805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803112+0000","last_change":"2024-09-16T07:32:07.305719+0000","last_active":"2024-09-16T07:32:09.803112+0000","last_peered":"2024-09-16T07:32:09.803112+0000","last_clean":"2024-09-16T07:32:09.803112+0000","last_became_active":"2024-09-16T07:32:07.305434+0000","last_became_peered":"2024-09-16T07:32:07.305434+0000","last_unstale":"2024-09-16T07:32:09.803112+0000","last_undegraded":"2024-09-16T07:32:09.803112+0000","last_fullsized":"2024-09-16T07:32:09.803112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:05.012073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289214+0000","last_change":"2024-09-16T07:32:08.291976+0000","last_active":"2024-09-16T07:32:09.289214+0000","last_peered":"2024-09-16T07:32:09.289214+0000","last_clean":"2024-09-16T07:32:09.289214+0000","last_became_active":"2024-09-16T07:32:08.291246+0000","last_became_peered":"2024-09-16T07:32:08.291246+0000","last_unstale":"2024-09-16T07:32:09.289214+0000","last_undegraded":"2024-09-16T07:32:09.289214+0000","last_fullsized":"2024-09-16T07:32:09.289214+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:57.639053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286746+0000","last_change":"2024-09-16T07:32:07.306242+0000","last_active":"2024-09-16T07:32:09.286746+0000","last_peered":"2024-09-16T07:32:09.286746+0000","last_clean":"2024-09-16T07:32:09.286746+0000","last_became_active":"2024-09-16T07:32:07.305908+0000","last_became_peered":"2024-09-16T07:32:07.305908+0000","last_unstale":"2024-09-16T07:32:09.286746+0000","last_undegraded":"2024-09-16T07:32:09.286746+0000","last_fullsized":"2024-09-16T07:32:09.286746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:39.774316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802837+0000","last_change":"2024-09-16T07:32:08.319014+0000","last_active":"2024-09-16T07:32:09.802837+0000","last_peered":"2024-09-16T07:32:09.802837+0000","last_clean":"2024-09-16T07:32:09.802837+0000","last_became_active":"2024-09-16T07:32:08.318726+0000","last_became_peered":"2024-09-16T07:32:08.318726+0000","last_unstale":"2024-09-16T07:32:09.802837+0000","last_undegraded":"2024-09-16T07:32:09.802837+0000","last_fullsized":"2024-09-16T07:32:09.802837+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:16.217607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288807+0000","last_change":"2024-09-16T07:32:07.303394+0000","last_active":"2024-09-16T07:32:09.288807+0000","last_peered":"2024-09-16T07:32:09.288807+0000","last_clean":"2024-09-16T07:32:09.288807+0000","last_became_active":"2024-09-16T07:32:07.301931+0000","last_became_peered":"2024-09-16T07:32:07.301931+0000","last_unstale":"2024-09-16T07:32:09.288807+0000","last_undegraded":"2024-09-16T07:32:09.288807+0000","last_fullsized":"2024-09-16T07:32:09.288807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:55.958990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317905+0000","last_change":"2024-09-16T07:32:08.304216+0000","last_active":"2024-09-16T07:32:08.317905+0000","last_peered":"2024-09-16T07:32:08.317905+0000","last_clean":"2024-09-16T07:32:08.317905+0000","last_became_active":"2024-09-16T07:32:08.303910+0000","last_became_peered":"2024-09-16T07:32:08.303910+0000","last_unstale":"2024-09-16T07:32:08.317905+0000","last_undegraded":"2024-09-16T07:32:08.317905+0000","last_fullsized":"2024-09-16T07:32:08.317905+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:14:54.269859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801224+0000","last_change":"2024-09-16T07:32:07.304199+0000","last_active":"2024-09-16T07:32:09.801224+0000","last_peered":"2024-09-16T07:32:09.801224+0000","last_clean":"2024-09-16T07:32:09.801224+0000","last_became_active":"2024-09-16T07:32:07.303864+0000","last_became_peered":"2024-09-16T07:32:07.303864+0000","last_unstale":"2024-09-16T07:32:09.801224+0000","last_undegraded":"2024-09-16T07:32:09.801224+0000","last_fullsized":"2024-09-16T07:32:09.801224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:38.370222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801739+0000","last_change":"2024-09-16T07:32:08.299020+0000","last_active":"2024-09-16T07:32:09.801739+0000","last_peered":"2024-09-16T07:32:09.801739+0000","last_clean":"2024-09-16T07:32:09.801739+0000","last_became_active":"2024-09-16T07:32:08.298768+0000","last_became_peered":"2024-09-16T07:32:08.298768+0000","last_unstale":"2024-09-16T07:32:09.801739+0000","last_undegraded":"2024-09-16T07:32:09.801739+0000","last_fullsized":"2024-09-16T07:32:09.801739+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:16.821318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287041+0000","last_change":"2024-09-16T07:32:07.305683+0000","last_active":"2024-09-16T07:32:09.287041+0000","last_peered":"2024-09-16T07:32:09.287041+0000","last_clean":"2024-09-16T07:32:09.287041+0000","last_became_active":"2024-09-16T07:32:07.305348+0000","last_became_peered":"2024-09-16T07:32:07.305348+0000","last_unstale":"2024-09-16T07:32:09.287041+0000","last_undegraded":"2024-09-16T07:32:09.287041+0000","last_fullsized":"2024-09-16T07:32:09.287041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:26.527468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288599+0000","last_change":"2024-09-16T07:32:08.305698+0000","last_active":"2024-09-16T07:32:09.288599+0000","last_peered":"2024-09-16T07:32:09.288599+0000","last_clean":"2024-09-16T07:32:09.288599+0000","last_became_active":"2024-09-16T07:32:08.304989+0000","last_became_peered":"2024-09-16T07:32:08.304989+0000","last_unstale":"2024-09-16T07:32:09.288599+0000","last_undegraded":"2024-09-16T07:32:09.288599+0000","last_fullsized":"2024-09-16T07:32:09.288599+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:27:10.686094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801784+0000","last_change":"2024-09-16T07:32:07.300822+0000","last_active":"2024-09-16T07:32:09.801784+0000","last_peered":"2024-09-16T07:32:09.801784+0000","last_clean":"2024-09-16T07:32:09.801784+0000","last_became_active":"2024-09-16T07:32:07.299917+0000","last_became_peered":"2024-09-16T07:32:07.299917+0000","last_unstale":"2024-09-16T07:32:09.801784+0000","last_undegraded":"2024-09-16T07:32:09.801784+0000","last_fullsized":"2024-09-16T07:32:09.801784+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:21.094893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803376+0000","last_change":"2024-09-16T07:32:08.305161+0000","last_active":"2024-09-16T07:32:09.803376+0000","last_peered":"2024-09-16T07:32:09.803376+0000","last_clean":"2024-09-16T07:32:09.803376+0000","last_became_active":"2024-09-16T07:32:08.304812+0000","last_became_peered":"2024-09-16T07:32:08.304812+0000","last_unstale":"2024-09-16T07:32:09.803376+0000","last_undegraded":"2024-09-16T07:32:09.803376+0000","last_fullsized":"2024-09-16T07:32:09.803376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:45.783015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287093+0000","last_change":"2024-09-16T07:32:07.300447+0000","last_active":"2024-09-16T07:32:09.287093+0000","last_peered":"2024-09-16T07:32:09.287093+0000","last_clean":"2024-09-16T07:32:09.287093+0000","last_became_active":"2024-09-16T07:32:07.299741+0000","last_became_peered":"2024-09-16T07:32:07.299741+0000","last_unstale":"2024-09-16T07:32:09.287093+0000","last_undegraded":"2024-09-16T07:32:09.287093+0000","last_fullsized":"2024-09-16T07:32:09.287093+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:10.288771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317857+0000","last_change":"2024-09-16T07:32:08.303263+0000","last_active":"2024-09-16T07:32:08.317857+0000","last_peered":"2024-09-16T07:32:08.317857+0000","last_clean":"2024-09-16T07:32:08.317857+0000","last_became_active":"2024-09-16T07:32:08.302981+0000","last_became_peered":"2024-09-16T07:32:08.302981+0000","last_unstale":"2024-09-16T07:32:08.317857+0000","last_undegraded":"2024-09-16T07:32:08.317857+0000","last_fullsized":"2024-09-16T07:32:08.317857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:47.755951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288416+0000","last_change":"2024-09-16T07:32:07.308730+0000","last_active":"2024-09-16T07:32:09.288416+0000","last_peered":"2024-09-16T07:32:09.288416+0000","last_clean":"2024-09-16T07:32:09.288416+0000","last_became_active":"2024-09-16T07:32:07.308398+0000","last_became_peered":"2024-09-16T07:32:07.308398+0000","last_unstale":"2024-09-16T07:32:09.288416+0000","last_undegraded":"2024-09-16T07:32:09.288416+0000","last_fullsized":"2024-09-16T07:32:09.288416+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:06:58.270398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302668+0000","last_change":"2024-09-16T07:32:08.310285+0000","last_active":"2024-09-16T07:32:09.302668+0000","last_peered":"2024-09-16T07:32:09.302668+0000","last_clean":"2024-09-16T07:32:09.302668+0000","last_became_active":"2024-09-16T07:32:08.310020+0000","last_became_peered":"2024-09-16T07:32:08.310020+0000","last_unstale":"2024-09-16T07:32:09.302668+0000","last_undegraded":"2024-09-16T07:32:09.302668+0000","last_fullsized":"2024-09-16T07:32:09.302668+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:31.397267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286582+0000","last_change":"2024-09-16T07:32:07.300914+0000","last_active":"2024-09-16T07:32:09.286582+0000","last_peered":"2024-09-16T07:32:09.286582+0000","last_clean":"2024-09-16T07:32:09.286582+0000","last_became_active":"2024-09-16T07:32:07.299885+0000","last_became_peered":"2024-09-16T07:32:07.299885+0000","last_unstale":"2024-09-16T07:32:09.286582+0000","last_undegraded":"2024-09-16T07:32:09.286582+0000","last_fullsized":"2024-09-16T07:32:09.286582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:40:30.223066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302334+0000","last_change":"2024-09-16T07:32:08.320654+0000","last_active":"2024-09-16T07:32:09.302334+0000","last_peered":"2024-09-16T07:32:09.302334+0000","last_clean":"2024-09-16T07:32:09.302334+0000","last_became_active":"2024-09-16T07:32:08.319915+0000","last_became_peered":"2024-09-16T07:32:08.319915+0000","last_unstale":"2024-09-16T07:32:09.302334+0000","last_undegraded":"2024-09-16T07:32:09.302334+0000","last_fullsized":"2024-09-16T07:32:09.302334+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:33.846471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288917+0000","last_change":"2024-09-16T07:32:07.298679+0000","last_active":"2024-09-16T07:32:09.288917+0000","last_peered":"2024-09-16T07:32:09.288917+0000","last_clean":"2024-09-16T07:32:09.288917+0000","last_became_active":"2024-09-16T07:32:07.298404+0000","last_became_peered":"2024-09-16T07:32:07.298404+0000","last_unstale":"2024-09-16T07:32:09.288917+0000","last_undegraded":"2024-09-16T07:32:09.288917+0000","last_fullsized":"2024-09-16T07:32:09.288917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:59.852615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302459+0000","last_change":"2024-09-16T07:32:08.323598+0000","last_active":"2024-09-16T07:32:09.302459+0000","last_peered":"2024-09-16T07:32:09.302459+0000","last_clean":"2024-09-16T07:32:09.302459+0000","last_became_active":"2024-09-16T07:32:08.323384+0000","last_became_peered":"2024-09-16T07:32:08.323384+0000","last_unstale":"2024-09-16T07:32:09.302459+0000","last_undegraded":"2024-09-16T07:32:09.302459+0000","last_fullsized":"2024-09-16T07:32:09.302459+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:54.854344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802711+0000","last_change":"2024-09-16T07:32:07.308353+0000","last_active":"2024-09-16T07:32:09.802711+0000","last_peered":"2024-09-16T07:32:09.802711+0000","last_clean":"2024-09-16T07:32:09.802711+0000","last_became_active":"2024-09-16T07:32:07.307974+0000","last_became_peered":"2024-09-16T07:32:07.307974+0000","last_unstale":"2024-09-16T07:32:09.802711+0000","last_undegraded":"2024-09-16T07:32:09.802711+0000","last_fullsized":"2024-09-16T07:32:09.802711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:27:31.872007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803811+0000","last_change":"2024-09-16T07:32:08.315950+0000","last_active":"2024-09-16T07:32:09.803811+0000","last_peered":"2024-09-16T07:32:09.803811+0000","last_clean":"2024-09-16T07:32:09.803811+0000","last_became_active":"2024-09-16T07:32:08.315630+0000","last_became_peered":"2024-09-16T07:32:08.315630+0000","last_unstale":"2024-09-16T07:32:09.803811+0000","last_undegraded":"2024-09-16T07:32:09.803811+0000","last_fullsized":"2024-09-16T07:32:09.803811+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:16:52.182468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287494+0000","last_change":"2024-09-16T07:32:07.304902+0000","last_active":"2024-09-16T07:32:09.287494+0000","last_peered":"2024-09-16T07:32:09.287494+0000","last_clean":"2024-09-16T07:32:09.287494+0000","last_became_active":"2024-09-16T07:32:07.304211+0000","last_became_peered":"2024-09-16T07:32:07.304211+0000","last_unstale":"2024-09-16T07:32:09.287494+0000","last_undegraded":"2024-09-16T07:32:09.287494+0000","last_fullsized":"2024-09-16T07:32:09.287494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:36.247989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289433+0000","last_change":"2024-09-16T07:32:08.296750+0000","last_active":"2024-09-16T07:32:09.289433+0000","last_peered":"2024-09-16T07:32:09.289433+0000","last_clean":"2024-09-16T07:32:09.289433+0000","last_became_active":"2024-09-16T07:32:08.296460+0000","last_became_peered":"2024-09-16T07:32:08.296460+0000","last_unstale":"2024-09-16T07:32:09.289433+0000","last_undegraded":"2024-09-16T07:32:09.289433+0000","last_fullsized":"2024-09-16T07:32:09.289433+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:51.224615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.289517+0000","last_change":"2024-09-16T07:32:07.301045+0000","last_active":"2024-09-16T07:32:09.289517+0000","last_peered":"2024-09-16T07:32:09.289517+0000","last_clean":"2024-09-16T07:32:09.289517+0000","last_became_active":"2024-09-16T07:32:07.300776+0000","last_became_peered":"2024-09-16T07:32:07.300776+0000","last_unstale":"2024-09-16T07:32:09.289517+0000","last_undegraded":"2024-09-16T07:32:09.289517+0000","last_fullsized":"2024-09-16T07:32:09.289517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:58:00.765229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288544+0000","last_change":"2024-09-16T07:32:08.317461+0000","last_active":"2024-09-16T07:32:09.288544+0000","last_peered":"2024-09-16T07:32:09.288544+0000","last_clean":"2024-09-16T07:32:09.288544+0000","last_became_active":"2024-09-16T07:32:08.317173+0000","last_became_peered":"2024-09-16T07:32:08.317173+0000","last_unstale":"2024-09-16T07:32:09.288544+0000","last_undegraded":"2024-09-16T07:32:09.288544+0000","last_fullsized":"2024-09-16T07:32:09.288544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:50.465211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.291816+0000","last_change":"2024-09-16T07:32:07.304201+0000","last_active":"2024-09-16T07:32:08.291816+0000","last_peered":"2024-09-16T07:32:08.291816+0000","last_clean":"2024-09-16T07:32:08.291816+0000","last_became_active":"2024-09-16T07:32:07.303494+0000","last_became_peered":"2024-09-16T07:32:07.303494+0000","last_unstale":"2024-09-16T07:32:08.291816+0000","last_undegraded":"2024-09-16T07:32:08.291816+0000","last_fullsized":"2024-09-16T07:32:08.291816+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:09:44.431476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.288512+0000","last_change":"2024-09-16T07:32:08.303325+0000","last_active":"2024-09-16T07:32:09.288512+0000","last_peered":"2024-09-16T07:32:09.288512+0000","last_clean":"2024-09-16T07:32:09.288512+0000","last_became_active":"2024-09-16T07:32:08.303079+0000","last_became_peered":"2024-09-16T07:32:08.303079+0000","last_unstale":"2024-09-16T07:32:09.288512+0000","last_undegraded":"2024-09-16T07:32:09.288512+0000","last_fullsized":"2024-09-16T07:32:09.288512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:40:55.637983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803237+0000","last_change":"2024-09-16T07:32:07.303170+0000","last_active":"2024-09-16T07:32:09.803237+0000","last_peered":"2024-09-16T07:32:09.803237+0000","last_clean":"2024-09-16T07:32:09.803237+0000","last_became_active":"2024-09-16T07:32:07.302917+0000","last_became_peered":"2024-09-16T07:32:07.302917+0000","last_unstale":"2024-09-16T07:32:09.803237+0000","last_undegraded":"2024-09-16T07:32:09.803237+0000","last_fullsized":"2024-09-16T07:32:09.803237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:40.817725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.317676+0000","last_change":"2024-09-16T07:32:08.301991+0000","last_active":"2024-09-16T07:32:08.317676+0000","last_peered":"2024-09-16T07:32:08.317676+0000","last_clean":"2024-09-16T07:32:08.317676+0000","last_became_active":"2024-09-16T07:32:08.301723+0000","last_became_peered":"2024-09-16T07:32:08.301723+0000","last_unstale":"2024-09-16T07:32:08.317676+0000","last_undegraded":"2024-09-16T07:32:08.317676+0000","last_fullsized":"2024-09-16T07:32:08.317676+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:58.170728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-16T07:32:08.289504+0000","last_change":"2024-09-16T07:32:07.302760+0000","last_active":"2024-09-16T07:32:08.289504+0000","last_peered":"2024-09-16T07:32:08.289504+0000","last_clean":"2024-09-16T07:32:08.289504+0000","last_became_active":"2024-09-16T07:32:07.302481+0000","last_became_peered":"2024-09-16T07:32:07.302481+0000","last_unstale":"2024-09-16T07:32:08.289504+0000","last_undegraded":"2024-09-16T07:32:08.289504+0000","last_fullsized":"2024-09-16T07:32:08.289504+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.679303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286800+0000","last_change":"2024-09-16T07:32:08.304086+0000","last_active":"2024-09-16T07:32:09.286800+0000","last_peered":"2024-09-16T07:32:09.286800+0000","last_clean":"2024-09-16T07:32:09.286800+0000","last_became_active":"2024-09-16T07:32:08.303774+0000","last_became_peered":"2024-09-16T07:32:08.303774+0000","last_unstale":"2024-09-16T07:32:09.286800+0000","last_undegraded":"2024-09-16T07:32:09.286800+0000","last_fullsized":"2024-09-16T07:32:09.286800+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:56.966689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.803087+0000","last_change":"2024-09-16T07:32:07.301495+0000","last_active":"2024-09-16T07:32:09.803087+0000","last_peered":"2024-09-16T07:32:09.803087+0000","last_clean":"2024-09-16T07:32:09.803087+0000","last_became_active":"2024-09-16T07:32:07.299755+0000","last_became_peered":"2024-09-16T07:32:07.299755+0000","last_unstale":"2024-09-16T07:32:09.803087+0000","last_undegraded":"2024-09-16T07:32:09.803087+0000","last_fullsized":"2024-09-16T07:32:09.803087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:39.567826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.802930+0000","last_change":"2024-09-16T07:32:08.306049+0000","last_active":"2024-09-16T07:32:09.802930+0000","last_peered":"2024-09-16T07:32:09.802930+0000","last_clean":"2024-09-16T07:32:09.802930+0000","last_became_active":"2024-09-16T07:32:08.305578+0000","last_became_peered":"2024-09-16T07:32:08.305578+0000","last_unstale":"2024-09-16T07:32:09.802930+0000","last_undegraded":"2024-09-16T07:32:09.802930+0000","last_fullsized":"2024-09-16T07:32:09.802930+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:53.545554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.801223+0000","last_change":"2024-09-16T07:32:07.305238+0000","last_active":"2024-09-16T07:32:09.801223+0000","last_peered":"2024-09-16T07:32:09.801223+0000","last_clean":"2024-09-16T07:32:09.801223+0000","last_became_active":"2024-09-16T07:32:07.304644+0000","last_became_peered":"2024-09-16T07:32:07.304644+0000","last_unstale":"2024-09-16T07:32:09.801223+0000","last_undegraded":"2024-09-16T07:32:09.801223+0000","last_fullsized":"2024-09-16T07:32:09.801223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:21.954412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286370+0000","last_change":"2024-09-16T07:32:08.318877+0000","last_active":"2024-09-16T07:32:09.286370+0000","last_peered":"2024-09-16T07:32:09.286370+0000","last_clean":"2024-09-16T07:32:09.286370+0000","last_became_active":"2024-09-16T07:32:08.318522+0000","last_became_peered":"2024-09-16T07:32:08.318522+0000","last_unstale":"2024-09-16T07:32:09.286370+0000","last_undegraded":"2024-09-16T07:32:09.286370+0000","last_fullsized":"2024-09-16T07:32:09.286370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:17.276766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287226+0000","last_change":"2024-09-16T07:32:07.301496+0000","last_active":"2024-09-16T07:32:09.287226+0000","last_peered":"2024-09-16T07:32:09.287226+0000","last_clean":"2024-09-16T07:32:09.287226+0000","last_became_active":"2024-09-16T07:32:07.301228+0000","last_became_peered":"2024-09-16T07:32:07.301228+0000","last_unstale":"2024-09-16T07:32:09.287226+0000","last_undegraded":"2024-09-16T07:32:09.287226+0000","last_fullsized":"2024-09-16T07:32:09.287226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:25:26.063449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.302534+0000","last_change":"2024-09-16T07:32:08.320214+0000","last_active":"2024-09-16T07:32:09.302534+0000","last_peered":"2024-09-16T07:32:09.302534+0000","last_clean":"2024-09-16T07:32:09.302534+0000","last_became_active":"2024-09-16T07:32:08.319951+0000","last_became_peered":"2024-09-16T07:32:08.319951+0000","last_unstale":"2024-09-16T07:32:09.302534+0000","last_undegraded":"2024-09-16T07:32:09.302534+0000","last_fullsized":"2024-09-16T07:32:09.302534+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:07.274730+0000","last_clean_scrub_stamp":"2024-09-16T07:32:07.274730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:28.895837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.286658+0000","last_change":"2024-09-16T07:32:07.301284+0000","last_active":"2024-09-16T07:32:09.286658+0000","last_peered":"2024-09-16T07:32:09.286658+0000","last_clean":"2024-09-16T07:32:09.286658+0000","last_became_active":"2024-09-16T07:32:07.300952+0000","last_became_peered":"2024-09-16T07:32:07.300952+0000","last_unstale":"2024-09-16T07:32:09.286658+0000","last_undegraded":"2024-09-16T07:32:09.286658+0000","last_fullsized":"2024-09-16T07:32:09.286658+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:06.267032+0000","last_clean_scrub_stamp":"2024-09-16T07:32:06.267032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:11:41.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":198,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-16T07:32:09.287894+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:32:09.287894+0000","last_peered":"2024-09-16T07:32:09.287894+0000","last_clean":"2024-09-16T07:32:09.287894+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:32:09.287894+0000","last_undegraded":"2024-09-16T07:32:09.287894+0000","last_fullsized":"2024-09-16T07:32:09.287894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1433600,"data_stored":937517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":346625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":835584,"data_stored":346623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":835584,"data_stored":346603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":346645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":348761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":930601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":831488,"data_stored":341845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:32:12.788 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:32:12.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:32:12.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 -- 172.21.15.114:0/779751223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b2bf0 msgr2=0x7f95cc15ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 --2- 172.21.15.114:0/779751223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b2bf0 0x7f95cc15ab10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0cfbb0 tx=0x7f95c401cd50 comp rx=0 tx=0).stop 2024-09-16T07:32:12.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 -- 172.21.15.114:0/779751223 shutdown_connections 2024-09-16T07:32:12.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 --2- 172.21.15.114:0/779751223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b2bf0 0x7f95cc15ab10 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 --2- 172.21.15.114:0/779751223 >> v2:172.21.15.149:3300/0 conn(0x7f95cc0cd100 0x7f95cc15a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 -- 172.21.15.114:0/779751223 >> 172.21.15.114:0/779751223 conn(0x7f95cc0b18f0 msgr2=0x7f95cc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:12.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 -- 172.21.15.114:0/779751223 shutdown_connections 2024-09-16T07:32:12.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.975+0000 7f95d0e00640 1 -- 172.21.15.114:0/779751223 wait complete. 2024-09-16T07:32:12.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 Processor -- start 2024-09-16T07:32:12.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 -- start start 2024-09-16T07:32:12.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b2bf0 0x7f95cc164810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b43d0 0x7f95cc0ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cd100 0x7f95cc159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc165220 con 0x7f95cc0b43d0 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc1650a0 con 0x7f95cc0cd100 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc1653a0 con 0x7f95cc0b2bf0 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b43d0 0x7f95cc0ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b43d0 0x7f95cc0ad360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55896/0 (socket says 172.21.15.114:55896) 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 -- 172.21.15.114:0/3335588155 learned_addr learned my addr 172.21.15.114:0/3335588155 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c9e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b2bf0 0x7f95cc164810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95ca800640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cd100 0x7f95cc159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 -- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b2bf0 msgr2=0x7f95cc164810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b2bf0 0x7f95cc164810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 -- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cd100 msgr2=0x7f95cc159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cd100 0x7f95cc159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 -- 172.21.15.114:0/3335588155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc163560 con 0x7f95cc0b43d0 2024-09-16T07:32:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95ca800640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cd100 0x7f95cc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c1400640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b43d0 0x7f95cc0ad360 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f95b400d720 tx=0x7f95b400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c2a00640 1 -- 172.21.15.114:0/3335588155 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4017070 con 0x7f95cc0b43d0 2024-09-16T07:32:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c2a00640 1 -- 172.21.15.114:0/3335588155 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95b4009d20 con 0x7f95cc0b43d0 2024-09-16T07:32:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc163840 con 0x7f95cc0b43d0 2024-09-16T07:32:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95c2a00640 1 -- 172.21.15.114:0/3335588155 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4005280 con 0x7f95cc0b43d0 2024-09-16T07:32:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc163e00 con 0x7f95cc0b43d0 2024-09-16T07:32:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.979+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc069410 con 0x7f95cc0b43d0 2024-09-16T07:32:12.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.983+0000 7f95c2a00640 1 -- 172.21.15.114:0/3335588155 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f95b4005420 con 0x7f95cc0b43d0 2024-09-16T07:32:12.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.983+0000 7f95c2a00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f95a8073220 0x7f95a80756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:12.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.983+0000 7f95c2a00640 1 -- 172.21.15.114:0/3335588155 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f95b40945c0 con 0x7f95cc0b43d0 2024-09-16T07:32:12.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.983+0000 7f95c9e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f95a8073220 0x7f95a80756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:12.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.983+0000 7f95c9e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f95a8073220 0x7f95a80756e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95bc007fd0 tx=0x7f95bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:12.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:12.987+0000 7f95c2a00640 1 -- 172.21.15.114:0/3335588155 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f95b405ebf0 con 0x7f95cc0b43d0 2024-09-16T07:32:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.215+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f95cc0b1e00 con 0x7f95cc0b43d0 2024-09-16T07:32:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.215+0000 7f95c2a00640 1 -- 172.21.15.114:0/3335588155 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f95b4063620 con 0x7f95cc0b43d0 2024-09-16T07:32:13.215 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:32:13.215 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:32:13.215 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:32:13.215 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:32:13.215 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:32:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f95a8073220 msgr2=0x7f95a80756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f95a8073220 0x7f95a80756e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95bc007fd0 tx=0x7f95bc009040 comp rx=0 tx=0).stop 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b43d0 msgr2=0x7f95cc0ad360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b43d0 0x7f95cc0ad360 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f95b400d720 tx=0x7f95b400dbe0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 shutdown_connections 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f95a8073220 0x7f95a80756e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95cc0cd100 0x7f95cc159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc0b43d0 0x7f95cc0ad360 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 --2- 172.21.15.114:0/3335588155 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95cc0b2bf0 0x7f95cc164810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 >> 172.21.15.114:0/3335588155 conn(0x7f95cc0b18f0 msgr2=0x7f95cc156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 shutdown_connections 2024-09-16T07:32:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.219+0000 7f95d0e00640 1 -- 172.21.15.114:0/3335588155 wait complete. 2024-09-16T07:32:13.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:13.242 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-16T07:32:13.243+0000 7f7732000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:32:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- 172.21.15.114:0/2102232471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b80003c20 msgr2=0x7f1b80004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 --2- 172.21.15.114:0/2102232471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b80003c20 0x7f1b80004020 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c001ef0 tx=0x7f1b8c01cc30 comp rx=0 tx=0).stop 2024-09-16T07:32:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1b9e800640 1 -- 172.21.15.114:0/2102232471 reap_dead start 2024-09-16T07:32:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- 172.21.15.114:0/2102232471 shutdown_connections 2024-09-16T07:32:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- 172.21.15.114:0/2102232471 >> 172.21.15.114:0/2102232471 conn(0x7f1b980b18f0 msgr2=0x7f1b980b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- 172.21.15.114:0/2102232471 shutdown_connections 2024-09-16T07:32:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- 172.21.15.114:0/2102232471 wait complete. 2024-09-16T07:32:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 Processor -- start 2024-09-16T07:32:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- start start 2024-09-16T07:32:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b80003c20 0x7f1b980cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b981493c0 0x7f1b98164b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b9809d3c0 0x7f1b980addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1b98166120 con 0x7f1b981493c0 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1b980ccc80 con 0x7f1b80003c20 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1ba0800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1b981662a0 con 0x7f1b9809d3c0 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1b9d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b981493c0 0x7f1b98164b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1b9d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b981493c0 0x7f1b98164b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55914/0 (socket says 172.21.15.114:55914) 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1b9d400640 1 -- 172.21.15.114:0/2292664725 learned_addr learned my addr 172.21.15.114:0/2292664725 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1b9de00640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b80003c20 0x7f1b980cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.383+0000 7f1b9e800640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b9809d3c0 0x7f1b980addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b9d400640 1 -- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b9809d3c0 msgr2=0x7f1b980addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b9d400640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b9809d3c0 0x7f1b980addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b9d400640 1 -- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b80003c20 msgr2=0x7f1b980cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b9d400640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b80003c20 0x7f1b980cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b9d400640 1 -- 172.21.15.114:0/2292664725 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b981650a0 con 0x7f1b981493c0 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b9d400640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b981493c0 0x7f1b98164b60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800e990 tx=0x7f1b8800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b92000640 1 -- 172.21.15.114:0/2292664725 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800cbe0 con 0x7f1b981493c0 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b92000640 1 -- 172.21.15.114:0/2292664725 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b8800cd80 con 0x7f1b981493c0 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b92000640 1 -- 172.21.15.114:0/2292664725 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88004290 con 0x7f1b981493c0 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9809c320 con 0x7f1b981493c0 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b9809c8e0 con 0x7f1b981493c0 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b98069410 con 0x7f1b981493c0 2024-09-16T07:32:13.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.387+0000 7f1b92000640 1 -- 172.21.15.114:0/2292664725 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f1b88003600 con 0x7f1b981493c0 2024-09-16T07:32:13.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.391+0000 7f1b92000640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b7c073220 0x7f1b7c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:13.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.391+0000 7f1b92000640 1 -- 172.21.15.114:0/2292664725 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f1b880947d0 con 0x7f1b981493c0 2024-09-16T07:32:13.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.391+0000 7f1b9de00640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b7c073220 0x7f1b7c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.391+0000 7f1b9de00640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b7c073220 0x7f1b7c0756e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0a9000 tx=0x7f1b8c019a20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.395+0000 7f1b92000640 1 -- 172.21.15.114:0/2292664725 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1b981650a0 con 0x7f1b981493c0 2024-09-16T07:32:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b9815cab0 con 0x7f1b981493c0 2024-09-16T07:32:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1b92000640 1 -- 172.21.15.114:0/2292664725 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7f1b8805ef40 con 0x7f1b981493c0 2024-09-16T07:32:13.594 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:13.594 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"btime":"2024-09-16T07:32:11:309113+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 47 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b7c073220 msgr2=0x7f1b7c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b7c073220 0x7f1b7c0756e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0a9000 tx=0x7f1b8c019a20 comp rx=0 tx=0).stop 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b981493c0 msgr2=0x7f1b98164b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b981493c0 0x7f1b98164b60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800e990 tx=0x7f1b8800ee50 comp rx=0 tx=0).stop 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 shutdown_connections 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f1b7c073220 0x7f1b7c0756e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1b9809d3c0 0x7f1b980addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b981493c0 0x7f1b98164b60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 --2- 172.21.15.114:0/2292664725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1b80003c20 0x7f1b980cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 >> 172.21.15.114:0/2292664725 conn(0x7f1b980b18f0 msgr2=0x7f1b980b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 shutdown_connections 2024-09-16T07:32:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:13.595+0000 7f1ba0800640 1 -- 172.21.15.114:0/2292664725 wait complete. 2024-09-16T07:32:14.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:32:07.684616+0000', 'modified': '2024-09-16T07:32:10.693544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6168}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6168': {'gid': 6168, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.114:6835/26034359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 26034359}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 26034359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6168, 'qdb_cluster': [6168]} 2024-09-16T07:32:14.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:32:14.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T07:32:14.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 -- 172.21.15.114:0/1820794511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c1613d0 msgr2=0x7fb13c0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 --2- 172.21.15.114:0/1820794511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c1613d0 0x7fb13c0d0540 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009900 tx=0x7fb12c01c8b0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 -- 172.21.15.114:0/1820794511 shutdown_connections 2024-09-16T07:32:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 --2- 172.21.15.114:0/1820794511 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13c0d29e0 0x7fb13c0b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 --2- 172.21.15.114:0/1820794511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c1613d0 0x7fb13c0d0540 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 -- 172.21.15.114:0/1820794511 >> 172.21.15.114:0/1820794511 conn(0x7fb13c0d3e00 msgr2=0x7fb13c0d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 -- 172.21.15.114:0/1820794511 shutdown_connections 2024-09-16T07:32:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.163+0000 7fb140e00640 1 -- 172.21.15.114:0/1820794511 wait complete. 2024-09-16T07:32:14.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 Processor -- start 2024-09-16T07:32:14.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 -- start start 2024-09-16T07:32:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c0d29e0 0x7fb13c1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13c1613d0 0x7fb13c0a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb13c1617b0 0x7fb13c0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c16acc0 con 0x7fb13c0d29e0 2024-09-16T07:32:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c0b8210 con 0x7fb13c1617b0 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb13c16ae40 con 0x7fb13c1613d0 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c0d29e0 0x7fb13c1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c0d29e0 0x7fb13c1565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41504/0 (socket says 172.21.15.114:41504) 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 -- 172.21.15.114:0/1699391651 learned_addr learned my addr 172.21.15.114:0/1699391651 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13aa00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13c1613d0 0x7fb13c0a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13be00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb13c1617b0 0x7fb13c0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 -- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13c1613d0 msgr2=0x7fb13c0a11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13c1613d0 0x7fb13c0a11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 -- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb13c1617b0 msgr2=0x7fb13c0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb13c1617b0 0x7fb13c0caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 -- 172.21.15.114:0/1699391651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c0a0cc0 con 0x7fb13c0d29e0 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13aa00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13c1613d0 0x7fb13c0a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13be00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb13c1617b0 0x7fb13c0caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb13b400640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c0d29e0 0x7fb13c1565d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009850 tx=0x7fb12c0a58a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb133400640 1 -- 172.21.15.114:0/1699391651 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0b2040 con 0x7fb13c0d29e0 2024-09-16T07:32:14.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb133400640 1 -- 172.21.15.114:0/1699391651 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb12c0053e0 con 0x7fb13c0d29e0 2024-09-16T07:32:14.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb133400640 1 -- 172.21.15.114:0/1699391651 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c003700 con 0x7fb13c0d29e0 2024-09-16T07:32:14.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13c158420 con 0x7fb13c0d29e0 2024-09-16T07:32:14.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.167+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13c09e890 con 0x7fb13c0d29e0 2024-09-16T07:32:14.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb133400640 1 -- 172.21.15.114:0/1699391651 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fb12c0be060 con 0x7fb13c0d29e0 2024-09-16T07:32:14.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb133400640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb11c073220 0x7fb11c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb133400640 1 -- 172.21.15.114:0/1699391651 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb12c12e2b0 con 0x7fb13c0d29e0 2024-09-16T07:32:14.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 Processor -- start 2024-09-16T07:32:14.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 -- start start 2024-09-16T07:32:14.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb11c073220 0x7fb11c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb11c073220 0x7fb11c0756e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb13c1fa4d0 tx=0x7fb128009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d3941db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d39422f0 0x55a5d38f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d38f5e10 0x55a5d38f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a5d38163f0 con 0x55a5d39422f0 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a5d3753b20 con 0x55a5d39419d0 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55a5d3742f50 con 0x55a5d38f5e10 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d39422f0 0x55a5d38f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d39422f0 0x55a5d38f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41508/0 (socket says 172.21.15.114:41508) 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 -- 172.21.15.114:0/2214399424 learned_addr learned my addr 172.21.15.114:0/2214399424 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13be00640 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d38f5e10 0x55a5d38f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13b400640 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d3941db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 -- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d38f5e10 msgr2=0x55a5d38f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d38f5e10 0x55a5d38f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 -- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 msgr2=0x55a5d3941db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d3941db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 -- 172.21.15.114:0/2214399424 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d370a590 con 0x55a5d39422f0 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13b400640 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d3941db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.171+0000 7fb13aa00640 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d39422f0 0x55a5d38f58d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb128001e00 tx=0x7fb128011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b689649d157ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb127e00640 1 -- 172.21.15.114:0/2214399424 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128003600 con 0x55a5d39422f0 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb127e00640 1 -- 172.21.15.114:0/2214399424 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb128003890 con 0x55a5d39422f0 2024-09-16T07:32:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb127e00640 1 -- 172.21.15.114:0/2214399424 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128003c80 con 0x55a5d39422f0 2024-09-16T07:32:14.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- 172.21.15.114:0/2214399424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d39422f0 msgr2=0x55a5d38f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d39422f0 0x55a5d38f58d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb128001e00 tx=0x7fb128011000 comp rx=0 tx=0).stop 2024-09-16T07:32:14.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- 172.21.15.114:0/2214399424 shutdown_connections 2024-09-16T07:32:14.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d38f5e10 0x55a5d38f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d39422f0 0x55a5d38f58d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2214399424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d3941db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- 172.21.15.114:0/2214399424 >> 172.21.15.114:0/2214399424 conn(0x55a5d37df130 msgr2=0x55a5d3924e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- 172.21.15.114:0/2214399424 shutdown_connections 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- 172.21.15.114:0/2214399424 wait complete. 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- start start 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 Processor -- start 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d38f7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 0x55a5d38f7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d38f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a5d36dd5d0 con 0x55a5d38f5e10 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a5d3746d60 con 0x55a5d39422f0 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55a5d36e9500 con 0x55a5d39419d0 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb1458d7000 10 client.0 _ll_register_callbacks cb 0x55a5d36ed810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:32:14.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d38f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d38f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41518/0 (socket says 172.21.15.114:41518) 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 -- 172.21.15.114:0/1468798882 learned_addr learned my addr 172.21.15.114:0/1468798882 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13aa00640 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 0x55a5d38f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13be00640 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d38f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 -- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 msgr2=0x55a5d38f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 0x55a5d38f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 -- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 msgr2=0x55a5d38f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d38f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 -- 172.21.15.114:0/1468798882 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d36e1170 con 0x55a5d38f5e10 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb13b400640 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d38f7240 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0f8830 tx=0x7fb12c0f82b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7151f28d30d0003d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb124c00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.175+0000 7fb124c00640 1 -- 172.21.15.114:0/1468798882 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0f8d00 con 0x55a5d38f5e10 2024-09-16T07:32:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 1 -- 172.21.15.114:0/1468798882 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb12c0f9bd0 con 0x55a5d38f5e10 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a5d36db0f0 con 0x55a5d38f5e10 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 1 -- 172.21.15.114:0/1468798882 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fb12c0f88a0 con 0x55a5d38f5e10 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 10 client.6300 fetch_fsmap learned FSMap version 47 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a5d37c7ef0 con 0x55a5d38f5e10 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 1 -- 172.21.15.114:0/1468798882 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a5d36db0f0 con 0x55a5d38f5e10 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 1 -- 172.21.15.114:0/1468798882 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7fb12c101da0 con 0x55a5d38f5e10 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 10 client.6300 fetch_fsmap finished waiting for FSMap version 47 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 10 client.6300 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 20 client.6300 populate_metadata read hostname 'smithi114' 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3950c70 0x55a5d3953060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 4 client.6300 mds_command: new command op to 6168 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 --> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5d3755a70 con 0x55a5d3950c70 2024-09-16T07:32:14.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb13aa00640 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3950c70 0x55a5d3953060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb13aa00640 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3950c70 0x55a5d3953060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4a716a658fff9c server_cookie=287c7a9166b48f63 in_seq=0 out_seq=0 2024-09-16T07:32:14.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 10 client.6300 ms_handle_connect on v2:172.21.15.114:6833/26034359 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 1 -- 172.21.15.114:0/1468798882 <== mds.0 v2:172.21.15.114:6833/26034359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5d3755a70 con 0x55a5d3950c70 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 10 client.6300 handle_command_reply: tid=0 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 client.6300 shutdown 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 msgr2=0x55a5d38f7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d38f7240 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0f8830 tx=0x7fb12c0f82b0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 shutdown_connections 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3950c70 0x55a5d3953060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d38f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 0x55a5d38f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 --2- 172.21.15.114:0/1468798882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d38f7240 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb124c00640 0 client.6300 ms_handle_reset on v2:172.21.15.114:6833/26034359 2024-09-16T07:32:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 >> 172.21.15.114:0/1468798882 conn(0x55a5d37df130 msgr2=0x55a5d38f4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 shutdown_connections 2024-09-16T07:32:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 1 -- 172.21.15.114:0/1468798882 wait complete. 2024-09-16T07:32:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.179+0000 7fb1458d7000 20 client.6300 trim_cache size 0 max 16384 2024-09-16T07:32:14.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 Processor -- start 2024-09-16T07:32:14.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- start start 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d39b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d39b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39422f0 0x55a5d39b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c1580a0 con 0x55a5d38f5e10 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a5d374b390 con 0x55a5d39419d0 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55a5d36dd5d0 con 0x55a5d39422f0 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d39b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d39b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41524/0 (socket says 172.21.15.114:41524) 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 -- 172.21.15.114:0/4069138095 learned_addr learned my addr 172.21.15.114:0/4069138095 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 -- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39422f0 msgr2=0x55a5d39b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13aa00640 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d39b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13be00640 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39422f0 0x55a5d39b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39422f0 0x55a5d39b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 -- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 msgr2=0x55a5d39b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d39b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 -- 172.21.15.114:0/4069138095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d379ed90 con 0x55a5d38f5e10 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13aa00640 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d39b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13be00640 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39422f0 0x55a5d39b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb13b400640 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d39b35d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb12c01ce20 tx=0x7fb12c0f8320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac0b1ad36a24378 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb127400640 1 -- 172.21.15.114:0/4069138095 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0fd3d0 con 0x55a5d38f5e10 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb127400640 1 -- 172.21.15.114:0/4069138095 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb12c102230 con 0x55a5d38f5e10 2024-09-16T07:32:14.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb127400640 1 -- 172.21.15.114:0/4069138095 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0f9e10 con 0x55a5d38f5e10 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- 172.21.15.114:0/4069138095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 msgr2=0x55a5d39b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d39b35d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb12c01ce20 tx=0x7fb12c0f8320 comp rx=0 tx=0).stop 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- 172.21.15.114:0/4069138095 shutdown_connections 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39422f0 0x55a5d39b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39419d0 0x55a5d39b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 --2- 172.21.15.114:0/4069138095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d39b35d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- 172.21.15.114:0/4069138095 >> 172.21.15.114:0/4069138095 conn(0x55a5d37df130 msgr2=0x55a5d38f5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.199+0000 7fb1458d7000 1 -- 172.21.15.114:0/4069138095 shutdown_connections 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- 172.21.15.114:0/4069138095 wait complete. 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- start start 2024-09-16T07:32:14.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 Processor -- start 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d3957c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 0x55a5d3973580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d3973ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a5d3746070 con 0x55a5d38f5e10 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a5d37c7a60 con 0x55a5d39422f0 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55a5d37528f0 con 0x55a5d39419d0 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 10 client.0 _ll_register_callbacks cb 0x7fb12c0f47f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d3957c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d3957c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41536/0 (socket says 172.21.15.114:41536) 2024-09-16T07:32:14.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 -- 172.21.15.114:0/2183776522 learned_addr learned my addr 172.21.15.114:0/2183776522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13be00640 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d3973ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 -- 172.21.15.114:0/2183776522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 msgr2=0x55a5d3973580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 0x55a5d3973580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 -- 172.21.15.114:0/2183776522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 msgr2=0x55a5d3973ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d3973ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 -- 172.21.15.114:0/2183776522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d3709a90 con 0x55a5d38f5e10 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13b400640 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d3957c50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0f5060 tx=0x7fb12c0f8db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6d697e149f5a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb124c00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb124c00640 1 -- 172.21.15.114:0/2183776522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0fd380 con 0x55a5d38f5e10 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb124c00640 1 -- 172.21.15.114:0/2183776522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb12c112bc0 con 0x55a5d38f5e10 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb12c102230 con 0x55a5d38f5e10 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb124c00640 1 -- 172.21.15.114:0/2183776522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fb12c112e00 con 0x55a5d38f5e10 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 10 client.6306 fetch_fsmap learned FSMap version 47 2024-09-16T07:32:14.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a5d36e8050 con 0x55a5d38f5e10 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb124c00640 1 -- 172.21.15.114:0/2183776522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb12c102230 con 0x55a5d38f5e10 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb124c00640 1 -- 172.21.15.114:0/2183776522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7fb12c0f7b00 con 0x55a5d38f5e10 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 10 client.6306 fetch_fsmap finished waiting for FSMap version 47 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 10 client.6306 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 20 client.6306 populate_metadata read hostname 'smithi114' 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3974000 0x55a5d39b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 4 client.6306 mds_command: new command op to 6168 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 --> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] -- command(tid 0: {"prefix": "status"}) -- 0x55a5d3751520 con 0x55a5d3974000 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.203+0000 7fb13aa00640 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3974000 0x55a5d39b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb124c00640 10 client.6306 ms_handle_connect on v2:172.21.15.114:6833/26034359 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb13aa00640 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3974000 0x55a5d39b7610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58712059744287b0 server_cookie=c07152ae9e1487d4 in_seq=0 out_seq=0 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb124c00640 1 -- 172.21.15.114:0/2183776522 <== mds.0 v2:172.21.15.114:6833/26034359 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a5d3751520 con 0x55a5d3974000 2024-09-16T07:32:14.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb124c00640 10 client.6306 handle_command_reply: tid=0 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 client.6306 shutdown 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 msgr2=0x55a5d3957c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d3957c50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0f5060 tx=0x7fb12c0f8db0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 shutdown_connections 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:6833/26034359,v1:172.21.15.114:6835/26034359] conn(0x55a5d3974000 0x55a5d39b7610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5d39422f0 0x55a5d3973ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a5d39419d0 0x55a5d3973580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 --2- 172.21.15.114:0/2183776522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a5d38f5e10 0x55a5d3957c50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb124c00640 0 client.6306 ms_handle_reset on v2:172.21.15.114:6833/26034359 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 >> 172.21.15.114:0/2183776522 conn(0x55a5d37df130 msgr2=0x55a5d3953060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 shutdown_connections 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 1 -- 172.21.15.114:0/2183776522 wait complete. 2024-09-16T07:32:14.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb1458d7000 20 client.6306 trim_cache size 0 max 16384 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6168, 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:32:14.210 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 5.9243769149999999, 2024-09-16T07:32:14.211 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 47, 2024-09-16T07:32:14.211 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 69, 2024-09-16T07:32:14.211 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 69, 2024-09-16T07:32:14.211 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 17.446383039000001 2024-09-16T07:32:14.211 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb11c073220 msgr2=0x7fb11c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb11c073220 0x7fb11c0756e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb13c1fa4d0 tx=0x7fb128009040 comp rx=0 tx=0).stop 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c0d29e0 msgr2=0x7fb13c1565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c0d29e0 0x7fb13c1565d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009850 tx=0x7fb12c0a58a0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 shutdown_connections 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fb11c073220 0x7fb11c0756e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb13c1617b0 0x7fb13c0caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb13c1613d0 0x7fb13c0a11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 --2- 172.21.15.114:0/1699391651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb13c0d29e0 0x7fb13c1565d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 >> 172.21.15.114:0/1699391651 conn(0x7fb13c0d3e00 msgr2=0x7fb13c0c97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 shutdown_connections 2024-09-16T07:32:14.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.207+0000 7fb140e00640 1 -- 172.21.15.114:0/1699391651 wait complete. 2024-09-16T07:32:14.225 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:32:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- 172.21.15.114:0/122363967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 msgr2=0x7fe9440051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 --2- 172.21.15.114:0/122363967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 0x7fe9440051b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe958001dc0 tx=0x7fe95801cb30 comp rx=0 tx=0).stop 2024-09-16T07:32:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe964a00640 1 -- 172.21.15.114:0/122363967 reap_dead start 2024-09-16T07:32:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- 172.21.15.114:0/122363967 shutdown_connections 2024-09-16T07:32:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- 172.21.15.114:0/122363967 >> 172.21.15.114:0/122363967 conn(0x7fe9600b18f0 msgr2=0x7fe9600b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- 172.21.15.114:0/122363967 shutdown_connections 2024-09-16T07:32:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- 172.21.15.114:0/122363967 wait complete. 2024-09-16T07:32:14.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 Processor -- start 2024-09-16T07:32:14.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- start start 2024-09-16T07:32:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 0x7fe9601585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe960159d90 0x7fe96009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe960144fc0 0x7fe96009ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe960070280 con 0x7fe944004d50 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe960070100 con 0x7fe960159d90 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe966a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9600cebf0 con 0x7fe960144fc0 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe95fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 0x7fe9601585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe95fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 0x7fe9601585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41550/0 (socket says 172.21.15.114:41550) 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe95fe00640 1 -- 172.21.15.114:0/2478291036 learned_addr learned my addr 172.21.15.114:0/2478291036 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe957e00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe960159d90 0x7fe96009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.371+0000 7fe964a00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe960144fc0 0x7fe96009ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95fe00640 1 -- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe960144fc0 msgr2=0x7fe96009ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95fe00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe960144fc0 0x7fe96009ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95fe00640 1 -- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe960159d90 msgr2=0x7fe96009d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95fe00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe960159d90 0x7fe96009d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95fe00640 1 -- 172.21.15.114:0/2478291036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe960158cf0 con 0x7fe944004d50 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95fe00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 0x7fe9601585e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe950011ae0 tx=0x7fe950009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95cc00640 1 -- 172.21.15.114:0/2478291036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95001e070 con 0x7fe944004d50 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95cc00640 1 -- 172.21.15.114:0/2478291036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe95000fe40 con 0x7fe944004d50 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95cc00640 1 -- 172.21.15.114:0/2478291036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9500042b0 con 0x7fe944004d50 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe960158fd0 con 0x7fe944004d50 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe960159590 con 0x7fe944004d50 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe960069410 con 0x7fe944004d50 2024-09-16T07:32:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95cc00640 1 -- 172.21.15.114:0/2478291036 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fe950021070 con 0x7fe944004d50 2024-09-16T07:32:14.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.375+0000 7fe95cc00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe93c073250 0x7fe93c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:14.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.379+0000 7fe95cc00640 1 -- 172.21.15.114:0/2478291036 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fe950095010 con 0x7fe944004d50 2024-09-16T07:32:14.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.379+0000 7fe957e00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe93c073250 0x7fe93c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:14.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.379+0000 7fe957e00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe93c073250 0x7fe93c075710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9601f8690 tx=0x7fe948006730 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:14.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.379+0000 7fe95cc00640 1 -- 172.21.15.114:0/2478291036 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe95005f670 con 0x7fe944004d50 2024-09-16T07:32:14.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.583+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe9600cf0c0 con 0x7fe944004d50 2024-09-16T07:32:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.583+0000 7fe95cc00640 1 -- 172.21.15.114:0/2478291036 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7fe9500640a0 con 0x7fe944004d50 2024-09-16T07:32:14.641 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:32:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe93c073250 msgr2=0x7fe93c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe93c073250 0x7fe93c075710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9601f8690 tx=0x7fe948006730 comp rx=0 tx=0).stop 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 msgr2=0x7fe9601585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 0x7fe9601585e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe950011ae0 tx=0x7fe950009ea0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 shutdown_connections 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fe93c073250 0x7fe93c075710 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe960144fc0 0x7fe96009ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe960159d90 0x7fe96009d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 --2- 172.21.15.114:0/2478291036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe944004d50 0x7fe9601585e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 >> 172.21.15.114:0/2478291036 conn(0x7fe9600b18f0 msgr2=0x7fe960155540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 shutdown_connections 2024-09-16T07:32:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14.587+0000 7fe966a00640 1 -- 172.21.15.114:0/2478291036 wait complete. 2024-09-16T07:32:14.643 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:32:14.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:32:14.644 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:32:14.644 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:32:14.644 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:14.644 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:32:14.644 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:32:14.644 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:32:14.644 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:32:14.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:14.644 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:32:14.653 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42206sec preferred_lft 42206sec 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:14.654 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:14.655 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:32:14.656 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:32:14.656 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:14.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:14.657 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:32:14.720 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:32:14.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:14.722 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:14.777 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:14.777 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:32:14.777 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:32:14.777 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:32:14.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:32:14.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:32:14.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:32:14.778 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:32:14.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:32:14.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:14.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:14.912 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:32:14.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:32:14.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:32:14.921 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:32:14.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:14.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:32:14.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:14.983 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:15.031 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:32:15.031 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:15.032 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:15.086 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:32:15.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:15.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:15.174 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:15.175 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:32:15.175 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:32:15.190 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:15.190 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:32:15.190 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:32:15.190 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:15.190 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:15.199 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:15.199 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:32:15.199 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:32:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:32:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:32:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:32:15.203 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:32:15.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:15.203 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:15.223 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:32:15.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:32:15.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:15.332 INFO:teuthology.orchestra.run.smithi114.stdout:client6085 2024-09-16T07:32:15.332 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:15.332 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:15.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:32:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- 172.21.15.114:0/770281691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00ced80 msgr2=0x7f6ca00ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/770281691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00ced80 0x7f6ca00ae9b0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009900 tx=0x7f6c8c01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- 172.21.15.114:0/770281691 shutdown_connections 2024-09-16T07:32:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/770281691 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca00cdb30 0x7f6ca00aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/770281691 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca00ced80 0x7f6ca00ae9b0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- 172.21.15.114:0/770281691 >> 172.21.15.114:0/770281691 conn(0x7f6ca00d1dc0 msgr2=0x7f6ca00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:15.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- 172.21.15.114:0/770281691 shutdown_connections 2024-09-16T07:32:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- 172.21.15.114:0/770281691 wait complete. 2024-09-16T07:32:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 Processor -- start 2024-09-16T07:32:15.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- start start 2024-09-16T07:32:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca00cdb30 0x7f6ca01fbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca00ced80 0x7f6ca014c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca015bea0 0x7f6ca006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0169340 con 0x7f6ca015bea0 2024-09-16T07:32:15.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca01691c0 con 0x7f6ca00ced80 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca01694c0 con 0x7f6ca00cdb30 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca015bea0 0x7f6ca006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca015bea0 0x7f6ca006efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41574/0 (socket says 172.21.15.114:41574) 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.527+0000 7f6ca5e00640 1 -- 172.21.15.114:0/4176732137 learned_addr learned my addr 172.21.15.114:0/4176732137 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca5400640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca00cdb30 0x7f6ca01fbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca4a00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca00ced80 0x7f6ca014c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca5e00640 1 -- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca00cdb30 msgr2=0x7f6ca01fbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca5e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca00cdb30 0x7f6ca01fbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca5e00640 1 -- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca00ced80 msgr2=0x7f6ca014c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca5e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca00ced80 0x7f6ca014c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca5e00640 1 -- 172.21.15.114:0/4176732137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca014c710 con 0x7f6ca015bea0 2024-09-16T07:32:15.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca5e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca015bea0 0x7f6ca006efb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800daa0 tx=0x7f6c9800df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:15.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6c9d600640 1 -- 172.21.15.114:0/4176732137 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98017070 con 0x7f6ca015bea0 2024-09-16T07:32:15.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6c9d600640 1 -- 172.21.15.114:0/4176732137 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c98004b30 con 0x7f6ca015bea0 2024-09-16T07:32:15.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6c9d600640 1 -- 172.21.15.114:0/4176732137 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98005020 con 0x7f6ca015bea0 2024-09-16T07:32:15.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca006df10 con 0x7f6ca015bea0 2024-09-16T07:32:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca006e4d0 con 0x7f6ca015bea0 2024-09-16T07:32:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca00ce670 con 0x7f6ca015bea0 2024-09-16T07:32:15.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.531+0000 7f6c9d600640 1 -- 172.21.15.114:0/4176732137 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f6c980051c0 con 0x7f6ca015bea0 2024-09-16T07:32:15.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.535+0000 7f6c9d600640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80073220 0x7f6c800756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:15.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.535+0000 7f6c9d600640 1 -- 172.21.15.114:0/4176732137 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f6c98094950 con 0x7f6ca015bea0 2024-09-16T07:32:15.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.535+0000 7f6ca5400640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80073220 0x7f6c800756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:15.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.535+0000 7f6ca5400640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80073220 0x7f6c800756e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c94007fd0 tx=0x7f6c94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.539+0000 7f6c9d600640 1 -- 172.21.15.114:0/4176732137 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6c98020070 con 0x7f6ca015bea0 2024-09-16T07:32:15.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.747+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6ca0072730 con 0x7f6ca015bea0 2024-09-16T07:32:15.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.747+0000 7f6c9d600640 1 -- 172.21.15.114:0/4176732137 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7f6c9805eef0 con 0x7f6ca015bea0 2024-09-16T07:32:15.747 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80073220 msgr2=0x7f6c800756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80073220 0x7f6c800756e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c94007fd0 tx=0x7f6c94009040 comp rx=0 tx=0).stop 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca015bea0 msgr2=0x7f6ca006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca015bea0 0x7f6ca006efb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800daa0 tx=0x7f6c9800df60 comp rx=0 tx=0).stop 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 shutdown_connections 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6c80073220 0x7f6c800756e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ca015bea0 0x7f6ca006efb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ca00ced80 0x7f6ca014c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 --2- 172.21.15.114:0/4176732137 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ca00cdb30 0x7f6ca01fbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 >> 172.21.15.114:0/4176732137 conn(0x7f6ca00d1dc0 msgr2=0x7f6ca0071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 shutdown_connections 2024-09-16T07:32:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:15.751+0000 7f6ca7e00640 1 -- 172.21.15.114:0/4176732137 wait complete. 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:32:15.768 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:32:15.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:15.769 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:32:15.779 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42214sec preferred_lft 42214sec 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:15.780 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:15.781 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:32:15.782 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:32:15.782 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:15.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:15.783 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:32:15.843 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:32:15.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:15.847 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:32:15.902 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:32:15.902 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:32:15.902 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:32:15.902 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:32:15.902 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:32:15.903 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:32:15.903 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:32:15.903 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:15.903 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:15.903 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:15.903 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:32:15.903 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:32:15.903 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:32:15.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:32:15.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:32:15.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:32:15.904 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:32:15.996 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:32:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:16.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:16.046 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:32:16.055 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:32:16.056 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:32:16.056 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:32:16.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:16.056 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:32:16.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:16.119 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:16.167 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:32:16.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:16.167 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:16.215 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:32:16.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:16.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:16.305 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:16.305 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:32:16.305 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:32:16.322 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:16.322 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:32:16.322 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:32:16.322 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:16.323 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:16.334 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:16.335 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:32:16.335 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:32:16.335 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:16.335 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:16.335 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:32:16.335 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:32:16.335 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:32:16.338 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:32:16.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:16.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:16.358 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:32:16.450 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:32:16.453 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:16.459 INFO:teuthology.orchestra.run.smithi149.stdout:client6324 2024-09-16T07:32:16.459 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:16.460 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:16.469 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:32:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- 172.21.15.114:0/3333464577 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942c004810 msgr2=0x7f942c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 --2- 172.21.15.114:0/3333464577 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942c004810 0x7f942c004c90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f943000c470 tx=0x7f943001f6c0 comp rx=0 tx=0).stop 2024-09-16T07:32:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- 172.21.15.114:0/3333464577 shutdown_connections 2024-09-16T07:32:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 --2- 172.21.15.114:0/3333464577 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f942c004810 0x7f942c004c90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- 172.21.15.114:0/3333464577 >> 172.21.15.114:0/3333464577 conn(0x7f94440b2140 msgr2=0x7f94440b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- 172.21.15.114:0/3333464577 shutdown_connections 2024-09-16T07:32:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- 172.21.15.114:0/3333464577 wait complete. 2024-09-16T07:32:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 Processor -- start 2024-09-16T07:32:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- start start 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f942c004810 0x7f94441508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94441540e0 0x7f9444158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94440b4ed0 0x7f94440b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f944415f490 con 0x7f94441540e0 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f944415f310 con 0x7f942c004810 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f944c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9444073120 con 0x7f94440b4ed0 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f9449000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94441540e0 0x7f9444158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.627+0000 7f9449a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f942c004810 0x7f94441508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94441540e0 0x7f9444158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41590/0 (socket says 172.21.15.114:41590) 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 -- 172.21.15.114:0/1519116748 learned_addr learned my addr 172.21.15.114:0/1519116748 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f942c004810 0x7f94441508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:36838/0 (socket says 172.21.15.114:36838) 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f944a400640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94440b4ed0 0x7f94440b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 -- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94440b4ed0 msgr2=0x7f94440b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94440b4ed0 0x7f94440b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 -- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f942c004810 msgr2=0x7f94441508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f942c004810 0x7f94441508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 -- 172.21.15.114:0/1519116748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9444159960 con 0x7f94441540e0 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9449000640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94441540e0 0x7f9444158ff0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f943009bfc0 tx=0x7f9430006620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9441600640 1 -- 172.21.15.114:0/1519116748 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94300bf070 con 0x7f94441540e0 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9441600640 1 -- 172.21.15.114:0/1519116748 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94300b4040 con 0x7f94441540e0 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9441600640 1 -- 172.21.15.114:0/1519116748 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94300b3070 con 0x7f94441540e0 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9444159c40 con 0x7f94441540e0 2024-09-16T07:32:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944415b3c0 con 0x7f94441540e0 2024-09-16T07:32:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94440cee20 con 0x7f94441540e0 2024-09-16T07:32:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.631+0000 7f9441600640 1 -- 172.21.15.114:0/1519116748 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f9430003600 con 0x7f94441540e0 2024-09-16T07:32:16.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.635+0000 7f9441600640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424073250 0x7f9424075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:16.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.635+0000 7f9441600640 1 -- 172.21.15.114:0/1519116748 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f9430131180 con 0x7f94441540e0 2024-09-16T07:32:16.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.635+0000 7f9449a00640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424073250 0x7f9424075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:16.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.635+0000 7f9449a00640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424073250 0x7f9424075710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9444052940 tx=0x7f943800b260 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.639+0000 7f9441600640 1 -- 172.21.15.114:0/1519116748 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f944415f640 con 0x7f94441540e0 2024-09-16T07:32:16.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:16.839+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f94440aef60 con 0x7f94441540e0 2024-09-16T07:32:17.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f9441600640 1 -- 172.21.15.114:0/1519116748 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v48) ==== 136+0+0 (secure 0 0 0) 0x7f94300fb790 con 0x7f94441540e0 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424073250 msgr2=0x7f9424075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424073250 0x7f9424075710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9444052940 tx=0x7f943800b260 comp rx=0 tx=0).stop 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94441540e0 msgr2=0x7f9444158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94441540e0 0x7f9444158ff0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f943009bfc0 tx=0x7f9430006620 comp rx=0 tx=0).stop 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 shutdown_connections 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9424073250 0x7f9424075710 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f94440b4ed0 0x7f94440b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94441540e0 0x7f9444158ff0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 --2- 172.21.15.114:0/1519116748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f942c004810 0x7f94441508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 >> 172.21.15.114:0/1519116748 conn(0x7f94440b2140 msgr2=0x7f94440ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:17.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 shutdown_connections 2024-09-16T07:32:17.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.335+0000 7f944c400640 1 -- 172.21.15.114:0/1519116748 wait complete. 2024-09-16T07:32:17.356 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:32:17.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 -- 172.21.15.114:0/1739066813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80b4270 msgr2=0x7f31e80af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 --2- 172.21.15.114:0/1739066813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80b4270 0x7f31e80af900 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f31e8072db0 tx=0x7f31d401c8a0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 -- 172.21.15.114:0/1739066813 shutdown_connections 2024-09-16T07:32:17.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 --2- 172.21.15.114:0/1739066813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80b4270 0x7f31e80af900 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 --2- 172.21.15.114:0/1739066813 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31e80d03e0 0x7f31e80d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 --2- 172.21.15.114:0/1739066813 >> v2:172.21.15.149:3300/0 conn(0x7f31e815bde0 0x7f31e8068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 -- 172.21.15.114:0/1739066813 >> 172.21.15.114:0/1739066813 conn(0x7f31e80b2240 msgr2=0x7f31e80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:17.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 -- 172.21.15.114:0/1739066813 shutdown_connections 2024-09-16T07:32:17.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.499+0000 7f31ef200640 1 -- 172.21.15.114:0/1739066813 wait complete. 2024-09-16T07:32:17.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 Processor -- start 2024-09-16T07:32:17.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 -- start start 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31e80b4270 0x7f31e80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80d03e0 0x7f31e8141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31e815bde0 0x7f31e81fb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f31e815fbf0 con 0x7f31e80d03e0 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f31e815fa70 con 0x7f31e815bde0 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f31e815fd70 con 0x7f31e80b4270 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80d03e0 0x7f31e8141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:17.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80d03e0 0x7f31e8141f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41604/0 (socket says 172.21.15.114:41604) 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 -- 172.21.15.114:0/4097022636 learned_addr learned my addr 172.21.15.114:0/4097022636 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7e00640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31e80b4270 0x7f31e80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ed200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31e815bde0 0x7f31e81fb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 -- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31e80b4270 msgr2=0x7f31e80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31e80b4270 0x7f31e80cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 -- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31e815bde0 msgr2=0x7f31e81fb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31e815bde0 0x7f31e81fb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 -- 172.21.15.114:0/4097022636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e814ea50 con 0x7f31e80d03e0 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ed200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31e815bde0 0x7f31e81fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31e7400640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80d03e0 0x7f31e8141f90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c10 tx=0x7f31d40a5520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31dfe00640 1 -- 172.21.15.114:0/4097022636 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40bb070 con 0x7f31e80d03e0 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31dfe00640 1 -- 172.21.15.114:0/4097022636 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31d40043f0 con 0x7f31e80d03e0 2024-09-16T07:32:17.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31dfe00640 1 -- 172.21.15.114:0/4097022636 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40b2040 con 0x7f31e80d03e0 2024-09-16T07:32:17.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e814ed30 con 0x7f31e80d03e0 2024-09-16T07:32:17.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.503+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e8158eb0 con 0x7f31e80d03e0 2024-09-16T07:32:17.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.507+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e80d0870 con 0x7f31e80d03e0 2024-09-16T07:32:17.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.507+0000 7f31dfe00640 1 -- 172.21.15.114:0/4097022636 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f31d40a5690 con 0x7f31e80d03e0 2024-09-16T07:32:17.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.507+0000 7f31dfe00640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31c8073220 0x7f31c80756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.507+0000 7f31dfe00640 1 -- 172.21.15.114:0/4097022636 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f31d412dcd0 con 0x7f31e80d03e0 2024-09-16T07:32:17.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.507+0000 7f31e7e00640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31c8073220 0x7f31c80756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:17.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.507+0000 7f31e7e00640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31c8073220 0x7f31c80756e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31d80058d0 tx=0x7f31d8005860 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:17.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.511+0000 7f31dfe00640 1 -- 172.21.15.114:0/4097022636 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f31d4016490 con 0x7f31e80d03e0 2024-09-16T07:32:17.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.699+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f31e81590f0 con 0x7f31c8073220 2024-09-16T07:32:17.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.699+0000 7f31dfe00640 1 -- 172.21.15.114:0/4097022636 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f31d800b2c0 con 0x7f31c8073220 2024-09-16T07:32:17.699 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:32:17.699 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:17.699 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:32:17.699 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:17.699 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31c8073220 msgr2=0x7f31c80756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31c8073220 0x7f31c80756e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31d80058d0 tx=0x7f31d8005860 comp rx=0 tx=0).stop 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80d03e0 msgr2=0x7f31e8141f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80d03e0 0x7f31e8141f90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f31d4000c10 tx=0x7f31d40a5520 comp rx=0 tx=0).stop 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 shutdown_connections 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f31c8073220 0x7f31c80756e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f31e815bde0 0x7f31e81fb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31e80d03e0 0x7f31e8141f90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 --2- 172.21.15.114:0/4097022636 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f31e80b4270 0x7f31e80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 >> 172.21.15.114:0/4097022636 conn(0x7f31e80b2240 msgr2=0x7f31e80b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:17.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 shutdown_connections 2024-09-16T07:32:17.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.703+0000 7f31ef200640 1 -- 172.21.15.114:0/4097022636 wait complete. 2024-09-16T07:32:17.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:32:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- 172.21.15.114:0/2304073589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda4073d10 msgr2=0x7fbda40cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 --2- 172.21.15.114:0/2304073589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda4073d10 0x7fbda40cd100 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbda406fcf0 tx=0x7fbd9001db30 comp rx=0 tx=0).stop 2024-09-16T07:32:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- 172.21.15.114:0/2304073589 shutdown_connections 2024-09-16T07:32:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 --2- 172.21.15.114:0/2304073589 >> v2:172.21.15.149:3300/0 conn(0x7fbda40b49e0 0x7fbda406e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 --2- 172.21.15.114:0/2304073589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda4073d10 0x7fbda40cd100 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- 172.21.15.114:0/2304073589 >> 172.21.15.114:0/2304073589 conn(0x7fbda40b18f0 msgr2=0x7fbda40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- 172.21.15.114:0/2304073589 shutdown_connections 2024-09-16T07:32:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- 172.21.15.114:0/2304073589 wait complete. 2024-09-16T07:32:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 Processor -- start 2024-09-16T07:32:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- start start 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbda4073d10 0x7fbda4149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbda40b49e0 0x7fbda409b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda415a660 0x7fbda415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4167310 con 0x7fbda415a660 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4167190 con 0x7fbda4073d10 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdac000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbda4167490 con 0x7fbda40b49e0 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdaa000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda415a660 0x7fbda415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.867+0000 7fbdaa000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda415a660 0x7fbda415bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41624/0 (socket says 172.21.15.114:41624) 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdaa000640 1 -- 172.21.15.114:0/522550920 learned_addr learned my addr 172.21.15.114:0/522550920 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbda8c00640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbda40b49e0 0x7fbda409b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:17.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdaa000640 1 -- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbda40b49e0 msgr2=0x7fbda409b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdaa000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbda40b49e0 0x7fbda409b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdaa000640 1 -- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbda4073d10 msgr2=0x7fbda4149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdaa000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbda4073d10 0x7fbda4149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdaa000640 1 -- 172.21.15.114:0/522550920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda409c3f0 con 0x7fbda415a660 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdaa000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda415a660 0x7fbda415bc90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00d780 tx=0x7fbd9c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbda1600640 1 -- 172.21.15.114:0/522550920 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c017070 con 0x7fbda415a660 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbda1600640 1 -- 172.21.15.114:0/522550920 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd9c00de90 con 0x7fbda415a660 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbda1600640 1 -- 172.21.15.114:0/522550920 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c004020 con 0x7fbda415a660 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda41f7ff0 con 0x7fbda415a660 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda41f85b0 con 0x7fbda415a660 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda4069410 con 0x7fbda415a660 2024-09-16T07:32:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.871+0000 7fbda1600640 1 -- 172.21.15.114:0/522550920 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7fbd9c0041c0 con 0x7fbda415a660 2024-09-16T07:32:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.875+0000 7fbda1600640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd84073220 0x7fbd840756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.875+0000 7fbda1600640 1 -- 172.21.15.114:0/522550920 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fbd9c094620 con 0x7fbda415a660 2024-09-16T07:32:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.875+0000 7fbda9600640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd84073220 0x7fbd840756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.875+0000 7fbda9600640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd84073220 0x7fbd840756e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd98004a40 tx=0x7fbd98001660 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:17.879+0000 7fbda1600640 1 -- 172.21.15.114:0/522550920 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbd9c05ebc0 con 0x7fbda415a660 2024-09-16T07:32:18.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.043+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbda40cd100 con 0x7fbda415a660 2024-09-16T07:32:18.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.043+0000 7fbda1600640 1 -- 172.21.15.114:0/522550920 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fbd9c0635f0 con 0x7fbda415a660 2024-09-16T07:32:18.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd84073220 msgr2=0x7fbd840756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd84073220 0x7fbd840756e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd98004a40 tx=0x7fbd98001660 comp rx=0 tx=0).stop 2024-09-16T07:32:18.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda415a660 msgr2=0x7fbda415bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda415a660 0x7fbda415bc90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00d780 tx=0x7fbd9c00dc40 comp rx=0 tx=0).stop 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 shutdown_connections 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7fbd84073220 0x7fbd840756e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbda415a660 0x7fbda415bc90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbda40b49e0 0x7fbda409b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 --2- 172.21.15.114:0/522550920 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbda4073d10 0x7fbda4149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 >> 172.21.15.114:0/522550920 conn(0x7fbda40b18f0 msgr2=0x7fbda40b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 shutdown_connections 2024-09-16T07:32:18.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.047+0000 7fbdac000640 1 -- 172.21.15.114:0/522550920 wait complete. 2024-09-16T07:32:18.065 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:18.065 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:18.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:32:18.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:32:18.075 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:18.075 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:18.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:32:18.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.355+0000 7f8e4a000640 1 -- 172.21.15.114:0/1896322692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e44073d10 msgr2=0x7f8e440cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.355+0000 7f8e4a000640 1 --2- 172.21.15.114:0/1896322692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e44073d10 0x7f8e440cd100 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000a950 tx=0x7f8e3001db70 comp rx=0 tx=0).stop 2024-09-16T07:32:18.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.355+0000 7f8e4a000640 1 -- 172.21.15.114:0/1896322692 shutdown_connections 2024-09-16T07:32:18.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.355+0000 7f8e4a000640 1 --2- 172.21.15.114:0/1896322692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e44073d10 0x7f8e440cd100 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.355+0000 7f8e4a000640 1 -- 172.21.15.114:0/1896322692 >> 172.21.15.114:0/1896322692 conn(0x7f8e440b18f0 msgr2=0x7f8e440b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:18.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.355+0000 7f8e4a000640 1 -- 172.21.15.114:0/1896322692 shutdown_connections 2024-09-16T07:32:18.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.355+0000 7f8e4a000640 1 -- 172.21.15.114:0/1896322692 wait complete. 2024-09-16T07:32:18.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 Processor -- start 2024-09-16T07:32:18.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 -- start start 2024-09-16T07:32:18.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e44073d10 0x7f8e440ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e440b49e0 0x7f8e4409d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e4415a660 0x7f8e4409c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8e44168530 con 0x7f8e440b49e0 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e441683b0 con 0x7f8e44073d10 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8e441686b0 con 0x7f8e4415a660 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e440b49e0 0x7f8e4409d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e440b49e0 0x7f8e4409d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41644/0 (socket says 172.21.15.114:41644) 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 -- 172.21.15.114:0/206025820 learned_addr learned my addr 172.21.15.114:0/206025820 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 -- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e4415a660 msgr2=0x7f8e4409c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e4415a660 0x7f8e4409c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 -- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e44073d10 msgr2=0x7f8e440ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e44073d10 0x7f8e440ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 -- 172.21.15.114:0/206025820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4409dac0 con 0x7f8e440b49e0 2024-09-16T07:32:18.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e42a00640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e440b49e0 0x7f8e4409d580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000a8a0 tx=0x7f8e30003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:18.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e3b400640 1 -- 172.21.15.114:0/206025820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e300b3040 con 0x7f8e440b49e0 2024-09-16T07:32:18.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e3b400640 1 -- 172.21.15.114:0/206025820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e30003b10 con 0x7f8e440b49e0 2024-09-16T07:32:18.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e3b400640 1 -- 172.21.15.114:0/206025820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e300ae440 con 0x7f8e440b49e0 2024-09-16T07:32:18.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e441f96f0 con 0x7f8e440b49e0 2024-09-16T07:32:18.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e441f9cb0 con 0x7f8e440b49e0 2024-09-16T07:32:18.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.359+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e44069410 con 0x7f8e440b49e0 2024-09-16T07:32:18.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.363+0000 7f8e3b400640 1 -- 172.21.15.114:0/206025820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f8e300b63c0 con 0x7f8e440b49e0 2024-09-16T07:32:18.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.363+0000 7f8e3b400640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e24073250 0x7f8e24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.363+0000 7f8e3b400640 1 -- 172.21.15.114:0/206025820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8e3012e9a0 con 0x7f8e440b49e0 2024-09-16T07:32:18.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.363+0000 7f8e43400640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e24073250 0x7f8e24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:18.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.363+0000 7f8e43400640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e24073250 0x7f8e24075710 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007fd0 tx=0x7f8e34007940 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:18.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.367+0000 7f8e3b400640 1 -- 172.21.15.114:0/206025820 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8e30017760 con 0x7f8e440b49e0 2024-09-16T07:32:18.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.543+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8e440cd100 con 0x7f8e440b49e0 2024-09-16T07:32:18.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.543+0000 7f8e3b400640 1 -- 172.21.15.114:0/206025820 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f8e300f9590 con 0x7f8e440b49e0 2024-09-16T07:32:18.543 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:32:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e24073250 msgr2=0x7f8e24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e24073250 0x7f8e24075710 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007fd0 tx=0x7f8e34007940 comp rx=0 tx=0).stop 2024-09-16T07:32:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e440b49e0 msgr2=0x7f8e4409d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e440b49e0 0x7f8e4409d580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000a8a0 tx=0x7f8e30003830 comp rx=0 tx=0).stop 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 shutdown_connections 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8e24073250 0x7f8e24075710 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8e4415a660 0x7f8e4409c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e440b49e0 0x7f8e4409d580 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 --2- 172.21.15.114:0/206025820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e44073d10 0x7f8e440ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 >> 172.21.15.114:0/206025820 conn(0x7f8e440b18f0 msgr2=0x7f8e44154980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 shutdown_connections 2024-09-16T07:32:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.547+0000 7f8e4a000640 1 -- 172.21.15.114:0/206025820 wait complete. 2024-09-16T07:32:18.565 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:32:18.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:18.565 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:18.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:32:18.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:18.592 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:32:18.644 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:18.644 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:18.653 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:18.654 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:18.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 -- 172.21.15.114:0/3582950771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432015ade0 msgr2=0x7f43200cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 --2- 172.21.15.114:0/3582950771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432015ade0 0x7f43200cebf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4314009900 tx=0x7f431401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 -- 172.21.15.114:0/3582950771 shutdown_connections 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 --2- 172.21.15.114:0/3582950771 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f432006e810 0x7f43200cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 --2- 172.21.15.114:0/3582950771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432015ade0 0x7f43200cebf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 -- 172.21.15.114:0/3582950771 >> 172.21.15.114:0/3582950771 conn(0x7f43200b18f0 msgr2=0x7f43200b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 -- 172.21.15.114:0/3582950771 shutdown_connections 2024-09-16T07:32:18.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.847+0000 7f4327a00640 1 -- 172.21.15.114:0/3582950771 wait complete. 2024-09-16T07:32:18.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 Processor -- start 2024-09-16T07:32:18.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 -- start start 2024-09-16T07:32:18.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432006e810 0x7f43201f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43200b4bd0 0x7f4320074400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f432015ade0 0x7f43200b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4320168140 con 0x7f432006e810 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4320167fc0 con 0x7f43200b4bd0 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f43201682c0 con 0x7f432015ade0 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432006e810 0x7f43201f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432006e810 0x7f43201f8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41654/0 (socket says 172.21.15.114:41654) 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 -- 172.21.15.114:0/2998569821 learned_addr learned my addr 172.21.15.114:0/2998569821 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f431fe00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43200b4bd0 0x7f4320074400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f432015ade0 0x7f43200b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 -- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f432015ade0 msgr2=0x7f43200b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f432015ade0 0x7f43200b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 -- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43200b4bd0 msgr2=0x7f4320074400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43200b4bd0 0x7f4320074400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 -- 172.21.15.114:0/2998569821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4320163d20 con 0x7f432006e810 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f432015ade0 0x7f43200b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4325000640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432006e810 0x7f43201f8950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4314009850 tx=0x7f43140a66b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f431cc00640 1 -- 172.21.15.114:0/2998569821 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314004380 con 0x7f432006e810 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f431cc00640 1 -- 172.21.15.114:0/2998569821 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4314005020 con 0x7f432006e810 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4320163fe0 con 0x7f432006e810 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f431cc00640 1 -- 172.21.15.114:0/2998569821 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314005450 con 0x7f432006e810 2024-09-16T07:32:18.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43201645a0 con 0x7f432006e810 2024-09-16T07:32:18.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.851+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4320069410 con 0x7f432006e810 2024-09-16T07:32:18.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.855+0000 7f431cc00640 1 -- 172.21.15.114:0/2998569821 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f43140be060 con 0x7f432006e810 2024-09-16T07:32:18.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.855+0000 7f431cc00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4300073220 0x7f43000756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:18.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.855+0000 7f431cc00640 1 -- 172.21.15.114:0/2998569821 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f431412e3d0 con 0x7f432006e810 2024-09-16T07:32:18.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.855+0000 7f431fe00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4300073220 0x7f43000756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:18.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.855+0000 7f431fe00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4300073220 0x7f43000756e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f43201f5a30 tx=0x7f430c00b390 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:18.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:18.859+0000 7f431cc00640 1 -- 172.21.15.114:0/2998569821 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f43140164d0 con 0x7f432006e810 2024-09-16T07:32:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.035+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f432015e900 con 0x7f432006e810 2024-09-16T07:32:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.035+0000 7f431cc00640 1 -- 172.21.15.114:0/2998569821 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f43140f9150 con 0x7f432006e810 2024-09-16T07:32:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:32:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4300073220 msgr2=0x7f43000756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4300073220 0x7f43000756e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f43201f5a30 tx=0x7f430c00b390 comp rx=0 tx=0).stop 2024-09-16T07:32:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432006e810 msgr2=0x7f43201f8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432006e810 0x7f43201f8950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4314009850 tx=0x7f43140a66b0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 shutdown_connections 2024-09-16T07:32:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f4300073220 0x7f43000756e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f432015ade0 0x7f43200b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f43200b4bd0 0x7f4320074400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 --2- 172.21.15.114:0/2998569821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f432006e810 0x7f43201f8950 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 >> 172.21.15.114:0/2998569821 conn(0x7f43200b18f0 msgr2=0x7f43200ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:19.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 shutdown_connections 2024-09-16T07:32:19.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.039+0000 7f4327a00640 1 -- 172.21.15.114:0/2998569821 wait complete. 2024-09-16T07:32:19.057 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:32:19.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:19.058 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:19.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:32:19.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:19.087 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:32:19.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.279+0000 7f8ab8a00640 1 -- 172.21.15.114:0/2755422859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 msgr2=0x7f8a98004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.279+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/2755422859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8a98004090 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4006e90 tx=0x7f8aa401cdd0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.279+0000 7f8ab8a00640 1 -- 172.21.15.114:0/2755422859 shutdown_connections 2024-09-16T07:32:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.279+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/2755422859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8a98004090 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.279+0000 7f8ab8a00640 1 -- 172.21.15.114:0/2755422859 >> 172.21.15.114:0/2755422859 conn(0x7f8ab40d1d90 msgr2=0x7f8ab40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.279+0000 7f8ab8a00640 1 -- 172.21.15.114:0/2755422859 shutdown_connections 2024-09-16T07:32:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.279+0000 7f8ab8a00640 1 -- 172.21.15.114:0/2755422859 wait complete. 2024-09-16T07:32:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 Processor -- start 2024-09-16T07:32:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 -- start start 2024-09-16T07:32:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8ab4159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ab41496e0 0x7f8ab4148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ab40c8dd0 0x7f8ab40c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab40cd370 con 0x7f8a98003c90 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab40cd1f0 con 0x7f8ab40c8dd0 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab40cd4f0 con 0x7f8ab41496e0 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8ab4159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8ab4159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41674/0 (socket says 172.21.15.114:41674) 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 -- 172.21.15.114:0/243550488 learned_addr learned my addr 172.21.15.114:0/243550488 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab2800640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ab40c8dd0 0x7f8ab40c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8aa9400640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ab41496e0 0x7f8ab4148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 -- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ab41496e0 msgr2=0x7f8ab4148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ab41496e0 0x7f8ab4148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 -- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ab40c8dd0 msgr2=0x7f8ab40c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ab40c8dd0 0x7f8ab40c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 -- 172.21.15.114:0/243550488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab415a0e0 con 0x7f8a98003c90 2024-09-16T07:32:19.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab1e00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8ab4159ba0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4006e90 tx=0x7f8aa4001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:19.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8aaaa00640 1 -- 172.21.15.114:0/243550488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4003600 con 0x7f8a98003c90 2024-09-16T07:32:19.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8aaaa00640 1 -- 172.21.15.114:0/243550488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8aa40037a0 con 0x7f8a98003c90 2024-09-16T07:32:19.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab415a380 con 0x7f8a98003c90 2024-09-16T07:32:19.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8aaaa00640 1 -- 172.21.15.114:0/243550488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4003bb0 con 0x7f8a98003c90 2024-09-16T07:32:19.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.283+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab415a940 con 0x7f8a98003c90 2024-09-16T07:32:19.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.287+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab415fad0 con 0x7f8a98003c90 2024-09-16T07:32:19.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.287+0000 7f8aaaa00640 1 -- 172.21.15.114:0/243550488 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f8aa40b7070 con 0x7f8a98003c90 2024-09-16T07:32:19.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.287+0000 7f8aaaa00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8a90073220 0x7f8a900756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.287+0000 7f8aaaa00640 1 -- 172.21.15.114:0/243550488 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8aa412e860 con 0x7f8a98003c90 2024-09-16T07:32:19.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.287+0000 7f8aa9400640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8a90073220 0x7f8a900756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.287+0000 7f8aa9400640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8a90073220 0x7f8a900756e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40b7e00 tx=0x7f8a9c006b20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:19.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.291+0000 7f8aaaa00640 1 -- 172.21.15.114:0/243550488 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8aa4016bb0 con 0x7f8a98003c90 2024-09-16T07:32:19.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ab4070270 con 0x7f8a98003c90 2024-09-16T07:32:19.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8aaaa00640 1 -- 172.21.15.114:0/243550488 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f8aa40f90a0 con 0x7f8a98003c90 2024-09-16T07:32:19.498 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:19.498 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"btime":"2024-09-16T07:32:17:332311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:19.498 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8a90073220 msgr2=0x7f8a900756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8a90073220 0x7f8a900756e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40b7e00 tx=0x7f8a9c006b20 comp rx=0 tx=0).stop 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 msgr2=0x7f8ab4159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8ab4159ba0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4006e90 tx=0x7f8aa4001bd0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 shutdown_connections 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f8a90073220 0x7f8a900756e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ab40c8dd0 0x7f8ab40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ab41496e0 0x7f8ab4148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 --2- 172.21.15.114:0/243550488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a98003c90 0x7f8ab4159ba0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 >> 172.21.15.114:0/243550488 conn(0x7f8ab40d1d90 msgr2=0x7f8ab41552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:19.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 shutdown_connections 2024-09-16T07:32:19.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.499+0000 7f8ab8a00640 1 -- 172.21.15.114:0/243550488 wait complete. 2024-09-16T07:32:19.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:32:19.679 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-09-16T07:32:19.679 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-16T07:32:19.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol45820 2024-09-16T07:32:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 -- 172.21.15.114:0/2130547915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 msgr2=0x7efc240cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 --2- 172.21.15.114:0/2130547915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 0x7efc240cd000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc14009900 tx=0x7efc1401f0d0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 -- 172.21.15.114:0/2130547915 shutdown_connections 2024-09-16T07:32:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 --2- 172.21.15.114:0/2130547915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 0x7efc240cd000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 --2- 172.21.15.114:0/2130547915 >> v2:172.21.15.149:3300/0 conn(0x7efc2415c3e0 0x7efc2415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 -- 172.21.15.114:0/2130547915 >> 172.21.15.114:0/2130547915 conn(0x7efc240b18f0 msgr2=0x7efc240b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 -- 172.21.15.114:0/2130547915 shutdown_connections 2024-09-16T07:32:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 -- 172.21.15.114:0/2130547915 wait complete. 2024-09-16T07:32:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 Processor -- start 2024-09-16T07:32:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.827+0000 7efc2c800640 1 -- start start 2024-09-16T07:32:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc240cd540 0x7efc240b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 0x7efc24154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2415c3e0 0x7efc240ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efc241601a0 con 0x7efc240cd540 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc24160020 con 0x7efc2415c3e0 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efc24160320 con 0x7efc2415bfa0 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc240cd540 0x7efc240b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc240cd540 0x7efc240b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41688/0 (socket says 172.21.15.114:41688) 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 -- 172.21.15.114:0/3988518304 learned_addr learned my addr 172.21.15.114:0/3988518304 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29400640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 0x7efc24154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2a800640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2415c3e0 0x7efc240ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 -- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 msgr2=0x7efc24154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 0x7efc24154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 -- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2415c3e0 msgr2=0x7efc240ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2415c3e0 0x7efc240ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 -- 172.21.15.114:0/3988518304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc24155330 con 0x7efc240cd540 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc29e00640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc240cd540 0x7efc240b3f00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efc1800e7a0 tx=0x7efc1800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc1e000640 1 -- 172.21.15.114:0/3988518304 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1800ccc0 con 0x7efc240cd540 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc1e000640 1 -- 172.21.15.114:0/3988518304 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc18010430 con 0x7efc240cd540 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc1e000640 1 -- 172.21.15.114:0/3988518304 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18010860 con 0x7efc240cd540 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc240b2e70 con 0x7efc240cd540 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc240b3430 con 0x7efc240cd540 2024-09-16T07:32:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.831+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc24069410 con 0x7efc240cd540 2024-09-16T07:32:19.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.835+0000 7efc1e000640 1 -- 172.21.15.114:0/3988518304 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7efc18010a00 con 0x7efc240cd540 2024-09-16T07:32:19.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.835+0000 7efc1e000640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc08073250 0x7efc08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:19.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.835+0000 7efc1e000640 1 -- 172.21.15.114:0/3988518304 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7efc18094d20 con 0x7efc240cd540 2024-09-16T07:32:19.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.835+0000 7efc29400640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc08073250 0x7efc08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:19.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.835+0000 7efc29400640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc08073250 0x7efc08075710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efc140b2000 tx=0x7efc140aa040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:19.839+0000 7efc1e000640 1 -- 172.21.15.114:0/3988518304 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efc24155330 con 0x7efc240cd540 2024-09-16T07:32:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.031+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 --> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol45820", "target": ["mon-mgr", ""]}) -- 0x7efc240cd000 con 0x7efc08073250 2024-09-16T07:32:20.038 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:32:20.035+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:20.038 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:32:20.035+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:20.038 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:32:20.035+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:20.038 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:32:20.035+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:20.038 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:32:20.035+0000 7f1829600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:20.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.075+0000 7efc1e000640 1 -- 172.21.15.114:0/3988518304 <== mgr.4111 v2:172.21.15.149:6800/921426846 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efc240cd000 con 0x7efc08073250 2024-09-16T07:32:20.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc08073250 msgr2=0x7efc08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc08073250 0x7efc08075710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efc140b2000 tx=0x7efc140aa040 comp rx=0 tx=0).stop 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc240cd540 msgr2=0x7efc240b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc240cd540 0x7efc240b3f00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efc1800e7a0 tx=0x7efc1800ec60 comp rx=0 tx=0).stop 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 shutdown_connections 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7efc08073250 0x7efc08075710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2415c3e0 0x7efc240ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc2415bfa0 0x7efc24154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 --2- 172.21.15.114:0/3988518304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc240cd540 0x7efc240b3f00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 >> 172.21.15.114:0/3988518304 conn(0x7efc240b18f0 msgr2=0x7efc240b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 shutdown_connections 2024-09-16T07:32:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.079+0000 7efc2c800640 1 -- 172.21.15.114:0/3988518304 wait complete. 2024-09-16T07:32:20.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:20.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 -- 172.21.15.114:0/3079328440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 msgr2=0x7f6f1000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 --2- 172.21.15.114:0/3079328440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 0x7f6f1000b9d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009eb0 tx=0x7f6f2401d5b0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f31200640 1 -- 172.21.15.114:0/3079328440 reap_dead start 2024-09-16T07:32:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 -- 172.21.15.114:0/3079328440 shutdown_connections 2024-09-16T07:32:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 -- 172.21.15.114:0/3079328440 >> 172.21.15.114:0/3079328440 conn(0x7f6f2c0b18f0 msgr2=0x7f6f2c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 -- 172.21.15.114:0/3079328440 shutdown_connections 2024-09-16T07:32:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 -- 172.21.15.114:0/3079328440 wait complete. 2024-09-16T07:32:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 Processor -- start 2024-09-16T07:32:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.239+0000 7f6f33200640 1 -- start start 2024-09-16T07:32:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 0x7f6f2c0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f2c13dcf0 0x7f6f2c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2c13e150 0x7f6f2c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c0b4d50 con 0x7f6f100051d0 2024-09-16T07:32:20.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c0b4bd0 con 0x7f6f2c13dcf0 2024-09-16T07:32:20.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2c0b4ed0 con 0x7f6f2c13e150 2024-09-16T07:32:20.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 0x7f6f2c0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:20.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 0x7f6f2c0aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41710/0 (socket says 172.21.15.114:41710) 2024-09-16T07:32:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 -- 172.21.15.114:0/12211597 learned_addr learned my addr 172.21.15.114:0/12211597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 -- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2c13e150 msgr2=0x7f6f2c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2c13e150 0x7f6f2c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 -- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f2c13dcf0 msgr2=0x7f6f2c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f2c13dcf0 0x7f6f2c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 -- 172.21.15.114:0/12211597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2c0af350 con 0x7f6f100051d0 2024-09-16T07:32:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f2be00640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 0x7f6f2c0aee10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c006660 tx=0x7f6f1c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f28c00640 1 -- 172.21.15.114:0/12211597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c015070 con 0x7f6f100051d0 2024-09-16T07:32:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f28c00640 1 -- 172.21.15.114:0/12211597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f1c011920 con 0x7f6f100051d0 2024-09-16T07:32:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2c1f8190 con 0x7f6f100051d0 2024-09-16T07:32:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f28c00640 1 -- 172.21.15.114:0/12211597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c011d70 con 0x7f6f100051d0 2024-09-16T07:32:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2c1f8750 con 0x7f6f100051d0 2024-09-16T07:32:20.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2c069410 con 0x7f6f100051d0 2024-09-16T07:32:20.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.243+0000 7f6f28c00640 1 -- 172.21.15.114:0/12211597 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f6f1c018070 con 0x7f6f100051d0 2024-09-16T07:32:20.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.247+0000 7f6f28c00640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6f08073220 0x7f6f080756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.247+0000 7f6f28c00640 1 -- 172.21.15.114:0/12211597 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f6f1c095290 con 0x7f6f100051d0 2024-09-16T07:32:20.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.247+0000 7f6f23400640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6f08073220 0x7f6f080756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:20.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.247+0000 7f6f23400640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6f08073220 0x7f6f080756e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c09de20 tx=0x7f6f140096d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:20.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.251+0000 7f6f28c00640 1 -- 172.21.15.114:0/12211597 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6f1c05fec0 con 0x7f6f100051d0 2024-09-16T07:32:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f2c0cebf0 con 0x7f6f100051d0 2024-09-16T07:32:20.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f28c00640 1 -- 172.21.15.114:0/12211597 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f6f1c05f7c0 con 0x7f6f100051d0 2024-09-16T07:32:20.453 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:20.454 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"btime":"2024-09-16T07:32:17:332311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:20.454 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-09-16T07:32:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6f08073220 msgr2=0x7f6f080756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6f08073220 0x7f6f080756e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c09de20 tx=0x7f6f140096d0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 msgr2=0x7f6f2c0aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 0x7f6f2c0aee10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c006660 tx=0x7f6f1c0039d0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 shutdown_connections 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f6f08073220 0x7f6f080756e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f2c13e150 0x7f6f2c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f2c13dcf0 0x7f6f2c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 --2- 172.21.15.114:0/12211597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f100051d0 0x7f6f2c0aee10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 >> 172.21.15.114:0/12211597 conn(0x7f6f2c0b18f0 msgr2=0x7f6f2c154aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.455+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 shutdown_connections 2024-09-16T07:32:20.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.459+0000 7f6f33200640 1 -- 172.21.15.114:0/12211597 wait complete. 2024-09-16T07:32:20.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:32:20.633 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":6127,"entity":{"name":{"type":"client","num":6127},"addr":{"type":"any","addr":"172.21.15.149:0","nonce":4029777038}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":0.57599320099999995,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.971396594892298,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6127 172.21.15.149:0/4029777038","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"x","hostname":"smithi149","pid":"28841","root":"/"}}] 2024-09-16T07:32:20.634 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi149", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28841", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.149:0", "nonce": 4029777038, "type": "any" }, "name": { "num": 6127, "type": "client" } }, "id": 6127, "inst": "client.6127 172.21.15.149:0/4029777038", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.971396594892298 }, "state": "open", "uptime": 0.575993201 } ] 2024-09-16T07:32:20.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 -- 172.21.15.114:0/163745297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cd100 msgr2=0x7f95380b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 --2- 172.21.15.114:0/163745297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cd100 0x7f95380b4340 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9538069950 tx=0x7f952401db60 comp rx=0 tx=0).stop 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 -- 172.21.15.114:0/163745297 shutdown_connections 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 --2- 172.21.15.114:0/163745297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cd100 0x7f95380b4340 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 --2- 172.21.15.114:0/163745297 >> v2:172.21.15.149:3300/0 conn(0x7f953815db50 0x7f95380acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 -- 172.21.15.114:0/163745297 >> 172.21.15.114:0/163745297 conn(0x7f95380b18f0 msgr2=0x7f95380b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 -- 172.21.15.114:0/163745297 shutdown_connections 2024-09-16T07:32:20.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.775+0000 7f9540400640 1 -- 172.21.15.114:0/163745297 wait complete. 2024-09-16T07:32:20.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 Processor -- start 2024-09-16T07:32:20.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 -- start start 2024-09-16T07:32:20.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380b4880 0x7f95381648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380cd100 0x7f95380b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f953815db50 0x7f95381465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95380cccf0 con 0x7f95380b4880 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95380ccb70 con 0x7f95380cd100 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9538167120 con 0x7f953815db50 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380b4880 0x7f95381648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380b4880 0x7f95381648e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41738/0 (socket says 172.21.15.114:41738) 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 -- 172.21.15.114:0/1279795195 learned_addr learned my addr 172.21.15.114:0/1279795195 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953d000640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380cd100 0x7f95380b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953e400640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f953815db50 0x7f95381465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 -- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f953815db50 msgr2=0x7f95381465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f953815db50 0x7f95381465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 -- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380cd100 msgr2=0x7f95380b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380cd100 0x7f95380b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:20.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 -- 172.21.15.114:0/1279795195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95381fc410 con 0x7f95380b4880 2024-09-16T07:32:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953d000640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380cd100 0x7f95380b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f953da00640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380b4880 0x7f95381648e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f952c0058d0 tx=0x7f952c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9535600640 1 -- 172.21.15.114:0/1279795195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c017070 con 0x7f95380b4880 2024-09-16T07:32:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9535600640 1 -- 172.21.15.114:0/1279795195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f952c009d20 con 0x7f95380b4880 2024-09-16T07:32:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9535600640 1 -- 172.21.15.114:0/1279795195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c0106c0 con 0x7f95380b4880 2024-09-16T07:32:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9538146b00 con 0x7f95380b4880 2024-09-16T07:32:20.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.779+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9538163240 con 0x7f95380b4880 2024-09-16T07:32:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.783+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9538069410 con 0x7f95380b4880 2024-09-16T07:32:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.783+0000 7f9535600640 1 -- 172.21.15.114:0/1279795195 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 11) ==== 97386+0+0 (secure 0 0 0) 0x7f952c01a070 con 0x7f95380b4880 2024-09-16T07:32:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.783+0000 7f9535600640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9518073190 0x7f9518075650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:20.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.783+0000 7f9535600640 1 -- 172.21.15.114:0/1279795195 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f952c094730 con 0x7f95380b4880 2024-09-16T07:32:20.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.783+0000 7f953d000640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9518073190 0x7f9518075650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:20.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.783+0000 7f953d000640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9518073190 0x7f9518075650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f95240b0000 tx=0x7f952401c3a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:20.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.787+0000 7f9535600640 1 -- 172.21.15.114:0/1279795195 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f952c05f340 con 0x7f95380b4880 2024-09-16T07:32:20.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:20.995+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f95380b4340 con 0x7f95380b4880 2024-09-16T07:32:21.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.003+0000 7f9535600640 1 -- 172.21.15.114:0/1279795195 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v11) ==== 81+0+505754 (secure 0 0 0) 0x7f952c05ec40 con 0x7f95380b4880 2024-09-16T07:32:21.007 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "epoch": 11, 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "active_gid": 4111, 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "active_name": "x", 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "active_addrs": { 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:6800", 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 921426846 2024-09-16T07:32:21.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.009 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-09-16T07:32:21.009 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:6801", 2024-09-16T07:32:21.009 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 921426846 2024-09-16T07:32:21.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.009 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "active_addr": "172.21.15.149:6801/921426846", 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "active_change": "2024-09-16T07:28:00.978069+0000", 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "active_mgr_features": 4540719139924082687, 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "available": true, 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "standbys": [ 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "gid": 4106, 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "y", 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr_features": 4540719139924082687, 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "available_modules": [ 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "alerts", 2024-09-16T07:32:21.010 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T07:32:21.011 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.012 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.013 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.014 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.015 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.016 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_destination": { 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_destination", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.017 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_from_name": { 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_from_name", 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.018 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "Ceph", 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email From: name", 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_host": { 2024-09-16T07:32:21.019 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_host", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP server", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.020 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_password": { 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_password", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Password to authenticate with", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.021 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_port": { 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_port", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "465", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP port", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.022 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.023 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.023 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_sender": { 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_sender", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP envelope sender", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.024 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_ssl": { 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_ssl", 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.025 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_user": { 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_user", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.026 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "User to authenticate as", 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.027 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.028 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.029 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "balancer", 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: "active": { 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "active", 2024-09-16T07:32:21.030 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.031 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_time": { 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_time", 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0000", 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.032 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_weekday": { 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_weekday", 2024-09-16T07:32:21.033 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.034 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_max_iterations": { 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_max_iterations", 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "25", 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "250", 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.035 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_metrics": { 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_metrics", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.036 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_step": { 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_step", 2024-09-16T07:32:21.037 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.5", 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0.001", 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "0.999", 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "aggressiveness of optimization", 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.038 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "end_time": { 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_time", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2359", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.039 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "end_weekday": { 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_weekday", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.040 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.041 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.042 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.043 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.044 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.045 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "min_score": { 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_score", 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.046 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.047 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "upmap", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "crush-compat", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "none", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "read", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap-read" 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Balancer mode", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.048 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_ids": { 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_ids", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.049 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.050 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.051 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_deviation": { 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_deviation", 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.052 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_optimizations": { 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_optimizations", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.053 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm", 2024-09-16T07:32:21.054 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_down_multiplier": { 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_down_multiplier", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.055 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_refresh_rate": { 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_refresh_rate", 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "20", 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.056 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_starting_port": { 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_starting_port", 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4721", 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.057 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_ptrace": { 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_ptrace", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.058 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_interval": { 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_interval", 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.059 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_memory_target_ratio": { 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.060 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.7", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm_log_destination": { 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm_log_destination", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.061 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "file", 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "file,syslog", 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "syslog" 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.062 INFO:teuthology.orchestra.run.smithi114.stdout: "cgroups_split": { 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cgroups_split", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.063 INFO:teuthology.orchestra.run.smithi114.stdout: "config_checks_enabled": { 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_checks_enabled", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.064 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "config_dashboard": { 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_dashboard", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.065 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_alertmanager": { 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_alertmanager", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.066 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_base": { 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_base", 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.067 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Container image name, without the tag", 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_elasticsearch": { 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_elasticsearch", 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.068 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "elasticsearch container image", 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_grafana": { 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_grafana", 2024-09-16T07:32:21.069 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_haproxy": { 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_haproxy", 2024-09-16T07:32:21.070 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "HAproxy container image", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_agent": { 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_agent", 2024-09-16T07:32:21.071 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger agent container image", 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_collector": { 2024-09-16T07:32:21.072 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_collector", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger collector container image", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_query": { 2024-09-16T07:32:21.073 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_query", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger query container image", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_keepalived": { 2024-09-16T07:32:21.074 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_keepalived", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Keepalived container image", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_loki": { 2024-09-16T07:32:21.075 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_loki", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Loki container image", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.076 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_nginx": { 2024-09-16T07:32:21.077 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_nginx", 2024-09-16T07:32:21.077 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.077 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.077 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.077 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-16T07:32:21.077 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.077 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Nginx container image", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_node_exporter": { 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_node_exporter", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.078 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_nvmeof": { 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_nvmeof", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.079 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Nvme-of container image", 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_oauth2_proxy": { 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_oauth2_proxy", 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-16T07:32:21.080 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "oauth2-proxy container image", 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_prometheus": { 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_prometheus", 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.081 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_promtail": { 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_promtail", 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.082 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Promtail container image", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_samba": { 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_samba", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.083 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Samba/SMB container image", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_samba_metrics": { 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_samba_metrics", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.084 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_snmp_gateway": { 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_snmp_gateway", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.085 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SNMP Gateway container image", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "container_init": { 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_init", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.086 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "daemon_cache_timeout": { 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "daemon_cache_timeout", 2024-09-16T07:32:21.087 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "default_cephadm_command_timeout": { 2024-09-16T07:32:21.088 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "900", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "default_registry": { 2024-09-16T07:32:21.089 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_registry", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "device_cache_timeout": { 2024-09-16T07:32:21.090 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_cache_timeout", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1800", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache device inventory", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "device_enhanced_scan": { 2024-09-16T07:32:21.091 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_enhanced_scan", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.092 INFO:teuthology.orchestra.run.smithi114.stdout: "facts_cache_timeout": { 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "facts_cache_timeout", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache host facts data", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.093 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "grafana_dashboards_path": { 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "grafana_dashboards_path", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.094 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "host_check_interval": { 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "host_check_interval", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to perform a host check", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.095 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "hw_monitoring": { 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "hw_monitoring", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.096 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "inventory_list_all": { 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "inventory_list_all", 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T07:32:21.097 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.098 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "log_refresh_metadata": { 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_refresh_metadata", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.099 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.100 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.101 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.102 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.103 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T07:32:21.104 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "*", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T07:32:21.105 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "max_count_per_host": { 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_count_per_host", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of daemons per service per host", 2024-09-16T07:32:21.106 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "max_osd_draining_count": { 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_osd_draining_count", 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.107 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "migration_current": { 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "migration_current", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.108 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "internal - do not modify", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "root", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.109 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm-package", 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "root" 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "oob_default_addr": { 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "oob_default_addr", 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.110 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "169.254.1.1", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "prometheus_alerts_path": { 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus_alerts_path", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.111 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_insecure": { 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_insecure", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.112 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_password": { 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_password", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.113 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_url": { 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_url", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.114 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_username": { 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_username", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.115 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "secure_monitoring_stack": { 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "secure_monitoring_stack", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.116 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "service_discovery_port": { 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "service_discovery_port", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.117 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8765", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "cephadm service discovery port", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.118 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_config_file": { 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_config_file", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.119 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_keepalive_count_max": { 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_keepalive_count_max", 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.120 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_keepalive_interval": { 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_keepalive_interval", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.121 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7", 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "use_agent": { 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_agent", 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.122 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "use_repo_digest": { 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_repo_digest", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.123 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_failed_host_check": { 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_failed_host_check", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.124 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_daemons": { 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_daemons", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.125 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_hosts": { 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_hosts", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.126 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crash", 2024-09-16T07:32:21.127 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.128 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.129 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.131 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "retain_interval": { 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retain_interval", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "31536000", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.133 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.134 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_recent_interval": { 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_recent_interval", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1209600", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.135 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dashboard", 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T07:32:21.136 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T07:32:21.137 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T07:32:21.138 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_ENABLED": { 2024-09-16T07:32:21.139 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T07:32:21.140 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T07:32:21.141 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T07:32:21.142 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T07:32:21.143 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T07:32:21.144 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T07:32:21.145 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T07:32:21.146 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T07:32:21.147 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.148 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.149 INFO:teuthology.orchestra.run.smithi114.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.150 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.151 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.152 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_URL": { 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_URL", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.153 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.154 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T07:32:21.155 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.156 INFO:teuthology.orchestra.run.smithi114.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.157 INFO:teuthology.orchestra.run.smithi114.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-16T07:32:21.158 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "[]", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: "MULTICLUSTER_CONFIG": { 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "{}", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.162 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.163 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.164 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.165 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.166 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.167 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.168 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.169 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.173 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "45", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.174 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.175 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.176 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.177 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.178 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "UNSAFE_TLS_v1_2": { 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.179 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.180 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.181 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.182 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "cross_origin_url": { 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cross_origin_url", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.183 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "crt_file": { 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crt_file", 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.184 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "debug": { 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "debug", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable/disable debug options", 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "jwt_token_ttl": { 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "jwt_token_ttl", 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "28800", 2024-09-16T07:32:21.186 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.187 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.188 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.189 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.190 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.191 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.192 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "motd": { 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "motd", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.193 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "The message of the day", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect_resolve_ip_addr": { 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.194 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.195 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2024-09-16T07:32:21.196 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8080", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.197 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2024-09-16T07:32:21.198 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl_server_port": { 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl_server_port", 2024-09-16T07:32:21.199 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8443", 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.200 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "redirect", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect" 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.201 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.202 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "url_prefix": { 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url_prefix", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.203 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "devicehealth", 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_monitoring": { 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_monitoring", 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.204 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "monitor device health metrics", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.205 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.206 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.207 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.208 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.209 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "mark_out_threshold": { 2024-09-16T07:32:21.210 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mark_out_threshold", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2419200", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.211 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_name": { 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_name", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "device_health_metrics", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.212 INFO:teuthology.orchestra.run.smithi114.stdout: "retention_period": { 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retention_period", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15552000", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain device health metrics", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.213 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_frequency": { 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_frequency", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.214 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "self_heal": { 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "self_heal", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.215 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.216 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.217 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_threshold": { 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_threshold", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7257600", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.218 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "diskprediction_local", 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.219 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.220 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.221 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.222 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.223 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "predict_interval": { 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predict_interval", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.224 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "predictor_model": { 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predictor_model", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.225 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "prophetstor", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.226 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.227 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.228 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "influx", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": false, 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "influxdb python module not found", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "batch_size": { 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "batch_size", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5000", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.229 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "database": { 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "database", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "ceph", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.230 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": { 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "hostname", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server hostname", 2024-09-16T07:32:21.231 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "30", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "5", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T07:32:21.232 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.233 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.234 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.235 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.236 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.237 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "password": { 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "password", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "password of InfluxDB server user", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.238 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "port": { 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "port", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8086", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server port", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.239 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.240 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "false", 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.241 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "threads": { 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threads", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "32", 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.242 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "username": { 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "username", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.243 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "username of InfluxDB server user", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "verify_ssl": { 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "verify_ssl", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "true", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.244 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "insights", 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.245 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.246 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.247 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.248 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.249 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.250 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "iostat", 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.252 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.253 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.255 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.256 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.257 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.258 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "localpool", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "failure_domain": { 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "failure_domain", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "host", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.259 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "failure domain for any created local pool", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.260 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.261 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.262 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.263 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.264 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "min_size": { 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_size", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.265 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default min_size for any created local pool", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "num_rep": { 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "num_rep", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.266 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default replica count for any created local pool", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_num": { 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_num", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "128", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.267 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "prefix": { 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prefix", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.268 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name prefix for any created local pool", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.269 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "subtree": { 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "subtree", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "rack", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.270 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirroring", 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.271 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.272 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.273 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.274 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.275 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.276 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.277 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "nfs", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.278 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.279 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.280 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.281 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.282 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.283 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.284 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "fail_fs": { 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "fail_fs", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.285 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.288 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.289 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.290 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.291 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.292 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator": { 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.293 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm", 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "rook", 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "test_orchestrator" 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Orchestrator backend", 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.294 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.295 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_perf_query", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.296 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.298 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.299 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.300 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.301 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_support", 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.302 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.303 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.304 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.305 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.306 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.307 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.308 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_autoscaler", 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.309 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.310 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.311 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.312 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.313 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.314 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.315 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "threshold": { 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threshold", 2024-09-16T07:32:21.316 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1.0", 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "scaling threshold", 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.317 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "progress", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_pg_recovery_event": { 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_pg_recovery_event", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.318 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.319 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.320 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.321 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.322 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.323 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.324 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "max_completed_events": { 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_completed_events", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "50", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.325 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "number of past completed events to remember", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.326 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long the module is going to sleep", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.327 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus", 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "cache": { 2024-09-16T07:32:21.328 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cache", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.329 INFO:teuthology.orchestra.run.smithi114.stdout: "exclude_perf_counters": { 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "exclude_perf_counters", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.330 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.331 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.332 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.333 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.335 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools": { 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.336 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.337 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_interval": { 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_interval", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15.0", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.338 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.339 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "9283", 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.340 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "stale_cache_strategy": { 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stale_cache_strategy", 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "log", 2024-09-16T07:32:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.343 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "default", 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "default", 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "error" 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2024-09-16T07:32:21.344 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.345 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_support", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.346 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.347 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.348 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.349 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.350 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_snap_create": { 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_snap_create", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.351 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "mirror_snapshot_schedule": { 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.352 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.353 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "trash_purge_schedule": { 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "trash_purge_schedule", 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.354 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.355 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "restful", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_auth": { 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_auth", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.356 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.357 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.358 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.359 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.360 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.361 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.362 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "max_requests": { 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_requests", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2024-09-16T07:32:21.363 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.364 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.365 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.366 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rgw", 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.367 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.368 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.369 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.370 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.371 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.372 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.373 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.374 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "selftest", 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.375 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.376 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.377 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.378 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.379 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.380 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "roption1": { 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption1", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.381 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "roption2": { 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption2", 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "xyz", 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.382 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption1": { 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption1", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.383 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption2": { 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption2", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.384 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption3": { 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption3", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.385 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption4": { 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption4", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.386 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption5": { 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption5", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption6": { 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption6", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.388 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption7": { 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption7", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "42", 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.389 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.390 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "testkey": { 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testkey", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.391 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "testlkey": { 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testlkey", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.392 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "testnewline": { 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testnewline", 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.393 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snap_schedule", 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.394 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_m_granularity": { 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_m_granularity", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.395 INFO:teuthology.orchestra.run.smithi114.stdout: "dump_on_update": { 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dump_on_update", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "dump database to debug log on update", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.396 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.397 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.398 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.399 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.400 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.401 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.402 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stats", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.403 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.404 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.405 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.406 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.407 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.408 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "status", 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.409 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.410 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.411 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.412 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.413 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.414 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.415 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telegraf", 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "address": { 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "address", 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T07:32:21.416 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15", 2024-09-16T07:32:21.417 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.418 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.419 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.420 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.421 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.422 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.423 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.424 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telemetry", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_basic": { 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_basic", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.425 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_crash": { 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_crash", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.426 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_device": { 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_device", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.427 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_ident": { 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_ident", 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.428 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_perf": { 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_perf", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.429 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "contact": { 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "contact", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.430 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "description": { 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "description", 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.431 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "device_url": { 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_url", 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.432 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.433 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.434 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "24", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "8", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "last_opt_revision": { 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "last_opt_revision", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.435 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard": { 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.436 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard_description": { 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard_description", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.437 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.438 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.439 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.440 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.441 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.442 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "organization": { 2024-09-16T07:32:21.443 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "organization", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.444 INFO:teuthology.orchestra.run.smithi114.stdout: "proxy": { 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "proxy", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.445 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.446 INFO:teuthology.orchestra.run.smithi114.stdout: "url": { 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.447 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "test_orchestrator", 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.448 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.449 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.450 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.451 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.452 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.453 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.454 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.455 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.456 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.457 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.458 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.459 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_clones": { 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_clones", 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4", 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.460 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "periodic_async_work": { 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "periodic_async_work", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.461 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Periodically check for async work", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot_clone_delay": { 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snapshot_clone_delay", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.462 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot_clone_no_wait": { 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.463 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.464 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix", 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.465 INFO:teuthology.orchestra.run.smithi114.stdout: "discovery_interval": { 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "discovery_interval", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "100", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.466 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "identifier": { 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "identifier", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.467 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.468 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.469 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.470 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.471 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.472 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.473 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.474 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_host": { 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_host", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.475 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_port": { 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_port", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10051", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.476 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_sender": { 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_sender", 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.477 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: "modules": [ 2024-09-16T07:32:21.478 INFO:teuthology.orchestra.run.smithi114.stdout: "iostat", 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "nfs", 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "restful" 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "available_modules": [ 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "alerts", 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.479 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.480 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.481 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.483 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.484 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.485 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_destination": { 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_destination", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.486 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_from_name": { 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_from_name", 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "Ceph", 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Email From: name", 2024-09-16T07:32:21.487 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_host": { 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_host", 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.488 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP server", 2024-09-16T07:32:21.489 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.489 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.489 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_password": { 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_password", 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.492 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Password to authenticate with", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_port": { 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_port", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "465", 2024-09-16T07:32:21.493 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP port", 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_sender": { 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_sender", 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.494 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SMTP envelope sender", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_ssl": { 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_ssl", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.495 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "smtp_user": { 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "smtp_user", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.496 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "User to authenticate as", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.497 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "balancer", 2024-09-16T07:32:21.498 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "active": { 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "active", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T07:32:21.499 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_time": { 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_time", 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0000", 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.500 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "begin_weekday": { 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "begin_weekday", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.501 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_max_iterations": { 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_max_iterations", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "25", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "250", 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.502 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_metrics": { 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_metrics", 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.503 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "crush_compat_step": { 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crush_compat_step", 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.5", 2024-09-16T07:32:21.504 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0.001", 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "0.999", 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "aggressiveness of optimization", 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "end_time": { 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_time", 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.505 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2359", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "end_weekday": { 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "end_weekday", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.506 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "0", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "6", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.507 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.508 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.509 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.510 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.511 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "min_score": { 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_score", 2024-09-16T07:32:21.512 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2024-09-16T07:32:21.513 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "upmap", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "crush-compat", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "none", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "read", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap", 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap-read" 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.514 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Balancer mode", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_ids": { 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_ids", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.515 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.516 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.517 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_deviation": { 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_deviation", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.518 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "upmap_max_optimizations": { 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "upmap_max_optimizations", 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.519 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm", 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.520 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_down_multiplier": { 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_down_multiplier", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.521 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_refresh_rate": { 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_refresh_rate", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "20", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.522 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "agent_starting_port": { 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "agent_starting_port", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4721", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.523 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_ptrace": { 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_ptrace", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.524 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_interval": { 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_interval", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.525 INFO:teuthology.orchestra.run.smithi114.stdout: "autotune_memory_target_ratio": { 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0.7", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.526 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm_log_destination": { 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephadm_log_destination", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "file", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "file,syslog", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "syslog" 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T07:32:21.527 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "cgroups_split": { 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cgroups_split", 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.528 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "config_checks_enabled": { 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_checks_enabled", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.529 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "config_dashboard": { 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "config_dashboard", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.530 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_alertmanager": { 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_alertmanager", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.531 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_base": { 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_base", 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.532 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Container image name, without the tag", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_elasticsearch": { 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_elasticsearch", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.533 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "elasticsearch container image", 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_grafana": { 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_grafana", 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-16T07:32:21.534 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_haproxy": { 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_haproxy", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T07:32:21.535 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "HAproxy container image", 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_agent": { 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_agent", 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.536 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger agent container image", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_collector": { 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_collector", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.537 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger collector container image", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_jaeger_query": { 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_jaeger_query", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.538 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Jaeger query container image", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_keepalived": { 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_keepalived", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.539 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Keepalived container image", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_loki": { 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_loki", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.540 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Loki container image", 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_nginx": { 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_nginx", 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.541 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Nginx container image", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_node_exporter": { 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_node_exporter", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.542 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_nvmeof": { 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_nvmeof", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.543 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Nvme-of container image", 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_oauth2_proxy": { 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_oauth2_proxy", 2024-09-16T07:32:21.544 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "oauth2-proxy container image", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_prometheus": { 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_prometheus", 2024-09-16T07:32:21.545 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Prometheus container image", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_promtail": { 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_promtail", 2024-09-16T07:32:21.546 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Promtail container image", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_samba": { 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_samba", 2024-09-16T07:32:21.547 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Samba/SMB container image", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_samba_metrics": { 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_samba_metrics", 2024-09-16T07:32:21.548 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "container_image_snmp_gateway": { 2024-09-16T07:32:21.549 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_image_snmp_gateway", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "SNMP Gateway container image", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.550 INFO:teuthology.orchestra.run.smithi114.stdout: "container_init": { 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "container_init", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.551 INFO:teuthology.orchestra.run.smithi114.stdout: "daemon_cache_timeout": { 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "daemon_cache_timeout", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.552 INFO:teuthology.orchestra.run.smithi114.stdout: "default_cephadm_command_timeout": { 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "900", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.553 INFO:teuthology.orchestra.run.smithi114.stdout: "default_registry": { 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "default_registry", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "docker.io", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.554 INFO:teuthology.orchestra.run.smithi114.stdout: "device_cache_timeout": { 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_cache_timeout", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1800", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache device inventory", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.555 INFO:teuthology.orchestra.run.smithi114.stdout: "device_enhanced_scan": { 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_enhanced_scan", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.556 INFO:teuthology.orchestra.run.smithi114.stdout: "facts_cache_timeout": { 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "facts_cache_timeout", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "seconds to cache host facts data", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.557 INFO:teuthology.orchestra.run.smithi114.stdout: "grafana_dashboards_path": { 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "grafana_dashboards_path", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.558 INFO:teuthology.orchestra.run.smithi114.stdout: "host_check_interval": { 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "host_check_interval", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to perform a host check", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.559 INFO:teuthology.orchestra.run.smithi114.stdout: "hw_monitoring": { 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "hw_monitoring", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.560 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "inventory_list_all": { 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "inventory_list_all", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.561 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.562 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "log_refresh_metadata": { 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_refresh_metadata", 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.563 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.564 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.565 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.566 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.567 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T07:32:21.568 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "*", 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.569 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "max_count_per_host": { 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_count_per_host", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.570 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of daemons per service per host", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "max_osd_draining_count": { 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_osd_draining_count", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.571 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "migration_current": { 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "migration_current", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.572 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "internal - do not modify", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": { 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mode", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "root", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.573 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm-package", 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "root" 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "oob_default_addr": { 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "oob_default_addr", 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.574 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "169.254.1.1", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "prometheus_alerts_path": { 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus_alerts_path", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.575 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_insecure": { 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_insecure", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.576 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_password": { 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_password", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.577 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_url": { 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_url", 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.578 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "registry_username": { 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "registry_username", 2024-09-16T07:32:21.579 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "secure_monitoring_stack": { 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "secure_monitoring_stack", 2024-09-16T07:32:21.580 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.581 INFO:teuthology.orchestra.run.smithi114.stdout: "service_discovery_port": { 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "service_discovery_port", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8765", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "cephadm service discovery port", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.582 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.583 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_config_file": { 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_config_file", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.584 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_keepalive_count_max": { 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_keepalive_count_max", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.585 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "ssh_keepalive_interval": { 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssh_keepalive_interval", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.586 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "use_agent": { 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_agent", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.587 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "use_repo_digest": { 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "use_repo_digest", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.588 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_failed_host_check": { 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_failed_host_check", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.589 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_daemons": { 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_daemons", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.590 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_on_stray_hosts": { 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_on_stray_hosts", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.591 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crash", 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.592 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.593 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.594 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.595 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.596 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "retain_interval": { 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retain_interval", 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.597 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "31536000", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.598 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_recent_interval": { 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_recent_interval", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1209600", 2024-09-16T07:32:21.599 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dashboard", 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.600 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.601 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.602 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.603 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_ENABLED": { 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.604 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.605 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.606 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.607 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.608 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.609 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.610 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.611 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.612 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.613 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.614 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.615 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.616 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_URL": { 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_URL", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.617 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.618 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.619 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.620 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.621 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.622 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "[]", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "MULTICLUSTER_CONFIG": { 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "{}", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.625 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.626 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.627 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.628 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.629 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.630 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.631 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.632 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.633 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.634 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.635 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.636 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T07:32:21.637 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T07:32:21.638 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "45", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T07:32:21.639 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T07:32:21.640 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "admin", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T07:32:21.641 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T07:32:21.642 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "UNSAFE_TLS_v1_2": { 2024-09-16T07:32:21.643 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.644 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.645 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.646 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.647 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "cross_origin_url": { 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cross_origin_url", 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.648 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "crt_file": { 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "crt_file", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.649 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "debug": { 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "debug", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.650 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Enable/disable debug options", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "jwt_token_ttl": { 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "jwt_token_ttl", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "28800", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.651 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.652 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.653 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.654 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.655 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.656 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.657 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "motd": { 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "motd", 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.658 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "The message of the day", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect_resolve_ip_addr": { 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.659 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2024-09-16T07:32:21.660 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.661 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8080", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.662 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.663 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl_server_port": { 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl_server_port", 2024-09-16T07:32:21.664 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8443", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2024-09-16T07:32:21.665 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "redirect", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "redirect" 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.666 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "url_prefix": { 2024-09-16T07:32:21.667 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url_prefix", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "devicehealth", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_monitoring": { 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_monitoring", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.669 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "monitor device health metrics", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.670 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.671 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.672 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.673 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.674 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "mark_out_threshold": { 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mark_out_threshold", 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.675 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "2419200", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_name": { 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pool_name", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.676 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "device_health_metrics", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "retention_period": { 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "retention_period", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.677 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15552000", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long to retain device health metrics", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_frequency": { 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_frequency", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.678 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "self_heal": { 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "self_heal", 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.679 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.680 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.681 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "warn_threshold": { 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "warn_threshold", 2024-09-16T07:32:21.682 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "7257600", 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.683 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "diskprediction_local", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.684 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.685 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.686 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.687 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.688 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "predict_interval": { 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predict_interval", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "86400", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.689 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "predictor_model": { 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "predictor_model", 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "prophetstor", 2024-09-16T07:32:21.690 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "600", 2024-09-16T07:32:21.691 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.692 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "influx", 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": false, 2024-09-16T07:32:21.693 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "influxdb python module not found", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "batch_size": { 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "batch_size", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5000", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.694 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "database": { 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "database", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "ceph", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.695 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": { 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "hostname", 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server hostname", 2024-09-16T07:32:21.696 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.697 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.697 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.697 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.697 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.700 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.700 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.700 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.700 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.700 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "30", 2024-09-16T07:32:21.700 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "5", 2024-09-16T07:32:21.700 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.701 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.702 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.703 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.704 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.705 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "password": { 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "password", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.706 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "password of InfluxDB server user", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "port": { 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "port", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "8086", 2024-09-16T07:32:21.707 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "InfluxDB server port", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.708 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "ssl": { 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "ssl", 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.709 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "false", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "threads": { 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threads", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.710 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "32", 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "username": { 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "username", 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.711 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "username of InfluxDB server user", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "verify_ssl": { 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "verify_ssl", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.712 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "true", 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.713 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "insights", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.714 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.715 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.717 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.718 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.719 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.720 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "iostat", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.721 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.722 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.723 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.724 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.725 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.726 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "localpool", 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "failure_domain": { 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "failure_domain", 2024-09-16T07:32:21.727 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "host", 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "failure domain for any created local pool", 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.730 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.731 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.732 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.733 INFO:teuthology.orchestra.run.smithi114.stdout: "min_size": { 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "min_size", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default min_size for any created local pool", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.734 INFO:teuthology.orchestra.run.smithi114.stdout: "num_rep": { 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "num_rep", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default replica count for any created local pool", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.735 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_num": { 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_num", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "128", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.736 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "prefix": { 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prefix", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "name prefix for any created local pool", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.737 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.738 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "subtree": { 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "subtree", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "rack", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.739 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirroring", 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.740 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.741 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.742 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.743 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.744 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.745 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.746 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "nfs", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.747 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.748 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.749 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.750 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.751 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.752 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2024-09-16T07:32:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "fail_fs": { 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "fail_fs", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.754 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.755 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.756 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.757 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.758 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.759 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator": { 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "orchestrator", 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.760 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "cephadm", 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "rook", 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "test_orchestrator" 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Orchestrator backend", 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.761 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.762 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_perf_query", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.763 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.764 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.765 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.766 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.767 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.768 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.769 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "osd_support", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.770 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.771 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.772 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.773 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.774 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.775 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "pg_autoscaler", 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.776 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.777 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.778 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.779 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.780 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.781 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.782 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "threshold": { 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "threshold", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.783 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "3.0", 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1.0", 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "scaling threshold", 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.784 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "progress", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_pg_recovery_event": { 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_pg_recovery_event", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T07:32:21.785 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.786 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.787 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.788 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.789 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.790 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.791 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "max_completed_events": { 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_completed_events", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "50", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.792 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "number of past completed events to remember", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "sleep_interval": { 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sleep_interval", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.793 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "how long the module is going to sleep", 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.794 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "prometheus", 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.795 INFO:teuthology.orchestra.run.smithi114.stdout: "cache": { 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cache", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.796 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "exclude_perf_counters": { 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "exclude_perf_counters", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.797 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.798 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.799 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.800 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.801 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.802 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools": { 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools", 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.803 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "300", 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.804 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "scrape_interval": { 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "scrape_interval", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15.0", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.805 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "::", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.806 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "9283", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.807 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.808 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "stale_cache_strategy": { 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stale_cache_strategy", 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "log", 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.809 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_behaviour": { 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_behaviour", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "default", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "default", 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "error" 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "standby_error_status_code": { 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "standby_error_status_code", 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.811 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "400", 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "599", 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_support", 2024-09-16T07:32:21.812 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.813 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.814 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.815 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.816 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.817 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_snap_create": { 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_snap_create", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.818 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "mirror_snapshot_schedule": { 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.819 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.820 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "trash_purge_schedule": { 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "trash_purge_schedule", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.821 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "restful", 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "enable_auth": { 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enable_auth", 2024-09-16T07:32:21.822 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "key_file": { 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "key_file", 2024-09-16T07:32:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "max_requests": { 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_requests", 2024-09-16T07:32:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "500", 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "server_addr": { 2024-09-16T07:32:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_addr", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "server_port": { 2024-09-16T07:32:21.831 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "server_port", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.832 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.833 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rgw", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.834 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.835 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.836 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.837 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.838 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "5", 2024-09-16T07:32:21.839 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.840 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "selftest", 2024-09-16T07:32:21.841 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.842 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.843 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.844 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.845 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.846 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "roption1": { 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption1", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.847 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "roption2": { 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "roption2", 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "xyz", 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.848 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption1": { 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption1", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.849 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption2": { 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption2", 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.850 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption3": { 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption3", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "float", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.851 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption4": { 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption4", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.852 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption5": { 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption5", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.853 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption6": { 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption6", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.854 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "rwoption7": { 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rwoption7", 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "1", 2024-09-16T07:32:21.855 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "42", 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.856 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "testkey": { 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testkey", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.857 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "testlkey": { 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testlkey", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.858 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "testnewline": { 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "testnewline", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.859 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snap_schedule", 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.860 INFO:teuthology.orchestra.run.smithi114.stdout: "allow_m_granularity": { 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "allow_m_granularity", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.861 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "dump_on_update": { 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "dump_on_update", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "dump database to debug log on update", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.862 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.863 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.864 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.865 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.866 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.867 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.868 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "stats", 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.869 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.870 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.871 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.872 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.873 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.874 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "status", 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.875 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.876 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.878 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.879 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.880 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.881 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telegraf", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "address": { 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "address", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.882 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "15", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.883 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.884 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.885 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.886 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.887 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.888 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.889 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "telemetry", 2024-09-16T07:32:21.890 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_basic": { 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_basic", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.891 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_crash": { 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_crash", 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T07:32:21.892 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_device": { 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_device", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T07:32:21.893 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_ident": { 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_ident", 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.894 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "channel_perf": { 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "channel_perf", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.895 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "contact": { 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "contact", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.896 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "description": { 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "description", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.897 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "device_url": { 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "device_url", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.898 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "enabled": { 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "enabled", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.899 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "24", 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "8", 2024-09-16T07:32:21.900 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "last_opt_revision": { 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "last_opt_revision", 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "1", 2024-09-16T07:32:21.901 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard": { 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.902 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.903 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.904 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.904 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.904 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.904 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.904 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.904 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.904 INFO:teuthology.orchestra.run.smithi114.stdout: "leaderboard_description": { 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "leaderboard_description", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.905 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.906 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.907 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.908 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.909 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.910 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "organization": { 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "organization", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.911 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "proxy": { 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "proxy", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.912 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.913 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "url": { 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "url", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.914 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "test_orchestrator", 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.915 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.916 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.917 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.918 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.919 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.920 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.921 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.922 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.923 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.924 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.925 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.926 INFO:teuthology.orchestra.run.smithi114.stdout: "max_concurrent_clones": { 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "max_concurrent_clones", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "4", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "periodic_async_work": { 2024-09-16T07:32:21.927 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "periodic_async_work", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Periodically check for async work", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.928 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot_clone_delay": { 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snapshot_clone_delay", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.929 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot_clone_no_wait": { 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "True", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.930 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.931 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix", 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "can_run": true, 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "error_string": "", 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "module_options": { 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "discovery_interval": { 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "discovery_interval", 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "uint", 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.932 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "100", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "identifier": { 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "identifier", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.933 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "interval": { 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "interval", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "secs", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.934 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "60", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "log_level": { 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_level", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.935 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.936 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster": { 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.937 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_cluster_level": { 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_cluster_level", 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "info", 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [ 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "", 2024-09-16T07:32:21.938 INFO:teuthology.orchestra.run.smithi114.stdout: "critical", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "debug", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "error", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "info", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "warning" 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "log_to_file": { 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "log_to_file", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "bool", 2024-09-16T07:32:21.939 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "False", 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "sqlite3_killpoint": { 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "sqlite3_killpoint", 2024-09-16T07:32:21.940 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "dev", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 1, 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "0", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_host": { 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_host", 2024-09-16T07:32:21.941 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_port": { 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_port", 2024-09-16T07:32:21.942 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "int", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "10051", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "zabbix_sender": { 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "zabbix_sender", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "str", 2024-09-16T07:32:21.943 INFO:teuthology.orchestra.run.smithi114.stdout: "level": "advanced", 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "flags": 0, 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "min": "", 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "max": "", 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "enum_allowed": [], 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "desc": "", 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "long_desc": "", 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "tags": [], 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "see_also": [] 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.944 INFO:teuthology.orchestra.run.smithi114.stdout: "services": {}, 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "always_on_modules": { 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "octopus": [ 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "pacific": [ 2024-09-16T07:32:21.945 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "quincy": [ 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2024-09-16T07:32:21.946 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "reef": [ 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2024-09-16T07:32:21.947 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "squid": [ 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "balancer", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "crash", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "devicehealth", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "orchestrator", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "pg_autoscaler", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "progress", 2024-09-16T07:32:21.948 INFO:teuthology.orchestra.run.smithi114.stdout: "rbd_support", 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "status", 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "telemetry", 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "volumes" 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "last_failure_osd_epoch": 0, 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "active_clients": [ 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "devicehealth", 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.949 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 4119429621 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "libcephsqlite", 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 582884511 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.950 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "rbd_support", 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2751300545 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.951 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 780559649 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.952 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 1675603639 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 4201783238 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.953 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2583562273 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.954 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 626953 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2006694112 2024-09-16T07:32:21.955 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "volumes", 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v2", 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.149:0", 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2277496221 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:21.956 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:32:21.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9518073190 msgr2=0x7f9518075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:21.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9518073190 0x7f9518075650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f95240b0000 tx=0x7f952401c3a0 comp rx=0 tx=0).stop 2024-09-16T07:32:21.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380b4880 msgr2=0x7f95381648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:21.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380b4880 0x7f95381648e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f952c0058d0 tx=0x7f952c00dde0 comp rx=0 tx=0).stop 2024-09-16T07:32:21.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 shutdown_connections 2024-09-16T07:32:21.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f9518073190 0x7f9518075650 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:21.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f953815db50 0x7f95381465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:21.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95380cd100 0x7f95380b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:21.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 --2- 172.21.15.114:0/1279795195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380b4880 0x7f95381648e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:21.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 >> 172.21.15.114:0/1279795195 conn(0x7f95380b18f0 msgr2=0x7f9538072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:21.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 shutdown_connections 2024-09-16T07:32:21.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:21.007+0000 7f9540400640 1 -- 172.21.15.114:0/1279795195 wait complete. 2024-09-16T07:32:21.963 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr fail x 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 -- 172.21.15.114:0/284382467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cfbe0 msgr2=0x7f2f700d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 --2- 172.21.15.114:0/284382467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cfbe0 0x7f2f700d09d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009840 tx=0x7f2f5801c7b0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 -- 172.21.15.114:0/284382467 shutdown_connections 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 --2- 172.21.15.114:0/284382467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cfbe0 0x7f2f700d09d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 --2- 172.21.15.114:0/284382467 >> v2:172.21.15.149:3300/0 conn(0x7f2f700cf800 0x7f2f7015f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 -- 172.21.15.114:0/284382467 >> 172.21.15.114:0/284382467 conn(0x7f2f70073490 msgr2=0x7f2f700d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 -- 172.21.15.114:0/284382467 shutdown_connections 2024-09-16T07:32:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.107+0000 7f2f76000640 1 -- 172.21.15.114:0/284382467 wait complete. 2024-09-16T07:32:22.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 Processor -- start 2024-09-16T07:32:22.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 -- start start 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cf800 0x7f2f7015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f700cfbe0 0x7f2f70099650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f700d0f10 0x7f2f700b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70155850 con 0x7f2f700cf800 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70075140 con 0x7f2f700d0f10 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f701559d0 con 0x7f2f700cfbe0 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cf800 0x7f2f7015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cf800 0x7f2f7015afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41762/0 (socket says 172.21.15.114:41762) 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 -- 172.21.15.114:0/1774093785 learned_addr learned my addr 172.21.15.114:0/1774093785 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f67e00640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f700cfbe0 0x7f2f70099650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f75600640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f700d0f10 0x7f2f700b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 -- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f700cfbe0 msgr2=0x7f2f70099650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f700cfbe0 0x7f2f70099650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 -- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f700d0f10 msgr2=0x7f2f700b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f700d0f10 0x7f2f700b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 -- 172.21.15.114:0/1774093785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7015bd30 con 0x7f2f700cf800 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f75600640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f700d0f10 0x7f2f700b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f67e00640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f700cfbe0 0x7f2f70099650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f74c00640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cf800 0x7f2f7015afa0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000d950 tx=0x7f2f6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60017070 con 0x7f2f700cf800 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f60009d20 con 0x7f2f700cf800 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f600106c0 con 0x7f2f700cf800 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7015a4c0 con 0x7f2f700cf800 2024-09-16T07:32:22.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.111+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7015aa80 con 0x7f2f700cf800 2024-09-16T07:32:22.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.115+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f700d09d0 con 0x7f2f700cf800 2024-09-16T07:32:22.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.115+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 12) ==== 97437+0+0 (secure 0 0 0) 0x7f2f60010860 con 0x7f2f700cf800 2024-09-16T07:32:22.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.115+0000 7f2f6d600640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f4c0732e0 0x7f2f4c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:22.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.115+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f2f60094a80 con 0x7f2f700cf800 2024-09-16T07:32:22.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.115+0000 7f2f67e00640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f4c0732e0 0x7f2f4c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:22.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.115+0000 7f2f67e00640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f4c0732e0 0x7f2f4c0757a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f580af000 tx=0x7f2f5801aff0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:22.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.119+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2f6005f5a0 con 0x7f2f700cf800 2024-09-16T07:32:22.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.327+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr fail", "who": "x"} v 0) -- 0x7f2f7015b530 con 0x7f2f700cf800 2024-09-16T07:32:22.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.331+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr fail", "who": "x"}]=0 v13) ==== 68+0+0 (secure 0 0 0) 0x7f2f6005eea0 con 0x7f2f700cf800 2024-09-16T07:32:22.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mgrmap(e 13) ==== 48578+0+0 (secure 0 0 0) 0x7f2f6005b110 con 0x7f2f700cf800 2024-09-16T07:32:22.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f6d600640 1 -- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f4c0732e0 msgr2=0x7f2f4c0757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f6d600640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f4c0732e0 0x7f2f4c0757a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f580af000 tx=0x7f2f5801aff0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cf800 msgr2=0x7f2f7015afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cf800 0x7f2f7015afa0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000d950 tx=0x7f2f6000de10 comp rx=0 tx=0).stop 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 shutdown_connections 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:6800/921426846,v1:172.21.15.149:6801/921426846] conn(0x7f2f4c0732e0 0x7f2f4c0757a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f700d0f10 0x7f2f700b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f700cfbe0 0x7f2f70099650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 --2- 172.21.15.114:0/1774093785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f700cf800 0x7f2f7015afa0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 >> 172.21.15.114:0/1774093785 conn(0x7f2f70073490 msgr2=0x7f2f701532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 shutdown_connections 2024-09-16T07:32:22.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.335+0000 7f2f76000640 1 -- 172.21.15.114:0/1774093785 wait complete. 2024-09-16T07:32:22.335 INFO:tasks.ceph.mgr.x.smithi149.stderr:2024-09-16T07:32:22.331+0000 7f18aac00640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-16T07:32:22.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:22.446 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.446 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.446 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.446 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.446 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.447 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.447 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.447 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.447 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.447 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:32:22.447+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:32:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 -- 172.21.15.114:0/1236767646 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7940cebf0 msgr2=0x7fa7940cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 --2- 172.21.15.114:0/1236767646 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7940cebf0 0x7fa7940cc8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa780009870 tx=0x7fa78001c780 comp rx=0 tx=0).stop 2024-09-16T07:32:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 -- 172.21.15.114:0/1236767646 shutdown_connections 2024-09-16T07:32:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 --2- 172.21.15.114:0/1236767646 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7940cebf0 0x7fa7940cc8b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 -- 172.21.15.114:0/1236767646 >> 172.21.15.114:0/1236767646 conn(0x7fa7940d1da0 msgr2=0x7fa7940d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 -- 172.21.15.114:0/1236767646 shutdown_connections 2024-09-16T07:32:22.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 -- 172.21.15.114:0/1236767646 wait complete. 2024-09-16T07:32:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 Processor -- start 2024-09-16T07:32:22.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.543+0000 7fa79ae00640 1 -- start start 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7940b6400 0x7fa79406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7940cebf0 0x7fa7941fb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa79415be80 0x7fa794167260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa79416a2c0 con 0x7fa7940cebf0 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa79416a140 con 0x7fa7940b6400 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa79416a440 con 0x7fa79415be80 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7940cebf0 0x7fa7941fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:22.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7940cebf0 0x7fa7941fb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41882/0 (socket says 172.21.15.114:41882) 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 -- 172.21.15.114:0/124013506 learned_addr learned my addr 172.21.15.114:0/124013506 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793e00640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7940b6400 0x7fa79406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa798e00640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa79415be80 0x7fa794167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 -- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa79415be80 msgr2=0x7fa794167260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa79415be80 0x7fa794167260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 -- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7940b6400 msgr2=0x7fa79406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7940b6400 0x7fa79406f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 -- 172.21.15.114:0/124013506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa794070e90 con 0x7fa7940cebf0 2024-09-16T07:32:22.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa793400640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7940cebf0 0x7fa7941fb230 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa78001a3b0 tx=0x7fa780005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa78be00640 1 -- 172.21.15.114:0/124013506 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800a78d0 con 0x7fa7940cebf0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa78be00640 1 -- 172.21.15.114:0/124013506 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7800a7b60 con 0x7fa7940cebf0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa78be00640 1 -- 172.21.15.114:0/124013506 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780003600 con 0x7fa7940cebf0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7941fba60 con 0x7fa7940cebf0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7941fc020 con 0x7fa7940cebf0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa78be00640 1 -- 172.21.15.114:0/124013506 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 13) ==== 48578+0+0 (secure 0 0 0) 0x7fa7800c2020 con 0x7fa7940cebf0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7940ce4e0 con 0x7fa7940cebf0 2024-09-16T07:32:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.547+0000 7fa78be00640 1 -- 172.21.15.114:0/124013506 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7fa7800eaa20 con 0x7fa7940cebf0 2024-09-16T07:32:22.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.555+0000 7fa78be00640 1 -- 172.21.15.114:0/124013506 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa780016370 con 0x7fa7940cebf0 2024-09-16T07:32:22.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.755+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7940c55e0 con 0x7fa7940cebf0 2024-09-16T07:32:22.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.755+0000 7fa78be00640 1 -- 172.21.15.114:0/124013506 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7fa7800aeca0 con 0x7fa7940cebf0 2024-09-16T07:32:22.755 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:22.755 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"btime":"2024-09-16T07:32:17:332311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:22.755 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-09-16T07:32:22.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7940cebf0 msgr2=0x7fa7941fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:22.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7940cebf0 0x7fa7941fb230 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa78001a3b0 tx=0x7fa780005ca0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 shutdown_connections 2024-09-16T07:32:22.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa79415be80 0x7fa794167260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7940cebf0 0x7fa7941fb230 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 --2- 172.21.15.114:0/124013506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7940b6400 0x7fa79406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:22.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 >> 172.21.15.114:0/124013506 conn(0x7fa7940d1da0 msgr2=0x7fa7940b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:22.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 shutdown_connections 2024-09-16T07:32:22.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:22.759+0000 7fa79ae00640 1 -- 172.21.15.114:0/124013506 wait complete. 2024-09-16T07:32:22.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T07:32:22.934 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":6169,"entity":{"name":{"type":"client","num":6169},"addr":{"type":"any","addr":"172.21.15.114:0","nonce":253377976}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.46799448599999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9978755028591169,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6169 172.21.15.114:0/253377976","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"y","hostname":"smithi114","pid":"28912","root":"/"}},{"id":5666,"entity":{"name":{"type":"client","num":5666},"addr":{"type":"any","addr":"172.21.15.114:0","nonce":1033870939}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.46799448599999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9978755028591169,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5666 172.21.15.114:0/1033870939","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4ef5f0587d1cad82c4295c20951c303dc342ac74","ceph_version":"ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)","entity_id":"y","hostname":"smithi114","pid":"28912","root":"/"}}] 2024-09-16T07:32:22.935 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi114", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28912", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 253377976, "type": "any" }, "name": { "num": 6169, "type": "client" } }, "id": 6169, "inst": "client.6169 172.21.15.114:0/253377976", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9978755028591169 }, "state": "open", "uptime": 0.467994486 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4ef5f0587d1cad82c4295c20951c303dc342ac74", "ceph_version": "ceph version 19.3.0-4938-g4ef5f058 (4ef5f0587d1cad82c4295c20951c303dc342ac74) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi114", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28912", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 1033870939, "type": "any" }, "name": { "num": 5666, "type": "client" } }, "id": 5666, "inst": "client.5666 172.21.15.114:0/1033870939", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9978755028591169 }, "state": "open", "uptime": 0.467994486 } ] 2024-09-16T07:32:22.935 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-16T07:32:22.935 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:32:22.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:32:23.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:32:23.122 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:32:23.122 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:32:23.123 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:23.123 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:23.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:32:23.131 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:32:23.131 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:23.131 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:23.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:32:23.140 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:32:23.140 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:23.140 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:23.180 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:32:23.181 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:32:23.181 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:23.181 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:23.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:32:23.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:23.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 -- 172.21.15.114:0/2761382639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80cd8c0 msgr2=0x7fd6a80cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 --2- 172.21.15.114:0/2761382639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80cd8c0 0x7fd6a80cea20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8073d80 tx=0x7fd6a001c8c0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 -- 172.21.15.114:0/2761382639 shutdown_connections 2024-09-16T07:32:23.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 --2- 172.21.15.114:0/2761382639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80cd8c0 0x7fd6a80cea20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 --2- 172.21.15.114:0/2761382639 >> v2:172.21.15.149:3300/0 conn(0x7fd6a815be80 0x7fd6a80ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 -- 172.21.15.114:0/2761382639 >> 172.21.15.114:0/2761382639 conn(0x7fd6a80d1da0 msgr2=0x7fd6a80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:23.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 -- 172.21.15.114:0/2761382639 shutdown_connections 2024-09-16T07:32:23.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.367+0000 7fd6af200640 1 -- 172.21.15.114:0/2761382639 wait complete. 2024-09-16T07:32:23.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 Processor -- start 2024-09-16T07:32:23.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 -- start start 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a80cd8c0 0x7fd6a814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80d28c0 0x7fd6a814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a815be80 0x7fd6a814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8168bd0 con 0x7fd6a80d28c0 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8168a50 con 0x7fd6a815be80 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6af200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a8168d50 con 0x7fd6a80cd8c0 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd69f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80d28c0 0x7fd6a814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd69f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80d28c0 0x7fd6a814a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41900/0 (socket says 172.21.15.114:41900) 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6a7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a80cd8c0 0x7fd6a814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6ad200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a815be80 0x7fd6a814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd6a7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a80cd8c0 0x7fd6a814a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53644/0 (socket says 172.21.15.114:53644) 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.371+0000 7fd69f400640 1 -- 172.21.15.114:0/288096709 learned_addr learned my addr 172.21.15.114:0/288096709 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd69f400640 1 -- 172.21.15.114:0/288096709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a80cd8c0 msgr2=0x7fd6a814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd69f400640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a80cd8c0 0x7fd6a814a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd69f400640 1 -- 172.21.15.114:0/288096709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a815be80 msgr2=0x7fd6a814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd69f400640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a815be80 0x7fd6a814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd69f400640 1 -- 172.21.15.114:0/288096709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a815da70 con 0x7fd6a80d28c0 2024-09-16T07:32:23.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd69f400640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80d28c0 0x7fd6a814a680 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c870 tx=0x7fd69000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:23.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd6a4c00640 1 -- 172.21.15.114:0/288096709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690003b80 con 0x7fd6a80d28c0 2024-09-16T07:32:23.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd6a4c00640 1 -- 172.21.15.114:0/288096709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd690003d20 con 0x7fd6a80d28c0 2024-09-16T07:32:23.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd6a4c00640 1 -- 172.21.15.114:0/288096709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69000aab0 con 0x7fd6a80d28c0 2024-09-16T07:32:23.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a80c7420 con 0x7fd6a80d28c0 2024-09-16T07:32:23.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a80c7f00 con 0x7fd6a80d28c0 2024-09-16T07:32:23.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.375+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a80c8220 con 0x7fd6a80d28c0 2024-09-16T07:32:23.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.379+0000 7fd6a4c00640 1 -- 172.21.15.114:0/288096709 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 14) ==== 48705+0+0 (secure 0 0 0) 0x7fd69000ac50 con 0x7fd6a80d28c0 2024-09-16T07:32:23.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.379+0000 7fd6a4c00640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd68403b810 0x7fd68403dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.379+0000 7fd6a4c00640 1 -- 172.21.15.114:0/288096709 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7fd69004ff60 con 0x7fd6a80d28c0 2024-09-16T07:32:23.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.379+0000 7fd6a7e00640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd68403b810 0x7fd68403dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.379+0000 7fd6a7e00640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd68403b810 0x7fd68403dcd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd69800dd90 tx=0x7fd69800f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:23.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.387+0000 7fd6a4c00640 1 -- 172.21.15.114:0/288096709 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd6a80d0350 con 0x7fd6a80d28c0 2024-09-16T07:32:23.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.587+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6a80b53f0 con 0x7fd6a80d28c0 2024-09-16T07:32:23.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.587+0000 7fd6a4c00640 1 -- 172.21.15.114:0/288096709 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7fd690014d20 con 0x7fd6a80d28c0 2024-09-16T07:32:23.588 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:23.588 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"btime":"2024-09-16T07:32:17:332311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:23.588 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-09-16T07:32:23.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd68403b810 msgr2=0x7fd68403dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd68403b810 0x7fd68403dcd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd69800dd90 tx=0x7fd69800f040 comp rx=0 tx=0).stop 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80d28c0 msgr2=0x7fd6a814a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80d28c0 0x7fd6a814a680 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c870 tx=0x7fd69000cd30 comp rx=0 tx=0).stop 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 shutdown_connections 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a815be80 0x7fd6a814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a80d28c0 0x7fd6a814a680 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd68403b810 0x7fd68403dcd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 --2- 172.21.15.114:0/288096709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a80cd8c0 0x7fd6a814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 >> 172.21.15.114:0/288096709 conn(0x7fd6a80d1da0 msgr2=0x7fd6a80b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 shutdown_connections 2024-09-16T07:32:23.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.591+0000 7fd6af200640 1 -- 172.21.15.114:0/288096709 wait complete. 2024-09-16T07:32:23.608 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 -- 172.21.15.114:0/1666873140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdb30 msgr2=0x7f47340cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 --2- 172.21.15.114:0/1666873140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdb30 0x7f47340cebb0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f47340cdf50 tx=0x7f471c01c8c0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 -- 172.21.15.114:0/1666873140 shutdown_connections 2024-09-16T07:32:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 --2- 172.21.15.114:0/1666873140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdb30 0x7f47340cebb0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 --2- 172.21.15.114:0/1666873140 >> v2:172.21.15.149:3300/0 conn(0x7f47340d28e0 0x7f47340cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 --2- 172.21.15.114:0/1666873140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f473415bea0 0x7f47340ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 -- 172.21.15.114:0/1666873140 >> 172.21.15.114:0/1666873140 conn(0x7f47340d1dc0 msgr2=0x7f47340d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 -- 172.21.15.114:0/1666873140 shutdown_connections 2024-09-16T07:32:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.751+0000 7f4739000640 1 -- 172.21.15.114:0/1666873140 wait complete. 2024-09-16T07:32:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 Processor -- start 2024-09-16T07:32:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 -- start start 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47340cdb30 0x7f4734153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47340d28e0 0x7f47340b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f473415bea0 0x7f4734157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f47340af0a0 con 0x7f473415bea0 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47340aef20 con 0x7f47340cdb30 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47340af220 con 0x7f47340d28e0 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f473415bea0 0x7f4734157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f473415bea0 0x7f4734157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41922/0 (socket says 172.21.15.114:41922) 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 -- 172.21.15.114:0/445600350 learned_addr learned my addr 172.21.15.114:0/445600350 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4731e00640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47340cdb30 0x7f4734153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4729400640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47340d28e0 0x7f47340b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 -- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47340d28e0 msgr2=0x7f47340b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47340d28e0 0x7f47340b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 -- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47340cdb30 msgr2=0x7f4734153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47340cdb30 0x7f4734153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 -- 172.21.15.114:0/445600350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4734153b50 con 0x7f473415bea0 2024-09-16T07:32:23.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4732800640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f473415bea0 0x7f4734157cb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f472c00e990 tx=0x7f472c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:23.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f472aa00640 1 -- 172.21.15.114:0/445600350 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c004d30 con 0x7f473415bea0 2024-09-16T07:32:23.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f472aa00640 1 -- 172.21.15.114:0/445600350 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f472c00cb00 con 0x7f473415bea0 2024-09-16T07:32:23.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f472aa00640 1 -- 172.21.15.114:0/445600350 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c005020 con 0x7f473415bea0 2024-09-16T07:32:23.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47340b1c30 con 0x7f473415bea0 2024-09-16T07:32:23.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473406ded0 con 0x7f473415bea0 2024-09-16T07:32:23.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.755+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47340cc9d0 con 0x7f473415bea0 2024-09-16T07:32:23.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.759+0000 7f472aa00640 1 -- 172.21.15.114:0/445600350 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 14) ==== 48705+0+0 (secure 0 0 0) 0x7f472c0051c0 con 0x7f473415bea0 2024-09-16T07:32:23.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.759+0000 7f472aa00640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f471003b810 0x7f471003dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:23.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.759+0000 7f472aa00640 1 -- 172.21.15.114:0/445600350 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f472c050a30 con 0x7f473415bea0 2024-09-16T07:32:23.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.759+0000 7f4731e00640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f471003b810 0x7f471003dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:23.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.759+0000 7f4731e00640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f471003b810 0x7f471003dcd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f472400bb50 tx=0x7f472400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:23.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.763+0000 7f472aa00640 1 -- 172.21.15.114:0/445600350 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4734153b50 con 0x7f473415bea0 2024-09-16T07:32:23.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f473415a500 con 0x7f473415bea0 2024-09-16T07:32:23.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f472aa00640 1 -- 172.21.15.114:0/445600350 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f472c016030 con 0x7f473415bea0 2024-09-16T07:32:23.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:23.962 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"btime":"2024-09-16T07:32:17:332311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:23.962 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-09-16T07:32:23.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f471003b810 msgr2=0x7f471003dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f471003b810 0x7f471003dcd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f472400bb50 tx=0x7f472400b2e0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f473415bea0 msgr2=0x7f4734157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f473415bea0 0x7f4734157cb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f472c00e990 tx=0x7f472c00ee50 comp rx=0 tx=0).stop 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 shutdown_connections 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f473415bea0 0x7f4734157cb0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f471003b810 0x7f471003dcd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47340d28e0 0x7f47340b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 --2- 172.21.15.114:0/445600350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47340cdb30 0x7f4734153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 >> 172.21.15.114:0/445600350 conn(0x7f47340d1dc0 msgr2=0x7f47340b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 shutdown_connections 2024-09-16T07:32:23.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:23.963+0000 7f4739000640 1 -- 172.21.15.114:0/445600350 wait complete. 2024-09-16T07:32:23.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:24.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 -- 172.21.15.114:0/430431654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b0ce0 msgr2=0x7f8ef40b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 --2- 172.21.15.114:0/430431654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b0ce0 0x7f8ef40b5870 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009840 tx=0x7f8ee001c820 comp rx=0 tx=0).stop 2024-09-16T07:32:24.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 -- 172.21.15.114:0/430431654 shutdown_connections 2024-09-16T07:32:24.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 --2- 172.21.15.114:0/430431654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b0ce0 0x7f8ef40b5870 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 -- 172.21.15.114:0/430431654 >> 172.21.15.114:0/430431654 conn(0x7f8ef409aa10 msgr2=0x7f8ef409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:24.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 -- 172.21.15.114:0/430431654 shutdown_connections 2024-09-16T07:32:24.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 -- 172.21.15.114:0/430431654 wait complete. 2024-09-16T07:32:24.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 Processor -- start 2024-09-16T07:32:24.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.127+0000 7f8ef3200640 1 -- start start 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40b0ce0 0x7f8ef4153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40b11a0 0x7f8ef4158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b4d80 0x7f8ef4158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef4169c50 con 0x7f8ef40b4d80 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef4169ad0 con 0x7f8ef40b0ce0 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef4169dd0 con 0x7f8ef40b11a0 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b4d80 0x7f8ef4158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b4d80 0x7f8ef4158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41946/0 (socket says 172.21.15.114:41946) 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 -- 172.21.15.114:0/1878849013 learned_addr learned my addr 172.21.15.114:0/1878849013 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef1e00640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40b0ce0 0x7f8ef4153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef1400640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40b11a0 0x7f8ef4158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 -- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40b11a0 msgr2=0x7f8ef4158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40b11a0 0x7f8ef4158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 -- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40b0ce0 msgr2=0x7f8ef4153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40b0ce0 0x7f8ef4153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 -- 172.21.15.114:0/1878849013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef4152330 con 0x7f8ef40b4d80 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef2800640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b4d80 0x7f8ef4158c60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c7c0 tx=0x7f8eec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8eea000640 1 -- 172.21.15.114:0/1878849013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec003b80 con 0x7f8ef40b4d80 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8eea000640 1 -- 172.21.15.114:0/1878849013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8eec003d20 con 0x7f8ef40b4d80 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef4152610 con 0x7f8ef40b4d80 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8eea000640 1 -- 172.21.15.114:0/1878849013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00aab0 con 0x7f8ef40b4d80 2024-09-16T07:32:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef4152bd0 con 0x7f8ef40b4d80 2024-09-16T07:32:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef40b5160 con 0x7f8ef40b4d80 2024-09-16T07:32:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8eea000640 1 -- 172.21.15.114:0/1878849013 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 14) ==== 48705+0+0 (secure 0 0 0) 0x7f8eec00ac50 con 0x7f8ef40b4d80 2024-09-16T07:32:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8eea000640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8ed403b840 0x7f8ed403dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.131+0000 7f8eea000640 1 -- 172.21.15.114:0/1878849013 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f8eec04fd80 con 0x7f8ef40b4d80 2024-09-16T07:32:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.135+0000 7f8ef1e00640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8ed403b840 0x7f8ed403dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.135+0000 7f8ef1e00640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8ed403b840 0x7f8ed403dd00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40046c0 tx=0x7f8ee4007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.139+0000 7f8eea000640 1 -- 172.21.15.114:0/1878849013 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8eec053030 con 0x7f8ef40b4d80 2024-09-16T07:32:24.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.307+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ef40ce0c0 con 0x7f8ef40b4d80 2024-09-16T07:32:24.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8eea000640 1 -- 172.21.15.114:0/1878849013 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17592 (secure 0 0 0) 0x7f8eec014d20 con 0x7f8ef40b4d80 2024-09-16T07:32:24.308 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:24.308 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":70,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:22.331529+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:05.778772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:06.639884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:0/2006694112":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/1675603639":"2024-09-17T07:32:22.331488+0000","172.21.15.149:6800/921426846":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4201783238":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2751300545":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/582884511":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2277496221":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4119429621":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4029777038":"2024-09-17T07:32:22.331488+0000","172.21.15.149:6801/921426846":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/780559649":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2583562273":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/626953":"2024-09-17T07:32:22.331488+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:24.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8ed403b840 msgr2=0x7f8ed403dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8ed403b840 0x7f8ed403dd00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40046c0 tx=0x7f8ee4007ea0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b4d80 msgr2=0x7f8ef4158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b4d80 0x7f8ef4158c60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c7c0 tx=0x7f8eec00cc80 comp rx=0 tx=0).stop 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 shutdown_connections 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ef40b4d80 0x7f8ef4158c60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8ed403b840 0x7f8ed403dd00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8ef40b11a0 0x7f8ef4158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 --2- 172.21.15.114:0/1878849013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8ef40b0ce0 0x7f8ef4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 >> 172.21.15.114:0/1878849013 conn(0x7f8ef409aa10 msgr2=0x7f8ef409adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 shutdown_connections 2024-09-16T07:32:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.311+0000 7f8ef3200640 1 -- 172.21.15.114:0/1878849013 wait complete. 2024-09-16T07:32:24.330 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:32:24.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 -- 172.21.15.114:0/3815546869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc0ced80 msgr2=0x7f82fc0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 --2- 172.21.15.114:0/3815546869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc0ced80 0x7f82fc0ae9b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009840 tx=0x7f82e801c820 comp rx=0 tx=0).stop 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 -- 172.21.15.114:0/3815546869 shutdown_connections 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 --2- 172.21.15.114:0/3815546869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82fc0cdb30 0x7f82fc0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 --2- 172.21.15.114:0/3815546869 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc0ced80 0x7f82fc0ae9b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 -- 172.21.15.114:0/3815546869 >> 172.21.15.114:0/3815546869 conn(0x7f82fc0d1dc0 msgr2=0x7f82fc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 -- 172.21.15.114:0/3815546869 shutdown_connections 2024-09-16T07:32:24.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.479+0000 7f8302000640 1 -- 172.21.15.114:0/3815546869 wait complete. 2024-09-16T07:32:24.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 Processor -- start 2024-09-16T07:32:24.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 -- start start 2024-09-16T07:32:24.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82fc0cdb30 0x7f82fc158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82fc0ced80 0x7f82fc0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc15bea0 0x7f82fc14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc169340 con 0x7f82fc15bea0 2024-09-16T07:32:24.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82fc1691c0 con 0x7f82fc0ced80 2024-09-16T07:32:24.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82fc1694c0 con 0x7f82fc0cdb30 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc15bea0 0x7f82fc14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc15bea0 0x7f82fc14e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47138/0 (socket says 172.21.15.114:47138) 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82fbe00640 1 -- 172.21.15.114:0/550083662 learned_addr learned my addr 172.21.15.114:0/550083662 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82faa00640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82fc0ced80 0x7f82fc0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82fb400640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82fc0cdb30 0x7f82fc158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82faa00640 1 -- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82fc0cdb30 msgr2=0x7f82fc158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82faa00640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82fc0cdb30 0x7f82fc158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82faa00640 1 -- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc15bea0 msgr2=0x7f82fc14e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82faa00640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc15bea0 0x7f82fc14e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82faa00640 1 -- 172.21.15.114:0/550083662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82fc1f8eb0 con 0x7f82fc0ced80 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82fbe00640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc15bea0 0x7f82fc14e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82fb400640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82fc0cdb30 0x7f82fc158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:32:24.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82faa00640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82fc0ced80 0x7f82fc0b30a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f82e80ac000 tx=0x7f82e80a55b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82f3400640 1 -- 172.21.15.114:0/550083662 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e80b2040 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82f3400640 1 -- 172.21.15.114:0/550083662 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82e8004470 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82fc0b3e20 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f82f3400640 1 -- 172.21.15.114:0/550083662 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8005280 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.483+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82fc1f9150 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.487+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82fc0ce670 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.487+0000 7f82f3400640 1 -- 172.21.15.114:0/550083662 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 15) ==== 48913+0+0 (secure 0 0 0) 0x7f82e8005420 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.487+0000 7f82f3400640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f82dc03ba50 0x7f82dc03df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.487+0000 7f82f3400640 1 -- 172.21.15.114:0/550083662 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f82e80ea0a0 con 0x7f82fc0ced80 2024-09-16T07:32:24.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.487+0000 7f82fb400640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f82dc03ba50 0x7f82dc03df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.487+0000 7f82fb400640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f82dc03ba50 0x7f82dc03df10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00d4f0 tx=0x7f82ec001a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:24.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.491+0000 7f82f3400640 1 -- 172.21.15.114:0/550083662 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f82e8016410 con 0x7f82fc0ced80 2024-09-16T07:32:24.621 INFO:tasks.ceph.mgr.x.smithi149.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T07:32:24.622 INFO:tasks.ceph.mgr.x.smithi149.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T07:32:24.622 INFO:tasks.ceph.mgr.x.smithi149.stderr: from numpy import show_config as show_numpy_config 2024-09-16T07:32:24.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82fc0b0e90 con 0x7f82fc0ced80 2024-09-16T07:32:24.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f82f3400640 1 -- 172.21.15.114:0/550083662 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f82e80b2d70 con 0x7f82fc0ced80 2024-09-16T07:32:24.693 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:24.693 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"btime":"2024-09-16T07:32:17:332311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:24.693 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f82dc03ba50 msgr2=0x7f82dc03df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f82dc03ba50 0x7f82dc03df10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00d4f0 tx=0x7f82ec001a00 comp rx=0 tx=0).stop 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82fc0ced80 msgr2=0x7f82fc0b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82fc0ced80 0x7f82fc0b30a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f82e80ac000 tx=0x7f82e80a55b0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 shutdown_connections 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82fc15bea0 0x7f82fc14e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82fc0ced80 0x7f82fc0b30a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f82dc03ba50 0x7f82dc03df10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 --2- 172.21.15.114:0/550083662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f82fc0cdb30 0x7f82fc158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 >> 172.21.15.114:0/550083662 conn(0x7f82fc0d1dc0 msgr2=0x7f82fc0b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:24.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 shutdown_connections 2024-09-16T07:32:24.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.695+0000 7f8302000640 1 -- 172.21.15.114:0/550083662 wait complete. 2024-09-16T07:32:24.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:24.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 -- 172.21.15.114:0/3364229546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f792815c130 msgr2=0x7f79280cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 --2- 172.21.15.114:0/3364229546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f792815c130 0x7f79280cce80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f7920009900 tx=0x7f792001c7c0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 -- 172.21.15.114:0/3364229546 shutdown_connections 2024-09-16T07:32:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 --2- 172.21.15.114:0/3364229546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f792815c130 0x7f79280cce80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 --2- 172.21.15.114:0/3364229546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f79280cecf0 0x7f79280cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 -- 172.21.15.114:0/3364229546 >> 172.21.15.114:0/3364229546 conn(0x7f79280d1ea0 msgr2=0x7f79280d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 -- 172.21.15.114:0/3364229546 shutdown_connections 2024-09-16T07:32:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 -- 172.21.15.114:0/3364229546 wait complete. 2024-09-16T07:32:24.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 Processor -- start 2024-09-16T07:32:24.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 -- start start 2024-09-16T07:32:24.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.859+0000 7f792ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79280cecf0 0x7f7928156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792815bd50 0x7f79280c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792815c130 0x7f79280c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f79281695e0 con 0x7f79280cecf0 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7928169460 con 0x7f792815c130 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7928169760 con 0x7f792815bd50 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79280cecf0 0x7f7928156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79280cecf0 0x7f7928156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47164/0 (socket says 172.21.15.114:47164) 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 -- 172.21.15.114:0/45009259 learned_addr learned my addr 172.21.15.114:0/45009259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7926800640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792815c130 0x7f79280c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925400640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792815bd50 0x7f79280c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 -- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792815bd50 msgr2=0x7f79280c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792815bd50 0x7f79280c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 -- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792815c130 msgr2=0x7f79280c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792815c130 0x7f79280c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 -- 172.21.15.114:0/45009259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79281f92d0 con 0x7f79280cecf0 2024-09-16T07:32:24.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925e00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79280cecf0 0x7f7928156eb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f791800c870 tx=0x7f791800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f791e000640 1 -- 172.21.15.114:0/45009259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918003b80 con 0x7f79280cecf0 2024-09-16T07:32:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f791e000640 1 -- 172.21.15.114:0/45009259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7918003d20 con 0x7f79280cecf0 2024-09-16T07:32:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7928155d30 con 0x7f79280cecf0 2024-09-16T07:32:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f791e000640 1 -- 172.21.15.114:0/45009259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791800aa50 con 0x7f79280cecf0 2024-09-16T07:32:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79281f9850 con 0x7f79280cecf0 2024-09-16T07:32:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f791e000640 1 -- 172.21.15.114:0/45009259 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 15) ==== 48913+0+0 (secure 0 0 0) 0x7f791800abf0 con 0x7f79280cecf0 2024-09-16T07:32:24.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79280ce5e0 con 0x7f79280cecf0 2024-09-16T07:32:24.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f791e000640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f790803ba80 0x7f790803df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:24.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f791e000640 1 -- 172.21.15.114:0/45009259 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f7918050360 con 0x7f79280cecf0 2024-09-16T07:32:24.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925400640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f790803ba80 0x7f790803df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:24.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.863+0000 7f7925400640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f790803ba80 0x7f790803df40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f79280c8980 tx=0x7f79140091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:24.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:24.867+0000 7f791e000640 1 -- 172.21.15.114:0/45009259 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7918012420 con 0x7f79280cecf0 2024-09-16T07:32:25.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.071+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7928072580 con 0x7f79280cecf0 2024-09-16T07:32:25.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.071+0000 7f791e000640 1 -- 172.21.15.114:0/45009259 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f7918005090 con 0x7f79280cecf0 2024-09-16T07:32:25.070 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:25.070 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"btime":"2024-09-16T07:32:17:332311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:07.684616+0000","modified":"2024-09-16T07:32:10.693544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6168":{"gid":6168,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/26034359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":26034359},{"type":"v1","addr":"172.21.15.114:6835","nonce":26034359}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6168,"qdb_cluster":[6168]},"id":5}]} 2024-09-16T07:32:25.070 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 48 2024-09-16T07:32:25.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f790803ba80 msgr2=0x7f790803df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f790803ba80 0x7f790803df40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f79280c8980 tx=0x7f79140091e0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79280cecf0 msgr2=0x7f7928156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79280cecf0 0x7f7928156eb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f791800c870 tx=0x7f791800cd30 comp rx=0 tx=0).stop 2024-09-16T07:32:25.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 shutdown_connections 2024-09-16T07:32:25.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f792815c130 0x7f79280c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f790803ba80 0x7f790803df40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f792815bd50 0x7f79280c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 --2- 172.21.15.114:0/45009259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79280cecf0 0x7f7928156eb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 >> 172.21.15.114:0/45009259 conn(0x7f79280d1ea0 msgr2=0x7f7928159110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:25.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 shutdown_connections 2024-09-16T07:32:25.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.075+0000 7f792ca00640 1 -- 172.21.15.114:0/45009259 wait complete. 2024-09-16T07:32:25.091 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:25.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- 172.21.15.114:0/973719371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d5015f490 msgr2=0x7f0d500b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 --2- 172.21.15.114:0/973719371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d5015f490 0x7f0d500b14c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0d50073dd0 tx=0x7f0d4401c830 comp rx=0 tx=0).stop 2024-09-16T07:32:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- 172.21.15.114:0/973719371 shutdown_connections 2024-09-16T07:32:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 --2- 172.21.15.114:0/973719371 >> v2:172.21.15.149:3300/0 conn(0x7f0d500b2e80 0x7f0d500b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 --2- 172.21.15.114:0/973719371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d5015f490 0x7f0d500b14c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- 172.21.15.114:0/973719371 >> 172.21.15.114:0/973719371 conn(0x7f0d500d1e30 msgr2=0x7f0d500d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- 172.21.15.114:0/973719371 shutdown_connections 2024-09-16T07:32:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- 172.21.15.114:0/973719371 wait complete. 2024-09-16T07:32:25.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 Processor -- start 2024-09-16T07:32:25.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- start start 2024-09-16T07:32:25.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d500b1f40 0x7f0d500c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d500b2e80 0x7f0d5015e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d5015f490 0x7f0d5014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d50168e90 con 0x7f0d500b1f40 2024-09-16T07:32:25.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5015f9e0 con 0x7f0d500b2e80 2024-09-16T07:32:25.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d58000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0d50169010 con 0x7f0d5015f490 2024-09-16T07:32:25.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d500b1f40 0x7f0d500c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d500b1f40 0x7f0d500c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47184/0 (socket says 172.21.15.114:47184) 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 -- 172.21.15.114:0/540204236 learned_addr learned my addr 172.21.15.114:0/540204236 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d54c00640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d500b2e80 0x7f0d5015e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d56000640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d5015f490 0x7f0d5014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 -- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d5015f490 msgr2=0x7f0d5014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d5015f490 0x7f0d5014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 -- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d500b2e80 msgr2=0x7f0d5015e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d500b2e80 0x7f0d5015e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.235+0000 7f0d55600640 1 -- 172.21.15.114:0/540204236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5006d120 con 0x7f0d500b1f40 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d55600640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d500b1f40 0x7f0d500c6ad0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009850 tx=0x7f0d44005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d4d600640 1 -- 172.21.15.114:0/540204236 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440bb070 con 0x7f0d500b1f40 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d4d600640 1 -- 172.21.15.114:0/540204236 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d44004320 con 0x7f0d500b1f40 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5014eec0 con 0x7f0d500b1f40 2024-09-16T07:32:25.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d4d600640 1 -- 172.21.15.114:0/540204236 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440b2040 con 0x7f0d500b1f40 2024-09-16T07:32:25.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5014dbc0 con 0x7f0d500b1f40 2024-09-16T07:32:25.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d4d600640 1 -- 172.21.15.114:0/540204236 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 15) ==== 48913+0+0 (secure 0 0 0) 0x7f0d440052d0 con 0x7f0d500b1f40 2024-09-16T07:32:25.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d500cfda0 con 0x7f0d500b1f40 2024-09-16T07:32:25.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d4d600640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0d3003ba80 0x7f0d3003df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d4d600640 1 -- 172.21.15.114:0/540204236 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f0d440e9b10 con 0x7f0d500b1f40 2024-09-16T07:32:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d54c00640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0d3003ba80 0x7f0d3003df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.239+0000 7f0d54c00640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0d3003ba80 0x7f0d3003df40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d5009fff0 tx=0x7f0d3c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:25.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.243+0000 7f0d4d600640 1 -- 172.21.15.114:0/540204236 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0d440164b0 con 0x7f0d500b1f40 2024-09-16T07:32:25.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.411+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d500b08b0 con 0x7f0d500b1f40 2024-09-16T07:32:25.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d4d600640 1 -- 172.21.15.114:0/540204236 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17592 (secure 0 0 0) 0x7f0d440b5380 con 0x7f0d500b1f40 2024-09-16T07:32:25.412 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:25.412 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":70,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:22.331529+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:05.778772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:06.639884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:0/2006694112":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/1675603639":"2024-09-17T07:32:22.331488+0000","172.21.15.149:6800/921426846":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4201783238":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2751300545":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/582884511":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2277496221":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4119429621":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4029777038":"2024-09-17T07:32:22.331488+0000","172.21.15.149:6801/921426846":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/780559649":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2583562273":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/626953":"2024-09-17T07:32:22.331488+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:25.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0d3003ba80 msgr2=0x7f0d3003df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0d3003ba80 0x7f0d3003df40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d5009fff0 tx=0x7f0d3c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d500b1f40 msgr2=0x7f0d500c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d500b1f40 0x7f0d500c6ad0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009850 tx=0x7f0d44005e00 comp rx=0 tx=0).stop 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 shutdown_connections 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0d3003ba80 0x7f0d3003df40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d5015f490 0x7f0d5014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d500b2e80 0x7f0d5015e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 --2- 172.21.15.114:0/540204236 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d500b1f40 0x7f0d500c6ad0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 >> 172.21.15.114:0/540204236 conn(0x7f0d500d1e30 msgr2=0x7f0d500d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 shutdown_connections 2024-09-16T07:32:25.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.415+0000 7f0d58000640 1 -- 172.21.15.114:0/540204236 wait complete. 2024-09-16T07:32:25.435 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:32:25.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 -- 172.21.15.114:0/2426102809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080b49b0 msgr2=0x7f720815ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 --2- 172.21.15.114:0/2426102809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080b49b0 0x7f720815ea30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f720815e160 tx=0x7f71f401c790 comp rx=0 tx=0).stop 2024-09-16T07:32:25.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 -- 172.21.15.114:0/2426102809 shutdown_connections 2024-09-16T07:32:25.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 --2- 172.21.15.114:0/2426102809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080b49b0 0x7f720815ea30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 -- 172.21.15.114:0/2426102809 >> 172.21.15.114:0/2426102809 conn(0x7f72080b18f0 msgr2=0x7f72080b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 -- 172.21.15.114:0/2426102809 shutdown_connections 2024-09-16T07:32:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 -- 172.21.15.114:0/2426102809 wait complete. 2024-09-16T07:32:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.579+0000 7f720fc00640 1 Processor -- start 2024-09-16T07:32:25.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 -- start start 2024-09-16T07:32:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080703d0 0x7f7208152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72080b49b0 0x7f7208141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f720815a4d0 0x7f72080ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f72080ccfe0 con 0x7f72080b49b0 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f72080cce60 con 0x7f72080703d0 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7208168180 con 0x7f720815a4d0 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72080b49b0 0x7f7208141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72080b49b0 0x7f7208141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47188/0 (socket says 172.21.15.114:47188) 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 -- 172.21.15.114:0/871672615 learned_addr learned my addr 172.21.15.114:0/871672615 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720d200640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080703d0 0x7f7208152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720dc00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f720815a4d0 0x7f72080ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 -- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f720815a4d0 msgr2=0x7f72080ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f720815a4d0 0x7f72080ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 -- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080703d0 msgr2=0x7f7208152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080703d0 0x7f7208152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 -- 172.21.15.114:0/871672615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72080cc230 con 0x7f72080b49b0 2024-09-16T07:32:25.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7207e00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72080b49b0 0x7f7208141570 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f71f401cc70 tx=0x7f71f4005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7204c00640 1 -- 172.21.15.114:0/871672615 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f40bb070 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7204c00640 1 -- 172.21.15.114:0/871672615 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71f4004330 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720814fcc0 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7204c00640 1 -- 172.21.15.114:0/871672615 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f40b2040 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7208153930 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7208069410 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.583+0000 7f7204c00640 1 -- 172.21.15.114:0/871672615 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 15) ==== 48913+0+0 (secure 0 0 0) 0x7f71f4005290 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.587+0000 7f7204c00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71e803ba50 0x7f71e803df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.587+0000 7f7204c00640 1 -- 172.21.15.114:0/871672615 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f71f40e9ee0 con 0x7f72080b49b0 2024-09-16T07:32:25.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.587+0000 7f720d200640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71e803ba50 0x7f71e803df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.587+0000 7f720d200640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71e803ba50 0x7f71e803df10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71fc007fd0 tx=0x7f71fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:25.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.591+0000 7f7204c00640 1 -- 172.21.15.114:0/871672615 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f71f4016410 con 0x7f72080b49b0 2024-09-16T07:32:25.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.787+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f720815ea30 con 0x7f72080b49b0 2024-09-16T07:32:25.787 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:32:25.787+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:32:25.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.791+0000 7f7204c00640 1 -- 172.21.15.114:0/871672615 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) ==== 161+0+0 (secure 0 0 0) 0x7f71f40046d0 con 0x7f72080b49b0 2024-09-16T07:32:25.789 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.791+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71e803ba50 msgr2=0x7f71e803df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.791+0000 7f720fc00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71e803ba50 0x7f71e803df10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f71fc007fd0 tx=0x7f71fc009040 comp rx=0 tx=0).stop 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.791+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72080b49b0 msgr2=0x7f7208141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.791+0000 7f720fc00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72080b49b0 0x7f7208141570 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f71f401cc70 tx=0x7f71f4005d10 comp rx=0 tx=0).stop 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 shutdown_connections 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71e803ba50 0x7f71e803df10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f720815a4d0 0x7f72080ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72080b49b0 0x7f7208141570 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 --2- 172.21.15.114:0/871672615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f72080703d0 0x7f7208152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 >> 172.21.15.114:0/871672615 conn(0x7f72080b18f0 msgr2=0x7f720806f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 shutdown_connections 2024-09-16T07:32:25.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.795+0000 7f720fc00640 1 -- 172.21.15.114:0/871672615 wait complete. 2024-09-16T07:32:25.805 INFO:tasks.ceph.mds.a.smithi114.stderr: -8267> 2024-09-16T07:32:13.243+0000 7f7732000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:32:25.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:32:25.858 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:32:25.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.959+0000 7f5fbbe00640 1 -- 172.21.15.114:0/2139121708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f9c005eb0 msgr2=0x7f5f9c006330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.959+0000 7f5fbbe00640 1 --2- 172.21.15.114:0/2139121708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f9c005eb0 0x7f5f9c006330 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5fac001f50 tx=0x7f5fac01f3b0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.959+0000 7f5fb9e00640 1 -- 172.21.15.114:0/2139121708 reap_dead start 2024-09-16T07:32:25.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.959+0000 7f5fbbe00640 1 -- 172.21.15.114:0/2139121708 shutdown_connections 2024-09-16T07:32:25.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.959+0000 7f5fbbe00640 1 -- 172.21.15.114:0/2139121708 >> 172.21.15.114:0/2139121708 conn(0x7f5fb40cfc20 msgr2=0x7f5fb40d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:25.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.959+0000 7f5fbbe00640 1 -- 172.21.15.114:0/2139121708 shutdown_connections 2024-09-16T07:32:25.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.959+0000 7f5fbbe00640 1 -- 172.21.15.114:0/2139121708 wait complete. 2024-09-16T07:32:25.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 Processor -- start 2024-09-16T07:32:25.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 -- start start 2024-09-16T07:32:25.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f9c005eb0 0x7f5fb4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb41547c0 0x7f5fb41f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb41f6dc0 0x7f5fb40ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb40cf1d0 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb40ae2d0 con 0x7f5fb41547c0 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb40cf350 con 0x7f5f9c005eb0 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb41f6dc0 0x7f5fb40ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb41f6dc0 0x7f5fb40ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47226/0 (socket says 172.21.15.114:47226) 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 -- 172.21.15.114:0/1882310526 learned_addr learned my addr 172.21.15.114:0/1882310526 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb8a00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb41547c0 0x7f5fb41f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 -- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f9c005eb0 msgr2=0x7f5fb4154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f9c005eb0 0x7f5fb4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 -- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb41547c0 msgr2=0x7f5fb41f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb41547c0 0x7f5fb41f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 -- 172.21.15.114:0/1882310526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb41f2d50 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb8a00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb41547c0 0x7f5fb41f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:32:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb9e00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb41f6dc0 0x7f5fb40ad0e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5fac01dab0 tx=0x7f5fac006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac0c1070 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fac003d50 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac001ba0 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb41f3030 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.963+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb41f35f0 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.967+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb415ac10 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.967+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 15) ==== 48913+0+0 (secure 0 0 0) 0x7f5fac0b1430 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.967+0000 7f5fb1600640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f9403ba50 0x7f5f9403df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:25.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.967+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6354+0+0 (secure 0 0 0) 0x7f5fac0ede10 con 0x7f5fb41f6dc0 2024-09-16T07:32:25.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.967+0000 7f5fb9400640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f9403ba50 0x7f5f9403df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:25.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.967+0000 7f5fb9400640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f9403ba50 0x7f5f9403df10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009b50 tx=0x7f5fa8009670 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:25.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:25.971+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5fac019160 con 0x7f5fb41f6dc0 2024-09-16T07:32:26.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.175+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5fb4074780 con 0x7f5fb41f6dc0 2024-09-16T07:32:26.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.387+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 16) ==== 48969+0+0 (secure 0 0 0) 0x7f5fac0b1c40 con 0x7f5fb41f6dc0 2024-09-16T07:32:26.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.799+0000 7f5fb1600640 1 -- 172.21.15.114:0/1882310526 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) ==== 104+0+0 (secure 0 0 0) 0x7f5fac0d9c50 con 0x7f5fb41f6dc0 2024-09-16T07:32:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f9403ba50 msgr2=0x7f5f9403df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f9403ba50 0x7f5f9403df10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009b50 tx=0x7f5fa8009670 comp rx=0 tx=0).stop 2024-09-16T07:32:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb41f6dc0 msgr2=0x7f5fb40ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:26.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb41f6dc0 0x7f5fb40ad0e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5fac01dab0 tx=0x7f5fac006660 comp rx=0 tx=0).stop 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 shutdown_connections 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb41f6dc0 0x7f5fb40ad0e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb41547c0 0x7f5fb41f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f9403ba50 0x7f5f9403df10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 --2- 172.21.15.114:0/1882310526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f9c005eb0 0x7f5fb4154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 >> 172.21.15.114:0/1882310526 conn(0x7f5fb40cfc20 msgr2=0x7f5fb4072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 shutdown_connections 2024-09-16T07:32:26.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:26.803+0000 7f5fbbe00640 1 -- 172.21.15.114:0/1882310526 wait complete. 2024-09-16T07:32:26.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:32:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 -- 172.21.15.114:0/2104959477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 msgr2=0x7f05e015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 --2- 172.21.15.114:0/2104959477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e015c070 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009840 tx=0x7f05c801c6d0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 -- 172.21.15.114:0/2104959477 shutdown_connections 2024-09-16T07:32:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 --2- 172.21.15.114:0/2104959477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e015c070 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 --2- 172.21.15.114:0/2104959477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05e015bc90 0x7f05e0074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 -- 172.21.15.114:0/2104959477 >> 172.21.15.114:0/2104959477 conn(0x7f05e006dd30 msgr2=0x7f05e006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 -- 172.21.15.114:0/2104959477 shutdown_connections 2024-09-16T07:32:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.015+0000 7f05e6200640 1 -- 172.21.15.114:0/2104959477 wait complete. 2024-09-16T07:32:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 Processor -- start 2024-09-16T07:32:27.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 -- start start 2024-09-16T07:32:27.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05e015bc90 0x7f05e01fb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e015c5b0 0x7f05e0142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e0070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05e0168cb0 con 0x7f05e01601a0 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f05e0168b30 con 0x7f05e015c5b0 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f05e0168e30 con 0x7f05e015bc90 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e0070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e0070bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47248/0 (socket says 172.21.15.114:47248) 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 -- 172.21.15.114:0/1200996709 learned_addr learned my addr 172.21.15.114:0/1200996709 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05d6a00640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e015c5b0 0x7f05e0142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05df400640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05e015bc90 0x7f05e01fb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 -- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05e015bc90 msgr2=0x7f05e01fb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05e015bc90 0x7f05e01fb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 -- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e015c5b0 msgr2=0x7f05e0142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e015c5b0 0x7f05e0142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 -- 172.21.15.114:0/1200996709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e01fac70 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05dfe00640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e0070bd0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c680 tx=0x7f05d800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8003b80 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05d8003d40 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80052d0 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e0071340 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e01fb1f0 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e0074580 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.019+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 16) ==== 48969+0+0 (secure 0 0 0) 0x7f05d8005470 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.023+0000 7f05d7e00640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f05bc03bae0 0x7f05bc03dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.023+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6354+0+0 (secure 0 0 0) 0x7f05d8050360 con 0x7f05e01601a0 2024-09-16T07:32:27.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.023+0000 7f05df400640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f05bc03bae0 0x7f05bc03dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.023+0000 7f05df400640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f05bc03bae0 0x7f05bc03dfa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009990 tx=0x7f05d0009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:27.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.027+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f05e00ae000 con 0x7f05e01601a0 2024-09-16T07:32:27.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.195+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f05e0148e30 con 0x7f05e01601a0 2024-09-16T07:32:27.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.395+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f05d8010d10 con 0x7f05e01601a0 2024-09-16T07:32:27.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.803+0000 7f05d7e00640 1 -- 172.21.15.114:0/1200996709 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) ==== 181+0+0 (secure 0 0 0) 0x7f05d804e5d0 con 0x7f05e01601a0 2024-09-16T07:32:27.802 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:32:27.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f05bc03bae0 msgr2=0x7f05bc03dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f05bc03bae0 0x7f05bc03dfa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009990 tx=0x7f05d0009110 comp rx=0 tx=0).stop 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 msgr2=0x7f05e0070bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e0070bd0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c680 tx=0x7f05d800cb40 comp rx=0 tx=0).stop 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 shutdown_connections 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05e01601a0 0x7f05e0070bd0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05e015c5b0 0x7f05e0142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f05bc03bae0 0x7f05bc03dfa0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 --2- 172.21.15.114:0/1200996709 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05e015bc90 0x7f05e01fb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 >> 172.21.15.114:0/1200996709 conn(0x7f05e006dd30 msgr2=0x7f05e01562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 shutdown_connections 2024-09-16T07:32:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.807+0000 7f05e6200640 1 -- 172.21.15.114:0/1200996709 wait complete. 2024-09-16T07:32:27.826 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:32:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 -- 172.21.15.114:0/1276782399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815be10 msgr2=0x7f10e80ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 --2- 172.21.15.114:0/1276782399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815be10 0x7f10e80ce700 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f10e80746b0 tx=0x7f10d801f0b0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 -- 172.21.15.114:0/1276782399 shutdown_connections 2024-09-16T07:32:27.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 --2- 172.21.15.114:0/1276782399 >> v2:172.21.15.149:3300/0 conn(0x7f10e815c1f0 0x7f10e80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 --2- 172.21.15.114:0/1276782399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815be10 0x7f10e80ce700 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 -- 172.21.15.114:0/1276782399 >> 172.21.15.114:0/1276782399 conn(0x7f10e80d1da0 msgr2=0x7f10e80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:27.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 -- 172.21.15.114:0/1276782399 shutdown_connections 2024-09-16T07:32:27.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.975+0000 7f10ef000640 1 -- 172.21.15.114:0/1276782399 wait complete. 2024-09-16T07:32:27.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 Processor -- start 2024-09-16T07:32:27.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 -- start start 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80b0b60 0x7f10e80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e815be10 0x7f10e8152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815c1f0 0x7f10e80b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f10e80cf510 con 0x7f10e815c1f0 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10e80cf390 con 0x7f10e80b0b60 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10e8160290 con 0x7f10e815be10 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815c1f0 0x7f10e80b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815c1f0 0x7f10e80b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47274/0 (socket says 172.21.15.114:47274) 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 -- 172.21.15.114:0/2510181977 learned_addr learned my addr 172.21.15.114:0/2510181977 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10df400640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e815be10 0x7f10e8152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10e7e00640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80b0b60 0x7f10e80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 -- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e815be10 msgr2=0x7f10e8152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e815be10 0x7f10e8152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 -- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80b0b60 msgr2=0x7f10e80c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80b0b60 0x7f10e80c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 -- 172.21.15.114:0/2510181977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e815ed00 con 0x7f10e815c1f0 2024-09-16T07:32:27.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ed000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815c1f0 0x7f10e80b25b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c7c0 tx=0x7f10e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10e4c00640 1 -- 172.21.15.114:0/2510181977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0003b80 con 0x7f10e815c1f0 2024-09-16T07:32:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10e4c00640 1 -- 172.21.15.114:0/2510181977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10e0003d20 con 0x7f10e815c1f0 2024-09-16T07:32:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10e4c00640 1 -- 172.21.15.114:0/2510181977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e000aab0 con 0x7f10e815c1f0 2024-09-16T07:32:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e80c6a50 con 0x7f10e815c1f0 2024-09-16T07:32:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e815efe0 con 0x7f10e815c1f0 2024-09-16T07:32:27.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.979+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e81607b0 con 0x7f10e815c1f0 2024-09-16T07:32:27.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.983+0000 7f10e4c00640 1 -- 172.21.15.114:0/2510181977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f10e000ac50 con 0x7f10e815c1f0 2024-09-16T07:32:27.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.983+0000 7f10e4c00640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4072fe0 0x7f10c40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:27.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.983+0000 7f10e4c00640 1 -- 172.21.15.114:0/2510181977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5916+0+0 (secure 0 0 0) 0x7f10e0093e60 con 0x7f10e815c1f0 2024-09-16T07:32:27.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.983+0000 7f10e7e00640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4072fe0 0x7f10c40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:27.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.983+0000 7f10e7e00640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4072fe0 0x7f10c40754a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10d80b2000 tx=0x7f10d801d8f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:27.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:27.987+0000 7f10e4c00640 1 -- 172.21.15.114:0/2510181977 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f10e005e760 con 0x7f10e815c1f0 2024-09-16T07:32:28.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.155+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f10e8070350 con 0x7f10e815c1f0 2024-09-16T07:32:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.811+0000 7f10e4c00640 1 -- 172.21.15.114:0/2510181977 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) ==== 169+0+0 (secure 0 0 0) 0x7f10e0063190 con 0x7f10e815c1f0 2024-09-16T07:32:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:32:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.811+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4072fe0 msgr2=0x7f10c40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.811+0000 7f10ef000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4072fe0 0x7f10c40754a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10d80b2000 tx=0x7f10d801d8f0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.811+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815c1f0 msgr2=0x7f10e80b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.811+0000 7f10ef000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815c1f0 0x7f10e80b25b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f10e000c7c0 tx=0x7f10e000cc80 comp rx=0 tx=0).stop 2024-09-16T07:32:28.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 shutdown_connections 2024-09-16T07:32:28.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10e815c1f0 0x7f10e80b25b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4072fe0 0x7f10c40754a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e815be10 0x7f10e8152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 --2- 172.21.15.114:0/2510181977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80b0b60 0x7f10e80c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 >> 172.21.15.114:0/2510181977 conn(0x7f10e80d1da0 msgr2=0x7f10e80b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:28.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 shutdown_connections 2024-09-16T07:32:28.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.815+0000 7f10ef000640 1 -- 172.21.15.114:0/2510181977 wait complete. 2024-09-16T07:32:28.837 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:32:28.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- 172.21.15.114:0/228789088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 msgr2=0x7f80a01602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:28.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 --2- 172.21.15.114:0/228789088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a01602b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f80a009e350 tx=0x7f809001c890 comp rx=0 tx=0).stop 2024-09-16T07:32:28.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- 172.21.15.114:0/228789088 shutdown_connections 2024-09-16T07:32:28.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 --2- 172.21.15.114:0/228789088 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a0074880 0x7f80a00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 --2- 172.21.15.114:0/228789088 >> v2:172.21.15.149:3300/0 conn(0x7f80a00cd0b0 0x7f80a0074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 --2- 172.21.15.114:0/228789088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a01602b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- 172.21.15.114:0/228789088 >> 172.21.15.114:0/228789088 conn(0x7f80a0073490 msgr2=0x7f80a00d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:28.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- 172.21.15.114:0/228789088 shutdown_connections 2024-09-16T07:32:28.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- 172.21.15.114:0/228789088 wait complete. 2024-09-16T07:32:28.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 Processor -- start 2024-09-16T07:32:28.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- start start 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0074880 0x7f80a00c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a0158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a00cd0b0 0x7f80a01586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f80a015c570 con 0x7f80a00cccd0 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80a015c3f0 con 0x7f80a0074880 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f80a015c6f0 con 0x7f80a00cd0b0 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a0158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a0158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47292/0 (socket says 172.21.15.114:47292) 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 -- 172.21.15.114:0/3859763607 learned_addr learned my addr 172.21.15.114:0/3859763607 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809ea00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0074880 0x7f80a00c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:28.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f809f400640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a00cd0b0 0x7f80a01586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 -- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a00cd0b0 msgr2=0x7f80a01586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a00cd0b0 0x7f80a01586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 -- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0074880 msgr2=0x7f80a00c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0074880 0x7f80a00c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 -- 172.21.15.114:0/3859763607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a00af010 con 0x7f80a00cccd0 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.987+0000 7f8097e00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a0158160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f808800b440 tx=0x7f808800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f8096a00640 1 -- 172.21.15.114:0/3859763607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088015020 con 0x7f80a00cccd0 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f8096a00640 1 -- 172.21.15.114:0/3859763607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8088011940 con 0x7f80a00cccd0 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f8096a00640 1 -- 172.21.15.114:0/3859763607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088011d90 con 0x7f80a00cccd0 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a01570c0 con 0x7f80a00cccd0 2024-09-16T07:32:28.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a0157680 con 0x7f80a00cccd0 2024-09-16T07:32:28.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a015cd00 con 0x7f80a00cccd0 2024-09-16T07:32:28.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f8096a00640 1 -- 172.21.15.114:0/3859763607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f8088018020 con 0x7f80a00cccd0 2024-09-16T07:32:28.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f8096a00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f807c072fe0 0x7f807c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:28.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f8096a00640 1 -- 172.21.15.114:0/3859763607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f8088093e10 con 0x7f80a00cccd0 2024-09-16T07:32:28.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.991+0000 7f809ea00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f807c072fe0 0x7f807c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:28.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.995+0000 7f809ea00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f807c072fe0 0x7f807c0754a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f80900af000 tx=0x7f809001b0d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:28.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:28.995+0000 7f8096a00640 1 -- 172.21.15.114:0/3859763607 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f808801f020 con 0x7f80a00cccd0 2024-09-16T07:32:29.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.163+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f80a00cdc50 con 0x7f80a00cccd0 2024-09-16T07:32:29.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f8096a00640 1 -- 172.21.15.114:0/3859763607 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f808805ef10 con 0x7f80a00cccd0 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f807c072fe0 msgr2=0x7f807c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f807c072fe0 0x7f807c0754a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f80900af000 tx=0x7f809001b0d0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 msgr2=0x7f80a0158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a0158160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f808800b440 tx=0x7f808800b900 comp rx=0 tx=0).stop 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 shutdown_connections 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f807c072fe0 0x7f807c0754a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f80a00cd0b0 0x7f80a01586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80a00cccd0 0x7f80a0158160 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 --2- 172.21.15.114:0/3859763607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80a0074880 0x7f80a00c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 >> 172.21.15.114:0/3859763607 conn(0x7f80a0073490 msgr2=0x7f80a0070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:29.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.167+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 shutdown_connections 2024-09-16T07:32:29.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.171+0000 7f809fe00640 1 -- 172.21.15.114:0/3859763607 wait complete. 2024-09-16T07:32:29.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-16T07:32:29.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 -- 172.21.15.114:0/4081404846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000b43d0 msgr2=0x7f2f000b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 --2- 172.21.15.114:0/4081404846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000b43d0 0x7f2f000b47b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009bc0 tx=0x7f2ef001cb90 comp rx=0 tx=0).stop 2024-09-16T07:32:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 -- 172.21.15.114:0/4081404846 shutdown_connections 2024-09-16T07:32:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 --2- 172.21.15.114:0/4081404846 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f0015b5e0 0x7f2f0006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 --2- 172.21.15.114:0/4081404846 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000b43d0 0x7f2f000b47b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 -- 172.21.15.114:0/4081404846 >> 172.21.15.114:0/4081404846 conn(0x7f2f000b18f0 msgr2=0x7f2f000b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 -- 172.21.15.114:0/4081404846 shutdown_connections 2024-09-16T07:32:29.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 -- 172.21.15.114:0/4081404846 wait complete. 2024-09-16T07:32:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 Processor -- start 2024-09-16T07:32:29.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.331+0000 7f2f06800640 1 -- start start 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f000b43d0 0x7f2f0009d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000cd100 0x7f2f0015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f001f9b60 0x7f2f00157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000cc9f0 con 0x7f2f000cd100 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f000cc870 con 0x7f2f000b43d0 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000ccb70 con 0x7f2f001f9b60 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000cd100 0x7f2f0015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000cd100 0x7f2f0015d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47308/0 (socket says 172.21.15.114:47308) 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 -- 172.21.15.114:0/1342944776 learned_addr learned my addr 172.21.15.114:0/1342944776 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2eff400640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f000b43d0 0x7f2f0009d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2effe00640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f001f9b60 0x7f2f00157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 -- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f001f9b60 msgr2=0x7f2f00157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:29.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f001f9b60 0x7f2f00157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 -- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f000b43d0 msgr2=0x7f2f0009d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:29.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f000b43d0 0x7f2f0009d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:29.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 -- 172.21.15.114:0/1342944776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0015c830 con 0x7f2f000cd100 2024-09-16T07:32:29.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2effe00640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f001f9b60 0x7f2f00157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:29.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2efea00640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000cd100 0x7f2f0015d5f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c420 tx=0x7f2eec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2ef7400640 1 -- 172.21.15.114:0/1342944776 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec017070 con 0x7f2f000cd100 2024-09-16T07:32:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2ef7400640 1 -- 172.21.15.114:0/1342944776 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2eec003600 con 0x7f2f000cd100 2024-09-16T07:32:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2ef7400640 1 -- 172.21.15.114:0/1342944776 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec003a50 con 0x7f2f000cd100 2024-09-16T07:32:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0015cb10 con 0x7f2f000cd100 2024-09-16T07:32:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f00158480 con 0x7f2f000cd100 2024-09-16T07:32:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f00069410 con 0x7f2f000cd100 2024-09-16T07:32:29.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.335+0000 7f2ef7400640 1 -- 172.21.15.114:0/1342944776 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f2eec01a070 con 0x7f2f000cd100 2024-09-16T07:32:29.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.339+0000 7f2ef7400640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2ee0072fe0 0x7f2ee00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:29.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.339+0000 7f2ef7400640 1 -- 172.21.15.114:0/1342944776 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f2eec093210 con 0x7f2f000cd100 2024-09-16T07:32:29.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.339+0000 7f2eff400640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2ee0072fe0 0x7f2ee00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:29.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.339+0000 7f2eff400640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2ee0072fe0 0x7f2ee00754a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00af000 tx=0x7f2ef001b3d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:29.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.343+0000 7f2ef7400640 1 -- 172.21.15.114:0/1342944776 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2eec05dcb0 con 0x7f2f000cd100 2024-09-16T07:32:29.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:29.567+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7f2f000b47b0 con 0x7f2f000cd100 2024-09-16T07:32:30.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.411+0000 7f2ef7400640 1 -- 172.21.15.114:0/1342944776 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v236) ==== 131+0+0 (secure 0 0 0) 0x7f2eec0626e0 con 0x7f2f000cd100 2024-09-16T07:32:30.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2ee0072fe0 msgr2=0x7f2ee00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2ee0072fe0 0x7f2ee00754a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00af000 tx=0x7f2ef001b3d0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000cd100 msgr2=0x7f2f0015d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000cd100 0x7f2f0015d5f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c420 tx=0x7f2eec00c8e0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 shutdown_connections 2024-09-16T07:32:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2ee0072fe0 0x7f2ee00754a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2f001f9b60 0x7f2f00157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f000cd100 0x7f2f0015d5f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 --2- 172.21.15.114:0/1342944776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f000b43d0 0x7f2f0009d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 >> 172.21.15.114:0/1342944776 conn(0x7f2f000b18f0 msgr2=0x7f2f0014bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 shutdown_connections 2024-09-16T07:32:30.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.415+0000 7f2f06800640 1 -- 172.21.15.114:0/1342944776 wait complete. 2024-09-16T07:32:30.436 INFO:tasks.cephfs_test_runner:test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-16T07:32:30.436 INFO:tasks.cephfs_test_runner:Starting test: test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) Test the creating vols, subvols subvolgroups fails when their names uses 2024-09-16T07:32:30.436 INFO:tasks.cephfs_test_runner:test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:32:30.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- 172.21.15.114:0/4033725537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 msgr2=0x7fbc640b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 --2- 172.21.15.114:0/4033725537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 0x7fbc640b5470 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009840 tx=0x7fbc4c01c820 comp rx=0 tx=0).stop 2024-09-16T07:32:30.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- 172.21.15.114:0/4033725537 shutdown_connections 2024-09-16T07:32:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 --2- 172.21.15.114:0/4033725537 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc640b59b0 0x7fbc6406f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 --2- 172.21.15.114:0/4033725537 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 0x7fbc640b5470 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- 172.21.15.114:0/4033725537 >> 172.21.15.114:0/4033725537 conn(0x7fbc6406dd30 msgr2=0x7fbc6406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- 172.21.15.114:0/4033725537 shutdown_connections 2024-09-16T07:32:30.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- 172.21.15.114:0/4033725537 wait complete. 2024-09-16T07:32:30.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 Processor -- start 2024-09-16T07:32:30.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- start start 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc640b59b0 0x7fbc640cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 0x7fbc641f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc64146b50 0x7fbc6415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6416ae50 con 0x7fbc64146b50 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6416acd0 con 0x7fbc640d16e0 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc6a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6416afd0 con 0x7fbc640b59b0 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc64146b50 0x7fbc6415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:30.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc64146b50 0x7fbc6415ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47316/0 (socket says 172.21.15.114:47316) 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 -- 172.21.15.114:0/2074403003 learned_addr learned my addr 172.21.15.114:0/2074403003 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc5aa00640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 0x7fbc641f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 -- 172.21.15.114:0/2074403003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc640b59b0 msgr2=0x7fbc640cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc640b59b0 0x7fbc640cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 -- 172.21.15.114:0/2074403003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 msgr2=0x7fbc641f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 0x7fbc641f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 -- 172.21.15.114:0/2074403003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc641f82e0 con 0x7fbc64146b50 2024-09-16T07:32:30.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc63e00640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc64146b50 0x7fbc6415ce10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e8c0 tx=0x7fbc5c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.587+0000 7fbc5be00640 1 -- 172.21.15.114:0/2074403003 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00ccc0 con 0x7fbc64146b50 2024-09-16T07:32:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc5be00640 1 -- 172.21.15.114:0/2074403003 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc5c00ce60 con 0x7fbc64146b50 2024-09-16T07:32:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc5be00640 1 -- 172.21.15.114:0/2074403003 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c004270 con 0x7fbc64146b50 2024-09-16T07:32:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc640b3570 con 0x7fbc64146b50 2024-09-16T07:32:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6415c630 con 0x7fbc64146b50 2024-09-16T07:32:30.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc6406f6b0 con 0x7fbc64146b50 2024-09-16T07:32:30.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc5be00640 1 -- 172.21.15.114:0/2074403003 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fbc5c003600 con 0x7fbc64146b50 2024-09-16T07:32:30.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc5be00640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbc40073010 0x7fbc400754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc5be00640 1 -- 172.21.15.114:0/2074403003 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7fbc5c094890 con 0x7fbc64146b50 2024-09-16T07:32:30.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.591+0000 7fbc63400640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbc40073010 0x7fbc400754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:30.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.595+0000 7fbc63400640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbc40073010 0x7fbc400754d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007fd0 tx=0x7fbc54007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:30.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.595+0000 7fbc5be00640 1 -- 172.21.15.114:0/2074403003 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbc641f82e0 con 0x7fbc64146b50 2024-09-16T07:32:30.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.767+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc6415dc60 con 0x7fbc64146b50 2024-09-16T07:32:30.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.767+0000 7fbc5be00640 1 -- 172.21.15.114:0/2074403003 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+13896 (secure 0 0 0) 0x7fbc5c05f8f0 con 0x7fbc64146b50 2024-09-16T07:32:30.766 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:30.766 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":73,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:28.807059+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/26034359":"2024-09-17T07:32:25.792026+0000","172.21.15.149:0/2583562273":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/780559649":"2024-09-17T07:32:22.331488+0000","172.21.15.149:6801/921426846":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4029777038":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/626953":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4119429621":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/582884511":"2024-09-17T07:32:22.331488+0000","172.21.15.114:6833/26034359":"2024-09-17T07:32:25.792026+0000","172.21.15.149:0/2751300545":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/4201783238":"2024-09-17T07:32:22.331488+0000","172.21.15.149:6800/921426846":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/1675603639":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2277496221":"2024-09-17T07:32:22.331488+0000","172.21.15.149:0/2006694112":"2024-09-17T07:32:22.331488+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:30.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbc40073010 msgr2=0x7fbc400754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbc40073010 0x7fbc400754d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbc54007fd0 tx=0x7fbc54007d40 comp rx=0 tx=0).stop 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc64146b50 msgr2=0x7fbc6415ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc64146b50 0x7fbc6415ce10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e8c0 tx=0x7fbc5c00ed80 comp rx=0 tx=0).stop 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 shutdown_connections 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc64146b50 0x7fbc6415ce10 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc640d16e0 0x7fbc641f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbc40073010 0x7fbc400754d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 --2- 172.21.15.114:0/2074403003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbc640b59b0 0x7fbc640cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 >> 172.21.15.114:0/2074403003 conn(0x7fbc6406dd30 msgr2=0x7fbc6406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 shutdown_connections 2024-09-16T07:32:30.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.771+0000 7fbc6a800640 1 -- 172.21.15.114:0/2074403003 wait complete. 2024-09-16T07:32:30.789 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:32:30.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:32:30.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 -- 172.21.15.114:0/251734658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c15f340 msgr2=0x7f318c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 --2- 172.21.15.114:0/251734658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c15f340 0x7f318c0b34a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f318c073ef0 tx=0x7f318001c7d0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 -- 172.21.15.114:0/251734658 shutdown_connections 2024-09-16T07:32:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 --2- 172.21.15.114:0/251734658 >> v2:172.21.15.149:3300/0 conn(0x7f318c0b2a00 0x7f318c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 --2- 172.21.15.114:0/251734658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c15f340 0x7f318c0b34a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 -- 172.21.15.114:0/251734658 >> 172.21.15.114:0/251734658 conn(0x7f318c0d1e00 msgr2=0x7f318c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 -- 172.21.15.114:0/251734658 shutdown_connections 2024-09-16T07:32:30.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 -- 172.21.15.114:0/251734658 wait complete. 2024-09-16T07:32:30.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 Processor -- start 2024-09-16T07:32:30.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.935+0000 7f3194000640 1 -- start start 2024-09-16T07:32:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c0b2a00 0x7f318c157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f318c0ccf10 0x7f318c14ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f318c15f340 0x7f318c163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f318c1690c0 con 0x7f318c0b2a00 2024-09-16T07:32:30.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f318c168f40 con 0x7f318c0ccf10 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f318c169240 con 0x7f318c15f340 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c0b2a00 0x7f318c157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c0b2a00 0x7f318c157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47322/0 (socket says 172.21.15.114:47322) 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 -- 172.21.15.114:0/2215487301 learned_addr learned my addr 172.21.15.114:0/2215487301 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 -- 172.21.15.114:0/2215487301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f318c15f340 msgr2=0x7f318c163ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f318c15f340 0x7f318c163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 -- 172.21.15.114:0/2215487301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f318c0ccf10 msgr2=0x7f318c14ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f318c0ccf10 0x7f318c14ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:30.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 -- 172.21.15.114:0/2215487301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c0b6000 con 0x7f318c0b2a00 2024-09-16T07:32:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3191600640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c0b2a00 0x7f318c157270 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3180000c10 tx=0x7f3180004220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3189600640 1 -- 172.21.15.114:0/2215487301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31800bb070 con 0x7f318c0b2a00 2024-09-16T07:32:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3189600640 1 -- 172.21.15.114:0/2215487301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3180005120 con 0x7f318c0b2a00 2024-09-16T07:32:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3189600640 1 -- 172.21.15.114:0/2215487301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31800b2040 con 0x7f318c0b2a00 2024-09-16T07:32:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318c157df0 con 0x7f318c0b2a00 2024-09-16T07:32:30.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318c0b62c0 con 0x7f318c0b2a00 2024-09-16T07:32:30.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318c0cd340 con 0x7f318c0b2a00 2024-09-16T07:32:30.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.939+0000 7f3189600640 1 -- 172.21.15.114:0/2215487301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f31800054f0 con 0x7f318c0b2a00 2024-09-16T07:32:30.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.943+0000 7f3189600640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f316c072fe0 0x7f316c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:30.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.943+0000 7f3189600640 1 -- 172.21.15.114:0/2215487301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f318012d9e0 con 0x7f318c0b2a00 2024-09-16T07:32:30.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.943+0000 7f3190c00640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f316c072fe0 0x7f316c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:30.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.943+0000 7f3190c00640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f316c072fe0 0x7f316c0754a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f318c166350 tx=0x7f3178005c80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:30.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:30.947+0000 7f3189600640 1 -- 172.21.15.114:0/2215487301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f31800f20b0 con 0x7f318c0b2a00 2024-09-16T07:32:31.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.111+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f318c158dd0 con 0x7f318c0b2a00 2024-09-16T07:32:31.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.111+0000 7f3189600640 1 -- 172.21.15.114:0/2215487301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f31800163f0 con 0x7f318c0b2a00 2024-09-16T07:32:31.110 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:32:31.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f316c072fe0 msgr2=0x7f316c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:31.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f316c072fe0 0x7f316c0754a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f318c166350 tx=0x7f3178005c80 comp rx=0 tx=0).stop 2024-09-16T07:32:31.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c0b2a00 msgr2=0x7f318c157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:31.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c0b2a00 0x7f318c157270 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3180000c10 tx=0x7f3180004220 comp rx=0 tx=0).stop 2024-09-16T07:32:31.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 shutdown_connections 2024-09-16T07:32:31.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f316c072fe0 0x7f316c0754a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f318c15f340 0x7f318c163ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f318c0ccf10 0x7f318c14ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 --2- 172.21.15.114:0/2215487301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f318c0b2a00 0x7f318c157270 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 >> 172.21.15.114:0/2215487301 conn(0x7f318c0d1e00 msgr2=0x7f318c0b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:31.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 shutdown_connections 2024-09-16T07:32:31.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.115+0000 7f3194000640 1 -- 172.21.15.114:0/2215487301 wait complete. 2024-09-16T07:32:31.132 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- 172.21.15.114:0/1015892376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080b2d00 msgr2=0x7fd30815fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1015892376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080b2d00 0x7fd30815fec0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd308073a90 tx=0x7fd2f001c7d0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- 172.21.15.114:0/1015892376 shutdown_connections 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1015892376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080b2d00 0x7fd30815fec0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1015892376 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd308160400 0x7fd308160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1015892376 >> v2:172.21.15.149:3300/0 conn(0x7fd3080cfe80 0x7fd3080d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- 172.21.15.114:0/1015892376 >> 172.21.15.114:0/1015892376 conn(0x7fd3080d1e40 msgr2=0x7fd3080d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- 172.21.15.114:0/1015892376 shutdown_connections 2024-09-16T07:32:31.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- 172.21.15.114:0/1015892376 wait complete. 2024-09-16T07:32:31.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 Processor -- start 2024-09-16T07:32:31.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- start start 2024-09-16T07:32:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3080b2d00 0x7fd3081527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080cfe80 0x7fd3080b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:31.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd308160400 0x7fd3081515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd3080b2880 con 0x7fd3080cfe80 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3080b2700 con 0x7fd3080b2d00 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd3080b2a00 con 0x7fd308160400 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080cfe80 0x7fd3080b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd2ff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080cfe80 0x7fd3080b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47336/0 (socket says 172.21.15.114:47336) 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd2ff400640 1 -- 172.21.15.114:0/1227817767 learned_addr learned my addr 172.21.15.114:0/1227817767 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd307e00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3080b2d00 0x7fd3081527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:31.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.279+0000 7fd30ca00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd308160400 0x7fd3081515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd2ff400640 1 -- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd308160400 msgr2=0x7fd3081515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd2ff400640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd308160400 0x7fd3081515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd2ff400640 1 -- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3080b2d00 msgr2=0x7fd3081527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd2ff400640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3080b2d00 0x7fd3081527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd2ff400640 1 -- 172.21.15.114:0/1227817767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3080b51b0 con 0x7fd3080cfe80 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd30ca00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd308160400 0x7fd3081515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd2ff400640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080cfe80 0x7fd3080b4c70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd2f001ccb0 tx=0x7fd2f00a6520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd304c00640 1 -- 172.21.15.114:0/1227817767 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00ac070 con 0x7fd3080cfe80 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd304c00640 1 -- 172.21.15.114:0/1227817767 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2f00050c0 con 0x7fd3080cfe80 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd308152f30 con 0x7fd3080cfe80 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd304c00640 1 -- 172.21.15.114:0/1227817767 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0005510 con 0x7fd3080cfe80 2024-09-16T07:32:31.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd308158020 con 0x7fd3080cfe80 2024-09-16T07:32:31.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3080c8950 con 0x7fd3080cfe80 2024-09-16T07:32:31.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd304c00640 1 -- 172.21.15.114:0/1227817767 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fd2f00af070 con 0x7fd3080cfe80 2024-09-16T07:32:31.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.283+0000 7fd304c00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd2e4072fe0 0x7fd2e40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:31.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.287+0000 7fd304c00640 1 -- 172.21.15.114:0/1227817767 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7fd2f012e690 con 0x7fd3080cfe80 2024-09-16T07:32:31.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.287+0000 7fd307e00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd2e4072fe0 0x7fd2e40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:31.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.287+0000 7fd307e00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd2e4072fe0 0x7fd2e40754a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c54c0 tx=0x7fd2f800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:31.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.287+0000 7fd304c00640 1 -- 172.21.15.114:0/1227817767 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd2f00164b0 con 0x7fd3080cfe80 2024-09-16T07:32:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:31.519+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7fd3080d0260 con 0x7fd3080cfe80 2024-09-16T07:32:32.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.419+0000 7fd304c00640 1 -- 172.21.15.114:0/1227817767 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v238) ==== 149+0+0 (secure 0 0 0) 0x7fd2f00f90b0 con 0x7fd3080cfe80 2024-09-16T07:32:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd2e4072fe0 msgr2=0x7fd2e40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd2e4072fe0 0x7fd2e40754a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c54c0 tx=0x7fd2f800b2e0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080cfe80 msgr2=0x7fd3080b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080cfe80 0x7fd3080b4c70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd2f001ccb0 tx=0x7fd2f00a6520 comp rx=0 tx=0).stop 2024-09-16T07:32:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 shutdown_connections 2024-09-16T07:32:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd2e4072fe0 0x7fd2e40754a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd308160400 0x7fd3081515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3080cfe80 0x7fd3080b4c70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 --2- 172.21.15.114:0/1227817767 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3080b2d00 0x7fd3081527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 >> 172.21.15.114:0/1227817767 conn(0x7fd3080d1e40 msgr2=0x7fd3080cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 shutdown_connections 2024-09-16T07:32:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.423+0000 7fd30ea00640 1 -- 172.21.15.114:0/1227817767 wait complete. 2024-09-16T07:32:32.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:32:32.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 -- 172.21.15.114:0/84619063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006cc20 msgr2=0x7fc60006d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 --2- 172.21.15.114:0/84619063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006cc20 0x7fc60006d090 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009c80 tx=0x7fc5f801cd70 comp rx=0 tx=0).stop 2024-09-16T07:32:32.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 -- 172.21.15.114:0/84619063 shutdown_connections 2024-09-16T07:32:32.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 --2- 172.21.15.114:0/84619063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006cc20 0x7fc60006d090 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 -- 172.21.15.114:0/84619063 >> 172.21.15.114:0/84619063 conn(0x7fc6000d0cd0 msgr2=0x7fc6000d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:32.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 -- 172.21.15.114:0/84619063 shutdown_connections 2024-09-16T07:32:32.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 -- 172.21.15.114:0/84619063 wait complete. 2024-09-16T07:32:32.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 Processor -- start 2024-09-16T07:32:32.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.591+0000 7fc605c00640 1 -- start start 2024-09-16T07:32:32.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006cc20 0x7fc6000ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006fff0 0x7fc600157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6000b6350 0x7fc60014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc60016a240 con 0x7fc60006fff0 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc60016a0c0 con 0x7fc6000b6350 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc60016a3c0 con 0x7fc60006cc20 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006fff0 0x7fc600157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006fff0 0x7fc600157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47354/0 (socket says 172.21.15.114:47354) 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 -- 172.21.15.114:0/232017021 learned_addr learned my addr 172.21.15.114:0/232017021 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5ff400640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6000b6350 0x7fc60014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 -- 172.21.15.114:0/232017021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006cc20 msgr2=0x7fc6000ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006cc20 0x7fc6000ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 -- 172.21.15.114:0/232017021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6000b6350 msgr2=0x7fc60014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6000b6350 0x7fc60014fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 -- 172.21.15.114:0/232017021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6000cede0 con 0x7fc60006fff0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5fe000640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006fff0 0x7fc600157bd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c500 tx=0x7fc5ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5f6a00640 1 -- 172.21.15.114:0/232017021 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec017070 con 0x7fc60006fff0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5f6a00640 1 -- 172.21.15.114:0/232017021 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5ec003600 con 0x7fc60006fff0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5f6a00640 1 -- 172.21.15.114:0/232017021 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec003a90 con 0x7fc60006fff0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc600152ad0 con 0x7fc60006fff0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc600153380 con 0x7fc60006fff0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60006d090 con 0x7fc60006fff0 2024-09-16T07:32:32.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.595+0000 7fc5f6a00640 1 -- 172.21.15.114:0/232017021 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc5ec01a070 con 0x7fc60006fff0 2024-09-16T07:32:32.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.599+0000 7fc5f6a00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5e0073010 0x7fc5e00754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.599+0000 7fc5f6a00640 1 -- 172.21.15.114:0/232017021 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7fc5ec0933f0 con 0x7fc60006fff0 2024-09-16T07:32:32.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.599+0000 7fc5fea00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5e0073010 0x7fc5e00754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:32.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.599+0000 7fc5fea00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5e0073010 0x7fc5e00754d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009670 tx=0x7fc5f0006bd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:32.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.603+0000 7fc5f6a00640 1 -- 172.21.15.114:0/232017021 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc5ec05e5a0 con 0x7fc60006fff0 2024-09-16T07:32:32.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc600153550 con 0x7fc60006fff0 2024-09-16T07:32:32.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc5f6a00640 1 -- 172.21.15.114:0/232017021 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+1998 (secure 0 0 0) 0x7fc5ec05dea0 con 0x7fc60006fff0 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:32:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:32:32.770 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:32:32.771 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:32:32.771 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:32:32.771 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:32:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5e0073010 msgr2=0x7fc5e00754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5e0073010 0x7fc5e00754d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009670 tx=0x7fc5f0006bd0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006fff0 msgr2=0x7fc600157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006fff0 0x7fc600157bd0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c500 tx=0x7fc5ec00c9c0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 shutdown_connections 2024-09-16T07:32:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6000b6350 0x7fc60014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc60006fff0 0x7fc600157bd0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5e0073010 0x7fc5e00754d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 --2- 172.21.15.114:0/232017021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc60006cc20 0x7fc6000ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 >> 172.21.15.114:0/232017021 conn(0x7fc6000d0cd0 msgr2=0x7fc60015d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:32.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 shutdown_connections 2024-09-16T07:32:32.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.771+0000 7fc605c00640 1 -- 172.21.15.114:0/232017021 wait complete. 2024-09-16T07:32:32.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:32:32.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 -- 172.21.15.114:0/3185236000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea70003ff0 msgr2=0x7fea70004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 --2- 172.21.15.114:0/3185236000 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea70003ff0 0x7fea70004810 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fea74009b60 tx=0x7fea7401d270 comp rx=0 tx=0).stop 2024-09-16T07:32:32.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea8e400640 1 -- 172.21.15.114:0/3185236000 reap_dead start 2024-09-16T07:32:32.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 -- 172.21.15.114:0/3185236000 shutdown_connections 2024-09-16T07:32:32.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 -- 172.21.15.114:0/3185236000 >> 172.21.15.114:0/3185236000 conn(0x7fea880d1dd0 msgr2=0x7fea880d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:32.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 -- 172.21.15.114:0/3185236000 shutdown_connections 2024-09-16T07:32:32.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 -- 172.21.15.114:0/3185236000 wait complete. 2024-09-16T07:32:32.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 Processor -- start 2024-09-16T07:32:32.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.935+0000 7fea90400640 1 -- start start 2024-09-16T07:32:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea70003ff0 0x7fea880c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea880b7960 0x7fea880c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea880c6810 0x7fea8815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fea880b0cd0 con 0x7fea880c6810 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea880b06d0 con 0x7fea880b7960 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea880b0e50 con 0x7fea70003ff0 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea880c6810 0x7fea8815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea880c6810 0x7fea8815ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47376/0 (socket says 172.21.15.114:47376) 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 -- 172.21.15.114:0/3202253822 learned_addr learned my addr 172.21.15.114:0/3202253822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 -- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea70003ff0 msgr2=0x7fea880c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8d000640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea880b7960 0x7fea880c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea70003ff0 0x7fea880c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 -- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea880b7960 msgr2=0x7fea880c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea880b7960 0x7fea880c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 -- 172.21.15.114:0/3202253822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea881f4a90 con 0x7fea880c6810 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8d000640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea880b7960 0x7fea880c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea8e400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea880c6810 0x7fea8815ec20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fea800015b0 tx=0x7fea8000fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea85600640 1 -- 172.21.15.114:0/3202253822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8001b070 con 0x7fea880c6810 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea85600640 1 -- 172.21.15.114:0/3202253822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea8000d920 con 0x7fea880c6810 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea85600640 1 -- 172.21.15.114:0/3202253822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8000dd70 con 0x7fea880c6810 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea881f4d30 con 0x7fea880c6810 2024-09-16T07:32:32.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea881f52f0 con 0x7fea880c6810 2024-09-16T07:32:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.939+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea880affc0 con 0x7fea880c6810 2024-09-16T07:32:32.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.943+0000 7fea85600640 1 -- 172.21.15.114:0/3202253822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fea8000a0d0 con 0x7fea880c6810 2024-09-16T07:32:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.943+0000 7fea85600640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea68073010 0x7fea680754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.943+0000 7fea85600640 1 -- 172.21.15.114:0/3202253822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7fea80096480 con 0x7fea880c6810 2024-09-16T07:32:32.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.943+0000 7fea8da00640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea68073010 0x7fea680754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:32.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.943+0000 7fea8da00640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea68073010 0x7fea680754d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea7c006540 tx=0x7fea7c006af0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:32.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:32.947+0000 7fea85600640 1 -- 172.21.15.114:0/3202253822 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fea80061570 con 0x7fea880c6810 2024-09-16T07:32:33.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.111+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fea880d1080 con 0x7fea880c6810 2024-09-16T07:32:33.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.115+0000 7fea85600640 1 -- 172.21.15.114:0/3202253822 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fea80060e70 con 0x7fea880c6810 2024-09-16T07:32:33.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea68073010 msgr2=0x7fea680754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea68073010 0x7fea680754d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea7c006540 tx=0x7fea7c006af0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea880c6810 msgr2=0x7fea8815ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea880c6810 0x7fea8815ec20 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fea800015b0 tx=0x7fea8000fb90 comp rx=0 tx=0).stop 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 shutdown_connections 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea880c6810 0x7fea8815ec20 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea880b7960 0x7fea880c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea68073010 0x7fea680754d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 --2- 172.21.15.114:0/3202253822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea70003ff0 0x7fea880c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 >> 172.21.15.114:0/3202253822 conn(0x7fea880d1dd0 msgr2=0x7fea88071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 shutdown_connections 2024-09-16T07:32:33.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.119+0000 7fea90400640 1 -- 172.21.15.114:0/3202253822 wait complete. 2024-09-16T07:32:33.137 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:32:33.137 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:32:33.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:32:33.318 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:32:33.318 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:33.319 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:33.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:32:33.327 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:33.327 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:33.336 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:32:33.337 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:33.337 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:33.383 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:32:33.384 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:33.384 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:33.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:32:33.393 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:32:33.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:33.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- 172.21.15.114:0/4066294799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d806f8c0 msgr2=0x7f17d806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:33.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 --2- 172.21.15.114:0/4066294799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d806f8c0 0x7f17d806fca0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009c80 tx=0x7f17c801d5b0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- 172.21.15.114:0/4066294799 shutdown_connections 2024-09-16T07:32:33.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 --2- 172.21.15.114:0/4066294799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d806f8c0 0x7f17d806fca0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- 172.21.15.114:0/4066294799 >> 172.21.15.114:0/4066294799 conn(0x7f17d80b18f0 msgr2=0x7f17d80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:33.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- 172.21.15.114:0/4066294799 shutdown_connections 2024-09-16T07:32:33.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- 172.21.15.114:0/4066294799 wait complete. 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 Processor -- start 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- start start 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17d806f8c0 0x7f17d81fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d80b3d30 0x7f17d80745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17d80cc740 0x7f17d8156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17d8169ca0 con 0x7f17d80b3d30 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f17d8169b20 con 0x7f17d806f8c0 2024-09-16T07:32:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17dce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f17d8169e20 con 0x7f17d80cc740 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d80b3d30 0x7f17d80745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d80b3d30 0x7f17d80745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47394/0 (socket says 172.21.15.114:47394) 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 -- 172.21.15.114:0/1012682235 learned_addr learned my addr 172.21.15.114:0/1012682235 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5e00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17d806f8c0 0x7f17d81fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d6800640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17d80cc740 0x7f17d8156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 -- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17d80cc740 msgr2=0x7f17d8156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17d80cc740 0x7f17d8156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 -- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17d806f8c0 msgr2=0x7f17d81fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17d806f8c0 0x7f17d81fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.575+0000 7f17d5400640 1 -- 172.21.15.114:0/1012682235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d81f7ee0 con 0x7f17d80b3d30 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17d5400640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d80b3d30 0x7f17d80745c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c420 tx=0x7f17c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:33.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17ce000640 1 -- 172.21.15.114:0/1012682235 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4017070 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17ce000640 1 -- 172.21.15.114:0/1012682235 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17c40053c0 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17ce000640 1 -- 172.21.15.114:0/1012682235 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4003860 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d81f81c0 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d81f8780 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d8069410 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17ce000640 1 -- 172.21.15.114:0/1012682235 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f17c401a070 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17ce000640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f17b8072fe0 0x7f17b80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17ce000640 1 -- 172.21.15.114:0/1012682235 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f17c40932b0 con 0x7f17d80b3d30 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.579+0000 7f17d5e00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f17b8072fe0 0x7f17b80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:33.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.583+0000 7f17d5e00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f17b8072fe0 0x7f17b80754a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17c80af000 tx=0x7f17c801bdf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:33.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.583+0000 7f17ce000640 1 -- 172.21.15.114:0/1012682235 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f17c405dd50 con 0x7f17d80b3d30 2024-09-16T07:32:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.783+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17d80cd3d0 con 0x7f17d80b3d30 2024-09-16T07:32:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17ce000640 1 -- 172.21.15.114:0/1012682235 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+3923 (secure 0 0 0) 0x7f17c4062780 con 0x7f17d80b3d30 2024-09-16T07:32:33.784 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:33.784 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":50,"btime":"2024-09-16T07:32:26:794731+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5959,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/4185604353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":4185604353},{"type":"v1","addr":"172.21.15.149:6835","nonce":4185604353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/1112333960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":1112333960},{"type":"v1","addr":"172.21.15.149:6837","nonce":1112333960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6165,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3768377225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3768377225},{"type":"v1","addr":"172.21.15.114:6834","nonce":3768377225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3609506049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3609506049},{"type":"v1","addr":"172.21.15.114:6835","nonce":3609506049}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[]} 2024-09-16T07:32:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 50 2024-09-16T07:32:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f17b8072fe0 msgr2=0x7f17b80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f17b8072fe0 0x7f17b80754a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f17c80af000 tx=0x7f17c801bdf0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d80b3d30 msgr2=0x7f17d80745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d80b3d30 0x7f17d80745c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c420 tx=0x7f17c400c8e0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 shutdown_connections 2024-09-16T07:32:33.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f17b8072fe0 0x7f17b80754a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17d80cc740 0x7f17d8156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17d80b3d30 0x7f17d80745c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 --2- 172.21.15.114:0/1012682235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17d806f8c0 0x7f17d81fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:33.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 >> 172.21.15.114:0/1012682235 conn(0x7f17d80b18f0 msgr2=0x7f17d815dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:33.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 shutdown_connections 2024-09-16T07:32:33.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:33.787+0000 7f17dce00640 1 -- 172.21.15.114:0/1012682235 wait complete. 2024-09-16T07:32:33.806 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:32:33.806 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:32:33.806 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:32:33.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:32:33.807 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:32:33.807 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:32:33.807 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:32:33.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:32:33.807 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:32:33.807 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:32:33.808 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:32:33.808 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:32:33.808 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:32:33.808 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:32:33.808 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:32:33.808 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:32:33.818 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:32:33.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:32:33.820 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:32:33.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:32:33.829 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:32:33.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:32:33.829 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:32:33.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:32:33.866 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:32:33.866 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:33.868 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:32:33.868 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:33.874 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:32:33.875 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:33.876 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:32:33.876 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:33.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:32:33.953 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:32:33.953 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:32:33.966 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:32:33.966 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:32:33.967 INFO:tasks.ceph.mds.d.smithi149.stderr:2024-09-16T07:32:33.963+0000 7f55f0c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 -- 172.21.15.114:0/3600790937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a015be80 msgr2=0x7f47a00ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 --2- 172.21.15.114:0/3600790937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a015be80 0x7f47a00ce4e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4794009bc0 tx=0x7f479401cba0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 -- 172.21.15.114:0/3600790937 shutdown_connections 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 --2- 172.21.15.114:0/3600790937 >> v2:172.21.15.149:3300/0 conn(0x7f47a00cd8c0 0x7f47a00cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 --2- 172.21.15.114:0/3600790937 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a015be80 0x7f47a00ce4e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 -- 172.21.15.114:0/3600790937 >> 172.21.15.114:0/3600790937 conn(0x7f47a00d1da0 msgr2=0x7f47a00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 -- 172.21.15.114:0/3600790937 shutdown_connections 2024-09-16T07:32:34.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 -- 172.21.15.114:0/3600790937 wait complete. 2024-09-16T07:32:34.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 Processor -- start 2024-09-16T07:32:34.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.031+0000 7f47a7e00640 1 -- start start 2024-09-16T07:32:34.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a00cd8c0 0x7f47a01573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a00d28c0 0x7f47a0159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47a015be80 0x7f47a00c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0168de0 con 0x7f47a015be80 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47a0168c60 con 0x7f47a00d28c0 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47a0168f60 con 0x7f47a00cd8c0 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a00d28c0 0x7f47a0159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a00cd8c0 0x7f47a01573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47a015be80 0x7f47a00c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a00d28c0 0x7f47a0159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:47354/0 (socket says 172.21.15.114:47354) 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47a015be80 0x7f47a00c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47424/0 (socket says 172.21.15.114:47424) 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5e00640 1 -- 172.21.15.114:0/1808234118 learned_addr learned my addr 172.21.15.114:0/1808234118 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a00cd8c0 0x7f47a01573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:33614/0 (socket says 172.21.15.114:33614) 2024-09-16T07:32:34.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 -- 172.21.15.114:0/1808234118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a00d28c0 msgr2=0x7f47a0159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a00d28c0 0x7f47a0159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 -- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47a015be80 msgr2=0x7f47a00c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47a015be80 0x7f47a00c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 -- 172.21.15.114:0/1808234118 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a006de60 con 0x7f47a00cd8c0 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a5400640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a00cd8c0 0x7f47a01573f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f47940ac000 tx=0x7f4794009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f479d600640 1 -- 172.21.15.114:0/1808234118 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47940b2040 con 0x7f47a00cd8c0 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f479d600640 1 -- 172.21.15.114:0/1808234118 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4794004c50 con 0x7f47a00cd8c0 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f479d600640 1 -- 172.21.15.114:0/1808234118 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794004260 con 0x7f47a00cd8c0 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a006e140 con 0x7f47a00cd8c0 2024-09-16T07:32:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a00c6820 con 0x7f47a00cd8c0 2024-09-16T07:32:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.035+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a00b53f0 con 0x7f47a00cd8c0 2024-09-16T07:32:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.039+0000 7f479d600640 1 -- 172.21.15.114:0/1808234118 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f47940a5d10 con 0x7f47a00cd8c0 2024-09-16T07:32:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.039+0000 7f479d600640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4780072fe0 0x7f47800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.039+0000 7f479d600640 1 -- 172.21.15.114:0/1808234118 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f479412dae0 con 0x7f47a00cd8c0 2024-09-16T07:32:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.039+0000 7f47a4a00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4780072fe0 0x7f47800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.039+0000 7f47a4a00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4780072fe0 0x7f47800754a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47a015f490 tx=0x7f478c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.043+0000 7f479d600640 1 -- 172.21.15.114:0/1808234118 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4794016790 con 0x7f47a00cd8c0 2024-09-16T07:32:34.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.219+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f47a00b7470 con 0x7f47a00cd8c0 2024-09-16T07:32:34.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.439+0000 7f479d600640 1 -- 172.21.15.114:0/1808234118 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) ==== 97+0+0 (secure 0 0 0) 0x7f47940f8580 con 0x7f47a00cd8c0 2024-09-16T07:32:34.439 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:32:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4780072fe0 msgr2=0x7f47800754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4780072fe0 0x7f47800754a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47a015f490 tx=0x7f478c009040 comp rx=0 tx=0).stop 2024-09-16T07:32:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a00cd8c0 msgr2=0x7f47a01573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a00cd8c0 0x7f47a01573f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f47940ac000 tx=0x7f4794009280 comp rx=0 tx=0).stop 2024-09-16T07:32:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 shutdown_connections 2024-09-16T07:32:34.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47a015be80 0x7f47a00c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47a00d28c0 0x7f47a0159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4780072fe0 0x7f47800754a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 --2- 172.21.15.114:0/1808234118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47a00cd8c0 0x7f47a01573f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 >> 172.21.15.114:0/1808234118 conn(0x7f47a00d1da0 msgr2=0x7f47a00b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 shutdown_connections 2024-09-16T07:32:34.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.443+0000 7f47a7e00640 1 -- 172.21.15.114:0/1808234118 wait complete. 2024-09-16T07:32:34.463 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:32:34.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- 172.21.15.114:0/945162882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6500039f0 msgr2=0x7fb650003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 --2- 172.21.15.114:0/945162882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6500039f0 0x7fb650003e10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c700 tx=0x7fb65c01c690 comp rx=0 tx=0).stop 2024-09-16T07:32:34.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb66b200640 1 -- 172.21.15.114:0/945162882 reap_dead start 2024-09-16T07:32:34.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- 172.21.15.114:0/945162882 shutdown_connections 2024-09-16T07:32:34.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- 172.21.15.114:0/945162882 >> 172.21.15.114:0/945162882 conn(0x7fb66c06dd30 msgr2=0x7fb66c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:34.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- 172.21.15.114:0/945162882 shutdown_connections 2024-09-16T07:32:34.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- 172.21.15.114:0/945162882 wait complete. 2024-09-16T07:32:34.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 Processor -- start 2024-09-16T07:32:34.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- start start 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6500039f0 0x7fb66c165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb66c155860 0x7fb66c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb66c158890 0x7fb66c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c167c90 con 0x7fb66c158890 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c167b10 con 0x7fb66c155860 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.607+0000 7fb670a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c167e10 con 0x7fb6500039f0 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb66c158890 0x7fb66c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb66c158890 0x7fb66c158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36408/0 (socket says 172.21.15.114:36408) 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 -- 172.21.15.114:0/1484252483 learned_addr learned my addr 172.21.15.114:0/1484252483 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66a800640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6500039f0 0x7fb66c165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb661e00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb66c155860 0x7fb66c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 -- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6500039f0 msgr2=0x7fb66c165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6500039f0 0x7fb66c165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 -- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb66c155860 msgr2=0x7fb66c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb66c155860 0x7fb66c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 -- 172.21.15.114:0/1484252483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c159250 con 0x7fb66c158890 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb661e00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb66c155860 0x7fb66c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb66b200640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb66c158890 0x7fb66c158d10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb66c073740 tx=0x7fb66400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb663400640 1 -- 172.21.15.114:0/1484252483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66400c990 con 0x7fb66c158890 2024-09-16T07:32:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb663400640 1 -- 172.21.15.114:0/1484252483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb664017070 con 0x7fb66c158890 2024-09-16T07:32:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb663400640 1 -- 172.21.15.114:0/1484252483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb664011460 con 0x7fb66c158890 2024-09-16T07:32:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c0b6700 con 0x7fb66c158890 2024-09-16T07:32:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c158390 con 0x7fb66c158890 2024-09-16T07:32:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66c0739a0 con 0x7fb66c158890 2024-09-16T07:32:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.611+0000 7fb663400640 1 -- 172.21.15.114:0/1484252483 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fb664011810 con 0x7fb66c158890 2024-09-16T07:32:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.615+0000 7fb663400640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb648073010 0x7fb6480754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.615+0000 7fb663400640 1 -- 172.21.15.114:0/1484252483 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7fb664094340 con 0x7fb66c158890 2024-09-16T07:32:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.615+0000 7fb66a800640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb648073010 0x7fb6480754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.615+0000 7fb66a800640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb648073010 0x7fb6480754d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6500057f0 tx=0x7fb65c019430 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.619+0000 7fb663400640 1 -- 172.21.15.114:0/1484252483 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb66405f620 con 0x7fb66c158890 2024-09-16T07:32:34.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.839+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb66c0b5ff0 con 0x7fb66c158890 2024-09-16T07:32:34.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.839+0000 7fb663400640 1 -- 172.21.15.114:0/1484252483 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7fb66405ef20 con 0x7fb66c158890 2024-09-16T07:32:34.840 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:34.840 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:32:34.840 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:32:34.840 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.840 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:32:34.840 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:32:34.840 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.841 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.842 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.843 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:32:34.844 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.845 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.846 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.847 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.848 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.849 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:32:34.850 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.851 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:32:34.852 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:32:34.853 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:32:34.854 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:32:34.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb648073010 msgr2=0x7fb6480754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb648073010 0x7fb6480754d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6500057f0 tx=0x7fb65c019430 comp rx=0 tx=0).stop 2024-09-16T07:32:34.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb66c158890 msgr2=0x7fb66c158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:34.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb66c158890 0x7fb66c158d10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb66c073740 tx=0x7fb66400ecf0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 shutdown_connections 2024-09-16T07:32:34.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb66c158890 0x7fb66c158d10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb66c155860 0x7fb66c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb648073010 0x7fb6480754d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 --2- 172.21.15.114:0/1484252483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6500039f0 0x7fb66c165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:34.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 >> 172.21.15.114:0/1484252483 conn(0x7fb66c06dd30 msgr2=0x7fb66c15a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:34.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 shutdown_connections 2024-09-16T07:32:34.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:34.843+0000 7fb670a00640 1 -- 172.21.15.114:0/1484252483 wait complete. 2024-09-16T07:32:34.861 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:32:35.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1602468875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 msgr2=0x7f5f3406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1602468875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f3406e740 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5f34161c00 tx=0x7f5f2401ccf0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1602468875 shutdown_connections 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1602468875 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f340b11d0 0x7f5f340afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1602468875 >> v2:172.21.15.149:3300/0 conn(0x7f5f3415e330 0x7f5f3406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1602468875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f3406e740 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1602468875 >> 172.21.15.114:0/1602468875 conn(0x7f5f340d1dc0 msgr2=0x7f5f340d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1602468875 shutdown_connections 2024-09-16T07:32:35.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.003+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1602468875 wait complete. 2024-09-16T07:32:35.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 Processor -- start 2024-09-16T07:32:35.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 -- start start 2024-09-16T07:32:35.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f340b11d0 0x7f5f340c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f34155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3415e330 0x7f5f341562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5f340b2f30 con 0x7f5f3415df50 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5f340b2db0 con 0x7f5f3415e330 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5f340b30b0 con 0x7f5f340b11d0 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f34155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f34155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36420/0 (socket says 172.21.15.114:36420) 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 -- 172.21.15.114:0/1721078279 learned_addr learned my addr 172.21.15.114:0/1721078279 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f33e00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f340b11d0 0x7f5f340c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f38c00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3415e330 0x7f5f341562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 -- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f340b11d0 msgr2=0x7f5f340c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f340b11d0 0x7f5f340c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 -- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3415e330 msgr2=0x7f5f341562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3415e330 0x7f5f341562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 -- 172.21.15.114:0/1721078279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f340c8c90 con 0x7f5f3415df50 2024-09-16T07:32:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f33e00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f340b11d0 0x7f5f340c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f2b400640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f34155d70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00e7a0 tx=0x7f5f1c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:35.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f30c00640 1 -- 172.21.15.114:0/1721078279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00ccc0 con 0x7f5f3415df50 2024-09-16T07:32:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f30c00640 1 -- 172.21.15.114:0/1721078279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f1c010430 con 0x7f5f3415df50 2024-09-16T07:32:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f30c00640 1 -- 172.21.15.114:0/1721078279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c010860 con 0x7f5f3415df50 2024-09-16T07:32:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f340c76f0 con 0x7f5f3415df50 2024-09-16T07:32:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f340c7c70 con 0x7f5f3415df50 2024-09-16T07:32:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.007+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f340b35d0 con 0x7f5f3415df50 2024-09-16T07:32:35.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.011+0000 7f5f30c00640 1 -- 172.21.15.114:0/1721078279 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f5f1c010a00 con 0x7f5f3415df50 2024-09-16T07:32:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.011+0000 7f5f30c00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f10072fe0 0x7f5f100754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.011+0000 7f5f30c00640 1 -- 172.21.15.114:0/1721078279 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f5f1c0947f0 con 0x7f5f3415df50 2024-09-16T07:32:35.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.011+0000 7f5f33e00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f10072fe0 0x7f5f100754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.011+0000 7f5f33e00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f10072fe0 0x7f5f100754a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f240af000 tx=0x7f5f2401b530 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:35.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.015+0000 7f5f30c00640 1 -- 172.21.15.114:0/1721078279 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5f340c8c90 con 0x7f5f3415df50 2024-09-16T07:32:35.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5f340b4dc0 con 0x7f5f3415df50 2024-09-16T07:32:35.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f30c00640 1 -- 172.21.15.114:0/1721078279 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f5f1c05fad0 con 0x7f5f3415df50 2024-09-16T07:32:35.181 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:35.181 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:32:35.181 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:35.181 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:32:35.181 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:32:35.182 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:35.182 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:32:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f10072fe0 msgr2=0x7f5f100754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f10072fe0 0x7f5f100754a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f240af000 tx=0x7f5f2401b530 comp rx=0 tx=0).stop 2024-09-16T07:32:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 msgr2=0x7f5f34155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f34155d70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00e7a0 tx=0x7f5f1c00ec60 comp rx=0 tx=0).stop 2024-09-16T07:32:35.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 shutdown_connections 2024-09-16T07:32:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5f3415e330 0x7f5f341562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f3415df50 0x7f5f34155d70 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f10072fe0 0x7f5f100754a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 --2- 172.21.15.114:0/1721078279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f340b11d0 0x7f5f340c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 >> 172.21.15.114:0/1721078279 conn(0x7f5f340d1dc0 msgr2=0x7f5f34071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 shutdown_connections 2024-09-16T07:32:35.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.183+0000 7f5f3ac00640 1 -- 172.21.15.114:0/1721078279 wait complete. 2024-09-16T07:32:35.206 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:32:35.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:32:35.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.351+0000 7f7fef600640 1 -- 172.21.15.114:0/1296612901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc004d50 msgr2=0x7f7fcc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.351+0000 7f7fef600640 1 --2- 172.21.15.114:0/1296612901 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc004d50 0x7f7fcc0051d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009ee0 tx=0x7f7fe001d630 comp rx=0 tx=0).stop 2024-09-16T07:32:35.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.351+0000 7f7fed600640 1 -- 172.21.15.114:0/1296612901 reap_dead start 2024-09-16T07:32:35.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.351+0000 7f7fef600640 1 -- 172.21.15.114:0/1296612901 shutdown_connections 2024-09-16T07:32:35.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.351+0000 7f7fef600640 1 -- 172.21.15.114:0/1296612901 >> 172.21.15.114:0/1296612901 conn(0x7f7fe80d1da0 msgr2=0x7f7fe80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:35.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 -- 172.21.15.114:0/1296612901 shutdown_connections 2024-09-16T07:32:35.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 -- 172.21.15.114:0/1296612901 wait complete. 2024-09-16T07:32:35.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 Processor -- start 2024-09-16T07:32:35.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 -- start start 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc004d50 0x7f7fe81f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fe8159ab0 0x7f7fe8158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe8159220 0x7f7fe81f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80cf300 con 0x7f7fe8159220 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80cf180 con 0x7f7fe8159ab0 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe80cf480 con 0x7f7fcc004d50 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe8159220 0x7f7fe81f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe8159220 0x7f7fe81f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36446/0 (socket says 172.21.15.114:36446) 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 -- 172.21.15.114:0/133455470 learned_addr learned my addr 172.21.15.114:0/133455470 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fecc00640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc004d50 0x7f7fe81f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fdfe00640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fe8159ab0 0x7f7fe8158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 -- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc004d50 msgr2=0x7f7fe81f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc004d50 0x7f7fe81f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 -- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fe8159ab0 msgr2=0x7f7fe8158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fe8159ab0 0x7f7fe8158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 -- 172.21.15.114:0/133455470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe81f5660 con 0x7f7fe8159220 2024-09-16T07:32:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fdfe00640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fe8159ab0 0x7f7fe8158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fed600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe8159220 0x7f7fe81f3d20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009ee0 tx=0x7f7fe0005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fe5600640 1 -- 172.21.15.114:0/133455470 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00ad070 con 0x7f7fe8159220 2024-09-16T07:32:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fe5600640 1 -- 172.21.15.114:0/133455470 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fe00a7ad0 con 0x7f7fe8159220 2024-09-16T07:32:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fe5600640 1 -- 172.21.15.114:0/133455470 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00a7ea0 con 0x7f7fe8159220 2024-09-16T07:32:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.355+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe815a030 con 0x7f7fe8159220 2024-09-16T07:32:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.359+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe81584e0 con 0x7f7fe8159220 2024-09-16T07:32:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.359+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe815a550 con 0x7f7fe8159220 2024-09-16T07:32:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.359+0000 7f7fe5600640 1 -- 172.21.15.114:0/133455470 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f7fe00b0070 con 0x7f7fe8159220 2024-09-16T07:32:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.359+0000 7f7fe5600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fc4072fe0 0x7f7fc40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.359+0000 7f7fe5600640 1 -- 172.21.15.114:0/133455470 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f7fe012e540 con 0x7f7fe8159220 2024-09-16T07:32:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.359+0000 7f7fecc00640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fc4072fe0 0x7f7fc40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:35.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.359+0000 7f7fecc00640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fc4072fe0 0x7f7fc40754a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8001020 tx=0x7f7fd8006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.363+0000 7f7fe5600640 1 -- 172.21.15.114:0/133455470 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7fe815a550 con 0x7f7fe8159220 2024-09-16T07:32:35.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:35.539+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7fe80d2a70 con 0x7f7fe8159220 2024-09-16T07:32:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fe5600640 1 -- 172.21.15.114:0/133455470 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f7fe81f5660 con 0x7f7fe8159220 2024-09-16T07:32:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:32:36.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fc4072fe0 msgr2=0x7f7fc40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:36.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fc4072fe0 0x7f7fc40754a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8001020 tx=0x7f7fd8006040 comp rx=0 tx=0).stop 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe8159220 msgr2=0x7f7fe81f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe8159220 0x7f7fe81f3d20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009ee0 tx=0x7f7fe0005c60 comp rx=0 tx=0).stop 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 shutdown_connections 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe8159220 0x7f7fe81f3d20 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fe8159ab0 0x7f7fe8158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fc4072fe0 0x7f7fc40754a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 --2- 172.21.15.114:0/133455470 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc004d50 0x7f7fe81f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 >> 172.21.15.114:0/133455470 conn(0x7f7fe80d1da0 msgr2=0x7f7fe80aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 shutdown_connections 2024-09-16T07:32:36.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.451+0000 7f7fef600640 1 -- 172.21.15.114:0/133455470 wait complete. 2024-09-16T07:32:36.476 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:32:36.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- 172.21.15.114:0/1595552259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 msgr2=0x7f0ca40cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:36.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 --2- 172.21.15.114:0/1595552259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca40cebf0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4076920 tx=0x7f0c9401c5d0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- 172.21.15.114:0/1595552259 shutdown_connections 2024-09-16T07:32:36.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 --2- 172.21.15.114:0/1595552259 >> v2:172.21.15.149:3300/0 conn(0x7f0ca40b4bd0 0x7f0ca415e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 --2- 172.21.15.114:0/1595552259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ca406e810 0x7f0ca40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 --2- 172.21.15.114:0/1595552259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca40cebf0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- 172.21.15.114:0/1595552259 >> 172.21.15.114:0/1595552259 conn(0x7f0ca40b18f0 msgr2=0x7f0ca40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:36.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- 172.21.15.114:0/1595552259 shutdown_connections 2024-09-16T07:32:36.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- 172.21.15.114:0/1595552259 wait complete. 2024-09-16T07:32:36.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 Processor -- start 2024-09-16T07:32:36.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- start start 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca406e810 0x7f0ca41513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ca40b4bd0 0x7f0ca41589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca4158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca406f0f0 con 0x7f0ca415ade0 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca406ef70 con 0x7f0ca406e810 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0caa000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca406f270 con 0x7f0ca40b4bd0 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca4158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca406e810 0x7f0ca41513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0c9aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ca40b4bd0 0x7f0ca41589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:36.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca4158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36470/0 (socket says 172.21.15.114:36470) 2024-09-16T07:32:36.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 -- 172.21.15.114:0/2592176348 learned_addr learned my addr 172.21.15.114:0/2592176348 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 -- 172.21.15.114:0/2592176348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ca40b4bd0 msgr2=0x7f0ca41589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ca40b4bd0 0x7f0ca41589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 -- 172.21.15.114:0/2592176348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca406e810 msgr2=0x7f0ca41513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca406e810 0x7f0ca41513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.627+0000 7f0ca3e00640 1 -- 172.21.15.114:0/2592176348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca41f5910 con 0x7f0ca415ade0 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0ca3e00640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca4158ef0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b970 tx=0x7f0c9c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0c9be00640 1 -- 172.21.15.114:0/2592176348 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c019070 con 0x7f0ca415ade0 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0c9be00640 1 -- 172.21.15.114:0/2592176348 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c9c00cc50 con 0x7f0ca415ade0 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca41f5c50 con 0x7f0ca415ade0 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0c9be00640 1 -- 172.21.15.114:0/2592176348 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0146a0 con 0x7f0ca415ade0 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca4159430 con 0x7f0ca415ade0 2024-09-16T07:32:36.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca4069410 con 0x7f0ca415ade0 2024-09-16T07:32:36.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0c9be00640 1 -- 172.21.15.114:0/2592176348 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f0c9c01c070 con 0x7f0ca415ade0 2024-09-16T07:32:36.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0c9be00640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c80072fe0 0x7f0c800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:36.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0c9be00640 1 -- 172.21.15.114:0/2592176348 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5227+0+0 (secure 0 0 0) 0x7f0c9c0940f0 con 0x7f0ca415ade0 2024-09-16T07:32:36.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.631+0000 7f0ca3400640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c80072fe0 0x7f0c800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:36.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.635+0000 7f0ca3400640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c80072fe0 0x7f0c800754a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0c940ae000 tx=0x7f0c9401ae10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:36.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.635+0000 7f0c9be00640 1 -- 172.21.15.114:0/2592176348 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0c9c023020 con 0x7f0ca415ade0 2024-09-16T07:32:36.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:36.803+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0ca415e900 con 0x7f0ca415ade0 2024-09-16T07:32:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.451+0000 7f0c9be00640 1 -- 172.21.15.114:0/2592176348 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f0ca41f5c50 con 0x7f0ca415ade0 2024-09-16T07:32:37.451 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:32:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c80072fe0 msgr2=0x7f0c800754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c80072fe0 0x7f0c800754a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0c940ae000 tx=0x7f0c9401ae10 comp rx=0 tx=0).stop 2024-09-16T07:32:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 msgr2=0x7f0ca4158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca4158ef0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b970 tx=0x7f0c9c00be30 comp rx=0 tx=0).stop 2024-09-16T07:32:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 shutdown_connections 2024-09-16T07:32:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ca415ade0 0x7f0ca4158ef0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:37.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c80072fe0 0x7f0c800754a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:37.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ca40b4bd0 0x7f0ca41589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:37.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 --2- 172.21.15.114:0/2592176348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ca406e810 0x7f0ca41513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:37.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 >> 172.21.15.114:0/2592176348 conn(0x7f0ca40b18f0 msgr2=0x7f0ca40ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:37.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 shutdown_connections 2024-09-16T07:32:37.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.455+0000 7f0caa000640 1 -- 172.21.15.114:0/2592176348 wait complete. 2024-09-16T07:32:37.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:32:37.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- 172.21.15.114:0/1610916473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00cff20 msgr2=0x7fc1e00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:37.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 --2- 172.21.15.114:0/1610916473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00cff20 0x7fc1e00d0300 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009840 tx=0x7fc1d001f010 comp rx=0 tx=0).stop 2024-09-16T07:32:37.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- 172.21.15.114:0/1610916473 shutdown_connections 2024-09-16T07:32:37.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 --2- 172.21.15.114:0/1610916473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00cff20 0x7fc1e00d0300 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:37.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- 172.21.15.114:0/1610916473 >> 172.21.15.114:0/1610916473 conn(0x7fc1e00d1dc0 msgr2=0x7fc1e00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:37.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- 172.21.15.114:0/1610916473 shutdown_connections 2024-09-16T07:32:37.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- 172.21.15.114:0/1610916473 wait complete. 2024-09-16T07:32:37.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 Processor -- start 2024-09-16T07:32:37.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- start start 2024-09-16T07:32:37.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00b2d80 0x7fc1e0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:37.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00cff20 0x7fc1e0153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1e00d0840 0x7fc1e0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01671c0 con 0x7fc1e00cff20 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0167040 con 0x7fc1e00b2d80 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1e7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e0167340 con 0x7fc1e00d0840 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.643+0000 7fc1d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00cff20 0x7fc1e0153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00b2d80 0x7fc1e0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00cff20 0x7fc1e0153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36478/0 (socket says 172.21.15.114:36478) 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 -- 172.21.15.114:0/2216153815 learned_addr learned my addr 172.21.15.114:0/2216153815 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:37.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1e5200640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1e00d0840 0x7fc1e0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:37.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 -- 172.21.15.114:0/2216153815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1e00d0840 msgr2=0x7fc1e0154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:37.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1e00d0840 0x7fc1e0154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:37.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 -- 172.21.15.114:0/2216153815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00b2d80 msgr2=0x7fc1e0151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00b2d80 0x7fc1e0151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 -- 172.21.15.114:0/2216153815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e01660e0 con 0x7fc1e00cff20 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1d7400640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00cff20 0x7fc1e0153e20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800c4d0 tx=0x7fc1c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1dcc00640 1 -- 172.21.15.114:0/2216153815 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8016020 con 0x7fc1e00cff20 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1dcc00640 1 -- 172.21.15.114:0/2216153815 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1c8012920 con 0x7fc1e00cff20 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e0166360 con 0x7fc1e00cff20 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1dcc00640 1 -- 172.21.15.114:0/2216153815 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8012d70 con 0x7fc1e00cff20 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e0166920 con 0x7fc1e00cff20 2024-09-16T07:32:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e00d0300 con 0x7fc1e00cff20 2024-09-16T07:32:37.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.647+0000 7fc1dcc00640 1 -- 172.21.15.114:0/2216153815 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc1c8019020 con 0x7fc1e00cff20 2024-09-16T07:32:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.651+0000 7fc1dcc00640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc1bc072fe0 0x7fc1bc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.651+0000 7fc1dcc00640 1 -- 172.21.15.114:0/2216153815 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5609+0+0 (secure 0 0 0) 0x7fc1c80942b0 con 0x7fc1e00cff20 2024-09-16T07:32:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.651+0000 7fc1dfe00640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc1bc072fe0 0x7fc1bc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.651+0000 7fc1dfe00640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc1bc072fe0 0x7fc1bc0754a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00b2000 tx=0x7fc1d001d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.651+0000 7fc1dcc00640 1 -- 172.21.15.114:0/2216153815 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc1c8020020 con 0x7fc1e00cff20 2024-09-16T07:32:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:37.859+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc1e0072760 con 0x7fc1e00cff20 2024-09-16T07:32:38.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.483+0000 7fc1dcc00640 1 -- 172.21.15.114:0/2216153815 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v53) ==== 174+0+0 (secure 0 0 0) 0x7fc1e01660e0 con 0x7fc1e00cff20 2024-09-16T07:32:38.483 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 12 and data pool 13 2024-09-16T07:32:38.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.491+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc1bc072fe0 msgr2=0x7fc1bc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:38.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.491+0000 7fc1e7200640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc1bc072fe0 0x7fc1bc0754a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00b2000 tx=0x7fc1d001d850 comp rx=0 tx=0).stop 2024-09-16T07:32:38.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.491+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00cff20 msgr2=0x7fc1e0153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:38.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.491+0000 7fc1e7200640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00cff20 0x7fc1e0153e20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800c4d0 tx=0x7fc1c800c990 comp rx=0 tx=0).stop 2024-09-16T07:32:38.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.495+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 shutdown_connections 2024-09-16T07:32:38.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.495+0000 7fc1e7200640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc1bc072fe0 0x7fc1bc0754a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.495+0000 7fc1e7200640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1e00d0840 0x7fc1e0154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.495+0000 7fc1e7200640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1e00cff20 0x7fc1e0153e20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.495+0000 7fc1e7200640 1 --2- 172.21.15.114:0/2216153815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1e00b2d80 0x7fc1e0151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.495+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 >> 172.21.15.114:0/2216153815 conn(0x7fc1e00d1dc0 msgr2=0x7fc1e0158010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:38.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.495+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 shutdown_connections 2024-09-16T07:32:38.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.499+0000 7fc1e7200640 1 -- 172.21.15.114:0/2216153815 wait complete. 2024-09-16T07:32:38.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- 172.21.15.114:0/616624156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2760 msgr2=0x7fd0441605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 --2- 172.21.15.114:0/616624156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2760 0x7fd0441605d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd0440b33d0 tx=0x7fd03c01ccd0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- 172.21.15.114:0/616624156 shutdown_connections 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 --2- 172.21.15.114:0/616624156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2760 0x7fd0441605d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 --2- 172.21.15.114:0/616624156 >> v2:172.21.15.149:3300/0 conn(0x7fd0440cfe80 0x7fd0440d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- 172.21.15.114:0/616624156 >> 172.21.15.114:0/616624156 conn(0x7fd0440d1e40 msgr2=0x7fd0440d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- 172.21.15.114:0/616624156 shutdown_connections 2024-09-16T07:32:38.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- 172.21.15.114:0/616624156 wait complete. 2024-09-16T07:32:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 Processor -- start 2024-09-16T07:32:38.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- start start 2024-09-16T07:32:38.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0440b2760 0x7fd0440b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:38.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2d00 0x7fd0440b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:38.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0440cfe80 0x7fd044157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:38.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd0440b0940 con 0x7fd0440b2d00 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0440b07c0 con 0x7fd0440b2760 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd04a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd0440b0ac0 con 0x7fd0440cfe80 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.671+0000 7fd042a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2d00 0x7fd0440b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2d00 0x7fd0440b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36504/0 (socket says 172.21.15.114:36504) 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 -- 172.21.15.114:0/2673082948 learned_addr learned my addr 172.21.15.114:0/2673082948 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd043400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0440b2760 0x7fd0440b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd043e00640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0440cfe80 0x7fd044157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 -- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0440cfe80 msgr2=0x7fd044157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0440cfe80 0x7fd044157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 -- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0440b2760 msgr2=0x7fd0440b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0440b2760 0x7fd0440b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 -- 172.21.15.114:0/2673082948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04415f1e0 con 0x7fd0440b2d00 2024-09-16T07:32:38.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd042a00640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2d00 0x7fd0440b74d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c500 tx=0x7fd03000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:38.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd03b400640 1 -- 172.21.15.114:0/2673082948 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030017070 con 0x7fd0440b2d00 2024-09-16T07:32:38.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd03b400640 1 -- 172.21.15.114:0/2673082948 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0300053c0 con 0x7fd0440b2d00 2024-09-16T07:32:38.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd03b400640 1 -- 172.21.15.114:0/2673082948 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030012890 con 0x7fd0440b2d00 2024-09-16T07:32:38.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04415f4c0 con 0x7fd0440b2d00 2024-09-16T07:32:38.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04415fa80 con 0x7fd0440b2d00 2024-09-16T07:32:38.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0440c9c90 con 0x7fd0440b2d00 2024-09-16T07:32:38.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.675+0000 7fd03b400640 1 -- 172.21.15.114:0/2673082948 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fd03001a070 con 0x7fd0440b2d00 2024-09-16T07:32:38.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.679+0000 7fd03b400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd024073010 0x7fd0240754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:38.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.679+0000 7fd03b400640 1 -- 172.21.15.114:0/2673082948 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fd0300932f0 con 0x7fd0440b2d00 2024-09-16T07:32:38.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.679+0000 7fd043400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd024073010 0x7fd0240754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:38.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.679+0000 7fd043400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd024073010 0x7fd0240754d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd03400ab40 tx=0x7fd03400a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:38.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.679+0000 7fd03b400640 1 -- 172.21.15.114:0/2673082948 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd0440d0c80 con 0x7fd0440b2d00 2024-09-16T07:32:38.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.851+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0440d0260 con 0x7fd0440b2d00 2024-09-16T07:32:38.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.851+0000 7fd03b400640 1 -- 172.21.15.114:0/2673082948 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16781 (secure 0 0 0) 0x7fd03005dc40 con 0x7fd0440b2d00 2024-09-16T07:32:38.851 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:38.851 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":80,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:37.860914+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:35.553549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:36.818015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:38.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd024073010 msgr2=0x7fd0240754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:38.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd024073010 0x7fd0240754d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd03400ab40 tx=0x7fd03400a250 comp rx=0 tx=0).stop 2024-09-16T07:32:38.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2d00 msgr2=0x7fd0440b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:38.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2d00 0x7fd0440b74d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd03000c500 tx=0x7fd03000c9c0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 shutdown_connections 2024-09-16T07:32:38.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd024073010 0x7fd0240754d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0440cfe80 0x7fd044157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0440b2d00 0x7fd0440b74d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 --2- 172.21.15.114:0/2673082948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0440b2760 0x7fd0440b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:38.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 >> 172.21.15.114:0/2673082948 conn(0x7fd0440d1e40 msgr2=0x7fd044070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:38.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 shutdown_connections 2024-09-16T07:32:38.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:38.855+0000 7fd04a400640 1 -- 172.21.15.114:0/2673082948 wait complete. 2024-09-16T07:32:38.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 -- 172.21.15.114:0/2276839908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40d01b0 msgr2=0x7ff3b40cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/2276839908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40d01b0 0x7ff3b40cefb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009840 tx=0x7ff3a001c790 comp rx=0 tx=0).stop 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 -- 172.21.15.114:0/2276839908 shutdown_connections 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/2276839908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40b2590 0x7ff3b40b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/2276839908 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40d01b0 0x7ff3b40cefb0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 -- 172.21.15.114:0/2276839908 >> 172.21.15.114:0/2276839908 conn(0x7ff3b409aa10 msgr2=0x7ff3b409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 -- 172.21.15.114:0/2276839908 shutdown_connections 2024-09-16T07:32:39.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 -- 172.21.15.114:0/2276839908 wait complete. 2024-09-16T07:32:39.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 Processor -- start 2024-09-16T07:32:39.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.015+0000 7ff3b8e00640 1 -- start start 2024-09-16T07:32:39.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40b2590 0x7ff3b415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d01b0 0x7ff3b415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b415f000 0x7ff3b415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4168eb0 con 0x7ff3b415f000 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4168d30 con 0x7ff3b40b2590 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b4169030 con 0x7ff3b40d01b0 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b415f000 0x7ff3b415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b415f000 0x7ff3b415e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36528/0 (socket says 172.21.15.114:36528) 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 -- 172.21.15.114:0/4255480570 learned_addr learned my addr 172.21.15.114:0/4255480570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b2a00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d01b0 0x7ff3b415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3400640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40b2590 0x7ff3b415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 -- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d01b0 msgr2=0x7ff3b415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d01b0 0x7ff3b415dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 -- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40b2590 msgr2=0x7ff3b415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40b2590 0x7ff3b415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 -- 172.21.15.114:0/4255480570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b40b6500 con 0x7ff3b415f000 2024-09-16T07:32:39.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b3e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b415f000 0x7ff3b415e1d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00cce0 tx=0x7ff3ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:39.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3ab400640 1 -- 172.21.15.114:0/4255480570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00f450 con 0x7ff3b415f000 2024-09-16T07:32:39.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3ab400640 1 -- 172.21.15.114:0/4255480570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3ac00f700 con 0x7ff3b415f000 2024-09-16T07:32:39.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b40b67e0 con 0x7ff3b415f000 2024-09-16T07:32:39.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3ab400640 1 -- 172.21.15.114:0/4255480570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00fb50 con 0x7ff3b415f000 2024-09-16T07:32:39.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b40b6da0 con 0x7ff3b415f000 2024-09-16T07:32:39.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.019+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b40b29e0 con 0x7ff3b415f000 2024-09-16T07:32:39.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.023+0000 7ff3ab400640 1 -- 172.21.15.114:0/4255480570 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7ff3ac00fcf0 con 0x7ff3b415f000 2024-09-16T07:32:39.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.023+0000 7ff3ab400640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff394072fe0 0x7ff3940754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.023+0000 7ff3ab400640 1 -- 172.21.15.114:0/4255480570 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7ff3ac094b50 con 0x7ff3b415f000 2024-09-16T07:32:39.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.023+0000 7ff3b3400640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff394072fe0 0x7ff3940754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.023+0000 7ff3b3400640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff394072fe0 0x7ff3940754a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4007fd0 tx=0x7ff3a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:39.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.027+0000 7ff3ab400640 1 -- 172.21.15.114:0/4255480570 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff3ac014030 con 0x7ff3b415f000 2024-09-16T07:32:39.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.195+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3b40b0450 con 0x7ff3b415f000 2024-09-16T07:32:39.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.195+0000 7ff3ab400640 1 -- 172.21.15.114:0/4255480570 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16781 (secure 0 0 0) 0x7ff3ac05f520 con 0x7ff3b415f000 2024-09-16T07:32:39.194 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:39.195 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":80,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:37.860914+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:35.553549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:36.818015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff394072fe0 msgr2=0x7ff3940754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff394072fe0 0x7ff3940754a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4007fd0 tx=0x7ff3a4009040 comp rx=0 tx=0).stop 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b415f000 msgr2=0x7ff3b415e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b415f000 0x7ff3b415e1d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00cce0 tx=0x7ff3ac00a620 comp rx=0 tx=0).stop 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 shutdown_connections 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b415f000 0x7ff3b415e1d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff394072fe0 0x7ff3940754a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d01b0 0x7ff3b415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 --2- 172.21.15.114:0/4255480570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40b2590 0x7ff3b415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 >> 172.21.15.114:0/4255480570 conn(0x7ff3b409aa10 msgr2=0x7ff3b40aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:39.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 shutdown_connections 2024-09-16T07:32:39.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.199+0000 7ff3b8e00640 1 -- 172.21.15.114:0/4255480570 wait complete. 2024-09-16T07:32:39.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:32:39.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 -- 172.21.15.114:0/2569233656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 msgr2=0x7fa9b40d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2569233656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 0x7fa9b40d4510 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009840 tx=0x7fa9a801c790 comp rx=0 tx=0).stop 2024-09-16T07:32:39.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 -- 172.21.15.114:0/2569233656 shutdown_connections 2024-09-16T07:32:39.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2569233656 >> v2:172.21.15.149:3300/0 conn(0x7fa9b40b0a90 0x7fa9b40d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2569233656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 0x7fa9b40d4510 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 -- 172.21.15.114:0/2569233656 >> 172.21.15.114:0/2569233656 conn(0x7fa9b409d0c0 msgr2=0x7fa9b40d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:39.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 -- 172.21.15.114:0/2569233656 shutdown_connections 2024-09-16T07:32:39.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 -- 172.21.15.114:0/2569233656 wait complete. 2024-09-16T07:32:39.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 Processor -- start 2024-09-16T07:32:39.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.363+0000 7fa9baa00640 1 -- start start 2024-09-16T07:32:39.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9b40b0a90 0x7fa9b40b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b40d2780 0x7fa9b4152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 0x7fa9b406da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b416aed0 con 0x7fa9b40d2780 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b416ad50 con 0x7fa9b40b0a90 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b416b050 con 0x7fa9b4161230 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b40d2780 0x7fa9b4152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b40d2780 0x7fa9b4152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36544/0 (socket says 172.21.15.114:36544) 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 -- 172.21.15.114:0/2463090546 learned_addr learned my addr 172.21.15.114:0/2463090546 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b9600640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9b40b0a90 0x7fa9b40b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9ba000640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 0x7fa9b406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 -- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 msgr2=0x7fa9b406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 0x7fa9b406da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 -- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9b40b0a90 msgr2=0x7fa9b40b86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9b40b0a90 0x7fa9b40b86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:39.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 -- 172.21.15.114:0/2463090546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b41528b0 con 0x7fa9b40d2780 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9ba000640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 0x7fa9b406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b8c00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b40d2780 0x7fa9b4152370 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000e9f0 tx=0x7fa9a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b1600640 1 -- 172.21.15.114:0/2463090546 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000cd80 con 0x7fa9b40d2780 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b1600640 1 -- 172.21.15.114:0/2463090546 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a0004020 con 0x7fa9b40d2780 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9b1600640 1 -- 172.21.15.114:0/2463090546 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0004450 con 0x7fa9b40d2780 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b40b7990 con 0x7fa9b40d2780 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b40c7ad0 con 0x7fa9b40d2780 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.367+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b40d2240 con 0x7fa9b40d2780 2024-09-16T07:32:39.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.371+0000 7fa9b1600640 1 -- 172.21.15.114:0/2463090546 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fa9a0003600 con 0x7fa9b40d2780 2024-09-16T07:32:39.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.371+0000 7fa9b1600640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa994072fe0 0x7fa9940754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:39.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.371+0000 7fa9b1600640 1 -- 172.21.15.114:0/2463090546 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fa9a0094b50 con 0x7fa9b40d2780 2024-09-16T07:32:39.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.371+0000 7fa9b9600640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa994072fe0 0x7fa9940754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:39.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.371+0000 7fa9b9600640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa994072fe0 0x7fa9940754a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80ae000 tx=0x7fa9a801afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:39.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.375+0000 7fa9b1600640 1 -- 172.21.15.114:0/2463090546 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa9a005fc30 con 0x7fa9b40d2780 2024-09-16T07:32:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:39.579+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa9b408d540 con 0x7fa9b40d2780 2024-09-16T07:32:40.447 INFO:tasks.ceph.mds.b.smithi149.stderr:2024-09-16T07:32:40.443+0000 7f6e6be00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:32:40.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.507+0000 7fa9b1600640 1 -- 172.21.15.114:0/2463090546 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) ==== 118+0+0 (secure 0 0 0) 0x7fa9a005f530 con 0x7fa9b40d2780 2024-09-16T07:32:40.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa994072fe0 msgr2=0x7fa9940754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa994072fe0 0x7fa9940754a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80ae000 tx=0x7fa9a801afd0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b40d2780 msgr2=0x7fa9b4152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b40d2780 0x7fa9b4152370 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000e9f0 tx=0x7fa9a000eeb0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 shutdown_connections 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa994072fe0 0x7fa9940754a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa9b4161230 0x7fa9b406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9b40d2780 0x7fa9b4152370 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 --2- 172.21.15.114:0/2463090546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9b40b0a90 0x7fa9b40b86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 >> 172.21.15.114:0/2463090546 conn(0x7fa9b409d0c0 msgr2=0x7fa9b406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 shutdown_connections 2024-09-16T07:32:40.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.511+0000 7fa9baa00640 1 -- 172.21.15.114:0/2463090546 wait complete. 2024-09-16T07:32:40.529 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:32:40.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:32:40.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 -- 172.21.15.114:0/4101363895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c0cf4e0 msgr2=0x7fc30c0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:40.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 --2- 172.21.15.114:0/4101363895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c0cf4e0 0x7fc30c0cd950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc30c073a20 tx=0x7fc30401cc60 comp rx=0 tx=0).stop 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 -- 172.21.15.114:0/4101363895 shutdown_connections 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 --2- 172.21.15.114:0/4101363895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c0cf4e0 0x7fc30c0cd950 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 --2- 172.21.15.114:0/4101363895 >> v2:172.21.15.149:3300/0 conn(0x7fc30c15bd50 0x7fc30c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 -- 172.21.15.114:0/4101363895 >> 172.21.15.114:0/4101363895 conn(0x7fc30c0d1ea0 msgr2=0x7fc30c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 -- 172.21.15.114:0/4101363895 shutdown_connections 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 -- 172.21.15.114:0/4101363895 wait complete. 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 Processor -- start 2024-09-16T07:32:40.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.679+0000 7fc310e00640 1 -- start start 2024-09-16T07:32:40.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc30c0cf4e0 0x7fc30c0b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc30c15bd50 0x7fc30c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c15c130 0x7fc30c071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c168ea0 con 0x7fc30c15c130 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c168d20 con 0x7fc30c0cf4e0 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c169020 con 0x7fc30c15bd50 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c15c130 0x7fc30c071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc309e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc30c0cf4e0 0x7fc30c0b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c15c130 0x7fc30c071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36564/0 (socket says 172.21.15.114:36564) 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 -- 172.21.15.114:0/2787713245 learned_addr learned my addr 172.21.15.114:0/2787713245 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc301400640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc30c15bd50 0x7fc30c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:40.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 -- 172.21.15.114:0/2787713245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc30c15bd50 msgr2=0x7fc30c14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc30c15bd50 0x7fc30c14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 -- 172.21.15.114:0/2787713245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc30c0cf4e0 msgr2=0x7fc30c0b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc30c0cf4e0 0x7fc30c0b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 -- 172.21.15.114:0/2787713245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c0b6df0 con 0x7fc30c15c130 2024-09-16T07:32:40.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc30a800640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c15c130 0x7fc30c071290 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc30401b310 tx=0x7fc304004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc302a00640 1 -- 172.21.15.114:0/2787713245 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3040bb070 con 0x7fc30c15c130 2024-09-16T07:32:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc302a00640 1 -- 172.21.15.114:0/2787713245 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc304004b40 con 0x7fc30c15c130 2024-09-16T07:32:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c0b7070 con 0x7fc30c15c130 2024-09-16T07:32:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc302a00640 1 -- 172.21.15.114:0/2787713245 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3040b2040 con 0x7fc30c15c130 2024-09-16T07:32:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c1536e0 con 0x7fc30c15c130 2024-09-16T07:32:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c0ce5e0 con 0x7fc30c15c130 2024-09-16T07:32:40.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.683+0000 7fc302a00640 1 -- 172.21.15.114:0/2787713245 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc3040be070 con 0x7fc30c15c130 2024-09-16T07:32:40.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.687+0000 7fc302a00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc2e8072fe0 0x7fc2e80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:40.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.687+0000 7fc302a00640 1 -- 172.21.15.114:0/2787713245 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fc30412df60 con 0x7fc30c15c130 2024-09-16T07:32:40.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.687+0000 7fc309e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc2e8072fe0 0x7fc2e80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:40.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.687+0000 7fc309e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc2e8072fe0 0x7fc2e80754a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc004610 tx=0x7fc2fc00b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:40.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.691+0000 7fc302a00640 1 -- 172.21.15.114:0/2787713245 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc30c0b6df0 con 0x7fc30c15c130 2024-09-16T07:32:40.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:40.895+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc30c076360 con 0x7fc30c15c130 2024-09-16T07:32:41.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc302a00640 1 -- 172.21.15.114:0/2787713245 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) ==== 122+0+0 (secure 0 0 0) 0x7fc304016970 con 0x7fc30c15c130 2024-09-16T07:32:41.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc2e8072fe0 msgr2=0x7fc2e80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:41.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc2e8072fe0 0x7fc2e80754a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc004610 tx=0x7fc2fc00b390 comp rx=0 tx=0).stop 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c15c130 msgr2=0x7fc30c071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c15c130 0x7fc30c071290 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc30401b310 tx=0x7fc304004270 comp rx=0 tx=0).stop 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 shutdown_connections 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc30c15c130 0x7fc30c071290 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc2e8072fe0 0x7fc2e80754a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc30c15bd50 0x7fc30c14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 --2- 172.21.15.114:0/2787713245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc30c0cf4e0 0x7fc30c0b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 >> 172.21.15.114:0/2787713245 conn(0x7fc30c0d1ea0 msgr2=0x7fc30c0709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 shutdown_connections 2024-09-16T07:32:41.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.511+0000 7fc310e00640 1 -- 172.21.15.114:0/2787713245 wait complete. 2024-09-16T07:32:41.531 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:32:41.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:41.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 -- 172.21.15.114:0/341008251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa76406d330 msgr2=0x7fa76406fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:41.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 --2- 172.21.15.114:0/341008251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa76406d330 0x7fa76406fa60 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009900 tx=0x7fa75c01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 -- 172.21.15.114:0/341008251 shutdown_connections 2024-09-16T07:32:41.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 --2- 172.21.15.114:0/341008251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa76406d330 0x7fa76406fa60 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 --2- 172.21.15.114:0/341008251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa764073170 0x7fa76406f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 -- 172.21.15.114:0/341008251 >> 172.21.15.114:0/341008251 conn(0x7fa7640b2240 msgr2=0x7fa7640b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:41.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 -- 172.21.15.114:0/341008251 shutdown_connections 2024-09-16T07:32:41.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 -- 172.21.15.114:0/341008251 wait complete. 2024-09-16T07:32:41.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 Processor -- start 2024-09-16T07:32:41.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 -- start start 2024-09-16T07:32:41.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa76406d330 0x7fa76414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:41.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa764073170 0x7fa764141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:41.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7640ce800 0x7fa7640aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:41.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.675+0000 7fa76b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa7641683e0 con 0x7fa7640ce800 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa76b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa764168260 con 0x7fa76406d330 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa76b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa764168560 con 0x7fa764073170 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7640ce800 0x7fa7640aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa75b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa764073170 0x7fa764141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7640ce800 0x7fa7640aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36572/0 (socket says 172.21.15.114:36572) 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 -- 172.21.15.114:0/3891168516 learned_addr learned my addr 172.21.15.114:0/3891168516 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa763e00640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa76406d330 0x7fa76414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 -- 172.21.15.114:0/3891168516 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa764073170 msgr2=0x7fa764141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa764073170 0x7fa764141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 -- 172.21.15.114:0/3891168516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa76406d330 msgr2=0x7fa76414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:41.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa76406d330 0x7fa76414c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 -- 172.21.15.114:0/3891168516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7641423b0 con 0x7fa7640ce800 2024-09-16T07:32:41.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa769200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7640ce800 0x7fa7640aed40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0b0040 tx=0x7fa75c005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:41.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa760c00640 1 -- 172.21.15.114:0/3891168516 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0b2040 con 0x7fa7640ce800 2024-09-16T07:32:41.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa760c00640 1 -- 172.21.15.114:0/3891168516 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa75c0043f0 con 0x7fa7640ce800 2024-09-16T07:32:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa760c00640 1 -- 172.21.15.114:0/3891168516 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c005290 con 0x7fa7640ce800 2024-09-16T07:32:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa764140dd0 con 0x7fa7640ce800 2024-09-16T07:32:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa764141390 con 0x7fa7640ce800 2024-09-16T07:32:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76406cc20 con 0x7fa7640ce800 2024-09-16T07:32:41.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.679+0000 7fa760c00640 1 -- 172.21.15.114:0/3891168516 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fa75c0be060 con 0x7fa7640ce800 2024-09-16T07:32:41.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.683+0000 7fa760c00640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa740072fe0 0x7fa7400754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:41.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.683+0000 7fa760c00640 1 -- 172.21.15.114:0/3891168516 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fa75c12d4d0 con 0x7fa7640ce800 2024-09-16T07:32:41.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.683+0000 7fa763e00640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa740072fe0 0x7fa7400754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:41.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.683+0000 7fa763e00640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa740072fe0 0x7fa7400754a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa754001e40 tx=0x7fa754009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:41.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.687+0000 7fa760c00640 1 -- 172.21.15.114:0/3891168516 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa75c0164d0 con 0x7fa7640ce800 2024-09-16T07:32:41.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.887+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa76406f490 con 0x7fa7640ce800 2024-09-16T07:32:41.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.887+0000 7fa760c00640 1 -- 172.21.15.114:0/3891168516 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5234 (secure 0 0 0) 0x7fa75c0f7eb0 con 0x7fa7640ce800 2024-09-16T07:32:41.886 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:41.887 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"btime":"2024-09-16T07:32:41:510667+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1449286393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1449286393},{"type":"v1","addr":"172.21.15.114:6834","nonce":1449286393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6307,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3836721187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":3836721187},{"type":"v1","addr":"172.21.15.149:6835","nonce":3836721187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2356735727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2356735727},{"type":"v1","addr":"172.21.15.114:6835","nonce":2356735727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:37.860881+0000","modified":"2024-09-16T07:32:40.899353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6834/862990525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":862990525},{"type":"v1","addr":"172.21.15.149:6834","nonce":862990525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6600,"qdb_cluster":[6600]},"id":6}]} 2024-09-16T07:32:41.887 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa740072fe0 msgr2=0x7fa7400754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa740072fe0 0x7fa7400754a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa754001e40 tx=0x7fa754009040 comp rx=0 tx=0).stop 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7640ce800 msgr2=0x7fa7640aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7640ce800 0x7fa7640aed40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0b0040 tx=0x7fa75c005e90 comp rx=0 tx=0).stop 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 shutdown_connections 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7640ce800 0x7fa7640aed40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa740072fe0 0x7fa7400754a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa764073170 0x7fa764141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 --2- 172.21.15.114:0/3891168516 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa76406d330 0x7fa76414c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 >> 172.21.15.114:0/3891168516 conn(0x7fa7640b2240 msgr2=0x7fa764143060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:41.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 shutdown_connections 2024-09-16T07:32:41.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:41.891+0000 7fa76b200640 1 -- 172.21.15.114:0/3891168516 wait complete. 2024-09-16T07:32:41.907 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 -- 172.21.15.114:0/3547149599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb540b49e0 msgr2=0x7fcb5406f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/3547149599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb540b49e0 0x7fcb5406f7b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009900 tx=0x7fcb4c01c850 comp rx=0 tx=0).stop 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 -- 172.21.15.114:0/3547149599 shutdown_connections 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/3547149599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb540b49e0 0x7fcb5406f7b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/3547149599 >> v2:172.21.15.149:3300/0 conn(0x7fcb5415dae0 0x7fcb540acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 -- 172.21.15.114:0/3547149599 >> 172.21.15.114:0/3547149599 conn(0x7fcb540b18f0 msgr2=0x7fcb540b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 -- 172.21.15.114:0/3547149599 shutdown_connections 2024-09-16T07:32:42.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 -- 172.21.15.114:0/3547149599 wait complete. 2024-09-16T07:32:42.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 Processor -- start 2024-09-16T07:32:42.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.051+0000 7fcb5aa00640 1 -- start start 2024-09-16T07:32:42.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb540b49e0 0x7fcb5409c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb540cd100 0x7fcb541599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5415dae0 0x7fcb541fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcb540cf1c0 con 0x7fcb540b49e0 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb540cf040 con 0x7fcb5415dae0 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcb540cf340 con 0x7fcb540cd100 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb540b49e0 0x7fcb5409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb540b49e0 0x7fcb5409c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36576/0 (socket says 172.21.15.114:36576) 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 -- 172.21.15.114:0/554170330 learned_addr learned my addr 172.21.15.114:0/554170330 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 -- 172.21.15.114:0/554170330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb540cd100 msgr2=0x7fcb541599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb540cd100 0x7fcb541599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 -- 172.21.15.114:0/554170330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5415dae0 msgr2=0x7fcb541fb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5415dae0 0x7fcb541fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 -- 172.21.15.114:0/554170330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb540aec10 con 0x7fcb540b49e0 2024-09-16T07:32:42.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb53e00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb540b49e0 0x7fcb5409c560 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ed40 tx=0x7fcb4400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:42.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb4be00640 1 -- 172.21.15.114:0/554170330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400b770 con 0x7fcb540b49e0 2024-09-16T07:32:42.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb4be00640 1 -- 172.21.15.114:0/554170330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb4400b910 con 0x7fcb540b49e0 2024-09-16T07:32:42.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb4be00640 1 -- 172.21.15.114:0/554170330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400bd00 con 0x7fcb540b49e0 2024-09-16T07:32:42.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb54156210 con 0x7fcb540b49e0 2024-09-16T07:32:42.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb541567d0 con 0x7fcb540b49e0 2024-09-16T07:32:42.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb54069410 con 0x7fcb540b49e0 2024-09-16T07:32:42.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.055+0000 7fcb4be00640 1 -- 172.21.15.114:0/554170330 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fcb44020440 con 0x7fcb540b49e0 2024-09-16T07:32:42.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.059+0000 7fcb4be00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb34072fe0 0x7fcb340754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.059+0000 7fcb4be00640 1 -- 172.21.15.114:0/554170330 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fcb44094fe0 con 0x7fcb540b49e0 2024-09-16T07:32:42.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.059+0000 7fcb53400640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb34072fe0 0x7fcb340754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.059+0000 7fcb53400640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb34072fe0 0x7fcb340754a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f70 tx=0x7fcb400079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:42.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.063+0000 7fcb4be00640 1 -- 172.21.15.114:0/554170330 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcb4405ffd0 con 0x7fcb540b49e0 2024-09-16T07:32:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb541fb230 con 0x7fcb540b49e0 2024-09-16T07:32:42.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb4be00640 1 -- 172.21.15.114:0/554170330 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16768 (secure 0 0 0) 0x7fcb4405f8d0 con 0x7fcb540b49e0 2024-09-16T07:32:42.229 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:42.229 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":81,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:32:39.483924+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:35.553549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:36.818015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:32:42.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb34072fe0 msgr2=0x7fcb340754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb34072fe0 0x7fcb340754a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f70 tx=0x7fcb400079c0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb540b49e0 msgr2=0x7fcb5409c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb540b49e0 0x7fcb5409c560 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ed40 tx=0x7fcb4400c7a0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 shutdown_connections 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5415dae0 0x7fcb541fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb34072fe0 0x7fcb340754a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb540cd100 0x7fcb541599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 --2- 172.21.15.114:0/554170330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb540b49e0 0x7fcb5409c560 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.231+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 >> 172.21.15.114:0/554170330 conn(0x7fcb540b18f0 msgr2=0x7fcb54073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.235+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 shutdown_connections 2024-09-16T07:32:42.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.235+0000 7fcb5aa00640 1 -- 172.21.15.114:0/554170330 wait complete. 2024-09-16T07:32:42.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:32:42.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:32:42.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.395+0000 7f8378000640 1 -- 172.21.15.114:0/165390631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 msgr2=0x7f8358003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.395+0000 7f8378000640 1 --2- 172.21.15.114:0/165390631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 0x7f8358003e30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8370074d20 tx=0x7f836401cfe0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.395+0000 7f8376000640 1 -- 172.21.15.114:0/165390631 reap_dead start 2024-09-16T07:32:42.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.395+0000 7f8378000640 1 -- 172.21.15.114:0/165390631 shutdown_connections 2024-09-16T07:32:42.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.395+0000 7f8378000640 1 -- 172.21.15.114:0/165390631 >> 172.21.15.114:0/165390631 conn(0x7f83700b18f0 msgr2=0x7f83700b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:42.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.395+0000 7f8378000640 1 -- 172.21.15.114:0/165390631 shutdown_connections 2024-09-16T07:32:42.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.395+0000 7f8378000640 1 -- 172.21.15.114:0/165390631 wait complete. 2024-09-16T07:32:42.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 Processor -- start 2024-09-16T07:32:42.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 -- start start 2024-09-16T07:32:42.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 0x7f83701567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83701fbfc0 0x7f83701636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8370162280 0x7f83701626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8370165af0 con 0x7f8358003a10 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8370165970 con 0x7f8370162280 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8370165c70 con 0x7f83701fbfc0 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 0x7f83701567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 0x7f83701567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36598/0 (socket says 172.21.15.114:36598) 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 -- 172.21.15.114:0/2725563763 learned_addr learned my addr 172.21.15.114:0/2725563763 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8374c00640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83701fbfc0 0x7f83701636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8376000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8370162280 0x7f83701626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 -- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83701fbfc0 msgr2=0x7f83701636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83701fbfc0 0x7f83701636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 -- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8370162280 msgr2=0x7f83701626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8370162280 0x7f83701626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 -- 172.21.15.114:0/2725563763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83701611e0 con 0x7f8358003a10 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8374c00640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83701fbfc0 0x7f83701636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8376000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8370162280 0x7f83701626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8375600640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 0x7f83701567e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f836401ca50 tx=0x7f8364009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f836d600640 1 -- 172.21.15.114:0/2725563763 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640ab050 con 0x7f8358003a10 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f836d600640 1 -- 172.21.15.114:0/2725563763 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8364005570 con 0x7f8358003a10 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f836d600640 1 -- 172.21.15.114:0/2725563763 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364005980 con 0x7f8358003a10 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83701614c0 con 0x7f8358003a10 2024-09-16T07:32:42.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.399+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8370161a80 con 0x7f8358003a10 2024-09-16T07:32:42.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.403+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83700b46e0 con 0x7f8358003a10 2024-09-16T07:32:42.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.403+0000 7f836d600640 1 -- 172.21.15.114:0/2725563763 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f83640bf060 con 0x7f8358003a10 2024-09-16T07:32:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.403+0000 7f836d600640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8350073010 0x7f83500754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.403+0000 7f836d600640 1 -- 172.21.15.114:0/2725563763 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f836412eab0 con 0x7f8358003a10 2024-09-16T07:32:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.403+0000 7f8374c00640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8350073010 0x7f83500754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.407+0000 7f8374c00640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8350073010 0x7f83500754d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83700742a0 tx=0x7f835c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:42.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.407+0000 7f836d600640 1 -- 172.21.15.114:0/2725563763 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f83640f40b0 con 0x7f8358003a10 2024-09-16T07:32:42.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.575+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83700b1560 con 0x7f8350073010 2024-09-16T07:32:42.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.579+0000 7f836d600640 1 -- 172.21.15.114:0/2725563763 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246777 (secure 0 0 0) 0x7f83700b1560 con 0x7f8350073010 2024-09-16T07:32:42.581 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:42.582 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8350073010 msgr2=0x7f83500754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8350073010 0x7f83500754d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f83700742a0 tx=0x7f835c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 msgr2=0x7f83701567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 0x7f83701567e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f836401ca50 tx=0x7f8364009a70 comp rx=0 tx=0).stop 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 shutdown_connections 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8370162280 0x7f83701626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8350073010 0x7f83500754d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83701fbfc0 0x7f83701636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 --2- 172.21.15.114:0/2725563763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8358003a10 0x7f83701567e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 >> 172.21.15.114:0/2725563763 conn(0x7f83700b18f0 msgr2=0x7f837006fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 shutdown_connections 2024-09-16T07:32:42.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.583+0000 7f8378000640 1 -- 172.21.15.114:0/2725563763 wait complete. 2024-09-16T07:32:42.601 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T07:32:42.373496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258228,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716492,"statfs":{"total":773094113280,"available":772829687808,"internally_reserved":0,"allocated":8888320,"data_stored":4431744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.920424"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464253+0000","last_change":"2024-09-16T07:32:37.464253+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464253+0000","last_undegraded":"2024-09-16T07:32:37.464253+0000","last_fullsized":"2024-09-16T07:32:37.464253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466202+0000","last_change":"2024-09-16T07:32:37.466202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466202+0000","last_undegraded":"2024-09-16T07:32:37.466202+0000","last_fullsized":"2024-09-16T07:32:37.466202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467358+0000","last_change":"2024-09-16T07:32:37.467358+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467358+0000","last_undegraded":"2024-09-16T07:32:37.467358+0000","last_fullsized":"2024-09-16T07:32:37.467358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.469828+0000","last_change":"2024-09-16T07:32:37.469828+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.469828+0000","last_undegraded":"2024-09-16T07:32:37.469828+0000","last_fullsized":"2024-09-16T07:32:37.469828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460511+0000","last_change":"2024-09-16T07:32:37.460511+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460511+0000","last_undegraded":"2024-09-16T07:32:37.460511+0000","last_fullsized":"2024-09-16T07:32:37.460511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473936+0000","last_change":"2024-09-16T07:32:37.473936+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473936+0000","last_undegraded":"2024-09-16T07:32:37.473936+0000","last_fullsized":"2024-09-16T07:32:37.473936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457825+0000","last_change":"2024-09-16T07:32:37.457825+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457825+0000","last_undegraded":"2024-09-16T07:32:37.457825+0000","last_fullsized":"2024-09-16T07:32:37.457825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459132+0000","last_change":"2024-09-16T07:32:37.459132+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459132+0000","last_undegraded":"2024-09-16T07:32:37.459132+0000","last_fullsized":"2024-09-16T07:32:37.459132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468111+0000","last_change":"2024-09-16T07:32:37.468111+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468111+0000","last_undegraded":"2024-09-16T07:32:37.468111+0000","last_fullsized":"2024-09-16T07:32:37.468111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458639+0000","last_change":"2024-09-16T07:32:37.458639+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458639+0000","last_undegraded":"2024-09-16T07:32:37.458639+0000","last_fullsized":"2024-09-16T07:32:37.458639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471190+0000","last_change":"2024-09-16T07:32:37.471190+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471190+0000","last_undegraded":"2024-09-16T07:32:37.471190+0000","last_fullsized":"2024-09-16T07:32:37.471190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.479918+0000","last_change":"2024-09-16T07:32:37.479918+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.479918+0000","last_undegraded":"2024-09-16T07:32:37.479918+0000","last_fullsized":"2024-09-16T07:32:37.479918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468554+0000","last_change":"2024-09-16T07:32:37.468554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468554+0000","last_undegraded":"2024-09-16T07:32:37.468554+0000","last_fullsized":"2024-09-16T07:32:37.468554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468492+0000","last_change":"2024-09-16T07:32:37.468492+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468492+0000","last_undegraded":"2024-09-16T07:32:37.468492+0000","last_fullsized":"2024-09-16T07:32:37.468492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471192+0000","last_change":"2024-09-16T07:32:37.471192+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471192+0000","last_undegraded":"2024-09-16T07:32:37.471192+0000","last_fullsized":"2024-09-16T07:32:37.471192+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468433+0000","last_change":"2024-09-16T07:32:37.468433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468433+0000","last_undegraded":"2024-09-16T07:32:37.468433+0000","last_fullsized":"2024-09-16T07:32:37.468433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466840+0000","last_change":"2024-09-16T07:32:37.466840+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466840+0000","last_undegraded":"2024-09-16T07:32:37.466840+0000","last_fullsized":"2024-09-16T07:32:37.466840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471699+0000","last_change":"2024-09-16T07:32:37.471699+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471699+0000","last_undegraded":"2024-09-16T07:32:37.471699+0000","last_fullsized":"2024-09-16T07:32:37.471699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467723+0000","last_change":"2024-09-16T07:32:37.467723+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467723+0000","last_undegraded":"2024-09-16T07:32:37.467723+0000","last_fullsized":"2024-09-16T07:32:37.467723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463665+0000","last_change":"2024-09-16T07:32:37.463665+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463665+0000","last_undegraded":"2024-09-16T07:32:37.463665+0000","last_fullsized":"2024-09-16T07:32:37.463665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468155+0000","last_change":"2024-09-16T07:32:37.468155+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468155+0000","last_undegraded":"2024-09-16T07:32:37.468155+0000","last_fullsized":"2024-09-16T07:32:37.468155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466325+0000","last_change":"2024-09-16T07:32:37.466325+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466325+0000","last_undegraded":"2024-09-16T07:32:37.466325+0000","last_fullsized":"2024-09-16T07:32:37.466325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458050+0000","last_change":"2024-09-16T07:32:37.458050+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458050+0000","last_undegraded":"2024-09-16T07:32:37.458050+0000","last_fullsized":"2024-09-16T07:32:37.458050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471208+0000","last_change":"2024-09-16T07:32:37.471208+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471208+0000","last_undegraded":"2024-09-16T07:32:37.471208+0000","last_fullsized":"2024-09-16T07:32:37.471208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463695+0000","last_change":"2024-09-16T07:32:37.463695+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463695+0000","last_undegraded":"2024-09-16T07:32:37.463695+0000","last_fullsized":"2024-09-16T07:32:37.463695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468168+0000","last_change":"2024-09-16T07:32:37.468168+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468168+0000","last_undegraded":"2024-09-16T07:32:37.468168+0000","last_fullsized":"2024-09-16T07:32:37.468168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466088+0000","last_change":"2024-09-16T07:32:37.466088+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466088+0000","last_undegraded":"2024-09-16T07:32:37.466088+0000","last_fullsized":"2024-09-16T07:32:37.466088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468544+0000","last_change":"2024-09-16T07:32:37.468544+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468544+0000","last_undegraded":"2024-09-16T07:32:37.468544+0000","last_fullsized":"2024-09-16T07:32:37.468544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463130+0000","last_change":"2024-09-16T07:32:37.463130+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463130+0000","last_undegraded":"2024-09-16T07:32:37.463130+0000","last_fullsized":"2024-09-16T07:32:37.463130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471373+0000","last_change":"2024-09-16T07:32:37.471373+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471373+0000","last_undegraded":"2024-09-16T07:32:37.471373+0000","last_fullsized":"2024-09-16T07:32:37.471373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480153+0000","last_change":"2024-09-16T07:32:37.477686+0000","last_active":"2024-09-16T07:32:37.480153+0000","last_peered":"2024-09-16T07:32:37.480153+0000","last_clean":"2024-09-16T07:32:37.480153+0000","last_became_active":"2024-09-16T07:32:37.477346+0000","last_became_peered":"2024-09-16T07:32:37.477346+0000","last_unstale":"2024-09-16T07:32:37.480153+0000","last_undegraded":"2024-09-16T07:32:37.480153+0000","last_fullsized":"2024-09-16T07:32:37.480153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:08:07.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463071+0000","last_change":"2024-09-16T07:32:37.463071+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463071+0000","last_undegraded":"2024-09-16T07:32:37.463071+0000","last_fullsized":"2024-09-16T07:32:37.463071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484789+0000","last_change":"2024-09-16T07:32:37.483296+0000","last_active":"2024-09-16T07:32:37.484789+0000","last_peered":"2024-09-16T07:32:37.484789+0000","last_clean":"2024-09-16T07:32:37.484789+0000","last_became_active":"2024-09-16T07:32:37.482999+0000","last_became_peered":"2024-09-16T07:32:37.482999+0000","last_unstale":"2024-09-16T07:32:37.484789+0000","last_undegraded":"2024-09-16T07:32:37.484789+0000","last_fullsized":"2024-09-16T07:32:37.484789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:05.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463046+0000","last_change":"2024-09-16T07:32:37.463046+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463046+0000","last_undegraded":"2024-09-16T07:32:37.463046+0000","last_fullsized":"2024-09-16T07:32:37.463046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490538+0000","last_change":"2024-09-16T07:32:37.488031+0000","last_active":"2024-09-16T07:32:37.490538+0000","last_peered":"2024-09-16T07:32:37.490538+0000","last_clean":"2024-09-16T07:32:37.490538+0000","last_became_active":"2024-09-16T07:32:37.487716+0000","last_became_peered":"2024-09-16T07:32:37.487716+0000","last_unstale":"2024-09-16T07:32:37.490538+0000","last_undegraded":"2024-09-16T07:32:37.490538+0000","last_fullsized":"2024-09-16T07:32:37.490538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:19.767528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.489418+0000","last_change":"2024-09-16T07:32:37.483866+0000","last_active":"2024-09-16T07:32:37.489418+0000","last_peered":"2024-09-16T07:32:37.489418+0000","last_clean":"2024-09-16T07:32:37.489418+0000","last_became_active":"2024-09-16T07:32:37.483605+0000","last_became_peered":"2024-09-16T07:32:37.483605+0000","last_unstale":"2024-09-16T07:32:37.489418+0000","last_undegraded":"2024-09-16T07:32:37.489418+0000","last_fullsized":"2024-09-16T07:32:37.489418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465238+0000","last_change":"2024-09-16T07:32:37.465238+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465238+0000","last_undegraded":"2024-09-16T07:32:37.465238+0000","last_fullsized":"2024-09-16T07:32:37.465238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484740+0000","last_change":"2024-09-16T07:32:37.481218+0000","last_active":"2024-09-16T07:32:37.484740+0000","last_peered":"2024-09-16T07:32:37.484740+0000","last_clean":"2024-09-16T07:32:37.484740+0000","last_became_active":"2024-09-16T07:32:37.480940+0000","last_became_peered":"2024-09-16T07:32:37.480940+0000","last_unstale":"2024-09-16T07:32:37.484740+0000","last_undegraded":"2024-09-16T07:32:37.484740+0000","last_fullsized":"2024-09-16T07:32:37.484740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:11.446314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468339+0000","last_change":"2024-09-16T07:32:37.468339+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468339+0000","last_undegraded":"2024-09-16T07:32:37.468339+0000","last_fullsized":"2024-09-16T07:32:37.468339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484810+0000","last_change":"2024-09-16T07:32:37.483432+0000","last_active":"2024-09-16T07:32:37.484810+0000","last_peered":"2024-09-16T07:32:37.484810+0000","last_clean":"2024-09-16T07:32:37.484810+0000","last_became_active":"2024-09-16T07:32:37.483094+0000","last_became_peered":"2024-09-16T07:32:37.483094+0000","last_unstale":"2024-09-16T07:32:37.484810+0000","last_undegraded":"2024-09-16T07:32:37.484810+0000","last_fullsized":"2024-09-16T07:32:37.484810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:45.386864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460239+0000","last_change":"2024-09-16T07:32:37.460239+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460239+0000","last_undegraded":"2024-09-16T07:32:37.460239+0000","last_fullsized":"2024-09-16T07:32:37.460239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483801+0000","last_change":"2024-09-16T07:32:37.475522+0000","last_active":"2024-09-16T07:32:37.483801+0000","last_peered":"2024-09-16T07:32:37.483801+0000","last_clean":"2024-09-16T07:32:37.483801+0000","last_became_active":"2024-09-16T07:32:37.475175+0000","last_became_peered":"2024-09-16T07:32:37.475175+0000","last_unstale":"2024-09-16T07:32:37.483801+0000","last_undegraded":"2024-09-16T07:32:37.483801+0000","last_fullsized":"2024-09-16T07:32:37.483801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:11.309285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.475658+0000","last_change":"2024-09-16T07:32:37.475658+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.475658+0000","last_undegraded":"2024-09-16T07:32:37.475658+0000","last_fullsized":"2024-09-16T07:32:37.475658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487250+0000","last_change":"2024-09-16T07:32:37.478353+0000","last_active":"2024-09-16T07:32:37.487250+0000","last_peered":"2024-09-16T07:32:37.487250+0000","last_clean":"2024-09-16T07:32:37.487250+0000","last_became_active":"2024-09-16T07:32:37.477976+0000","last_became_peered":"2024-09-16T07:32:37.477976+0000","last_unstale":"2024-09-16T07:32:37.487250+0000","last_undegraded":"2024-09-16T07:32:37.487250+0000","last_fullsized":"2024-09-16T07:32:37.487250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:44.008476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473368+0000","last_change":"2024-09-16T07:32:37.473368+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473368+0000","last_undegraded":"2024-09-16T07:32:37.473368+0000","last_fullsized":"2024-09-16T07:32:37.473368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481831+0000","last_change":"2024-09-16T07:32:37.479382+0000","last_active":"2024-09-16T07:32:37.481831+0000","last_peered":"2024-09-16T07:32:37.481831+0000","last_clean":"2024-09-16T07:32:37.481831+0000","last_became_active":"2024-09-16T07:32:37.479132+0000","last_became_peered":"2024-09-16T07:32:37.479132+0000","last_unstale":"2024-09-16T07:32:37.481831+0000","last_undegraded":"2024-09-16T07:32:37.481831+0000","last_fullsized":"2024-09-16T07:32:37.481831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:12.345158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458659+0000","last_change":"2024-09-16T07:32:37.458659+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458659+0000","last_undegraded":"2024-09-16T07:32:37.458659+0000","last_fullsized":"2024-09-16T07:32:37.458659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478155+0000","last_change":"2024-09-16T07:32:37.475562+0000","last_active":"2024-09-16T07:32:37.478155+0000","last_peered":"2024-09-16T07:32:37.478155+0000","last_clean":"2024-09-16T07:32:37.478155+0000","last_became_active":"2024-09-16T07:32:37.475257+0000","last_became_peered":"2024-09-16T07:32:37.475257+0000","last_unstale":"2024-09-16T07:32:37.478155+0000","last_undegraded":"2024-09-16T07:32:37.478155+0000","last_fullsized":"2024-09-16T07:32:37.478155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:18.559168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467545+0000","last_change":"2024-09-16T07:32:37.467545+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467545+0000","last_undegraded":"2024-09-16T07:32:37.467545+0000","last_fullsized":"2024-09-16T07:32:37.467545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478795+0000","last_change":"2024-09-16T07:32:37.472209+0000","last_active":"2024-09-16T07:32:37.478795+0000","last_peered":"2024-09-16T07:32:37.478795+0000","last_clean":"2024-09-16T07:32:37.478795+0000","last_became_active":"2024-09-16T07:32:37.471927+0000","last_became_peered":"2024-09-16T07:32:37.471927+0000","last_unstale":"2024-09-16T07:32:37.478795+0000","last_undegraded":"2024-09-16T07:32:37.478795+0000","last_fullsized":"2024-09-16T07:32:37.478795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:25.171346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470745+0000","last_change":"2024-09-16T07:32:37.470745+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470745+0000","last_undegraded":"2024-09-16T07:32:37.470745+0000","last_fullsized":"2024-09-16T07:32:37.470745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480135+0000","last_change":"2024-09-16T07:32:37.477898+0000","last_active":"2024-09-16T07:32:37.480135+0000","last_peered":"2024-09-16T07:32:37.480135+0000","last_clean":"2024-09-16T07:32:37.480135+0000","last_became_active":"2024-09-16T07:32:37.477470+0000","last_became_peered":"2024-09-16T07:32:37.477470+0000","last_unstale":"2024-09-16T07:32:37.480135+0000","last_undegraded":"2024-09-16T07:32:37.480135+0000","last_fullsized":"2024-09-16T07:32:37.480135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:19.634468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466218+0000","last_change":"2024-09-16T07:32:37.466218+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466218+0000","last_undegraded":"2024-09-16T07:32:37.466218+0000","last_fullsized":"2024-09-16T07:32:37.466218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487066+0000","last_change":"2024-09-16T07:32:37.477253+0000","last_active":"2024-09-16T07:32:37.487066+0000","last_peered":"2024-09-16T07:32:37.487066+0000","last_clean":"2024-09-16T07:32:37.487066+0000","last_became_active":"2024-09-16T07:32:37.476963+0000","last_became_peered":"2024-09-16T07:32:37.476963+0000","last_unstale":"2024-09-16T07:32:37.487066+0000","last_undegraded":"2024-09-16T07:32:37.487066+0000","last_fullsized":"2024-09-16T07:32:37.487066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:12.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458202+0000","last_change":"2024-09-16T07:32:37.458202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458202+0000","last_undegraded":"2024-09-16T07:32:37.458202+0000","last_fullsized":"2024-09-16T07:32:37.458202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490503+0000","last_change":"2024-09-16T07:32:37.486936+0000","last_active":"2024-09-16T07:32:37.490503+0000","last_peered":"2024-09-16T07:32:37.490503+0000","last_clean":"2024-09-16T07:32:37.490503+0000","last_became_active":"2024-09-16T07:32:37.486624+0000","last_became_peered":"2024-09-16T07:32:37.486624+0000","last_unstale":"2024-09-16T07:32:37.490503+0000","last_undegraded":"2024-09-16T07:32:37.490503+0000","last_fullsized":"2024-09-16T07:32:37.490503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:03.813816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466500+0000","last_change":"2024-09-16T07:32:37.466500+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466500+0000","last_undegraded":"2024-09-16T07:32:37.466500+0000","last_fullsized":"2024-09-16T07:32:37.466500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478471+0000","last_change":"2024-09-16T07:32:37.474376+0000","last_active":"2024-09-16T07:32:37.478471+0000","last_peered":"2024-09-16T07:32:37.478471+0000","last_clean":"2024-09-16T07:32:37.478471+0000","last_became_active":"2024-09-16T07:32:37.474060+0000","last_became_peered":"2024-09-16T07:32:37.474060+0000","last_unstale":"2024-09-16T07:32:37.478471+0000","last_undegraded":"2024-09-16T07:32:37.478471+0000","last_fullsized":"2024-09-16T07:32:37.478471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:07:56.653178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465423+0000","last_change":"2024-09-16T07:32:37.465423+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465423+0000","last_undegraded":"2024-09-16T07:32:37.465423+0000","last_fullsized":"2024-09-16T07:32:37.465423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483015+0000","last_change":"2024-09-16T07:32:37.472142+0000","last_active":"2024-09-16T07:32:37.483015+0000","last_peered":"2024-09-16T07:32:37.483015+0000","last_clean":"2024-09-16T07:32:37.483015+0000","last_became_active":"2024-09-16T07:32:37.471899+0000","last_became_peered":"2024-09-16T07:32:37.471899+0000","last_unstale":"2024-09-16T07:32:37.483015+0000","last_undegraded":"2024-09-16T07:32:37.483015+0000","last_fullsized":"2024-09-16T07:32:37.483015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:29:58.140194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457585+0000","last_change":"2024-09-16T07:32:37.457585+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457585+0000","last_undegraded":"2024-09-16T07:32:37.457585+0000","last_fullsized":"2024-09-16T07:32:37.457585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474783+0000","last_change":"2024-09-16T07:32:37.467550+0000","last_active":"2024-09-16T07:32:37.474783+0000","last_peered":"2024-09-16T07:32:37.474783+0000","last_clean":"2024-09-16T07:32:37.474783+0000","last_became_active":"2024-09-16T07:32:37.467230+0000","last_became_peered":"2024-09-16T07:32:37.467230+0000","last_unstale":"2024-09-16T07:32:37.474783+0000","last_undegraded":"2024-09-16T07:32:37.474783+0000","last_fullsized":"2024-09-16T07:32:37.474783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:46.140465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461697+0000","last_change":"2024-09-16T07:32:37.461697+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461697+0000","last_undegraded":"2024-09-16T07:32:37.461697+0000","last_fullsized":"2024-09-16T07:32:37.461697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486613+0000","last_change":"2024-09-16T07:32:37.481488+0000","last_active":"2024-09-16T07:32:37.486613+0000","last_peered":"2024-09-16T07:32:37.486613+0000","last_clean":"2024-09-16T07:32:37.486613+0000","last_became_active":"2024-09-16T07:32:37.481151+0000","last_became_peered":"2024-09-16T07:32:37.481151+0000","last_unstale":"2024-09-16T07:32:37.486613+0000","last_undegraded":"2024-09-16T07:32:37.486613+0000","last_fullsized":"2024-09-16T07:32:37.486613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:58.916885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470222+0000","last_change":"2024-09-16T07:32:37.470222+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470222+0000","last_undegraded":"2024-09-16T07:32:37.470222+0000","last_fullsized":"2024-09-16T07:32:37.470222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481621+0000","last_change":"2024-09-16T07:32:37.475609+0000","last_active":"2024-09-16T07:32:37.481621+0000","last_peered":"2024-09-16T07:32:37.481621+0000","last_clean":"2024-09-16T07:32:37.481621+0000","last_became_active":"2024-09-16T07:32:37.475160+0000","last_became_peered":"2024-09-16T07:32:37.475160+0000","last_unstale":"2024-09-16T07:32:37.481621+0000","last_undegraded":"2024-09-16T07:32:37.481621+0000","last_fullsized":"2024-09-16T07:32:37.481621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:46.252223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467874+0000","last_change":"2024-09-16T07:32:37.467874+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467874+0000","last_undegraded":"2024-09-16T07:32:37.467874+0000","last_fullsized":"2024-09-16T07:32:37.467874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490416+0000","last_change":"2024-09-16T07:32:37.486787+0000","last_active":"2024-09-16T07:32:37.490416+0000","last_peered":"2024-09-16T07:32:37.490416+0000","last_clean":"2024-09-16T07:32:37.490416+0000","last_became_active":"2024-09-16T07:32:37.486507+0000","last_became_peered":"2024-09-16T07:32:37.486507+0000","last_unstale":"2024-09-16T07:32:37.490416+0000","last_undegraded":"2024-09-16T07:32:37.490416+0000","last_fullsized":"2024-09-16T07:32:37.490416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:58.259219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458902+0000","last_change":"2024-09-16T07:32:37.458902+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458902+0000","last_undegraded":"2024-09-16T07:32:37.458902+0000","last_fullsized":"2024-09-16T07:32:37.458902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483265+0000","last_change":"2024-09-16T07:32:37.479541+0000","last_active":"2024-09-16T07:32:37.483265+0000","last_peered":"2024-09-16T07:32:37.483265+0000","last_clean":"2024-09-16T07:32:37.483265+0000","last_became_active":"2024-09-16T07:32:37.479221+0000","last_became_peered":"2024-09-16T07:32:37.479221+0000","last_unstale":"2024-09-16T07:32:37.483265+0000","last_undegraded":"2024-09-16T07:32:37.483265+0000","last_fullsized":"2024-09-16T07:32:37.483265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:12.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467000+0000","last_change":"2024-09-16T07:32:37.467000+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467000+0000","last_undegraded":"2024-09-16T07:32:37.467000+0000","last_fullsized":"2024-09-16T07:32:37.467000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490072+0000","last_change":"2024-09-16T07:32:37.486057+0000","last_active":"2024-09-16T07:32:37.490072+0000","last_peered":"2024-09-16T07:32:37.490072+0000","last_clean":"2024-09-16T07:32:37.490072+0000","last_became_active":"2024-09-16T07:32:37.485799+0000","last_became_peered":"2024-09-16T07:32:37.485799+0000","last_unstale":"2024-09-16T07:32:37.490072+0000","last_undegraded":"2024-09-16T07:32:37.490072+0000","last_fullsized":"2024-09-16T07:32:37.490072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:18.829713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490746+0000","last_change":"2024-09-16T07:32:37.488821+0000","last_active":"2024-09-16T07:32:37.490746+0000","last_peered":"2024-09-16T07:32:37.490746+0000","last_clean":"2024-09-16T07:32:37.490746+0000","last_became_active":"2024-09-16T07:32:37.488458+0000","last_became_peered":"2024-09-16T07:32:37.488458+0000","last_unstale":"2024-09-16T07:32:37.490746+0000","last_undegraded":"2024-09-16T07:32:37.490746+0000","last_fullsized":"2024-09-16T07:32:37.490746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:37:57.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470954+0000","last_change":"2024-09-16T07:32:37.470954+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470954+0000","last_undegraded":"2024-09-16T07:32:37.470954+0000","last_fullsized":"2024-09-16T07:32:37.470954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484629+0000","last_change":"2024-09-16T07:32:37.473768+0000","last_active":"2024-09-16T07:32:37.484629+0000","last_peered":"2024-09-16T07:32:37.484629+0000","last_clean":"2024-09-16T07:32:37.484629+0000","last_became_active":"2024-09-16T07:32:37.473395+0000","last_became_peered":"2024-09-16T07:32:37.473395+0000","last_unstale":"2024-09-16T07:32:37.484629+0000","last_undegraded":"2024-09-16T07:32:37.484629+0000","last_fullsized":"2024-09-16T07:32:37.484629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:31.988034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457957+0000","last_change":"2024-09-16T07:32:37.457957+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457957+0000","last_undegraded":"2024-09-16T07:32:37.457957+0000","last_fullsized":"2024-09-16T07:32:37.457957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486022+0000","last_change":"2024-09-16T07:32:37.474441+0000","last_active":"2024-09-16T07:32:37.486022+0000","last_peered":"2024-09-16T07:32:37.486022+0000","last_clean":"2024-09-16T07:32:37.486022+0000","last_became_active":"2024-09-16T07:32:37.474052+0000","last_became_peered":"2024-09-16T07:32:37.474052+0000","last_unstale":"2024-09-16T07:32:37.486022+0000","last_undegraded":"2024-09-16T07:32:37.486022+0000","last_fullsized":"2024-09-16T07:32:37.486022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:20.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461774+0000","last_change":"2024-09-16T07:32:37.461774+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461774+0000","last_undegraded":"2024-09-16T07:32:37.461774+0000","last_fullsized":"2024-09-16T07:32:37.461774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484379+0000","last_change":"2024-09-16T07:32:37.480703+0000","last_active":"2024-09-16T07:32:37.484379+0000","last_peered":"2024-09-16T07:32:37.484379+0000","last_clean":"2024-09-16T07:32:37.484379+0000","last_became_active":"2024-09-16T07:32:37.480323+0000","last_became_peered":"2024-09-16T07:32:37.480323+0000","last_unstale":"2024-09-16T07:32:37.484379+0000","last_undegraded":"2024-09-16T07:32:37.484379+0000","last_fullsized":"2024-09-16T07:32:37.484379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:55.093776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468838+0000","last_change":"2024-09-16T07:32:37.468838+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468838+0000","last_undegraded":"2024-09-16T07:32:37.468838+0000","last_fullsized":"2024-09-16T07:32:37.468838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480086+0000","last_change":"2024-09-16T07:32:37.476463+0000","last_active":"2024-09-16T07:32:37.480086+0000","last_peered":"2024-09-16T07:32:37.480086+0000","last_clean":"2024-09-16T07:32:37.480086+0000","last_became_active":"2024-09-16T07:32:37.476117+0000","last_became_peered":"2024-09-16T07:32:37.476117+0000","last_unstale":"2024-09-16T07:32:37.480086+0000","last_undegraded":"2024-09-16T07:32:37.480086+0000","last_fullsized":"2024-09-16T07:32:37.480086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:42.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458345+0000","last_change":"2024-09-16T07:32:37.458345+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458345+0000","last_undegraded":"2024-09-16T07:32:37.458345+0000","last_fullsized":"2024-09-16T07:32:37.458345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481572+0000","last_change":"2024-09-16T07:32:37.475919+0000","last_active":"2024-09-16T07:32:37.481572+0000","last_peered":"2024-09-16T07:32:37.481572+0000","last_clean":"2024-09-16T07:32:37.481572+0000","last_became_active":"2024-09-16T07:32:37.475565+0000","last_became_peered":"2024-09-16T07:32:37.475565+0000","last_unstale":"2024-09-16T07:32:37.481572+0000","last_undegraded":"2024-09-16T07:32:37.481572+0000","last_fullsized":"2024-09-16T07:32:37.481572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:07.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465554+0000","last_change":"2024-09-16T07:32:37.465554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465554+0000","last_undegraded":"2024-09-16T07:32:37.465554+0000","last_fullsized":"2024-09-16T07:32:37.465554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484792+0000","last_change":"2024-09-16T07:32:37.483345+0000","last_active":"2024-09-16T07:32:37.484792+0000","last_peered":"2024-09-16T07:32:37.484792+0000","last_clean":"2024-09-16T07:32:37.484792+0000","last_became_active":"2024-09-16T07:32:37.482995+0000","last_became_peered":"2024-09-16T07:32:37.482995+0000","last_unstale":"2024-09-16T07:32:37.484792+0000","last_undegraded":"2024-09-16T07:32:37.484792+0000","last_fullsized":"2024-09-16T07:32:37.484792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:26.808309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481836+0000","last_change":"2024-09-16T07:32:37.479500+0000","last_active":"2024-09-16T07:32:37.481836+0000","last_peered":"2024-09-16T07:32:37.481836+0000","last_clean":"2024-09-16T07:32:37.481836+0000","last_became_active":"2024-09-16T07:32:37.479184+0000","last_became_peered":"2024-09-16T07:32:37.479184+0000","last_unstale":"2024-09-16T07:32:37.481836+0000","last_undegraded":"2024-09-16T07:32:37.481836+0000","last_fullsized":"2024-09-16T07:32:37.481836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:10.685063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461634+0000","last_change":"2024-09-16T07:32:37.461634+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461634+0000","last_undegraded":"2024-09-16T07:32:37.461634+0000","last_fullsized":"2024-09-16T07:32:37.461634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478407+0000","last_change":"2024-09-16T07:32:37.475751+0000","last_active":"2024-09-16T07:32:37.478407+0000","last_peered":"2024-09-16T07:32:37.478407+0000","last_clean":"2024-09-16T07:32:37.478407+0000","last_became_active":"2024-09-16T07:32:37.475454+0000","last_became_peered":"2024-09-16T07:32:37.475454+0000","last_unstale":"2024-09-16T07:32:37.478407+0000","last_undegraded":"2024-09-16T07:32:37.478407+0000","last_fullsized":"2024-09-16T07:32:37.478407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:15:05.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467120+0000","last_change":"2024-09-16T07:32:37.467120+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467120+0000","last_undegraded":"2024-09-16T07:32:37.467120+0000","last_fullsized":"2024-09-16T07:32:37.467120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474512+0000","last_change":"2024-09-16T07:32:37.470906+0000","last_active":"2024-09-16T07:32:37.474512+0000","last_peered":"2024-09-16T07:32:37.474512+0000","last_clean":"2024-09-16T07:32:37.474512+0000","last_became_active":"2024-09-16T07:32:37.470554+0000","last_became_peered":"2024-09-16T07:32:37.470554+0000","last_unstale":"2024-09-16T07:32:37.474512+0000","last_undegraded":"2024-09-16T07:32:37.474512+0000","last_fullsized":"2024-09-16T07:32:37.474512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":243,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.460954+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:32:37.460954+0000","last_peered":"2024-09-16T07:32:37.460954+0000","last_clean":"2024-09-16T07:32:37.460954+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:32:37.460954+0000","last_undegraded":"2024-09-16T07:32:37.460954+0000","last_fullsized":"2024-09-16T07:32:37.460954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:32:42.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:32:42.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- 172.21.15.114:0/362664439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1730003ab0 msgr2=0x7f1730003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 --2- 172.21.15.114:0/362664439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1730003ab0 0x7f1730003ed0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f173c009b30 tx=0x7f173c01d210 comp rx=0 tx=0).stop 2024-09-16T07:32:42.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- 172.21.15.114:0/362664439 shutdown_connections 2024-09-16T07:32:42.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 --2- 172.21.15.114:0/362664439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1730003ab0 0x7f1730003ed0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- 172.21.15.114:0/362664439 >> 172.21.15.114:0/362664439 conn(0x7f174c0b18f0 msgr2=0x7f174c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:42.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- 172.21.15.114:0/362664439 shutdown_connections 2024-09-16T07:32:42.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- 172.21.15.114:0/362664439 wait complete. 2024-09-16T07:32:42.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 Processor -- start 2024-09-16T07:32:42.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- start start 2024-09-16T07:32:42.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1730003ab0 0x7f174c14fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c1fc3b0 0x7f174c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15db70 0x7f174c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f174c15ec90 con 0x7f174c1fc3b0 2024-09-16T07:32:42.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f174c15eb10 con 0x7f1730003ab0 2024-09-16T07:32:42.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1752600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f174c15ee10 con 0x7f174c15db70 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1743e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c1fc3b0 0x7f174c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1743e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c1fc3b0 0x7f174c15bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36622/0 (socket says 172.21.15.114:36622) 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f1743e00640 1 -- 172.21.15.114:0/1124574163 learned_addr learned my addr 172.21.15.114:0/1124574163 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.787+0000 7f174b400640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1730003ab0 0x7f174c14fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f174be00640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15db70 0x7f174c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743e00640 1 -- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15db70 msgr2=0x7f174c0c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743e00640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15db70 0x7f174c0c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743e00640 1 -- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1730003ab0 msgr2=0x7f174c14fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743e00640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1730003ab0 0x7f174c14fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743e00640 1 -- 172.21.15.114:0/1124574163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c15c3e0 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743e00640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c1fc3b0 0x7f174c15bea0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1734001cb0 tx=0x7f1734001830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743400640 1 -- 172.21.15.114:0/1124574163 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734015070 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743400640 1 -- 172.21.15.114:0/1124574163 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1734010980 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c1fc8b0 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743400640 1 -- 172.21.15.114:0/1124574163 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734010dd0 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c0ad980 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174c069410 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743400640 1 -- 172.21.15.114:0/1124574163 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f1734018070 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.791+0000 7f1743400640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1728072fe0 0x7f17280754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.795+0000 7f1743400640 1 -- 172.21.15.114:0/1124574163 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f1734094440 con 0x7f174c1fc3b0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.795+0000 7f174b400640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1728072fe0 0x7f17280754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:42.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.795+0000 7f174b400640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1728072fe0 0x7f17280754a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f173c0ae000 tx=0x7f173c019fb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:42.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.795+0000 7f1743400640 1 -- 172.21.15.114:0/1124574163 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f173405ed80 con 0x7f174c1fc3b0 2024-09-16T07:32:42.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.959+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f174c0cf720 con 0x7f1728072fe0 2024-09-16T07:32:42.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.963+0000 7f1743400640 1 -- 172.21.15.114:0/1124574163 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246777 (secure 0 0 0) 0x7f174c0cf720 con 0x7f1728072fe0 2024-09-16T07:32:42.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:42.967 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1728072fe0 msgr2=0x7f17280754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1728072fe0 0x7f17280754a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f173c0ae000 tx=0x7f173c019fb0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c1fc3b0 msgr2=0x7f174c15bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c1fc3b0 0x7f174c15bea0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1734001cb0 tx=0x7f1734001830 comp rx=0 tx=0).stop 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 shutdown_connections 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1728072fe0 0x7f17280754a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f174c15db70 0x7f174c0c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f174c1fc3b0 0x7f174c15bea0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 --2- 172.21.15.114:0/1124574163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1730003ab0 0x7f174c14fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:42.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 >> 172.21.15.114:0/1124574163 conn(0x7f174c0b18f0 msgr2=0x7f174c1572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:42.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 shutdown_connections 2024-09-16T07:32:42.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:42.967+0000 7f1752600640 1 -- 172.21.15.114:0/1124574163 wait complete. 2024-09-16T07:32:42.986 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T07:32:42.373496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258228,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716492,"statfs":{"total":773094113280,"available":772829687808,"internally_reserved":0,"allocated":8888320,"data_stored":4431744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.920424"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464253+0000","last_change":"2024-09-16T07:32:37.464253+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464253+0000","last_undegraded":"2024-09-16T07:32:37.464253+0000","last_fullsized":"2024-09-16T07:32:37.464253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466202+0000","last_change":"2024-09-16T07:32:37.466202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466202+0000","last_undegraded":"2024-09-16T07:32:37.466202+0000","last_fullsized":"2024-09-16T07:32:37.466202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467358+0000","last_change":"2024-09-16T07:32:37.467358+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467358+0000","last_undegraded":"2024-09-16T07:32:37.467358+0000","last_fullsized":"2024-09-16T07:32:37.467358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.469828+0000","last_change":"2024-09-16T07:32:37.469828+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.469828+0000","last_undegraded":"2024-09-16T07:32:37.469828+0000","last_fullsized":"2024-09-16T07:32:37.469828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460511+0000","last_change":"2024-09-16T07:32:37.460511+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460511+0000","last_undegraded":"2024-09-16T07:32:37.460511+0000","last_fullsized":"2024-09-16T07:32:37.460511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473936+0000","last_change":"2024-09-16T07:32:37.473936+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473936+0000","last_undegraded":"2024-09-16T07:32:37.473936+0000","last_fullsized":"2024-09-16T07:32:37.473936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457825+0000","last_change":"2024-09-16T07:32:37.457825+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457825+0000","last_undegraded":"2024-09-16T07:32:37.457825+0000","last_fullsized":"2024-09-16T07:32:37.457825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459132+0000","last_change":"2024-09-16T07:32:37.459132+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459132+0000","last_undegraded":"2024-09-16T07:32:37.459132+0000","last_fullsized":"2024-09-16T07:32:37.459132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468111+0000","last_change":"2024-09-16T07:32:37.468111+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468111+0000","last_undegraded":"2024-09-16T07:32:37.468111+0000","last_fullsized":"2024-09-16T07:32:37.468111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458639+0000","last_change":"2024-09-16T07:32:37.458639+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458639+0000","last_undegraded":"2024-09-16T07:32:37.458639+0000","last_fullsized":"2024-09-16T07:32:37.458639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471190+0000","last_change":"2024-09-16T07:32:37.471190+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471190+0000","last_undegraded":"2024-09-16T07:32:37.471190+0000","last_fullsized":"2024-09-16T07:32:37.471190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.479918+0000","last_change":"2024-09-16T07:32:37.479918+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.479918+0000","last_undegraded":"2024-09-16T07:32:37.479918+0000","last_fullsized":"2024-09-16T07:32:37.479918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468554+0000","last_change":"2024-09-16T07:32:37.468554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468554+0000","last_undegraded":"2024-09-16T07:32:37.468554+0000","last_fullsized":"2024-09-16T07:32:37.468554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468492+0000","last_change":"2024-09-16T07:32:37.468492+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468492+0000","last_undegraded":"2024-09-16T07:32:37.468492+0000","last_fullsized":"2024-09-16T07:32:37.468492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471192+0000","last_change":"2024-09-16T07:32:37.471192+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471192+0000","last_undegraded":"2024-09-16T07:32:37.471192+0000","last_fullsized":"2024-09-16T07:32:37.471192+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468433+0000","last_change":"2024-09-16T07:32:37.468433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468433+0000","last_undegraded":"2024-09-16T07:32:37.468433+0000","last_fullsized":"2024-09-16T07:32:37.468433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466840+0000","last_change":"2024-09-16T07:32:37.466840+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466840+0000","last_undegraded":"2024-09-16T07:32:37.466840+0000","last_fullsized":"2024-09-16T07:32:37.466840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471699+0000","last_change":"2024-09-16T07:32:37.471699+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471699+0000","last_undegraded":"2024-09-16T07:32:37.471699+0000","last_fullsized":"2024-09-16T07:32:37.471699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467723+0000","last_change":"2024-09-16T07:32:37.467723+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467723+0000","last_undegraded":"2024-09-16T07:32:37.467723+0000","last_fullsized":"2024-09-16T07:32:37.467723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463665+0000","last_change":"2024-09-16T07:32:37.463665+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463665+0000","last_undegraded":"2024-09-16T07:32:37.463665+0000","last_fullsized":"2024-09-16T07:32:37.463665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468155+0000","last_change":"2024-09-16T07:32:37.468155+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468155+0000","last_undegraded":"2024-09-16T07:32:37.468155+0000","last_fullsized":"2024-09-16T07:32:37.468155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466325+0000","last_change":"2024-09-16T07:32:37.466325+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466325+0000","last_undegraded":"2024-09-16T07:32:37.466325+0000","last_fullsized":"2024-09-16T07:32:37.466325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458050+0000","last_change":"2024-09-16T07:32:37.458050+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458050+0000","last_undegraded":"2024-09-16T07:32:37.458050+0000","last_fullsized":"2024-09-16T07:32:37.458050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471208+0000","last_change":"2024-09-16T07:32:37.471208+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471208+0000","last_undegraded":"2024-09-16T07:32:37.471208+0000","last_fullsized":"2024-09-16T07:32:37.471208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463695+0000","last_change":"2024-09-16T07:32:37.463695+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463695+0000","last_undegraded":"2024-09-16T07:32:37.463695+0000","last_fullsized":"2024-09-16T07:32:37.463695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468168+0000","last_change":"2024-09-16T07:32:37.468168+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468168+0000","last_undegraded":"2024-09-16T07:32:37.468168+0000","last_fullsized":"2024-09-16T07:32:37.468168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466088+0000","last_change":"2024-09-16T07:32:37.466088+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466088+0000","last_undegraded":"2024-09-16T07:32:37.466088+0000","last_fullsized":"2024-09-16T07:32:37.466088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468544+0000","last_change":"2024-09-16T07:32:37.468544+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468544+0000","last_undegraded":"2024-09-16T07:32:37.468544+0000","last_fullsized":"2024-09-16T07:32:37.468544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463130+0000","last_change":"2024-09-16T07:32:37.463130+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463130+0000","last_undegraded":"2024-09-16T07:32:37.463130+0000","last_fullsized":"2024-09-16T07:32:37.463130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471373+0000","last_change":"2024-09-16T07:32:37.471373+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471373+0000","last_undegraded":"2024-09-16T07:32:37.471373+0000","last_fullsized":"2024-09-16T07:32:37.471373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480153+0000","last_change":"2024-09-16T07:32:37.477686+0000","last_active":"2024-09-16T07:32:37.480153+0000","last_peered":"2024-09-16T07:32:37.480153+0000","last_clean":"2024-09-16T07:32:37.480153+0000","last_became_active":"2024-09-16T07:32:37.477346+0000","last_became_peered":"2024-09-16T07:32:37.477346+0000","last_unstale":"2024-09-16T07:32:37.480153+0000","last_undegraded":"2024-09-16T07:32:37.480153+0000","last_fullsized":"2024-09-16T07:32:37.480153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:08:07.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463071+0000","last_change":"2024-09-16T07:32:37.463071+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463071+0000","last_undegraded":"2024-09-16T07:32:37.463071+0000","last_fullsized":"2024-09-16T07:32:37.463071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484789+0000","last_change":"2024-09-16T07:32:37.483296+0000","last_active":"2024-09-16T07:32:37.484789+0000","last_peered":"2024-09-16T07:32:37.484789+0000","last_clean":"2024-09-16T07:32:37.484789+0000","last_became_active":"2024-09-16T07:32:37.482999+0000","last_became_peered":"2024-09-16T07:32:37.482999+0000","last_unstale":"2024-09-16T07:32:37.484789+0000","last_undegraded":"2024-09-16T07:32:37.484789+0000","last_fullsized":"2024-09-16T07:32:37.484789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:05.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463046+0000","last_change":"2024-09-16T07:32:37.463046+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463046+0000","last_undegraded":"2024-09-16T07:32:37.463046+0000","last_fullsized":"2024-09-16T07:32:37.463046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490538+0000","last_change":"2024-09-16T07:32:37.488031+0000","last_active":"2024-09-16T07:32:37.490538+0000","last_peered":"2024-09-16T07:32:37.490538+0000","last_clean":"2024-09-16T07:32:37.490538+0000","last_became_active":"2024-09-16T07:32:37.487716+0000","last_became_peered":"2024-09-16T07:32:37.487716+0000","last_unstale":"2024-09-16T07:32:37.490538+0000","last_undegraded":"2024-09-16T07:32:37.490538+0000","last_fullsized":"2024-09-16T07:32:37.490538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:19.767528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.489418+0000","last_change":"2024-09-16T07:32:37.483866+0000","last_active":"2024-09-16T07:32:37.489418+0000","last_peered":"2024-09-16T07:32:37.489418+0000","last_clean":"2024-09-16T07:32:37.489418+0000","last_became_active":"2024-09-16T07:32:37.483605+0000","last_became_peered":"2024-09-16T07:32:37.483605+0000","last_unstale":"2024-09-16T07:32:37.489418+0000","last_undegraded":"2024-09-16T07:32:37.489418+0000","last_fullsized":"2024-09-16T07:32:37.489418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465238+0000","last_change":"2024-09-16T07:32:37.465238+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465238+0000","last_undegraded":"2024-09-16T07:32:37.465238+0000","last_fullsized":"2024-09-16T07:32:37.465238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484740+0000","last_change":"2024-09-16T07:32:37.481218+0000","last_active":"2024-09-16T07:32:37.484740+0000","last_peered":"2024-09-16T07:32:37.484740+0000","last_clean":"2024-09-16T07:32:37.484740+0000","last_became_active":"2024-09-16T07:32:37.480940+0000","last_became_peered":"2024-09-16T07:32:37.480940+0000","last_unstale":"2024-09-16T07:32:37.484740+0000","last_undegraded":"2024-09-16T07:32:37.484740+0000","last_fullsized":"2024-09-16T07:32:37.484740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:11.446314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468339+0000","last_change":"2024-09-16T07:32:37.468339+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468339+0000","last_undegraded":"2024-09-16T07:32:37.468339+0000","last_fullsized":"2024-09-16T07:32:37.468339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484810+0000","last_change":"2024-09-16T07:32:37.483432+0000","last_active":"2024-09-16T07:32:37.484810+0000","last_peered":"2024-09-16T07:32:37.484810+0000","last_clean":"2024-09-16T07:32:37.484810+0000","last_became_active":"2024-09-16T07:32:37.483094+0000","last_became_peered":"2024-09-16T07:32:37.483094+0000","last_unstale":"2024-09-16T07:32:37.484810+0000","last_undegraded":"2024-09-16T07:32:37.484810+0000","last_fullsized":"2024-09-16T07:32:37.484810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:45.386864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460239+0000","last_change":"2024-09-16T07:32:37.460239+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460239+0000","last_undegraded":"2024-09-16T07:32:37.460239+0000","last_fullsized":"2024-09-16T07:32:37.460239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483801+0000","last_change":"2024-09-16T07:32:37.475522+0000","last_active":"2024-09-16T07:32:37.483801+0000","last_peered":"2024-09-16T07:32:37.483801+0000","last_clean":"2024-09-16T07:32:37.483801+0000","last_became_active":"2024-09-16T07:32:37.475175+0000","last_became_peered":"2024-09-16T07:32:37.475175+0000","last_unstale":"2024-09-16T07:32:37.483801+0000","last_undegraded":"2024-09-16T07:32:37.483801+0000","last_fullsized":"2024-09-16T07:32:37.483801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:11.309285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.475658+0000","last_change":"2024-09-16T07:32:37.475658+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.475658+0000","last_undegraded":"2024-09-16T07:32:37.475658+0000","last_fullsized":"2024-09-16T07:32:37.475658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487250+0000","last_change":"2024-09-16T07:32:37.478353+0000","last_active":"2024-09-16T07:32:37.487250+0000","last_peered":"2024-09-16T07:32:37.487250+0000","last_clean":"2024-09-16T07:32:37.487250+0000","last_became_active":"2024-09-16T07:32:37.477976+0000","last_became_peered":"2024-09-16T07:32:37.477976+0000","last_unstale":"2024-09-16T07:32:37.487250+0000","last_undegraded":"2024-09-16T07:32:37.487250+0000","last_fullsized":"2024-09-16T07:32:37.487250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:44.008476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473368+0000","last_change":"2024-09-16T07:32:37.473368+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473368+0000","last_undegraded":"2024-09-16T07:32:37.473368+0000","last_fullsized":"2024-09-16T07:32:37.473368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481831+0000","last_change":"2024-09-16T07:32:37.479382+0000","last_active":"2024-09-16T07:32:37.481831+0000","last_peered":"2024-09-16T07:32:37.481831+0000","last_clean":"2024-09-16T07:32:37.481831+0000","last_became_active":"2024-09-16T07:32:37.479132+0000","last_became_peered":"2024-09-16T07:32:37.479132+0000","last_unstale":"2024-09-16T07:32:37.481831+0000","last_undegraded":"2024-09-16T07:32:37.481831+0000","last_fullsized":"2024-09-16T07:32:37.481831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:12.345158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458659+0000","last_change":"2024-09-16T07:32:37.458659+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458659+0000","last_undegraded":"2024-09-16T07:32:37.458659+0000","last_fullsized":"2024-09-16T07:32:37.458659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478155+0000","last_change":"2024-09-16T07:32:37.475562+0000","last_active":"2024-09-16T07:32:37.478155+0000","last_peered":"2024-09-16T07:32:37.478155+0000","last_clean":"2024-09-16T07:32:37.478155+0000","last_became_active":"2024-09-16T07:32:37.475257+0000","last_became_peered":"2024-09-16T07:32:37.475257+0000","last_unstale":"2024-09-16T07:32:37.478155+0000","last_undegraded":"2024-09-16T07:32:37.478155+0000","last_fullsized":"2024-09-16T07:32:37.478155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:18.559168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467545+0000","last_change":"2024-09-16T07:32:37.467545+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467545+0000","last_undegraded":"2024-09-16T07:32:37.467545+0000","last_fullsized":"2024-09-16T07:32:37.467545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478795+0000","last_change":"2024-09-16T07:32:37.472209+0000","last_active":"2024-09-16T07:32:37.478795+0000","last_peered":"2024-09-16T07:32:37.478795+0000","last_clean":"2024-09-16T07:32:37.478795+0000","last_became_active":"2024-09-16T07:32:37.471927+0000","last_became_peered":"2024-09-16T07:32:37.471927+0000","last_unstale":"2024-09-16T07:32:37.478795+0000","last_undegraded":"2024-09-16T07:32:37.478795+0000","last_fullsized":"2024-09-16T07:32:37.478795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:25.171346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470745+0000","last_change":"2024-09-16T07:32:37.470745+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470745+0000","last_undegraded":"2024-09-16T07:32:37.470745+0000","last_fullsized":"2024-09-16T07:32:37.470745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480135+0000","last_change":"2024-09-16T07:32:37.477898+0000","last_active":"2024-09-16T07:32:37.480135+0000","last_peered":"2024-09-16T07:32:37.480135+0000","last_clean":"2024-09-16T07:32:37.480135+0000","last_became_active":"2024-09-16T07:32:37.477470+0000","last_became_peered":"2024-09-16T07:32:37.477470+0000","last_unstale":"2024-09-16T07:32:37.480135+0000","last_undegraded":"2024-09-16T07:32:37.480135+0000","last_fullsized":"2024-09-16T07:32:37.480135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:19.634468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466218+0000","last_change":"2024-09-16T07:32:37.466218+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466218+0000","last_undegraded":"2024-09-16T07:32:37.466218+0000","last_fullsized":"2024-09-16T07:32:37.466218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487066+0000","last_change":"2024-09-16T07:32:37.477253+0000","last_active":"2024-09-16T07:32:37.487066+0000","last_peered":"2024-09-16T07:32:37.487066+0000","last_clean":"2024-09-16T07:32:37.487066+0000","last_became_active":"2024-09-16T07:32:37.476963+0000","last_became_peered":"2024-09-16T07:32:37.476963+0000","last_unstale":"2024-09-16T07:32:37.487066+0000","last_undegraded":"2024-09-16T07:32:37.487066+0000","last_fullsized":"2024-09-16T07:32:37.487066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:12.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458202+0000","last_change":"2024-09-16T07:32:37.458202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458202+0000","last_undegraded":"2024-09-16T07:32:37.458202+0000","last_fullsized":"2024-09-16T07:32:37.458202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490503+0000","last_change":"2024-09-16T07:32:37.486936+0000","last_active":"2024-09-16T07:32:37.490503+0000","last_peered":"2024-09-16T07:32:37.490503+0000","last_clean":"2024-09-16T07:32:37.490503+0000","last_became_active":"2024-09-16T07:32:37.486624+0000","last_became_peered":"2024-09-16T07:32:37.486624+0000","last_unstale":"2024-09-16T07:32:37.490503+0000","last_undegraded":"2024-09-16T07:32:37.490503+0000","last_fullsized":"2024-09-16T07:32:37.490503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:03.813816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466500+0000","last_change":"2024-09-16T07:32:37.466500+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466500+0000","last_undegraded":"2024-09-16T07:32:37.466500+0000","last_fullsized":"2024-09-16T07:32:37.466500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478471+0000","last_change":"2024-09-16T07:32:37.474376+0000","last_active":"2024-09-16T07:32:37.478471+0000","last_peered":"2024-09-16T07:32:37.478471+0000","last_clean":"2024-09-16T07:32:37.478471+0000","last_became_active":"2024-09-16T07:32:37.474060+0000","last_became_peered":"2024-09-16T07:32:37.474060+0000","last_unstale":"2024-09-16T07:32:37.478471+0000","last_undegraded":"2024-09-16T07:32:37.478471+0000","last_fullsized":"2024-09-16T07:32:37.478471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:07:56.653178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465423+0000","last_change":"2024-09-16T07:32:37.465423+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465423+0000","last_undegraded":"2024-09-16T07:32:37.465423+0000","last_fullsized":"2024-09-16T07:32:37.465423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483015+0000","last_change":"2024-09-16T07:32:37.472142+0000","last_active":"2024-09-16T07:32:37.483015+0000","last_peered":"2024-09-16T07:32:37.483015+0000","last_clean":"2024-09-16T07:32:37.483015+0000","last_became_active":"2024-09-16T07:32:37.471899+0000","last_became_peered":"2024-09-16T07:32:37.471899+0000","last_unstale":"2024-09-16T07:32:37.483015+0000","last_undegraded":"2024-09-16T07:32:37.483015+0000","last_fullsized":"2024-09-16T07:32:37.483015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:29:58.140194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457585+0000","last_change":"2024-09-16T07:32:37.457585+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457585+0000","last_undegraded":"2024-09-16T07:32:37.457585+0000","last_fullsized":"2024-09-16T07:32:37.457585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474783+0000","last_change":"2024-09-16T07:32:37.467550+0000","last_active":"2024-09-16T07:32:37.474783+0000","last_peered":"2024-09-16T07:32:37.474783+0000","last_clean":"2024-09-16T07:32:37.474783+0000","last_became_active":"2024-09-16T07:32:37.467230+0000","last_became_peered":"2024-09-16T07:32:37.467230+0000","last_unstale":"2024-09-16T07:32:37.474783+0000","last_undegraded":"2024-09-16T07:32:37.474783+0000","last_fullsized":"2024-09-16T07:32:37.474783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:46.140465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461697+0000","last_change":"2024-09-16T07:32:37.461697+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461697+0000","last_undegraded":"2024-09-16T07:32:37.461697+0000","last_fullsized":"2024-09-16T07:32:37.461697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486613+0000","last_change":"2024-09-16T07:32:37.481488+0000","last_active":"2024-09-16T07:32:37.486613+0000","last_peered":"2024-09-16T07:32:37.486613+0000","last_clean":"2024-09-16T07:32:37.486613+0000","last_became_active":"2024-09-16T07:32:37.481151+0000","last_became_peered":"2024-09-16T07:32:37.481151+0000","last_unstale":"2024-09-16T07:32:37.486613+0000","last_undegraded":"2024-09-16T07:32:37.486613+0000","last_fullsized":"2024-09-16T07:32:37.486613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:58.916885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470222+0000","last_change":"2024-09-16T07:32:37.470222+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470222+0000","last_undegraded":"2024-09-16T07:32:37.470222+0000","last_fullsized":"2024-09-16T07:32:37.470222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481621+0000","last_change":"2024-09-16T07:32:37.475609+0000","last_active":"2024-09-16T07:32:37.481621+0000","last_peered":"2024-09-16T07:32:37.481621+0000","last_clean":"2024-09-16T07:32:37.481621+0000","last_became_active":"2024-09-16T07:32:37.475160+0000","last_became_peered":"2024-09-16T07:32:37.475160+0000","last_unstale":"2024-09-16T07:32:37.481621+0000","last_undegraded":"2024-09-16T07:32:37.481621+0000","last_fullsized":"2024-09-16T07:32:37.481621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:46.252223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467874+0000","last_change":"2024-09-16T07:32:37.467874+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467874+0000","last_undegraded":"2024-09-16T07:32:37.467874+0000","last_fullsized":"2024-09-16T07:32:37.467874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490416+0000","last_change":"2024-09-16T07:32:37.486787+0000","last_active":"2024-09-16T07:32:37.490416+0000","last_peered":"2024-09-16T07:32:37.490416+0000","last_clean":"2024-09-16T07:32:37.490416+0000","last_became_active":"2024-09-16T07:32:37.486507+0000","last_became_peered":"2024-09-16T07:32:37.486507+0000","last_unstale":"2024-09-16T07:32:37.490416+0000","last_undegraded":"2024-09-16T07:32:37.490416+0000","last_fullsized":"2024-09-16T07:32:37.490416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:58.259219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458902+0000","last_change":"2024-09-16T07:32:37.458902+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458902+0000","last_undegraded":"2024-09-16T07:32:37.458902+0000","last_fullsized":"2024-09-16T07:32:37.458902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483265+0000","last_change":"2024-09-16T07:32:37.479541+0000","last_active":"2024-09-16T07:32:37.483265+0000","last_peered":"2024-09-16T07:32:37.483265+0000","last_clean":"2024-09-16T07:32:37.483265+0000","last_became_active":"2024-09-16T07:32:37.479221+0000","last_became_peered":"2024-09-16T07:32:37.479221+0000","last_unstale":"2024-09-16T07:32:37.483265+0000","last_undegraded":"2024-09-16T07:32:37.483265+0000","last_fullsized":"2024-09-16T07:32:37.483265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:12.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467000+0000","last_change":"2024-09-16T07:32:37.467000+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467000+0000","last_undegraded":"2024-09-16T07:32:37.467000+0000","last_fullsized":"2024-09-16T07:32:37.467000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490072+0000","last_change":"2024-09-16T07:32:37.486057+0000","last_active":"2024-09-16T07:32:37.490072+0000","last_peered":"2024-09-16T07:32:37.490072+0000","last_clean":"2024-09-16T07:32:37.490072+0000","last_became_active":"2024-09-16T07:32:37.485799+0000","last_became_peered":"2024-09-16T07:32:37.485799+0000","last_unstale":"2024-09-16T07:32:37.490072+0000","last_undegraded":"2024-09-16T07:32:37.490072+0000","last_fullsized":"2024-09-16T07:32:37.490072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:18.829713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490746+0000","last_change":"2024-09-16T07:32:37.488821+0000","last_active":"2024-09-16T07:32:37.490746+0000","last_peered":"2024-09-16T07:32:37.490746+0000","last_clean":"2024-09-16T07:32:37.490746+0000","last_became_active":"2024-09-16T07:32:37.488458+0000","last_became_peered":"2024-09-16T07:32:37.488458+0000","last_unstale":"2024-09-16T07:32:37.490746+0000","last_undegraded":"2024-09-16T07:32:37.490746+0000","last_fullsized":"2024-09-16T07:32:37.490746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:37:57.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470954+0000","last_change":"2024-09-16T07:32:37.470954+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470954+0000","last_undegraded":"2024-09-16T07:32:37.470954+0000","last_fullsized":"2024-09-16T07:32:37.470954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484629+0000","last_change":"2024-09-16T07:32:37.473768+0000","last_active":"2024-09-16T07:32:37.484629+0000","last_peered":"2024-09-16T07:32:37.484629+0000","last_clean":"2024-09-16T07:32:37.484629+0000","last_became_active":"2024-09-16T07:32:37.473395+0000","last_became_peered":"2024-09-16T07:32:37.473395+0000","last_unstale":"2024-09-16T07:32:37.484629+0000","last_undegraded":"2024-09-16T07:32:37.484629+0000","last_fullsized":"2024-09-16T07:32:37.484629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:31.988034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457957+0000","last_change":"2024-09-16T07:32:37.457957+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457957+0000","last_undegraded":"2024-09-16T07:32:37.457957+0000","last_fullsized":"2024-09-16T07:32:37.457957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486022+0000","last_change":"2024-09-16T07:32:37.474441+0000","last_active":"2024-09-16T07:32:37.486022+0000","last_peered":"2024-09-16T07:32:37.486022+0000","last_clean":"2024-09-16T07:32:37.486022+0000","last_became_active":"2024-09-16T07:32:37.474052+0000","last_became_peered":"2024-09-16T07:32:37.474052+0000","last_unstale":"2024-09-16T07:32:37.486022+0000","last_undegraded":"2024-09-16T07:32:37.486022+0000","last_fullsized":"2024-09-16T07:32:37.486022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:20.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461774+0000","last_change":"2024-09-16T07:32:37.461774+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461774+0000","last_undegraded":"2024-09-16T07:32:37.461774+0000","last_fullsized":"2024-09-16T07:32:37.461774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484379+0000","last_change":"2024-09-16T07:32:37.480703+0000","last_active":"2024-09-16T07:32:37.484379+0000","last_peered":"2024-09-16T07:32:37.484379+0000","last_clean":"2024-09-16T07:32:37.484379+0000","last_became_active":"2024-09-16T07:32:37.480323+0000","last_became_peered":"2024-09-16T07:32:37.480323+0000","last_unstale":"2024-09-16T07:32:37.484379+0000","last_undegraded":"2024-09-16T07:32:37.484379+0000","last_fullsized":"2024-09-16T07:32:37.484379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:55.093776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468838+0000","last_change":"2024-09-16T07:32:37.468838+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468838+0000","last_undegraded":"2024-09-16T07:32:37.468838+0000","last_fullsized":"2024-09-16T07:32:37.468838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480086+0000","last_change":"2024-09-16T07:32:37.476463+0000","last_active":"2024-09-16T07:32:37.480086+0000","last_peered":"2024-09-16T07:32:37.480086+0000","last_clean":"2024-09-16T07:32:37.480086+0000","last_became_active":"2024-09-16T07:32:37.476117+0000","last_became_peered":"2024-09-16T07:32:37.476117+0000","last_unstale":"2024-09-16T07:32:37.480086+0000","last_undegraded":"2024-09-16T07:32:37.480086+0000","last_fullsized":"2024-09-16T07:32:37.480086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:42.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458345+0000","last_change":"2024-09-16T07:32:37.458345+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458345+0000","last_undegraded":"2024-09-16T07:32:37.458345+0000","last_fullsized":"2024-09-16T07:32:37.458345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481572+0000","last_change":"2024-09-16T07:32:37.475919+0000","last_active":"2024-09-16T07:32:37.481572+0000","last_peered":"2024-09-16T07:32:37.481572+0000","last_clean":"2024-09-16T07:32:37.481572+0000","last_became_active":"2024-09-16T07:32:37.475565+0000","last_became_peered":"2024-09-16T07:32:37.475565+0000","last_unstale":"2024-09-16T07:32:37.481572+0000","last_undegraded":"2024-09-16T07:32:37.481572+0000","last_fullsized":"2024-09-16T07:32:37.481572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:07.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465554+0000","last_change":"2024-09-16T07:32:37.465554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465554+0000","last_undegraded":"2024-09-16T07:32:37.465554+0000","last_fullsized":"2024-09-16T07:32:37.465554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484792+0000","last_change":"2024-09-16T07:32:37.483345+0000","last_active":"2024-09-16T07:32:37.484792+0000","last_peered":"2024-09-16T07:32:37.484792+0000","last_clean":"2024-09-16T07:32:37.484792+0000","last_became_active":"2024-09-16T07:32:37.482995+0000","last_became_peered":"2024-09-16T07:32:37.482995+0000","last_unstale":"2024-09-16T07:32:37.484792+0000","last_undegraded":"2024-09-16T07:32:37.484792+0000","last_fullsized":"2024-09-16T07:32:37.484792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:26.808309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481836+0000","last_change":"2024-09-16T07:32:37.479500+0000","last_active":"2024-09-16T07:32:37.481836+0000","last_peered":"2024-09-16T07:32:37.481836+0000","last_clean":"2024-09-16T07:32:37.481836+0000","last_became_active":"2024-09-16T07:32:37.479184+0000","last_became_peered":"2024-09-16T07:32:37.479184+0000","last_unstale":"2024-09-16T07:32:37.481836+0000","last_undegraded":"2024-09-16T07:32:37.481836+0000","last_fullsized":"2024-09-16T07:32:37.481836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:10.685063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461634+0000","last_change":"2024-09-16T07:32:37.461634+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461634+0000","last_undegraded":"2024-09-16T07:32:37.461634+0000","last_fullsized":"2024-09-16T07:32:37.461634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478407+0000","last_change":"2024-09-16T07:32:37.475751+0000","last_active":"2024-09-16T07:32:37.478407+0000","last_peered":"2024-09-16T07:32:37.478407+0000","last_clean":"2024-09-16T07:32:37.478407+0000","last_became_active":"2024-09-16T07:32:37.475454+0000","last_became_peered":"2024-09-16T07:32:37.475454+0000","last_unstale":"2024-09-16T07:32:37.478407+0000","last_undegraded":"2024-09-16T07:32:37.478407+0000","last_fullsized":"2024-09-16T07:32:37.478407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:15:05.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467120+0000","last_change":"2024-09-16T07:32:37.467120+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467120+0000","last_undegraded":"2024-09-16T07:32:37.467120+0000","last_fullsized":"2024-09-16T07:32:37.467120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474512+0000","last_change":"2024-09-16T07:32:37.470906+0000","last_active":"2024-09-16T07:32:37.474512+0000","last_peered":"2024-09-16T07:32:37.474512+0000","last_clean":"2024-09-16T07:32:37.474512+0000","last_became_active":"2024-09-16T07:32:37.470554+0000","last_became_peered":"2024-09-16T07:32:37.470554+0000","last_unstale":"2024-09-16T07:32:37.474512+0000","last_undegraded":"2024-09-16T07:32:37.474512+0000","last_fullsized":"2024-09-16T07:32:37.474512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":243,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.460954+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:32:37.460954+0000","last_peered":"2024-09-16T07:32:37.460954+0000","last_clean":"2024-09-16T07:32:37.460954+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:32:37.460954+0000","last_undegraded":"2024-09-16T07:32:37.460954+0000","last_fullsized":"2024-09-16T07:32:37.460954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:32:42.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:32:43.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 -- 172.21.15.114:0/3605134201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd015c3e0 msgr2=0x7f3dd015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/3605134201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd015c3e0 0x7f3dd015c7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc001f0d0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 -- 172.21.15.114:0/3605134201 shutdown_connections 2024-09-16T07:32:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/3605134201 >> v2:172.21.15.149:3300/0 conn(0x7f3dd006e7a0 0x7f3dd006ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/3605134201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd015c3e0 0x7f3dd015c7c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 -- 172.21.15.114:0/3605134201 >> 172.21.15.114:0/3605134201 conn(0x7f3dd00b18f0 msgr2=0x7f3dd00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 -- 172.21.15.114:0/3605134201 shutdown_connections 2024-09-16T07:32:43.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 -- 172.21.15.114:0/3605134201 wait complete. 2024-09-16T07:32:43.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 Processor -- start 2024-09-16T07:32:43.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.171+0000 7f3dd7c00640 1 -- start start 2024-09-16T07:32:43.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd006e7a0 0x7f3dd014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dd015bfa0 0x7f3dd009c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015c3e0 0x7f3dd009cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd006f2f0 con 0x7f3dd015c3e0 2024-09-16T07:32:43.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd006f170 con 0x7f3dd015bfa0 2024-09-16T07:32:43.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd006f470 con 0x7f3dd006e7a0 2024-09-16T07:32:43.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015c3e0 0x7f3dd009cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015c3e0 0x7f3dd009cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36624/0 (socket says 172.21.15.114:36624) 2024-09-16T07:32:43.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 -- 172.21.15.114:0/2033421047 learned_addr learned my addr 172.21.15.114:0/2033421047 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5200640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd006e7a0 0x7f3dd014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dc7e00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dd015bfa0 0x7f3dd009c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 -- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd006e7a0 msgr2=0x7f3dd014b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd006e7a0 0x7f3dd014b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 -- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dd015bfa0 msgr2=0x7f3dd009c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dd015bfa0 0x7f3dd009c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 -- 172.21.15.114:0/2033421047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd01f8510 con 0x7f3dd015c3e0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd5c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015c3e0 0x7f3dd009cc30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800eb50 tx=0x7f3dc800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dcd600640 1 -- 172.21.15.114:0/2033421047 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8004d30 con 0x7f3dd015c3e0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dcd600640 1 -- 172.21.15.114:0/2033421047 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dc800ce70 con 0x7f3dd015c3e0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd01f87f0 con 0x7f3dd015c3e0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dcd600640 1 -- 172.21.15.114:0/2033421047 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8005240 con 0x7f3dd015c3e0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd0157ba0 con 0x7f3dd015c3e0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd006ec30 con 0x7f3dd015c3e0 2024-09-16T07:32:43.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.175+0000 7f3dcd600640 1 -- 172.21.15.114:0/2033421047 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f3dc80053e0 con 0x7f3dd015c3e0 2024-09-16T07:32:43.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.179+0000 7f3dcd600640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dac072fe0 0x7f3dac0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.179+0000 7f3dcd600640 1 -- 172.21.15.114:0/2033421047 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f3dc8094ed0 con 0x7f3dd015c3e0 2024-09-16T07:32:43.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.179+0000 7f3dd5200640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dac072fe0 0x7f3dac0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.179+0000 7f3dd5200640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dac072fe0 0x7f3dac0754a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00b2000 tx=0x7f3dc001d910 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:43.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.183+0000 7f3dcd600640 1 -- 172.21.15.114:0/2033421047 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3dc805fde0 con 0x7f3dd015c3e0 2024-09-16T07:32:43.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.343+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dd00cbf00 con 0x7f3dac072fe0 2024-09-16T07:32:43.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.347+0000 7f3dcd600640 1 -- 172.21.15.114:0/2033421047 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246777 (secure 0 0 0) 0x7f3dd00cbf00 con 0x7f3dac072fe0 2024-09-16T07:32:43.348 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:43.350 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dac072fe0 msgr2=0x7f3dac0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dac072fe0 0x7f3dac0754a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00b2000 tx=0x7f3dc001d910 comp rx=0 tx=0).stop 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015c3e0 msgr2=0x7f3dd009cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015c3e0 0x7f3dd009cc30 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800eb50 tx=0x7f3dc800c6a0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 shutdown_connections 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dd015c3e0 0x7f3dd009cc30 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3dd015bfa0 0x7f3dd009c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dac072fe0 0x7f3dac0754a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 --2- 172.21.15.114:0/2033421047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3dd006e7a0 0x7f3dd014b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 >> 172.21.15.114:0/2033421047 conn(0x7f3dd00b18f0 msgr2=0x7f3dd00cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:43.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 shutdown_connections 2024-09-16T07:32:43.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.351+0000 7f3dd7c00640 1 -- 172.21.15.114:0/2033421047 wait complete. 2024-09-16T07:32:43.369 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T07:32:42.373496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258228,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716492,"statfs":{"total":773094113280,"available":772829687808,"internally_reserved":0,"allocated":8888320,"data_stored":4431744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.920424"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464253+0000","last_change":"2024-09-16T07:32:37.464253+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464253+0000","last_undegraded":"2024-09-16T07:32:37.464253+0000","last_fullsized":"2024-09-16T07:32:37.464253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466202+0000","last_change":"2024-09-16T07:32:37.466202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466202+0000","last_undegraded":"2024-09-16T07:32:37.466202+0000","last_fullsized":"2024-09-16T07:32:37.466202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467358+0000","last_change":"2024-09-16T07:32:37.467358+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467358+0000","last_undegraded":"2024-09-16T07:32:37.467358+0000","last_fullsized":"2024-09-16T07:32:37.467358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.469828+0000","last_change":"2024-09-16T07:32:37.469828+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.469828+0000","last_undegraded":"2024-09-16T07:32:37.469828+0000","last_fullsized":"2024-09-16T07:32:37.469828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460511+0000","last_change":"2024-09-16T07:32:37.460511+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460511+0000","last_undegraded":"2024-09-16T07:32:37.460511+0000","last_fullsized":"2024-09-16T07:32:37.460511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473936+0000","last_change":"2024-09-16T07:32:37.473936+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473936+0000","last_undegraded":"2024-09-16T07:32:37.473936+0000","last_fullsized":"2024-09-16T07:32:37.473936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457825+0000","last_change":"2024-09-16T07:32:37.457825+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457825+0000","last_undegraded":"2024-09-16T07:32:37.457825+0000","last_fullsized":"2024-09-16T07:32:37.457825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459132+0000","last_change":"2024-09-16T07:32:37.459132+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459132+0000","last_undegraded":"2024-09-16T07:32:37.459132+0000","last_fullsized":"2024-09-16T07:32:37.459132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468111+0000","last_change":"2024-09-16T07:32:37.468111+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468111+0000","last_undegraded":"2024-09-16T07:32:37.468111+0000","last_fullsized":"2024-09-16T07:32:37.468111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458639+0000","last_change":"2024-09-16T07:32:37.458639+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458639+0000","last_undegraded":"2024-09-16T07:32:37.458639+0000","last_fullsized":"2024-09-16T07:32:37.458639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471190+0000","last_change":"2024-09-16T07:32:37.471190+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471190+0000","last_undegraded":"2024-09-16T07:32:37.471190+0000","last_fullsized":"2024-09-16T07:32:37.471190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.479918+0000","last_change":"2024-09-16T07:32:37.479918+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.479918+0000","last_undegraded":"2024-09-16T07:32:37.479918+0000","last_fullsized":"2024-09-16T07:32:37.479918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468554+0000","last_change":"2024-09-16T07:32:37.468554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468554+0000","last_undegraded":"2024-09-16T07:32:37.468554+0000","last_fullsized":"2024-09-16T07:32:37.468554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468492+0000","last_change":"2024-09-16T07:32:37.468492+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468492+0000","last_undegraded":"2024-09-16T07:32:37.468492+0000","last_fullsized":"2024-09-16T07:32:37.468492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471192+0000","last_change":"2024-09-16T07:32:37.471192+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471192+0000","last_undegraded":"2024-09-16T07:32:37.471192+0000","last_fullsized":"2024-09-16T07:32:37.471192+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468433+0000","last_change":"2024-09-16T07:32:37.468433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468433+0000","last_undegraded":"2024-09-16T07:32:37.468433+0000","last_fullsized":"2024-09-16T07:32:37.468433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466840+0000","last_change":"2024-09-16T07:32:37.466840+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466840+0000","last_undegraded":"2024-09-16T07:32:37.466840+0000","last_fullsized":"2024-09-16T07:32:37.466840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471699+0000","last_change":"2024-09-16T07:32:37.471699+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471699+0000","last_undegraded":"2024-09-16T07:32:37.471699+0000","last_fullsized":"2024-09-16T07:32:37.471699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467723+0000","last_change":"2024-09-16T07:32:37.467723+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467723+0000","last_undegraded":"2024-09-16T07:32:37.467723+0000","last_fullsized":"2024-09-16T07:32:37.467723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463665+0000","last_change":"2024-09-16T07:32:37.463665+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463665+0000","last_undegraded":"2024-09-16T07:32:37.463665+0000","last_fullsized":"2024-09-16T07:32:37.463665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468155+0000","last_change":"2024-09-16T07:32:37.468155+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468155+0000","last_undegraded":"2024-09-16T07:32:37.468155+0000","last_fullsized":"2024-09-16T07:32:37.468155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466325+0000","last_change":"2024-09-16T07:32:37.466325+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466325+0000","last_undegraded":"2024-09-16T07:32:37.466325+0000","last_fullsized":"2024-09-16T07:32:37.466325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458050+0000","last_change":"2024-09-16T07:32:37.458050+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458050+0000","last_undegraded":"2024-09-16T07:32:37.458050+0000","last_fullsized":"2024-09-16T07:32:37.458050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471208+0000","last_change":"2024-09-16T07:32:37.471208+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471208+0000","last_undegraded":"2024-09-16T07:32:37.471208+0000","last_fullsized":"2024-09-16T07:32:37.471208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463695+0000","last_change":"2024-09-16T07:32:37.463695+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463695+0000","last_undegraded":"2024-09-16T07:32:37.463695+0000","last_fullsized":"2024-09-16T07:32:37.463695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468168+0000","last_change":"2024-09-16T07:32:37.468168+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468168+0000","last_undegraded":"2024-09-16T07:32:37.468168+0000","last_fullsized":"2024-09-16T07:32:37.468168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466088+0000","last_change":"2024-09-16T07:32:37.466088+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466088+0000","last_undegraded":"2024-09-16T07:32:37.466088+0000","last_fullsized":"2024-09-16T07:32:37.466088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468544+0000","last_change":"2024-09-16T07:32:37.468544+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468544+0000","last_undegraded":"2024-09-16T07:32:37.468544+0000","last_fullsized":"2024-09-16T07:32:37.468544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463130+0000","last_change":"2024-09-16T07:32:37.463130+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463130+0000","last_undegraded":"2024-09-16T07:32:37.463130+0000","last_fullsized":"2024-09-16T07:32:37.463130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471373+0000","last_change":"2024-09-16T07:32:37.471373+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471373+0000","last_undegraded":"2024-09-16T07:32:37.471373+0000","last_fullsized":"2024-09-16T07:32:37.471373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480153+0000","last_change":"2024-09-16T07:32:37.477686+0000","last_active":"2024-09-16T07:32:37.480153+0000","last_peered":"2024-09-16T07:32:37.480153+0000","last_clean":"2024-09-16T07:32:37.480153+0000","last_became_active":"2024-09-16T07:32:37.477346+0000","last_became_peered":"2024-09-16T07:32:37.477346+0000","last_unstale":"2024-09-16T07:32:37.480153+0000","last_undegraded":"2024-09-16T07:32:37.480153+0000","last_fullsized":"2024-09-16T07:32:37.480153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:08:07.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463071+0000","last_change":"2024-09-16T07:32:37.463071+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463071+0000","last_undegraded":"2024-09-16T07:32:37.463071+0000","last_fullsized":"2024-09-16T07:32:37.463071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484789+0000","last_change":"2024-09-16T07:32:37.483296+0000","last_active":"2024-09-16T07:32:37.484789+0000","last_peered":"2024-09-16T07:32:37.484789+0000","last_clean":"2024-09-16T07:32:37.484789+0000","last_became_active":"2024-09-16T07:32:37.482999+0000","last_became_peered":"2024-09-16T07:32:37.482999+0000","last_unstale":"2024-09-16T07:32:37.484789+0000","last_undegraded":"2024-09-16T07:32:37.484789+0000","last_fullsized":"2024-09-16T07:32:37.484789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:05.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463046+0000","last_change":"2024-09-16T07:32:37.463046+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463046+0000","last_undegraded":"2024-09-16T07:32:37.463046+0000","last_fullsized":"2024-09-16T07:32:37.463046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490538+0000","last_change":"2024-09-16T07:32:37.488031+0000","last_active":"2024-09-16T07:32:37.490538+0000","last_peered":"2024-09-16T07:32:37.490538+0000","last_clean":"2024-09-16T07:32:37.490538+0000","last_became_active":"2024-09-16T07:32:37.487716+0000","last_became_peered":"2024-09-16T07:32:37.487716+0000","last_unstale":"2024-09-16T07:32:37.490538+0000","last_undegraded":"2024-09-16T07:32:37.490538+0000","last_fullsized":"2024-09-16T07:32:37.490538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:19.767528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.489418+0000","last_change":"2024-09-16T07:32:37.483866+0000","last_active":"2024-09-16T07:32:37.489418+0000","last_peered":"2024-09-16T07:32:37.489418+0000","last_clean":"2024-09-16T07:32:37.489418+0000","last_became_active":"2024-09-16T07:32:37.483605+0000","last_became_peered":"2024-09-16T07:32:37.483605+0000","last_unstale":"2024-09-16T07:32:37.489418+0000","last_undegraded":"2024-09-16T07:32:37.489418+0000","last_fullsized":"2024-09-16T07:32:37.489418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465238+0000","last_change":"2024-09-16T07:32:37.465238+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465238+0000","last_undegraded":"2024-09-16T07:32:37.465238+0000","last_fullsized":"2024-09-16T07:32:37.465238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484740+0000","last_change":"2024-09-16T07:32:37.481218+0000","last_active":"2024-09-16T07:32:37.484740+0000","last_peered":"2024-09-16T07:32:37.484740+0000","last_clean":"2024-09-16T07:32:37.484740+0000","last_became_active":"2024-09-16T07:32:37.480940+0000","last_became_peered":"2024-09-16T07:32:37.480940+0000","last_unstale":"2024-09-16T07:32:37.484740+0000","last_undegraded":"2024-09-16T07:32:37.484740+0000","last_fullsized":"2024-09-16T07:32:37.484740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:11.446314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468339+0000","last_change":"2024-09-16T07:32:37.468339+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468339+0000","last_undegraded":"2024-09-16T07:32:37.468339+0000","last_fullsized":"2024-09-16T07:32:37.468339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484810+0000","last_change":"2024-09-16T07:32:37.483432+0000","last_active":"2024-09-16T07:32:37.484810+0000","last_peered":"2024-09-16T07:32:37.484810+0000","last_clean":"2024-09-16T07:32:37.484810+0000","last_became_active":"2024-09-16T07:32:37.483094+0000","last_became_peered":"2024-09-16T07:32:37.483094+0000","last_unstale":"2024-09-16T07:32:37.484810+0000","last_undegraded":"2024-09-16T07:32:37.484810+0000","last_fullsized":"2024-09-16T07:32:37.484810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:45.386864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460239+0000","last_change":"2024-09-16T07:32:37.460239+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460239+0000","last_undegraded":"2024-09-16T07:32:37.460239+0000","last_fullsized":"2024-09-16T07:32:37.460239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483801+0000","last_change":"2024-09-16T07:32:37.475522+0000","last_active":"2024-09-16T07:32:37.483801+0000","last_peered":"2024-09-16T07:32:37.483801+0000","last_clean":"2024-09-16T07:32:37.483801+0000","last_became_active":"2024-09-16T07:32:37.475175+0000","last_became_peered":"2024-09-16T07:32:37.475175+0000","last_unstale":"2024-09-16T07:32:37.483801+0000","last_undegraded":"2024-09-16T07:32:37.483801+0000","last_fullsized":"2024-09-16T07:32:37.483801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:11.309285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.475658+0000","last_change":"2024-09-16T07:32:37.475658+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.475658+0000","last_undegraded":"2024-09-16T07:32:37.475658+0000","last_fullsized":"2024-09-16T07:32:37.475658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487250+0000","last_change":"2024-09-16T07:32:37.478353+0000","last_active":"2024-09-16T07:32:37.487250+0000","last_peered":"2024-09-16T07:32:37.487250+0000","last_clean":"2024-09-16T07:32:37.487250+0000","last_became_active":"2024-09-16T07:32:37.477976+0000","last_became_peered":"2024-09-16T07:32:37.477976+0000","last_unstale":"2024-09-16T07:32:37.487250+0000","last_undegraded":"2024-09-16T07:32:37.487250+0000","last_fullsized":"2024-09-16T07:32:37.487250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:44.008476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473368+0000","last_change":"2024-09-16T07:32:37.473368+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473368+0000","last_undegraded":"2024-09-16T07:32:37.473368+0000","last_fullsized":"2024-09-16T07:32:37.473368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481831+0000","last_change":"2024-09-16T07:32:37.479382+0000","last_active":"2024-09-16T07:32:37.481831+0000","last_peered":"2024-09-16T07:32:37.481831+0000","last_clean":"2024-09-16T07:32:37.481831+0000","last_became_active":"2024-09-16T07:32:37.479132+0000","last_became_peered":"2024-09-16T07:32:37.479132+0000","last_unstale":"2024-09-16T07:32:37.481831+0000","last_undegraded":"2024-09-16T07:32:37.481831+0000","last_fullsized":"2024-09-16T07:32:37.481831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:12.345158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458659+0000","last_change":"2024-09-16T07:32:37.458659+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458659+0000","last_undegraded":"2024-09-16T07:32:37.458659+0000","last_fullsized":"2024-09-16T07:32:37.458659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478155+0000","last_change":"2024-09-16T07:32:37.475562+0000","last_active":"2024-09-16T07:32:37.478155+0000","last_peered":"2024-09-16T07:32:37.478155+0000","last_clean":"2024-09-16T07:32:37.478155+0000","last_became_active":"2024-09-16T07:32:37.475257+0000","last_became_peered":"2024-09-16T07:32:37.475257+0000","last_unstale":"2024-09-16T07:32:37.478155+0000","last_undegraded":"2024-09-16T07:32:37.478155+0000","last_fullsized":"2024-09-16T07:32:37.478155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:18.559168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467545+0000","last_change":"2024-09-16T07:32:37.467545+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467545+0000","last_undegraded":"2024-09-16T07:32:37.467545+0000","last_fullsized":"2024-09-16T07:32:37.467545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478795+0000","last_change":"2024-09-16T07:32:37.472209+0000","last_active":"2024-09-16T07:32:37.478795+0000","last_peered":"2024-09-16T07:32:37.478795+0000","last_clean":"2024-09-16T07:32:37.478795+0000","last_became_active":"2024-09-16T07:32:37.471927+0000","last_became_peered":"2024-09-16T07:32:37.471927+0000","last_unstale":"2024-09-16T07:32:37.478795+0000","last_undegraded":"2024-09-16T07:32:37.478795+0000","last_fullsized":"2024-09-16T07:32:37.478795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:25.171346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470745+0000","last_change":"2024-09-16T07:32:37.470745+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470745+0000","last_undegraded":"2024-09-16T07:32:37.470745+0000","last_fullsized":"2024-09-16T07:32:37.470745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480135+0000","last_change":"2024-09-16T07:32:37.477898+0000","last_active":"2024-09-16T07:32:37.480135+0000","last_peered":"2024-09-16T07:32:37.480135+0000","last_clean":"2024-09-16T07:32:37.480135+0000","last_became_active":"2024-09-16T07:32:37.477470+0000","last_became_peered":"2024-09-16T07:32:37.477470+0000","last_unstale":"2024-09-16T07:32:37.480135+0000","last_undegraded":"2024-09-16T07:32:37.480135+0000","last_fullsized":"2024-09-16T07:32:37.480135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:19.634468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466218+0000","last_change":"2024-09-16T07:32:37.466218+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466218+0000","last_undegraded":"2024-09-16T07:32:37.466218+0000","last_fullsized":"2024-09-16T07:32:37.466218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487066+0000","last_change":"2024-09-16T07:32:37.477253+0000","last_active":"2024-09-16T07:32:37.487066+0000","last_peered":"2024-09-16T07:32:37.487066+0000","last_clean":"2024-09-16T07:32:37.487066+0000","last_became_active":"2024-09-16T07:32:37.476963+0000","last_became_peered":"2024-09-16T07:32:37.476963+0000","last_unstale":"2024-09-16T07:32:37.487066+0000","last_undegraded":"2024-09-16T07:32:37.487066+0000","last_fullsized":"2024-09-16T07:32:37.487066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:12.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458202+0000","last_change":"2024-09-16T07:32:37.458202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458202+0000","last_undegraded":"2024-09-16T07:32:37.458202+0000","last_fullsized":"2024-09-16T07:32:37.458202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490503+0000","last_change":"2024-09-16T07:32:37.486936+0000","last_active":"2024-09-16T07:32:37.490503+0000","last_peered":"2024-09-16T07:32:37.490503+0000","last_clean":"2024-09-16T07:32:37.490503+0000","last_became_active":"2024-09-16T07:32:37.486624+0000","last_became_peered":"2024-09-16T07:32:37.486624+0000","last_unstale":"2024-09-16T07:32:37.490503+0000","last_undegraded":"2024-09-16T07:32:37.490503+0000","last_fullsized":"2024-09-16T07:32:37.490503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:03.813816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466500+0000","last_change":"2024-09-16T07:32:37.466500+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466500+0000","last_undegraded":"2024-09-16T07:32:37.466500+0000","last_fullsized":"2024-09-16T07:32:37.466500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478471+0000","last_change":"2024-09-16T07:32:37.474376+0000","last_active":"2024-09-16T07:32:37.478471+0000","last_peered":"2024-09-16T07:32:37.478471+0000","last_clean":"2024-09-16T07:32:37.478471+0000","last_became_active":"2024-09-16T07:32:37.474060+0000","last_became_peered":"2024-09-16T07:32:37.474060+0000","last_unstale":"2024-09-16T07:32:37.478471+0000","last_undegraded":"2024-09-16T07:32:37.478471+0000","last_fullsized":"2024-09-16T07:32:37.478471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:07:56.653178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465423+0000","last_change":"2024-09-16T07:32:37.465423+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465423+0000","last_undegraded":"2024-09-16T07:32:37.465423+0000","last_fullsized":"2024-09-16T07:32:37.465423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483015+0000","last_change":"2024-09-16T07:32:37.472142+0000","last_active":"2024-09-16T07:32:37.483015+0000","last_peered":"2024-09-16T07:32:37.483015+0000","last_clean":"2024-09-16T07:32:37.483015+0000","last_became_active":"2024-09-16T07:32:37.471899+0000","last_became_peered":"2024-09-16T07:32:37.471899+0000","last_unstale":"2024-09-16T07:32:37.483015+0000","last_undegraded":"2024-09-16T07:32:37.483015+0000","last_fullsized":"2024-09-16T07:32:37.483015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:29:58.140194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457585+0000","last_change":"2024-09-16T07:32:37.457585+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457585+0000","last_undegraded":"2024-09-16T07:32:37.457585+0000","last_fullsized":"2024-09-16T07:32:37.457585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474783+0000","last_change":"2024-09-16T07:32:37.467550+0000","last_active":"2024-09-16T07:32:37.474783+0000","last_peered":"2024-09-16T07:32:37.474783+0000","last_clean":"2024-09-16T07:32:37.474783+0000","last_became_active":"2024-09-16T07:32:37.467230+0000","last_became_peered":"2024-09-16T07:32:37.467230+0000","last_unstale":"2024-09-16T07:32:37.474783+0000","last_undegraded":"2024-09-16T07:32:37.474783+0000","last_fullsized":"2024-09-16T07:32:37.474783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:46.140465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461697+0000","last_change":"2024-09-16T07:32:37.461697+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461697+0000","last_undegraded":"2024-09-16T07:32:37.461697+0000","last_fullsized":"2024-09-16T07:32:37.461697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486613+0000","last_change":"2024-09-16T07:32:37.481488+0000","last_active":"2024-09-16T07:32:37.486613+0000","last_peered":"2024-09-16T07:32:37.486613+0000","last_clean":"2024-09-16T07:32:37.486613+0000","last_became_active":"2024-09-16T07:32:37.481151+0000","last_became_peered":"2024-09-16T07:32:37.481151+0000","last_unstale":"2024-09-16T07:32:37.486613+0000","last_undegraded":"2024-09-16T07:32:37.486613+0000","last_fullsized":"2024-09-16T07:32:37.486613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:58.916885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470222+0000","last_change":"2024-09-16T07:32:37.470222+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470222+0000","last_undegraded":"2024-09-16T07:32:37.470222+0000","last_fullsized":"2024-09-16T07:32:37.470222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481621+0000","last_change":"2024-09-16T07:32:37.475609+0000","last_active":"2024-09-16T07:32:37.481621+0000","last_peered":"2024-09-16T07:32:37.481621+0000","last_clean":"2024-09-16T07:32:37.481621+0000","last_became_active":"2024-09-16T07:32:37.475160+0000","last_became_peered":"2024-09-16T07:32:37.475160+0000","last_unstale":"2024-09-16T07:32:37.481621+0000","last_undegraded":"2024-09-16T07:32:37.481621+0000","last_fullsized":"2024-09-16T07:32:37.481621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:46.252223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467874+0000","last_change":"2024-09-16T07:32:37.467874+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467874+0000","last_undegraded":"2024-09-16T07:32:37.467874+0000","last_fullsized":"2024-09-16T07:32:37.467874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490416+0000","last_change":"2024-09-16T07:32:37.486787+0000","last_active":"2024-09-16T07:32:37.490416+0000","last_peered":"2024-09-16T07:32:37.490416+0000","last_clean":"2024-09-16T07:32:37.490416+0000","last_became_active":"2024-09-16T07:32:37.486507+0000","last_became_peered":"2024-09-16T07:32:37.486507+0000","last_unstale":"2024-09-16T07:32:37.490416+0000","last_undegraded":"2024-09-16T07:32:37.490416+0000","last_fullsized":"2024-09-16T07:32:37.490416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:58.259219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458902+0000","last_change":"2024-09-16T07:32:37.458902+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458902+0000","last_undegraded":"2024-09-16T07:32:37.458902+0000","last_fullsized":"2024-09-16T07:32:37.458902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483265+0000","last_change":"2024-09-16T07:32:37.479541+0000","last_active":"2024-09-16T07:32:37.483265+0000","last_peered":"2024-09-16T07:32:37.483265+0000","last_clean":"2024-09-16T07:32:37.483265+0000","last_became_active":"2024-09-16T07:32:37.479221+0000","last_became_peered":"2024-09-16T07:32:37.479221+0000","last_unstale":"2024-09-16T07:32:37.483265+0000","last_undegraded":"2024-09-16T07:32:37.483265+0000","last_fullsized":"2024-09-16T07:32:37.483265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:12.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467000+0000","last_change":"2024-09-16T07:32:37.467000+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467000+0000","last_undegraded":"2024-09-16T07:32:37.467000+0000","last_fullsized":"2024-09-16T07:32:37.467000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490072+0000","last_change":"2024-09-16T07:32:37.486057+0000","last_active":"2024-09-16T07:32:37.490072+0000","last_peered":"2024-09-16T07:32:37.490072+0000","last_clean":"2024-09-16T07:32:37.490072+0000","last_became_active":"2024-09-16T07:32:37.485799+0000","last_became_peered":"2024-09-16T07:32:37.485799+0000","last_unstale":"2024-09-16T07:32:37.490072+0000","last_undegraded":"2024-09-16T07:32:37.490072+0000","last_fullsized":"2024-09-16T07:32:37.490072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:18.829713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490746+0000","last_change":"2024-09-16T07:32:37.488821+0000","last_active":"2024-09-16T07:32:37.490746+0000","last_peered":"2024-09-16T07:32:37.490746+0000","last_clean":"2024-09-16T07:32:37.490746+0000","last_became_active":"2024-09-16T07:32:37.488458+0000","last_became_peered":"2024-09-16T07:32:37.488458+0000","last_unstale":"2024-09-16T07:32:37.490746+0000","last_undegraded":"2024-09-16T07:32:37.490746+0000","last_fullsized":"2024-09-16T07:32:37.490746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:37:57.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470954+0000","last_change":"2024-09-16T07:32:37.470954+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470954+0000","last_undegraded":"2024-09-16T07:32:37.470954+0000","last_fullsized":"2024-09-16T07:32:37.470954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484629+0000","last_change":"2024-09-16T07:32:37.473768+0000","last_active":"2024-09-16T07:32:37.484629+0000","last_peered":"2024-09-16T07:32:37.484629+0000","last_clean":"2024-09-16T07:32:37.484629+0000","last_became_active":"2024-09-16T07:32:37.473395+0000","last_became_peered":"2024-09-16T07:32:37.473395+0000","last_unstale":"2024-09-16T07:32:37.484629+0000","last_undegraded":"2024-09-16T07:32:37.484629+0000","last_fullsized":"2024-09-16T07:32:37.484629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:31.988034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457957+0000","last_change":"2024-09-16T07:32:37.457957+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457957+0000","last_undegraded":"2024-09-16T07:32:37.457957+0000","last_fullsized":"2024-09-16T07:32:37.457957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486022+0000","last_change":"2024-09-16T07:32:37.474441+0000","last_active":"2024-09-16T07:32:37.486022+0000","last_peered":"2024-09-16T07:32:37.486022+0000","last_clean":"2024-09-16T07:32:37.486022+0000","last_became_active":"2024-09-16T07:32:37.474052+0000","last_became_peered":"2024-09-16T07:32:37.474052+0000","last_unstale":"2024-09-16T07:32:37.486022+0000","last_undegraded":"2024-09-16T07:32:37.486022+0000","last_fullsized":"2024-09-16T07:32:37.486022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:20.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461774+0000","last_change":"2024-09-16T07:32:37.461774+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461774+0000","last_undegraded":"2024-09-16T07:32:37.461774+0000","last_fullsized":"2024-09-16T07:32:37.461774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484379+0000","last_change":"2024-09-16T07:32:37.480703+0000","last_active":"2024-09-16T07:32:37.484379+0000","last_peered":"2024-09-16T07:32:37.484379+0000","last_clean":"2024-09-16T07:32:37.484379+0000","last_became_active":"2024-09-16T07:32:37.480323+0000","last_became_peered":"2024-09-16T07:32:37.480323+0000","last_unstale":"2024-09-16T07:32:37.484379+0000","last_undegraded":"2024-09-16T07:32:37.484379+0000","last_fullsized":"2024-09-16T07:32:37.484379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:55.093776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468838+0000","last_change":"2024-09-16T07:32:37.468838+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468838+0000","last_undegraded":"2024-09-16T07:32:37.468838+0000","last_fullsized":"2024-09-16T07:32:37.468838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480086+0000","last_change":"2024-09-16T07:32:37.476463+0000","last_active":"2024-09-16T07:32:37.480086+0000","last_peered":"2024-09-16T07:32:37.480086+0000","last_clean":"2024-09-16T07:32:37.480086+0000","last_became_active":"2024-09-16T07:32:37.476117+0000","last_became_peered":"2024-09-16T07:32:37.476117+0000","last_unstale":"2024-09-16T07:32:37.480086+0000","last_undegraded":"2024-09-16T07:32:37.480086+0000","last_fullsized":"2024-09-16T07:32:37.480086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:42.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458345+0000","last_change":"2024-09-16T07:32:37.458345+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458345+0000","last_undegraded":"2024-09-16T07:32:37.458345+0000","last_fullsized":"2024-09-16T07:32:37.458345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481572+0000","last_change":"2024-09-16T07:32:37.475919+0000","last_active":"2024-09-16T07:32:37.481572+0000","last_peered":"2024-09-16T07:32:37.481572+0000","last_clean":"2024-09-16T07:32:37.481572+0000","last_became_active":"2024-09-16T07:32:37.475565+0000","last_became_peered":"2024-09-16T07:32:37.475565+0000","last_unstale":"2024-09-16T07:32:37.481572+0000","last_undegraded":"2024-09-16T07:32:37.481572+0000","last_fullsized":"2024-09-16T07:32:37.481572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:07.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465554+0000","last_change":"2024-09-16T07:32:37.465554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465554+0000","last_undegraded":"2024-09-16T07:32:37.465554+0000","last_fullsized":"2024-09-16T07:32:37.465554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484792+0000","last_change":"2024-09-16T07:32:37.483345+0000","last_active":"2024-09-16T07:32:37.484792+0000","last_peered":"2024-09-16T07:32:37.484792+0000","last_clean":"2024-09-16T07:32:37.484792+0000","last_became_active":"2024-09-16T07:32:37.482995+0000","last_became_peered":"2024-09-16T07:32:37.482995+0000","last_unstale":"2024-09-16T07:32:37.484792+0000","last_undegraded":"2024-09-16T07:32:37.484792+0000","last_fullsized":"2024-09-16T07:32:37.484792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:26.808309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481836+0000","last_change":"2024-09-16T07:32:37.479500+0000","last_active":"2024-09-16T07:32:37.481836+0000","last_peered":"2024-09-16T07:32:37.481836+0000","last_clean":"2024-09-16T07:32:37.481836+0000","last_became_active":"2024-09-16T07:32:37.479184+0000","last_became_peered":"2024-09-16T07:32:37.479184+0000","last_unstale":"2024-09-16T07:32:37.481836+0000","last_undegraded":"2024-09-16T07:32:37.481836+0000","last_fullsized":"2024-09-16T07:32:37.481836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:10.685063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461634+0000","last_change":"2024-09-16T07:32:37.461634+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461634+0000","last_undegraded":"2024-09-16T07:32:37.461634+0000","last_fullsized":"2024-09-16T07:32:37.461634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478407+0000","last_change":"2024-09-16T07:32:37.475751+0000","last_active":"2024-09-16T07:32:37.478407+0000","last_peered":"2024-09-16T07:32:37.478407+0000","last_clean":"2024-09-16T07:32:37.478407+0000","last_became_active":"2024-09-16T07:32:37.475454+0000","last_became_peered":"2024-09-16T07:32:37.475454+0000","last_unstale":"2024-09-16T07:32:37.478407+0000","last_undegraded":"2024-09-16T07:32:37.478407+0000","last_fullsized":"2024-09-16T07:32:37.478407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:15:05.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467120+0000","last_change":"2024-09-16T07:32:37.467120+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467120+0000","last_undegraded":"2024-09-16T07:32:37.467120+0000","last_fullsized":"2024-09-16T07:32:37.467120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474512+0000","last_change":"2024-09-16T07:32:37.470906+0000","last_active":"2024-09-16T07:32:37.474512+0000","last_peered":"2024-09-16T07:32:37.474512+0000","last_clean":"2024-09-16T07:32:37.474512+0000","last_became_active":"2024-09-16T07:32:37.470554+0000","last_became_peered":"2024-09-16T07:32:37.470554+0000","last_unstale":"2024-09-16T07:32:37.474512+0000","last_undegraded":"2024-09-16T07:32:37.474512+0000","last_fullsized":"2024-09-16T07:32:37.474512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":243,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.460954+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:32:37.460954+0000","last_peered":"2024-09-16T07:32:37.460954+0000","last_clean":"2024-09-16T07:32:37.460954+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:32:37.460954+0000","last_undegraded":"2024-09-16T07:32:37.460954+0000","last_fullsized":"2024-09-16T07:32:37.460954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:32:43.373 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-16T07:32:43.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.464253+0000', 'last_change': '2024-09-16T07:32:37.464253+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.464253+0000', 'last_undegraded': '2024-09-16T07:32:37.464253+0000', 'last_fullsized': '2024-09-16T07:32:37.464253+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.373 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-16T07:32:43.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.466202+0000', 'last_change': '2024-09-16T07:32:37.466202+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.466202+0000', 'last_undegraded': '2024-09-16T07:32:37.466202+0000', 'last_fullsized': '2024-09-16T07:32:37.466202+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.373 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-16T07:32:43.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.459963+0000', 'last_change': '2024-09-16T07:32:37.459963+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.459963+0000', 'last_undegraded': '2024-09-16T07:32:37.459963+0000', 'last_fullsized': '2024-09-16T07:32:37.459963+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.373 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.467358+0000', 'last_change': '2024-09-16T07:32:37.467358+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.467358+0000', 'last_undegraded': '2024-09-16T07:32:37.467358+0000', 'last_fullsized': '2024-09-16T07:32:37.467358+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.469828+0000', 'last_change': '2024-09-16T07:32:37.469828+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.469828+0000', 'last_undegraded': '2024-09-16T07:32:37.469828+0000', 'last_fullsized': '2024-09-16T07:32:37.469828+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.460511+0000', 'last_change': '2024-09-16T07:32:37.460511+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.460511+0000', 'last_undegraded': '2024-09-16T07:32:37.460511+0000', 'last_fullsized': '2024-09-16T07:32:37.460511+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.473936+0000', 'last_change': '2024-09-16T07:32:37.473936+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.473936+0000', 'last_undegraded': '2024-09-16T07:32:37.473936+0000', 'last_fullsized': '2024-09-16T07:32:37.473936+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.457825+0000', 'last_change': '2024-09-16T07:32:37.457825+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.457825+0000', 'last_undegraded': '2024-09-16T07:32:37.457825+0000', 'last_fullsized': '2024-09-16T07:32:37.457825+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-16T07:32:43.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.459132+0000', 'last_change': '2024-09-16T07:32:37.459132+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.459132+0000', 'last_undegraded': '2024-09-16T07:32:37.459132+0000', 'last_fullsized': '2024-09-16T07:32:37.459132+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.464336+0000', 'last_change': '2024-09-16T07:32:37.464336+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.464336+0000', 'last_undegraded': '2024-09-16T07:32:37.464336+0000', 'last_fullsized': '2024-09-16T07:32:37.464336+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:PG 13.35 is not active+clean 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468111+0000', 'last_change': '2024-09-16T07:32:37.468111+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468111+0000', 'last_undegraded': '2024-09-16T07:32:37.468111+0000', 'last_fullsized': '2024-09-16T07:32:37.468111+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.464336+0000', 'last_change': '2024-09-16T07:32:37.464336+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.464336+0000', 'last_undegraded': '2024-09-16T07:32:37.464336+0000', 'last_fullsized': '2024-09-16T07:32:37.464336+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.458639+0000', 'last_change': '2024-09-16T07:32:37.458639+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.458639+0000', 'last_undegraded': '2024-09-16T07:32:37.458639+0000', 'last_fullsized': '2024-09-16T07:32:37.458639+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:PG 13.32 is not active+clean 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.471190+0000', 'last_change': '2024-09-16T07:32:37.471190+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.471190+0000', 'last_undegraded': '2024-09-16T07:32:37.471190+0000', 'last_fullsized': '2024-09-16T07:32:37.471190+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-16T07:32:43.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.479918+0000', 'last_change': '2024-09-16T07:32:37.479918+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.479918+0000', 'last_undegraded': '2024-09-16T07:32:37.479918+0000', 'last_fullsized': '2024-09-16T07:32:37.479918+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468554+0000', 'last_change': '2024-09-16T07:32:37.468554+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468554+0000', 'last_undegraded': '2024-09-16T07:32:37.468554+0000', 'last_fullsized': '2024-09-16T07:32:37.468554+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468492+0000', 'last_change': '2024-09-16T07:32:37.468492+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468492+0000', 'last_undegraded': '2024-09-16T07:32:37.468492+0000', 'last_fullsized': '2024-09-16T07:32:37.468492+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2e is not active+clean 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.471192+0000', 'last_change': '2024-09-16T07:32:37.471192+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.471192+0000', 'last_undegraded': '2024-09-16T07:32:37.471192+0000', 'last_fullsized': '2024-09-16T07:32:37.471192+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2d is not active+clean 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468433+0000', 'last_change': '2024-09-16T07:32:37.468433+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468433+0000', 'last_undegraded': '2024-09-16T07:32:37.468433+0000', 'last_fullsized': '2024-09-16T07:32:37.468433+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2c is not active+clean 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.466840+0000', 'last_change': '2024-09-16T07:32:37.466840+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.466840+0000', 'last_undegraded': '2024-09-16T07:32:37.466840+0000', 'last_fullsized': '2024-09-16T07:32:37.466840+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.376 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2b is not active+clean 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.471699+0000', 'last_change': '2024-09-16T07:32:37.471699+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.471699+0000', 'last_undegraded': '2024-09-16T07:32:37.471699+0000', 'last_fullsized': '2024-09-16T07:32:37.471699+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2a is not active+clean 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.467723+0000', 'last_change': '2024-09-16T07:32:37.467723+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.467723+0000', 'last_undegraded': '2024-09-16T07:32:37.467723+0000', 'last_fullsized': '2024-09-16T07:32:37.467723+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.463665+0000', 'last_change': '2024-09-16T07:32:37.463665+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.463665+0000', 'last_undegraded': '2024-09-16T07:32:37.463665+0000', 'last_fullsized': '2024-09-16T07:32:37.463665+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:PG 13.28 is not active+clean 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468155+0000', 'last_change': '2024-09-16T07:32:37.468155+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468155+0000', 'last_undegraded': '2024-09-16T07:32:37.468155+0000', 'last_fullsized': '2024-09-16T07:32:37.468155+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:PG 13.27 is not active+clean 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.466325+0000', 'last_change': '2024-09-16T07:32:37.466325+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.466325+0000', 'last_undegraded': '2024-09-16T07:32:37.466325+0000', 'last_fullsized': '2024-09-16T07:32:37.466325+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.458050+0000', 'last_change': '2024-09-16T07:32:37.458050+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.458050+0000', 'last_undegraded': '2024-09-16T07:32:37.458050+0000', 'last_fullsized': '2024-09-16T07:32:37.458050+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.377 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.471208+0000', 'last_change': '2024-09-16T07:32:37.471208+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.471208+0000', 'last_undegraded': '2024-09-16T07:32:37.471208+0000', 'last_fullsized': '2024-09-16T07:32:37.471208+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.463695+0000', 'last_change': '2024-09-16T07:32:37.463695+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.463695+0000', 'last_undegraded': '2024-09-16T07:32:37.463695+0000', 'last_fullsized': '2024-09-16T07:32:37.463695+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.23 is not active+clean 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468168+0000', 'last_change': '2024-09-16T07:32:37.468168+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468168+0000', 'last_undegraded': '2024-09-16T07:32:37.468168+0000', 'last_fullsized': '2024-09-16T07:32:37.468168+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.22 is not active+clean 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.466088+0000', 'last_change': '2024-09-16T07:32:37.466088+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.466088+0000', 'last_undegraded': '2024-09-16T07:32:37.466088+0000', 'last_fullsized': '2024-09-16T07:32:37.466088+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468544+0000', 'last_change': '2024-09-16T07:32:37.468544+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468544+0000', 'last_undegraded': '2024-09-16T07:32:37.468544+0000', 'last_fullsized': '2024-09-16T07:32:37.468544+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-16T07:32:43.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.463130+0000', 'last_change': '2024-09-16T07:32:37.463130+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.463130+0000', 'last_undegraded': '2024-09-16T07:32:37.463130+0000', 'last_fullsized': '2024-09-16T07:32:37.463130+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.471373+0000', 'last_change': '2024-09-16T07:32:37.471373+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.471373+0000', 'last_undegraded': '2024-09-16T07:32:37.471373+0000', 'last_fullsized': '2024-09-16T07:32:37.471373+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.463071+0000', 'last_change': '2024-09-16T07:32:37.463071+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.463071+0000', 'last_undegraded': '2024-09-16T07:32:37.463071+0000', 'last_fullsized': '2024-09-16T07:32:37.463071+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.463046+0000', 'last_change': '2024-09-16T07:32:37.463046+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.463046+0000', 'last_undegraded': '2024-09-16T07:32:37.463046+0000', 'last_fullsized': '2024-09-16T07:32:37.463046+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.457433+0000', 'last_change': '2024-09-16T07:32:37.457433+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.457433+0000', 'last_undegraded': '2024-09-16T07:32:37.457433+0000', 'last_fullsized': '2024-09-16T07:32:37.457433+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.465238+0000', 'last_change': '2024-09-16T07:32:37.465238+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.465238+0000', 'last_undegraded': '2024-09-16T07:32:37.465238+0000', 'last_fullsized': '2024-09-16T07:32:37.465238+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-16T07:32:43.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468339+0000', 'last_change': '2024-09-16T07:32:37.468339+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468339+0000', 'last_undegraded': '2024-09-16T07:32:37.468339+0000', 'last_fullsized': '2024-09-16T07:32:37.468339+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.460239+0000', 'last_change': '2024-09-16T07:32:37.460239+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.460239+0000', 'last_undegraded': '2024-09-16T07:32:37.460239+0000', 'last_fullsized': '2024-09-16T07:32:37.460239+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.475658+0000', 'last_change': '2024-09-16T07:32:37.475658+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.475658+0000', 'last_undegraded': '2024-09-16T07:32:37.475658+0000', 'last_fullsized': '2024-09-16T07:32:37.475658+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.473368+0000', 'last_change': '2024-09-16T07:32:37.473368+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.473368+0000', 'last_undegraded': '2024-09-16T07:32:37.473368+0000', 'last_fullsized': '2024-09-16T07:32:37.473368+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.458659+0000', 'last_change': '2024-09-16T07:32:37.458659+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.458659+0000', 'last_undegraded': '2024-09-16T07:32:37.458659+0000', 'last_fullsized': '2024-09-16T07:32:37.458659+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.467545+0000', 'last_change': '2024-09-16T07:32:37.467545+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.467545+0000', 'last_undegraded': '2024-09-16T07:32:37.467545+0000', 'last_fullsized': '2024-09-16T07:32:37.467545+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:32:43.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.470745+0000', 'last_change': '2024-09-16T07:32:37.470745+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.470745+0000', 'last_undegraded': '2024-09-16T07:32:37.470745+0000', 'last_fullsized': '2024-09-16T07:32:37.470745+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.466218+0000', 'last_change': '2024-09-16T07:32:37.466218+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.466218+0000', 'last_undegraded': '2024-09-16T07:32:37.466218+0000', 'last_fullsized': '2024-09-16T07:32:37.466218+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.458202+0000', 'last_change': '2024-09-16T07:32:37.458202+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.458202+0000', 'last_undegraded': '2024-09-16T07:32:37.458202+0000', 'last_fullsized': '2024-09-16T07:32:37.458202+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.466500+0000', 'last_change': '2024-09-16T07:32:37.466500+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.466500+0000', 'last_undegraded': '2024-09-16T07:32:37.466500+0000', 'last_fullsized': '2024-09-16T07:32:37.466500+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.465423+0000', 'last_change': '2024-09-16T07:32:37.465423+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.465423+0000', 'last_undegraded': '2024-09-16T07:32:37.465423+0000', 'last_fullsized': '2024-09-16T07:32:37.465423+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-16T07:32:43.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.457585+0000', 'last_change': '2024-09-16T07:32:37.457585+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.457585+0000', 'last_undegraded': '2024-09-16T07:32:37.457585+0000', 'last_fullsized': '2024-09-16T07:32:37.457585+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.461697+0000', 'last_change': '2024-09-16T07:32:37.461697+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.461697+0000', 'last_undegraded': '2024-09-16T07:32:37.461697+0000', 'last_fullsized': '2024-09-16T07:32:37.461697+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.470222+0000', 'last_change': '2024-09-16T07:32:37.470222+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.470222+0000', 'last_undegraded': '2024-09-16T07:32:37.470222+0000', 'last_fullsized': '2024-09-16T07:32:37.470222+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.467874+0000', 'last_change': '2024-09-16T07:32:37.467874+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.467874+0000', 'last_undegraded': '2024-09-16T07:32:37.467874+0000', 'last_fullsized': '2024-09-16T07:32:37.467874+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.458902+0000', 'last_change': '2024-09-16T07:32:37.458902+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.458902+0000', 'last_undegraded': '2024-09-16T07:32:37.458902+0000', 'last_fullsized': '2024-09-16T07:32:37.458902+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.8 is not active+clean 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.467000+0000', 'last_change': '2024-09-16T07:32:37.467000+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.467000+0000', 'last_undegraded': '2024-09-16T07:32:37.467000+0000', 'last_fullsized': '2024-09-16T07:32:37.467000+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-16T07:32:43.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.459963+0000', 'last_change': '2024-09-16T07:32:37.459963+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.459963+0000', 'last_undegraded': '2024-09-16T07:32:37.459963+0000', 'last_fullsized': '2024-09-16T07:32:37.459963+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.470954+0000', 'last_change': '2024-09-16T07:32:37.470954+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.470954+0000', 'last_undegraded': '2024-09-16T07:32:37.470954+0000', 'last_fullsized': '2024-09-16T07:32:37.470954+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.457957+0000', 'last_change': '2024-09-16T07:32:37.457957+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.457957+0000', 'last_undegraded': '2024-09-16T07:32:37.457957+0000', 'last_fullsized': '2024-09-16T07:32:37.457957+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.461774+0000', 'last_change': '2024-09-16T07:32:37.461774+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.461774+0000', 'last_undegraded': '2024-09-16T07:32:37.461774+0000', 'last_fullsized': '2024-09-16T07:32:37.461774+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.468838+0000', 'last_change': '2024-09-16T07:32:37.468838+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.468838+0000', 'last_undegraded': '2024-09-16T07:32:37.468838+0000', 'last_fullsized': '2024-09-16T07:32:37.468838+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.458345+0000', 'last_change': '2024-09-16T07:32:37.458345+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.458345+0000', 'last_undegraded': '2024-09-16T07:32:37.458345+0000', 'last_fullsized': '2024-09-16T07:32:37.458345+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-16T07:32:43.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.465554+0000', 'last_change': '2024-09-16T07:32:37.465554+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.465554+0000', 'last_undegraded': '2024-09-16T07:32:37.465554+0000', 'last_fullsized': '2024-09-16T07:32:37.465554+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:32:43.384 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-16T07:32:43.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.457433+0000', 'last_change': '2024-09-16T07:32:37.457433+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.457433+0000', 'last_undegraded': '2024-09-16T07:32:37.457433+0000', 'last_fullsized': '2024-09-16T07:32:37.457433+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:32:43.384 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-16T07:32:43.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.461634+0000', 'last_change': '2024-09-16T07:32:37.461634+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.461634+0000', 'last_undegraded': '2024-09-16T07:32:37.461634+0000', 'last_fullsized': '2024-09-16T07:32:37.461634+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:32:43.384 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-09-16T07:32:43.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:32:37.467120+0000', 'last_change': '2024-09-16T07:32:37.467120+0000', 'last_active': '2024-09-16T07:32:37.452465+0000', 'last_peered': '2024-09-16T07:32:37.452465+0000', 'last_clean': '2024-09-16T07:32:37.452465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:32:37.467120+0000', 'last_undegraded': '2024-09-16T07:32:37.467120+0000', 'last_fullsized': '2024-09-16T07:32:37.467120+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'last_clean_scrub_stamp': '2024-09-16T07:32:37.452465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:32:43.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:32:43.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 -- 172.21.15.114:0/320166525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2760 msgr2=0x7f5d0c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 --2- 172.21.15.114:0/320166525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2760 0x7f5d0c0d0260 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0cf810 tx=0x7f5cf401c650 comp rx=0 tx=0).stop 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 -- 172.21.15.114:0/320166525 shutdown_connections 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 --2- 172.21.15.114:0/320166525 >> v2:172.21.15.149:3300/0 conn(0x7f5d0c0b2d00 0x7f5d0c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 --2- 172.21.15.114:0/320166525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2760 0x7f5d0c0d0260 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 -- 172.21.15.114:0/320166525 >> 172.21.15.114:0/320166525 conn(0x7f5d0c0d1e40 msgr2=0x7f5d0c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 -- 172.21.15.114:0/320166525 shutdown_connections 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 -- 172.21.15.114:0/320166525 wait complete. 2024-09-16T07:32:43.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 Processor -- start 2024-09-16T07:32:43.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.559+0000 7f5d13600640 1 -- start start 2024-09-16T07:32:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d0c0b2760 0x7f5d0c151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2d00 0x7f5d0c1f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d0c0cfe80 0x7f5d0c1fb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c0b0940 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c0b07c0 con 0x7f5d0c0b2760 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0c0b0ac0 con 0x7f5d0c0cfe80 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2d00 0x7f5d0c1f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2d00 0x7f5d0c1f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36638/0 (socket says 172.21.15.114:36638) 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 -- 172.21.15.114:0/1551848863 learned_addr learned my addr 172.21.15.114:0/1551848863 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d10c00640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d0c0b2760 0x7f5d0c151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d11600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d0c0cfe80 0x7f5d0c1fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 -- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d0c0cfe80 msgr2=0x7f5d0c1fb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d0c0cfe80 0x7f5d0c1fb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 -- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d0c0b2760 msgr2=0x7f5d0c151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d0c0b2760 0x7f5d0c151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 -- 172.21.15.114:0/1551848863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0c1f8780 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d03e00640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2d00 0x7f5d0c1f8240 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5cf401ad00 tx=0x7f5cf40aa500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:43.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d09600640 1 -- 172.21.15.114:0/1551848863 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40aab10 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d09600640 1 -- 172.21.15.114:0/1551848863 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cf40b8070 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d09600640 1 -- 172.21.15.114:0/1551848863 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4005030 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0c15ab00 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0c1f7a40 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0c0d0260 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.563+0000 7f5d09600640 1 -- 172.21.15.114:0/1551848863 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f5cf40a8050 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.567+0000 7f5d09600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5ce8072fe0 0x7f5ce80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.567+0000 7f5d09600640 1 -- 172.21.15.114:0/1551848863 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf412e900 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.567+0000 7f5d10c00640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5ce8072fe0 0x7f5ce80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.567+0000 7f5d10c00640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5ce8072fe0 0x7f5ce80754a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0b5300 tx=0x7f5cfc009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:43.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.571+0000 7f5d09600640 1 -- 172.21.15.114:0/1551848863 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5cf40a6040 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5d0c070eb0 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d09600640 1 -- 172.21.15.114:0/1551848863 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3142 (secure 0 0 0) 0x7f5d0c0d0c80 con 0x7f5d0c0b2d00 2024-09-16T07:32:43.793 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:43.793 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":288,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":264425472,"bytes_avail":772829687808,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":57,"btime":"2024-09-16T07:32:41:510667+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":6600}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-16T07:32:26.370185+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T07:32:43.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5ce8072fe0 msgr2=0x7f5ce80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5ce8072fe0 0x7f5ce80754a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0b5300 tx=0x7f5cfc009060 comp rx=0 tx=0).stop 2024-09-16T07:32:43.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2d00 msgr2=0x7f5d0c1f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2d00 0x7f5d0c1f8240 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5cf401ad00 tx=0x7f5cf40aa500 comp rx=0 tx=0).stop 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 shutdown_connections 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5ce8072fe0 0x7f5ce80754a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5d0c0cfe80 0x7f5d0c1fb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5d0c0b2d00 0x7f5d0c1f8240 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 --2- 172.21.15.114:0/1551848863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d0c0b2760 0x7f5d0c151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 >> 172.21.15.114:0/1551848863 conn(0x7f5d0c0d1e40 msgr2=0x7f5d0c15c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 shutdown_connections 2024-09-16T07:32:43.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.795+0000 7f5d13600640 1 -- 172.21.15.114:0/1551848863 wait complete. 2024-09-16T07:32:43.813 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:32:43.814 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:32:43.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 -- 172.21.15.114:0/866002626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640cefb0 msgr2=0x7f9c640cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 --2- 172.21.15.114:0/866002626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640cefb0 0x7f9c640cc5b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009900 tx=0x7f9c4c01c850 comp rx=0 tx=0).stop 2024-09-16T07:32:43.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 -- 172.21.15.114:0/866002626 shutdown_connections 2024-09-16T07:32:43.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 --2- 172.21.15.114:0/866002626 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640cefb0 0x7f9c640cc5b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 --2- 172.21.15.114:0/866002626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c6415f000 0x7f9c640d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 -- 172.21.15.114:0/866002626 >> 172.21.15.114:0/866002626 conn(0x7f9c6409aa10 msgr2=0x7f9c6409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:43.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 -- 172.21.15.114:0/866002626 shutdown_connections 2024-09-16T07:32:43.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.955+0000 7f9c6a400640 1 -- 172.21.15.114:0/866002626 wait complete. 2024-09-16T07:32:43.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 Processor -- start 2024-09-16T07:32:43.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 -- start start 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640ccaf0 0x7f9c641fbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c640cefb0 0x7f9c640c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c6415f000 0x7f9c641500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64169290 con 0x7f9c640ccaf0 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64169110 con 0x7f9c6415f000 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9c64169410 con 0x7f9c640cefb0 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640ccaf0 0x7f9c641fbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640ccaf0 0x7f9c641fbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36662/0 (socket says 172.21.15.114:36662) 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 -- 172.21.15.114:0/3617267927 learned_addr learned my addr 172.21.15.114:0/3617267927 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c5be00640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c640cefb0 0x7f9c640c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c6415f000 0x7f9c641500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 -- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c640cefb0 msgr2=0x7f9c640c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c640cefb0 0x7f9c640c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 -- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c6415f000 msgr2=0x7f9c641500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c6415f000 0x7f9c641500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 -- 172.21.15.114:0/3617267927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c640b6500 con 0x7f9c640ccaf0 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69a00640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c6415f000 0x7f9c641500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c69000640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640ccaf0 0x7f9c641fbec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c9f0 tx=0x7f9c5400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c61600640 1 -- 172.21.15.114:0/3617267927 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54007bb0 con 0x7f9c640ccaf0 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c61600640 1 -- 172.21.15.114:0/3617267927 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c54007e40 con 0x7f9c640ccaf0 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c640b6220 con 0x7f9c640ccaf0 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c61600640 1 -- 172.21.15.114:0/3617267927 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400f690 con 0x7f9c640ccaf0 2024-09-16T07:32:43.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.959+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c641fb6c0 con 0x7f9c640ccaf0 2024-09-16T07:32:43.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.963+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c640cc5b0 con 0x7f9c640ccaf0 2024-09-16T07:32:43.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.963+0000 7f9c61600640 1 -- 172.21.15.114:0/3617267927 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f9c5400f830 con 0x7f9c640ccaf0 2024-09-16T07:32:43.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.963+0000 7f9c61600640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9c40072fe0 0x7f9c400754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:43.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.963+0000 7f9c61600640 1 -- 172.21.15.114:0/3617267927 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f9c540948b0 con 0x7f9c640ccaf0 2024-09-16T07:32:43.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.963+0000 7f9c5be00640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9c40072fe0 0x7f9c400754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:43.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.963+0000 7f9c5be00640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9c40072fe0 0x7f9c400754a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0ae000 tx=0x7f9c4c01b090 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:43.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:43.967+0000 7f9c61600640 1 -- 172.21.15.114:0/3617267927 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9c54014030 con 0x7f9c640ccaf0 2024-09-16T07:32:44.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.131+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c6406eac0 con 0x7f9c40072fe0 2024-09-16T07:32:44.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.135+0000 7f9c61600640 1 -- 172.21.15.114:0/3617267927 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246777 (secure 0 0 0) 0x7f9c6406eac0 con 0x7f9c40072fe0 2024-09-16T07:32:44.137 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:44.138 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:32:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9c40072fe0 msgr2=0x7f9c400754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9c40072fe0 0x7f9c400754a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0ae000 tx=0x7f9c4c01b090 comp rx=0 tx=0).stop 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640ccaf0 msgr2=0x7f9c641fbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640ccaf0 0x7f9c641fbec0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c9f0 tx=0x7f9c5400ceb0 comp rx=0 tx=0).stop 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 shutdown_connections 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c6415f000 0x7f9c641500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9c40072fe0 0x7f9c400754a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9c640cefb0 0x7f9c640c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 --2- 172.21.15.114:0/3617267927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c640ccaf0 0x7f9c641fbec0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 >> 172.21.15.114:0/3617267927 conn(0x7f9c6409aa10 msgr2=0x7f9c64075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 shutdown_connections 2024-09-16T07:32:44.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:44.139+0000 7f9c6a400640 1 -- 172.21.15.114:0/3617267927 wait complete. 2024-09-16T07:32:44.156 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T07:32:42.373496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258228,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716492,"statfs":{"total":773094113280,"available":772829687808,"internally_reserved":0,"allocated":8888320,"data_stored":4431744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.920424"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464253+0000","last_change":"2024-09-16T07:32:37.464253+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464253+0000","last_undegraded":"2024-09-16T07:32:37.464253+0000","last_fullsized":"2024-09-16T07:32:37.464253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466202+0000","last_change":"2024-09-16T07:32:37.466202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466202+0000","last_undegraded":"2024-09-16T07:32:37.466202+0000","last_fullsized":"2024-09-16T07:32:37.466202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467358+0000","last_change":"2024-09-16T07:32:37.467358+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467358+0000","last_undegraded":"2024-09-16T07:32:37.467358+0000","last_fullsized":"2024-09-16T07:32:37.467358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.469828+0000","last_change":"2024-09-16T07:32:37.469828+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.469828+0000","last_undegraded":"2024-09-16T07:32:37.469828+0000","last_fullsized":"2024-09-16T07:32:37.469828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460511+0000","last_change":"2024-09-16T07:32:37.460511+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460511+0000","last_undegraded":"2024-09-16T07:32:37.460511+0000","last_fullsized":"2024-09-16T07:32:37.460511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473936+0000","last_change":"2024-09-16T07:32:37.473936+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473936+0000","last_undegraded":"2024-09-16T07:32:37.473936+0000","last_fullsized":"2024-09-16T07:32:37.473936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457825+0000","last_change":"2024-09-16T07:32:37.457825+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457825+0000","last_undegraded":"2024-09-16T07:32:37.457825+0000","last_fullsized":"2024-09-16T07:32:37.457825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459132+0000","last_change":"2024-09-16T07:32:37.459132+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459132+0000","last_undegraded":"2024-09-16T07:32:37.459132+0000","last_fullsized":"2024-09-16T07:32:37.459132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468111+0000","last_change":"2024-09-16T07:32:37.468111+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468111+0000","last_undegraded":"2024-09-16T07:32:37.468111+0000","last_fullsized":"2024-09-16T07:32:37.468111+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.464336+0000","last_change":"2024-09-16T07:32:37.464336+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.464336+0000","last_undegraded":"2024-09-16T07:32:37.464336+0000","last_fullsized":"2024-09-16T07:32:37.464336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458639+0000","last_change":"2024-09-16T07:32:37.458639+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458639+0000","last_undegraded":"2024-09-16T07:32:37.458639+0000","last_fullsized":"2024-09-16T07:32:37.458639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471190+0000","last_change":"2024-09-16T07:32:37.471190+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471190+0000","last_undegraded":"2024-09-16T07:32:37.471190+0000","last_fullsized":"2024-09-16T07:32:37.471190+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.479918+0000","last_change":"2024-09-16T07:32:37.479918+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.479918+0000","last_undegraded":"2024-09-16T07:32:37.479918+0000","last_fullsized":"2024-09-16T07:32:37.479918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468554+0000","last_change":"2024-09-16T07:32:37.468554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468554+0000","last_undegraded":"2024-09-16T07:32:37.468554+0000","last_fullsized":"2024-09-16T07:32:37.468554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468492+0000","last_change":"2024-09-16T07:32:37.468492+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468492+0000","last_undegraded":"2024-09-16T07:32:37.468492+0000","last_fullsized":"2024-09-16T07:32:37.468492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471192+0000","last_change":"2024-09-16T07:32:37.471192+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471192+0000","last_undegraded":"2024-09-16T07:32:37.471192+0000","last_fullsized":"2024-09-16T07:32:37.471192+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468433+0000","last_change":"2024-09-16T07:32:37.468433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468433+0000","last_undegraded":"2024-09-16T07:32:37.468433+0000","last_fullsized":"2024-09-16T07:32:37.468433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466840+0000","last_change":"2024-09-16T07:32:37.466840+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466840+0000","last_undegraded":"2024-09-16T07:32:37.466840+0000","last_fullsized":"2024-09-16T07:32:37.466840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471699+0000","last_change":"2024-09-16T07:32:37.471699+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471699+0000","last_undegraded":"2024-09-16T07:32:37.471699+0000","last_fullsized":"2024-09-16T07:32:37.471699+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467723+0000","last_change":"2024-09-16T07:32:37.467723+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467723+0000","last_undegraded":"2024-09-16T07:32:37.467723+0000","last_fullsized":"2024-09-16T07:32:37.467723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463665+0000","last_change":"2024-09-16T07:32:37.463665+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463665+0000","last_undegraded":"2024-09-16T07:32:37.463665+0000","last_fullsized":"2024-09-16T07:32:37.463665+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468155+0000","last_change":"2024-09-16T07:32:37.468155+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468155+0000","last_undegraded":"2024-09-16T07:32:37.468155+0000","last_fullsized":"2024-09-16T07:32:37.468155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466325+0000","last_change":"2024-09-16T07:32:37.466325+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466325+0000","last_undegraded":"2024-09-16T07:32:37.466325+0000","last_fullsized":"2024-09-16T07:32:37.466325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458050+0000","last_change":"2024-09-16T07:32:37.458050+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458050+0000","last_undegraded":"2024-09-16T07:32:37.458050+0000","last_fullsized":"2024-09-16T07:32:37.458050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471208+0000","last_change":"2024-09-16T07:32:37.471208+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471208+0000","last_undegraded":"2024-09-16T07:32:37.471208+0000","last_fullsized":"2024-09-16T07:32:37.471208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463695+0000","last_change":"2024-09-16T07:32:37.463695+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463695+0000","last_undegraded":"2024-09-16T07:32:37.463695+0000","last_fullsized":"2024-09-16T07:32:37.463695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468168+0000","last_change":"2024-09-16T07:32:37.468168+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468168+0000","last_undegraded":"2024-09-16T07:32:37.468168+0000","last_fullsized":"2024-09-16T07:32:37.468168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466088+0000","last_change":"2024-09-16T07:32:37.466088+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466088+0000","last_undegraded":"2024-09-16T07:32:37.466088+0000","last_fullsized":"2024-09-16T07:32:37.466088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468544+0000","last_change":"2024-09-16T07:32:37.468544+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468544+0000","last_undegraded":"2024-09-16T07:32:37.468544+0000","last_fullsized":"2024-09-16T07:32:37.468544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463130+0000","last_change":"2024-09-16T07:32:37.463130+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463130+0000","last_undegraded":"2024-09-16T07:32:37.463130+0000","last_fullsized":"2024-09-16T07:32:37.463130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.471373+0000","last_change":"2024-09-16T07:32:37.471373+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.471373+0000","last_undegraded":"2024-09-16T07:32:37.471373+0000","last_fullsized":"2024-09-16T07:32:37.471373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480153+0000","last_change":"2024-09-16T07:32:37.477686+0000","last_active":"2024-09-16T07:32:37.480153+0000","last_peered":"2024-09-16T07:32:37.480153+0000","last_clean":"2024-09-16T07:32:37.480153+0000","last_became_active":"2024-09-16T07:32:37.477346+0000","last_became_peered":"2024-09-16T07:32:37.477346+0000","last_unstale":"2024-09-16T07:32:37.480153+0000","last_undegraded":"2024-09-16T07:32:37.480153+0000","last_fullsized":"2024-09-16T07:32:37.480153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:08:07.897942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463071+0000","last_change":"2024-09-16T07:32:37.463071+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463071+0000","last_undegraded":"2024-09-16T07:32:37.463071+0000","last_fullsized":"2024-09-16T07:32:37.463071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484789+0000","last_change":"2024-09-16T07:32:37.483296+0000","last_active":"2024-09-16T07:32:37.484789+0000","last_peered":"2024-09-16T07:32:37.484789+0000","last_clean":"2024-09-16T07:32:37.484789+0000","last_became_active":"2024-09-16T07:32:37.482999+0000","last_became_peered":"2024-09-16T07:32:37.482999+0000","last_unstale":"2024-09-16T07:32:37.484789+0000","last_undegraded":"2024-09-16T07:32:37.484789+0000","last_fullsized":"2024-09-16T07:32:37.484789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:05.401818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.463046+0000","last_change":"2024-09-16T07:32:37.463046+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.463046+0000","last_undegraded":"2024-09-16T07:32:37.463046+0000","last_fullsized":"2024-09-16T07:32:37.463046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490538+0000","last_change":"2024-09-16T07:32:37.488031+0000","last_active":"2024-09-16T07:32:37.490538+0000","last_peered":"2024-09-16T07:32:37.490538+0000","last_clean":"2024-09-16T07:32:37.490538+0000","last_became_active":"2024-09-16T07:32:37.487716+0000","last_became_peered":"2024-09-16T07:32:37.487716+0000","last_unstale":"2024-09-16T07:32:37.490538+0000","last_undegraded":"2024-09-16T07:32:37.490538+0000","last_fullsized":"2024-09-16T07:32:37.490538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:19.767528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.489418+0000","last_change":"2024-09-16T07:32:37.483866+0000","last_active":"2024-09-16T07:32:37.489418+0000","last_peered":"2024-09-16T07:32:37.489418+0000","last_clean":"2024-09-16T07:32:37.489418+0000","last_became_active":"2024-09-16T07:32:37.483605+0000","last_became_peered":"2024-09-16T07:32:37.483605+0000","last_unstale":"2024-09-16T07:32:37.489418+0000","last_undegraded":"2024-09-16T07:32:37.489418+0000","last_fullsized":"2024-09-16T07:32:37.489418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465238+0000","last_change":"2024-09-16T07:32:37.465238+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465238+0000","last_undegraded":"2024-09-16T07:32:37.465238+0000","last_fullsized":"2024-09-16T07:32:37.465238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484740+0000","last_change":"2024-09-16T07:32:37.481218+0000","last_active":"2024-09-16T07:32:37.484740+0000","last_peered":"2024-09-16T07:32:37.484740+0000","last_clean":"2024-09-16T07:32:37.484740+0000","last_became_active":"2024-09-16T07:32:37.480940+0000","last_became_peered":"2024-09-16T07:32:37.480940+0000","last_unstale":"2024-09-16T07:32:37.484740+0000","last_undegraded":"2024-09-16T07:32:37.484740+0000","last_fullsized":"2024-09-16T07:32:37.484740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:11.446314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468339+0000","last_change":"2024-09-16T07:32:37.468339+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468339+0000","last_undegraded":"2024-09-16T07:32:37.468339+0000","last_fullsized":"2024-09-16T07:32:37.468339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484810+0000","last_change":"2024-09-16T07:32:37.483432+0000","last_active":"2024-09-16T07:32:37.484810+0000","last_peered":"2024-09-16T07:32:37.484810+0000","last_clean":"2024-09-16T07:32:37.484810+0000","last_became_active":"2024-09-16T07:32:37.483094+0000","last_became_peered":"2024-09-16T07:32:37.483094+0000","last_unstale":"2024-09-16T07:32:37.484810+0000","last_undegraded":"2024-09-16T07:32:37.484810+0000","last_fullsized":"2024-09-16T07:32:37.484810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:45.386864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.460239+0000","last_change":"2024-09-16T07:32:37.460239+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.460239+0000","last_undegraded":"2024-09-16T07:32:37.460239+0000","last_fullsized":"2024-09-16T07:32:37.460239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483801+0000","last_change":"2024-09-16T07:32:37.475522+0000","last_active":"2024-09-16T07:32:37.483801+0000","last_peered":"2024-09-16T07:32:37.483801+0000","last_clean":"2024-09-16T07:32:37.483801+0000","last_became_active":"2024-09-16T07:32:37.475175+0000","last_became_peered":"2024-09-16T07:32:37.475175+0000","last_unstale":"2024-09-16T07:32:37.483801+0000","last_undegraded":"2024-09-16T07:32:37.483801+0000","last_fullsized":"2024-09-16T07:32:37.483801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:11.309285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.475658+0000","last_change":"2024-09-16T07:32:37.475658+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.475658+0000","last_undegraded":"2024-09-16T07:32:37.475658+0000","last_fullsized":"2024-09-16T07:32:37.475658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487250+0000","last_change":"2024-09-16T07:32:37.478353+0000","last_active":"2024-09-16T07:32:37.487250+0000","last_peered":"2024-09-16T07:32:37.487250+0000","last_clean":"2024-09-16T07:32:37.487250+0000","last_became_active":"2024-09-16T07:32:37.477976+0000","last_became_peered":"2024-09-16T07:32:37.477976+0000","last_unstale":"2024-09-16T07:32:37.487250+0000","last_undegraded":"2024-09-16T07:32:37.487250+0000","last_fullsized":"2024-09-16T07:32:37.487250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:44.008476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.473368+0000","last_change":"2024-09-16T07:32:37.473368+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.473368+0000","last_undegraded":"2024-09-16T07:32:37.473368+0000","last_fullsized":"2024-09-16T07:32:37.473368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481831+0000","last_change":"2024-09-16T07:32:37.479382+0000","last_active":"2024-09-16T07:32:37.481831+0000","last_peered":"2024-09-16T07:32:37.481831+0000","last_clean":"2024-09-16T07:32:37.481831+0000","last_became_active":"2024-09-16T07:32:37.479132+0000","last_became_peered":"2024-09-16T07:32:37.479132+0000","last_unstale":"2024-09-16T07:32:37.481831+0000","last_undegraded":"2024-09-16T07:32:37.481831+0000","last_fullsized":"2024-09-16T07:32:37.481831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:12.345158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458659+0000","last_change":"2024-09-16T07:32:37.458659+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458659+0000","last_undegraded":"2024-09-16T07:32:37.458659+0000","last_fullsized":"2024-09-16T07:32:37.458659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478155+0000","last_change":"2024-09-16T07:32:37.475562+0000","last_active":"2024-09-16T07:32:37.478155+0000","last_peered":"2024-09-16T07:32:37.478155+0000","last_clean":"2024-09-16T07:32:37.478155+0000","last_became_active":"2024-09-16T07:32:37.475257+0000","last_became_peered":"2024-09-16T07:32:37.475257+0000","last_unstale":"2024-09-16T07:32:37.478155+0000","last_undegraded":"2024-09-16T07:32:37.478155+0000","last_fullsized":"2024-09-16T07:32:37.478155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:18.559168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467545+0000","last_change":"2024-09-16T07:32:37.467545+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467545+0000","last_undegraded":"2024-09-16T07:32:37.467545+0000","last_fullsized":"2024-09-16T07:32:37.467545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478795+0000","last_change":"2024-09-16T07:32:37.472209+0000","last_active":"2024-09-16T07:32:37.478795+0000","last_peered":"2024-09-16T07:32:37.478795+0000","last_clean":"2024-09-16T07:32:37.478795+0000","last_became_active":"2024-09-16T07:32:37.471927+0000","last_became_peered":"2024-09-16T07:32:37.471927+0000","last_unstale":"2024-09-16T07:32:37.478795+0000","last_undegraded":"2024-09-16T07:32:37.478795+0000","last_fullsized":"2024-09-16T07:32:37.478795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:01:25.171346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470745+0000","last_change":"2024-09-16T07:32:37.470745+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470745+0000","last_undegraded":"2024-09-16T07:32:37.470745+0000","last_fullsized":"2024-09-16T07:32:37.470745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480135+0000","last_change":"2024-09-16T07:32:37.477898+0000","last_active":"2024-09-16T07:32:37.480135+0000","last_peered":"2024-09-16T07:32:37.480135+0000","last_clean":"2024-09-16T07:32:37.480135+0000","last_became_active":"2024-09-16T07:32:37.477470+0000","last_became_peered":"2024-09-16T07:32:37.477470+0000","last_unstale":"2024-09-16T07:32:37.480135+0000","last_undegraded":"2024-09-16T07:32:37.480135+0000","last_fullsized":"2024-09-16T07:32:37.480135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:39:19.634468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466218+0000","last_change":"2024-09-16T07:32:37.466218+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466218+0000","last_undegraded":"2024-09-16T07:32:37.466218+0000","last_fullsized":"2024-09-16T07:32:37.466218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.487066+0000","last_change":"2024-09-16T07:32:37.477253+0000","last_active":"2024-09-16T07:32:37.487066+0000","last_peered":"2024-09-16T07:32:37.487066+0000","last_clean":"2024-09-16T07:32:37.487066+0000","last_became_active":"2024-09-16T07:32:37.476963+0000","last_became_peered":"2024-09-16T07:32:37.476963+0000","last_unstale":"2024-09-16T07:32:37.487066+0000","last_undegraded":"2024-09-16T07:32:37.487066+0000","last_fullsized":"2024-09-16T07:32:37.487066+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:12.788025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458202+0000","last_change":"2024-09-16T07:32:37.458202+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458202+0000","last_undegraded":"2024-09-16T07:32:37.458202+0000","last_fullsized":"2024-09-16T07:32:37.458202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490503+0000","last_change":"2024-09-16T07:32:37.486936+0000","last_active":"2024-09-16T07:32:37.490503+0000","last_peered":"2024-09-16T07:32:37.490503+0000","last_clean":"2024-09-16T07:32:37.490503+0000","last_became_active":"2024-09-16T07:32:37.486624+0000","last_became_peered":"2024-09-16T07:32:37.486624+0000","last_unstale":"2024-09-16T07:32:37.490503+0000","last_undegraded":"2024-09-16T07:32:37.490503+0000","last_fullsized":"2024-09-16T07:32:37.490503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:03.813816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.466500+0000","last_change":"2024-09-16T07:32:37.466500+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.466500+0000","last_undegraded":"2024-09-16T07:32:37.466500+0000","last_fullsized":"2024-09-16T07:32:37.466500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478471+0000","last_change":"2024-09-16T07:32:37.474376+0000","last_active":"2024-09-16T07:32:37.478471+0000","last_peered":"2024-09-16T07:32:37.478471+0000","last_clean":"2024-09-16T07:32:37.478471+0000","last_became_active":"2024-09-16T07:32:37.474060+0000","last_became_peered":"2024-09-16T07:32:37.474060+0000","last_unstale":"2024-09-16T07:32:37.478471+0000","last_undegraded":"2024-09-16T07:32:37.478471+0000","last_fullsized":"2024-09-16T07:32:37.478471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:07:56.653178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465423+0000","last_change":"2024-09-16T07:32:37.465423+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465423+0000","last_undegraded":"2024-09-16T07:32:37.465423+0000","last_fullsized":"2024-09-16T07:32:37.465423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483015+0000","last_change":"2024-09-16T07:32:37.472142+0000","last_active":"2024-09-16T07:32:37.483015+0000","last_peered":"2024-09-16T07:32:37.483015+0000","last_clean":"2024-09-16T07:32:37.483015+0000","last_became_active":"2024-09-16T07:32:37.471899+0000","last_became_peered":"2024-09-16T07:32:37.471899+0000","last_unstale":"2024-09-16T07:32:37.483015+0000","last_undegraded":"2024-09-16T07:32:37.483015+0000","last_fullsized":"2024-09-16T07:32:37.483015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:29:58.140194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457585+0000","last_change":"2024-09-16T07:32:37.457585+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457585+0000","last_undegraded":"2024-09-16T07:32:37.457585+0000","last_fullsized":"2024-09-16T07:32:37.457585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474783+0000","last_change":"2024-09-16T07:32:37.467550+0000","last_active":"2024-09-16T07:32:37.474783+0000","last_peered":"2024-09-16T07:32:37.474783+0000","last_clean":"2024-09-16T07:32:37.474783+0000","last_became_active":"2024-09-16T07:32:37.467230+0000","last_became_peered":"2024-09-16T07:32:37.467230+0000","last_unstale":"2024-09-16T07:32:37.474783+0000","last_undegraded":"2024-09-16T07:32:37.474783+0000","last_fullsized":"2024-09-16T07:32:37.474783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:46.140465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461697+0000","last_change":"2024-09-16T07:32:37.461697+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461697+0000","last_undegraded":"2024-09-16T07:32:37.461697+0000","last_fullsized":"2024-09-16T07:32:37.461697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486613+0000","last_change":"2024-09-16T07:32:37.481488+0000","last_active":"2024-09-16T07:32:37.486613+0000","last_peered":"2024-09-16T07:32:37.486613+0000","last_clean":"2024-09-16T07:32:37.486613+0000","last_became_active":"2024-09-16T07:32:37.481151+0000","last_became_peered":"2024-09-16T07:32:37.481151+0000","last_unstale":"2024-09-16T07:32:37.486613+0000","last_undegraded":"2024-09-16T07:32:37.486613+0000","last_fullsized":"2024-09-16T07:32:37.486613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:58.916885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470222+0000","last_change":"2024-09-16T07:32:37.470222+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470222+0000","last_undegraded":"2024-09-16T07:32:37.470222+0000","last_fullsized":"2024-09-16T07:32:37.470222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481621+0000","last_change":"2024-09-16T07:32:37.475609+0000","last_active":"2024-09-16T07:32:37.481621+0000","last_peered":"2024-09-16T07:32:37.481621+0000","last_clean":"2024-09-16T07:32:37.481621+0000","last_became_active":"2024-09-16T07:32:37.475160+0000","last_became_peered":"2024-09-16T07:32:37.475160+0000","last_unstale":"2024-09-16T07:32:37.481621+0000","last_undegraded":"2024-09-16T07:32:37.481621+0000","last_fullsized":"2024-09-16T07:32:37.481621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:46.252223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467874+0000","last_change":"2024-09-16T07:32:37.467874+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467874+0000","last_undegraded":"2024-09-16T07:32:37.467874+0000","last_fullsized":"2024-09-16T07:32:37.467874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490416+0000","last_change":"2024-09-16T07:32:37.486787+0000","last_active":"2024-09-16T07:32:37.490416+0000","last_peered":"2024-09-16T07:32:37.490416+0000","last_clean":"2024-09-16T07:32:37.490416+0000","last_became_active":"2024-09-16T07:32:37.486507+0000","last_became_peered":"2024-09-16T07:32:37.486507+0000","last_unstale":"2024-09-16T07:32:37.490416+0000","last_undegraded":"2024-09-16T07:32:37.490416+0000","last_fullsized":"2024-09-16T07:32:37.490416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:58.259219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458902+0000","last_change":"2024-09-16T07:32:37.458902+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458902+0000","last_undegraded":"2024-09-16T07:32:37.458902+0000","last_fullsized":"2024-09-16T07:32:37.458902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.483265+0000","last_change":"2024-09-16T07:32:37.479541+0000","last_active":"2024-09-16T07:32:37.483265+0000","last_peered":"2024-09-16T07:32:37.483265+0000","last_clean":"2024-09-16T07:32:37.483265+0000","last_became_active":"2024-09-16T07:32:37.479221+0000","last_became_peered":"2024-09-16T07:32:37.479221+0000","last_unstale":"2024-09-16T07:32:37.483265+0000","last_undegraded":"2024-09-16T07:32:37.483265+0000","last_fullsized":"2024-09-16T07:32:37.483265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:46:12.248690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467000+0000","last_change":"2024-09-16T07:32:37.467000+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467000+0000","last_undegraded":"2024-09-16T07:32:37.467000+0000","last_fullsized":"2024-09-16T07:32:37.467000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490072+0000","last_change":"2024-09-16T07:32:37.486057+0000","last_active":"2024-09-16T07:32:37.490072+0000","last_peered":"2024-09-16T07:32:37.490072+0000","last_clean":"2024-09-16T07:32:37.490072+0000","last_became_active":"2024-09-16T07:32:37.485799+0000","last_became_peered":"2024-09-16T07:32:37.485799+0000","last_unstale":"2024-09-16T07:32:37.490072+0000","last_undegraded":"2024-09-16T07:32:37.490072+0000","last_fullsized":"2024-09-16T07:32:37.490072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:40:18.829713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.459963+0000","last_change":"2024-09-16T07:32:37.459963+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.459963+0000","last_undegraded":"2024-09-16T07:32:37.459963+0000","last_fullsized":"2024-09-16T07:32:37.459963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.490746+0000","last_change":"2024-09-16T07:32:37.488821+0000","last_active":"2024-09-16T07:32:37.490746+0000","last_peered":"2024-09-16T07:32:37.490746+0000","last_clean":"2024-09-16T07:32:37.490746+0000","last_became_active":"2024-09-16T07:32:37.488458+0000","last_became_peered":"2024-09-16T07:32:37.488458+0000","last_unstale":"2024-09-16T07:32:37.490746+0000","last_undegraded":"2024-09-16T07:32:37.490746+0000","last_fullsized":"2024-09-16T07:32:37.490746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:37:57.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.470954+0000","last_change":"2024-09-16T07:32:37.470954+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.470954+0000","last_undegraded":"2024-09-16T07:32:37.470954+0000","last_fullsized":"2024-09-16T07:32:37.470954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484629+0000","last_change":"2024-09-16T07:32:37.473768+0000","last_active":"2024-09-16T07:32:37.484629+0000","last_peered":"2024-09-16T07:32:37.484629+0000","last_clean":"2024-09-16T07:32:37.484629+0000","last_became_active":"2024-09-16T07:32:37.473395+0000","last_became_peered":"2024-09-16T07:32:37.473395+0000","last_unstale":"2024-09-16T07:32:37.484629+0000","last_undegraded":"2024-09-16T07:32:37.484629+0000","last_fullsized":"2024-09-16T07:32:37.484629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:31.988034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457957+0000","last_change":"2024-09-16T07:32:37.457957+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457957+0000","last_undegraded":"2024-09-16T07:32:37.457957+0000","last_fullsized":"2024-09-16T07:32:37.457957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.486022+0000","last_change":"2024-09-16T07:32:37.474441+0000","last_active":"2024-09-16T07:32:37.486022+0000","last_peered":"2024-09-16T07:32:37.486022+0000","last_clean":"2024-09-16T07:32:37.486022+0000","last_became_active":"2024-09-16T07:32:37.474052+0000","last_became_peered":"2024-09-16T07:32:37.474052+0000","last_unstale":"2024-09-16T07:32:37.486022+0000","last_undegraded":"2024-09-16T07:32:37.486022+0000","last_fullsized":"2024-09-16T07:32:37.486022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:20.535490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461774+0000","last_change":"2024-09-16T07:32:37.461774+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461774+0000","last_undegraded":"2024-09-16T07:32:37.461774+0000","last_fullsized":"2024-09-16T07:32:37.461774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484379+0000","last_change":"2024-09-16T07:32:37.480703+0000","last_active":"2024-09-16T07:32:37.484379+0000","last_peered":"2024-09-16T07:32:37.484379+0000","last_clean":"2024-09-16T07:32:37.484379+0000","last_became_active":"2024-09-16T07:32:37.480323+0000","last_became_peered":"2024-09-16T07:32:37.480323+0000","last_unstale":"2024-09-16T07:32:37.484379+0000","last_undegraded":"2024-09-16T07:32:37.484379+0000","last_fullsized":"2024-09-16T07:32:37.484379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:55.093776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.468838+0000","last_change":"2024-09-16T07:32:37.468838+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.468838+0000","last_undegraded":"2024-09-16T07:32:37.468838+0000","last_fullsized":"2024-09-16T07:32:37.468838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.480086+0000","last_change":"2024-09-16T07:32:37.476463+0000","last_active":"2024-09-16T07:32:37.480086+0000","last_peered":"2024-09-16T07:32:37.480086+0000","last_clean":"2024-09-16T07:32:37.480086+0000","last_became_active":"2024-09-16T07:32:37.476117+0000","last_became_peered":"2024-09-16T07:32:37.476117+0000","last_unstale":"2024-09-16T07:32:37.480086+0000","last_undegraded":"2024-09-16T07:32:37.480086+0000","last_fullsized":"2024-09-16T07:32:37.480086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:42.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.458345+0000","last_change":"2024-09-16T07:32:37.458345+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.458345+0000","last_undegraded":"2024-09-16T07:32:37.458345+0000","last_fullsized":"2024-09-16T07:32:37.458345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481572+0000","last_change":"2024-09-16T07:32:37.475919+0000","last_active":"2024-09-16T07:32:37.481572+0000","last_peered":"2024-09-16T07:32:37.481572+0000","last_clean":"2024-09-16T07:32:37.481572+0000","last_became_active":"2024-09-16T07:32:37.475565+0000","last_became_peered":"2024-09-16T07:32:37.475565+0000","last_unstale":"2024-09-16T07:32:37.481572+0000","last_undegraded":"2024-09-16T07:32:37.481572+0000","last_fullsized":"2024-09-16T07:32:37.481572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:07.383597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.465554+0000","last_change":"2024-09-16T07:32:37.465554+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.465554+0000","last_undegraded":"2024-09-16T07:32:37.465554+0000","last_fullsized":"2024-09-16T07:32:37.465554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.484792+0000","last_change":"2024-09-16T07:32:37.483345+0000","last_active":"2024-09-16T07:32:37.484792+0000","last_peered":"2024-09-16T07:32:37.484792+0000","last_clean":"2024-09-16T07:32:37.484792+0000","last_became_active":"2024-09-16T07:32:37.482995+0000","last_became_peered":"2024-09-16T07:32:37.482995+0000","last_unstale":"2024-09-16T07:32:37.484792+0000","last_undegraded":"2024-09-16T07:32:37.484792+0000","last_fullsized":"2024-09-16T07:32:37.484792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:26.808309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.457433+0000","last_change":"2024-09-16T07:32:37.457433+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.457433+0000","last_undegraded":"2024-09-16T07:32:37.457433+0000","last_fullsized":"2024-09-16T07:32:37.457433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.481836+0000","last_change":"2024-09-16T07:32:37.479500+0000","last_active":"2024-09-16T07:32:37.481836+0000","last_peered":"2024-09-16T07:32:37.481836+0000","last_clean":"2024-09-16T07:32:37.481836+0000","last_became_active":"2024-09-16T07:32:37.479184+0000","last_became_peered":"2024-09-16T07:32:37.479184+0000","last_unstale":"2024-09-16T07:32:37.481836+0000","last_undegraded":"2024-09-16T07:32:37.481836+0000","last_fullsized":"2024-09-16T07:32:37.481836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:10.685063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.461634+0000","last_change":"2024-09-16T07:32:37.461634+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.461634+0000","last_undegraded":"2024-09-16T07:32:37.461634+0000","last_fullsized":"2024-09-16T07:32:37.461634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.478407+0000","last_change":"2024-09-16T07:32:37.475751+0000","last_active":"2024-09-16T07:32:37.478407+0000","last_peered":"2024-09-16T07:32:37.478407+0000","last_clean":"2024-09-16T07:32:37.478407+0000","last_became_active":"2024-09-16T07:32:37.475454+0000","last_became_peered":"2024-09-16T07:32:37.475454+0000","last_unstale":"2024-09-16T07:32:37.478407+0000","last_undegraded":"2024-09-16T07:32:37.478407+0000","last_fullsized":"2024-09-16T07:32:37.478407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:15:05.321945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-16T07:32:37.467120+0000","last_change":"2024-09-16T07:32:37.467120+0000","last_active":"2024-09-16T07:32:37.452465+0000","last_peered":"2024-09-16T07:32:37.452465+0000","last_clean":"2024-09-16T07:32:37.452465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:32:37.467120+0000","last_undegraded":"2024-09-16T07:32:37.467120+0000","last_fullsized":"2024-09-16T07:32:37.467120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.474512+0000","last_change":"2024-09-16T07:32:37.470906+0000","last_active":"2024-09-16T07:32:37.474512+0000","last_peered":"2024-09-16T07:32:37.474512+0000","last_clean":"2024-09-16T07:32:37.474512+0000","last_became_active":"2024-09-16T07:32:37.470554+0000","last_became_peered":"2024-09-16T07:32:37.470554+0000","last_unstale":"2024-09-16T07:32:37.474512+0000","last_undegraded":"2024-09-16T07:32:37.474512+0000","last_fullsized":"2024-09-16T07:32:37.474512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:09:20.566431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":243,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-16T07:32:37.460954+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:32:37.460954+0000","last_peered":"2024-09-16T07:32:37.460954+0000","last_clean":"2024-09-16T07:32:37.460954+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:32:37.460954+0000","last_undegraded":"2024-09-16T07:32:37.460954+0000","last_fullsized":"2024-09-16T07:32:37.460954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":406376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1556480,"data_stored":996744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:32:47.161 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:32:47.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.315+0000 7f9582600640 1 -- 172.21.15.114:0/767797322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c0cdb30 msgr2=0x7f957c0af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.315+0000 7f9582600640 1 --2- 172.21.15.114:0/767797322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c0cdb30 0x7f957c0af0c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9574009bc0 tx=0x7f957401cba0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.315+0000 7f9582600640 1 -- 172.21.15.114:0/767797322 shutdown_connections 2024-09-16T07:32:47.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.315+0000 7f9582600640 1 --2- 172.21.15.114:0/767797322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c0cdb30 0x7f957c0af0c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.315+0000 7f9582600640 1 -- 172.21.15.114:0/767797322 >> 172.21.15.114:0/767797322 conn(0x7f957c0d1dc0 msgr2=0x7f957c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:47.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.315+0000 7f9582600640 1 -- 172.21.15.114:0/767797322 shutdown_connections 2024-09-16T07:32:47.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.315+0000 7f9582600640 1 -- 172.21.15.114:0/767797322 wait complete. 2024-09-16T07:32:47.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 Processor -- start 2024-09-16T07:32:47.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 -- start start 2024-09-16T07:32:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f957c0cdb30 0x7f957c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f957c0ced80 0x7f957c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c15bea0 0x7f957c1f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f957c16a8a0 con 0x7f957c15bea0 2024-09-16T07:32:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f957c16a720 con 0x7f957c0ced80 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f957c16aa20 con 0x7f957c0cdb30 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c15bea0 0x7f957c1f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c15bea0 0x7f957c1f8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40638/0 (socket says 172.21.15.114:40638) 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 -- 172.21.15.114:0/674826240 learned_addr learned my addr 172.21.15.114:0/674826240 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957b400640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f957c0cdb30 0x7f957c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957aa00640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f957c0ced80 0x7f957c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 -- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f957c0cdb30 msgr2=0x7f957c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f957c0cdb30 0x7f957c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 -- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f957c0ced80 msgr2=0x7f957c0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f957c0ced80 0x7f957c0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 -- 172.21.15.114:0/674826240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c0ca010 con 0x7f957c15bea0 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f957be00640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c15bea0 0x7f957c1f8000 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f957401a7d0 tx=0x7f95740a5b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:47.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9573400640 1 -- 172.21.15.114:0/674826240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740bb070 con 0x7f957c15bea0 2024-09-16T07:32:47.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9573400640 1 -- 172.21.15.114:0/674826240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9574004e00 con 0x7f957c15bea0 2024-09-16T07:32:47.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9573400640 1 -- 172.21.15.114:0/674826240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740b2040 con 0x7f957c15bea0 2024-09-16T07:32:47.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957c0ca2f0 con 0x7f957c15bea0 2024-09-16T07:32:47.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957c0ca8b0 con 0x7f957c15bea0 2024-09-16T07:32:47.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.319+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957c0ce670 con 0x7f957c15bea0 2024-09-16T07:32:47.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.323+0000 7f9573400640 1 -- 172.21.15.114:0/674826240 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f95740be070 con 0x7f957c15bea0 2024-09-16T07:32:47.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.323+0000 7f9573400640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f955c072fe0 0x7f955c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.323+0000 7f9573400640 1 -- 172.21.15.114:0/674826240 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f957412df10 con 0x7f957c15bea0 2024-09-16T07:32:47.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.323+0000 7f957b400640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f955c072fe0 0x7f955c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.323+0000 7f957b400640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f955c072fe0 0x7f955c0754a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b810 tx=0x7f956c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:47.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.327+0000 7f9573400640 1 -- 172.21.15.114:0/674826240 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f95740a5e20 con 0x7f957c15bea0 2024-09-16T07:32:47.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.499+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f957c0cc040 con 0x7f955c072fe0 2024-09-16T07:32:47.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.503+0000 7f9573400640 1 -- 172.21.15.114:0/674826240 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f957c0cc040 con 0x7f955c072fe0 2024-09-16T07:32:47.505 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:47.507 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f955c072fe0 msgr2=0x7f955c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f955c072fe0 0x7f955c0754a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f956c00b810 tx=0x7f956c008040 comp rx=0 tx=0).stop 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c15bea0 msgr2=0x7f957c1f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c15bea0 0x7f957c1f8000 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f957401a7d0 tx=0x7f95740a5b00 comp rx=0 tx=0).stop 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 shutdown_connections 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f957c15bea0 0x7f957c1f8000 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f957c0ced80 0x7f957c0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f955c072fe0 0x7f955c0754a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 --2- 172.21.15.114:0/674826240 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f957c0cdb30 0x7f957c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 >> 172.21.15.114:0/674826240 conn(0x7f957c0d1dc0 msgr2=0x7f957c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:47.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 shutdown_connections 2024-09-16T07:32:47.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.507+0000 7f9582600640 1 -- 172.21.15.114:0/674826240 wait complete. 2024-09-16T07:32:47.524 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-16T07:32:46.374378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258448,"kb_used_data":8936,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716272,"statfs":{"total":773094113280,"available":772829462528,"internally_reserved":0,"allocated":9150464,"data_stored":4541164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001699"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587956+0000","last_change":"2024-09-16T07:32:38.496617+0000","last_active":"2024-09-16T07:32:40.587956+0000","last_peered":"2024-09-16T07:32:40.587956+0000","last_clean":"2024-09-16T07:32:40.587956+0000","last_became_active":"2024-09-16T07:32:38.495769+0000","last_became_peered":"2024-09-16T07:32:38.495769+0000","last_unstale":"2024-09-16T07:32:40.587956+0000","last_undegraded":"2024-09-16T07:32:40.587956+0000","last_fullsized":"2024-09-16T07:32:40.587956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:54:48.176826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575824+0000","last_change":"2024-09-16T07:32:38.499141+0000","last_active":"2024-09-16T07:32:39.575824+0000","last_peered":"2024-09-16T07:32:39.575824+0000","last_clean":"2024-09-16T07:32:39.575824+0000","last_became_active":"2024-09-16T07:32:38.498894+0000","last_became_peered":"2024-09-16T07:32:38.498894+0000","last_unstale":"2024-09-16T07:32:39.575824+0000","last_undegraded":"2024-09-16T07:32:39.575824+0000","last_fullsized":"2024-09-16T07:32:39.575824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:24.302477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587939+0000","last_change":"2024-09-16T07:32:38.506433+0000","last_active":"2024-09-16T07:32:40.587939+0000","last_peered":"2024-09-16T07:32:40.587939+0000","last_clean":"2024-09-16T07:32:40.587939+0000","last_became_active":"2024-09-16T07:32:38.506162+0000","last_became_peered":"2024-09-16T07:32:38.506162+0000","last_unstale":"2024-09-16T07:32:40.587939+0000","last_undegraded":"2024-09-16T07:32:40.587939+0000","last_fullsized":"2024-09-16T07:32:40.587939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:43.390120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589800+0000","last_change":"2024-09-16T07:32:38.486765+0000","last_active":"2024-09-16T07:32:40.589800+0000","last_peered":"2024-09-16T07:32:40.589800+0000","last_clean":"2024-09-16T07:32:40.589800+0000","last_became_active":"2024-09-16T07:32:38.486334+0000","last_became_peered":"2024-09-16T07:32:38.486334+0000","last_unstale":"2024-09-16T07:32:40.589800+0000","last_undegraded":"2024-09-16T07:32:40.589800+0000","last_fullsized":"2024-09-16T07:32:40.589800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:26.062898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487762+0000","last_change":"2024-09-16T07:32:38.491069+0000","last_active":"2024-09-16T07:32:39.487762+0000","last_peered":"2024-09-16T07:32:39.487762+0000","last_clean":"2024-09-16T07:32:39.487762+0000","last_became_active":"2024-09-16T07:32:38.490813+0000","last_became_peered":"2024-09-16T07:32:38.490813+0000","last_unstale":"2024-09-16T07:32:39.487762+0000","last_undegraded":"2024-09-16T07:32:39.487762+0000","last_fullsized":"2024-09-16T07:32:39.487762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:47.436804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487178+0000","last_change":"2024-09-16T07:32:38.500818+0000","last_active":"2024-09-16T07:32:39.487178+0000","last_peered":"2024-09-16T07:32:39.487178+0000","last_clean":"2024-09-16T07:32:39.487178+0000","last_became_active":"2024-09-16T07:32:38.500542+0000","last_became_peered":"2024-09-16T07:32:38.500542+0000","last_unstale":"2024-09-16T07:32:39.487178+0000","last_undegraded":"2024-09-16T07:32:39.487178+0000","last_fullsized":"2024-09-16T07:32:39.487178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:13.085573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589410+0000","last_change":"2024-09-16T07:32:38.499619+0000","last_active":"2024-09-16T07:32:40.589410+0000","last_peered":"2024-09-16T07:32:40.589410+0000","last_clean":"2024-09-16T07:32:40.589410+0000","last_became_active":"2024-09-16T07:32:38.499285+0000","last_became_peered":"2024-09-16T07:32:38.499285+0000","last_unstale":"2024-09-16T07:32:40.589410+0000","last_undegraded":"2024-09-16T07:32:40.589410+0000","last_fullsized":"2024-09-16T07:32:40.589410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:11:16.955639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488167+0000","last_change":"2024-09-16T07:32:38.490061+0000","last_active":"2024-09-16T07:32:39.488167+0000","last_peered":"2024-09-16T07:32:39.488167+0000","last_clean":"2024-09-16T07:32:39.488167+0000","last_became_active":"2024-09-16T07:32:38.489499+0000","last_became_peered":"2024-09-16T07:32:38.489499+0000","last_unstale":"2024-09-16T07:32:39.488167+0000","last_undegraded":"2024-09-16T07:32:39.488167+0000","last_fullsized":"2024-09-16T07:32:39.488167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:44.765462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487801+0000","last_change":"2024-09-16T07:32:38.500833+0000","last_active":"2024-09-16T07:32:39.487801+0000","last_peered":"2024-09-16T07:32:39.487801+0000","last_clean":"2024-09-16T07:32:39.487801+0000","last_became_active":"2024-09-16T07:32:38.500053+0000","last_became_peered":"2024-09-16T07:32:38.500053+0000","last_unstale":"2024-09-16T07:32:39.487801+0000","last_undegraded":"2024-09-16T07:32:39.487801+0000","last_fullsized":"2024-09-16T07:32:39.487801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:47.436804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588144+0000","last_change":"2024-09-16T07:32:38.496356+0000","last_active":"2024-09-16T07:32:40.588144+0000","last_peered":"2024-09-16T07:32:40.588144+0000","last_clean":"2024-09-16T07:32:40.588144+0000","last_became_active":"2024-09-16T07:32:38.496069+0000","last_became_peered":"2024-09-16T07:32:38.496069+0000","last_unstale":"2024-09-16T07:32:40.588144+0000","last_undegraded":"2024-09-16T07:32:40.588144+0000","last_fullsized":"2024-09-16T07:32:40.588144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:54.000217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575948+0000","last_change":"2024-09-16T07:32:38.500320+0000","last_active":"2024-09-16T07:32:39.575948+0000","last_peered":"2024-09-16T07:32:39.575948+0000","last_clean":"2024-09-16T07:32:39.575948+0000","last_became_active":"2024-09-16T07:32:38.499981+0000","last_became_peered":"2024-09-16T07:32:38.499981+0000","last_unstale":"2024-09-16T07:32:39.575948+0000","last_undegraded":"2024-09-16T07:32:39.575948+0000","last_fullsized":"2024-09-16T07:32:39.575948+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:12.442607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587291+0000","last_change":"2024-09-16T07:32:38.488344+0000","last_active":"2024-09-16T07:32:40.587291+0000","last_peered":"2024-09-16T07:32:40.587291+0000","last_clean":"2024-09-16T07:32:40.587291+0000","last_became_active":"2024-09-16T07:32:38.487899+0000","last_became_peered":"2024-09-16T07:32:38.487899+0000","last_unstale":"2024-09-16T07:32:40.587291+0000","last_undegraded":"2024-09-16T07:32:40.587291+0000","last_fullsized":"2024-09-16T07:32:40.587291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:59.073572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587560+0000","last_change":"2024-09-16T07:32:38.502610+0000","last_active":"2024-09-16T07:32:40.587560+0000","last_peered":"2024-09-16T07:32:40.587560+0000","last_clean":"2024-09-16T07:32:40.587560+0000","last_became_active":"2024-09-16T07:32:38.502350+0000","last_became_peered":"2024-09-16T07:32:38.502350+0000","last_unstale":"2024-09-16T07:32:40.587560+0000","last_undegraded":"2024-09-16T07:32:40.587560+0000","last_fullsized":"2024-09-16T07:32:40.587560+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:24.939827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589691+0000","last_change":"2024-09-16T07:32:38.486644+0000","last_active":"2024-09-16T07:32:40.589691+0000","last_peered":"2024-09-16T07:32:40.589691+0000","last_clean":"2024-09-16T07:32:40.589691+0000","last_became_active":"2024-09-16T07:32:38.486341+0000","last_became_peered":"2024-09-16T07:32:38.486341+0000","last_unstale":"2024-09-16T07:32:40.589691+0000","last_undegraded":"2024-09-16T07:32:40.589691+0000","last_fullsized":"2024-09-16T07:32:40.589691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:50.934698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.490423+0000","last_change":"2024-09-16T07:32:38.498916+0000","last_active":"2024-09-16T07:32:39.490423+0000","last_peered":"2024-09-16T07:32:39.490423+0000","last_clean":"2024-09-16T07:32:39.490423+0000","last_became_active":"2024-09-16T07:32:38.498390+0000","last_became_peered":"2024-09-16T07:32:38.498390+0000","last_unstale":"2024-09-16T07:32:39.490423+0000","last_undegraded":"2024-09-16T07:32:39.490423+0000","last_fullsized":"2024-09-16T07:32:39.490423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:42:51.866778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487153+0000","last_change":"2024-09-16T07:32:38.493900+0000","last_active":"2024-09-16T07:32:39.487153+0000","last_peered":"2024-09-16T07:32:39.487153+0000","last_clean":"2024-09-16T07:32:39.487153+0000","last_became_active":"2024-09-16T07:32:38.493604+0000","last_became_peered":"2024-09-16T07:32:38.493604+0000","last_unstale":"2024-09-16T07:32:39.487153+0000","last_undegraded":"2024-09-16T07:32:39.487153+0000","last_fullsized":"2024-09-16T07:32:39.487153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:29.034043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487358+0000","last_change":"2024-09-16T07:32:38.499304+0000","last_active":"2024-09-16T07:32:39.487358+0000","last_peered":"2024-09-16T07:32:39.487358+0000","last_clean":"2024-09-16T07:32:39.487358+0000","last_became_active":"2024-09-16T07:32:38.499040+0000","last_became_peered":"2024-09-16T07:32:38.499040+0000","last_unstale":"2024-09-16T07:32:39.487358+0000","last_undegraded":"2024-09-16T07:32:39.487358+0000","last_fullsized":"2024-09-16T07:32:39.487358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:13.085573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589802+0000","last_change":"2024-09-16T07:32:38.495009+0000","last_active":"2024-09-16T07:32:40.589802+0000","last_peered":"2024-09-16T07:32:40.589802+0000","last_clean":"2024-09-16T07:32:40.589802+0000","last_became_active":"2024-09-16T07:32:38.494036+0000","last_became_peered":"2024-09-16T07:32:38.494036+0000","last_unstale":"2024-09-16T07:32:40.589802+0000","last_undegraded":"2024-09-16T07:32:40.589802+0000","last_fullsized":"2024-09-16T07:32:40.589802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:10.197825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496988+0000","last_change":"2024-09-16T07:32:38.497160+0000","last_active":"2024-09-16T07:32:40.496988+0000","last_peered":"2024-09-16T07:32:40.496988+0000","last_clean":"2024-09-16T07:32:40.496988+0000","last_became_active":"2024-09-16T07:32:38.496782+0000","last_became_peered":"2024-09-16T07:32:38.496782+0000","last_unstale":"2024-09-16T07:32:40.496988+0000","last_undegraded":"2024-09-16T07:32:40.496988+0000","last_fullsized":"2024-09-16T07:32:40.496988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:48.145855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589997+0000","last_change":"2024-09-16T07:32:38.499963+0000","last_active":"2024-09-16T07:32:40.589997+0000","last_peered":"2024-09-16T07:32:40.589997+0000","last_clean":"2024-09-16T07:32:40.589997+0000","last_became_active":"2024-09-16T07:32:38.499674+0000","last_became_peered":"2024-09-16T07:32:38.499674+0000","last_unstale":"2024-09-16T07:32:40.589997+0000","last_undegraded":"2024-09-16T07:32:40.589997+0000","last_fullsized":"2024-09-16T07:32:40.589997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:02.388117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589767+0000","last_change":"2024-09-16T07:32:38.499038+0000","last_active":"2024-09-16T07:32:40.589767+0000","last_peered":"2024-09-16T07:32:40.589767+0000","last_clean":"2024-09-16T07:32:40.589767+0000","last_became_active":"2024-09-16T07:32:38.498805+0000","last_became_peered":"2024-09-16T07:32:38.498805+0000","last_unstale":"2024-09-16T07:32:40.589767+0000","last_undegraded":"2024-09-16T07:32:40.589767+0000","last_fullsized":"2024-09-16T07:32:40.589767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:35.911983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575375+0000","last_change":"2024-09-16T07:32:38.498711+0000","last_active":"2024-09-16T07:32:39.575375+0000","last_peered":"2024-09-16T07:32:39.575375+0000","last_clean":"2024-09-16T07:32:39.575375+0000","last_became_active":"2024-09-16T07:32:38.498107+0000","last_became_peered":"2024-09-16T07:32:38.498107+0000","last_unstale":"2024-09-16T07:32:39.575375+0000","last_undegraded":"2024-09-16T07:32:39.575375+0000","last_fullsized":"2024-09-16T07:32:39.575375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:08:08.906420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587199+0000","last_change":"2024-09-16T07:32:38.497086+0000","last_active":"2024-09-16T07:32:40.587199+0000","last_peered":"2024-09-16T07:32:40.587199+0000","last_clean":"2024-09-16T07:32:40.587199+0000","last_became_active":"2024-09-16T07:32:38.496768+0000","last_became_peered":"2024-09-16T07:32:38.496768+0000","last_unstale":"2024-09-16T07:32:40.587199+0000","last_undegraded":"2024-09-16T07:32:40.587199+0000","last_fullsized":"2024-09-16T07:32:40.587199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:25.032079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589485+0000","last_change":"2024-09-16T07:32:38.497372+0000","last_active":"2024-09-16T07:32:40.589485+0000","last_peered":"2024-09-16T07:32:40.589485+0000","last_clean":"2024-09-16T07:32:40.589485+0000","last_became_active":"2024-09-16T07:32:38.497058+0000","last_became_peered":"2024-09-16T07:32:38.497058+0000","last_unstale":"2024-09-16T07:32:40.589485+0000","last_undegraded":"2024-09-16T07:32:40.589485+0000","last_fullsized":"2024-09-16T07:32:40.589485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:16.892178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575820+0000","last_change":"2024-09-16T07:32:38.504948+0000","last_active":"2024-09-16T07:32:39.575820+0000","last_peered":"2024-09-16T07:32:39.575820+0000","last_clean":"2024-09-16T07:32:39.575820+0000","last_became_active":"2024-09-16T07:32:38.504675+0000","last_became_peered":"2024-09-16T07:32:38.504675+0000","last_unstale":"2024-09-16T07:32:39.575820+0000","last_undegraded":"2024-09-16T07:32:39.575820+0000","last_fullsized":"2024-09-16T07:32:39.575820+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:21.402350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588239+0000","last_change":"2024-09-16T07:32:38.507995+0000","last_active":"2024-09-16T07:32:40.588239+0000","last_peered":"2024-09-16T07:32:40.588239+0000","last_clean":"2024-09-16T07:32:40.588239+0000","last_became_active":"2024-09-16T07:32:38.507646+0000","last_became_peered":"2024-09-16T07:32:38.507646+0000","last_unstale":"2024-09-16T07:32:40.588239+0000","last_undegraded":"2024-09-16T07:32:40.588239+0000","last_fullsized":"2024-09-16T07:32:40.588239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:55.137317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488145+0000","last_change":"2024-09-16T07:32:38.496497+0000","last_active":"2024-09-16T07:32:39.488145+0000","last_peered":"2024-09-16T07:32:39.488145+0000","last_clean":"2024-09-16T07:32:39.488145+0000","last_became_active":"2024-09-16T07:32:38.495697+0000","last_became_peered":"2024-09-16T07:32:38.495697+0000","last_unstale":"2024-09-16T07:32:39.488145+0000","last_undegraded":"2024-09-16T07:32:39.488145+0000","last_fullsized":"2024-09-16T07:32:39.488145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:44.765462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587829+0000","last_change":"2024-09-16T07:32:38.494960+0000","last_active":"2024-09-16T07:32:40.587829+0000","last_peered":"2024-09-16T07:32:40.587829+0000","last_clean":"2024-09-16T07:32:40.587829+0000","last_became_active":"2024-09-16T07:32:38.494687+0000","last_became_peered":"2024-09-16T07:32:38.494687+0000","last_unstale":"2024-09-16T07:32:40.587829+0000","last_undegraded":"2024-09-16T07:32:40.587829+0000","last_fullsized":"2024-09-16T07:32:40.587829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:35.605497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575478+0000","last_change":"2024-09-16T07:32:38.492705+0000","last_active":"2024-09-16T07:32:39.575478+0000","last_peered":"2024-09-16T07:32:39.575478+0000","last_clean":"2024-09-16T07:32:39.575478+0000","last_became_active":"2024-09-16T07:32:38.492415+0000","last_became_peered":"2024-09-16T07:32:38.492415+0000","last_unstale":"2024-09-16T07:32:39.575478+0000","last_undegraded":"2024-09-16T07:32:39.575478+0000","last_fullsized":"2024-09-16T07:32:39.575478+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:13.353636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575613+0000","last_change":"2024-09-16T07:32:38.503069+0000","last_active":"2024-09-16T07:32:39.575613+0000","last_peered":"2024-09-16T07:32:39.575613+0000","last_clean":"2024-09-16T07:32:39.575613+0000","last_became_active":"2024-09-16T07:32:38.500143+0000","last_became_peered":"2024-09-16T07:32:38.500143+0000","last_unstale":"2024-09-16T07:32:39.575613+0000","last_undegraded":"2024-09-16T07:32:39.575613+0000","last_fullsized":"2024-09-16T07:32:39.575613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:11.693541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487277+0000","last_change":"2024-09-16T07:32:38.506156+0000","last_active":"2024-09-16T07:32:39.487277+0000","last_peered":"2024-09-16T07:32:39.487277+0000","last_clean":"2024-09-16T07:32:39.487277+0000","last_became_active":"2024-09-16T07:32:38.505563+0000","last_became_peered":"2024-09-16T07:32:38.505563+0000","last_unstale":"2024-09-16T07:32:39.487277+0000","last_undegraded":"2024-09-16T07:32:39.487277+0000","last_fullsized":"2024-09-16T07:32:39.487277+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:54:52.498865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587245+0000","last_change":"2024-09-16T07:32:38.486609+0000","last_active":"2024-09-16T07:32:40.587245+0000","last_peered":"2024-09-16T07:32:40.587245+0000","last_clean":"2024-09-16T07:32:40.587245+0000","last_became_active":"2024-09-16T07:32:38.486347+0000","last_became_peered":"2024-09-16T07:32:38.486347+0000","last_unstale":"2024-09-16T07:32:40.587245+0000","last_undegraded":"2024-09-16T07:32:40.587245+0000","last_fullsized":"2024-09-16T07:32:40.587245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:08:59.444635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487474+0000","last_change":"2024-09-16T07:32:38.489908+0000","last_active":"2024-09-16T07:32:39.487474+0000","last_peered":"2024-09-16T07:32:39.487474+0000","last_clean":"2024-09-16T07:32:39.487474+0000","last_became_active":"2024-09-16T07:32:38.489627+0000","last_became_peered":"2024-09-16T07:32:38.489627+0000","last_unstale":"2024-09-16T07:32:39.487474+0000","last_undegraded":"2024-09-16T07:32:39.487474+0000","last_fullsized":"2024-09-16T07:32:39.487474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:48.931923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"80'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588524+0000","last_change":"2024-09-16T07:32:37.477686+0000","last_active":"2024-09-16T07:32:40.588524+0000","last_peered":"2024-09-16T07:32:40.588524+0000","last_clean":"2024-09-16T07:32:40.588524+0000","last_became_active":"2024-09-16T07:32:37.477346+0000","last_became_peered":"2024-09-16T07:32:37.477346+0000","last_unstale":"2024-09-16T07:32:40.588524+0000","last_undegraded":"2024-09-16T07:32:40.588524+0000","last_fullsized":"2024-09-16T07:32:40.588524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:22.431966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588410+0000","last_change":"2024-09-16T07:32:38.502142+0000","last_active":"2024-09-16T07:32:40.588410+0000","last_peered":"2024-09-16T07:32:40.588410+0000","last_clean":"2024-09-16T07:32:40.588410+0000","last_became_active":"2024-09-16T07:32:38.501748+0000","last_became_peered":"2024-09-16T07:32:38.501748+0000","last_unstale":"2024-09-16T07:32:40.588410+0000","last_undegraded":"2024-09-16T07:32:40.588410+0000","last_fullsized":"2024-09-16T07:32:40.588410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.865212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487908+0000","last_change":"2024-09-16T07:32:37.483296+0000","last_active":"2024-09-16T07:32:39.487908+0000","last_peered":"2024-09-16T07:32:39.487908+0000","last_clean":"2024-09-16T07:32:39.487908+0000","last_became_active":"2024-09-16T07:32:37.482999+0000","last_became_peered":"2024-09-16T07:32:37.482999+0000","last_unstale":"2024-09-16T07:32:39.487908+0000","last_undegraded":"2024-09-16T07:32:39.487908+0000","last_fullsized":"2024-09-16T07:32:39.487908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:21.351724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587719+0000","last_change":"2024-09-16T07:32:38.488056+0000","last_active":"2024-09-16T07:32:40.587719+0000","last_peered":"2024-09-16T07:32:40.587719+0000","last_clean":"2024-09-16T07:32:40.587719+0000","last_became_active":"2024-09-16T07:32:38.487395+0000","last_became_peered":"2024-09-16T07:32:38.487395+0000","last_unstale":"2024-09-16T07:32:40.587719+0000","last_undegraded":"2024-09-16T07:32:40.587719+0000","last_fullsized":"2024-09-16T07:32:40.587719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:28:10.350730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496996+0000","last_change":"2024-09-16T07:32:37.488031+0000","last_active":"2024-09-16T07:32:40.496996+0000","last_peered":"2024-09-16T07:32:40.496996+0000","last_clean":"2024-09-16T07:32:40.496996+0000","last_became_active":"2024-09-16T07:32:37.487716+0000","last_became_peered":"2024-09-16T07:32:37.487716+0000","last_unstale":"2024-09-16T07:32:40.496996+0000","last_undegraded":"2024-09-16T07:32:40.496996+0000","last_fullsized":"2024-09-16T07:32:40.496996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:47.923445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588134+0000","last_change":"2024-09-16T07:32:38.499081+0000","last_active":"2024-09-16T07:32:40.588134+0000","last_peered":"2024-09-16T07:32:40.588134+0000","last_clean":"2024-09-16T07:32:40.588134+0000","last_became_active":"2024-09-16T07:32:38.498822+0000","last_became_peered":"2024-09-16T07:32:38.498822+0000","last_unstale":"2024-09-16T07:32:40.588134+0000","last_undegraded":"2024-09-16T07:32:40.588134+0000","last_fullsized":"2024-09-16T07:32:40.588134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:48.145855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496757+0000","last_change":"2024-09-16T07:32:37.483866+0000","last_active":"2024-09-16T07:32:40.496757+0000","last_peered":"2024-09-16T07:32:40.496757+0000","last_clean":"2024-09-16T07:32:40.496757+0000","last_became_active":"2024-09-16T07:32:37.483605+0000","last_became_peered":"2024-09-16T07:32:37.483605+0000","last_unstale":"2024-09-16T07:32:40.496757+0000","last_undegraded":"2024-09-16T07:32:40.496757+0000","last_fullsized":"2024-09-16T07:32:40.496757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:46.428327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575850+0000","last_change":"2024-09-16T07:32:38.503378+0000","last_active":"2024-09-16T07:32:39.575850+0000","last_peered":"2024-09-16T07:32:39.575850+0000","last_clean":"2024-09-16T07:32:39.575850+0000","last_became_active":"2024-09-16T07:32:38.502826+0000","last_became_peered":"2024-09-16T07:32:38.502826+0000","last_unstale":"2024-09-16T07:32:39.575850+0000","last_undegraded":"2024-09-16T07:32:39.575850+0000","last_fullsized":"2024-09-16T07:32:39.575850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:24.605911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488202+0000","last_change":"2024-09-16T07:32:37.481218+0000","last_active":"2024-09-16T07:32:39.488202+0000","last_peered":"2024-09-16T07:32:39.488202+0000","last_clean":"2024-09-16T07:32:39.488202+0000","last_became_active":"2024-09-16T07:32:37.480940+0000","last_became_peered":"2024-09-16T07:32:37.480940+0000","last_unstale":"2024-09-16T07:32:39.488202+0000","last_undegraded":"2024-09-16T07:32:39.488202+0000","last_fullsized":"2024-09-16T07:32:39.488202+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:41:43.903141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488006+0000","last_change":"2024-09-16T07:32:38.495600+0000","last_active":"2024-09-16T07:32:39.488006+0000","last_peered":"2024-09-16T07:32:39.488006+0000","last_clean":"2024-09-16T07:32:39.488006+0000","last_became_active":"2024-09-16T07:32:38.495301+0000","last_became_peered":"2024-09-16T07:32:38.495301+0000","last_unstale":"2024-09-16T07:32:39.488006+0000","last_undegraded":"2024-09-16T07:32:39.488006+0000","last_fullsized":"2024-09-16T07:32:39.488006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:19.653806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487808+0000","last_change":"2024-09-16T07:32:37.483432+0000","last_active":"2024-09-16T07:32:39.487808+0000","last_peered":"2024-09-16T07:32:39.487808+0000","last_clean":"2024-09-16T07:32:39.487808+0000","last_became_active":"2024-09-16T07:32:37.483094+0000","last_became_peered":"2024-09-16T07:32:37.483094+0000","last_unstale":"2024-09-16T07:32:39.487808+0000","last_undegraded":"2024-09-16T07:32:39.487808+0000","last_fullsized":"2024-09-16T07:32:39.487808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:08.166826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587109+0000","last_change":"2024-09-16T07:32:38.496962+0000","last_active":"2024-09-16T07:32:40.587109+0000","last_peered":"2024-09-16T07:32:40.587109+0000","last_clean":"2024-09-16T07:32:40.587109+0000","last_became_active":"2024-09-16T07:32:38.496698+0000","last_became_peered":"2024-09-16T07:32:38.496698+0000","last_unstale":"2024-09-16T07:32:40.587109+0000","last_undegraded":"2024-09-16T07:32:40.587109+0000","last_fullsized":"2024-09-16T07:32:40.587109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:23.042104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496587+0000","last_change":"2024-09-16T07:32:37.475522+0000","last_active":"2024-09-16T07:32:40.496587+0000","last_peered":"2024-09-16T07:32:40.496587+0000","last_clean":"2024-09-16T07:32:40.496587+0000","last_became_active":"2024-09-16T07:32:37.475175+0000","last_became_peered":"2024-09-16T07:32:37.475175+0000","last_unstale":"2024-09-16T07:32:40.496587+0000","last_undegraded":"2024-09-16T07:32:40.496587+0000","last_fullsized":"2024-09-16T07:32:40.496587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:17:12.077095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.490421+0000","last_change":"2024-09-16T07:32:38.498629+0000","last_active":"2024-09-16T07:32:39.490421+0000","last_peered":"2024-09-16T07:32:39.490421+0000","last_clean":"2024-09-16T07:32:39.490421+0000","last_became_active":"2024-09-16T07:32:38.498053+0000","last_became_peered":"2024-09-16T07:32:38.498053+0000","last_unstale":"2024-09-16T07:32:39.490421+0000","last_undegraded":"2024-09-16T07:32:39.490421+0000","last_fullsized":"2024-09-16T07:32:39.490421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:35.274056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575267+0000","last_change":"2024-09-16T07:32:37.478353+0000","last_active":"2024-09-16T07:32:39.575267+0000","last_peered":"2024-09-16T07:32:39.575267+0000","last_clean":"2024-09-16T07:32:39.575267+0000","last_became_active":"2024-09-16T07:32:37.477976+0000","last_became_peered":"2024-09-16T07:32:37.477976+0000","last_unstale":"2024-09-16T07:32:39.575267+0000","last_undegraded":"2024-09-16T07:32:39.575267+0000","last_fullsized":"2024-09-16T07:32:39.575267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:46.446023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.490958+0000","last_change":"2024-09-16T07:32:38.491633+0000","last_active":"2024-09-16T07:32:39.490958+0000","last_peered":"2024-09-16T07:32:39.490958+0000","last_clean":"2024-09-16T07:32:39.490958+0000","last_became_active":"2024-09-16T07:32:38.491175+0000","last_became_peered":"2024-09-16T07:32:38.491175+0000","last_unstale":"2024-09-16T07:32:39.490958+0000","last_undegraded":"2024-09-16T07:32:39.490958+0000","last_fullsized":"2024-09-16T07:32:39.490958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:05:02.591119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588561+0000","last_change":"2024-09-16T07:32:37.479382+0000","last_active":"2024-09-16T07:32:40.588561+0000","last_peered":"2024-09-16T07:32:40.588561+0000","last_clean":"2024-09-16T07:32:40.588561+0000","last_became_active":"2024-09-16T07:32:37.479132+0000","last_became_peered":"2024-09-16T07:32:37.479132+0000","last_unstale":"2024-09-16T07:32:40.588561+0000","last_undegraded":"2024-09-16T07:32:40.588561+0000","last_fullsized":"2024-09-16T07:32:40.588561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:46.956700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488026+0000","last_change":"2024-09-16T07:32:38.501055+0000","last_active":"2024-09-16T07:32:39.488026+0000","last_peered":"2024-09-16T07:32:39.488026+0000","last_clean":"2024-09-16T07:32:39.488026+0000","last_became_active":"2024-09-16T07:32:38.500551+0000","last_became_peered":"2024-09-16T07:32:38.500551+0000","last_unstale":"2024-09-16T07:32:39.488026+0000","last_undegraded":"2024-09-16T07:32:39.488026+0000","last_fullsized":"2024-09-16T07:32:39.488026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:19.653806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588244+0000","last_change":"2024-09-16T07:32:37.475562+0000","last_active":"2024-09-16T07:32:40.588244+0000","last_peered":"2024-09-16T07:32:40.588244+0000","last_clean":"2024-09-16T07:32:40.588244+0000","last_became_active":"2024-09-16T07:32:37.475257+0000","last_became_peered":"2024-09-16T07:32:37.475257+0000","last_unstale":"2024-09-16T07:32:40.588244+0000","last_undegraded":"2024-09-16T07:32:40.588244+0000","last_fullsized":"2024-09-16T07:32:40.588244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:20.393872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496797+0000","last_change":"2024-09-16T07:32:38.497554+0000","last_active":"2024-09-16T07:32:40.496797+0000","last_peered":"2024-09-16T07:32:40.496797+0000","last_clean":"2024-09-16T07:32:40.496797+0000","last_became_active":"2024-09-16T07:32:38.497294+0000","last_became_peered":"2024-09-16T07:32:38.497294+0000","last_unstale":"2024-09-16T07:32:40.496797+0000","last_undegraded":"2024-09-16T07:32:40.496797+0000","last_fullsized":"2024-09-16T07:32:40.496797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:49.338090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"80'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587687+0000","last_change":"2024-09-16T07:32:37.472209+0000","last_active":"2024-09-16T07:32:40.587687+0000","last_peered":"2024-09-16T07:32:40.587687+0000","last_clean":"2024-09-16T07:32:40.587687+0000","last_became_active":"2024-09-16T07:32:37.471927+0000","last_became_peered":"2024-09-16T07:32:37.471927+0000","last_unstale":"2024-09-16T07:32:40.587687+0000","last_undegraded":"2024-09-16T07:32:40.587687+0000","last_fullsized":"2024-09-16T07:32:40.587687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:39.885061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488350+0000","last_change":"2024-09-16T07:32:38.507439+0000","last_active":"2024-09-16T07:32:39.488350+0000","last_peered":"2024-09-16T07:32:39.488350+0000","last_clean":"2024-09-16T07:32:39.488350+0000","last_became_active":"2024-09-16T07:32:38.505797+0000","last_became_peered":"2024-09-16T07:32:38.505797+0000","last_unstale":"2024-09-16T07:32:39.488350+0000","last_undegraded":"2024-09-16T07:32:39.488350+0000","last_fullsized":"2024-09-16T07:32:39.488350+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:15.379816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"80'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487959+0000","last_change":"2024-09-16T07:32:37.477898+0000","last_active":"2024-09-16T07:32:39.487959+0000","last_peered":"2024-09-16T07:32:39.487959+0000","last_clean":"2024-09-16T07:32:39.487959+0000","last_became_active":"2024-09-16T07:32:37.477470+0000","last_became_peered":"2024-09-16T07:32:37.477470+0000","last_unstale":"2024-09-16T07:32:39.487959+0000","last_undegraded":"2024-09-16T07:32:39.487959+0000","last_fullsized":"2024-09-16T07:32:39.487959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:41.473094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496754+0000","last_change":"2024-09-16T07:32:38.499091+0000","last_active":"2024-09-16T07:32:40.496754+0000","last_peered":"2024-09-16T07:32:40.496754+0000","last_clean":"2024-09-16T07:32:40.496754+0000","last_became_active":"2024-09-16T07:32:38.498844+0000","last_became_peered":"2024-09-16T07:32:38.498844+0000","last_unstale":"2024-09-16T07:32:40.496754+0000","last_undegraded":"2024-09-16T07:32:40.496754+0000","last_fullsized":"2024-09-16T07:32:40.496754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:39:24.939827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575451+0000","last_change":"2024-09-16T07:32:37.477253+0000","last_active":"2024-09-16T07:32:39.575451+0000","last_peered":"2024-09-16T07:32:39.575451+0000","last_clean":"2024-09-16T07:32:39.575451+0000","last_became_active":"2024-09-16T07:32:37.476963+0000","last_became_peered":"2024-09-16T07:32:37.476963+0000","last_unstale":"2024-09-16T07:32:39.575451+0000","last_undegraded":"2024-09-16T07:32:39.575451+0000","last_fullsized":"2024-09-16T07:32:39.575451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:19:47.677059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587625+0000","last_change":"2024-09-16T07:32:38.503313+0000","last_active":"2024-09-16T07:32:40.587625+0000","last_peered":"2024-09-16T07:32:40.587625+0000","last_clean":"2024-09-16T07:32:40.587625+0000","last_became_active":"2024-09-16T07:32:38.502951+0000","last_became_peered":"2024-09-16T07:32:38.502951+0000","last_unstale":"2024-09-16T07:32:40.587625+0000","last_undegraded":"2024-09-16T07:32:40.587625+0000","last_fullsized":"2024-09-16T07:32:40.587625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:49.338090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.490575+0000","last_change":"2024-09-16T07:32:37.486936+0000","last_active":"2024-09-16T07:32:39.490575+0000","last_peered":"2024-09-16T07:32:39.490575+0000","last_clean":"2024-09-16T07:32:39.490575+0000","last_became_active":"2024-09-16T07:32:37.486624+0000","last_became_peered":"2024-09-16T07:32:37.486624+0000","last_unstale":"2024-09-16T07:32:39.490575+0000","last_undegraded":"2024-09-16T07:32:39.490575+0000","last_fullsized":"2024-09-16T07:32:39.490575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:49.763371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575293+0000","last_change":"2024-09-16T07:32:38.496756+0000","last_active":"2024-09-16T07:32:39.575293+0000","last_peered":"2024-09-16T07:32:39.575293+0000","last_clean":"2024-09-16T07:32:39.575293+0000","last_became_active":"2024-09-16T07:32:38.496357+0000","last_became_peered":"2024-09-16T07:32:38.496357+0000","last_unstale":"2024-09-16T07:32:39.575293+0000","last_undegraded":"2024-09-16T07:32:39.575293+0000","last_fullsized":"2024-09-16T07:32:39.575293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:43.197001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487543+0000","last_change":"2024-09-16T07:32:37.474376+0000","last_active":"2024-09-16T07:32:39.487543+0000","last_peered":"2024-09-16T07:32:39.487543+0000","last_clean":"2024-09-16T07:32:39.487543+0000","last_became_active":"2024-09-16T07:32:37.474060+0000","last_became_peered":"2024-09-16T07:32:37.474060+0000","last_unstale":"2024-09-16T07:32:39.487543+0000","last_undegraded":"2024-09-16T07:32:39.487543+0000","last_fullsized":"2024-09-16T07:32:39.487543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:29:58.140194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575252+0000","last_change":"2024-09-16T07:32:38.492780+0000","last_active":"2024-09-16T07:32:39.575252+0000","last_peered":"2024-09-16T07:32:39.575252+0000","last_clean":"2024-09-16T07:32:39.575252+0000","last_became_active":"2024-09-16T07:32:38.490491+0000","last_became_peered":"2024-09-16T07:32:38.490491+0000","last_unstale":"2024-09-16T07:32:39.575252+0000","last_undegraded":"2024-09-16T07:32:39.575252+0000","last_fullsized":"2024-09-16T07:32:39.575252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:19.567646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496458+0000","last_change":"2024-09-16T07:32:37.472142+0000","last_active":"2024-09-16T07:32:40.496458+0000","last_peered":"2024-09-16T07:32:40.496458+0000","last_clean":"2024-09-16T07:32:40.496458+0000","last_became_active":"2024-09-16T07:32:37.471899+0000","last_became_peered":"2024-09-16T07:32:37.471899+0000","last_unstale":"2024-09-16T07:32:40.496458+0000","last_undegraded":"2024-09-16T07:32:40.496458+0000","last_fullsized":"2024-09-16T07:32:40.496458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:54:51.490387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588471+0000","last_change":"2024-09-16T07:32:38.508751+0000","last_active":"2024-09-16T07:32:40.588471+0000","last_peered":"2024-09-16T07:32:40.588471+0000","last_clean":"2024-09-16T07:32:40.588471+0000","last_became_active":"2024-09-16T07:32:38.508490+0000","last_became_peered":"2024-09-16T07:32:38.508490+0000","last_unstale":"2024-09-16T07:32:40.588471+0000","last_undegraded":"2024-09-16T07:32:40.588471+0000","last_fullsized":"2024-09-16T07:32:40.588471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:50.771849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588628+0000","last_change":"2024-09-16T07:32:37.467550+0000","last_active":"2024-09-16T07:32:40.588628+0000","last_peered":"2024-09-16T07:32:40.588628+0000","last_clean":"2024-09-16T07:32:40.588628+0000","last_became_active":"2024-09-16T07:32:37.467230+0000","last_became_peered":"2024-09-16T07:32:37.467230+0000","last_unstale":"2024-09-16T07:32:40.588628+0000","last_undegraded":"2024-09-16T07:32:40.588628+0000","last_fullsized":"2024-09-16T07:32:40.588628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:30.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588464+0000","last_change":"2024-09-16T07:32:38.497512+0000","last_active":"2024-09-16T07:32:40.588464+0000","last_peered":"2024-09-16T07:32:40.588464+0000","last_clean":"2024-09-16T07:32:40.588464+0000","last_became_active":"2024-09-16T07:32:38.497261+0000","last_became_peered":"2024-09-16T07:32:38.497261+0000","last_unstale":"2024-09-16T07:32:40.588464+0000","last_undegraded":"2024-09-16T07:32:40.588464+0000","last_fullsized":"2024-09-16T07:32:40.588464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:59.267696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496920+0000","last_change":"2024-09-16T07:32:37.481488+0000","last_active":"2024-09-16T07:32:40.496920+0000","last_peered":"2024-09-16T07:32:40.496920+0000","last_clean":"2024-09-16T07:32:40.496920+0000","last_became_active":"2024-09-16T07:32:37.481151+0000","last_became_peered":"2024-09-16T07:32:37.481151+0000","last_unstale":"2024-09-16T07:32:40.496920+0000","last_undegraded":"2024-09-16T07:32:40.496920+0000","last_fullsized":"2024-09-16T07:32:40.496920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:56.293206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488456+0000","last_change":"2024-09-16T07:32:38.496111+0000","last_active":"2024-09-16T07:32:39.488456+0000","last_peered":"2024-09-16T07:32:39.488456+0000","last_clean":"2024-09-16T07:32:39.488456+0000","last_became_active":"2024-09-16T07:32:38.495357+0000","last_became_peered":"2024-09-16T07:32:38.495357+0000","last_unstale":"2024-09-16T07:32:39.488456+0000","last_undegraded":"2024-09-16T07:32:39.488456+0000","last_fullsized":"2024-09-16T07:32:39.488456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:57.301683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496995+0000","last_change":"2024-09-16T07:32:37.475609+0000","last_active":"2024-09-16T07:32:40.496995+0000","last_peered":"2024-09-16T07:32:40.496995+0000","last_clean":"2024-09-16T07:32:40.496995+0000","last_became_active":"2024-09-16T07:32:37.475160+0000","last_became_peered":"2024-09-16T07:32:37.475160+0000","last_unstale":"2024-09-16T07:32:40.496995+0000","last_undegraded":"2024-09-16T07:32:40.496995+0000","last_fullsized":"2024-09-16T07:32:40.496995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:18.645328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589949+0000","last_change":"2024-09-16T07:32:38.487272+0000","last_active":"2024-09-16T07:32:40.589949+0000","last_peered":"2024-09-16T07:32:40.589949+0000","last_clean":"2024-09-16T07:32:40.589949+0000","last_became_active":"2024-09-16T07:32:38.486691+0000","last_became_peered":"2024-09-16T07:32:38.486691+0000","last_unstale":"2024-09-16T07:32:40.589949+0000","last_undegraded":"2024-09-16T07:32:40.589949+0000","last_fullsized":"2024-09-16T07:32:40.589949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:06:27.186608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.490712+0000","last_change":"2024-09-16T07:32:37.486787+0000","last_active":"2024-09-16T07:32:39.490712+0000","last_peered":"2024-09-16T07:32:39.490712+0000","last_clean":"2024-09-16T07:32:39.490712+0000","last_became_active":"2024-09-16T07:32:37.486507+0000","last_became_peered":"2024-09-16T07:32:37.486507+0000","last_unstale":"2024-09-16T07:32:39.490712+0000","last_undegraded":"2024-09-16T07:32:39.490712+0000","last_fullsized":"2024-09-16T07:32:39.490712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:00.534941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487521+0000","last_change":"2024-09-16T07:32:38.490881+0000","last_active":"2024-09-16T07:32:39.487521+0000","last_peered":"2024-09-16T07:32:39.487521+0000","last_clean":"2024-09-16T07:32:39.487521+0000","last_became_active":"2024-09-16T07:32:38.490592+0000","last_became_peered":"2024-09-16T07:32:38.490592+0000","last_unstale":"2024-09-16T07:32:39.487521+0000","last_undegraded":"2024-09-16T07:32:39.487521+0000","last_fullsized":"2024-09-16T07:32:39.487521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:48.931923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.590006+0000","last_change":"2024-09-16T07:32:37.479541+0000","last_active":"2024-09-16T07:32:40.590006+0000","last_peered":"2024-09-16T07:32:40.590006+0000","last_clean":"2024-09-16T07:32:40.590006+0000","last_became_active":"2024-09-16T07:32:37.479221+0000","last_became_peered":"2024-09-16T07:32:37.479221+0000","last_unstale":"2024-09-16T07:32:40.590006+0000","last_undegraded":"2024-09-16T07:32:40.590006+0000","last_fullsized":"2024-09-16T07:32:40.590006+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:00.424601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589552+0000","last_change":"2024-09-16T07:32:38.490798+0000","last_active":"2024-09-16T07:32:40.589552+0000","last_peered":"2024-09-16T07:32:40.589552+0000","last_clean":"2024-09-16T07:32:40.589552+0000","last_became_active":"2024-09-16T07:32:38.490528+0000","last_became_peered":"2024-09-16T07:32:38.490528+0000","last_unstale":"2024-09-16T07:32:40.589552+0000","last_undegraded":"2024-09-16T07:32:40.589552+0000","last_fullsized":"2024-09-16T07:32:40.589552+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:37.797495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.589417+0000","last_change":"2024-09-16T07:32:37.486057+0000","last_active":"2024-09-16T07:32:40.589417+0000","last_peered":"2024-09-16T07:32:40.589417+0000","last_clean":"2024-09-16T07:32:40.589417+0000","last_became_active":"2024-09-16T07:32:37.485799+0000","last_became_peered":"2024-09-16T07:32:37.485799+0000","last_unstale":"2024-09-16T07:32:40.589417+0000","last_undegraded":"2024-09-16T07:32:40.589417+0000","last_fullsized":"2024-09-16T07:32:40.589417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:41.823425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488398+0000","last_change":"2024-09-16T07:32:38.495888+0000","last_active":"2024-09-16T07:32:39.488398+0000","last_peered":"2024-09-16T07:32:39.488398+0000","last_clean":"2024-09-16T07:32:39.488398+0000","last_became_active":"2024-09-16T07:32:38.495573+0000","last_became_peered":"2024-09-16T07:32:38.495573+0000","last_unstale":"2024-09-16T07:32:39.488398+0000","last_undegraded":"2024-09-16T07:32:39.488398+0000","last_fullsized":"2024-09-16T07:32:39.488398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:15.379816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.490334+0000","last_change":"2024-09-16T07:32:37.488821+0000","last_active":"2024-09-16T07:32:39.490334+0000","last_peered":"2024-09-16T07:32:39.490334+0000","last_clean":"2024-09-16T07:32:39.490334+0000","last_became_active":"2024-09-16T07:32:37.488458+0000","last_became_peered":"2024-09-16T07:32:37.488458+0000","last_unstale":"2024-09-16T07:32:39.490334+0000","last_undegraded":"2024-09-16T07:32:39.490334+0000","last_fullsized":"2024-09-16T07:32:39.490334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:54.128839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487682+0000","last_change":"2024-09-16T07:32:38.492029+0000","last_active":"2024-09-16T07:32:39.487682+0000","last_peered":"2024-09-16T07:32:39.487682+0000","last_clean":"2024-09-16T07:32:39.487682+0000","last_became_active":"2024-09-16T07:32:38.491777+0000","last_became_peered":"2024-09-16T07:32:38.491777+0000","last_unstale":"2024-09-16T07:32:39.487682+0000","last_undegraded":"2024-09-16T07:32:39.487682+0000","last_fullsized":"2024-09-16T07:32:39.487682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:07.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575967+0000","last_change":"2024-09-16T07:32:37.473768+0000","last_active":"2024-09-16T07:32:39.575967+0000","last_peered":"2024-09-16T07:32:39.575967+0000","last_clean":"2024-09-16T07:32:39.575967+0000","last_became_active":"2024-09-16T07:32:37.473395+0000","last_became_peered":"2024-09-16T07:32:37.473395+0000","last_unstale":"2024-09-16T07:32:39.575967+0000","last_undegraded":"2024-09-16T07:32:39.575967+0000","last_fullsized":"2024-09-16T07:32:39.575967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:32:35.682756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588318+0000","last_change":"2024-09-16T07:32:38.506670+0000","last_active":"2024-09-16T07:32:40.588318+0000","last_peered":"2024-09-16T07:32:40.588318+0000","last_clean":"2024-09-16T07:32:40.588318+0000","last_became_active":"2024-09-16T07:32:38.506415+0000","last_became_peered":"2024-09-16T07:32:38.506415+0000","last_unstale":"2024-09-16T07:32:40.588318+0000","last_undegraded":"2024-09-16T07:32:40.588318+0000","last_fullsized":"2024-09-16T07:32:40.588318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:01.543418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"81'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575863+0000","last_change":"2024-09-16T07:32:37.474441+0000","last_active":"2024-09-16T07:32:39.575863+0000","last_peered":"2024-09-16T07:32:39.575863+0000","last_clean":"2024-09-16T07:32:39.575863+0000","last_became_active":"2024-09-16T07:32:37.474052+0000","last_became_peered":"2024-09-16T07:32:37.474052+0000","last_unstale":"2024-09-16T07:32:39.575863+0000","last_undegraded":"2024-09-16T07:32:39.575863+0000","last_fullsized":"2024-09-16T07:32:39.575863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:43.467200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587959+0000","last_change":"2024-09-16T07:32:38.488130+0000","last_active":"2024-09-16T07:32:40.587959+0000","last_peered":"2024-09-16T07:32:40.587959+0000","last_clean":"2024-09-16T07:32:40.587959+0000","last_became_active":"2024-09-16T07:32:38.487811+0000","last_became_peered":"2024-09-16T07:32:38.487811+0000","last_unstale":"2024-09-16T07:32:40.587959+0000","last_undegraded":"2024-09-16T07:32:40.587959+0000","last_fullsized":"2024-09-16T07:32:40.587959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:18:49.286902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587811+0000","last_change":"2024-09-16T07:32:37.480703+0000","last_active":"2024-09-16T07:32:40.587811+0000","last_peered":"2024-09-16T07:32:40.587811+0000","last_clean":"2024-09-16T07:32:40.587811+0000","last_became_active":"2024-09-16T07:32:37.480323+0000","last_became_peered":"2024-09-16T07:32:37.480323+0000","last_unstale":"2024-09-16T07:32:40.587811+0000","last_undegraded":"2024-09-16T07:32:40.587811+0000","last_fullsized":"2024-09-16T07:32:40.587811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:23.597433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.488584+0000","last_change":"2024-09-16T07:32:38.500013+0000","last_active":"2024-09-16T07:32:39.488584+0000","last_peered":"2024-09-16T07:32:39.488584+0000","last_clean":"2024-09-16T07:32:39.488584+0000","last_became_active":"2024-09-16T07:32:38.499750+0000","last_became_peered":"2024-09-16T07:32:38.499750+0000","last_unstale":"2024-09-16T07:32:39.488584+0000","last_undegraded":"2024-09-16T07:32:39.488584+0000","last_fullsized":"2024-09-16T07:32:39.488584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:23.042104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587972+0000","last_change":"2024-09-16T07:32:37.476463+0000","last_active":"2024-09-16T07:32:40.587972+0000","last_peered":"2024-09-16T07:32:40.587972+0000","last_clean":"2024-09-16T07:32:40.587972+0000","last_became_active":"2024-09-16T07:32:37.476117+0000","last_became_peered":"2024-09-16T07:32:37.476117+0000","last_unstale":"2024-09-16T07:32:40.587972+0000","last_undegraded":"2024-09-16T07:32:40.587972+0000","last_fullsized":"2024-09-16T07:32:40.587972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:11.434130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487602+0000","last_change":"2024-09-16T07:32:38.490186+0000","last_active":"2024-09-16T07:32:39.487602+0000","last_peered":"2024-09-16T07:32:39.487602+0000","last_clean":"2024-09-16T07:32:39.487602+0000","last_became_active":"2024-09-16T07:32:38.489890+0000","last_became_peered":"2024-09-16T07:32:38.489890+0000","last_unstale":"2024-09-16T07:32:39.487602+0000","last_undegraded":"2024-09-16T07:32:39.487602+0000","last_fullsized":"2024-09-16T07:32:39.487602+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:07.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496790+0000","last_change":"2024-09-16T07:32:37.475919+0000","last_active":"2024-09-16T07:32:40.496790+0000","last_peered":"2024-09-16T07:32:40.496790+0000","last_clean":"2024-09-16T07:32:40.496790+0000","last_became_active":"2024-09-16T07:32:37.475565+0000","last_became_peered":"2024-09-16T07:32:37.475565+0000","last_unstale":"2024-09-16T07:32:40.496790+0000","last_undegraded":"2024-09-16T07:32:40.496790+0000","last_fullsized":"2024-09-16T07:32:40.496790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:06.103402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.496819+0000","last_change":"2024-09-16T07:32:38.500576+0000","last_active":"2024-09-16T07:32:40.496819+0000","last_peered":"2024-09-16T07:32:40.496819+0000","last_clean":"2024-09-16T07:32:40.496819+0000","last_became_active":"2024-09-16T07:32:38.500307+0000","last_became_peered":"2024-09-16T07:32:38.500307+0000","last_unstale":"2024-09-16T07:32:40.496819+0000","last_undegraded":"2024-09-16T07:32:40.496819+0000","last_fullsized":"2024-09-16T07:32:40.496819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:04.822294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487926+0000","last_change":"2024-09-16T07:32:37.483345+0000","last_active":"2024-09-16T07:32:39.487926+0000","last_peered":"2024-09-16T07:32:39.487926+0000","last_clean":"2024-09-16T07:32:39.487926+0000","last_became_active":"2024-09-16T07:32:37.482995+0000","last_became_peered":"2024-09-16T07:32:37.482995+0000","last_unstale":"2024-09-16T07:32:39.487926+0000","last_undegraded":"2024-09-16T07:32:39.487926+0000","last_fullsized":"2024-09-16T07:32:39.487926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:06:15.600779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587430+0000","last_change":"2024-09-16T07:32:38.510003+0000","last_active":"2024-09-16T07:32:40.587430+0000","last_peered":"2024-09-16T07:32:40.587430+0000","last_clean":"2024-09-16T07:32:40.587430+0000","last_became_active":"2024-09-16T07:32:38.509761+0000","last_became_peered":"2024-09-16T07:32:38.509761+0000","last_unstale":"2024-09-16T07:32:40.587430+0000","last_undegraded":"2024-09-16T07:32:40.587430+0000","last_fullsized":"2024-09-16T07:32:40.587430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:59.095138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587984+0000","last_change":"2024-09-16T07:32:37.479500+0000","last_active":"2024-09-16T07:32:40.587984+0000","last_peered":"2024-09-16T07:32:40.587984+0000","last_clean":"2024-09-16T07:32:40.587984+0000","last_became_active":"2024-09-16T07:32:37.479184+0000","last_became_peered":"2024-09-16T07:32:37.479184+0000","last_unstale":"2024-09-16T07:32:40.587984+0000","last_undegraded":"2024-09-16T07:32:40.587984+0000","last_fullsized":"2024-09-16T07:32:40.587984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:52:08.977221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587238+0000","last_change":"2024-09-16T07:32:38.491382+0000","last_active":"2024-09-16T07:32:40.587238+0000","last_peered":"2024-09-16T07:32:40.587238+0000","last_clean":"2024-09-16T07:32:40.587238+0000","last_became_active":"2024-09-16T07:32:38.490988+0000","last_became_peered":"2024-09-16T07:32:38.490988+0000","last_unstale":"2024-09-16T07:32:40.587238+0000","last_undegraded":"2024-09-16T07:32:40.587238+0000","last_fullsized":"2024-09-16T07:32:40.587238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:18:47.436804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.487101+0000","last_change":"2024-09-16T07:32:37.475751+0000","last_active":"2024-09-16T07:32:39.487101+0000","last_peered":"2024-09-16T07:32:39.487101+0000","last_clean":"2024-09-16T07:32:39.487101+0000","last_became_active":"2024-09-16T07:32:37.475454+0000","last_became_peered":"2024-09-16T07:32:37.475454+0000","last_unstale":"2024-09-16T07:32:39.487101+0000","last_undegraded":"2024-09-16T07:32:39.487101+0000","last_fullsized":"2024-09-16T07:32:39.487101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:23.293999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:39.575653+0000","last_change":"2024-09-16T07:32:38.494065+0000","last_active":"2024-09-16T07:32:39.575653+0000","last_peered":"2024-09-16T07:32:39.575653+0000","last_clean":"2024-09-16T07:32:39.575653+0000","last_became_active":"2024-09-16T07:32:38.493735+0000","last_became_peered":"2024-09-16T07:32:38.493735+0000","last_unstale":"2024-09-16T07:32:39.575653+0000","last_undegraded":"2024-09-16T07:32:39.575653+0000","last_fullsized":"2024-09-16T07:32:39.575653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:37.452465+0000","last_clean_scrub_stamp":"2024-09-16T07:32:37.452465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:56.102254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.588301+0000","last_change":"2024-09-16T07:32:37.470906+0000","last_active":"2024-09-16T07:32:40.588301+0000","last_peered":"2024-09-16T07:32:40.588301+0000","last_clean":"2024-09-16T07:32:40.588301+0000","last_became_active":"2024-09-16T07:32:37.470554+0000","last_became_peered":"2024-09-16T07:32:37.470554+0000","last_unstale":"2024-09-16T07:32:40.588301+0000","last_undegraded":"2024-09-16T07:32:40.588301+0000","last_fullsized":"2024-09-16T07:32:40.588301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:32:36.443987+0000","last_clean_scrub_stamp":"2024-09-16T07:32:36.443987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:28.025565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":247,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-16T07:32:40.587412+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:32:40.587412+0000","last_peered":"2024-09-16T07:32:40.587412+0000","last_clean":"2024-09-16T07:32:40.587412+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:32:40.587412+0000","last_undegraded":"2024-09-16T07:32:40.587412+0000","last_fullsized":"2024-09-16T07:32:40.587412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":1009889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":420145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1003520,"data_stored":421085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":987136,"data_stored":419451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509497,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":421063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":420033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":419645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":1009853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:32:47.528 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:32:47.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:32:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.719+0000 7f0cb7a00640 1 -- 172.21.15.114:0/1095725260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c94004810 msgr2=0x7f0c94004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.719+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/1095725260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c94004810 0x7f0c94004c90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c260 tx=0x7f0c9801cf00 comp rx=0 tx=0).stop 2024-09-16T07:32:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.719+0000 7f0cb7a00640 1 -- 172.21.15.114:0/1095725260 shutdown_connections 2024-09-16T07:32:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.719+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/1095725260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c94004810 0x7f0c94004c90 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.719+0000 7f0cb7a00640 1 -- 172.21.15.114:0/1095725260 >> 172.21.15.114:0/1095725260 conn(0x7f0cb00b18f0 msgr2=0x7f0cb00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.719+0000 7f0cb7a00640 1 -- 172.21.15.114:0/1095725260 shutdown_connections 2024-09-16T07:32:47.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.719+0000 7f0cb7a00640 1 -- 172.21.15.114:0/1095725260 wait complete. 2024-09-16T07:32:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 Processor -- start 2024-09-16T07:32:47.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 -- start start 2024-09-16T07:32:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c94004810 0x7f0cb0073a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cb0158be0 0x7f0cb014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cb015bb20 0x7f0cb015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb006e7a0 con 0x7f0cb0158be0 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb00cd080 con 0x7f0c94004810 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb006e920 con 0x7f0cb015bb20 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cb0158be0 0x7f0cb014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cb0158be0 0x7f0cb014b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40652/0 (socket says 172.21.15.114:40652) 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 -- 172.21.15.114:0/3978687179 learned_addr learned my addr 172.21.15.114:0/3978687179 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb5000640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c94004810 0x7f0cb0073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb5a00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cb015bb20 0x7f0cb015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 -- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cb015bb20 msgr2=0x7f0cb015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cb015bb20 0x7f0cb015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 -- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c94004810 msgr2=0x7f0cb0073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c94004810 0x7f0cb0073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 -- 172.21.15.114:0/3978687179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb015d4f0 con 0x7f0cb0158be0 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0ca7e00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cb0158be0 0x7f0cb014b710 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0c9801d3e0 tx=0x7f0c98006c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:47.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cad600640 1 -- 172.21.15.114:0/3978687179 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98001500 con 0x7f0cb0158be0 2024-09-16T07:32:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cad600640 1 -- 172.21.15.114:0/3978687179 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c980016a0 con 0x7f0cb0158be0 2024-09-16T07:32:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cad600640 1 -- 172.21.15.114:0/3978687179 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c980064e0 con 0x7f0cb0158be0 2024-09-16T07:32:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb015d790 con 0x7f0cb0158be0 2024-09-16T07:32:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.723+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb00b20b0 con 0x7f0cb0158be0 2024-09-16T07:32:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.727+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb0069410 con 0x7f0cb0158be0 2024-09-16T07:32:47.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.727+0000 7f0cad600640 1 -- 172.21.15.114:0/3978687179 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f0c98003600 con 0x7f0cb0158be0 2024-09-16T07:32:47.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.727+0000 7f0cad600640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c8c073010 0x7f0c8c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:47.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.727+0000 7f0cad600640 1 -- 172.21.15.114:0/3978687179 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f0c9812d820 con 0x7f0cb0158be0 2024-09-16T07:32:47.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.727+0000 7f0cb5000640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c8c073010 0x7f0c8c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:47.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.727+0000 7f0cb5000640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c8c073010 0x7f0c8c0754d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000c10 tx=0x7f0ca0006cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:47.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.731+0000 7f0cad600640 1 -- 172.21.15.114:0/3978687179 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0c98016cb0 con 0x7f0cb0158be0 2024-09-16T07:32:47.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.959+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0cb006edf0 con 0x7f0cb0158be0 2024-09-16T07:32:47.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.963+0000 7f0cad600640 1 -- 172.21.15.114:0/3978687179 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f0c980f8170 con 0x7f0cb0158be0 2024-09-16T07:32:47.961 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:32:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:32:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:32:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:32:47.962 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:32:47.962 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c8c073010 msgr2=0x7f0c8c0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c8c073010 0x7f0c8c0754d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000c10 tx=0x7f0ca0006cb0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cb0158be0 msgr2=0x7f0cb014b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cb0158be0 0x7f0cb014b710 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0c9801d3e0 tx=0x7f0c98006c70 comp rx=0 tx=0).stop 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 shutdown_connections 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c8c073010 0x7f0c8c0754d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0cb015bb20 0x7f0cb015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cb0158be0 0x7f0cb014b710 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 --2- 172.21.15.114:0/3978687179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c94004810 0x7f0cb0073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 >> 172.21.15.114:0/3978687179 conn(0x7f0cb00b18f0 msgr2=0x7f0cb0159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:47.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 shutdown_connections 2024-09-16T07:32:47.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:47.967+0000 7f0cb7a00640 1 -- 172.21.15.114:0/3978687179 wait complete. 2024-09-16T07:32:47.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:32:48.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- 172.21.15.114:0/2434893512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 msgr2=0x7fb1d8074380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 --2- 172.21.15.114:0/2434893512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d8074380 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009900 tx=0x7fb1c401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- 172.21.15.114:0/2434893512 shutdown_connections 2024-09-16T07:32:48.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 --2- 172.21.15.114:0/2434893512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d8074380 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- 172.21.15.114:0/2434893512 >> 172.21.15.114:0/2434893512 conn(0x7fb1d80b1f10 msgr2=0x7fb1d80b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- 172.21.15.114:0/2434893512 shutdown_connections 2024-09-16T07:32:48.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- 172.21.15.114:0/2434893512 wait complete. 2024-09-16T07:32:48.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 Processor -- start 2024-09-16T07:32:48.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- start start 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1d80748c0 0x7fb1d81549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d81f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1d815bea0 0x7fb1d8155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8169fe0 con 0x7fb1d80b10a0 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d8074d30 con 0x7fb1d815bea0 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1df000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d816a160 con 0x7fb1d80748c0 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d81f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.127+0000 7fb1d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d81f8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40666/0 (socket says 172.21.15.114:40666) 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7400640 1 -- 172.21.15.114:0/812908549 learned_addr learned my addr 172.21.15.114:0/812908549 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7e00640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1d80748c0 0x7fb1d81549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1dd000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1d815bea0 0x7fb1d8155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7400640 1 -- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1d80748c0 msgr2=0x7fb1d81549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7400640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1d80748c0 0x7fb1d81549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7400640 1 -- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1d815bea0 msgr2=0x7fb1d8155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7400640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1d815bea0 0x7fb1d8155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7400640 1 -- 172.21.15.114:0/812908549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d81fbc20 con 0x7fb1d80b10a0 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1dd000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1d815bea0 0x7fb1d8155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:48.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1d7400640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d81f8190 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009850 tx=0x7fb1c40a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:32:48.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1cfe00640 1 -- 172.21.15.114:0/812908549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40b2040 con 0x7fb1d80b10a0 2024-09-16T07:32:48.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1cfe00640 1 -- 172.21.15.114:0/812908549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1c40044b0 con 0x7fb1d80b10a0 2024-09-16T07:32:48.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d8155a90 con 0x7fb1d80b10a0 2024-09-16T07:32:48.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1cfe00640 1 -- 172.21.15.114:0/812908549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4005280 con 0x7fb1d80b10a0 2024-09-16T07:32:48.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d81fb380 con 0x7fb1d80b10a0 2024-09-16T07:32:48.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d8074380 con 0x7fb1d80b10a0 2024-09-16T07:32:48.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.131+0000 7fb1cfe00640 1 -- 172.21.15.114:0/812908549 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fb1c4005420 con 0x7fb1d80b10a0 2024-09-16T07:32:48.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.135+0000 7fb1cfe00640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1b8072fe0 0x7fb1b80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:32:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.135+0000 7fb1cfe00640 1 -- 172.21.15.114:0/812908549 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c412e080 con 0x7fb1d80b10a0 2024-09-16T07:32:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.135+0000 7fb1d7e00640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1b8072fe0 0x7fb1b80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.135+0000 7fb1d7e00640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1b8072fe0 0x7fb1b80754a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8007fd0 tx=0x7fb1c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.139+0000 7fb1cfe00640 1 -- 172.21.15.114:0/812908549 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb1c40164d0 con 0x7fb1d80b10a0 2024-09-16T07:32:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.343+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1d80b62a0 con 0x7fb1d80b10a0 2024-09-16T07:32:48.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.343+0000 7fb1cfe00640 1 -- 172.21.15.114:0/812908549 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5234 (secure 0 0 0) 0x7fb1c40f90b0 con 0x7fb1d80b10a0 2024-09-16T07:32:48.341 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:32:48.341 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":57,"btime":"2024-09-16T07:32:41:510667+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1449286393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1449286393},{"type":"v1","addr":"172.21.15.114:6834","nonce":1449286393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6307,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3836721187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":3836721187},{"type":"v1","addr":"172.21.15.149:6835","nonce":3836721187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6588,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2356735727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2356735727},{"type":"v1","addr":"172.21.15.114:6835","nonce":2356735727}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:37.860881+0000","modified":"2024-09-16T07:32:40.899353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6834/862990525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":862990525},{"type":"v1","addr":"172.21.15.149:6834","nonce":862990525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6600,"qdb_cluster":[6600]},"id":6}]} 2024-09-16T07:32:48.342 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 57 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1b8072fe0 msgr2=0x7fb1b80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1b8072fe0 0x7fb1b80754a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8007fd0 tx=0x7fb1c8009040 comp rx=0 tx=0).stop 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 msgr2=0x7fb1d81f8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d81f8190 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009850 tx=0x7fb1c40a56e0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 shutdown_connections 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1d815bea0 0x7fb1d8155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1d80b10a0 0x7fb1d81f8190 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1b8072fe0 0x7fb1b80754a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 --2- 172.21.15.114:0/812908549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb1d80748c0 0x7fb1d81549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 >> 172.21.15.114:0/812908549 conn(0x7fb1d80b1f10 msgr2=0x7fb1d815ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 shutdown_connections 2024-09-16T07:32:48.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.347+0000 7fb1df000640 1 -- 172.21.15.114:0/812908549 wait complete. 2024-09-16T07:32:48.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:32:37.860881+0000', 'modified': '2024-09-16T07:32:40.899353+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6600}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6600': {'gid': 6600, 'name': 'b', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6834/862990525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6800', 'nonce': 862990525}, {'type': 'v1', 'addr': '172.21.15.149:6834', 'nonce': 862990525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6600, 'qdb_cluster': [6600]} 2024-09-16T07:32:48.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:32:48.766 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T07:32:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.911+0000 7effb2a00640 1 -- 172.21.15.114:0/4178420836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff90004d50 msgr2=0x7eff900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.911+0000 7effb2a00640 1 --2- 172.21.15.114:0/4178420836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff90004d50 0x7eff900051d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7effa4001dc0 tx=0x7effa401cb30 comp rx=0 tx=0).stop 2024-09-16T07:32:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.911+0000 7effb0a00640 1 -- 172.21.15.114:0/4178420836 reap_dead start 2024-09-16T07:32:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.911+0000 7effb2a00640 1 -- 172.21.15.114:0/4178420836 shutdown_connections 2024-09-16T07:32:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.911+0000 7effb2a00640 1 -- 172.21.15.114:0/4178420836 >> 172.21.15.114:0/4178420836 conn(0x7effac0b18f0 msgr2=0x7effac0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.911+0000 7effb2a00640 1 -- 172.21.15.114:0/4178420836 shutdown_connections 2024-09-16T07:32:48.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.911+0000 7effb2a00640 1 -- 172.21.15.114:0/4178420836 wait complete. 2024-09-16T07:32:48.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 Processor -- start 2024-09-16T07:32:48.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 -- start start 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff90004d50 0x7effac1435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effac154dd0 0x7effac06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effac06eb30 0x7effac158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7effac0acd40 con 0x7effac154dd0 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7effac06fb30 con 0x7effac06eb30 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7effac0acec0 con 0x7eff90004d50 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effac154dd0 0x7effac06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effac154dd0 0x7effac06e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40690/0 (socket says 172.21.15.114:40690) 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 -- 172.21.15.114:0/1686642526 learned_addr learned my addr 172.21.15.114:0/1686642526 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb0a00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effac06eb30 0x7effac158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 -- 172.21.15.114:0/1686642526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff90004d50 msgr2=0x7effac1435b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff90004d50 0x7effac1435b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 -- 172.21.15.114:0/1686642526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effac06eb30 msgr2=0x7effac158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effac06eb30 0x7effac158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 -- 172.21.15.114:0/1686642526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac154010 con 0x7effac154dd0 2024-09-16T07:32:48.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effab400640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effac154dd0 0x7effac06e5f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7eff9800ea10 tx=0x7eff9800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effa3e00640 1 -- 172.21.15.114:0/1686642526 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9800cbc0 con 0x7effac154dd0 2024-09-16T07:32:48.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effa3e00640 1 -- 172.21.15.114:0/1686642526 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff98005020 con 0x7effac154dd0 2024-09-16T07:32:48.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac1542f0 con 0x7effac154dd0 2024-09-16T07:32:48.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effa3e00640 1 -- 172.21.15.114:0/1686642526 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98005470 con 0x7effac154dd0 2024-09-16T07:32:48.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.915+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac158f80 con 0x7effac154dd0 2024-09-16T07:32:48.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effa3e00640 1 -- 172.21.15.114:0/1686642526 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7eff980047b0 con 0x7effac154dd0 2024-09-16T07:32:48.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effa3e00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7eff8c072fe0 0x7eff8c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effa3e00640 1 -- 172.21.15.114:0/1686642526 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7eff980943d0 con 0x7effac154dd0 2024-09-16T07:32:48.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 Processor -- start 2024-09-16T07:32:48.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effabe00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7eff8c072fe0 0x7eff8c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 -- start start 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effabe00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7eff8c072fe0 0x7eff8c0754a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff9c001230 tx=0x7eff9c001500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 0x5576a08ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a08b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5576a07d43f0 con 0x5576a09002f0 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5576a0711b20 con 0x5576a08b3e10 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5576a0700f50 con 0x5576a08ff9d0 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40694/0 (socket says 172.21.15.114:40694) 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 -- 172.21.15.114:0/4010111804 learned_addr learned my addr 172.21.15.114:0/4010111804 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effabe00640 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 0x5576a08ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effb0a00640 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a08b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 -- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 msgr2=0x5576a08ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 0x5576a08ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 -- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 msgr2=0x5576a08b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a08b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.919+0000 7effab400640 1 -- 172.21.15.114:0/4010111804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576a06c8590 con 0x5576a09002f0 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effab400640 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08b38d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7eff9805c010 tx=0x7eff9805e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dde6798b14dfffd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effa0c00640 1 -- 172.21.15.114:0/4010111804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff980637d0 con 0x5576a09002f0 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effa0c00640 1 -- 172.21.15.114:0/4010111804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff98068680 con 0x5576a09002f0 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effa0c00640 1 -- 172.21.15.114:0/4010111804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98092850 con 0x5576a09002f0 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- 172.21.15.114:0/4010111804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 msgr2=0x5576a08b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08b38d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7eff9805c010 tx=0x7eff9805e8b0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- 172.21.15.114:0/4010111804 shutdown_connections 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a08b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08b38d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 --2- 172.21.15.114:0/4010111804 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 0x5576a08ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- 172.21.15.114:0/4010111804 >> 172.21.15.114:0/4010111804 conn(0x5576a079d130 msgr2=0x5576a08e2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- 172.21.15.114:0/4010111804 shutdown_connections 2024-09-16T07:32:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- 172.21.15.114:0/4010111804 wait complete. 2024-09-16T07:32:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- start start 2024-09-16T07:32:48.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 Processor -- start 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08b3e10 0x5576a08e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08ff9d0 0x5576a08e0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5576a069b5d0 con 0x5576a09002f0 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5576a0704d60 con 0x5576a08ff9d0 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5576a06a7500 con 0x5576a08b3e10 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb5db0000 10 client.0 _ll_register_callbacks cb 0x5576a06ab810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08e13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40696/0 (socket says 172.21.15.114:40696) 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 -- 172.21.15.114:0/2980422540 learned_addr learned my addr 172.21.15.114:0/2980422540 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:48.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effabe00640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08b3e10 0x5576a08e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effab400640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08ff9d0 0x5576a08e0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 -- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08b3e10 msgr2=0x5576a08e06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08b3e10 0x5576a08e06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 -- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08ff9d0 msgr2=0x5576a08e0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08ff9d0 0x5576a08e0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effb0a00640 1 -- 172.21.15.114:0/2980422540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576a069f170 con 0x5576a09002f0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effab400640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08ff9d0 0x5576a08e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.923+0000 7effabe00640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08b3e10 0x5576a08e06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb0a00640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08e13b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7effa4000f90 tx=0x7effa4019920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e012199308555578 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 1 -- 172.21.15.114:0/2980422540 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4006cb0 con 0x5576a09002f0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 1 -- 172.21.15.114:0/2980422540 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7effa4003980 con 0x5576a09002f0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5576a06990f0 con 0x5576a09002f0 2024-09-16T07:32:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 1 -- 172.21.15.114:0/2980422540 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7effa40c4050 con 0x5576a09002f0 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 10 client.6735 fetch_fsmap learned FSMap version 57 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x5576a0785ef0 con 0x5576a09002f0 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 1 -- 172.21.15.114:0/2980422540 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5576a06990f0 con 0x5576a09002f0 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 1 -- 172.21.15.114:0/2980422540 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 57) ==== 3502+0+0 (secure 0 0 0) 0x7effa40c7020 con 0x5576a09002f0 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 10 client.6735 fetch_fsmap finished waiting for FSMap version 57 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 10 client.6735 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 20 client.6735 populate_metadata read hostname 'smithi114' 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a08e20f0 0x5576a0911c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 4 client.6735 mds_command: new command op to 6600 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 --> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576a0713a70 con 0x5576a08e20f0 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effabe00640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a08e20f0 0x5576a0911c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effabe00640 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a08e20f0 0x5576a0911c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=248da1800a95d7cb server_cookie=61386344f51a6b44 in_seq=0 out_seq=0 2024-09-16T07:32:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 10 client.6735 ms_handle_connect on v2:172.21.15.149:6800/862990525 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 1 -- 172.21.15.114:0/2980422540 <== mds.0 v2:172.21.15.149:6800/862990525 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576a0713a70 con 0x5576a08e20f0 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 10 client.6735 handle_command_reply: tid=0 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 client.6735 shutdown 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 msgr2=0x5576a08e13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08e13b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7effa4000f90 tx=0x7effa4019920 comp rx=0 tx=0).stop 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 shutdown_connections 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a08e20f0 0x5576a0911c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a08e13b0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08ff9d0 0x5576a08e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 --2- 172.21.15.114:0/2980422540 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08b3e10 0x5576a08e06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7eff95600640 0 client.6735 ms_handle_reset on v2:172.21.15.149:6800/862990525 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 >> 172.21.15.114:0/2980422540 conn(0x5576a079d130 msgr2=0x5576a08b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 shutdown_connections 2024-09-16T07:32:48.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 1 -- 172.21.15.114:0/2980422540 wait complete. 2024-09-16T07:32:48.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.927+0000 7effb5db0000 20 client.6735 trim_cache size 0 max 16384 2024-09-16T07:32:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 Processor -- start 2024-09-16T07:32:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 -- start start 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a0971dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a08ff9d0 0x5576a0972310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a09002f0 0x5576a0972850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7effac1ff6e0 con 0x5576a08ff9d0 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7effac1fe780 con 0x5576a08b3e10 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7effac1f6780 con 0x5576a09002f0 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a08ff9d0 0x5576a0972310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a08ff9d0 0x5576a0972310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40702/0 (socket says 172.21.15.114:40702) 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 -- 172.21.15.114:0/601208404 learned_addr learned my addr 172.21.15.114:0/601208404 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effb0a00640 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a09002f0 0x5576a0972850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effabe00640 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a0971dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 -- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a09002f0 msgr2=0x5576a0972850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a09002f0 0x5576a0972850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 -- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 msgr2=0x5576a0971dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a0971dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 -- 172.21.15.114:0/601208404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576a075cd90 con 0x5576a08ff9d0 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effabe00640 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a0971dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7effab400640 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a08ff9d0 0x5576a0972310 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7eff9805c010 tx=0x7eff980046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d220b25b78bb876 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7eff97e00640 1 -- 172.21.15.114:0/601208404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff980637d0 con 0x5576a08ff9d0 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7eff97e00640 1 -- 172.21.15.114:0/601208404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff98068680 con 0x5576a08ff9d0 2024-09-16T07:32:48.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.947+0000 7eff97e00640 1 -- 172.21.15.114:0/601208404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9805b010 con 0x5576a08ff9d0 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- 172.21.15.114:0/601208404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a08ff9d0 msgr2=0x5576a0972310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a08ff9d0 0x5576a0972310 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7eff9805c010 tx=0x7eff980046d0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- 172.21.15.114:0/601208404 shutdown_connections 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a09002f0 0x5576a0972850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a08ff9d0 0x5576a0972310 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 --2- 172.21.15.114:0/601208404 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a0971dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- 172.21.15.114:0/601208404 >> 172.21.15.114:0/601208404 conn(0x5576a079d130 msgr2=0x5576a08bbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- 172.21.15.114:0/601208404 shutdown_connections 2024-09-16T07:32:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- 172.21.15.114:0/601208404 wait complete. 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- start start 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 Processor -- start 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a09759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 0x5576a0975f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a0976470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5576a07108f0 con 0x5576a09002f0 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5576a07c0730 con 0x5576a08b3e10 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5576a0785a60 con 0x5576a08ff9d0 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 10 client.0 _ll_register_callbacks cb 0x7eff98005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a0976470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a0976470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40708/0 (socket says 172.21.15.114:40708) 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 -- 172.21.15.114:0/2121525977 learned_addr learned my addr 172.21.15.114:0/2121525977 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 -- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 msgr2=0x5576a0975f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 0x5576a0975f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 -- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 msgr2=0x5576a09759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:32:48.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a09759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 -- 172.21.15.114:0/2121525977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576a06c7a90 con 0x5576a09002f0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb0a00640 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a0976470 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7effa4001dc0 tx=0x7effa4006d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66710aeb757cc00 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7eff95600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7eff95600640 1 -- 172.21.15.114:0/2121525977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa40019f0 con 0x5576a09002f0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7eff95600640 1 -- 172.21.15.114:0/2121525977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7effa4003bd0 con 0x5576a09002f0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff98068680 con 0x5576a09002f0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7eff95600640 1 -- 172.21.15.114:0/2121525977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7effa4003dd0 con 0x5576a09002f0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 10 client.6741 fetch_fsmap learned FSMap version 57 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) -- 0x5576a06a6050 con 0x5576a09002f0 2024-09-16T07:32:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7eff95600640 1 -- 172.21.15.114:0/2121525977 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff98068680 con 0x5576a09002f0 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.951+0000 7eff95600640 1 -- 172.21.15.114:0/2121525977 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 57) ==== 3502+0+0 (secure 0 0 0) 0x7effa40c7040 con 0x5576a09002f0 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 10 client.6741 fetch_fsmap finished waiting for FSMap version 57 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 10 client.6741 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 20 client.6741 populate_metadata read hostname 'smithi114' 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a09145a0 0x5576a0914980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 4 client.6741 mds_command: new command op to 6600 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 --> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] -- command(tid 0: {"prefix": "status"}) -- 0x5576a070f520 con 0x5576a09145a0 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effabe00640 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a09145a0 0x5576a0914980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effabe00640 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a09145a0 0x5576a0914980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53663f506df5daea server_cookie=2cb6a789e488bd0e in_seq=0 out_seq=0 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7eff95600640 10 client.6741 ms_handle_connect on v2:172.21.15.149:6800/862990525 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7eff95600640 1 -- 172.21.15.114:0/2121525977 <== mds.0 v2:172.21.15.149:6800/862990525 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x5576a070f520 con 0x5576a09145a0 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7eff95600640 10 client.6741 handle_command_reply: tid=0 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 client.6741 shutdown 2024-09-16T07:32:48.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 msgr2=0x5576a0976470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a0976470 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7effa4001dc0 tx=0x7effa4006d20 comp rx=0 tx=0).stop 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 shutdown_connections 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:6800/862990525,v1:172.21.15.149:6834/862990525] conn(0x5576a09145a0 0x5576a0914980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5576a09002f0 0x5576a0976470 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7eff95600640 0 client.6741 ms_handle_reset on v2:172.21.15.149:6800/862990525 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5576a08ff9d0 0x5576a0975f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 --2- 172.21.15.114:0/2121525977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5576a08b3e10 0x5576a09759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 >> 172.21.15.114:0/2121525977 conn(0x5576a079d130 msgr2=0x5576a08fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 shutdown_connections 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 1 -- 172.21.15.114:0/2121525977 wait complete. 2024-09-16T07:32:48.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb5db0000 20 client.6741 trim_cache size 0 max 16384 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6600, 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.469586564, 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 57, 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 81, 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 81, 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 14.98428307 2024-09-16T07:32:48.957 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:32:48.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7eff8c072fe0 msgr2=0x7eff8c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7eff8c072fe0 0x7eff8c0754a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff9c001230 tx=0x7eff9c001500 comp rx=0 tx=0).stop 2024-09-16T07:32:48.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effac154dd0 msgr2=0x7effac06e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effac154dd0 0x7effac06e5f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7eff9800ea10 tx=0x7eff9800eed0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 shutdown_connections 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7effac06eb30 0x7effac158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effac154dd0 0x7effac06e5f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7eff8c072fe0 0x7eff8c0754a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 --2- 172.21.15.114:0/1686642526 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7eff90004d50 0x7effac1435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 >> 172.21.15.114:0/1686642526 conn(0x7effac0b18f0 msgr2=0x7effac072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 shutdown_connections 2024-09-16T07:32:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:48.955+0000 7effb2a00640 1 -- 172.21.15.114:0/1686642526 wait complete. 2024-09-16T07:32:48.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:32:49.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 -- 172.21.15.114:0/1142796467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e815bea0 msgr2=0x7f16e80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:49.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 --2- 172.21.15.114:0/1142796467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e815bea0 0x7f16e80ce670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009900 tx=0x7f16d801c8e0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 -- 172.21.15.114:0/1142796467 shutdown_connections 2024-09-16T07:32:49.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 --2- 172.21.15.114:0/1142796467 >> v2:172.21.15.149:3300/0 conn(0x7f16e80cdb30 0x7f16e80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 --2- 172.21.15.114:0/1142796467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e815bea0 0x7f16e80ce670 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 -- 172.21.15.114:0/1142796467 >> 172.21.15.114:0/1142796467 conn(0x7f16e80d1dc0 msgr2=0x7f16e80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:49.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 -- 172.21.15.114:0/1142796467 shutdown_connections 2024-09-16T07:32:49.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.119+0000 7f16ede00640 1 -- 172.21.15.114:0/1142796467 wait complete. 2024-09-16T07:32:49.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 Processor -- start 2024-09-16T07:32:49.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 -- start start 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cdb30 0x7f16e80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16e80d28e0 0x7f16e8070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e815bea0 0x7f16e8070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f16e8168fc0 con 0x7f16e80d28e0 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16e8168e40 con 0x7f16e815bea0 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16e8169140 con 0x7f16e80cdb30 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16e80d28e0 0x7f16e8070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16e80d28e0 0x7f16e8070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40714/0 (socket says 172.21.15.114:40714) 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 -- 172.21.15.114:0/2351124019 learned_addr learned my addr 172.21.15.114:0/2351124019 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:49.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16e6a00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cdb30 0x7f16e80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16e7400640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e815bea0 0x7f16e8070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 -- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cdb30 msgr2=0x7f16e80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cdb30 0x7f16e80cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 -- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e815bea0 msgr2=0x7f16e8070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e815bea0 0x7f16e8070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 -- 172.21.15.114:0/2351124019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e80cc020 con 0x7f16e80d28e0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16dfe00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16e80d28e0 0x7f16e8070980 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f16d000ea40 tx=0x7f16d000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16df400640 1 -- 172.21.15.114:0/2351124019 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d000ce40 con 0x7f16e80d28e0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16df400640 1 -- 172.21.15.114:0/2351124019 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d0004020 con 0x7f16e80d28e0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16df400640 1 -- 172.21.15.114:0/2351124019 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0004470 con 0x7f16e80d28e0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e806e290 con 0x7f16e80d28e0 2024-09-16T07:32:49.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e806e850 con 0x7f16e80d28e0 2024-09-16T07:32:49.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.123+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e806e0a0 con 0x7f16e80d28e0 2024-09-16T07:32:49.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.127+0000 7f16df400640 1 -- 172.21.15.114:0/2351124019 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f16d0003600 con 0x7f16e80d28e0 2024-09-16T07:32:49.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.127+0000 7f16df400640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f16c4072fe0 0x7f16c40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:49.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.127+0000 7f16df400640 1 -- 172.21.15.114:0/2351124019 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f16d00948a0 con 0x7f16e80d28e0 2024-09-16T07:32:49.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.127+0000 7f16e6a00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f16c4072fe0 0x7f16c40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:49.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.127+0000 7f16e6a00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f16c4072fe0 0x7f16c40754a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16d80af000 tx=0x7f16d801b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:49.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.131+0000 7f16df400640 1 -- 172.21.15.114:0/2351124019 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f16d005f310 con 0x7f16e80d28e0 2024-09-16T07:32:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f16e80cc9d0 con 0x7f16e80d28e0 2024-09-16T07:32:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16df400640 1 -- 172.21.15.114:0/2351124019 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) ==== 53+0+73 (secure 0 0 0) 0x7f16d0063d40 con 0x7f16e80d28e0 2024-09-16T07:32:49.332 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:32:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f16c4072fe0 msgr2=0x7f16c40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f16c4072fe0 0x7f16c40754a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16d80af000 tx=0x7f16d801b120 comp rx=0 tx=0).stop 2024-09-16T07:32:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16e80d28e0 msgr2=0x7f16e8070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16e80d28e0 0x7f16e8070980 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f16d000ea40 tx=0x7f16d000ef00 comp rx=0 tx=0).stop 2024-09-16T07:32:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 shutdown_connections 2024-09-16T07:32:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16e815bea0 0x7f16e8070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16e80d28e0 0x7f16e8070980 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f16c4072fe0 0x7f16c40754a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 --2- 172.21.15.114:0/2351124019 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16e80cdb30 0x7f16e80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:49.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 >> 172.21.15.114:0/2351124019 conn(0x7f16e80d1dc0 msgr2=0x7f16e8158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:49.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 shutdown_connections 2024-09-16T07:32:49.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49.335+0000 7f16ede00640 1 -- 172.21.15.114:0/2351124019 wait complete. 2024-09-16T07:32:49.353 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:32:49.354 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:32:49.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:49.355 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:49.364 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:49.365 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42172sec preferred_lft 42172sec 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:49.366 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:32:49.367 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:49.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:49.368 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:32:49.424 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:32:49.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:49.427 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:32:49.478 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:49.479 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:32:49.480 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:32:49.480 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:32:49.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:32:49.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:32:49.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:32:49.480 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:32:49.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:32:49.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:49.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:49.617 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:32:49.626 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:32:49.627 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:32:49.627 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:32:49.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:49.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:32:49.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:49.686 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:49.735 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:32:49.735 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:49.735 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:49.786 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:32:49.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:49.786 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:49.875 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:49.875 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:32:49.875 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:32:49.890 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:49.891 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:32:49.891 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:32:49.891 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:49.891 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:49.900 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:32:49.900 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:32:49.900 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:32:49.900 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:49.901 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:49.901 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:32:49.901 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:32:49.901 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:32:49.905 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:32:49.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:49.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:32:49.970 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:32:50.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:32:50.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:50.075 INFO:teuthology.orchestra.run.smithi114.stdout:client6747 2024-09-16T07:32:50.075 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:32:50.075 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:50.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:32:50.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 -- 172.21.15.114:0/2310474763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 msgr2=0x7fce80004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:50.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 --2- 172.21.15.114:0/2310474763 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 0x7fce80004810 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c310 tx=0x7fce8801cfc0 comp rx=0 tx=0).stop 2024-09-16T07:32:50.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea1800640 1 -- 172.21.15.114:0/2310474763 reap_dead start 2024-09-16T07:32:50.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 -- 172.21.15.114:0/2310474763 shutdown_connections 2024-09-16T07:32:50.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 -- 172.21.15.114:0/2310474763 >> 172.21.15.114:0/2310474763 conn(0x7fce9c09aa10 msgr2=0x7fce9c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:50.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 -- 172.21.15.114:0/2310474763 shutdown_connections 2024-09-16T07:32:50.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 -- 172.21.15.114:0/2310474763 wait complete. 2024-09-16T07:32:50.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 Processor -- start 2024-09-16T07:32:50.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.271+0000 7fcea2200640 1 -- start start 2024-09-16T07:32:50.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 0x7fce9c162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce9c0b7470 0x7fce9c14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce9c0c9160 0x7fce9c0c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c166d30 con 0x7fce80003fe0 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c166bb0 con 0x7fce9c0c9160 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c166eb0 con 0x7fce9c0b7470 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 0x7fce9c162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 0x7fce9c162870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40728/0 (socket says 172.21.15.114:40728) 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 -- 172.21.15.114:0/3850269707 learned_addr learned my addr 172.21.15.114:0/3850269707 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fce9be00640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce9c0b7470 0x7fce9c14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea1800640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce9c0c9160 0x7fce9c0c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 -- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce9c0b7470 msgr2=0x7fce9c14ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce9c0b7470 0x7fce9c14ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 -- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce9c0c9160 msgr2=0x7fce9c0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:50.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce9c0c9160 0x7fce9c0c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:50.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 -- 172.21.15.114:0/3850269707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c0b78f0 con 0x7fce80003fe0 2024-09-16T07:32:50.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea0e00640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 0x7fce9c162870 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fce8c011d10 tx=0x7fce8c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:50.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fce98c00640 1 -- 172.21.15.114:0/3850269707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c003b90 con 0x7fce80003fe0 2024-09-16T07:32:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fce98c00640 1 -- 172.21.15.114:0/3850269707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce8c003d30 con 0x7fce80003fe0 2024-09-16T07:32:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fce98c00640 1 -- 172.21.15.114:0/3850269707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c004290 con 0x7fce80003fe0 2024-09-16T07:32:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c162f30 con 0x7fce80003fe0 2024-09-16T07:32:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c1634f0 con 0x7fce80003fe0 2024-09-16T07:32:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.275+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c0b29e0 con 0x7fce80003fe0 2024-09-16T07:32:50.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.279+0000 7fce98c00640 1 -- 172.21.15.114:0/3850269707 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fce8c004430 con 0x7fce80003fe0 2024-09-16T07:32:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.279+0000 7fce98c00640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce7c073010 0x7fce7c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.279+0000 7fce98c00640 1 -- 172.21.15.114:0/3850269707 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fce8c095230 con 0x7fce80003fe0 2024-09-16T07:32:50.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.279+0000 7fce9be00640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce7c073010 0x7fce7c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:50.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.279+0000 7fce9be00640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce7c073010 0x7fce7c0754d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce880ac000 tx=0x7fce88005040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:50.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.283+0000 7fce98c00640 1 -- 172.21.15.114:0/3850269707 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fce8c05fc10 con 0x7fce80003fe0 2024-09-16T07:32:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.487+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fce9c076210 con 0x7fce80003fe0 2024-09-16T07:32:50.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.487+0000 7fce98c00640 1 -- 172.21.15.114:0/3850269707 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) ==== 53+0+73 (secure 0 0 0) 0x7fce8c064640 con 0x7fce80003fe0 2024-09-16T07:32:50.487 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:32:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce7c073010 msgr2=0x7fce7c0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce7c073010 0x7fce7c0754d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce880ac000 tx=0x7fce88005040 comp rx=0 tx=0).stop 2024-09-16T07:32:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 msgr2=0x7fce9c162870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 0x7fce9c162870 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fce8c011d10 tx=0x7fce8c00f790 comp rx=0 tx=0).stop 2024-09-16T07:32:50.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 shutdown_connections 2024-09-16T07:32:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce9c0c9160 0x7fce9c0c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce7c073010 0x7fce7c0754d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce9c0b7470 0x7fce9c14ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 --2- 172.21.15.114:0/3850269707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce80003fe0 0x7fce9c162870 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 >> 172.21.15.114:0/3850269707 conn(0x7fce9c09aa10 msgr2=0x7fce9c15e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 shutdown_connections 2024-09-16T07:32:50.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:50.491+0000 7fcea2200640 1 -- 172.21.15.114:0/3850269707 wait complete. 2024-09-16T07:32:50.507 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:32:50.507 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:32:50.507 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:32:50.507 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:32:50.507 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:50.508 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:32:50.508 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:32:50.508 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:32:50.508 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:32:50.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:50.508 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:32:50.517 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:32:50.517 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:32:50.517 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:32:50.517 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.517 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:32:50.517 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.517 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42179sec preferred_lft 42179sec 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.518 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.519 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:32:50.520 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:32:50.520 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:32:50.520 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:32:50.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:50.521 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:32:50.585 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:32:50.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:50.587 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:32:50.642 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:32:50.643 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:32:50.643 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:32:50.643 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:32:50.643 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:32:50.643 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:32:50.643 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:32:50.643 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:50.644 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:50.644 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:32:50.644 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:32:50.644 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:32:50.644 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:32:50.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:32:50.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:32:50.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:32:50.644 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:32:50.729 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:32:50.770 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:50.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:50.777 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:32:50.786 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:32:50.786 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:32:50.787 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:32:50.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:50.787 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:32:50.851 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:50.851 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:50.903 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:32:50.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:32:50.903 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:50.959 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:32:50.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:50.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:51.054 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:51.054 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:32:51.055 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:32:51.069 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:51.069 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:32:51.070 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:32:51.070 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:51.070 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:32:51.081 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:32:51.084 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:32:51.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:32:51.085 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:32:51.145 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:32:51.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:32:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:32:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:32:51.246 INFO:teuthology.orchestra.run.smithi149.stdout:client6756 2024-09-16T07:32:51.247 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:32:51.247 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:32:51.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 -- 172.21.15.114:0/3576240956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c15be10 msgr2=0x7fb95c0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 --2- 172.21.15.114:0/3576240956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c15be10 0x7fb95c0ce700 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0746b0 tx=0x7fb94c01f370 comp rx=0 tx=0).stop 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 -- 172.21.15.114:0/3576240956 shutdown_connections 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 --2- 172.21.15.114:0/3576240956 >> v2:172.21.15.149:3300/0 conn(0x7fb95c15c1f0 0x7fb95c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 --2- 172.21.15.114:0/3576240956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c15be10 0x7fb95c0ce700 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 -- 172.21.15.114:0/3576240956 >> 172.21.15.114:0/3576240956 conn(0x7fb95c0d1da0 msgr2=0x7fb95c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 -- 172.21.15.114:0/3576240956 shutdown_connections 2024-09-16T07:32:51.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.403+0000 7fb963200640 1 -- 172.21.15.114:0/3576240956 wait complete. 2024-09-16T07:32:51.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 Processor -- start 2024-09-16T07:32:51.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 -- start start 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c0b0b60 0x7fb95c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb95c15be10 0x7fb95c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c15c1f0 0x7fb95c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c0cf510 con 0x7fb95c0b0b60 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c0cf390 con 0x7fb95c15c1f0 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c160290 con 0x7fb95c15be10 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c0b0b60 0x7fb95c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:51.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c0b0b60 0x7fb95c15ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40746/0 (socket says 172.21.15.114:40746) 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 -- 172.21.15.114:0/2547424831 learned_addr learned my addr 172.21.15.114:0/2547424831 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb953400640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb95c15be10 0x7fb95c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb961200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c15c1f0 0x7fb95c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 -- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb95c15be10 msgr2=0x7fb95c150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb95c15be10 0x7fb95c150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 -- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c15c1f0 msgr2=0x7fb95c1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c15c1f0 0x7fb95c1513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 -- 172.21.15.114:0/2547424831 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c071db0 con 0x7fb95c0b0b60 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb961200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c15c1f0 0x7fb95c1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:51.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb95be00640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c0b0b60 0x7fb95c15ab60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009b10 tx=0x7fb94c0af480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:51.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb958c00640 1 -- 172.21.15.114:0/2547424831 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0b4040 con 0x7fb95c0b0b60 2024-09-16T07:32:51.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb958c00640 1 -- 172.21.15.114:0/2547424831 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb94c0c1070 con 0x7fb95c0b0b60 2024-09-16T07:32:51.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c06a3a0 con 0x7fb95c0b0b60 2024-09-16T07:32:51.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb958c00640 1 -- 172.21.15.114:0/2547424831 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c004000 con 0x7fb95c0b0b60 2024-09-16T07:32:51.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.407+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c0cd320 con 0x7fb95c0b0b60 2024-09-16T07:32:51.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.411+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95c1607b0 con 0x7fb95c0b0b60 2024-09-16T07:32:51.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.411+0000 7fb958c00640 1 -- 172.21.15.114:0/2547424831 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fb94c0041a0 con 0x7fb95c0b0b60 2024-09-16T07:32:51.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.411+0000 7fb958c00640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb938072fe0 0x7fb9380754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:51.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.411+0000 7fb958c00640 1 -- 172.21.15.114:0/2547424831 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb94c133600 con 0x7fb95c0b0b60 2024-09-16T07:32:51.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.411+0000 7fb953400640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb938072fe0 0x7fb9380754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:51.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.411+0000 7fb953400640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb938072fe0 0x7fb9380754a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb95c158e90 tx=0x7fb94400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:51.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.415+0000 7fb958c00640 1 -- 172.21.15.114:0/2547424831 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb94c018ed0 con 0x7fb95c0b0b60 2024-09-16T07:32:51.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:51.619+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb95c0b65c0 con 0x7fb95c0b0b60 2024-09-16T07:32:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.551+0000 7fb958c00640 1 -- 172.21.15.114:0/2547424831 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v58) ==== 136+0+0 (secure 0 0 0) 0x7fb94c0fe740 con 0x7fb95c0b0b60 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb938072fe0 msgr2=0x7fb9380754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb938072fe0 0x7fb9380754a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb95c158e90 tx=0x7fb94400b2e0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c0b0b60 msgr2=0x7fb95c15ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c0b0b60 0x7fb95c15ab60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009b10 tx=0x7fb94c0af480 comp rx=0 tx=0).stop 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 shutdown_connections 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb95c15c1f0 0x7fb95c1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb938072fe0 0x7fb9380754a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb95c15be10 0x7fb95c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 --2- 172.21.15.114:0/2547424831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb95c0b0b60 0x7fb95c15ab60 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 >> 172.21.15.114:0/2547424831 conn(0x7fb95c0d1da0 msgr2=0x7fb95c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 shutdown_connections 2024-09-16T07:32:52.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.555+0000 7fb963200640 1 -- 172.21.15.114:0/2547424831 wait complete. 2024-09-16T07:32:52.575 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:32:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 -- 172.21.15.114:0/3563786172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80cdb30 msgr2=0x7f7be80cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 --2- 172.21.15.114:0/3563786172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80cdb30 0x7f7be80cebb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7be80745d0 tx=0x7f7bd001c770 comp rx=0 tx=0).stop 2024-09-16T07:32:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 -- 172.21.15.114:0/3563786172 shutdown_connections 2024-09-16T07:32:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 --2- 172.21.15.114:0/3563786172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80cdb30 0x7f7be80cebb0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 --2- 172.21.15.114:0/3563786172 >> v2:172.21.15.149:3300/0 conn(0x7f7be815bea0 0x7f7be80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 -- 172.21.15.114:0/3563786172 >> 172.21.15.114:0/3563786172 conn(0x7f7be80d1dc0 msgr2=0x7f7be80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 -- 172.21.15.114:0/3563786172 shutdown_connections 2024-09-16T07:32:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.719+0000 7f7befc00640 1 -- 172.21.15.114:0/3563786172 wait complete. 2024-09-16T07:32:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 Processor -- start 2024-09-16T07:32:52.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 -- start start 2024-09-16T07:32:52.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7be80cdb30 0x7f7be815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80d28e0 0x7f7be8148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7be815bea0 0x7f7be80c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8168f10 con 0x7f7be80d28e0 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8168d90 con 0x7f7be80cdb30 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7be8169090 con 0x7f7be815bea0 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80d28e0 0x7f7be8148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80d28e0 0x7f7be8148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40768/0 (socket says 172.21.15.114:40768) 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 -- 172.21.15.114:0/1371337861 learned_addr learned my addr 172.21.15.114:0/1371337861 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bed200640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7be80cdb30 0x7f7be815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bedc00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7be815bea0 0x7f7be80c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 -- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7be815bea0 msgr2=0x7f7be80c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7be815bea0 0x7f7be80c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 -- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7be80cdb30 msgr2=0x7f7be815e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7be80cdb30 0x7f7be815e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 -- 172.21.15.114:0/1371337861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80ceda0 con 0x7f7be80d28e0 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bed200640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7be80cdb30 0x7f7be815e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7bdfe00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80d28e0 0x7f7be8148080 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0098260 tx=0x7f7bd0005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7be5600640 1 -- 172.21.15.114:0/1371337861 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00bb070 con 0x7f7be80d28e0 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7be5600640 1 -- 172.21.15.114:0/1371337861 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bd0004330 con 0x7f7be80d28e0 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7be5600640 1 -- 172.21.15.114:0/1371337861 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00b2040 con 0x7f7be80d28e0 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be815eda0 con 0x7f7be80d28e0 2024-09-16T07:32:52.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be80cb540 con 0x7f7be80d28e0 2024-09-16T07:32:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.723+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be80cc9d0 con 0x7f7be80d28e0 2024-09-16T07:32:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.727+0000 7f7be5600640 1 -- 172.21.15.114:0/1371337861 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f7bd00be070 con 0x7f7be80d28e0 2024-09-16T07:32:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.727+0000 7f7be5600640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7bc4072fe0 0x7f7bc40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.727+0000 7f7be5600640 1 -- 172.21.15.114:0/1371337861 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f7bd012db00 con 0x7f7be80d28e0 2024-09-16T07:32:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.727+0000 7f7bed200640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7bc4072fe0 0x7f7bc40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:52.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.727+0000 7f7bed200640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7bc4072fe0 0x7f7bc40754a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8005fd0 tx=0x7f7bd8005f20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.731+0000 7f7be5600640 1 -- 172.21.15.114:0/1371337861 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7bd00163f0 con 0x7f7be80d28e0 2024-09-16T07:32:52.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7be80762f0 con 0x7f7bc4072fe0 2024-09-16T07:32:52.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7be5600640 1 -- 172.21.15.114:0/1371337861 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7be80762f0 con 0x7f7bc4072fe0 2024-09-16T07:32:52.917 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:32:52.917 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:32:52.917 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:32:52.917 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:32:52.917 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:32:52.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7bc4072fe0 msgr2=0x7f7bc40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:52.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7bc4072fe0 0x7f7bc40754a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8005fd0 tx=0x7f7bd8005f20 comp rx=0 tx=0).stop 2024-09-16T07:32:52.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80d28e0 msgr2=0x7f7be8148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:52.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80d28e0 0x7f7be8148080 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0098260 tx=0x7f7bd0005db0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 shutdown_connections 2024-09-16T07:32:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7bc4072fe0 0x7f7bc40754a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7be815bea0 0x7f7be80c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7be80d28e0 0x7f7be8148080 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 --2- 172.21.15.114:0/1371337861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7be80cdb30 0x7f7be815e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 >> 172.21.15.114:0/1371337861 conn(0x7f7be80d1dc0 msgr2=0x7f7be80b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 shutdown_connections 2024-09-16T07:32:52.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:52.919+0000 7f7befc00640 1 -- 172.21.15.114:0/1371337861 wait complete. 2024-09-16T07:32:52.939 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:32:53.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- 172.21.15.114:0/2952117357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 msgr2=0x7f4750004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 --2- 172.21.15.114:0/2952117357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f4750004c90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f475800c2e0 tx=0x7f475801f6e0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- 172.21.15.114:0/2952117357 shutdown_connections 2024-09-16T07:32:53.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 --2- 172.21.15.114:0/2952117357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f4750004c90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- 172.21.15.114:0/2952117357 >> 172.21.15.114:0/2952117357 conn(0x7f476c0d1dd0 msgr2=0x7f476c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:53.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- 172.21.15.114:0/2952117357 shutdown_connections 2024-09-16T07:32:53.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- 172.21.15.114:0/2952117357 wait complete. 2024-09-16T07:32:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 Processor -- start 2024-09-16T07:32:53.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- start start 2024-09-16T07:32:53.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f476c06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f476c0b6a20 0x7f476c06f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f476c1f88a0 0x7f476c1f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f476c0b0e50 con 0x7f4750004810 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f476c0b0cd0 con 0x7f476c1f88a0 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4771000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f476c0b1220 con 0x7f476c0b6a20 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f476c06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f476c06edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40788/0 (socket says 172.21.15.114:40788) 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 -- 172.21.15.114:0/820073301 learned_addr learned my addr 172.21.15.114:0/820073301 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769400640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f476c0b6a20 0x7f476c06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f476a800640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f476c1f88a0 0x7f476c1f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 -- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f476c0b6a20 msgr2=0x7f476c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f476c0b6a20 0x7f476c06f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 -- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f476c1f88a0 msgr2=0x7f476c1f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f476c1f88a0 0x7f476c1f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 -- 172.21.15.114:0/820073301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c1f9290 con 0x7f4750004810 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4769e00640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f476c06edf0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f475c011b60 tx=0x7f475c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.087+0000 7f4762000640 1 -- 172.21.15.114:0/820073301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c01e070 con 0x7f4750004810 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4762000640 1 -- 172.21.15.114:0/820073301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f475c00e7c0 con 0x7f4750004810 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4762000640 1 -- 172.21.15.114:0/820073301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c00ebb0 con 0x7f4750004810 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c1f60f0 con 0x7f4750004810 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c1f66b0 con 0x7f4750004810 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c0d06e0 con 0x7f4750004810 2024-09-16T07:32:53.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4762000640 1 -- 172.21.15.114:0/820073301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f475c021070 con 0x7f4750004810 2024-09-16T07:32:53.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4762000640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f474c073010 0x7f474c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4762000640 1 -- 172.21.15.114:0/820073301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f475c095060 con 0x7f4750004810 2024-09-16T07:32:53.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.091+0000 7f4769400640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f474c073010 0x7f474c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.095+0000 7f4769400640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f474c073010 0x7f474c0754d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47580b0000 tx=0x7f475801c520 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:53.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.095+0000 7f4762000640 1 -- 172.21.15.114:0/820073301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f475c05fa30 con 0x7f4750004810 2024-09-16T07:32:53.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f476c0d1080 con 0x7f4750004810 2024-09-16T07:32:53.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4762000640 1 -- 172.21.15.114:0/820073301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f475c064460 con 0x7f4750004810 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f474c073010 msgr2=0x7f474c0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f474c073010 0x7f474c0754d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47580b0000 tx=0x7f475801c520 comp rx=0 tx=0).stop 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 msgr2=0x7f476c06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f476c06edf0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f475c011b60 tx=0x7f475c00f790 comp rx=0 tx=0).stop 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 shutdown_connections 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f476c1f88a0 0x7f476c1f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f474c073010 0x7f474c0754d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f476c0b6a20 0x7f476c06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 --2- 172.21.15.114:0/820073301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4750004810 0x7f476c06edf0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 >> 172.21.15.114:0/820073301 conn(0x7f476c0d1dd0 msgr2=0x7f476c070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:53.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 shutdown_connections 2024-09-16T07:32:53.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.263+0000 7f4771000640 1 -- 172.21.15.114:0/820073301 wait complete. 2024-09-16T07:32:53.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create 'abcd@#' 2024-09-16T07:32:53.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 -- 172.21.15.114:0/188433537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb474155180 msgr2=0x7fb4740c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 --2- 172.21.15.114:0/188433537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb474155180 0x7fb4740c58b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb47415c010 tx=0x7fb46401cce0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 -- 172.21.15.114:0/188433537 shutdown_connections 2024-09-16T07:32:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 --2- 172.21.15.114:0/188433537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb474155180 0x7fb4740c58b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 -- 172.21.15.114:0/188433537 >> 172.21.15.114:0/188433537 conn(0x7fb474071420 msgr2=0x7fb47406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 -- 172.21.15.114:0/188433537 shutdown_connections 2024-09-16T07:32:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 -- 172.21.15.114:0/188433537 wait complete. 2024-09-16T07:32:53.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 Processor -- start 2024-09-16T07:32:53.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.431+0000 7fb47ae00640 1 -- start start 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb474070ae0 0x7fb474146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4740cfe60 0x7fb4741f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb474155180 0x7fb47414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb474168c90 con 0x7fb474070ae0 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb474168b10 con 0x7fb4740cfe60 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb474168e10 con 0x7fb474155180 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb474070ae0 0x7fb474146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb474070ae0 0x7fb474146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40810/0 (socket says 172.21.15.114:40810) 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 -- 172.21.15.114:0/1319339932 learned_addr learned my addr 172.21.15.114:0/1319339932 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 -- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb474155180 msgr2=0x7fb47414b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb46b400640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4740cfe60 0x7fb4741f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb478e00640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb474155180 0x7fb47414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb474155180 0x7fb47414b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 -- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4740cfe60 msgr2=0x7fb4741f9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4740cfe60 0x7fb4741f9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 -- 172.21.15.114:0/1319339932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4741f99c0 con 0x7fb474070ae0 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb46b400640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4740cfe60 0x7fb4741f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb478e00640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb474155180 0x7fb47414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb473e00640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb474070ae0 0x7fb474146320 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb464000f90 tx=0x7fb4640a5bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb470c00640 1 -- 172.21.15.114:0/1319339932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4640bb070 con 0x7fb474070ae0 2024-09-16T07:32:53.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb470c00640 1 -- 172.21.15.114:0/1319339932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb464004e00 con 0x7fb474070ae0 2024-09-16T07:32:53.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb470c00640 1 -- 172.21.15.114:0/1319339932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4640b2040 con 0x7fb474070ae0 2024-09-16T07:32:53.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 -- 172.21.15.114:0/1319339932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb47414c8c0 con 0x7fb474070ae0 2024-09-16T07:32:53.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 -- 172.21.15.114:0/1319339932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb47414ce80 con 0x7fb474070ae0 2024-09-16T07:32:53.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.435+0000 7fb47ae00640 1 -- 172.21.15.114:0/1319339932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb47415ac40 con 0x7fb474070ae0 2024-09-16T07:32:53.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.439+0000 7fb470c00640 1 -- 172.21.15.114:0/1319339932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fb4640be070 con 0x7fb474070ae0 2024-09-16T07:32:53.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.439+0000 7fb470c00640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb450072fe0 0x7fb4500754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.439+0000 7fb470c00640 1 -- 172.21.15.114:0/1319339932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb46412dfe0 con 0x7fb474070ae0 2024-09-16T07:32:53.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.439+0000 7fb46b400640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb450072fe0 0x7fb4500754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.439+0000 7fb46b400640 1 --2- 172.21.15.114:0/1319339932 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb450072fe0 0x7fb4500754a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb47414e020 tx=0x7fb45c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:53.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.443+0000 7fb470c00640 1 -- 172.21.15.114:0/1319339932 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb464016990 con 0x7fb474070ae0 2024-09-16T07:32:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-16T07:32:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:fs volume create [] : Create a CephFS volume 2024-09-16T07:32:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:Error EINVAL: invalid command 2024-09-16T07:32:53.644 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:32:53.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create testvol 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.787+0000 7fd63a800640 1 -- 172.21.15.114:0/206038235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd63415bc80 msgr2=0x7fd6340cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.787+0000 7fd63a800640 1 --2- 172.21.15.114:0/206038235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd63415bc80 0x7fd6340cf9d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd6340c5860 tx=0x7fd62401c800 comp rx=0 tx=0).stop 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- 172.21.15.114:0/206038235 shutdown_connections 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 --2- 172.21.15.114:0/206038235 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340d1f80 0x7fd63415c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 --2- 172.21.15.114:0/206038235 >> v2:172.21.15.149:3300/0 conn(0x7fd63415c060 0x7fd6340d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 --2- 172.21.15.114:0/206038235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd63415bc80 0x7fd6340cf9d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- 172.21.15.114:0/206038235 >> 172.21.15.114:0/206038235 conn(0x7fd63409aa10 msgr2=0x7fd63409adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- 172.21.15.114:0/206038235 shutdown_connections 2024-09-16T07:32:53.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- 172.21.15.114:0/206038235 wait complete. 2024-09-16T07:32:53.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 Processor -- start 2024-09-16T07:32:53.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- start start 2024-09-16T07:32:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340d1f80 0x7fd6341521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63415bc80 0x7fd6341f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415c060 0x7fd63415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6340cedf0 con 0x7fd6340d1f80 2024-09-16T07:32:53.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd6340cec70 con 0x7fd63415c060 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd6340cef70 con 0x7fd63415bc80 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340d1f80 0x7fd6341521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340d1f80 0x7fd6341521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40826/0 (socket says 172.21.15.114:40826) 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 -- 172.21.15.114:0/2975591462 learned_addr learned my addr 172.21.15.114:0/2975591462 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633e00640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415c060 0x7fd63415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd62aa00640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63415bc80 0x7fd6341f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 -- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63415bc80 msgr2=0x7fd6341f94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63415bc80 0x7fd6341f94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 -- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415c060 msgr2=0x7fd63415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415c060 0x7fd63415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 -- 172.21.15.114:0/2975591462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6341f99e0 con 0x7fd6340d1f80 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd633400640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340d1f80 0x7fd6341521a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b0040 tx=0x7fd6240a57b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd62be00640 1 -- 172.21.15.114:0/2975591462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240b2040 con 0x7fd6340d1f80 2024-09-16T07:32:53.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd62be00640 1 -- 172.21.15.114:0/2975591462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd624004400 con 0x7fd6340d1f80 2024-09-16T07:32:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.791+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd634144b40 con 0x7fd6340d1f80 2024-09-16T07:32:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd62be00640 1 -- 172.21.15.114:0/2975591462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624005290 con 0x7fd6340d1f80 2024-09-16T07:32:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd634158020 con 0x7fd6340d1f80 2024-09-16T07:32:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6340cf420 con 0x7fd6340d1f80 2024-09-16T07:32:53.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd62be00640 1 -- 172.21.15.114:0/2975591462 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fd624005430 con 0x7fd6340d1f80 2024-09-16T07:32:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd62be00640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd610073010 0x7fd6100754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd62be00640 1 -- 172.21.15.114:0/2975591462 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fd62412dbe0 con 0x7fd6340d1f80 2024-09-16T07:32:53.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd62aa00640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd610073010 0x7fd6100754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.795+0000 7fd62aa00640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd610073010 0x7fd6100754d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0058d0 tx=0x7fd61c005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.799+0000 7fd62be00640 1 -- 172.21.15.114:0/2975591462 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd6341f99e0 con 0x7fd6340d1f80 2024-09-16T07:32:53.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:53.991+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "testvol", "target": ["mon-mgr", ""]}) -- 0x7fd634070cb0 con 0x7fd610073010 2024-09-16T07:32:56.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.587+0000 7fd62be00640 1 -- 172.21.15.114:0/2975591462 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) ==== 60+0+0 (secure 0 0 0) 0x7fd634070cb0 con 0x7fd610073010 2024-09-16T07:32:56.587 INFO:teuthology.orchestra.run.smithi114.stderr:Volume created successfully (no MDS daemons created) 2024-09-16T07:32:56.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.591+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd610073010 msgr2=0x7fd6100754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:56.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.591+0000 7fd63a800640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd610073010 0x7fd6100754d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0058d0 tx=0x7fd61c005860 comp rx=0 tx=0).stop 2024-09-16T07:32:56.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.591+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340d1f80 msgr2=0x7fd6341521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:56.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.591+0000 7fd63a800640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340d1f80 0x7fd6341521a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b0040 tx=0x7fd6240a57b0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 shutdown_connections 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415c060 0x7fd63415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd610073010 0x7fd6100754d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd63415bc80 0x7fd6341f94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 --2- 172.21.15.114:0/2975591462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340d1f80 0x7fd6341521a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 >> 172.21.15.114:0/2975591462 conn(0x7fd63409aa10 msgr2=0x7fd63415ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 shutdown_connections 2024-09-16T07:32:56.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.595+0000 7fd63a800640 1 -- 172.21.15.114:0/2975591462 wait complete. 2024-09-16T07:32:56.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create testvol 'abcd@#' 2024-09-16T07:32:56.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.771+0000 7febcb400640 1 -- 172.21.15.114:0/3304131962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc415f9a0 msgr2=0x7febc406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:56.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.771+0000 7febcb400640 1 --2- 172.21.15.114:0/3304131962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc415f9a0 0x7febc406e7a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7febb4009900 tx=0x7febb401c8b0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- 172.21.15.114:0/3304131962 shutdown_connections 2024-09-16T07:32:56.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 --2- 172.21.15.114:0/3304131962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc415f9a0 0x7febc406e7a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- 172.21.15.114:0/3304131962 >> 172.21.15.114:0/3304131962 conn(0x7febc40b18f0 msgr2=0x7febc40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:56.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- 172.21.15.114:0/3304131962 shutdown_connections 2024-09-16T07:32:56.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- 172.21.15.114:0/3304131962 wait complete. 2024-09-16T07:32:56.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 Processor -- start 2024-09-16T07:32:56.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- start start 2024-09-16T07:32:56.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40cf1d0 0x7febc40b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:56.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415f9a0 0x7febc4146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:56.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc4160490 0x7febc409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:56.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7febc416a7c0 con 0x7febc40cf1d0 2024-09-16T07:32:56.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7febc4159dd0 con 0x7febc415f9a0 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7febc416a940 con 0x7febc4160490 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40cf1d0 0x7febc40b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40cf1d0 0x7febc40b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45928/0 (socket says 172.21.15.114:45928) 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 -- 172.21.15.114:0/832874597 learned_addr learned my addr 172.21.15.114:0/832874597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc3e00640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415f9a0 0x7febc4146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc9400640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc4160490 0x7febc409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 -- 172.21.15.114:0/832874597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc4160490 msgr2=0x7febc409aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc4160490 0x7febc409aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 -- 172.21.15.114:0/832874597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415f9a0 msgr2=0x7febc4146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415f9a0 0x7febc4146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 -- 172.21.15.114:0/832874597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc40744c0 con 0x7febc40cf1d0 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc8a00640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40cf1d0 0x7febc40b47c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7febb401a4e0 tx=0x7febb40a5880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:56.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc0c00640 1 -- 172.21.15.114:0/832874597 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb40b2040 con 0x7febc40cf1d0 2024-09-16T07:32:56.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc0c00640 1 -- 172.21.15.114:0/832874597 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febb4005320 con 0x7febc40cf1d0 2024-09-16T07:32:56.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febcb400640 1 -- 172.21.15.114:0/832874597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc40747a0 con 0x7febc40cf1d0 2024-09-16T07:32:56.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.775+0000 7febc0c00640 1 -- 172.21.15.114:0/832874597 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4003700 con 0x7febc40cf1d0 2024-09-16T07:32:56.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.779+0000 7febcb400640 1 -- 172.21.15.114:0/832874597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc415f5b0 con 0x7febc40cf1d0 2024-09-16T07:32:56.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.779+0000 7febcb400640 1 -- 172.21.15.114:0/832874597 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc4069410 con 0x7febc40cf1d0 2024-09-16T07:32:56.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.779+0000 7febc0c00640 1 -- 172.21.15.114:0/832874597 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7febb40038c0 con 0x7febc40cf1d0 2024-09-16T07:32:56.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.779+0000 7febc0c00640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073010 0x7feba40754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:56.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.779+0000 7febc0c00640 1 -- 172.21.15.114:0/832874597 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6543+0+0 (secure 0 0 0) 0x7febb412e720 con 0x7febc40cf1d0 2024-09-16T07:32:56.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.779+0000 7febc3e00640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073010 0x7feba40754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:56.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.779+0000 7febc3e00640 1 --2- 172.21.15.114:0/832874597 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073010 0x7feba40754d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febc40d0770 tx=0x7febb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:56.783+0000 7febc0c00640 1 -- 172.21.15.114:0/832874597 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7febb40164d0 con 0x7febc40cf1d0 2024-09-16T07:32:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-16T07:32:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:fs subvolumegroup create [] [] [] [] [] : Create a CephFS subvolume group in a volume, and optionally, with a specific data pool layout, and a specific numeric mode 2024-09-16T07:32:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:Error EINVAL: invalid command 2024-09-16T07:32:56.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:32:56.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create testvol 'abcd@#' 2024-09-16T07:32:57.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.123+0000 7f2336200640 1 -- 172.21.15.114:0/1675643853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23300cdf20 msgr2=0x7f23300b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.123+0000 7f2336200640 1 --2- 172.21.15.114:0/1675643853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23300cdf20 0x7f23300b1860 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f2330073ef0 tx=0x7f232801cb50 comp rx=0 tx=0).stop 2024-09-16T07:32:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.123+0000 7f2336200640 1 -- 172.21.15.114:0/1675643853 shutdown_connections 2024-09-16T07:32:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.123+0000 7f2336200640 1 --2- 172.21.15.114:0/1675643853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23300cdf20 0x7f23300b1860 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.123+0000 7f2336200640 1 --2- 172.21.15.114:0/1675643853 >> v2:172.21.15.149:3300/0 conn(0x7f23300b3bb0 0x7f23300b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.123+0000 7f2336200640 1 -- 172.21.15.114:0/1675643853 >> 172.21.15.114:0/1675643853 conn(0x7f23300d1e00 msgr2=0x7f23300d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 -- 172.21.15.114:0/1675643853 shutdown_connections 2024-09-16T07:32:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 -- 172.21.15.114:0/1675643853 wait complete. 2024-09-16T07:32:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 Processor -- start 2024-09-16T07:32:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 -- start start 2024-09-16T07:32:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23300b3bb0 0x7f23300b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23300cdf20 0x7f233006eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f233015f340 0x7f23301f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2330168f10 con 0x7f233015f340 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2330168d90 con 0x7f23300cdf20 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2330169090 con 0x7f23300b3bb0 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f233015f340 0x7f23301f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f233015f340 0x7f23301f7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45942/0 (socket says 172.21.15.114:45942) 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 -- 172.21.15.114:0/1304215581 learned_addr learned my addr 172.21.15.114:0/1304215581 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232f400640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23300b3bb0 0x7f23300b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2326a00640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23300cdf20 0x7f233006eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 -- 172.21.15.114:0/1304215581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23300b3bb0 msgr2=0x7f23300b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f23300b3bb0 0x7f23300b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 -- 172.21.15.114:0/1304215581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23300cdf20 msgr2=0x7f233006eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23300cdf20 0x7f233006eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:57.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 -- 172.21.15.114:0/1304215581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23301f8480 con 0x7f233015f340 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2326a00640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f23300cdf20 0x7f233006eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f232fe00640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f233015f340 0x7f23301f7a00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2328009b10 tx=0x7f2328009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2327e00640 1 -- 172.21.15.114:0/1304215581 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280bb070 con 0x7f233015f340 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2327e00640 1 -- 172.21.15.114:0/1304215581 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2328004d40 con 0x7f233015f340 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2327e00640 1 -- 172.21.15.114:0/1304215581 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23280b2040 con 0x7f233015f340 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.127+0000 7f2336200640 1 -- 172.21.15.114:0/1304215581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23301f8760 con 0x7f233015f340 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.131+0000 7f2336200640 1 -- 172.21.15.114:0/1304215581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2330165540 con 0x7f233015f340 2024-09-16T07:32:57.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.131+0000 7f2336200640 1 -- 172.21.15.114:0/1304215581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23300b34a0 con 0x7f233015f340 2024-09-16T07:32:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.131+0000 7f2327e00640 1 -- 172.21.15.114:0/1304215581 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f23280a5bc0 con 0x7f233015f340 2024-09-16T07:32:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.131+0000 7f2327e00640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f230c073010 0x7f230c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.131+0000 7f2327e00640 1 -- 172.21.15.114:0/1304215581 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6543+0+0 (secure 0 0 0) 0x7f232812df20 con 0x7f233015f340 2024-09-16T07:32:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.131+0000 7f232f400640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f230c073010 0x7f230c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.131+0000 7f232f400640 1 --2- 172.21.15.114:0/1304215581 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f230c073010 0x7f230c0754d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2320007d70 tx=0x7f2320007d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.135+0000 7f2327e00640 1 -- 172.21.15.114:0/1304215581 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f23280f20b0 con 0x7f233015f340 2024-09-16T07:32:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-16T07:32:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:fs subvolume create [] [] [] [] [] [] [--namespace-isolated] [] : Create a CephFS subvolume in a volume, and optionally, with a specific size (in bytes), a specific data pool layout, a specific mode, in a specific subvolume group and in separate RADOS namespace 2024-09-16T07:32:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:Error EINVAL: invalid command 2024-09-16T07:32:57.331 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:32:57.332 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm testvol --yes-i-really-mean-it 2024-09-16T07:32:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.478+0000 7fcf7e200640 1 -- 172.21.15.114:0/533340721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 msgr2=0x7fcf6000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.478+0000 7fcf7e200640 1 --2- 172.21.15.114:0/533340721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 0x7fcf6000b9d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcf780d26d0 tx=0x7fcf7001f900 comp rx=0 tx=0).stop 2024-09-16T07:32:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.478+0000 7fcf7d800640 1 -- 172.21.15.114:0/533340721 reap_dead start 2024-09-16T07:32:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.478+0000 7fcf7e200640 1 -- 172.21.15.114:0/533340721 shutdown_connections 2024-09-16T07:32:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.478+0000 7fcf7e200640 1 -- 172.21.15.114:0/533340721 >> 172.21.15.114:0/533340721 conn(0x7fcf7809aa10 msgr2=0x7fcf7809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:32:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.478+0000 7fcf7e200640 1 -- 172.21.15.114:0/533340721 shutdown_connections 2024-09-16T07:32:57.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.478+0000 7fcf7e200640 1 -- 172.21.15.114:0/533340721 wait complete. 2024-09-16T07:32:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 Processor -- start 2024-09-16T07:32:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 -- start start 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 0x7fcf781f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf7815e090 0x7fcf781f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf7815e4f0 0x7fcf781f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf780ccd30 con 0x7fcf600051d0 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf780d08e0 con 0x7fcf7815e4f0 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf780cceb0 con 0x7fcf7815e090 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 0x7fcf781f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 0x7fcf781f1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45960/0 (socket says 172.21.15.114:45960) 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 -- 172.21.15.114:0/137697425 learned_addr learned my addr 172.21.15.114:0/137697425 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:32:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf77e00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf7815e090 0x7fcf781f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7d800640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf7815e4f0 0x7fcf781f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 -- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf7815e090 msgr2=0x7fcf781f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf7815e090 0x7fcf781f7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 -- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf7815e4f0 msgr2=0x7fcf781f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf7815e4f0 0x7fcf781f8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 -- 172.21.15.114:0/137697425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7815eaa0 con 0x7fcf600051d0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf77e00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf7815e090 0x7fcf781f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7ce00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 0x7fcf781f1c70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c011a30 tx=0x7fcf6c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf74c00640 1 -- 172.21.15.114:0/137697425 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00fd10 con 0x7fcf600051d0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf74c00640 1 -- 172.21.15.114:0/137697425 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf6c005020 con 0x7fcf600051d0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf74c00640 1 -- 172.21.15.114:0/137697425 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c005470 con 0x7fcf600051d0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7815ed80 con 0x7fcf600051d0 2024-09-16T07:32:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.482+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf781f8ba0 con 0x7fcf600051d0 2024-09-16T07:32:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.486+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf7806dd30 con 0x7fcf600051d0 2024-09-16T07:32:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.486+0000 7fcf74c00640 1 -- 172.21.15.114:0/137697425 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fcf6c0047b0 con 0x7fcf600051d0 2024-09-16T07:32:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.486+0000 7fcf74c00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf58073010 0x7fcf580754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:32:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.486+0000 7fcf74c00640 1 -- 172.21.15.114:0/137697425 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6543+0+0 (secure 0 0 0) 0x7fcf6c094fe0 con 0x7fcf600051d0 2024-09-16T07:32:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.486+0000 7fcf77e00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf58073010 0x7fcf580754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:32:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.486+0000 7fcf77e00640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf58073010 0x7fcf580754d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf7815ba00 tx=0x7fcf64006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:32:57.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.490+0000 7fcf74c00640 1 -- 172.21.15.114:0/137697425 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcf6c05f6d0 con 0x7fcf600051d0 2024-09-16T07:32:57.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:32:57.694+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "testvol", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) -- 0x7fcf7815ef50 con 0x7fcf58073010 2024-09-16T07:32:57.697 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:32:57.698+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:32:57.744 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:33:00.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.718+0000 7fcf74c00640 1 -- 172.21.15.114:0/137697425 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+78 (secure 0 0 0) 0x7fcf7815ef50 con 0x7fcf58073010 2024-09-16T07:33:00.719 INFO:teuthology.orchestra.run.smithi114.stdout:metadata pool: cephfs.testvol.meta data pool: ['cephfs.testvol.data'] removed 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf58073010 msgr2=0x7fcf580754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf58073010 0x7fcf580754d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf7815ba00 tx=0x7fcf64006b20 comp rx=0 tx=0).stop 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 msgr2=0x7fcf781f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 0x7fcf781f1c70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c011a30 tx=0x7fcf6c011ef0 comp rx=0 tx=0).stop 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 shutdown_connections 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf7815e4f0 0x7fcf781f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf58073010 0x7fcf580754d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf7815e090 0x7fcf781f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 --2- 172.21.15.114:0/137697425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf600051d0 0x7fcf781f1c70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:00.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 >> 172.21.15.114:0/137697425 conn(0x7fcf7809aa10 msgr2=0x7fcf780b6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 shutdown_connections 2024-09-16T07:33:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:00.722+0000 7fcf7e200640 1 -- 172.21.15.114:0/137697425 wait complete. 2024-09-16T07:33:00.741 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:33:00.742 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:33:00.846 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:33:00.934 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:33:00.934 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:00.934 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:00.934 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:00.943 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:00.943 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:00.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 -- 172.21.15.114:0/2063318499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc75815ade0 msgr2=0x7fc7580cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 --2- 172.21.15.114:0/2063318499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc75815ade0 0x7fc7580cebf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009840 tx=0x7fc74c01c820 comp rx=0 tx=0).stop 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 -- 172.21.15.114:0/2063318499 shutdown_connections 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 --2- 172.21.15.114:0/2063318499 >> v2:172.21.15.149:3300/0 conn(0x7fc75806e810 0x7fc7580cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 --2- 172.21.15.114:0/2063318499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc75815ade0 0x7fc7580cebf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 -- 172.21.15.114:0/2063318499 >> 172.21.15.114:0/2063318499 conn(0x7fc7580b18f0 msgr2=0x7fc7580b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 -- 172.21.15.114:0/2063318499 shutdown_connections 2024-09-16T07:33:01.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.182+0000 7fc75fe00640 1 -- 172.21.15.114:0/2063318499 wait complete. 2024-09-16T07:33:01.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 Processor -- start 2024-09-16T07:33:01.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 -- start start 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75806e810 0x7fc75809d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7580b4bd0 0x7fc758165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75815ade0 0x7fc7581597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc758168140 con 0x7fc75806e810 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc758167fc0 con 0x7fc75815ade0 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc7581682c0 con 0x7fc7580b4bd0 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75806e810 0x7fc75809d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75806e810 0x7fc75809d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45988/0 (socket says 172.21.15.114:45988) 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 -- 172.21.15.114:0/4066877726 learned_addr learned my addr 172.21.15.114:0/4066877726 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75ca00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7580b4bd0 0x7fc758165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75de00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75815ade0 0x7fc7581597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 -- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7580b4bd0 msgr2=0x7fc758165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7580b4bd0 0x7fc758165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 -- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75815ade0 msgr2=0x7fc7581597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75815ade0 0x7fc7581597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 -- 172.21.15.114:0/4066877726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7581640e0 con 0x7fc75806e810 2024-09-16T07:33:01.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75d400640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75806e810 0x7fc75809d710 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc74c000c10 tx=0x7fc74c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:01.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc755600640 1 -- 172.21.15.114:0/4066877726 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0ac050 con 0x7fc75806e810 2024-09-16T07:33:01.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc755600640 1 -- 172.21.15.114:0/4066877726 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc74c0a6ba0 con 0x7fc75806e810 2024-09-16T07:33:01.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7581643c0 con 0x7fc75806e810 2024-09-16T07:33:01.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc755600640 1 -- 172.21.15.114:0/4066877726 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c005ca0 con 0x7fc75806e810 2024-09-16T07:33:01.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc758164980 con 0x7fc75806e810 2024-09-16T07:33:01.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.186+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc758069410 con 0x7fc75806e810 2024-09-16T07:33:01.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.190+0000 7fc755600640 1 -- 172.21.15.114:0/4066877726 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc74c0af070 con 0x7fc75806e810 2024-09-16T07:33:01.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.190+0000 7fc755600640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc738072fe0 0x7fc7380754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.190+0000 7fc755600640 1 -- 172.21.15.114:0/4066877726 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7fc74c12e270 con 0x7fc75806e810 2024-09-16T07:33:01.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.190+0000 7fc75ca00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc738072fe0 0x7fc7380754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.190+0000 7fc75ca00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc738072fe0 0x7fc7380754a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc758154f50 tx=0x7fc7440091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:01.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.194+0000 7fc755600640 1 -- 172.21.15.114:0/4066877726 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc74c016410 con 0x7fc75806e810 2024-09-16T07:33:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc7581656c0 con 0x7fc75806e810 2024-09-16T07:33:01.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc755600640 1 -- 172.21.15.114:0/4066877726 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v88) ==== 80+0+124 (secure 0 0 0) 0x7fc74c0f8b50 con 0x7fc75806e810 2024-09-16T07:33:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/2356735727 2024-09-17T07:32:57.702214+0000 2024-09-16T07:33:01.373 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6833/2356735727 2024-09-17T07:32:57.702214+0000 2024-09-16T07:33:01.373 INFO:teuthology.orchestra.run.smithi114.stderr:listed 2 entries 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc738072fe0 msgr2=0x7fc7380754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc738072fe0 0x7fc7380754a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc758154f50 tx=0x7fc7440091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75806e810 msgr2=0x7fc75809d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75806e810 0x7fc75809d710 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc74c000c10 tx=0x7fc74c0056e0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 shutdown_connections 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc75815ade0 0x7fc7581597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc738072fe0 0x7fc7380754a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7580b4bd0 0x7fc758165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 --2- 172.21.15.114:0/4066877726 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc75806e810 0x7fc75809d710 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 >> 172.21.15.114:0/4066877726 conn(0x7fc7580b18f0 msgr2=0x7fc7580aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 shutdown_connections 2024-09-16T07:33:01.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.374+0000 7fc75fe00640 1 -- 172.21.15.114:0/4066877726 wait complete. 2024-09-16T07:33:01.394 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:33:01.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:01.395 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:01.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:33:01.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:01.421 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:33:01.472 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:01.472 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:01.472 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:01.482 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:01.482 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:01.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 -- 172.21.15.114:0/395867761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec15c130 msgr2=0x7f61ec0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 --2- 172.21.15.114:0/395867761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec15c130 0x7f61ec0ceb20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f61ec073a20 tx=0x7f61d401c6e0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 -- 172.21.15.114:0/395867761 shutdown_connections 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 --2- 172.21.15.114:0/395867761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec15c130 0x7f61ec0ceb20 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 --2- 172.21.15.114:0/395867761 >> v2:172.21.15.149:3300/0 conn(0x7f61ec15bd50 0x7f61ec0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 -- 172.21.15.114:0/395867761 >> 172.21.15.114:0/395867761 conn(0x7f61ec0d1ea0 msgr2=0x7f61ec0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 -- 172.21.15.114:0/395867761 shutdown_connections 2024-09-16T07:33:01.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.674+0000 7f61f2400640 1 -- 172.21.15.114:0/395867761 wait complete. 2024-09-16T07:33:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 Processor -- start 2024-09-16T07:33:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 -- start start 2024-09-16T07:33:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec0cf4e0 0x7f61ec159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61ec15bd50 0x7f61ec14eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61ec15c130 0x7f61ec1fad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec168e50 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec168cd0 con 0x7f61ec15c130 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f61ec168fd0 con 0x7f61ec15bd50 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec0cf4e0 0x7f61ec159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec0cf4e0 0x7f61ec159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46018/0 (socket says 172.21.15.114:46018) 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 -- 172.21.15.114:0/2602551409 learned_addr learned my addr 172.21.15.114:0/2602551409 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61e2a00640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61ec15bd50 0x7f61ec14eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61ebe00640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61ec15c130 0x7f61ec1fad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 -- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61ec15bd50 msgr2=0x7f61ec14eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61ec15bd50 0x7f61ec14eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 -- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61ec15c130 msgr2=0x7f61ec1fad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61ec15c130 0x7f61ec1fad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 -- 172.21.15.114:0/2602551409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec14f3f0 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61e2a00640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61ec15bd50 0x7f61ec14eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61eb400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec0cf4e0 0x7f61ec159030 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9f0 tx=0x7f61dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61e3e00640 1 -- 172.21.15.114:0/2602551409 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00cd80 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61e3e00640 1 -- 172.21.15.114:0/2602551409 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61dc010430 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ec159710 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61e3e00640 1 -- 172.21.15.114:0/2602551409 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc010860 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ec159cd0 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.678+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ec0c5dd0 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.682+0000 7f61e3e00640 1 -- 172.21.15.114:0/2602551409 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f61dc010a00 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.682+0000 7f61e3e00640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f61c8072fe0 0x7f61c80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.682+0000 7f61e3e00640 1 -- 172.21.15.114:0/2602551409 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7f61dc094bf0 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.682+0000 7f61e2a00640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f61c8072fe0 0x7f61c80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.682+0000 7f61e2a00640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f61c8072fe0 0x7f61c80754a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61d40af000 tx=0x7f61d401af20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.686+0000 7f61e3e00640 1 -- 172.21.15.114:0/2602551409 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f61dc05fd10 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.866+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61ec070c10 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.866+0000 7f61e3e00640 1 -- 172.21.15.114:0/2602551409 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v88) ==== 80+0+124 (secure 0 0 0) 0x7f61dc05f610 con 0x7f61ec0cf4e0 2024-09-16T07:33:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6835/2356735727 2024-09-17T07:32:57.702214+0000 2024-09-16T07:33:01.867 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:6833/2356735727 2024-09-17T07:32:57.702214+0000 2024-09-16T07:33:01.867 INFO:teuthology.orchestra.run.smithi114.stderr:listed 2 entries 2024-09-16T07:33:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f61c8072fe0 msgr2=0x7f61c80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f61c8072fe0 0x7f61c80754a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f61d40af000 tx=0x7f61d401af20 comp rx=0 tx=0).stop 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec0cf4e0 msgr2=0x7f61ec159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec0cf4e0 0x7f61ec159030 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9f0 tx=0x7f61dc00eeb0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 shutdown_connections 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61ec15c130 0x7f61ec1fad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f61c8072fe0 0x7f61c80754a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61ec15bd50 0x7f61ec14eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 --2- 172.21.15.114:0/2602551409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61ec0cf4e0 0x7f61ec159030 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 >> 172.21.15.114:0/2602551409 conn(0x7f61ec0d1ea0 msgr2=0x7f61ec0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 shutdown_connections 2024-09-16T07:33:01.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:01.870+0000 7f61f2400640 1 -- 172.21.15.114:0/2602551409 wait complete. 2024-09-16T07:33:01.888 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:33:01.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:01.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:33:01.914 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:33:01.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:01.914 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:33:01.964 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:01.964 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:01.964 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:01.973 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:33:01.973 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:01.973 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:01.973 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:02.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:33:02.015 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 -- 172.21.15.114:0/2586810728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 msgr2=0x7ff0540062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 --2- 172.21.15.114:0/2586810728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 0x7ff0540062e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff068001ef0 tx=0x7ff06801f3c0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff06f400640 1 -- 172.21.15.114:0/2586810728 reap_dead start 2024-09-16T07:33:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 -- 172.21.15.114:0/2586810728 shutdown_connections 2024-09-16T07:33:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 -- 172.21.15.114:0/2586810728 >> 172.21.15.114:0/2586810728 conn(0x7ff0700b18f0 msgr2=0x7ff0700b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 -- 172.21.15.114:0/2586810728 shutdown_connections 2024-09-16T07:33:02.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 -- 172.21.15.114:0/2586810728 wait complete. 2024-09-16T07:33:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 Processor -- start 2024-09-16T07:33:02.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 -- start start 2024-09-16T07:33:02.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 0x7ff0701495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.158+0000 7ff075600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff07009aa10 0x7ff07009ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff075600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0701586a0 0x7ff070158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff075600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700acd40 con 0x7ff054005e60 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff075600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff07006fb00 con 0x7ff0701586a0 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff075600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff0700acec0 con 0x7ff07009aa10 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 0x7ff0701495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 0x7ff0701495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46028/0 (socket says 172.21.15.114:46028) 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 -- 172.21.15.114:0/557595918 learned_addr learned my addr 172.21.15.114:0/557595918 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff066000640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff07009aa10 0x7ff07009ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06f400640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0701586a0 0x7ff070158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 -- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff07009aa10 msgr2=0x7ff07009ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff07009aa10 0x7ff07009ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 -- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0701586a0 msgr2=0x7ff070158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0701586a0 0x7ff070158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 -- 172.21.15.114:0/557595918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff070157600 con 0x7ff054005e60 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff066000640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff07009aa10 0x7ff07009ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06f400640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0701586a0 0x7ff070158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff06ea00640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 0x7ff0701495f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff060005f70 tx=0x7ff06000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff067400640 1 -- 172.21.15.114:0/557595918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06001e070 con 0x7ff054005e60 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff067400640 1 -- 172.21.15.114:0/557595918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff06000e7c0 con 0x7ff054005e60 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff067400640 1 -- 172.21.15.114:0/557595918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06000ebf0 con 0x7ff054005e60 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0701578e0 con 0x7ff054005e60 2024-09-16T07:33:02.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff070157ea0 con 0x7ff054005e60 2024-09-16T07:33:02.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0700cf090 con 0x7ff054005e60 2024-09-16T07:33:02.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.162+0000 7ff067400640 1 -- 172.21.15.114:0/557595918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7ff060021070 con 0x7ff054005e60 2024-09-16T07:33:02.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.166+0000 7ff067400640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff04c073010 0x7ff04c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.166+0000 7ff067400640 1 -- 172.21.15.114:0/557595918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7ff060095030 con 0x7ff054005e60 2024-09-16T07:33:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.166+0000 7ff066000640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff04c073010 0x7ff04c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.166+0000 7ff066000640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff04c073010 0x7ff04c0754d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff070157410 tx=0x7ff058000f80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:02.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.170+0000 7ff067400640 1 -- 172.21.15.114:0/557595918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff06005f9b0 con 0x7ff054005e60 2024-09-16T07:33:02.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0700ae180 con 0x7ff054005e60 2024-09-16T07:33:02.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff067400640 1 -- 172.21.15.114:0/557595918 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7ff0600643e0 con 0x7ff054005e60 2024-09-16T07:33:02.369 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:02.369 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"btime":"2024-09-16T07:32:58:705112+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1449286393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1449286393},{"type":"v1","addr":"172.21.15.114:6834","nonce":1449286393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6307,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3836721187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":3836721187},{"type":"v1","addr":"172.21.15.149:6835","nonce":3836721187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/926181044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":926181044},{"type":"v1","addr":"172.21.15.114:6835","nonce":926181044}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:37.860881+0000","modified":"2024-09-16T07:32:40.899353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6834/862990525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":862990525},{"type":"v1","addr":"172.21.15.149:6834","nonce":862990525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6600,"qdb_cluster":[6600]},"id":6}]} 2024-09-16T07:33:02.369 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2024-09-16T07:33:02.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff04c073010 msgr2=0x7ff04c0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff04c073010 0x7ff04c0754d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff070157410 tx=0x7ff058000f80 comp rx=0 tx=0).stop 2024-09-16T07:33:02.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 msgr2=0x7ff0701495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 0x7ff0701495f0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff060005f70 tx=0x7ff06000f790 comp rx=0 tx=0).stop 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 shutdown_connections 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0701586a0 0x7ff070158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff04c073010 0x7ff04c0754d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff07009aa10 0x7ff07009ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 --2- 172.21.15.114:0/557595918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff054005e60 0x7ff0701495f0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 >> 172.21.15.114:0/557595918 conn(0x7ff0700b18f0 msgr2=0x7ff07006fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 shutdown_connections 2024-09-16T07:33:02.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.370+0000 7ff075600640 1 -- 172.21.15.114:0/557595918 wait complete. 2024-09-16T07:33:02.391 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 -- 172.21.15.114:0/3193581862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100af120 msgr2=0x7fc1100cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 --2- 172.21.15.114:0/3193581862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100af120 0x7fc1100cad30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc1100b2540 tx=0x7fc0fc01f0b0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 -- 172.21.15.114:0/3193581862 shutdown_connections 2024-09-16T07:33:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 --2- 172.21.15.114:0/3193581862 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100af120 0x7fc1100cad30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 --2- 172.21.15.114:0/3193581862 >> v2:172.21.15.149:3300/0 conn(0x7fc1100ca950 0x7fc11006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 -- 172.21.15.114:0/3193581862 >> 172.21.15.114:0/3193581862 conn(0x7fc1100cfa30 msgr2=0x7fc1100cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 -- 172.21.15.114:0/3193581862 shutdown_connections 2024-09-16T07:33:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 -- 172.21.15.114:0/3193581862 wait complete. 2024-09-16T07:33:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 Processor -- start 2024-09-16T07:33:02.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.538+0000 7fc115200640 1 -- start start 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100707b0 0x7fc110152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1100af120 0x7fc1100b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100ca950 0x7fc11015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc1100739f0 con 0x7fc1100707b0 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc110073870 con 0x7fc1100ca950 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc11015eb30 con 0x7fc1100af120 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100707b0 0x7fc110152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100707b0 0x7fc110152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46036/0 (socket says 172.21.15.114:46036) 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 -- 172.21.15.114:0/2310355001 learned_addr learned my addr 172.21.15.114:0/2310355001 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10ea00640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1100af120 0x7fc1100b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10fe00640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100ca950 0x7fc11015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 -- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1100af120 msgr2=0x7fc1100b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1100af120 0x7fc1100b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 -- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100ca950 msgr2=0x7fc11015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100ca950 0x7fc11015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 -- 172.21.15.114:0/2310355001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11015a500 con 0x7fc1100707b0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc10f400640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100707b0 0x7fc110152e60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc10000d950 tx=0x7fc10000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc107400640 1 -- 172.21.15.114:0/2310355001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100017070 con 0x7fc1100707b0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc107400640 1 -- 172.21.15.114:0/2310355001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc100009cc0 con 0x7fc1100707b0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11015a7e0 con 0x7fc1100707b0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc107400640 1 -- 172.21.15.114:0/2310355001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000106c0 con 0x7fc1100707b0 2024-09-16T07:33:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1100b5670 con 0x7fc1100707b0 2024-09-16T07:33:02.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc11015ad00 con 0x7fc1100707b0 2024-09-16T07:33:02.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.542+0000 7fc107400640 1 -- 172.21.15.114:0/2310355001 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc10001a070 con 0x7fc1100707b0 2024-09-16T07:33:02.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.546+0000 7fc107400640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0f0072fe0 0x7fc0f00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.546+0000 7fc107400640 1 -- 172.21.15.114:0/2310355001 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7fc1000942a0 con 0x7fc1100707b0 2024-09-16T07:33:02.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.546+0000 7fc10ea00640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0f0072fe0 0x7fc0f00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.546+0000 7fc10ea00640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0f0072fe0 0x7fc0f00754a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0b2000 tx=0x7fc0fc01d8f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:02.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.550+0000 7fc107400640 1 -- 172.21.15.114:0/2310355001 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc11015ad00 con 0x7fc1100707b0 2024-09-16T07:33:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.750+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1100cad30 con 0x7fc1100707b0 2024-09-16T07:33:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.750+0000 7fc107400640 1 -- 172.21.15.114:0/2310355001 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7fc10005f1d0 con 0x7fc1100707b0 2024-09-16T07:33:02.749 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:02.750 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"btime":"2024-09-16T07:32:58:705112+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1449286393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1449286393},{"type":"v1","addr":"172.21.15.114:6834","nonce":1449286393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6307,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3836721187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":3836721187},{"type":"v1","addr":"172.21.15.149:6835","nonce":3836721187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/926181044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":926181044},{"type":"v1","addr":"172.21.15.114:6835","nonce":926181044}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:37.860881+0000","modified":"2024-09-16T07:32:40.899353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6834/862990525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":862990525},{"type":"v1","addr":"172.21.15.149:6834","nonce":862990525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6600,"qdb_cluster":[6600]},"id":6}]} 2024-09-16T07:33:02.750 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2024-09-16T07:33:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.750+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0f0072fe0 msgr2=0x7fc0f00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.750+0000 7fc115200640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0f0072fe0 0x7fc0f00754a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0b2000 tx=0x7fc0fc01d8f0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.750+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100707b0 msgr2=0x7fc110152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.750+0000 7fc115200640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100707b0 0x7fc110152e60 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc10000d950 tx=0x7fc10000de10 comp rx=0 tx=0).stop 2024-09-16T07:33:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 shutdown_connections 2024-09-16T07:33:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1100ca950 0x7fc11015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0f0072fe0 0x7fc0f00754a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1100af120 0x7fc1100b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 --2- 172.21.15.114:0/2310355001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1100707b0 0x7fc110152e60 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 >> 172.21.15.114:0/2310355001 conn(0x7fc1100cfa30 msgr2=0x7fc1100cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 shutdown_connections 2024-09-16T07:33:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.754+0000 7fc115200640 1 -- 172.21.15.114:0/2310355001 wait complete. 2024-09-16T07:33:02.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:02.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- 172.21.15.114:0/2823270148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0b49e0 msgr2=0x7f0ffc06f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 --2- 172.21.15.114:0/2823270148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0b49e0 0x7f0ffc06f7b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc06aab0 tx=0x7f0ff401dad0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- 172.21.15.114:0/2823270148 shutdown_connections 2024-09-16T07:33:02.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 --2- 172.21.15.114:0/2823270148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc0b49e0 0x7f0ffc06f7b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 --2- 172.21.15.114:0/2823270148 >> v2:172.21.15.149:3300/0 conn(0x7f0ffc15dae0 0x7f0ffc0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- 172.21.15.114:0/2823270148 >> 172.21.15.114:0/2823270148 conn(0x7f0ffc0b18f0 msgr2=0x7f0ffc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:02.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- 172.21.15.114:0/2823270148 shutdown_connections 2024-09-16T07:33:02.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- 172.21.15.114:0/2823270148 wait complete. 2024-09-16T07:33:02.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 Processor -- start 2024-09-16T07:33:02.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- start start 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ffc0b49e0 0x7f0ffc06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ffc0cd100 0x7f0ffc06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc15dae0 0x7f0ffc0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc0cf150 con 0x7f0ffc15dae0 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc0cefd0 con 0x7f0ffc0b49e0 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f1002400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc0cf2d0 con 0x7f0ffc0cd100 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc15dae0 0x7f0ffc0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc15dae0 0x7f0ffc0af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46052/0 (socket says 172.21.15.114:46052) 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 -- 172.21.15.114:0/1912406693 learned_addr learned my addr 172.21.15.114:0/1912406693 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffb400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ffc0b49e0 0x7f0ffc06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffaa00640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ffc0cd100 0x7f0ffc06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 -- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ffc0cd100 msgr2=0x7f0ffc06f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ffc0cd100 0x7f0ffc06f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 -- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ffc0b49e0 msgr2=0x7f0ffc06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:02.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ffc0b49e0 0x7f0ffc06e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:02.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffbe00640 1 -- 172.21.15.114:0/1912406693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc06f7e0 con 0x7f0ffc15dae0 2024-09-16T07:33:02.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.914+0000 7f0ffaa00640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ffc0cd100 0x7f0ffc06f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:02.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f0ffbe00640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc15dae0 0x7f0ffc0af860 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400a960 tx=0x7f0ff40a67c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:02.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f0ff3400640 1 -- 172.21.15.114:0/1912406693 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40bc070 con 0x7f0ffc15dae0 2024-09-16T07:33:02.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f0ff3400640 1 -- 172.21.15.114:0/1912406693 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ff4003b80 con 0x7f0ffc15dae0 2024-09-16T07:33:02.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ffc074660 con 0x7f0ffc15dae0 2024-09-16T07:33:02.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f0ff3400640 1 -- 172.21.15.114:0/1912406693 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40b3070 con 0x7f0ffc15dae0 2024-09-16T07:33:02.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ffc074010 con 0x7f0ffc15dae0 2024-09-16T07:33:02.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ffc069410 con 0x7f0ffc15dae0 2024-09-16T07:33:02.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f0ff3400640 1 -- 172.21.15.114:0/1912406693 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f0ff40bf070 con 0x7f0ffc15dae0 2024-09-16T07:33:02.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f0ff3400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0fdc073010 0x7f0fdc0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:02.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.918+0000 7f0ff3400640 1 -- 172.21.15.114:0/1912406693 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7f0ff412ea80 con 0x7f0ffc15dae0 2024-09-16T07:33:02.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.922+0000 7f0ffb400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0fdc073010 0x7f0fdc0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:02.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.922+0000 7f0ffb400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0fdc073010 0x7f0fdc0754d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc1fac20 tx=0x7f0fec0095b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:02.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:02.922+0000 7f0ff3400640 1 -- 172.21.15.114:0/1912406693 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0ff40177e0 con 0x7f0ffc15dae0 2024-09-16T07:33:03.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.090+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ffc0acd40 con 0x7f0ffc15dae0 2024-09-16T07:33:03.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f0ff3400640 1 -- 172.21.15.114:0/1912406693 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16899 (secure 0 0 0) 0x7f0ff40f9470 con 0x7f0ffc15dae0 2024-09-16T07:33:03.092 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:03.092 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":88,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:00.714368+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:35.553549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:36.818015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/2356735727":"2024-09-17T07:32:57.702214+0000","172.21.15.114:6833/2356735727":"2024-09-17T07:32:57.702214+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0fdc073010 msgr2=0x7f0fdc0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0fdc073010 0x7f0fdc0754d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc1fac20 tx=0x7f0fec0095b0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc15dae0 msgr2=0x7f0ffc0af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc15dae0 0x7f0ffc0af860 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400a960 tx=0x7f0ff40a67c0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 shutdown_connections 2024-09-16T07:33:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ffc15dae0 0x7f0ffc0af860 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0fdc073010 0x7f0fdc0754d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0ffc0cd100 0x7f0ffc06f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 --2- 172.21.15.114:0/1912406693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0ffc0b49e0 0x7f0ffc06e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 >> 172.21.15.114:0/1912406693 conn(0x7f0ffc0b18f0 msgr2=0x7f0ffc15a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:03.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 shutdown_connections 2024-09-16T07:33:03.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.094+0000 7f1002400640 1 -- 172.21.15.114:0/1912406693 wait complete. 2024-09-16T07:33:03.113 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:33:03.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:03.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 -- 172.21.15.114:0/3117009282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24080cdb30 msgr2=0x7f24080aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 --2- 172.21.15.114:0/3117009282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24080cdb30 0x7f24080aeef0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2400009c80 tx=0x7f240001cda0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 -- 172.21.15.114:0/3117009282 shutdown_connections 2024-09-16T07:33:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 --2- 172.21.15.114:0/3117009282 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24080cdb30 0x7f24080aeef0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 --2- 172.21.15.114:0/3117009282 >> v2:172.21.15.149:3300/0 conn(0x7f24080ced80 0x7f24080ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 -- 172.21.15.114:0/3117009282 >> 172.21.15.114:0/3117009282 conn(0x7f24080d1dc0 msgr2=0x7f24080d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 -- 172.21.15.114:0/3117009282 shutdown_connections 2024-09-16T07:33:03.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.254+0000 7f2410000640 1 -- 172.21.15.114:0/3117009282 wait complete. 2024-09-16T07:33:03.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 Processor -- start 2024-09-16T07:33:03.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 -- start start 2024-09-16T07:33:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24080cdb30 0x7f24081fb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24080ced80 0x7f2408071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f240815bea0 0x7f24081f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2408169340 con 0x7f24080ced80 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24081691c0 con 0x7f24080cdb30 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24081694c0 con 0x7f240815bea0 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24080ced80 0x7f2408071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24080ced80 0x7f2408071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46058/0 (socket says 172.21.15.114:46058) 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 -- 172.21.15.114:0/1167593781 learned_addr learned my addr 172.21.15.114:0/1167593781 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240d600640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24080cdb30 0x7f24081fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240e000640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f240815bea0 0x7f24081f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 -- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f240815bea0 msgr2=0x7f24081f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f240815bea0 0x7f24081f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 -- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24080cdb30 msgr2=0x7f24081fb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24080cdb30 0x7f24081fb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 -- 172.21.15.114:0/1167593781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24080719a0 con 0x7f24080ced80 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f240cc00640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24080ced80 0x7f2408071460 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f23f400ea10 tx=0x7f23f400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2405600640 1 -- 172.21.15.114:0/1167593781 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f400cde0 con 0x7f24080ced80 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2405600640 1 -- 172.21.15.114:0/1167593781 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23f4004020 con 0x7f24080ced80 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24080b16a0 con 0x7f24080ced80 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2405600640 1 -- 172.21.15.114:0/1167593781 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4004470 con 0x7f24080ced80 2024-09-16T07:33:03.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.258+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24080b1c60 con 0x7f24080ced80 2024-09-16T07:33:03.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.262+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24080ce670 con 0x7f24080ced80 2024-09-16T07:33:03.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.262+0000 7f2405600640 1 -- 172.21.15.114:0/1167593781 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f23f4003600 con 0x7f24080ced80 2024-09-16T07:33:03.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.262+0000 7f2405600640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23e8072fe0 0x7f23e80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.262+0000 7f2405600640 1 -- 172.21.15.114:0/1167593781 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7f23f40949a0 con 0x7f24080ced80 2024-09-16T07:33:03.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.262+0000 7f240d600640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23e8072fe0 0x7f23e80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.262+0000 7f240d600640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23e8072fe0 0x7f23e80754a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007fd0 tx=0x7f23fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:03.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.266+0000 7f2405600640 1 -- 172.21.15.114:0/1167593781 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f23f405f310 con 0x7f24080ced80 2024-09-16T07:33:03.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.466+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24080762f0 con 0x7f24080ced80 2024-09-16T07:33:03.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.466+0000 7f2405600640 1 -- 172.21.15.114:0/1167593781 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7f23f4063d40 con 0x7f24080ced80 2024-09-16T07:33:03.467 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:03.467 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"btime":"2024-09-16T07:32:58:705112+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1449286393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1449286393},{"type":"v1","addr":"172.21.15.114:6834","nonce":1449286393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6307,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3836721187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":3836721187},{"type":"v1","addr":"172.21.15.149:6835","nonce":3836721187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/926181044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":926181044},{"type":"v1","addr":"172.21.15.114:6835","nonce":926181044}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:37.860881+0000","modified":"2024-09-16T07:32:40.899353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6834/862990525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":862990525},{"type":"v1","addr":"172.21.15.149:6834","nonce":862990525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6600,"qdb_cluster":[6600]},"id":6}]} 2024-09-16T07:33:03.468 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2024-09-16T07:33:03.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23e8072fe0 msgr2=0x7f23e80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23e8072fe0 0x7f23e80754a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007fd0 tx=0x7f23fc009040 comp rx=0 tx=0).stop 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24080ced80 msgr2=0x7f2408071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24080ced80 0x7f2408071460 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f23f400ea10 tx=0x7f23f400eed0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 shutdown_connections 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23e8072fe0 0x7f23e80754a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f240815bea0 0x7f24081f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24080ced80 0x7f2408071460 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 --2- 172.21.15.114:0/1167593781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24080cdb30 0x7f24081fb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 >> 172.21.15.114:0/1167593781 conn(0x7f24080d1dc0 msgr2=0x7f24080d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 shutdown_connections 2024-09-16T07:33:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.470+0000 7f2410000640 1 -- 172.21.15.114:0/1167593781 wait complete. 2024-09-16T07:33:03.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- 172.21.15.114:0/2200876506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 msgr2=0x7f67b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 --2- 172.21.15.114:0/2200876506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 0x7f67b8004c90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f67d4070900 tx=0x7f67c001d1f0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d2800640 1 -- 172.21.15.114:0/2200876506 reap_dead start 2024-09-16T07:33:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- 172.21.15.114:0/2200876506 shutdown_connections 2024-09-16T07:33:03.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- 172.21.15.114:0/2200876506 >> 172.21.15.114:0/2200876506 conn(0x7f67d40b18f0 msgr2=0x7f67d40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- 172.21.15.114:0/2200876506 shutdown_connections 2024-09-16T07:33:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- 172.21.15.114:0/2200876506 wait complete. 2024-09-16T07:33:03.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 Processor -- start 2024-09-16T07:33:03.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- start start 2024-09-16T07:33:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 0x7f67d414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d40af920 0x7f67d4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67d4152090 0x7f67d4153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67d40cf4f0 con 0x7f67b8004810 2024-09-16T07:33:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f67d40cf370 con 0x7f67d40af920 2024-09-16T07:33:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f67d4165110 con 0x7f67d4152090 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 0x7f67d414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 0x7f67d414f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46082/0 (socket says 172.21.15.114:46082) 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d1e00640 1 -- 172.21.15.114:0/249001665 learned_addr learned my addr 172.21.15.114:0/249001665 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d1400640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d40af920 0x7f67d4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.634+0000 7f67d2800640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67d4152090 0x7f67d4153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d1e00640 1 -- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67d4152090 msgr2=0x7f67d4153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d1e00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67d4152090 0x7f67d4153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d1e00640 1 -- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d40af920 msgr2=0x7f67d4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d1e00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d40af920 0x7f67d4151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d1e00640 1 -- 172.21.15.114:0/249001665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d4150260 con 0x7f67b8004810 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d2800640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67d4152090 0x7f67d4153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d1e00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 0x7f67d414f420 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f67c40062c0 tx=0x7f67c4006780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67ca000640 1 -- 172.21.15.114:0/249001665 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4015070 con 0x7f67b8004810 2024-09-16T07:33:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67ca000640 1 -- 172.21.15.114:0/249001665 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67c400fd40 con 0x7f67b8004810 2024-09-16T07:33:03.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d4150540 con 0x7f67b8004810 2024-09-16T07:33:03.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67ca000640 1 -- 172.21.15.114:0/249001665 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4011690 con 0x7f67b8004810 2024-09-16T07:33:03.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d4150b00 con 0x7f67b8004810 2024-09-16T07:33:03.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d40ce810 con 0x7f67b8004810 2024-09-16T07:33:03.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67ca000640 1 -- 172.21.15.114:0/249001665 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f67c4011830 con 0x7f67b8004810 2024-09-16T07:33:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67ca000640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f67b4072fe0 0x7f67b40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.638+0000 7f67ca000640 1 -- 172.21.15.114:0/249001665 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7f67c40950e0 con 0x7f67b8004810 2024-09-16T07:33:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.642+0000 7f67d1400640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f67b4072fe0 0x7f67b40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.642+0000 7f67d1400640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f67b4072fe0 0x7f67b40754a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67c00ae000 tx=0x7f67c0019f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:03.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.646+0000 7f67ca000640 1 -- 172.21.15.114:0/249001665 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f67c405f9c0 con 0x7f67b8004810 2024-09-16T07:33:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.846+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d40ad5c0 con 0x7f67b8004810 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67ca000640 1 -- 172.21.15.114:0/249001665 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7f67c40643f0 con 0x7f67b8004810 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"btime":"2024-09-16T07:32:58:705112+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1449286393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1449286393},{"type":"v1","addr":"172.21.15.114:6834","nonce":1449286393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6307,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3836721187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":3836721187},{"type":"v1","addr":"172.21.15.149:6835","nonce":3836721187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/926181044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":926181044},{"type":"v1","addr":"172.21.15.114:6835","nonce":926181044}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:32:37.860881+0000","modified":"2024-09-16T07:32:40.899353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6600},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6600":{"gid":6600,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6834/862990525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":862990525},{"type":"v1","addr":"172.21.15.149:6834","nonce":862990525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6600,"qdb_cluster":[6600]},"id":6}]} 2024-09-16T07:33:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 63 2024-09-16T07:33:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f67b4072fe0 msgr2=0x7f67b40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f67b4072fe0 0x7f67b40754a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67c00ae000 tx=0x7f67c0019f90 comp rx=0 tx=0).stop 2024-09-16T07:33:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 msgr2=0x7f67d414f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 0x7f67d414f420 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f67c40062c0 tx=0x7f67c4006780 comp rx=0 tx=0).stop 2024-09-16T07:33:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 shutdown_connections 2024-09-16T07:33:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f67b4072fe0 0x7f67b40754a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f67d4152090 0x7f67d4153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67d40af920 0x7f67d4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 --2- 172.21.15.114:0/249001665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b8004810 0x7f67d414f420 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 >> 172.21.15.114:0/249001665 conn(0x7f67d40b18f0 msgr2=0x7f67d4154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 shutdown_connections 2024-09-16T07:33:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:03.850+0000 7f67d8a00640 1 -- 172.21.15.114:0/249001665 wait complete. 2024-09-16T07:33:03.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:04.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.010+0000 7fa8f5600640 1 -- 172.21.15.114:0/2439456208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 msgr2=0x7fa8f00ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.010+0000 7fa8f5600640 1 --2- 172.21.15.114:0/2439456208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f00ceb20 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0073a20 tx=0x7fa8d801c7a0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.010+0000 7fa8f5600640 1 -- 172.21.15.114:0/2439456208 shutdown_connections 2024-09-16T07:33:04.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.010+0000 7fa8f5600640 1 --2- 172.21.15.114:0/2439456208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f00ceb20 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.010+0000 7fa8f5600640 1 --2- 172.21.15.114:0/2439456208 >> v2:172.21.15.149:3300/0 conn(0x7fa8f015bd50 0x7fa8f00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.010+0000 7fa8f5600640 1 -- 172.21.15.114:0/2439456208 >> 172.21.15.114:0/2439456208 conn(0x7fa8f00d1ea0 msgr2=0x7fa8f00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:04.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.010+0000 7fa8f5600640 1 -- 172.21.15.114:0/2439456208 shutdown_connections 2024-09-16T07:33:04.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 -- 172.21.15.114:0/2439456208 wait complete. 2024-09-16T07:33:04.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 Processor -- start 2024-09-16T07:33:04.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 -- start start 2024-09-16T07:33:04.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f00cf4e0 0x7fa8f00cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f015bd50 0x7fa8f0152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f01f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f0168e50 con 0x7fa8f015c130 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f0168cd0 con 0x7fa8f00cf4e0 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8f5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f0168fd0 con 0x7fa8f015bd50 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f01f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f01f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46096/0 (socket says 172.21.15.114:46096) 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 -- 172.21.15.114:0/3254089167 learned_addr learned my addr 172.21.15.114:0/3254089167 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8eea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f00cf4e0 0x7fa8f00cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8e6000640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f015bd50 0x7fa8f0152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 -- 172.21.15.114:0/3254089167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f015bd50 msgr2=0x7fa8f0152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f015bd50 0x7fa8f0152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 -- 172.21.15.114:0/3254089167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f00cf4e0 msgr2=0x7fa8f00cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f00cf4e0 0x7fa8f00cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 -- 172.21.15.114:0/3254089167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f00cb5c0 con 0x7fa8f015c130 2024-09-16T07:33:04.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8ef400640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f01f8aa0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800c7c0 tx=0x7fa8e800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:04.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.014+0000 7fa8e7400640 1 -- 172.21.15.114:0/3254089167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8003b80 con 0x7fa8f015c130 2024-09-16T07:33:04.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8e7400640 1 -- 172.21.15.114:0/3254089167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8e8003d20 con 0x7fa8f015c130 2024-09-16T07:33:04.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f00cbb40 con 0x7fa8f015c130 2024-09-16T07:33:04.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8e7400640 1 -- 172.21.15.114:0/3254089167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800aab0 con 0x7fa8f015c130 2024-09-16T07:33:04.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f00cb860 con 0x7fa8f015c130 2024-09-16T07:33:04.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f00c5dd0 con 0x7fa8f015c130 2024-09-16T07:33:04.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8e7400640 1 -- 172.21.15.114:0/3254089167 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fa8e800ac50 con 0x7fa8f015c130 2024-09-16T07:33:04.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8e7400640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa8cc072fe0 0x7fa8cc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8e7400640 1 -- 172.21.15.114:0/3254089167 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7fa8e8093e70 con 0x7fa8f015c130 2024-09-16T07:33:04.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8eea00640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa8cc072fe0 0x7fa8cc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.018+0000 7fa8eea00640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa8cc072fe0 0x7fa8cc0754a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00cc4c0 tx=0x7fa8e000b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:04.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.022+0000 7fa8e7400640 1 -- 172.21.15.114:0/3254089167 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa8e805e7e0 con 0x7fa8f015c130 2024-09-16T07:33:04.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.190+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8f00c80f0 con 0x7fa8f015c130 2024-09-16T07:33:04.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.190+0000 7fa8e7400640 1 -- 172.21.15.114:0/3254089167 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16899 (secure 0 0 0) 0x7fa8e8063210 con 0x7fa8f015c130 2024-09-16T07:33:04.191 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:04.191 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":88,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:00.714368+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:32:35.553549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-16T07:32:36.818015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/2356735727":"2024-09-17T07:32:57.702214+0000","172.21.15.114:6833/2356735727":"2024-09-17T07:32:57.702214+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa8cc072fe0 msgr2=0x7fa8cc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa8cc072fe0 0x7fa8cc0754a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00cc4c0 tx=0x7fa8e000b390 comp rx=0 tx=0).stop 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 msgr2=0x7fa8f01f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f01f8aa0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800c7c0 tx=0x7fa8e800cc80 comp rx=0 tx=0).stop 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 shutdown_connections 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa8f015c130 0x7fa8f01f8aa0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa8cc072fe0 0x7fa8cc0754a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa8f015bd50 0x7fa8f0152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 --2- 172.21.15.114:0/3254089167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8f00cf4e0 0x7fa8f00cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 >> 172.21.15.114:0/3254089167 conn(0x7fa8f00d1ea0 msgr2=0x7fa8f0154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:04.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 shutdown_connections 2024-09-16T07:33:04.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.194+0000 7fa8f5600640 1 -- 172.21.15.114:0/3254089167 wait complete. 2024-09-16T07:33:04.213 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:33:04.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 -- 172.21.15.114:0/4105016971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf806e7a0 msgr2=0x7fddf806ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 --2- 172.21.15.114:0/4105016971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf806e7a0 0x7fddf806ec30 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009900 tx=0x7fddf001f0d0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 -- 172.21.15.114:0/4105016971 shutdown_connections 2024-09-16T07:33:04.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 --2- 172.21.15.114:0/4105016971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf806e7a0 0x7fddf806ec30 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 --2- 172.21.15.114:0/4105016971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddf815c3e0 0x7fddf815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 -- 172.21.15.114:0/4105016971 >> 172.21.15.114:0/4105016971 conn(0x7fddf80b18f0 msgr2=0x7fddf80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 -- 172.21.15.114:0/4105016971 shutdown_connections 2024-09-16T07:33:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.354+0000 7fddfcc00640 1 -- 172.21.15.114:0/4105016971 wait complete. 2024-09-16T07:33:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 Processor -- start 2024-09-16T07:33:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 -- start start 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddf806e7a0 0x7fddf80b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf815bfa0 0x7fddf81557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf815c3e0 0x7fddf81593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fddf806f2f0 con 0x7fddf815c3e0 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fddf806f170 con 0x7fddf815bfa0 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fddf806f470 con 0x7fddf806e7a0 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf815c3e0 0x7fddf81593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf815c3e0 0x7fddf81593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42224/0 (socket says 172.21.15.114:42224) 2024-09-16T07:33:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 -- 172.21.15.114:0/3601063423 learned_addr learned my addr 172.21.15.114:0/3601063423 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 -- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddf806e7a0 msgr2=0x7fddf80b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddf806e7a0 0x7fddf80b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 -- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf815bfa0 msgr2=0x7fddf81557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf5400640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf815bfa0 0x7fddf81557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf815bfa0 0x7fddf81557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 -- 172.21.15.114:0/3601063423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf8155cf0 con 0x7fddf815c3e0 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf5400640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf815bfa0 0x7fddf81557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddf6800640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf815c3e0 0x7fddf81593d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fddf00b3040 tx=0x7fddf00a8d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddee000640 1 -- 172.21.15.114:0/3601063423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf00b5040 con 0x7fddf815c3e0 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddee000640 1 -- 172.21.15.114:0/3601063423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddf0005320 con 0x7fddf815c3e0 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddee000640 1 -- 172.21.15.114:0/3601063423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf00046d0 con 0x7fddf815c3e0 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf8158610 con 0x7fddf815c3e0 2024-09-16T07:33:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.358+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf8158bd0 con 0x7fddf815c3e0 2024-09-16T07:33:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.362+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf8069410 con 0x7fddf815c3e0 2024-09-16T07:33:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.362+0000 7fddee000640 1 -- 172.21.15.114:0/3601063423 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fddf00c1060 con 0x7fddf815c3e0 2024-09-16T07:33:04.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.362+0000 7fddee000640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fddd8072fe0 0x7fddd80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.362+0000 7fddee000640 1 -- 172.21.15.114:0/3601063423 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5795+0+0 (secure 0 0 0) 0x7fddf01311c0 con 0x7fddf815c3e0 2024-09-16T07:33:04.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.362+0000 7fddf5e00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fddd8072fe0 0x7fddd80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.362+0000 7fddf5e00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fddd8072fe0 0x7fddd80754a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005fd0 tx=0x7fdde8005ee0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:04.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.366+0000 7fddee000640 1 -- 172.21.15.114:0/3601063423 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fddf0018c30 con 0x7fddf815c3e0 2024-09-16T07:33:04.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.570+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fddf806ec30 con 0x7fddf815c3e0 2024-09-16T07:33:04.568 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:33:04.570+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:33:04.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.570+0000 7fddee000640 1 -- 172.21.15.114:0/3601063423 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7fddf00fc190 con 0x7fddf815c3e0 2024-09-16T07:33:04.570 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fddd8072fe0 msgr2=0x7fddd80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fddd8072fe0 0x7fddd80754a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005fd0 tx=0x7fdde8005ee0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf815c3e0 msgr2=0x7fddf81593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf815c3e0 0x7fddf81593d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fddf00b3040 tx=0x7fddf00a8d50 comp rx=0 tx=0).stop 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 shutdown_connections 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf815c3e0 0x7fddf81593d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddf815bfa0 0x7fddf81557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fddd8072fe0 0x7fddd80754a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 --2- 172.21.15.114:0/3601063423 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fddf806e7a0 0x7fddf80b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 >> 172.21.15.114:0/3601063423 conn(0x7fddf80b18f0 msgr2=0x7fddf815d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:04.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 shutdown_connections 2024-09-16T07:33:04.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.574+0000 7fddfcc00640 1 -- 172.21.15.114:0/3601063423 wait complete. 2024-09-16T07:33:04.581 INFO:tasks.ceph.mds.b.smithi149.stderr: -2919> 2024-09-16T07:32:40.443+0000 7f6e6be00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:33:04.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:33:04.629 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:33:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3167701178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000cd0f0 msgr2=0x7fa700073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3167701178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000cd0f0 0x7fa700073b70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa700076240 tx=0x7fa6f801c890 comp rx=0 tx=0).stop 2024-09-16T07:33:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3167701178 shutdown_connections 2024-09-16T07:33:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3167701178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000cd0f0 0x7fa700073b70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3167701178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7000ccc90 0x7fa700073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3167701178 >> v2:172.21.15.149:3300/0 conn(0x7fa70015acb0 0x7fa7000ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3167701178 >> 172.21.15.114:0/3167701178 conn(0x7fa7000d0ab0 msgr2=0x7fa7000d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3167701178 shutdown_connections 2024-09-16T07:33:04.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.738+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3167701178 wait complete. 2024-09-16T07:33:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 Processor -- start 2024-09-16T07:33:04.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 -- start start 2024-09-16T07:33:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000ccc90 0x7fa70015d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa70015acb0 0x7fa7000ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7000ca620 0x7fa7000b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa700070070 con 0x7fa7000ccc90 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa7000cef60 con 0x7fa7000ca620 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa70015e840 con 0x7fa70015acb0 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000ccc90 0x7fa70015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000ccc90 0x7fa70015d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42240/0 (socket says 172.21.15.114:42240) 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 -- 172.21.15.114:0/3573891854 learned_addr learned my addr 172.21.15.114:0/3573891854 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6f6000640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa70015acb0 0x7fa7000ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ff400640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7000ca620 0x7fa7000b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 -- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa70015acb0 msgr2=0x7fa7000ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa70015acb0 0x7fa7000ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 -- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7000ca620 msgr2=0x7fa7000b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7000ca620 0x7fa7000b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 -- 172.21.15.114:0/3573891854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7000c91a0 con 0x7fa7000ccc90 2024-09-16T07:33:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6fea00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000ccc90 0x7fa70015d900 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000ed30 tx=0x7fa6f000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6f7e00640 1 -- 172.21.15.114:0/3573891854 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0003b80 con 0x7fa7000ccc90 2024-09-16T07:33:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6f7e00640 1 -- 172.21.15.114:0/3573891854 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6f0003d20 con 0x7fa7000ccc90 2024-09-16T07:33:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6f7e00640 1 -- 172.21.15.114:0/3573891854 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0004280 con 0x7fa7000ccc90 2024-09-16T07:33:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7000b5430 con 0x7fa7000ccc90 2024-09-16T07:33:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7000b59f0 con 0x7fa7000ccc90 2024-09-16T07:33:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.742+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7000caa30 con 0x7fa7000ccc90 2024-09-16T07:33:04.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.746+0000 7fa6f7e00640 1 -- 172.21.15.114:0/3573891854 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fa6f0004420 con 0x7fa7000ccc90 2024-09-16T07:33:04.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.746+0000 7fa6f7e00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa6dc073010 0x7fa6dc0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:04.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.746+0000 7fa6f7e00640 1 -- 172.21.15.114:0/3573891854 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5881+0+0 (secure 0 0 0) 0x7fa6f0094ba0 con 0x7fa7000ccc90 2024-09-16T07:33:04.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.746+0000 7fa6f6000640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa6dc073010 0x7fa6dc0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:04.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.746+0000 7fa6f6000640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa6dc073010 0x7fa6dc0754d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7000c7150 tx=0x7fa6e80091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:04.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.750+0000 7fa6f7e00640 1 -- 172.21.15.114:0/3573891854 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa7000caa30 con 0x7fa7000ccc90 2024-09-16T07:33:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:04.950+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa7000ce890 con 0x7fa7000ccc90 2024-09-16T07:33:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6f7e00640 1 -- 172.21.15.114:0/3573891854 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7fa6f005f4e0 con 0x7fa7000ccc90 2024-09-16T07:33:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa6dc073010 msgr2=0x7fa6dc0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa6dc073010 0x7fa6dc0754d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7000c7150 tx=0x7fa6e80091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000ccc90 msgr2=0x7fa70015d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000ccc90 0x7fa70015d900 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000ed30 tx=0x7fa6f000c6a0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 shutdown_connections 2024-09-16T07:33:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7000ca620 0x7fa7000b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa6dc073010 0x7fa6dc0754d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa70015acb0 0x7fa7000ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 --2- 172.21.15.114:0/3573891854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7000ccc90 0x7fa70015d900 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 >> 172.21.15.114:0/3573891854 conn(0x7fa7000d0ab0 msgr2=0x7fa7000c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.574+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 shutdown_connections 2024-09-16T07:33:05.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.578+0000 7fa6ffe00640 1 -- 172.21.15.114:0/3573891854 wait complete. 2024-09-16T07:33:05.598 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 -- 172.21.15.114:0/1559548968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c15ffd0 msgr2=0x7f8f3c0d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/1559548968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c15ffd0 0x7f8f3c0d2910 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0cf8f0 tx=0x7f8f3001c7e0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 -- 172.21.15.114:0/1559548968 shutdown_connections 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/1559548968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f3c0af580 0x7f8f3c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/1559548968 >> v2:172.21.15.149:3300/0 conn(0x7f8f3c1603b0 0x7f8f3c160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/1559548968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c15ffd0 0x7f8f3c0d2910 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 -- 172.21.15.114:0/1559548968 >> 172.21.15.114:0/1559548968 conn(0x7f8f3c0d1df0 msgr2=0x7f8f3c0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 -- 172.21.15.114:0/1559548968 shutdown_connections 2024-09-16T07:33:05.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 -- 172.21.15.114:0/1559548968 wait complete. 2024-09-16T07:33:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.746+0000 7f8f44000640 1 Processor -- start 2024-09-16T07:33:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 -- start start 2024-09-16T07:33:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c0af580 0x7f8f3c0ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f3c15ffd0 0x7f8f3c15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f3c1603b0 0x7f8f3c15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c1681e0 con 0x7f8f3c0af580 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c168060 con 0x7f8f3c15ffd0 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c168360 con 0x7f8f3c1603b0 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c0af580 0x7f8f3c0ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c0af580 0x7f8f3c0ce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42264/0 (socket says 172.21.15.114:42264) 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 -- 172.21.15.114:0/381727241 learned_addr learned my addr 172.21.15.114:0/381727241 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 -- 172.21.15.114:0/381727241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f3c1603b0 msgr2=0x7f8f3c15e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f3c1603b0 0x7f8f3c15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 -- 172.21.15.114:0/381727241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f3c15ffd0 msgr2=0x7f8f3c15e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f3c15ffd0 0x7f8f3c15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 -- 172.21.15.114:0/381727241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c14c7a0 con 0x7f8f3c0af580 2024-09-16T07:33:05.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f41600640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c0af580 0x7f8f3c0ce070 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8f30000c10 tx=0x7f8f30005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f39600640 1 -- 172.21.15.114:0/381727241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300bb070 con 0x7f8f3c0af580 2024-09-16T07:33:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f39600640 1 -- 172.21.15.114:0/381727241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f300043f0 con 0x7f8f3c0af580 2024-09-16T07:33:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f39600640 1 -- 172.21.15.114:0/381727241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300b2040 con 0x7f8f3c0af580 2024-09-16T07:33:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c14ca40 con 0x7f8f3c0af580 2024-09-16T07:33:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c14d000 con 0x7f8f3c0af580 2024-09-16T07:33:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.750+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c0d2910 con 0x7f8f3c0af580 2024-09-16T07:33:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.754+0000 7f8f39600640 1 -- 172.21.15.114:0/381727241 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f8f300be070 con 0x7f8f3c0af580 2024-09-16T07:33:05.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.754+0000 7f8f39600640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f1c072fe0 0x7f8f1c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:05.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.754+0000 7f8f39600640 1 -- 172.21.15.114:0/381727241 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5881+0+0 (secure 0 0 0) 0x7f8f3012da10 con 0x7f8f3c0af580 2024-09-16T07:33:05.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.754+0000 7f8f40c00640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f1c072fe0 0x7f8f1c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:05.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.754+0000 7f8f40c00640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f1c072fe0 0x7f8f1c0754a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f280058d0 tx=0x7f8f28005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:05.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.758+0000 7f8f39600640 1 -- 172.21.15.114:0/381727241 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8f30016490 con 0x7f8f3c0af580 2024-09-16T07:33:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:05.930+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8f3c15dc70 con 0x7f8f3c0af580 2024-09-16T07:33:06.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.742+0000 7f8f39600640 1 -- 172.21.15.114:0/381727241 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7f8f300f88f0 con 0x7f8f3c0af580 2024-09-16T07:33:06.742 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:33:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f1c072fe0 msgr2=0x7f8f1c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f1c072fe0 0x7f8f1c0754a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f280058d0 tx=0x7f8f28005860 comp rx=0 tx=0).stop 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c0af580 msgr2=0x7f8f3c0ce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c0af580 0x7f8f3c0ce070 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8f30000c10 tx=0x7f8f30005df0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 shutdown_connections 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f1c072fe0 0x7f8f1c0754a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f3c1603b0 0x7f8f3c15e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f3c15ffd0 0x7f8f3c15e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 --2- 172.21.15.114:0/381727241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f3c0af580 0x7f8f3c0ce070 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 >> 172.21.15.114:0/381727241 conn(0x7f8f3c0d1df0 msgr2=0x7f8f3c0ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 shutdown_connections 2024-09-16T07:33:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.746+0000 7f8f44000640 1 -- 172.21.15.114:0/381727241 wait complete. 2024-09-16T07:33:06.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:33:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- 172.21.15.114:0/2643288972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0cea60 msgr2=0x7f0d0c165350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 --2- 172.21.15.114:0/2643288972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0cea60 0x7f0d0c165350 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400acd0 tx=0x7f0d0401def0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- 172.21.15.114:0/2643288972 shutdown_connections 2024-09-16T07:33:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 --2- 172.21.15.114:0/2643288972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0cea60 0x7f0d0c165350 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- 172.21.15.114:0/2643288972 >> 172.21.15.114:0/2643288972 conn(0x7f0d0c0cfbc0 msgr2=0x7f0d0c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- 172.21.15.114:0/2643288972 shutdown_connections 2024-09-16T07:33:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- 172.21.15.114:0/2643288972 wait complete. 2024-09-16T07:33:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 Processor -- start 2024-09-16T07:33:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- start start 2024-09-16T07:33:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0734f0 0x7f0d0c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d0c0cea60 0x7f0d0c146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:06.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d0c15a9d0 0x7f0d0c0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c168140 con 0x7f0d0c0734f0 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c167fc0 con 0x7f0d0c0cea60 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d14200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c1682c0 con 0x7f0d0c15a9d0 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d11800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0734f0 0x7f0d0c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d11800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0734f0 0x7f0d0c0b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42286/0 (socket says 172.21.15.114:42286) 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d11800640 1 -- 172.21.15.114:0/3884811303 learned_addr learned my addr 172.21.15.114:0/3884811303 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d10e00640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d0c0cea60 0x7f0d0c146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.922+0000 7f0d12200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d0c15a9d0 0x7f0d0c0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d11800640 1 -- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d0c15a9d0 msgr2=0x7f0d0c0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d11800640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d0c15a9d0 0x7f0d0c0b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d11800640 1 -- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d0c0cea60 msgr2=0x7f0d0c146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:06.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d11800640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d0c0cea60 0x7f0d0c146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d11800640 1 -- 172.21.15.114:0/3884811303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0b31b0 con 0x7f0d0c0734f0 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d10e00640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d0c0cea60 0x7f0d0c146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d12200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d0c15a9d0 0x7f0d0c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d11800640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0734f0 0x7f0d0c0b4250 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000c500 tx=0x7f0d0000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d09600640 1 -- 172.21.15.114:0/3884811303 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00017070 con 0x7f0d0c0734f0 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d09600640 1 -- 172.21.15.114:0/3884811303 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d000053c0 con 0x7f0d0c0734f0 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d09600640 1 -- 172.21.15.114:0/3884811303 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00012890 con 0x7f0d0c0734f0 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c0b3490 con 0x7f0d0c0734f0 2024-09-16T07:33:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c0b3a50 con 0x7f0d0c0734f0 2024-09-16T07:33:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c069410 con 0x7f0d0c0734f0 2024-09-16T07:33:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d09600640 1 -- 172.21.15.114:0/3884811303 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f0d0001a070 con 0x7f0d0c0734f0 2024-09-16T07:33:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.926+0000 7f0d09600640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0cec072fe0 0x7f0cec0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.930+0000 7f0d09600640 1 -- 172.21.15.114:0/3884811303 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5443+0+0 (secure 0 0 0) 0x7f0d000932d0 con 0x7f0d0c0734f0 2024-09-16T07:33:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.930+0000 7f0d10e00640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0cec072fe0 0x7f0cec0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.930+0000 7f0d10e00640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0cec072fe0 0x7f0cec0754a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80046c0 tx=0x7f0cf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:06.930+0000 7f0d09600640 1 -- 172.21.15.114:0/3884811303 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0d0005e370 con 0x7f0d0c0734f0 2024-09-16T07:33:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.098+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0d0c0d0850 con 0x7f0d0c0734f0 2024-09-16T07:33:07.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d09600640 1 -- 172.21.15.114:0/3884811303 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7f0d0005dc70 con 0x7f0d0c0734f0 2024-09-16T07:33:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:33:07.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0cec072fe0 msgr2=0x7f0cec0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:07.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0cec072fe0 0x7f0cec0754a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80046c0 tx=0x7f0cf8009040 comp rx=0 tx=0).stop 2024-09-16T07:33:07.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0734f0 msgr2=0x7f0d0c0b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:07.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0734f0 0x7f0d0c0b4250 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000c500 tx=0x7f0d0000c9c0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 shutdown_connections 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0cec072fe0 0x7f0cec0754a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0d0c15a9d0 0x7f0d0c0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d0c0cea60 0x7f0d0c146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 --2- 172.21.15.114:0/3884811303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d0c0734f0 0x7f0d0c0b4250 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 >> 172.21.15.114:0/3884811303 conn(0x7f0d0c0cfbc0 msgr2=0x7f0d0c153370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.746+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 shutdown_connections 2024-09-16T07:33:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.750+0000 7f0d14200640 1 -- 172.21.15.114:0/3884811303 wait complete. 2024-09-16T07:33:07.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:33:07.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.914+0000 7f549d200640 1 -- 172.21.15.114:0/1510903851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5498164c60 msgr2=0x7f5498167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.914+0000 7f549d200640 1 --2- 172.21.15.114:0/1510903851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5498164c60 0x7f5498167050 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5490009840 tx=0x7f549001c680 comp rx=0 tx=0).stop 2024-09-16T07:33:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.914+0000 7f549d200640 1 -- 172.21.15.114:0/1510903851 shutdown_connections 2024-09-16T07:33:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.914+0000 7f549d200640 1 --2- 172.21.15.114:0/1510903851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5498164c60 0x7f5498167050 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.914+0000 7f549d200640 1 -- 172.21.15.114:0/1510903851 >> 172.21.15.114:0/1510903851 conn(0x7f54980d1e30 msgr2=0x7f54980d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.914+0000 7f549d200640 1 -- 172.21.15.114:0/1510903851 shutdown_connections 2024-09-16T07:33:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.914+0000 7f549d200640 1 -- 172.21.15.114:0/1510903851 wait complete. 2024-09-16T07:33:07.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 Processor -- start 2024-09-16T07:33:07.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 -- start start 2024-09-16T07:33:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54980b2e80 0x7f5498153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f549815f490 0x7f54980c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5498164c60 0x7f54980c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5498169f30 con 0x7f549815f490 2024-09-16T07:33:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5498169db0 con 0x7f54980b2e80 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f549816a0b0 con 0x7f5498164c60 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f549815f490 0x7f54980c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f549815f490 0x7f54980c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42292/0 (socket says 172.21.15.114:42292) 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 -- 172.21.15.114:0/622326493 learned_addr learned my addr 172.21.15.114:0/622326493 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5496800640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5498164c60 0x7f54980c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495e00640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54980b2e80 0x7f5498153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 -- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5498164c60 msgr2=0x7f54980c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5498164c60 0x7f54980c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 -- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54980b2e80 msgr2=0x7f5498153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54980b2e80 0x7f5498153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 -- 172.21.15.114:0/622326493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54980cb620 con 0x7f549815f490 2024-09-16T07:33:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495e00640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54980b2e80 0x7f5498153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f5495400640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f549815f490 0x7f54980c5960 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f548400c4b0 tx=0x7f548400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f548e000640 1 -- 172.21.15.114:0/622326493 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54840052d0 con 0x7f549815f490 2024-09-16T07:33:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f548e000640 1 -- 172.21.15.114:0/622326493 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5484005470 con 0x7f549815f490 2024-09-16T07:33:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f548e000640 1 -- 172.21.15.114:0/622326493 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484012870 con 0x7f549815f490 2024-09-16T07:33:07.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5498154750 con 0x7f549815f490 2024-09-16T07:33:07.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.918+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54980ca960 con 0x7f549815f490 2024-09-16T07:33:07.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.922+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54980b14c0 con 0x7f549815f490 2024-09-16T07:33:07.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.922+0000 7f548e000640 1 -- 172.21.15.114:0/622326493 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f5484003600 con 0x7f549815f490 2024-09-16T07:33:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.922+0000 7f548e000640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5478072fe0 0x7f54780754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.922+0000 7f548e000640 1 -- 172.21.15.114:0/622326493 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7f54840938d0 con 0x7f549815f490 2024-09-16T07:33:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.922+0000 7f5495e00640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5478072fe0 0x7f54780754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.922+0000 7f5495e00640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5478072fe0 0x7f54780754a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54880015b0 tx=0x7f5488009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:07.926+0000 7f548e000640 1 -- 172.21.15.114:0/622326493 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f548405eb10 con 0x7f549815f490 2024-09-16T07:33:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.098+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f5498071860 con 0x7f549815f490 2024-09-16T07:33:08.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f548e000640 1 -- 172.21.15.114:0/622326493 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f548405e410 con 0x7f549815f490 2024-09-16T07:33:08.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5478072fe0 msgr2=0x7f54780754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5478072fe0 0x7f54780754a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54880015b0 tx=0x7f5488009040 comp rx=0 tx=0).stop 2024-09-16T07:33:08.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f549815f490 msgr2=0x7f54980c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f549815f490 0x7f54980c5960 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f548400c4b0 tx=0x7f548400c970 comp rx=0 tx=0).stop 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 shutdown_connections 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5478072fe0 0x7f54780754a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5498164c60 0x7f54980c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f549815f490 0x7f54980c5960 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 --2- 172.21.15.114:0/622326493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54980b2e80 0x7f5498153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 >> 172.21.15.114:0/622326493 conn(0x7f54980d1e30 msgr2=0x7f5498071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.102+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 shutdown_connections 2024-09-16T07:33:08.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.106+0000 7f549d200640 1 -- 172.21.15.114:0/622326493 wait complete. 2024-09-16T07:33:08.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-16T07:33:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 -- 172.21.15.114:0/3228180834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228074330 msgr2=0x7f822806f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 --2- 172.21.15.114:0/3228180834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228074330 0x7f822806f9a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f8228074c60 tx=0x7f822001cd50 comp rx=0 tx=0).stop 2024-09-16T07:33:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 -- 172.21.15.114:0/3228180834 shutdown_connections 2024-09-16T07:33:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 --2- 172.21.15.114:0/3228180834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8228074330 0x7f822806f9a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 --2- 172.21.15.114:0/3228180834 >> v2:172.21.15.149:3300/0 conn(0x7f822815af60 0x7f82280cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 -- 172.21.15.114:0/3228180834 >> 172.21.15.114:0/3228180834 conn(0x7f82280d0c90 msgr2=0x7f82280d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:08.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 -- 172.21.15.114:0/3228180834 shutdown_connections 2024-09-16T07:33:08.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 -- 172.21.15.114:0/3228180834 wait complete. 2024-09-16T07:33:08.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 Processor -- start 2024-09-16T07:33:08.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.274+0000 7f822da00640 1 -- start start 2024-09-16T07:33:08.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82280737c0 0x7f82281f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228074330 0x7f82280c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f822815af60 0x7f82280c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8228167ab0 con 0x7f82280737c0 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8228167930 con 0x7f8228074330 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8228167c30 con 0x7f822815af60 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82280737c0 0x7f82281f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82280737c0 0x7f82281f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42312/0 (socket says 172.21.15.114:42312) 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 -- 172.21.15.114:0/4056948414 learned_addr learned my addr 172.21.15.114:0/4056948414 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f821e000640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228074330 0x7f82280c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8227400640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f822815af60 0x7f82280c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 -- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f822815af60 msgr2=0x7f82280c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f822815af60 0x7f82280c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 -- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228074330 msgr2=0x7f82280c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228074330 0x7f82280c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 -- 172.21.15.114:0/4056948414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82280cf6f0 con 0x7f82280737c0 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8227400640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f822815af60 0x7f82280c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f8226a00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82280737c0 0x7f82281f66a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f821800d750 tx=0x7f821800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f821f400640 1 -- 172.21.15.114:0/4056948414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218017070 con 0x7f82280737c0 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f821f400640 1 -- 172.21.15.114:0/4056948414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8218009d20 con 0x7f82280737c0 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f821f400640 1 -- 172.21.15.114:0/4056948414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218005280 con 0x7f82280737c0 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822806fd10 con 0x7f82280737c0 2024-09-16T07:33:08.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8228074160 con 0x7f82280737c0 2024-09-16T07:33:08.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822806f9a0 con 0x7f82280737c0 2024-09-16T07:33:08.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.278+0000 7f821f400640 1 -- 172.21.15.114:0/4056948414 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f8218005420 con 0x7f82280737c0 2024-09-16T07:33:08.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.282+0000 7f821f400640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8204073010 0x7f82040754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.282+0000 7f821f400640 1 -- 172.21.15.114:0/4056948414 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7f8218093e50 con 0x7f82280737c0 2024-09-16T07:33:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.282+0000 7f821e000640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8204073010 0x7f82040754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.282+0000 7f821e000640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8204073010 0x7f82040754d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82280d01f0 tx=0x7f8210007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:08.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.286+0000 7f821f400640 1 -- 172.21.15.114:0/4056948414 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f821800de60 con 0x7f82280737c0 2024-09-16T07:33:08.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.510+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7f82280cced0 con 0x7f82280737c0 2024-09-16T07:33:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.754+0000 7f821f400640 1 -- 172.21.15.114:0/4056948414 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v273) ==== 146+0+0 (secure 0 0 0) 0x7f821805ea30 con 0x7f82280737c0 2024-09-16T07:33:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8204073010 msgr2=0x7f82040754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8204073010 0x7f82040754d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82280d01f0 tx=0x7f8210007e40 comp rx=0 tx=0).stop 2024-09-16T07:33:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82280737c0 msgr2=0x7f82281f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82280737c0 0x7f82281f66a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f821800d750 tx=0x7f821800dc10 comp rx=0 tx=0).stop 2024-09-16T07:33:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 shutdown_connections 2024-09-16T07:33:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8204073010 0x7f82040754d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f822815af60 0x7f82280c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228074330 0x7f82280c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 --2- 172.21.15.114:0/4056948414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82280737c0 0x7f82281f66a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 >> 172.21.15.114:0/4056948414 conn(0x7f82280d0c90 msgr2=0x7f82281559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 shutdown_connections 2024-09-16T07:33:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.758+0000 7f822da00640 1 -- 172.21.15.114:0/4056948414 wait complete. 2024-09-16T07:33:08.777 INFO:tasks.cephfs_test_runner:Test the creating vols, subvols subvolgroups fails when their names uses ... ok 2024-09-16T07:33:08.777 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-16T07:33:08.777 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:33:08.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.918+0000 7f7940a00640 1 -- 172.21.15.114:0/874945040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0b49e0 msgr2=0x7f793c06f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.918+0000 7f7940a00640 1 --2- 172.21.15.114:0/874945040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0b49e0 0x7f793c06f7b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f793c06aab0 tx=0x7f793401dad0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- 172.21.15.114:0/874945040 shutdown_connections 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 --2- 172.21.15.114:0/874945040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0b49e0 0x7f793c06f7b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 --2- 172.21.15.114:0/874945040 >> v2:172.21.15.149:3300/0 conn(0x7f793c15dae0 0x7f793c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- 172.21.15.114:0/874945040 >> 172.21.15.114:0/874945040 conn(0x7f793c0b18f0 msgr2=0x7f793c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- 172.21.15.114:0/874945040 shutdown_connections 2024-09-16T07:33:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- 172.21.15.114:0/874945040 wait complete. 2024-09-16T07:33:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 Processor -- start 2024-09-16T07:33:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- start start 2024-09-16T07:33:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f793c0b49e0 0x7f793c148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0cd100 0x7f793c072ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f793c15dae0 0x7f793c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f793c0cf150 con 0x7f793c0cd100 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f793c0cefd0 con 0x7f793c15dae0 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7940a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f793c0cf2d0 con 0x7f793c0b49e0 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0cd100 0x7f793c072ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0cd100 0x7f793c072ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42324/0 (socket says 172.21.15.114:42324) 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 -- 172.21.15.114:0/635854912 learned_addr learned my addr 172.21.15.114:0/635854912 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f793a800640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f793c15dae0 0x7f793c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7939e00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f793c0b49e0 0x7f793c148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 -- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f793c0b49e0 msgr2=0x7f793c148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f793c0b49e0 0x7f793c148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 -- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f793c15dae0 msgr2=0x7f793c0730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f793c15dae0 0x7f793c0730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 -- 172.21.15.114:0/635854912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c0d0a20 con 0x7f793c0cd100 2024-09-16T07:33:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7931400640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0cd100 0x7f793c072ba0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f792400c450 tx=0x7f792400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.922+0000 7f7932a00640 1 -- 172.21.15.114:0/635854912 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924012830 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7932a00640 1 -- 172.21.15.114:0/635854912 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7924017070 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7932a00640 1 -- 172.21.15.114:0/635854912 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924012d80 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c09ce80 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c09d440 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c069410 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7932a00640 1 -- 172.21.15.114:0/635854912 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f792401c460 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7932a00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7918072fe0 0x7f79180754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7932a00640 1 -- 172.21.15.114:0/635854912 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7f7924093b50 con 0x7f793c0cd100 2024-09-16T07:33:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7939e00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7918072fe0 0x7f79180754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.926+0000 7f7939e00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7918072fe0 0x7f79180754a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f792c005c50 tx=0x7f792c005be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:08.930+0000 7f7932a00640 1 -- 172.21.15.114:0/635854912 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f792405ed80 con 0x7f793c0cd100 2024-09-16T07:33:09.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.102+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f793c15c220 con 0x7f793c0cd100 2024-09-16T07:33:09.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7932a00640 1 -- 172.21.15.114:0/635854912 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+13213 (secure 0 0 0) 0x7f792405e680 con 0x7f793c0cd100 2024-09-16T07:33:09.103 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:09.104 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":91,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:07.746502+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.149:6800/862990525":"2024-09-17T07:33:04.573038+0000","172.21.15.114:6835/2356735727":"2024-09-17T07:32:57.702214+0000","172.21.15.149:6834/862990525":"2024-09-17T07:33:04.573038+0000","172.21.15.114:6833/2356735727":"2024-09-17T07:32:57.702214+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7918072fe0 msgr2=0x7f79180754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7918072fe0 0x7f79180754a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f792c005c50 tx=0x7f792c005be0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0cd100 msgr2=0x7f793c072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0cd100 0x7f793c072ba0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f792400c450 tx=0x7f792400c910 comp rx=0 tx=0).stop 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 shutdown_connections 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f793c15dae0 0x7f793c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f793c0cd100 0x7f793c072ba0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7918072fe0 0x7f79180754a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 --2- 172.21.15.114:0/635854912 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f793c0b49e0 0x7f793c148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 >> 172.21.15.114:0/635854912 conn(0x7f793c0b18f0 msgr2=0x7f793c159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 shutdown_connections 2024-09-16T07:33:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.106+0000 7f7940a00640 1 -- 172.21.15.114:0/635854912 wait complete. 2024-09-16T07:33:09.125 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:33:09.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:33:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.270+0000 7fc572400640 1 -- 172.21.15.114:0/4163888022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5500051d0 msgr2=0x7fc55000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.270+0000 7fc572400640 1 --2- 172.21.15.114:0/4163888022 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5500051d0 0x7fc55000b9d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0b3020 tx=0x7fc56401fa00 comp rx=0 tx=0).stop 2024-09-16T07:33:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.270+0000 7fc56be00640 1 -- 172.21.15.114:0/4163888022 reap_dead start 2024-09-16T07:33:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.270+0000 7fc572400640 1 -- 172.21.15.114:0/4163888022 shutdown_connections 2024-09-16T07:33:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.270+0000 7fc572400640 1 -- 172.21.15.114:0/4163888022 >> 172.21.15.114:0/4163888022 conn(0x7fc56c0b18f0 msgr2=0x7fc56c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.270+0000 7fc572400640 1 -- 172.21.15.114:0/4163888022 shutdown_connections 2024-09-16T07:33:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.270+0000 7fc572400640 1 -- 172.21.15.114:0/4163888022 wait complete. 2024-09-16T07:33:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 Processor -- start 2024-09-16T07:33:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 -- start start 2024-09-16T07:33:09.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5500051d0 0x7fc56c1f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc56c158790 0x7fc56c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc56c1e6f20 0x7fc56c1e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c0b43b0 con 0x7fc56c158790 2024-09-16T07:33:09.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c0cd820 con 0x7fc56c1e6f20 2024-09-16T07:33:09.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c0b4530 con 0x7fc5500051d0 2024-09-16T07:33:09.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc56c158790 0x7fc56c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc56c158790 0x7fc56c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42336/0 (socket says 172.21.15.114:42336) 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 -- 172.21.15.114:0/1104068769 learned_addr learned my addr 172.21.15.114:0/1104068769 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc56b400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5500051d0 0x7fc56c1f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc56be00640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc56c1e6f20 0x7fc56c1e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 -- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5500051d0 msgr2=0x7fc56c1f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5500051d0 0x7fc56c1f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 -- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc56c1e6f20 msgr2=0x7fc56c1e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc56c1e6f20 0x7fc56c1e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 -- 172.21.15.114:0/1104068769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c1f2c60 con 0x7fc56c158790 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc56b400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5500051d0 0x7fc56c1f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc56be00640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc56c1e6f20 0x7fc56c1e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc562a00640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc56c158790 0x7fc56c1594c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc554011a40 tx=0x7fc554011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc563e00640 1 -- 172.21.15.114:0/1104068769 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55400fd30 con 0x7fc56c158790 2024-09-16T07:33:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc563e00640 1 -- 172.21.15.114:0/1104068769 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc554004030 con 0x7fc56c158790 2024-09-16T07:33:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c1f2f40 con 0x7fc56c158790 2024-09-16T07:33:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc563e00640 1 -- 172.21.15.114:0/1104068769 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554004460 con 0x7fc56c158790 2024-09-16T07:33:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.274+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c1f3500 con 0x7fc56c158790 2024-09-16T07:33:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.278+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56c069410 con 0x7fc56c158790 2024-09-16T07:33:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.278+0000 7fc563e00640 1 -- 172.21.15.114:0/1104068769 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc554005020 con 0x7fc56c158790 2024-09-16T07:33:09.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.278+0000 7fc563e00640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc548072fe0 0x7fc5480754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.278+0000 7fc563e00640 1 -- 172.21.15.114:0/1104068769 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7fc5540949a0 con 0x7fc56c158790 2024-09-16T07:33:09.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.278+0000 7fc56b400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc548072fe0 0x7fc5480754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.278+0000 7fc56b400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc548072fe0 0x7fc5480754a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc55c006fd0 tx=0x7fc55c006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.282+0000 7fc563e00640 1 -- 172.21.15.114:0/1104068769 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc55405fd00 con 0x7fc56c158790 2024-09-16T07:33:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.454+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc56c1e8ce0 con 0x7fc56c158790 2024-09-16T07:33:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.454+0000 7fc563e00640 1 -- 172.21.15.114:0/1104068769 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fc55405f600 con 0x7fc56c158790 2024-09-16T07:33:09.454 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:33:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc548072fe0 msgr2=0x7fc5480754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc548072fe0 0x7fc5480754a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc55c006fd0 tx=0x7fc55c006b20 comp rx=0 tx=0).stop 2024-09-16T07:33:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc56c158790 msgr2=0x7fc56c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc56c158790 0x7fc56c1594c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc554011a40 tx=0x7fc554011f00 comp rx=0 tx=0).stop 2024-09-16T07:33:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 shutdown_connections 2024-09-16T07:33:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc56c1e6f20 0x7fc56c1e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc56c158790 0x7fc56c1594c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc548072fe0 0x7fc5480754a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 --2- 172.21.15.114:0/1104068769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5500051d0 0x7fc56c1f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 >> 172.21.15.114:0/1104068769 conn(0x7fc56c0b18f0 msgr2=0x7fc56c15adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 shutdown_connections 2024-09-16T07:33:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.458+0000 7fc572400640 1 -- 172.21.15.114:0/1104068769 wait complete. 2024-09-16T07:33:09.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-16T07:33:09.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 -- 172.21.15.114:0/4200316441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c0b6400 msgr2=0x7f0c8c0ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 --2- 172.21.15.114:0/4200316441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c0b6400 0x7f0c8c0ccdf0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009c80 tx=0x7f0c8401cbc0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 -- 172.21.15.114:0/4200316441 shutdown_connections 2024-09-16T07:33:09.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 --2- 172.21.15.114:0/4200316441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c0b6400 0x7f0c8c0ccdf0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 --2- 172.21.15.114:0/4200316441 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c8c0cebf0 0x7f0c8c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 -- 172.21.15.114:0/4200316441 >> 172.21.15.114:0/4200316441 conn(0x7f0c8c0d1da0 msgr2=0x7f0c8c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 -- 172.21.15.114:0/4200316441 shutdown_connections 2024-09-16T07:33:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.618+0000 7f0c94400640 1 -- 172.21.15.114:0/4200316441 wait complete. 2024-09-16T07:33:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 Processor -- start 2024-09-16T07:33:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 -- start start 2024-09-16T07:33:09.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c8c0b6400 0x7f0c8c149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c8c0cebf0 0x7f0c8c09bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c15be80 0x7f0c8c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c1692b0 con 0x7f0c8c15be80 2024-09-16T07:33:09.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c169130 con 0x7f0c8c0b6400 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c169430 con 0x7f0c8c0cebf0 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c15be80 0x7f0c8c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c15be80 0x7f0c8c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42352/0 (socket says 172.21.15.114:42352) 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 -- 172.21.15.114:0/979433599 learned_addr learned my addr 172.21.15.114:0/979433599 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c91000640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c8c0cebf0 0x7f0c8c09bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c91a00640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c8c0b6400 0x7f0c8c149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 -- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c8c0cebf0 msgr2=0x7f0c8c09bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c8c0cebf0 0x7f0c8c09bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 -- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c8c0b6400 msgr2=0x7f0c8c149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c8c0b6400 0x7f0c8c149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 -- 172.21.15.114:0/979433599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0c5b20 con 0x7f0c8c15be80 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c92400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c15be80 0x7f0c8c06e330 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0c8401c9f0 tx=0x7f0c84009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c89600640 1 -- 172.21.15.114:0/979433599 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c840bb070 con 0x7f0c8c15be80 2024-09-16T07:33:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c89600640 1 -- 172.21.15.114:0/979433599 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c84004e00 con 0x7f0c8c15be80 2024-09-16T07:33:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c89600640 1 -- 172.21.15.114:0/979433599 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c840b2040 con 0x7f0c8c15be80 2024-09-16T07:33:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c0c5e00 con 0x7f0c8c15be80 2024-09-16T07:33:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.622+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c0c63c0 con 0x7f0c8c15be80 2024-09-16T07:33:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.626+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c0ce4e0 con 0x7f0c8c15be80 2024-09-16T07:33:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.626+0000 7f0c89600640 1 -- 172.21.15.114:0/979433599 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f0c840a5aa0 con 0x7f0c8c15be80 2024-09-16T07:33:09.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.626+0000 7f0c89600640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c6c072fe0 0x7f0c6c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:09.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.626+0000 7f0c89600640 1 -- 172.21.15.114:0/979433599 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7f0c8412dc60 con 0x7f0c8c15be80 2024-09-16T07:33:09.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.626+0000 7f0c91a00640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c6c072fe0 0x7f0c6c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:09.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.626+0000 7f0c91a00640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c6c072fe0 0x7f0c6c0754a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c800098e0 tx=0x7f0c80009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.630+0000 7f0c89600640 1 -- 172.21.15.114:0/979433599 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0c8c0d0350 con 0x7f0c8c15be80 2024-09-16T07:33:09.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:09.866+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f0c8c0d2220 con 0x7f0c8c15be80 2024-09-16T07:33:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c89600640 1 -- 172.21.15.114:0/979433599 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v275) ==== 152+0+0 (secure 0 0 0) 0x7f0c840f8840 con 0x7f0c8c15be80 2024-09-16T07:33:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c6c072fe0 msgr2=0x7f0c6c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c6c072fe0 0x7f0c6c0754a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c800098e0 tx=0x7f0c80009060 comp rx=0 tx=0).stop 2024-09-16T07:33:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c15be80 msgr2=0x7f0c8c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c15be80 0x7f0c8c06e330 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0c8401c9f0 tx=0x7f0c84009390 comp rx=0 tx=0).stop 2024-09-16T07:33:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 shutdown_connections 2024-09-16T07:33:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c8c15be80 0x7f0c8c06e330 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0c6c072fe0 0x7f0c6c0754a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0c8c0cebf0 0x7f0c8c09bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 --2- 172.21.15.114:0/979433599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c8c0b6400 0x7f0c8c149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 >> 172.21.15.114:0/979433599 conn(0x7f0c8c0d1da0 msgr2=0x7f0c8c0b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 shutdown_connections 2024-09-16T07:33:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.766+0000 7f0c94400640 1 -- 172.21.15.114:0/979433599 wait complete. 2024-09-16T07:33:10.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:33:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- 172.21.15.114:0/1874395438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0cc2a0 msgr2=0x7f6cec06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/1874395438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0cc2a0 0x7f6cec06eab0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009840 tx=0x7f6cd801c790 comp rx=0 tx=0).stop 2024-09-16T07:33:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- 172.21.15.114:0/1874395438 shutdown_connections 2024-09-16T07:33:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/1874395438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cec0b4cf0 0x7f6cec06eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/1874395438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0cc2a0 0x7f6cec06eab0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- 172.21.15.114:0/1874395438 >> 172.21.15.114:0/1874395438 conn(0x7f6cec0b18f0 msgr2=0x7f6cec0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:10.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- 172.21.15.114:0/1874395438 shutdown_connections 2024-09-16T07:33:10.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- 172.21.15.114:0/1874395438 wait complete. 2024-09-16T07:33:10.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 Processor -- start 2024-09-16T07:33:10.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- start start 2024-09-16T07:33:10.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cec0b4cf0 0x7f6cec1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:10.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec15e260 0x7f6cec09d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:10.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cec09dcc0 0x7f6cec159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec1681c0 con 0x7f6cec15e260 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec168040 con 0x7f6cec09dcc0 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf2e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6cec168340 con 0x7f6cec0b4cf0 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec15e260 0x7f6cec09d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec15e260 0x7f6cec09d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42368/0 (socket says 172.21.15.114:42368) 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 -- 172.21.15.114:0/2732492375 learned_addr learned my addr 172.21.15.114:0/2732492375 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cebe00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cec0b4cf0 0x7f6cec1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 -- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cec0b4cf0 msgr2=0x7f6cec1542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf0e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cec09dcc0 0x7f6cec159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cec0b4cf0 0x7f6cec1542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 -- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cec09dcc0 msgr2=0x7f6cec159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:10.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cec09dcc0 0x7f6cec159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6ceb400640 1 -- 172.21.15.114:0/2732492375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec15ce40 con 0x7f6cec15e260 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cebe00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cec0b4cf0 0x7f6cec1542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.934+0000 7f6cf0e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cec09dcc0 0x7f6cec159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6ceb400640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec15e260 0x7f6cec09d780 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009790 tx=0x7f6cd8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6ce3e00640 1 -- 172.21.15.114:0/2732492375 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80ba020 con 0x7f6cec15e260 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6ce3e00640 1 -- 172.21.15.114:0/2732492375 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cd8005020 con 0x7f6cec15e260 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cec15d0c0 con 0x7f6cec15e260 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6ce3e00640 1 -- 172.21.15.114:0/2732492375 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80b2040 con 0x7f6cec15e260 2024-09-16T07:33:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cec15d680 con 0x7f6cec15e260 2024-09-16T07:33:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec069410 con 0x7f6cec15e260 2024-09-16T07:33:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6ce3e00640 1 -- 172.21.15.114:0/2732492375 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f6cd8005430 con 0x7f6cec15e260 2024-09-16T07:33:10.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6ce3e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ccc073010 0x7f6ccc0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:10.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6ce3e00640 1 -- 172.21.15.114:0/2732492375 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7f6cd812de20 con 0x7f6cec15e260 2024-09-16T07:33:10.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.938+0000 7f6cebe00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ccc073010 0x7f6ccc0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:10.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.942+0000 7f6cebe00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ccc073010 0x7f6ccc0754d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cec158920 tx=0x7f6cdc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:10.942+0000 7f6ce3e00640 1 -- 172.21.15.114:0/2732492375 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6cd80c4020 con 0x7f6cec15e260 2024-09-16T07:33:11.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.110+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6cec1f7f40 con 0x7f6cec15e260 2024-09-16T07:33:11.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.110+0000 7f6ce3e00640 1 -- 172.21.15.114:0/2732492375 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+1998 (secure 0 0 0) 0x7f6cec1f7f40 con 0x7f6cec15e260 2024-09-16T07:33:11.111 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:33:11.111 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:33:11.111 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:33:11.111 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:33:11.112 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:33:11.112 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:33:11.112 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:33:11.112 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:33:11.112 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:33:11.113 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:33:11.113 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:33:11.113 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:33:11.113 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:33:11.113 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:33:11.114 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:33:11.114 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:33:11.114 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:33:11.114 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:33:11.114 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:33:11.115 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:33:11.115 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:33:11.115 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:33:11.115 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:33:11.115 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:33:11.115 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:33:11.116 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:33:11.116 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:33:11.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ccc073010 msgr2=0x7f6ccc0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ccc073010 0x7f6ccc0754d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cec158920 tx=0x7f6cdc009040 comp rx=0 tx=0).stop 2024-09-16T07:33:11.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec15e260 msgr2=0x7f6cec09d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec15e260 0x7f6cec09d780 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009790 tx=0x7f6cd8004040 comp rx=0 tx=0).stop 2024-09-16T07:33:11.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 shutdown_connections 2024-09-16T07:33:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cec09dcc0 0x7f6cec159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec15e260 0x7f6cec09d780 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ccc073010 0x7f6ccc0754d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 --2- 172.21.15.114:0/2732492375 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6cec0b4cf0 0x7f6cec1542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 >> 172.21.15.114:0/2732492375 conn(0x7f6cec0b18f0 msgr2=0x7f6cec0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 shutdown_connections 2024-09-16T07:33:11.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.114+0000 7f6cf2e00640 1 -- 172.21.15.114:0/2732492375 wait complete. 2024-09-16T07:33:11.132 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:33:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 -- 172.21.15.114:0/1115909126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00cdf20 msgr2=0x7f27f00b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 --2- 172.21.15.114:0/1115909126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00cdf20 0x7f27f00b1860 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009bc0 tx=0x7f27e801cb70 comp rx=0 tx=0).stop 2024-09-16T07:33:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 -- 172.21.15.114:0/1115909126 shutdown_connections 2024-09-16T07:33:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 --2- 172.21.15.114:0/1115909126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00cdf20 0x7f27f00b1860 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 --2- 172.21.15.114:0/1115909126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27f00b3bb0 0x7f27f00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 -- 172.21.15.114:0/1115909126 >> 172.21.15.114:0/1115909126 conn(0x7f27f00d1e00 msgr2=0x7f27f00d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 -- 172.21.15.114:0/1115909126 shutdown_connections 2024-09-16T07:33:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 -- 172.21.15.114:0/1115909126 wait complete. 2024-09-16T07:33:11.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 Processor -- start 2024-09-16T07:33:11.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.278+0000 7f27f4a00640 1 -- start start 2024-09-16T07:33:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00b3bb0 0x7f27f00c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27f00cdf20 0x7f27f015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f015f340 0x7f27f00b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0168fd0 con 0x7f27f015f340 2024-09-16T07:33:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0168e50 con 0x7f27f00b3bb0 2024-09-16T07:33:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f27f0169150 con 0x7f27f00cdf20 2024-09-16T07:33:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f015f340 0x7f27f00b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f015f340 0x7f27f00b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42384/0 (socket says 172.21.15.114:42384) 2024-09-16T07:33:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 -- 172.21.15.114:0/387400230 learned_addr learned my addr 172.21.15.114:0/387400230 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ede00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00b3bb0 0x7f27f00c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27e5400640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27f00cdf20 0x7f27f015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 -- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27f00cdf20 msgr2=0x7f27f015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27f00cdf20 0x7f27f015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 -- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00b3bb0 msgr2=0x7f27f00c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00b3bb0 0x7f27f00c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 -- 172.21.15.114:0/387400230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f0163ea0 con 0x7f27f015f340 2024-09-16T07:33:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27e5400640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27f00cdf20 0x7f27f015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:11.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ede00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00b3bb0 0x7f27f00c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27ee800640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f015f340 0x7f27f00b4c50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f27e801a7a0 tx=0x7f27e8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27e6a00640 1 -- 172.21.15.114:0/387400230 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e80b2040 con 0x7f27f015f340 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27e6a00640 1 -- 172.21.15.114:0/387400230 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27e8004d40 con 0x7f27f015f340 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27e6a00640 1 -- 172.21.15.114:0/387400230 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8004240 con 0x7f27f015f340 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f015cff0 con 0x7f27f015f340 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f015d5b0 con 0x7f27f015f340 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.282+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f00b34a0 con 0x7f27f015f340 2024-09-16T07:33:11.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.286+0000 7f27e6a00640 1 -- 172.21.15.114:0/387400230 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f27e80be060 con 0x7f27f015f340 2024-09-16T07:33:11.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.286+0000 7f27e6a00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27cc072fe0 0x7f27cc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.286+0000 7f27e6a00640 1 -- 172.21.15.114:0/387400230 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7f27e812dac0 con 0x7f27f015f340 2024-09-16T07:33:11.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.286+0000 7f27ede00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27cc072fe0 0x7f27cc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.286+0000 7f27ede00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27cc072fe0 0x7f27cc0754a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27e00016b0 tx=0x7f27e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:11.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.290+0000 7f27e6a00640 1 -- 172.21.15.114:0/387400230 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f27e8016790 con 0x7f27f015f340 2024-09-16T07:33:11.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.458+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f27f00762f0 con 0x7f27f015f340 2024-09-16T07:33:11.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27e6a00640 1 -- 172.21.15.114:0/387400230 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f27e80f8c60 con 0x7f27f015f340 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27cc072fe0 msgr2=0x7f27cc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27cc072fe0 0x7f27cc0754a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27e00016b0 tx=0x7f27e0009040 comp rx=0 tx=0).stop 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f015f340 msgr2=0x7f27f00b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f015f340 0x7f27f00b4c50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f27e801a7a0 tx=0x7f27e8009300 comp rx=0 tx=0).stop 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 shutdown_connections 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f015f340 0x7f27f00b4c50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27cc072fe0 0x7f27cc0754a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27f00cdf20 0x7f27f015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 --2- 172.21.15.114:0/387400230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27f00b3bb0 0x7f27f00c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 >> 172.21.15.114:0/387400230 conn(0x7f27f00d1e00 msgr2=0x7f27f006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 shutdown_connections 2024-09-16T07:33:11.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.462+0000 7f27f4a00640 1 -- 172.21.15.114:0/387400230 wait complete. 2024-09-16T07:33:11.481 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:33:11.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:33:11.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:33:11.666 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:33:11.667 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:11.667 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:11.676 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:33:11.676 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:11.677 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:11.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:33:11.690 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:11.690 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:11.727 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:33:11.727 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:11.727 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:11.739 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:33:11.739 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:33:11.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 -- 172.21.15.114:0/1399319400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7015ade0 msgr2=0x7fbd700cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1399319400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7015ade0 0x7fbd700cebf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009900 tx=0x7fbd6001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 -- 172.21.15.114:0/1399319400 shutdown_connections 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1399319400 >> v2:172.21.15.149:3300/0 conn(0x7fbd700b4bd0 0x7fbd700cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1399319400 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7015ade0 0x7fbd700cebf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 -- 172.21.15.114:0/1399319400 >> 172.21.15.114:0/1399319400 conn(0x7fbd700b18f0 msgr2=0x7fbd700b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 -- 172.21.15.114:0/1399319400 shutdown_connections 2024-09-16T07:33:11.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 -- 172.21.15.114:0/1399319400 wait complete. 2024-09-16T07:33:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 Processor -- start 2024-09-16T07:33:11.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 -- start start 2024-09-16T07:33:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7006e810 0x7fbd7014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd700b4bd0 0x7fbd7014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.914+0000 7fbd77c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd7015ade0 0x7fbd701f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd77c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70168140 con 0x7fbd7015ade0 2024-09-16T07:33:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd77c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd70167fc0 con 0x7fbd700b4bd0 2024-09-16T07:33:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd77c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbd701682c0 con 0x7fbd7006e810 2024-09-16T07:33:11.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd7015ade0 0x7fbd701f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7006e810 0x7fbd7014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd7015ade0 0x7fbd701f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42388/0 (socket says 172.21.15.114:42388) 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7006e810 0x7fbd7014e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:39748/0 (socket says 172.21.15.114:39748) 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 -- 172.21.15.114:0/1148275314 learned_addr learned my addr 172.21.15.114:0/1148275314 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd67e00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd700b4bd0 0x7fbd7014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 -- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7006e810 msgr2=0x7fbd7014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7006e810 0x7fbd7014e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 -- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd700b4bd0 msgr2=0x7fbd7014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd700b4bd0 0x7fbd7014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:11.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 -- 172.21.15.114:0/1148275314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7009d610 con 0x7fbd7015ade0 2024-09-16T07:33:11.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75200640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7006e810 0x7fbd7014e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:11.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd75c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd7015ade0 0x7fbd701f7a20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800efd0 tx=0x7fbd6800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd6d600640 1 -- 172.21.15.114:0/1148275314 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68003b80 con 0x7fbd7015ade0 2024-09-16T07:33:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd6d600640 1 -- 172.21.15.114:0/1148275314 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd68003d20 con 0x7fbd7015ade0 2024-09-16T07:33:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd6d600640 1 -- 172.21.15.114:0/1148275314 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68004280 con 0x7fbd7015ade0 2024-09-16T07:33:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7014e330 con 0x7fbd7015ade0 2024-09-16T07:33:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd70073780 con 0x7fbd7015ade0 2024-09-16T07:33:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd70069410 con 0x7fbd7015ade0 2024-09-16T07:33:11.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.918+0000 7fbd6d600640 1 -- 172.21.15.114:0/1148275314 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fbd68004420 con 0x7fbd7015ade0 2024-09-16T07:33:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.922+0000 7fbd6d600640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd4c072fe0 0x7fbd4c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.922+0000 7fbd6d600640 1 -- 172.21.15.114:0/1148275314 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7fbd68094ad0 con 0x7fbd7015ade0 2024-09-16T07:33:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.922+0000 7fbd75200640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd4c072fe0 0x7fbd4c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:11.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.922+0000 7fbd75200640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd4c072fe0 0x7fbd4c0754a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd600af000 tx=0x7fbd6001b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:11.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:11.926+0000 7fbd6d600640 1 -- 172.21.15.114:0/1148275314 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbd6805f740 con 0x7fbd7015ade0 2024-09-16T07:33:12.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.130+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd700cf720 con 0x7fbd7015ade0 2024-09-16T07:33:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd6d600640 1 -- 172.21.15.114:0/1148275314 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3920 (secure 0 0 0) 0x7fbd68064170 con 0x7fbd7015ade0 2024-09-16T07:33:12.132 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:12.132 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":65,"btime":"2024-09-16T07:33:05:575393+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1449286393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1449286393},{"type":"v1","addr":"172.21.15.114:6834","nonce":1449286393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5951,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/2014519392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2014519392},{"type":"v1","addr":"172.21.15.149:6834","nonce":2014519392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6307,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3836721187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":3836721187},{"type":"v1","addr":"172.21.15.149:6835","nonce":3836721187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6828,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/926181044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":926181044},{"type":"v1","addr":"172.21.15.114:6835","nonce":926181044}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[]} 2024-09-16T07:33:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 65 2024-09-16T07:33:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd4c072fe0 msgr2=0x7fbd4c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd4c072fe0 0x7fbd4c0754a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd600af000 tx=0x7fbd6001b120 comp rx=0 tx=0).stop 2024-09-16T07:33:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd7015ade0 msgr2=0x7fbd701f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd7015ade0 0x7fbd701f7a20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800efd0 tx=0x7fbd6800c6a0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 shutdown_connections 2024-09-16T07:33:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd7015ade0 0x7fbd701f7a20 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd700b4bd0 0x7fbd7014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd4c072fe0 0x7fbd4c0754a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 --2- 172.21.15.114:0/1148275314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd7006e810 0x7fbd7014e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 >> 172.21.15.114:0/1148275314 conn(0x7fbd700b18f0 msgr2=0x7fbd70152530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 shutdown_connections 2024-09-16T07:33:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.134+0000 7fbd77c00640 1 -- 172.21.15.114:0/1148275314 wait complete. 2024-09-16T07:33:12.152 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:33:12.152 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:33:12.152 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:33:12.152 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:33:12.153 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:33:12.153 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:33:12.153 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:33:12.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:33:12.153 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:33:12.153 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:33:12.154 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:33:12.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:33:12.154 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:33:12.154 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:33:12.154 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:33:12.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:33:12.167 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:33:12.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:33:12.169 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:33:12.169 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:33:12.170 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:33:12.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:33:12.171 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:33:12.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:33:12.214 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:33:12.214 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:12.215 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:33:12.215 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:12.217 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:33:12.217 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:12.219 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:33:12.219 DEBUG:teuthology.parallel:result is None 2024-09-16T07:33:12.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:33:12.304 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:33:12.305 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:33:12.306 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:33:12.306 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:33:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 -- 172.21.15.114:0/2967838665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e00cdb30 msgr2=0x7fc8e00af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/2967838665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e00cdb30 0x7fc8e00af0c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009bc0 tx=0x7fc8d801cba0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 -- 172.21.15.114:0/2967838665 shutdown_connections 2024-09-16T07:33:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/2967838665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e00cdb30 0x7fc8e00af0c0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 -- 172.21.15.114:0/2967838665 >> 172.21.15.114:0/2967838665 conn(0x7fc8e00d1dc0 msgr2=0x7fc8e00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 -- 172.21.15.114:0/2967838665 shutdown_connections 2024-09-16T07:33:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 -- 172.21.15.114:0/2967838665 wait complete. 2024-09-16T07:33:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 Processor -- start 2024-09-16T07:33:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.370+0000 7fc8e4a00640 1 -- start start 2024-09-16T07:33:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8e00cdb30 0x7fc8e006e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8e00ced80 0x7fc8e0157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e015bea0 0x7fc8e0157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e016a840 con 0x7fc8e015bea0 2024-09-16T07:33:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e016a6c0 con 0x7fc8e00ced80 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc8e016a9c0 con 0x7fc8e00cdb30 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e015bea0 0x7fc8e0157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e015bea0 0x7fc8e0157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42434/0 (socket says 172.21.15.114:42434) 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 -- 172.21.15.114:0/909215204 learned_addr learned my addr 172.21.15.114:0/909215204 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8dd400640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8e00ced80 0x7fc8e0157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8dde00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8e00cdb30 0x7fc8e006e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 -- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8e00cdb30 msgr2=0x7fc8e006e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8e00cdb30 0x7fc8e006e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 -- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8e00ced80 msgr2=0x7fc8e0157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8e00ced80 0x7fc8e0157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 -- 172.21.15.114:0/909215204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e006fd20 con 0x7fc8e015bea0 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8dd400640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8e00ced80 0x7fc8e0157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8de800640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e015bea0 0x7fc8e0157b70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80197b0 tx=0x7fc8d8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8d6000640 1 -- 172.21.15.114:0/909215204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d80bb070 con 0x7fc8e015bea0 2024-09-16T07:33:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8d6000640 1 -- 172.21.15.114:0/909215204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8d8004d40 con 0x7fc8e015bea0 2024-09-16T07:33:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e006fa40 con 0x7fc8e015bea0 2024-09-16T07:33:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8d6000640 1 -- 172.21.15.114:0/909215204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d80b2040 con 0x7fc8e015bea0 2024-09-16T07:33:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e006e0b0 con 0x7fc8e015bea0 2024-09-16T07:33:12.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.374+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e00ce670 con 0x7fc8e015bea0 2024-09-16T07:33:12.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.378+0000 7fc8d6000640 1 -- 172.21.15.114:0/909215204 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc8d80be070 con 0x7fc8e015bea0 2024-09-16T07:33:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.378+0000 7fc8d6000640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8c0072fe0 0x7fc8c00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.378+0000 7fc8d6000640 1 -- 172.21.15.114:0/909215204 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5029+0+0 (secure 0 0 0) 0x7fc8d812da60 con 0x7fc8e015bea0 2024-09-16T07:33:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.378+0000 7fc8dde00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8c0072fe0 0x7fc8c00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.378+0000 7fc8dde00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8c0072fe0 0x7fc8c00754a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0001130 tx=0x7fc8d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:12.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.382+0000 7fc8d6000640 1 -- 172.21.15.114:0/909215204 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc8d80a5e20 con 0x7fc8e015bea0 2024-09-16T07:33:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.558+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc8e00b1090 con 0x7fc8e015bea0 2024-09-16T07:33:12.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.786+0000 7fc8d6000640 1 -- 172.21.15.114:0/909215204 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v93) ==== 97+0+0 (secure 0 0 0) 0x7fc8d8016790 con 0x7fc8e015bea0 2024-09-16T07:33:12.786 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:33:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8c0072fe0 msgr2=0x7fc8c00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8c0072fe0 0x7fc8c00754a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0001130 tx=0x7fc8d0009040 comp rx=0 tx=0).stop 2024-09-16T07:33:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e015bea0 msgr2=0x7fc8e0157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e015bea0 0x7fc8e0157b70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80197b0 tx=0x7fc8d8009220 comp rx=0 tx=0).stop 2024-09-16T07:33:12.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 shutdown_connections 2024-09-16T07:33:12.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e015bea0 0x7fc8e0157b70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8e00ced80 0x7fc8e0157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8c0072fe0 0x7fc8c00754a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 --2- 172.21.15.114:0/909215204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8e00cdb30 0x7fc8e006e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 >> 172.21.15.114:0/909215204 conn(0x7fc8e00d1dc0 msgr2=0x7fc8e00b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:12.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 shutdown_connections 2024-09-16T07:33:12.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.790+0000 7fc8e4a00640 1 -- 172.21.15.114:0/909215204 wait complete. 2024-09-16T07:33:12.812 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:33:12.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 -- 172.21.15.114:0/746970211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898073880 msgr2=0x7f089815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 --2- 172.21.15.114:0/746970211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898073880 0x7f089815ba90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0884009900 tx=0x7f088401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 -- 172.21.15.114:0/746970211 shutdown_connections 2024-09-16T07:33:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 --2- 172.21.15.114:0/746970211 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f089815bfd0 0x7f08980d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 --2- 172.21.15.114:0/746970211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898073880 0x7f089815ba90 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 -- 172.21.15.114:0/746970211 >> 172.21.15.114:0/746970211 conn(0x7f08980d0d40 msgr2=0x7f08980d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 -- 172.21.15.114:0/746970211 shutdown_connections 2024-09-16T07:33:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 -- 172.21.15.114:0/746970211 wait complete. 2024-09-16T07:33:12.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 Processor -- start 2024-09-16T07:33:12.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.954+0000 7f089ca00640 1 -- start start 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0898073880 0x7f089814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898151b30 0x7f08980b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089815bfd0 0x7f08981f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f08980cd090 con 0x7f0898151b30 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f08980ccf10 con 0x7f089815bfd0 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0898168c90 con 0x7f0898073880 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898151b30 0x7f08980b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0898073880 0x7f089814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898151b30 0x7f08980b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42458/0 (socket says 172.21.15.114:42458) 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 -- 172.21.15.114:0/3903440346 learned_addr learned my addr 172.21.15.114:0/3903440346 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0896800640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089815bfd0 0x7f08981f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 -- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0898073880 msgr2=0x7f089814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0898073880 0x7f089814dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 -- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089815bfd0 msgr2=0x7f08981f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089815bfd0 0x7f08981f8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 -- 172.21.15.114:0/3903440346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08980b4170 con 0x7f0898151b30 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895e00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0898073880 0x7f089814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f0895400640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898151b30 0x7f08980b5210 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f08840b0040 tx=0x7f08840a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f088e000640 1 -- 172.21.15.114:0/3903440346 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840b2040 con 0x7f0898151b30 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f088e000640 1 -- 172.21.15.114:0/3903440346 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08840043b0 con 0x7f0898151b30 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08980b4450 con 0x7f0898151b30 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f088e000640 1 -- 172.21.15.114:0/3903440346 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884005290 con 0x7f0898151b30 2024-09-16T07:33:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08980b4a10 con 0x7f0898151b30 2024-09-16T07:33:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.958+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089815ba90 con 0x7f0898151b30 2024-09-16T07:33:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.962+0000 7f088e000640 1 -- 172.21.15.114:0/3903440346 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f08840be060 con 0x7f0898151b30 2024-09-16T07:33:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.962+0000 7f088e000640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0878072fe0 0x7f08780754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.962+0000 7f088e000640 1 -- 172.21.15.114:0/3903440346 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f088412d450 con 0x7f0898151b30 2024-09-16T07:33:12.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.962+0000 7f0895e00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0878072fe0 0x7f08780754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:12.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.962+0000 7f0895e00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0878072fe0 0x7f08780754a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0888007fd0 tx=0x7f0888009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:12.966+0000 7f088e000640 1 -- 172.21.15.114:0/3903440346 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f08840164d0 con 0x7f0898151b30 2024-09-16T07:33:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0898074a00 con 0x7f0898151b30 2024-09-16T07:33:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f088e000640 1 -- 172.21.15.114:0/3903440346 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f08840f80f0 con 0x7f0898151b30 2024-09-16T07:33:13.193 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:13.193 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:13.193 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:33:13.194 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.194 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:33:13.194 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:33:13.194 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.194 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.195 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:33:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.197 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:33:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:33:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.201 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.202 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:33:13.203 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:33:13.204 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.205 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:33:13.206 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.207 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.208 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.209 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:33:13.210 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.211 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.211 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:33:13.211 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0878072fe0 msgr2=0x7f08780754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0878072fe0 0x7f08780754a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0888007fd0 tx=0x7f0888009040 comp rx=0 tx=0).stop 2024-09-16T07:33:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898151b30 msgr2=0x7f08980b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898151b30 0x7f08980b5210 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f08840b0040 tx=0x7f08840a5730 comp rx=0 tx=0).stop 2024-09-16T07:33:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 shutdown_connections 2024-09-16T07:33:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f089815bfd0 0x7f08981f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0898151b30 0x7f08980b5210 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0878072fe0 0x7f08780754a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 --2- 172.21.15.114:0/3903440346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0898073880 0x7f089814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 >> 172.21.15.114:0/3903440346 conn(0x7f08980d0d40 msgr2=0x7f089814ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 shutdown_connections 2024-09-16T07:33:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.194+0000 7f089ca00640 1 -- 172.21.15.114:0/3903440346 wait complete. 2024-09-16T07:33:13.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:33:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.358+0000 7f4c99400640 1 -- 172.21.15.114:0/1228146804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bb90 msgr2=0x7f4c9415f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.358+0000 7f4c99400640 1 --2- 172.21.15.114:0/1228146804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bb90 0x7f4c9415f960 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009840 tx=0x7f4c8401c820 comp rx=0 tx=0).stop 2024-09-16T07:33:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.358+0000 7f4c99400640 1 -- 172.21.15.114:0/1228146804 shutdown_connections 2024-09-16T07:33:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.358+0000 7f4c99400640 1 --2- 172.21.15.114:0/1228146804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bb90 0x7f4c9415f960 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.358+0000 7f4c99400640 1 -- 172.21.15.114:0/1228146804 >> 172.21.15.114:0/1228146804 conn(0x7f4c940d1d90 msgr2=0x7f4c940d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.358+0000 7f4c99400640 1 -- 172.21.15.114:0/1228146804 shutdown_connections 2024-09-16T07:33:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.358+0000 7f4c99400640 1 -- 172.21.15.114:0/1228146804 wait complete. 2024-09-16T07:33:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 Processor -- start 2024-09-16T07:33:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 -- start start 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c940d2940 0x7f4c9406f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c9415bb90 0x7f4c9414e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bf70 0x7f4c9406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94169ec0 con 0x7f4c9415bf70 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4c940b66c0 con 0x7f4c940d2940 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9416a040 con 0x7f4c9415bb90 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bf70 0x7f4c9406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bf70 0x7f4c9406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42466/0 (socket says 172.21.15.114:42466) 2024-09-16T07:33:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c92800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c940d2940 0x7f4c9406f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 -- 172.21.15.114:0/2588019508 learned_addr learned my addr 172.21.15.114:0/2588019508 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c89e00640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c9415bb90 0x7f4c9414e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 -- 172.21.15.114:0/2588019508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c9415bb90 msgr2=0x7f4c9414e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c9415bb90 0x7f4c9414e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 -- 172.21.15.114:0/2588019508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c940d2940 msgr2=0x7f4c9406f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c940d2940 0x7f4c9406f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 -- 172.21.15.114:0/2588019508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9406e7b0 con 0x7f4c9415bf70 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c93200640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bf70 0x7f4c9406dd30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c710 tx=0x7f4c8c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c8b400640 1 -- 172.21.15.114:0/2588019508 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c003b80 con 0x7f4c9415bf70 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c8b400640 1 -- 172.21.15.114:0/2588019508 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8c003d20 con 0x7f4c9415bf70 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9406ea90 con 0x7f4c9415bf70 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c8b400640 1 -- 172.21.15.114:0/2588019508 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00aab0 con 0x7f4c9415bf70 2024-09-16T07:33:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9406f050 con 0x7f4c9415bf70 2024-09-16T07:33:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.362+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c940b53e0 con 0x7f4c9415bf70 2024-09-16T07:33:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.366+0000 7f4c8b400640 1 -- 172.21.15.114:0/2588019508 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f4c8c00ac50 con 0x7f4c9415bf70 2024-09-16T07:33:13.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.366+0000 7f4c8b400640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c70072fe0 0x7f4c700754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.366+0000 7f4c8b400640 1 -- 172.21.15.114:0/2588019508 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f4c8c0943d0 con 0x7f4c9415bf70 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.366+0000 7f4c92800640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c70072fe0 0x7f4c700754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.366+0000 7f4c92800640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c70072fe0 0x7f4c700754a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c840af000 tx=0x7f4c8401b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:13.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.370+0000 7f4c8b400640 1 -- 172.21.15.114:0/2588019508 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4c8c00ce20 con 0x7f4c9415bf70 2024-09-16T07:33:13.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4c94070270 con 0x7f4c9415bf70 2024-09-16T07:33:13.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c8b400640 1 -- 172.21.15.114:0/2588019508 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) ==== 84+0+65 (secure 0 0 0) 0x7f4c8c05f1f0 con 0x7f4c9415bf70 2024-09-16T07:33:13.556 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:13.556 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:33:13.556 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:13.556 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:33:13.557 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:33:13.557 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:13.557 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:33:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c70072fe0 msgr2=0x7f4c700754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c70072fe0 0x7f4c700754a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4c840af000 tx=0x7f4c8401b060 comp rx=0 tx=0).stop 2024-09-16T07:33:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bf70 msgr2=0x7f4c9406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bf70 0x7f4c9406dd30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c710 tx=0x7f4c8c00cbd0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 shutdown_connections 2024-09-16T07:33:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c9415bf70 0x7f4c9406dd30 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c70072fe0 0x7f4c700754a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c9415bb90 0x7f4c9414e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 --2- 172.21.15.114:0/2588019508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c940d2940 0x7f4c9406f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 >> 172.21.15.114:0/2588019508 conn(0x7f4c940d1d90 msgr2=0x7f4c941542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:13.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 shutdown_connections 2024-09-16T07:33:13.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.558+0000 7f4c99400640 1 -- 172.21.15.114:0/2588019508 wait complete. 2024-09-16T07:33:13.578 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:33:13.578 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 -- 172.21.15.114:0/1678572475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73480b0b60 msgr2=0x7f73480ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 --2- 172.21.15.114:0/1678572475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73480b0b60 0x7f73480ccbd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7340009c80 tx=0x7f734001cda0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 -- 172.21.15.114:0/1678572475 shutdown_connections 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 --2- 172.21.15.114:0/1678572475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73480b0b60 0x7f73480ccbd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 --2- 172.21.15.114:0/1678572475 >> v2:172.21.15.149:3300/0 conn(0x7f734815be10 0x7f73480ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 -- 172.21.15.114:0/1678572475 >> 172.21.15.114:0/1678572475 conn(0x7f73480d1da0 msgr2=0x7f73480d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 -- 172.21.15.114:0/1678572475 shutdown_connections 2024-09-16T07:33:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.722+0000 7f734da00640 1 -- 172.21.15.114:0/1678572475 wait complete. 2024-09-16T07:33:13.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 Processor -- start 2024-09-16T07:33:13.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 -- start start 2024-09-16T07:33:13.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b0b60 0x7f734814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734815be10 0x7f734814e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734815c1f0 0x7f73480b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7348169040 con 0x7f734815c1f0 2024-09-16T07:33:13.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7348168ec0 con 0x7f73480b0b60 2024-09-16T07:33:13.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f73481691c0 con 0x7f734815be10 2024-09-16T07:33:13.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7346a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b0b60 0x7f734814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7347400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734815c1f0 0x7f73480b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7346a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b0b60 0x7f734814d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:38012/0 (socket says 172.21.15.114:38012) 2024-09-16T07:33:13.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7346a00640 1 -- 172.21.15.114:0/3517623962 learned_addr learned my addr 172.21.15.114:0/3517623962 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:13.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f733e000640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734815be10 0x7f734814e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7347400640 1 -- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734815be10 msgr2=0x7f734814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7347400640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734815be10 0x7f734814e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7347400640 1 -- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b0b60 msgr2=0x7f734814d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:13.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7347400640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b0b60 0x7f734814d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:13.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7347400640 1 -- 172.21.15.114:0/3517623962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734814f350 con 0x7f734815c1f0 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7346a00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b0b60 0x7f734814d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f7347400640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734815c1f0 0x7f73480b5c90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f73400ac000 tx=0x7f7340009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f733f400640 1 -- 172.21.15.114:0/3517623962 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73400bb070 con 0x7f734815c1f0 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f733f400640 1 -- 172.21.15.114:0/3517623962 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7340004d40 con 0x7f734815c1f0 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f733f400640 1 -- 172.21.15.114:0/3517623962 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73400b2040 con 0x7f734815c1f0 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734814f630 con 0x7f734815c1f0 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.726+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734814fbf0 con 0x7f734815c1f0 2024-09-16T07:33:13.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.730+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73480ccbd0 con 0x7f734815c1f0 2024-09-16T07:33:13.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.730+0000 7f733f400640 1 -- 172.21.15.114:0/3517623962 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f73400a5c60 con 0x7f734815c1f0 2024-09-16T07:33:13.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.730+0000 7f733f400640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7324073010 0x7f73240754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:13.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.730+0000 7f733f400640 1 -- 172.21.15.114:0/3517623962 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f734012d960 con 0x7f734815c1f0 2024-09-16T07:33:13.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.730+0000 7f7346a00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7324073010 0x7f73240754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:13.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.730+0000 7f7346a00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7324073010 0x7f73240754d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7338011550 tx=0x7f73380091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:13.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.734+0000 7f733f400640 1 -- 172.21.15.114:0/3517623962 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7340016990 con 0x7f734815c1f0 2024-09-16T07:33:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:13.906+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7348070350 con 0x7f734815c1f0 2024-09-16T07:33:14.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f733f400640 1 -- 172.21.15.114:0/3517623962 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) ==== 138+0+0 (secure 0 0 0) 0x7f73400f8680 con 0x7f734815c1f0 2024-09-16T07:33:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7324073010 msgr2=0x7f73240754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7324073010 0x7f73240754d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7338011550 tx=0x7f73380091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734815c1f0 msgr2=0x7f73480b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734815c1f0 0x7f73480b5c90 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f73400ac000 tx=0x7f7340009330 comp rx=0 tx=0).stop 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 shutdown_connections 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f734815c1f0 0x7f73480b5c90 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7324073010 0x7f73240754d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f734815be10 0x7f734814e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 --2- 172.21.15.114:0/3517623962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73480b0b60 0x7f734814d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 >> 172.21.15.114:0/3517623962 conn(0x7f73480d1da0 msgr2=0x7f7348151040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:14.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 shutdown_connections 2024-09-16T07:33:14.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.794+0000 7f734da00640 1 -- 172.21.15.114:0/3517623962 wait complete. 2024-09-16T07:33:14.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:33:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.974+0000 7f18e8200640 1 -- 172.21.15.114:0/3249709388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c8003f80 msgr2=0x7f18c8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.974+0000 7f18e8200640 1 --2- 172.21.15.114:0/3249709388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18c8003f80 0x7f18c8004810 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f18e00af4b0 tx=0x7f18cc01c7c0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.974+0000 7f18e6200640 1 -- 172.21.15.114:0/3249709388 reap_dead start 2024-09-16T07:33:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.974+0000 7f18e8200640 1 -- 172.21.15.114:0/3249709388 shutdown_connections 2024-09-16T07:33:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.974+0000 7f18e8200640 1 -- 172.21.15.114:0/3249709388 >> 172.21.15.114:0/3249709388 conn(0x7f18e00b18f0 msgr2=0x7f18e00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.974+0000 7f18e8200640 1 -- 172.21.15.114:0/3249709388 shutdown_connections 2024-09-16T07:33:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.974+0000 7f18e8200640 1 -- 172.21.15.114:0/3249709388 wait complete. 2024-09-16T07:33:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 Processor -- start 2024-09-16T07:33:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 -- start start 2024-09-16T07:33:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18c8003f80 0x7f18e01facb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e01f90f0 0x7f18e01fb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e01fbb10 0x7f18e0073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0167080 con 0x7f18e01f90f0 2024-09-16T07:33:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0166f00 con 0x7f18e01fbb10 2024-09-16T07:33:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f18e0167200 con 0x7f18c8003f80 2024-09-16T07:33:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e01f90f0 0x7f18e01fb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e01f90f0 0x7f18e01fb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35534/0 (socket says 172.21.15.114:35534) 2024-09-16T07:33:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 -- 172.21.15.114:0/4065504985 learned_addr learned my addr 172.21.15.114:0/4065504985 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:14.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e6200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e01fbb10 0x7f18e0073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:14.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e5800640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18c8003f80 0x7f18e01facb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 -- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18c8003f80 msgr2=0x7f18e01facb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18c8003f80 0x7f18e01facb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 -- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e01fbb10 msgr2=0x7f18e0073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e01fbb10 0x7f18e0073280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 -- 172.21.15.114:0/4065504985 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e015a5f0 con 0x7f18e01f90f0 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e5800640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18c8003f80 0x7f18e01facb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e6200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e01fbb10 0x7f18e0073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e4e00640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e01f90f0 0x7f18e01fb5d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f18cc01c5f0 tx=0x7f18cc0013f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18dd600640 1 -- 172.21.15.114:0/4065504985 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0048f0 con 0x7f18e01f90f0 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18dd600640 1 -- 172.21.15.114:0/4065504985 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18cc004a90 con 0x7f18e01f90f0 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e009bf50 con 0x7f18e01f90f0 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18dd600640 1 -- 172.21.15.114:0/4065504985 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0bc430 con 0x7f18e01f90f0 2024-09-16T07:33:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e009c1d0 con 0x7f18e01f90f0 2024-09-16T07:33:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.978+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e01fbf20 con 0x7f18e01f90f0 2024-09-16T07:33:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.982+0000 7f18dd600640 1 -- 172.21.15.114:0/4065504985 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f18cc0c5440 con 0x7f18e01f90f0 2024-09-16T07:33:14.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.982+0000 7f18dd600640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f18c0073010 0x7f18c00754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:14.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.982+0000 7f18dd600640 1 -- 172.21.15.114:0/4065504985 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5227+0+0 (secure 0 0 0) 0x7f18cc12eea0 con 0x7f18e01f90f0 2024-09-16T07:33:14.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.982+0000 7f18e5800640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f18c0073010 0x7f18c00754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:14.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.982+0000 7f18e5800640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f18c0073010 0x7f18c00754d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009aa0 tx=0x7f18d40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:14.986+0000 7f18dd600640 1 -- 172.21.15.114:0/4065504985 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f18e01fbf20 con 0x7f18e01f90f0 2024-09-16T07:33:15.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.154+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f18e015e8e0 con 0x7f18e01f90f0 2024-09-16T07:33:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.794+0000 7f18dd600640 1 -- 172.21.15.114:0/4065504985 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) ==== 170+0+0 (secure 0 0 0) 0x7f18e009bf50 con 0x7f18e01f90f0 2024-09-16T07:33:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f18c0073010 msgr2=0x7f18c00754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f18c0073010 0x7f18c00754d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009aa0 tx=0x7f18d40091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e01f90f0 msgr2=0x7f18e01fb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e01f90f0 0x7f18e01fb5d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f18cc01c5f0 tx=0x7f18cc0013f0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 shutdown_connections 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18e01fbb10 0x7f18e0073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e01f90f0 0x7f18e01fb5d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f18c0073010 0x7f18c00754d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 --2- 172.21.15.114:0/4065504985 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18c8003f80 0x7f18e01facb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 >> 172.21.15.114:0/4065504985 conn(0x7f18e00b18f0 msgr2=0x7f18e00ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 shutdown_connections 2024-09-16T07:33:15.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.798+0000 7f18e8200640 1 -- 172.21.15.114:0/4065504985 wait complete. 2024-09-16T07:33:15.836 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:33:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 -- 172.21.15.114:0/1608103196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe84c004d50 msgr2=0x7fe84c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 --2- 172.21.15.114:0/1608103196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe84c004d50 0x7fe84c0051d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c640 tx=0x7fe86001fa80 comp rx=0 tx=0).stop 2024-09-16T07:33:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe866800640 1 -- 172.21.15.114:0/1608103196 reap_dead start 2024-09-16T07:33:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 -- 172.21.15.114:0/1608103196 shutdown_connections 2024-09-16T07:33:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 -- 172.21.15.114:0/1608103196 >> 172.21.15.114:0/1608103196 conn(0x7fe86809d0c0 msgr2=0x7fe8680d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 -- 172.21.15.114:0/1608103196 shutdown_connections 2024-09-16T07:33:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 -- 172.21.15.114:0/1608103196 wait complete. 2024-09-16T07:33:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 Processor -- start 2024-09-16T07:33:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.982+0000 7fe867200640 1 -- start start 2024-09-16T07:33:15.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe84c004d50 0x7fe8681560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:15.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8680c7930 0x7fe8680c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8680c82f0 0x7fe8680b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680d4a50 con 0x7fe8680c82f0 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8680b31f0 con 0x7fe84c004d50 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe8680d4bd0 con 0x7fe8680c7930 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8680c82f0 0x7fe8680b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8680c82f0 0x7fe8680b7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35560/0 (socket says 172.21.15.114:35560) 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 -- 172.21.15.114:0/302936114 learned_addr learned my addr 172.21.15.114:0/302936114 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe865e00640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe84c004d50 0x7fe8681560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe85d400640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8680c7930 0x7fe8680c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 -- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8680c7930 msgr2=0x7fe8680c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8680c7930 0x7fe8680c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 -- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe84c004d50 msgr2=0x7fe8681560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe84c004d50 0x7fe8681560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 -- 172.21.15.114:0/302936114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8680c8770 con 0x7fe8680c82f0 2024-09-16T07:33:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe866800640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8680c82f0 0x7fe8680b7560 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe86009c370 tx=0x7fe8600a9450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe85ea00640 1 -- 172.21.15.114:0/302936114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860003980 con 0x7fe8680c82f0 2024-09-16T07:33:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe85ea00640 1 -- 172.21.15.114:0/302936114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe860003b20 con 0x7fe8680c82f0 2024-09-16T07:33:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe868156630 con 0x7fe8680c82f0 2024-09-16T07:33:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe85ea00640 1 -- 172.21.15.114:0/302936114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8600a9650 con 0x7fe8680c82f0 2024-09-16T07:33:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8680b8fe0 con 0x7fe8680c82f0 2024-09-16T07:33:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.986+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8680d2530 con 0x7fe8680c82f0 2024-09-16T07:33:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.990+0000 7fe85ea00640 1 -- 172.21.15.114:0/302936114 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fe8600ba030 con 0x7fe8680c82f0 2024-09-16T07:33:15.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.990+0000 7fe85ea00640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe844073010 0x7fe8440754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:15.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.990+0000 7fe85ea00640 1 -- 172.21.15.114:0/302936114 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5609+0+0 (secure 0 0 0) 0x7fe860130f90 con 0x7fe8680c82f0 2024-09-16T07:33:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.990+0000 7fe865e00640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe844073010 0x7fe8440754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.990+0000 7fe865e00640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe844073010 0x7fe8440754d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8680d1100 tx=0x7fe85800d390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:15.994+0000 7fe85ea00640 1 -- 172.21.15.114:0/302936114 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe868156630 con 0x7fe8680c82f0 2024-09-16T07:33:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.198+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe86808d540 con 0x7fe8680c82f0 2024-09-16T07:33:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.826+0000 7fe85ea00640 1 -- 172.21.15.114:0/302936114 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v68) ==== 174+0+0 (secure 0 0 0) 0x7fe860019830 con 0x7fe8680c82f0 2024-09-16T07:33:16.825 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 16 and data pool 17 2024-09-16T07:33:16.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe844073010 msgr2=0x7fe8440754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:16.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe844073010 0x7fe8440754d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8680d1100 tx=0x7fe85800d390 comp rx=0 tx=0).stop 2024-09-16T07:33:16.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8680c82f0 msgr2=0x7fe8680b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:16.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8680c82f0 0x7fe8680b7560 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe86009c370 tx=0x7fe8600a9450 comp rx=0 tx=0).stop 2024-09-16T07:33:16.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 shutdown_connections 2024-09-16T07:33:16.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8680c82f0 0x7fe8680b7560 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:16.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe844073010 0x7fe8440754d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:16.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8680c7930 0x7fe8680c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:16.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 --2- 172.21.15.114:0/302936114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe84c004d50 0x7fe8681560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:16.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 >> 172.21.15.114:0/302936114 conn(0x7fe86809d0c0 msgr2=0x7fe86806e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:16.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 shutdown_connections 2024-09-16T07:33:16.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:16.830+0000 7fe867200640 1 -- 172.21.15.114:0/302936114 wait complete. 2024-09-16T07:33:16.866 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 -- 172.21.15.114:0/2175524487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 msgr2=0x7fcd400cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 --2- 172.21.15.114:0/2175524487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd400cea20 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fcd40073d80 tx=0x7fcd2c01c6e0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 -- 172.21.15.114:0/2175524487 shutdown_connections 2024-09-16T07:33:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 --2- 172.21.15.114:0/2175524487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd400cea20 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 --2- 172.21.15.114:0/2175524487 >> v2:172.21.15.149:3300/0 conn(0x7fcd4015be80 0x7fcd400ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 -- 172.21.15.114:0/2175524487 >> 172.21.15.114:0/2175524487 conn(0x7fcd400d1da0 msgr2=0x7fcd400d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 -- 172.21.15.114:0/2175524487 shutdown_connections 2024-09-16T07:33:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.006+0000 7fcd45800640 1 -- 172.21.15.114:0/2175524487 wait complete. 2024-09-16T07:33:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 Processor -- start 2024-09-16T07:33:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 -- start start 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd400b53f0 0x7fcd40147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd4015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4015be80 0x7fcd400c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401691c0 con 0x7fcd400d28c0 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd40169040 con 0x7fcd400b53f0 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd40169340 con 0x7fcd4015be80 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd4015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd4015e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35582/0 (socket says 172.21.15.114:35582) 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 -- 172.21.15.114:0/184008544 learned_addr learned my addr 172.21.15.114:0/184008544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3ea00640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd400b53f0 0x7fcd40147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3f400640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4015be80 0x7fcd400c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 -- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4015be80 msgr2=0x7fcd400c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4015be80 0x7fcd400c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 -- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd400b53f0 msgr2=0x7fcd40147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd400b53f0 0x7fcd40147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 -- 172.21.15.114:0/184008544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4015ed80 con 0x7fcd400d28c0 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3f400640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4015be80 0x7fcd400c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd3e000640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd4015e3a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c01c510 tx=0x7fcd2c0a94f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd36a00640 1 -- 172.21.15.114:0/184008544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0ad040 con 0x7fcd400d28c0 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd36a00640 1 -- 172.21.15.114:0/184008544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd2c0053e0 con 0x7fcd400d28c0 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd36a00640 1 -- 172.21.15.114:0/184008544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0aaa50 con 0x7fcd400d28c0 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.010+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4015f060 con 0x7fcd400d28c0 2024-09-16T07:33:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.014+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd401642d0 con 0x7fcd400d28c0 2024-09-16T07:33:17.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.014+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd400b57f0 con 0x7fcd400d28c0 2024-09-16T07:33:17.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.014+0000 7fcd36a00640 1 -- 172.21.15.114:0/184008544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fcd2c0b0070 con 0x7fcd400d28c0 2024-09-16T07:33:17.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.014+0000 7fcd36a00640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd20072fe0 0x7fcd200754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.014+0000 7fcd36a00640 1 -- 172.21.15.114:0/184008544 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fcd2c12ea00 con 0x7fcd400d28c0 2024-09-16T07:33:17.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.014+0000 7fcd3ea00640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd20072fe0 0x7fcd200754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.014+0000 7fcd3ea00640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd20072fe0 0x7fcd200754a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009e50 tx=0x7fcd300095e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:17.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.018+0000 7fcd36a00640 1 -- 172.21.15.114:0/184008544 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcd2c0c3030 con 0x7fcd400d28c0 2024-09-16T07:33:17.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd400d2320 con 0x7fcd400d28c0 2024-09-16T07:33:17.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd36a00640 1 -- 172.21.15.114:0/184008544 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16737 (secure 0 0 0) 0x7fcd400d0350 con 0x7fcd400d28c0 2024-09-16T07:33:17.189 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:17.189 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":98,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:16.201741+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:33:13.921061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-16T07:33:15.169498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:17.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd20072fe0 msgr2=0x7fcd200754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd20072fe0 0x7fcd200754a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd30009e50 tx=0x7fcd300095e0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 msgr2=0x7fcd4015e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd4015e3a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c01c510 tx=0x7fcd2c0a94f0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 shutdown_connections 2024-09-16T07:33:17.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd20072fe0 0x7fcd200754a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd4015be80 0x7fcd400c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd400d28c0 0x7fcd4015e3a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 --2- 172.21.15.114:0/184008544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd400b53f0 0x7fcd40147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 >> 172.21.15.114:0/184008544 conn(0x7fcd400d1da0 msgr2=0x7fcd4015a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 shutdown_connections 2024-09-16T07:33:17.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.190+0000 7fcd45800640 1 -- 172.21.15.114:0/184008544 wait complete. 2024-09-16T07:33:17.210 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:17.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- 172.21.15.114:0/916730997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f829415b580 msgr2=0x7f829415b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 --2- 172.21.15.114:0/916730997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f829415b580 0x7f829415b960 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8284009bc0 tx=0x7f828401cba0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- 172.21.15.114:0/916730997 shutdown_connections 2024-09-16T07:33:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 --2- 172.21.15.114:0/916730997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f829415b580 0x7f829415b960 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- 172.21.15.114:0/916730997 >> 172.21.15.114:0/916730997 conn(0x7f82940b18f0 msgr2=0x7f82940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- 172.21.15.114:0/916730997 shutdown_connections 2024-09-16T07:33:17.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- 172.21.15.114:0/916730997 wait complete. 2024-09-16T07:33:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 Processor -- start 2024-09-16T07:33:17.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- start start 2024-09-16T07:33:17.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b3300 0x7f829409d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940b4bd0 0x7f829414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829415b580 0x7f82941f9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8294169340 con 0x7f82940b3300 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82941691c0 con 0x7f82940b4bd0 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8299400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f82941694c0 con 0x7f829415b580 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8292800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b3300 0x7f829409d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.354+0000 7f8292800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b3300 0x7f829409d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35606/0 (socket says 172.21.15.114:35606) 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8292800640 1 -- 172.21.15.114:0/2287331623 learned_addr learned my addr 172.21.15.114:0/2287331623 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8289e00640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940b4bd0 0x7f829414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8293200640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829415b580 0x7f82941f9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8292800640 1 -- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829415b580 msgr2=0x7f82941f9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8292800640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829415b580 0x7f82941f9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8292800640 1 -- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940b4bd0 msgr2=0x7f829414e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8292800640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940b4bd0 0x7f829414e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8292800640 1 -- 172.21.15.114:0/2287331623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8294166790 con 0x7f82940b3300 2024-09-16T07:33:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8292800640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b3300 0x7f829409d0f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8284009b10 tx=0x7f82840a5a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:17.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f828b400640 1 -- 172.21.15.114:0/2287331623 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840bc070 con 0x7f82940b3300 2024-09-16T07:33:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f828b400640 1 -- 172.21.15.114:0/2287331623 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82840043b0 con 0x7f82940b3300 2024-09-16T07:33:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f828b400640 1 -- 172.21.15.114:0/2287331623 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82840b2040 con 0x7f82940b3300 2024-09-16T07:33:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829409d780 con 0x7f82940b3300 2024-09-16T07:33:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829414dfd0 con 0x7f82940b3300 2024-09-16T07:33:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829415b960 con 0x7f82940b3300 2024-09-16T07:33:17.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.358+0000 7f828b400640 1 -- 172.21.15.114:0/2287331623 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f82840bf070 con 0x7f82940b3300 2024-09-16T07:33:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.362+0000 7f828b400640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8270072fe0 0x7f82700754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.362+0000 7f828b400640 1 -- 172.21.15.114:0/2287331623 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f828412de00 con 0x7f82940b3300 2024-09-16T07:33:17.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.362+0000 7f8289e00640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8270072fe0 0x7f82700754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.362+0000 7f8289e00640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8270072fe0 0x7f82700754a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f829415c7a0 tx=0x7f827c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:17.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.362+0000 7f828b400640 1 -- 172.21.15.114:0/2287331623 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f82840a5e20 con 0x7f82940b3300 2024-09-16T07:33:17.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.534+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82940b0df0 con 0x7f82940b3300 2024-09-16T07:33:17.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.534+0000 7f828b400640 1 -- 172.21.15.114:0/2287331623 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16737 (secure 0 0 0) 0x7f8284016790 con 0x7f82940b3300 2024-09-16T07:33:17.533 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:17.534 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":98,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:16.201741+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:33:13.921061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-16T07:33:15.169498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8270072fe0 msgr2=0x7f82700754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8270072fe0 0x7f82700754a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f829415c7a0 tx=0x7f827c009040 comp rx=0 tx=0).stop 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b3300 msgr2=0x7f829409d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b3300 0x7f829409d0f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8284009b10 tx=0x7f82840a5a00 comp rx=0 tx=0).stop 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 shutdown_connections 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8270072fe0 0x7f82700754a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f829415b580 0x7f82941f9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f82940b4bd0 0x7f829414e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 --2- 172.21.15.114:0/2287331623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82940b3300 0x7f829409d0f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 >> 172.21.15.114:0/2287331623 conn(0x7f82940b18f0 msgr2=0x7f82940b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 shutdown_connections 2024-09-16T07:33:17.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.538+0000 7f8299400640 1 -- 172.21.15.114:0/2287331623 wait complete. 2024-09-16T07:33:17.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:33:17.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 -- 172.21.15.114:0/665430097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e00d22c0 msgr2=0x7f93e00cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 --2- 172.21.15.114:0/665430097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e00d22c0 0x7f93e00cc620 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009840 tx=0x7f93d801c820 comp rx=0 tx=0).stop 2024-09-16T07:33:17.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 -- 172.21.15.114:0/665430097 shutdown_connections 2024-09-16T07:33:17.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 --2- 172.21.15.114:0/665430097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e00d22c0 0x7f93e00cc620 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 --2- 172.21.15.114:0/665430097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93e015bd40 0x7f93e00d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 -- 172.21.15.114:0/665430097 >> 172.21.15.114:0/665430097 conn(0x7f93e009aa10 msgr2=0x7f93e009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:17.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 -- 172.21.15.114:0/665430097 shutdown_connections 2024-09-16T07:33:17.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 -- 172.21.15.114:0/665430097 wait complete. 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 Processor -- start 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.702+0000 7f93e4a00640 1 -- start start 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93e00b0d10 0x7f93e00b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e00d22c0 0x7f93e014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e015bd40 0x7f93e014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f93e0168c50 con 0x7f93e00d22c0 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93e0168ad0 con 0x7f93e015bd40 2024-09-16T07:33:17.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f93e0168dd0 con 0x7f93e00b0d10 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e00d22c0 0x7f93e014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e00d22c0 0x7f93e014f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35612/0 (socket says 172.21.15.114:35612) 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 -- 172.21.15.114:0/1730368473 learned_addr learned my addr 172.21.15.114:0/1730368473 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93df400640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93e00b0d10 0x7f93e00b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93dfe00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e015bd40 0x7f93e014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 -- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93e00b0d10 msgr2=0x7f93e00b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93e00b0d10 0x7f93e00b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 -- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e015bd40 msgr2=0x7f93e014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e015bd40 0x7f93e014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 -- 172.21.15.114:0/1730368473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e014dd10 con 0x7f93e00d22c0 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d6a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e00d22c0 0x7f93e014f3f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c490 tx=0x7f93c800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d7e00640 1 -- 172.21.15.114:0/1730368473 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8016020 con 0x7f93e00d22c0 2024-09-16T07:33:17.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d7e00640 1 -- 172.21.15.114:0/1730368473 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93c8012940 con 0x7f93e00d22c0 2024-09-16T07:33:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93d7e00640 1 -- 172.21.15.114:0/1730368473 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8012d90 con 0x7f93e00d22c0 2024-09-16T07:33:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e01fb880 con 0x7f93e00d22c0 2024-09-16T07:33:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e01fafe0 con 0x7f93e00d22c0 2024-09-16T07:33:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.706+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e00b6210 con 0x7f93e00d22c0 2024-09-16T07:33:17.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.710+0000 7f93d7e00640 1 -- 172.21.15.114:0/1730368473 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f93c8019020 con 0x7f93e00d22c0 2024-09-16T07:33:17.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.710+0000 7f93d7e00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f93bc072fe0 0x7f93bc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:17.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.710+0000 7f93d7e00640 1 -- 172.21.15.114:0/1730368473 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f93c8093cb0 con 0x7f93e00d22c0 2024-09-16T07:33:17.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.710+0000 7f93df400640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f93bc072fe0 0x7f93bc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:17.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.710+0000 7f93df400640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f93bc072fe0 0x7f93bc0754a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93e015c790 tx=0x7f93d0009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:17.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.714+0000 7f93d7e00640 1 -- 172.21.15.114:0/1730368473 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f93c8020030 con 0x7f93e00d22c0 2024-09-16T07:33:17.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:17.922+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f93e00cc620 con 0x7f93e00d22c0 2024-09-16T07:33:18.183 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:33:18.187 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:33:18.792 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-09-16T07:33:18.794+0000 7f01f6800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:33:18.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.834+0000 7f93d7e00640 1 -- 172.21.15.114:0/1730368473 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) ==== 118+0+0 (secure 0 0 0) 0x7f93c805e740 con 0x7f93e00d22c0 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f93bc072fe0 msgr2=0x7f93bc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f93bc072fe0 0x7f93bc0754a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93e015c790 tx=0x7f93d0009500 comp rx=0 tx=0).stop 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e00d22c0 msgr2=0x7f93e014f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e00d22c0 0x7f93e014f3f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c490 tx=0x7f93c800c950 comp rx=0 tx=0).stop 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 shutdown_connections 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e015bd40 0x7f93e014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93e00d22c0 0x7f93e014f3f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:18.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f93bc072fe0 0x7f93bc0754a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:18.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 --2- 172.21.15.114:0/1730368473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93e00b0d10 0x7f93e00b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:18.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 >> 172.21.15.114:0/1730368473 conn(0x7f93e009aa10 msgr2=0x7f93e006e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:18.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 shutdown_connections 2024-09-16T07:33:18.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:18.838+0000 7f93e4a00640 1 -- 172.21.15.114:0/1730368473 wait complete. 2024-09-16T07:33:18.858 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:33:18.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:33:19.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.002+0000 7f93b9800640 1 -- 172.21.15.114:0/4207187806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b40b1650 msgr2=0x7f93b40b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.002+0000 7f93b9800640 1 --2- 172.21.15.114:0/4207187806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b40b1650 0x7f93b40b1a30 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f939c009840 tx=0x7f939c01c820 comp rx=0 tx=0).stop 2024-09-16T07:33:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.002+0000 7f93b9800640 1 -- 172.21.15.114:0/4207187806 shutdown_connections 2024-09-16T07:33:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.002+0000 7f93b9800640 1 --2- 172.21.15.114:0/4207187806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b40b1650 0x7f93b40b1a30 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.002+0000 7f93b9800640 1 -- 172.21.15.114:0/4207187806 >> 172.21.15.114:0/4207187806 conn(0x7f93b40d1dd0 msgr2=0x7f93b40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.002+0000 7f93b9800640 1 -- 172.21.15.114:0/4207187806 shutdown_connections 2024-09-16T07:33:19.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.002+0000 7f93b9800640 1 -- 172.21.15.114:0/4207187806 wait complete. 2024-09-16T07:33:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 Processor -- start 2024-09-16T07:33:19.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 -- start start 2024-09-16T07:33:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b40afb10 0x7f93b415b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b40b1650 0x7f93b40b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:19.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b41605d0 0x7f93b4071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f93b40b13a0 con 0x7f93b41605d0 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93b40b1220 con 0x7f93b40b1650 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f93b416a550 con 0x7f93b40afb10 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b41605d0 0x7f93b4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b41605d0 0x7f93b4071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35620/0 (socket says 172.21.15.114:35620) 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 -- 172.21.15.114:0/3900572761 learned_addr learned my addr 172.21.15.114:0/3900572761 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93aa000640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b40b1650 0x7f93b40b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b2a00640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b40afb10 0x7f93b415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 -- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b40afb10 msgr2=0x7f93b415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b40afb10 0x7f93b415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 -- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b40b1650 msgr2=0x7f93b40b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:19.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b40b1650 0x7f93b40b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 -- 172.21.15.114:0/3900572761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b41674f0 con 0x7f93b41605d0 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b3400640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b41605d0 0x7f93b4071870 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c7a0 tx=0x7f93ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93ab400640 1 -- 172.21.15.114:0/3900572761 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac017070 con 0x7f93b41605d0 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93ab400640 1 -- 172.21.15.114:0/3900572761 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93ac005070 con 0x7f93b41605d0 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93ab400640 1 -- 172.21.15.114:0/3900572761 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac0054c0 con 0x7f93b41605d0 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b41677d0 con 0x7f93b41605d0 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.006+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b415c4c0 con 0x7f93b41605d0 2024-09-16T07:33:19.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.010+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b40d0690 con 0x7f93b41605d0 2024-09-16T07:33:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.010+0000 7f93ab400640 1 -- 172.21.15.114:0/3900572761 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f93ac01a070 con 0x7f93b41605d0 2024-09-16T07:33:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.010+0000 7f93ab400640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9390073010 0x7f93900754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:19.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.010+0000 7f93ab400640 1 -- 172.21.15.114:0/3900572761 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f93ac093610 con 0x7f93b41605d0 2024-09-16T07:33:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.010+0000 7f93b2a00640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9390073010 0x7f93900754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:19.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.010+0000 7f93b2a00640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9390073010 0x7f93900754d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007fd0 tx=0x7f93a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.014+0000 7f93ab400640 1 -- 172.21.15.114:0/3900572761 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f93ac05dff0 con 0x7f93b41605d0 2024-09-16T07:33:19.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.214+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f93b40d1080 con 0x7f93b41605d0 2024-09-16T07:33:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.838+0000 7f93ab400640 1 -- 172.21.15.114:0/3900572761 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) ==== 122+0+0 (secure 0 0 0) 0x7f93ac062a20 con 0x7f93b41605d0 2024-09-16T07:33:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.838+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9390073010 msgr2=0x7f93900754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.838+0000 7f93b9800640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9390073010 0x7f93900754d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93a4007fd0 tx=0x7f93a4009040 comp rx=0 tx=0).stop 2024-09-16T07:33:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b41605d0 msgr2=0x7f93b4071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b41605d0 0x7f93b4071870 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c7a0 tx=0x7f93ac00cc60 comp rx=0 tx=0).stop 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 shutdown_connections 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93b41605d0 0x7f93b4071870 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93b40b1650 0x7f93b40b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9390073010 0x7f93900754d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 --2- 172.21.15.114:0/3900572761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93b40afb10 0x7f93b415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 >> 172.21.15.114:0/3900572761 conn(0x7f93b40d1dd0 msgr2=0x7f93b40ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 shutdown_connections 2024-09-16T07:33:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:19.842+0000 7f93b9800640 1 -- 172.21.15.114:0/3900572761 wait complete. 2024-09-16T07:33:19.860 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:33:19.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:20.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.002+0000 7f97dec00640 1 -- 172.21.15.114:0/1206395269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d80cdb30 msgr2=0x7f97d80cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.002+0000 7f97dec00640 1 --2- 172.21.15.114:0/1206395269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d80cdb30 0x7f97d80cebb0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f97d80cdf50 tx=0x7f97c001c8c0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.002+0000 7f97dec00640 1 -- 172.21.15.114:0/1206395269 shutdown_connections 2024-09-16T07:33:20.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.002+0000 7f97dec00640 1 --2- 172.21.15.114:0/1206395269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d80cdb30 0x7f97d80cebb0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.002+0000 7f97dec00640 1 --2- 172.21.15.114:0/1206395269 >> v2:172.21.15.149:3300/0 conn(0x7f97d80d28e0 0x7f97d80cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.002+0000 7f97dec00640 1 --2- 172.21.15.114:0/1206395269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97d815bea0 0x7f97d80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.002+0000 7f97dec00640 1 -- 172.21.15.114:0/1206395269 >> 172.21.15.114:0/1206395269 conn(0x7f97d80d1dc0 msgr2=0x7f97d80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:20.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 -- 172.21.15.114:0/1206395269 shutdown_connections 2024-09-16T07:33:20.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 -- 172.21.15.114:0/1206395269 wait complete. 2024-09-16T07:33:20.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 Processor -- start 2024-09-16T07:33:20.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 -- start start 2024-09-16T07:33:20.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97d80cdb30 0x7f97d81572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d80d28e0 0x7f97d8158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d815bea0 0x7f97d81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97d80af0a0 con 0x7f97d815bea0 2024-09-16T07:33:20.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f97d80aef20 con 0x7f97d80d28e0 2024-09-16T07:33:20.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f97d80af220 con 0x7f97d80cdb30 2024-09-16T07:33:20.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d815bea0 0x7f97d81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97cfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d80d28e0 0x7f97d8158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d815bea0 0x7f97d81529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35630/0 (socket says 172.21.15.114:35630) 2024-09-16T07:33:20.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 -- 172.21.15.114:0/749115895 learned_addr learned my addr 172.21.15.114:0/749115895 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:20.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97d7e00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97d80cdb30 0x7f97d81572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 -- 172.21.15.114:0/749115895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97d80cdb30 msgr2=0x7f97d81572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97d80cdb30 0x7f97d81572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 -- 172.21.15.114:0/749115895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d80d28e0 msgr2=0x7f97d8158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d80d28e0 0x7f97d8158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 -- 172.21.15.114:0/749115895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d81578b0 con 0x7f97d815bea0 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97dcc00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d815bea0 0x7f97d81529c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f97d000e9c0 tx=0x7f97d000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97d4c00640 1 -- 172.21.15.114:0/749115895 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d000cd80 con 0x7f97d815bea0 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97d4c00640 1 -- 172.21.15.114:0/749115895 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97d0004b30 con 0x7f97d815bea0 2024-09-16T07:33:20.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.006+0000 7f97d4c00640 1 -- 172.21.15.114:0/749115895 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0005020 con 0x7f97d815bea0 2024-09-16T07:33:20.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.010+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d8157b90 con 0x7f97d815bea0 2024-09-16T07:33:20.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.010+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d8158150 con 0x7f97d815bea0 2024-09-16T07:33:20.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.010+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d80cc9d0 con 0x7f97d815bea0 2024-09-16T07:33:20.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.010+0000 7f97d4c00640 1 -- 172.21.15.114:0/749115895 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f97d00051c0 con 0x7f97d815bea0 2024-09-16T07:33:20.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.010+0000 7f97d4c00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f97b4072fe0 0x7f97b40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.010+0000 7f97d4c00640 1 -- 172.21.15.114:0/749115895 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f97d00949d0 con 0x7f97d815bea0 2024-09-16T07:33:20.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.010+0000 7f97d7e00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f97b4072fe0 0x7f97b40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.014+0000 7f97d7e00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f97b4072fe0 0x7f97b40754a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97c800bb50 tx=0x7f97c800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:20.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.014+0000 7f97d4c00640 1 -- 172.21.15.114:0/749115895 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f97d0016030 con 0x7f97d815bea0 2024-09-16T07:33:20.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.218+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97d815a500 con 0x7f97d815bea0 2024-09-16T07:33:20.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.218+0000 7f97d4c00640 1 -- 172.21.15.114:0/749115895 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5234 (secure 0 0 0) 0x7f97d005f310 con 0x7f97d815bea0 2024-09-16T07:33:20.218 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:20.218 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"btime":"2024-09-16T07:33:19:840176+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1374083886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1374083886},{"type":"v1","addr":"172.21.15.149:6835","nonce":1374083886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/320868897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":320868897},{"type":"v1","addr":"172.21.15.149:6801","nonce":320868897}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1288852592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1288852592},{"type":"v1","addr":"172.21.15.114:6834","nonce":1288852592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:33:16.201708+0000","modified":"2024-09-16T07:33:19.219727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/3128573512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3128573512},{"type":"v1","addr":"172.21.15.114:6835","nonce":3128573512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6984,"qdb_cluster":[6984]},"id":8}]} 2024-09-16T07:33:20.218 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 72 2024-09-16T07:33:20.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f97b4072fe0 msgr2=0x7f97b40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f97b4072fe0 0x7f97b40754a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97c800bb50 tx=0x7f97c800b2e0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d815bea0 msgr2=0x7f97d81529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d815bea0 0x7f97d81529c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f97d000e9c0 tx=0x7f97d000ee80 comp rx=0 tx=0).stop 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 shutdown_connections 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97d815bea0 0x7f97d81529c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97d80d28e0 0x7f97d8158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f97b4072fe0 0x7f97b40754a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 --2- 172.21.15.114:0/749115895 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97d80cdb30 0x7f97d81572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 >> 172.21.15.114:0/749115895 conn(0x7f97d80d1dc0 msgr2=0x7f97d80b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 shutdown_connections 2024-09-16T07:33:20.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.222+0000 7f97dec00640 1 -- 172.21.15.114:0/749115895 wait complete. 2024-09-16T07:33:20.239 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:20.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 -- 172.21.15.114:0/4051619224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 msgr2=0x7fe6a40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 --2- 172.21.15.114:0/4051619224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a40cc870 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe690009900 tx=0x7fe69001f0d0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 -- 172.21.15.114:0/4051619224 shutdown_connections 2024-09-16T07:33:20.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 --2- 172.21.15.114:0/4051619224 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a40cc870 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 --2- 172.21.15.114:0/4051619224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6a415bee0 0x7fe6a40cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 -- 172.21.15.114:0/4051619224 >> 172.21.15.114:0/4051619224 conn(0x7fe6a40b18f0 msgr2=0x7fe6a40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:20.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 -- 172.21.15.114:0/4051619224 shutdown_connections 2024-09-16T07:33:20.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 -- 172.21.15.114:0/4051619224 wait complete. 2024-09-16T07:33:20.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 Processor -- start 2024-09-16T07:33:20.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.382+0000 7fe6ac600640 1 -- start start 2024-09-16T07:33:20.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6a40ccdb0 0x7fe6a414a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6a415bee0 0x7fe6a41f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41603b0 con 0x7fe6a40cf400 2024-09-16T07:33:20.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4160230 con 0x7fe6a40ccdb0 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a4160530 con 0x7fe6a415bee0 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a409ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35640/0 (socket says 172.21.15.114:35640) 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 -- 172.21.15.114:0/2303015902 learned_addr learned my addr 172.21.15.114:0/2303015902 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9c00640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6a40ccdb0 0x7fe6a414a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6aa600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6a415bee0 0x7fe6a41f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 -- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6a415bee0 msgr2=0x7fe6a41f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6a415bee0 0x7fe6a41f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 -- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6a40ccdb0 msgr2=0x7fe6a414a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6a40ccdb0 0x7fe6a414a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 -- 172.21.15.114:0/2303015902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a409c520 con 0x7fe6a40cf400 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a9200640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a409ba60 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe69001f970 tx=0x7fe6900a8c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a1600640 1 -- 172.21.15.114:0/2303015902 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900b5040 con 0x7fe6a40cf400 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a1600640 1 -- 172.21.15.114:0/2303015902 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6900053e0 con 0x7fe6a40cf400 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a1600640 1 -- 172.21.15.114:0/2303015902 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900046d0 con 0x7fe6a40cf400 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a409c800 con 0x7fe6a40cf400 2024-09-16T07:33:20.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a409cdc0 con 0x7fe6a40cf400 2024-09-16T07:33:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a4069410 con 0x7fe6a40cf400 2024-09-16T07:33:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.386+0000 7fe6a1600640 1 -- 172.21.15.114:0/2303015902 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fe6900c1060 con 0x7fe6a40cf400 2024-09-16T07:33:20.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.390+0000 7fe6a1600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe684072fe0 0x7fe6840754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.390+0000 7fe6a1600640 1 -- 172.21.15.114:0/2303015902 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fe6901311a0 con 0x7fe6a40cf400 2024-09-16T07:33:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.390+0000 7fe6a9c00640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe684072fe0 0x7fe6840754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.390+0000 7fe6a9c00640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe684072fe0 0x7fe6840754a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe6980058d0 tx=0x7fe698005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:20.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.394+0000 7fe6a1600640 1 -- 172.21.15.114:0/2303015902 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe690018c30 con 0x7fe6a40cf400 2024-09-16T07:33:20.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.558+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6a415fb20 con 0x7fe6a40cf400 2024-09-16T07:33:20.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6a1600640 1 -- 172.21.15.114:0/2303015902 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16724 (secure 0 0 0) 0x7fe6900fc1c0 con 0x7fe6a40cf400 2024-09-16T07:33:20.560 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:20.560 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":99,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:17.814139+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:33:13.921061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-16T07:33:15.169498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:20.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe684072fe0 msgr2=0x7fe6840754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe684072fe0 0x7fe6840754a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe6980058d0 tx=0x7fe698005860 comp rx=0 tx=0).stop 2024-09-16T07:33:20.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 msgr2=0x7fe6a409ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a409ba60 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe69001f970 tx=0x7fe6900a8c60 comp rx=0 tx=0).stop 2024-09-16T07:33:20.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 shutdown_connections 2024-09-16T07:33:20.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe684072fe0 0x7fe6840754a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe6a415bee0 0x7fe6a41f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40cf400 0x7fe6a409ba60 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 --2- 172.21.15.114:0/2303015902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6a40ccdb0 0x7fe6a414a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 >> 172.21.15.114:0/2303015902 conn(0x7fe6a40b18f0 msgr2=0x7fe6a40ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:20.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 shutdown_connections 2024-09-16T07:33:20.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.562+0000 7fe6ac600640 1 -- 172.21.15.114:0/2303015902 wait complete. 2024-09-16T07:33:20.582 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:33:20.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:33:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 -- 172.21.15.114:0/1212829998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb23815db50 msgr2=0x7fb2380acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 --2- 172.21.15.114:0/1212829998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb23815db50 0x7fb2380acd40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00a950 tx=0x7fb22c01dae0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 -- 172.21.15.114:0/1212829998 shutdown_connections 2024-09-16T07:33:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 --2- 172.21.15.114:0/1212829998 >> v2:172.21.15.149:3300/0 conn(0x7fb2380b4a50 0x7fb2380ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 --2- 172.21.15.114:0/1212829998 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb23815db50 0x7fb2380acd40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 -- 172.21.15.114:0/1212829998 >> 172.21.15.114:0/1212829998 conn(0x7fb2380b18f0 msgr2=0x7fb2380b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 -- 172.21.15.114:0/1212829998 shutdown_connections 2024-09-16T07:33:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 -- 172.21.15.114:0/1212829998 wait complete. 2024-09-16T07:33:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 Processor -- start 2024-09-16T07:33:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.726+0000 7fb240400640 1 -- start start 2024-09-16T07:33:20.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2380b4a50 0x7fb2381537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2380cd100 0x7fb2381f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb23815db50 0x7fb23814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb238167120 con 0x7fb2380cd100 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2380cf5a0 con 0x7fb23815db50 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb2381672a0 con 0x7fb2380b4a50 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2380cd100 0x7fb2381f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2380cd100 0x7fb2381f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35654/0 (socket says 172.21.15.114:35654) 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 -- 172.21.15.114:0/300165695 learned_addr learned my addr 172.21.15.114:0/300165695 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23da00640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2380b4a50 0x7fb2381537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23e400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb23815db50 0x7fb23814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 -- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2380b4a50 msgr2=0x7fb2381537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2380b4a50 0x7fb2381537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 -- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb23815db50 msgr2=0x7fb23814d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb23815db50 0x7fb23814d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 -- 172.21.15.114:0/300165695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2380ae690 con 0x7fb2380cd100 2024-09-16T07:33:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23da00640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2380b4a50 0x7fb2381537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23e400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb23815db50 0x7fb23814d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb23d000640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2380cd100 0x7fb2381f66e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb22400c480 tx=0x7fb22400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb235600640 1 -- 172.21.15.114:0/300165695 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224016020 con 0x7fb2380cd100 2024-09-16T07:33:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb235600640 1 -- 172.21.15.114:0/300165695 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb224012920 con 0x7fb2380cd100 2024-09-16T07:33:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb238153e80 con 0x7fb2380cd100 2024-09-16T07:33:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb235600640 1 -- 172.21.15.114:0/300165695 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224012db0 con 0x7fb2380cd100 2024-09-16T07:33:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2381f5ee0 con 0x7fb2380cd100 2024-09-16T07:33:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.730+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb238069410 con 0x7fb2380cd100 2024-09-16T07:33:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.734+0000 7fb235600640 1 -- 172.21.15.114:0/300165695 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fb224019020 con 0x7fb2380cd100 2024-09-16T07:33:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.734+0000 7fb235600640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb218072fe0 0x7fb2180754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.734+0000 7fb235600640 1 -- 172.21.15.114:0/300165695 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fb224093ef0 con 0x7fb2380cd100 2024-09-16T07:33:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.734+0000 7fb23da00640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb218072fe0 0x7fb2180754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.734+0000 7fb23da00640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb218072fe0 0x7fb2180754a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0b0000 tx=0x7fb22c01c320 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:20.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.738+0000 7fb235600640 1 -- 172.21.15.114:0/300165695 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb224020020 con 0x7fb2380cd100 2024-09-16T07:33:20.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.902+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2381576e0 con 0x7fb218072fe0 2024-09-16T07:33:20.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb235600640 1 -- 172.21.15.114:0/300165695 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252073 (secure 0 0 0) 0x7fb2381576e0 con 0x7fb218072fe0 2024-09-16T07:33:20.910 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:20.911 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:33:20.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb218072fe0 msgr2=0x7fb2180754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb218072fe0 0x7fb2180754a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0b0000 tx=0x7fb22c01c320 comp rx=0 tx=0).stop 2024-09-16T07:33:20.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2380cd100 msgr2=0x7fb2381f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2380cd100 0x7fb2381f66e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb22400c480 tx=0x7fb22400c940 comp rx=0 tx=0).stop 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 shutdown_connections 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb23815db50 0x7fb23814d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2380cd100 0x7fb2381f66e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb218072fe0 0x7fb2180754a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 --2- 172.21.15.114:0/300165695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2380b4a50 0x7fb2381537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 >> 172.21.15.114:0/300165695 conn(0x7fb2380b18f0 msgr2=0x7fb2381504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 shutdown_connections 2024-09-16T07:33:20.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:20.910+0000 7fb240400640 1 -- 172.21.15.114:0/300165695 wait complete. 2024-09-16T07:33:20.930 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-16T07:33:20.381232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260288,"kb_used_data":10744,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714432,"statfs":{"total":773094113280,"available":772827578368,"internally_reserved":0,"allocated":11001856,"data_stored":5416492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.583992"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980851+0000","last_change":"2024-09-16T07:33:16.834363+0000","last_active":"2024-09-16T07:33:17.980851+0000","last_peered":"2024-09-16T07:33:17.980851+0000","last_clean":"2024-09-16T07:33:17.980851+0000","last_became_active":"2024-09-16T07:33:16.834052+0000","last_became_peered":"2024-09-16T07:33:16.834052+0000","last_unstale":"2024-09-16T07:33:17.980851+0000","last_undegraded":"2024-09-16T07:33:17.980851+0000","last_fullsized":"2024-09-16T07:33:17.980851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:49.270329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821479+0000","last_change":"2024-09-16T07:33:16.846065+0000","last_active":"2024-09-16T07:33:17.821479+0000","last_peered":"2024-09-16T07:33:17.821479+0000","last_clean":"2024-09-16T07:33:17.821479+0000","last_became_active":"2024-09-16T07:33:16.845772+0000","last_became_peered":"2024-09-16T07:33:16.845772+0000","last_unstale":"2024-09-16T07:33:17.821479+0000","last_undegraded":"2024-09-16T07:33:17.821479+0000","last_fullsized":"2024-09-16T07:33:17.821479+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:23.768180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978694+0000","last_change":"2024-09-16T07:33:16.848143+0000","last_active":"2024-09-16T07:33:17.978694+0000","last_peered":"2024-09-16T07:33:17.978694+0000","last_clean":"2024-09-16T07:33:17.978694+0000","last_became_active":"2024-09-16T07:33:16.847703+0000","last_became_peered":"2024-09-16T07:33:16.847703+0000","last_unstale":"2024-09-16T07:33:17.978694+0000","last_undegraded":"2024-09-16T07:33:17.978694+0000","last_fullsized":"2024-09-16T07:33:17.978694+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:25.688843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980223+0000","last_change":"2024-09-16T07:33:16.833551+0000","last_active":"2024-09-16T07:33:17.980223+0000","last_peered":"2024-09-16T07:33:17.980223+0000","last_clean":"2024-09-16T07:33:17.980223+0000","last_became_active":"2024-09-16T07:33:16.832825+0000","last_became_peered":"2024-09-16T07:33:16.832825+0000","last_unstale":"2024-09-16T07:33:17.980223+0000","last_undegraded":"2024-09-16T07:33:17.980223+0000","last_fullsized":"2024-09-16T07:33:17.980223+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:09:12.584189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980096+0000","last_change":"2024-09-16T07:33:16.826026+0000","last_active":"2024-09-16T07:33:17.980096+0000","last_peered":"2024-09-16T07:33:17.980096+0000","last_clean":"2024-09-16T07:33:17.980096+0000","last_became_active":"2024-09-16T07:33:16.825750+0000","last_became_peered":"2024-09-16T07:33:16.825750+0000","last_unstale":"2024-09-16T07:33:17.980096+0000","last_undegraded":"2024-09-16T07:33:17.980096+0000","last_fullsized":"2024-09-16T07:33:17.980096+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:14.993187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818849+0000","last_change":"2024-09-16T07:33:16.824390+0000","last_active":"2024-09-16T07:33:17.818849+0000","last_peered":"2024-09-16T07:33:17.818849+0000","last_clean":"2024-09-16T07:33:17.818849+0000","last_became_active":"2024-09-16T07:33:16.824146+0000","last_became_peered":"2024-09-16T07:33:16.824146+0000","last_unstale":"2024-09-16T07:33:17.818849+0000","last_undegraded":"2024-09-16T07:33:17.818849+0000","last_fullsized":"2024-09-16T07:33:17.818849+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:25.022513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822320+0000","last_change":"2024-09-16T07:33:16.832839+0000","last_active":"2024-09-16T07:33:17.822320+0000","last_peered":"2024-09-16T07:33:17.822320+0000","last_clean":"2024-09-16T07:33:17.822320+0000","last_became_active":"2024-09-16T07:33:16.832401+0000","last_became_peered":"2024-09-16T07:33:16.832401+0000","last_unstale":"2024-09-16T07:33:17.822320+0000","last_undegraded":"2024-09-16T07:33:17.822320+0000","last_fullsized":"2024-09-16T07:33:17.822320+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:21:27.249087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978359+0000","last_change":"2024-09-16T07:33:16.845448+0000","last_active":"2024-09-16T07:33:17.978359+0000","last_peered":"2024-09-16T07:33:17.978359+0000","last_clean":"2024-09-16T07:33:17.978359+0000","last_became_active":"2024-09-16T07:33:16.845052+0000","last_became_peered":"2024-09-16T07:33:16.845052+0000","last_unstale":"2024-09-16T07:33:17.978359+0000","last_undegraded":"2024-09-16T07:33:17.978359+0000","last_fullsized":"2024-09-16T07:33:17.978359+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:08.751763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981159+0000","last_change":"2024-09-16T07:33:16.840530+0000","last_active":"2024-09-16T07:33:17.981159+0000","last_peered":"2024-09-16T07:33:17.981159+0000","last_clean":"2024-09-16T07:33:17.981159+0000","last_became_active":"2024-09-16T07:33:16.840275+0000","last_became_peered":"2024-09-16T07:33:16.840275+0000","last_unstale":"2024-09-16T07:33:17.981159+0000","last_undegraded":"2024-09-16T07:33:17.981159+0000","last_fullsized":"2024-09-16T07:33:17.981159+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:21.344020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980543+0000","last_change":"2024-09-16T07:33:16.838492+0000","last_active":"2024-09-16T07:33:17.980543+0000","last_peered":"2024-09-16T07:33:17.980543+0000","last_clean":"2024-09-16T07:33:17.980543+0000","last_became_active":"2024-09-16T07:33:16.836369+0000","last_became_peered":"2024-09-16T07:33:16.836369+0000","last_unstale":"2024-09-16T07:33:17.980543+0000","last_undegraded":"2024-09-16T07:33:17.980543+0000","last_fullsized":"2024-09-16T07:33:17.980543+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:11:50.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820972+0000","last_change":"2024-09-16T07:33:16.831017+0000","last_active":"2024-09-16T07:33:17.820972+0000","last_peered":"2024-09-16T07:33:17.820972+0000","last_clean":"2024-09-16T07:33:17.820972+0000","last_became_active":"2024-09-16T07:33:16.830673+0000","last_became_peered":"2024-09-16T07:33:16.830673+0000","last_unstale":"2024-09-16T07:33:17.820972+0000","last_undegraded":"2024-09-16T07:33:17.820972+0000","last_fullsized":"2024-09-16T07:33:17.820972+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:20.841282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980568+0000","last_change":"2024-09-16T07:33:16.833063+0000","last_active":"2024-09-16T07:33:17.980568+0000","last_peered":"2024-09-16T07:33:17.980568+0000","last_clean":"2024-09-16T07:33:17.980568+0000","last_became_active":"2024-09-16T07:33:16.832559+0000","last_became_peered":"2024-09-16T07:33:16.832559+0000","last_unstale":"2024-09-16T07:33:17.980568+0000","last_undegraded":"2024-09-16T07:33:17.980568+0000","last_fullsized":"2024-09-16T07:33:17.980568+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:43.316369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978519+0000","last_change":"2024-09-16T07:33:16.849709+0000","last_active":"2024-09-16T07:33:17.978519+0000","last_peered":"2024-09-16T07:33:17.978519+0000","last_clean":"2024-09-16T07:33:17.978519+0000","last_became_active":"2024-09-16T07:33:16.848902+0000","last_became_peered":"2024-09-16T07:33:16.848902+0000","last_unstale":"2024-09-16T07:33:17.978519+0000","last_undegraded":"2024-09-16T07:33:17.978519+0000","last_fullsized":"2024-09-16T07:33:17.978519+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:58.246640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978370+0000","last_change":"2024-09-16T07:33:16.845112+0000","last_active":"2024-09-16T07:33:17.978370+0000","last_peered":"2024-09-16T07:33:17.978370+0000","last_clean":"2024-09-16T07:33:17.978370+0000","last_became_active":"2024-09-16T07:33:16.844837+0000","last_became_peered":"2024-09-16T07:33:16.844837+0000","last_unstale":"2024-09-16T07:33:17.978370+0000","last_undegraded":"2024-09-16T07:33:17.978370+0000","last_fullsized":"2024-09-16T07:33:17.978370+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:02:18.512124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818813+0000","last_change":"2024-09-16T07:33:16.825253+0000","last_active":"2024-09-16T07:33:17.818813+0000","last_peered":"2024-09-16T07:33:17.818813+0000","last_clean":"2024-09-16T07:33:17.818813+0000","last_became_active":"2024-09-16T07:33:16.823912+0000","last_became_peered":"2024-09-16T07:33:16.823912+0000","last_unstale":"2024-09-16T07:33:17.818813+0000","last_undegraded":"2024-09-16T07:33:17.818813+0000","last_fullsized":"2024-09-16T07:33:17.818813+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:26.524753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980419+0000","last_change":"2024-09-16T07:33:16.841069+0000","last_active":"2024-09-16T07:33:17.980419+0000","last_peered":"2024-09-16T07:33:17.980419+0000","last_clean":"2024-09-16T07:33:17.980419+0000","last_became_active":"2024-09-16T07:33:16.840832+0000","last_became_peered":"2024-09-16T07:33:16.840832+0000","last_unstale":"2024-09-16T07:33:17.980419+0000","last_undegraded":"2024-09-16T07:33:17.980419+0000","last_fullsized":"2024-09-16T07:33:17.980419+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:08.271112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821272+0000","last_change":"2024-09-16T07:33:16.833212+0000","last_active":"2024-09-16T07:33:17.821272+0000","last_peered":"2024-09-16T07:33:17.821272+0000","last_clean":"2024-09-16T07:33:17.821272+0000","last_became_active":"2024-09-16T07:33:16.832636+0000","last_became_peered":"2024-09-16T07:33:16.832636+0000","last_unstale":"2024-09-16T07:33:17.821272+0000","last_undegraded":"2024-09-16T07:33:17.821272+0000","last_fullsized":"2024-09-16T07:33:17.821272+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:03.550593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839308+0000","last_change":"2024-09-16T07:33:16.830938+0000","last_active":"2024-09-16T07:33:17.839308+0000","last_peered":"2024-09-16T07:33:17.839308+0000","last_clean":"2024-09-16T07:33:17.839308+0000","last_became_active":"2024-09-16T07:33:16.830674+0000","last_became_peered":"2024-09-16T07:33:16.830674+0000","last_unstale":"2024-09-16T07:33:17.839308+0000","last_undegraded":"2024-09-16T07:33:17.839308+0000","last_fullsized":"2024-09-16T07:33:17.839308+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:58.919384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978736+0000","last_change":"2024-09-16T07:33:16.849344+0000","last_active":"2024-09-16T07:33:17.978736+0000","last_peered":"2024-09-16T07:33:17.978736+0000","last_clean":"2024-09-16T07:33:17.978736+0000","last_became_active":"2024-09-16T07:33:16.849029+0000","last_became_peered":"2024-09-16T07:33:16.849029+0000","last_unstale":"2024-09-16T07:33:17.978736+0000","last_undegraded":"2024-09-16T07:33:17.978736+0000","last_fullsized":"2024-09-16T07:33:17.978736+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:26.268640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820927+0000","last_change":"2024-09-16T07:33:16.841163+0000","last_active":"2024-09-16T07:33:17.820927+0000","last_peered":"2024-09-16T07:33:17.820927+0000","last_clean":"2024-09-16T07:33:17.820927+0000","last_became_active":"2024-09-16T07:33:16.840810+0000","last_became_peered":"2024-09-16T07:33:16.840810+0000","last_unstale":"2024-09-16T07:33:17.820927+0000","last_undegraded":"2024-09-16T07:33:17.820927+0000","last_fullsized":"2024-09-16T07:33:17.820927+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:57.265738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821516+0000","last_change":"2024-09-16T07:33:16.828348+0000","last_active":"2024-09-16T07:33:17.821516+0000","last_peered":"2024-09-16T07:33:17.821516+0000","last_clean":"2024-09-16T07:33:17.821516+0000","last_became_active":"2024-09-16T07:33:16.828054+0000","last_became_peered":"2024-09-16T07:33:16.828054+0000","last_unstale":"2024-09-16T07:33:17.821516+0000","last_undegraded":"2024-09-16T07:33:17.821516+0000","last_fullsized":"2024-09-16T07:33:17.821516+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:22.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981603+0000","last_change":"2024-09-16T07:33:16.826911+0000","last_active":"2024-09-16T07:33:17.981603+0000","last_peered":"2024-09-16T07:33:17.981603+0000","last_clean":"2024-09-16T07:33:17.981603+0000","last_became_active":"2024-09-16T07:33:16.826677+0000","last_became_peered":"2024-09-16T07:33:16.826677+0000","last_unstale":"2024-09-16T07:33:17.981603+0000","last_undegraded":"2024-09-16T07:33:17.981603+0000","last_fullsized":"2024-09-16T07:33:17.981603+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:52.791215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821094+0000","last_change":"2024-09-16T07:33:16.838558+0000","last_active":"2024-09-16T07:33:17.821094+0000","last_peered":"2024-09-16T07:33:17.821094+0000","last_clean":"2024-09-16T07:33:17.821094+0000","last_became_active":"2024-09-16T07:33:16.838211+0000","last_became_peered":"2024-09-16T07:33:16.838211+0000","last_unstale":"2024-09-16T07:33:17.821094+0000","last_undegraded":"2024-09-16T07:33:17.821094+0000","last_fullsized":"2024-09-16T07:33:17.821094+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:56:58.154763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981367+0000","last_change":"2024-09-16T07:33:16.845734+0000","last_active":"2024-09-16T07:33:17.981367+0000","last_peered":"2024-09-16T07:33:17.981367+0000","last_clean":"2024-09-16T07:33:17.981367+0000","last_became_active":"2024-09-16T07:33:16.839997+0000","last_became_peered":"2024-09-16T07:33:16.839997+0000","last_unstale":"2024-09-16T07:33:17.981367+0000","last_undegraded":"2024-09-16T07:33:17.981367+0000","last_fullsized":"2024-09-16T07:33:17.981367+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:10.376613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821220+0000","last_change":"2024-09-16T07:33:16.833491+0000","last_active":"2024-09-16T07:33:17.821220+0000","last_peered":"2024-09-16T07:33:17.821220+0000","last_clean":"2024-09-16T07:33:17.821220+0000","last_became_active":"2024-09-16T07:33:16.832974+0000","last_became_peered":"2024-09-16T07:33:16.832974+0000","last_unstale":"2024-09-16T07:33:17.821220+0000","last_undegraded":"2024-09-16T07:33:17.821220+0000","last_fullsized":"2024-09-16T07:33:17.821220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:03.766345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980528+0000","last_change":"2024-09-16T07:33:16.838198+0000","last_active":"2024-09-16T07:33:17.980528+0000","last_peered":"2024-09-16T07:33:17.980528+0000","last_clean":"2024-09-16T07:33:17.980528+0000","last_became_active":"2024-09-16T07:33:16.837846+0000","last_became_peered":"2024-09-16T07:33:16.837846+0000","last_unstale":"2024-09-16T07:33:17.980528+0000","last_undegraded":"2024-09-16T07:33:17.980528+0000","last_fullsized":"2024-09-16T07:33:17.980528+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:24.192257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819262+0000","last_change":"2024-09-16T07:33:16.835301+0000","last_active":"2024-09-16T07:33:17.819262+0000","last_peered":"2024-09-16T07:33:17.819262+0000","last_clean":"2024-09-16T07:33:17.819262+0000","last_became_active":"2024-09-16T07:33:16.834931+0000","last_became_peered":"2024-09-16T07:33:16.834931+0000","last_unstale":"2024-09-16T07:33:17.819262+0000","last_undegraded":"2024-09-16T07:33:17.819262+0000","last_fullsized":"2024-09-16T07:33:17.819262+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:52.775380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981825+0000","last_change":"2024-09-16T07:33:16.844468+0000","last_active":"2024-09-16T07:33:17.981825+0000","last_peered":"2024-09-16T07:33:17.981825+0000","last_clean":"2024-09-16T07:33:17.981825+0000","last_became_active":"2024-09-16T07:33:16.844232+0000","last_became_peered":"2024-09-16T07:33:16.844232+0000","last_unstale":"2024-09-16T07:33:17.981825+0000","last_undegraded":"2024-09-16T07:33:17.981825+0000","last_fullsized":"2024-09-16T07:33:17.981825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:30.071389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821221+0000","last_change":"2024-09-16T07:33:16.839359+0000","last_active":"2024-09-16T07:33:17.821221+0000","last_peered":"2024-09-16T07:33:17.821221+0000","last_clean":"2024-09-16T07:33:17.821221+0000","last_became_active":"2024-09-16T07:33:16.839084+0000","last_became_peered":"2024-09-16T07:33:16.839084+0000","last_unstale":"2024-09-16T07:33:17.821221+0000","last_undegraded":"2024-09-16T07:33:17.821221+0000","last_fullsized":"2024-09-16T07:33:17.821221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:52:46.807022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822372+0000","last_change":"2024-09-16T07:33:16.842137+0000","last_active":"2024-09-16T07:33:17.822372+0000","last_peered":"2024-09-16T07:33:17.822372+0000","last_clean":"2024-09-16T07:33:17.822372+0000","last_became_active":"2024-09-16T07:33:16.841801+0000","last_became_peered":"2024-09-16T07:33:16.841801+0000","last_unstale":"2024-09-16T07:33:17.822372+0000","last_undegraded":"2024-09-16T07:33:17.822372+0000","last_fullsized":"2024-09-16T07:33:17.822372+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:18.296919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980348+0000","last_change":"2024-09-16T07:33:16.842586+0000","last_active":"2024-09-16T07:33:17.980348+0000","last_peered":"2024-09-16T07:33:17.980348+0000","last_clean":"2024-09-16T07:33:17.980348+0000","last_became_active":"2024-09-16T07:33:16.842262+0000","last_became_peered":"2024-09-16T07:33:16.842262+0000","last_unstale":"2024-09-16T07:33:17.980348+0000","last_undegraded":"2024-09-16T07:33:17.980348+0000","last_fullsized":"2024-09-16T07:33:17.980348+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:15.501041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818988+0000","last_change":"2024-09-16T07:33:16.824138+0000","last_active":"2024-09-16T07:33:17.818988+0000","last_peered":"2024-09-16T07:33:17.818988+0000","last_clean":"2024-09-16T07:33:17.818988+0000","last_became_active":"2024-09-16T07:33:16.823880+0000","last_became_peered":"2024-09-16T07:33:16.823880+0000","last_unstale":"2024-09-16T07:33:17.818988+0000","last_undegraded":"2024-09-16T07:33:17.818988+0000","last_fullsized":"2024-09-16T07:33:17.818988+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:17.597750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819404+0000","last_change":"2024-09-16T07:33:16.828920+0000","last_active":"2024-09-16T07:33:17.819404+0000","last_peered":"2024-09-16T07:33:17.819404+0000","last_clean":"2024-09-16T07:33:17.819404+0000","last_became_active":"2024-09-16T07:33:16.828619+0000","last_became_peered":"2024-09-16T07:33:16.828619+0000","last_unstale":"2024-09-16T07:33:17.819404+0000","last_undegraded":"2024-09-16T07:33:17.819404+0000","last_fullsized":"2024-09-16T07:33:17.819404+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:55.660970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"98'4","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822585+0000","last_change":"2024-09-16T07:33:15.816591+0000","last_active":"2024-09-16T07:33:17.822585+0000","last_peered":"2024-09-16T07:33:17.822585+0000","last_clean":"2024-09-16T07:33:17.822585+0000","last_became_active":"2024-09-16T07:33:15.816111+0000","last_became_peered":"2024-09-16T07:33:15.816111+0000","last_unstale":"2024-09-16T07:33:17.822585+0000","last_undegraded":"2024-09-16T07:33:17.822585+0000","last_fullsized":"2024-09-16T07:33:17.822585+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:33.713908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839468+0000","last_change":"2024-09-16T07:33:16.843190+0000","last_active":"2024-09-16T07:33:17.839468+0000","last_peered":"2024-09-16T07:33:17.839468+0000","last_clean":"2024-09-16T07:33:17.839468+0000","last_became_active":"2024-09-16T07:33:16.842769+0000","last_became_peered":"2024-09-16T07:33:16.842769+0000","last_unstale":"2024-09-16T07:33:17.839468+0000","last_undegraded":"2024-09-16T07:33:17.839468+0000","last_fullsized":"2024-09-16T07:33:17.839468+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:02:18.512124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978249+0000","last_change":"2024-09-16T07:33:15.818256+0000","last_active":"2024-09-16T07:33:17.978249+0000","last_peered":"2024-09-16T07:33:17.978249+0000","last_clean":"2024-09-16T07:33:17.978249+0000","last_became_active":"2024-09-16T07:33:15.817975+0000","last_became_peered":"2024-09-16T07:33:15.817975+0000","last_unstale":"2024-09-16T07:33:17.978249+0000","last_undegraded":"2024-09-16T07:33:17.978249+0000","last_fullsized":"2024-09-16T07:33:17.978249+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:00.044484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819088+0000","last_change":"2024-09-16T07:33:16.825160+0000","last_active":"2024-09-16T07:33:17.819088+0000","last_peered":"2024-09-16T07:33:17.819088+0000","last_clean":"2024-09-16T07:33:17.819088+0000","last_became_active":"2024-09-16T07:33:16.824908+0000","last_became_peered":"2024-09-16T07:33:16.824908+0000","last_unstale":"2024-09-16T07:33:17.819088+0000","last_undegraded":"2024-09-16T07:33:17.819088+0000","last_fullsized":"2024-09-16T07:33:17.819088+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:27.823106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981008+0000","last_change":"2024-09-16T07:33:15.831135+0000","last_active":"2024-09-16T07:33:17.981008+0000","last_peered":"2024-09-16T07:33:17.981008+0000","last_clean":"2024-09-16T07:33:17.981008+0000","last_became_active":"2024-09-16T07:33:15.830870+0000","last_became_peered":"2024-09-16T07:33:15.830870+0000","last_unstale":"2024-09-16T07:33:17.981008+0000","last_undegraded":"2024-09-16T07:33:17.981008+0000","last_fullsized":"2024-09-16T07:33:17.981008+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:27:10.842957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978848+0000","last_change":"2024-09-16T07:33:16.849404+0000","last_active":"2024-09-16T07:33:17.978848+0000","last_peered":"2024-09-16T07:33:17.978848+0000","last_clean":"2024-09-16T07:33:17.978848+0000","last_became_active":"2024-09-16T07:33:16.849135+0000","last_became_peered":"2024-09-16T07:33:16.849135+0000","last_unstale":"2024-09-16T07:33:17.978848+0000","last_undegraded":"2024-09-16T07:33:17.978848+0000","last_fullsized":"2024-09-16T07:33:17.978848+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:34.866931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979951+0000","last_change":"2024-09-16T07:33:15.828234+0000","last_active":"2024-09-16T07:33:17.979951+0000","last_peered":"2024-09-16T07:33:17.979951+0000","last_clean":"2024-09-16T07:33:17.979951+0000","last_became_active":"2024-09-16T07:33:15.826974+0000","last_became_peered":"2024-09-16T07:33:15.826974+0000","last_unstale":"2024-09-16T07:33:17.979951+0000","last_undegraded":"2024-09-16T07:33:17.979951+0000","last_fullsized":"2024-09-16T07:33:17.979951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:58:30.628595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979884+0000","last_change":"2024-09-16T07:33:16.840718+0000","last_active":"2024-09-16T07:33:17.979884+0000","last_peered":"2024-09-16T07:33:17.979884+0000","last_clean":"2024-09-16T07:33:17.979884+0000","last_became_active":"2024-09-16T07:33:16.839210+0000","last_became_peered":"2024-09-16T07:33:16.839210+0000","last_unstale":"2024-09-16T07:33:17.979884+0000","last_undegraded":"2024-09-16T07:33:17.979884+0000","last_fullsized":"2024-09-16T07:33:17.979884+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:09:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822237+0000","last_change":"2024-09-16T07:33:15.822184+0000","last_active":"2024-09-16T07:33:17.822237+0000","last_peered":"2024-09-16T07:33:17.822237+0000","last_clean":"2024-09-16T07:33:17.822237+0000","last_became_active":"2024-09-16T07:33:15.821896+0000","last_became_peered":"2024-09-16T07:33:15.821896+0000","last_unstale":"2024-09-16T07:33:17.822237+0000","last_undegraded":"2024-09-16T07:33:17.822237+0000","last_fullsized":"2024-09-16T07:33:17.822237+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:13.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821154+0000","last_change":"2024-09-16T07:33:16.829011+0000","last_active":"2024-09-16T07:33:17.821154+0000","last_peered":"2024-09-16T07:33:17.821154+0000","last_clean":"2024-09-16T07:33:17.821154+0000","last_became_active":"2024-09-16T07:33:16.828739+0000","last_became_peered":"2024-09-16T07:33:16.828739+0000","last_unstale":"2024-09-16T07:33:17.821154+0000","last_undegraded":"2024-09-16T07:33:17.821154+0000","last_fullsized":"2024-09-16T07:33:17.821154+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:15.525294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981737+0000","last_change":"2024-09-16T07:33:15.815359+0000","last_active":"2024-09-16T07:33:17.981737+0000","last_peered":"2024-09-16T07:33:17.981737+0000","last_clean":"2024-09-16T07:33:17.981737+0000","last_became_active":"2024-09-16T07:33:15.814864+0000","last_became_peered":"2024-09-16T07:33:15.814864+0000","last_unstale":"2024-09-16T07:33:17.981737+0000","last_undegraded":"2024-09-16T07:33:17.981737+0000","last_fullsized":"2024-09-16T07:33:17.981737+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:51.638191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979786+0000","last_change":"2024-09-16T07:33:16.848868+0000","last_active":"2024-09-16T07:33:17.979786+0000","last_peered":"2024-09-16T07:33:17.979786+0000","last_clean":"2024-09-16T07:33:17.979786+0000","last_became_active":"2024-09-16T07:33:16.848342+0000","last_became_peered":"2024-09-16T07:33:16.848342+0000","last_unstale":"2024-09-16T07:33:17.979786+0000","last_undegraded":"2024-09-16T07:33:17.979786+0000","last_fullsized":"2024-09-16T07:33:17.979786+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:04:29.816618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820678+0000","last_change":"2024-09-16T07:33:15.814123+0000","last_active":"2024-09-16T07:33:17.820678+0000","last_peered":"2024-09-16T07:33:17.820678+0000","last_clean":"2024-09-16T07:33:17.820678+0000","last_became_active":"2024-09-16T07:33:15.813731+0000","last_became_peered":"2024-09-16T07:33:15.813731+0000","last_unstale":"2024-09-16T07:33:17.820678+0000","last_undegraded":"2024-09-16T07:33:17.820678+0000","last_fullsized":"2024-09-16T07:33:17.820678+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.712121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822196+0000","last_change":"2024-09-16T07:33:16.836301+0000","last_active":"2024-09-16T07:33:17.822196+0000","last_peered":"2024-09-16T07:33:17.822196+0000","last_clean":"2024-09-16T07:33:17.822196+0000","last_became_active":"2024-09-16T07:33:16.836019+0000","last_became_peered":"2024-09-16T07:33:16.836019+0000","last_unstale":"2024-09-16T07:33:17.822196+0000","last_undegraded":"2024-09-16T07:33:17.822196+0000","last_fullsized":"2024-09-16T07:33:17.822196+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:19.080853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979967+0000","last_change":"2024-09-16T07:33:15.832648+0000","last_active":"2024-09-16T07:33:17.979967+0000","last_peered":"2024-09-16T07:33:17.979967+0000","last_clean":"2024-09-16T07:33:17.979967+0000","last_became_active":"2024-09-16T07:33:15.832331+0000","last_became_peered":"2024-09-16T07:33:15.832331+0000","last_unstale":"2024-09-16T07:33:17.979967+0000","last_undegraded":"2024-09-16T07:33:17.979967+0000","last_fullsized":"2024-09-16T07:33:17.979967+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:02.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822721+0000","last_change":"2024-09-16T07:33:16.838015+0000","last_active":"2024-09-16T07:33:17.822721+0000","last_peered":"2024-09-16T07:33:17.822721+0000","last_clean":"2024-09-16T07:33:17.822721+0000","last_became_active":"2024-09-16T07:33:16.837720+0000","last_became_peered":"2024-09-16T07:33:16.837720+0000","last_unstale":"2024-09-16T07:33:17.822721+0000","last_undegraded":"2024-09-16T07:33:17.822721+0000","last_fullsized":"2024-09-16T07:33:17.822721+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:51.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981136+0000","last_change":"2024-09-16T07:33:15.829283+0000","last_active":"2024-09-16T07:33:17.981136+0000","last_peered":"2024-09-16T07:33:17.981136+0000","last_clean":"2024-09-16T07:33:17.981136+0000","last_became_active":"2024-09-16T07:33:15.827908+0000","last_became_peered":"2024-09-16T07:33:15.827908+0000","last_unstale":"2024-09-16T07:33:17.981136+0000","last_undegraded":"2024-09-16T07:33:17.981136+0000","last_fullsized":"2024-09-16T07:33:17.981136+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:29.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839510+0000","last_change":"2024-09-16T07:33:16.835561+0000","last_active":"2024-09-16T07:33:17.839510+0000","last_peered":"2024-09-16T07:33:17.839510+0000","last_clean":"2024-09-16T07:33:17.839510+0000","last_became_active":"2024-09-16T07:33:16.835270+0000","last_became_peered":"2024-09-16T07:33:16.835270+0000","last_unstale":"2024-09-16T07:33:17.839510+0000","last_undegraded":"2024-09-16T07:33:17.839510+0000","last_fullsized":"2024-09-16T07:33:17.839510+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:45.323919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981802+0000","last_change":"2024-09-16T07:33:15.821160+0000","last_active":"2024-09-16T07:33:17.981802+0000","last_peered":"2024-09-16T07:33:17.981802+0000","last_clean":"2024-09-16T07:33:17.981802+0000","last_became_active":"2024-09-16T07:33:15.820931+0000","last_became_peered":"2024-09-16T07:33:15.820931+0000","last_unstale":"2024-09-16T07:33:17.981802+0000","last_undegraded":"2024-09-16T07:33:17.981802+0000","last_fullsized":"2024-09-16T07:33:17.981802+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:41:27.110266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981811+0000","last_change":"2024-09-16T07:33:16.833482+0000","last_active":"2024-09-16T07:33:17.981811+0000","last_peered":"2024-09-16T07:33:17.981811+0000","last_clean":"2024-09-16T07:33:17.981811+0000","last_became_active":"2024-09-16T07:33:16.832916+0000","last_became_peered":"2024-09-16T07:33:16.832916+0000","last_unstale":"2024-09-16T07:33:17.981811+0000","last_undegraded":"2024-09-16T07:33:17.981811+0000","last_fullsized":"2024-09-16T07:33:17.981811+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:46:08.389557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"98'3","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980257+0000","last_change":"2024-09-16T07:33:15.835042+0000","last_active":"2024-09-16T07:33:17.980257+0000","last_peered":"2024-09-16T07:33:17.980257+0000","last_clean":"2024-09-16T07:33:17.980257+0000","last_became_active":"2024-09-16T07:33:15.834077+0000","last_became_peered":"2024-09-16T07:33:15.834077+0000","last_unstale":"2024-09-16T07:33:17.980257+0000","last_undegraded":"2024-09-16T07:33:17.980257+0000","last_fullsized":"2024-09-16T07:33:17.980257+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:52:47.595893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822648+0000","last_change":"2024-09-16T07:33:16.838571+0000","last_active":"2024-09-16T07:33:17.822648+0000","last_peered":"2024-09-16T07:33:17.822648+0000","last_clean":"2024-09-16T07:33:17.822648+0000","last_became_active":"2024-09-16T07:33:16.838306+0000","last_became_peered":"2024-09-16T07:33:16.838306+0000","last_unstale":"2024-09-16T07:33:17.822648+0000","last_undegraded":"2024-09-16T07:33:17.822648+0000","last_fullsized":"2024-09-16T07:33:17.822648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:41:28.116483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"98'6","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980612+0000","last_change":"2024-09-16T07:33:15.827718+0000","last_active":"2024-09-16T07:33:17.980612+0000","last_peered":"2024-09-16T07:33:17.980612+0000","last_clean":"2024-09-16T07:33:17.980612+0000","last_became_active":"2024-09-16T07:33:15.827439+0000","last_became_peered":"2024-09-16T07:33:15.827439+0000","last_unstale":"2024-09-16T07:33:17.980612+0000","last_undegraded":"2024-09-16T07:33:17.980612+0000","last_fullsized":"2024-09-16T07:33:17.980612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:22.020454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981739+0000","last_change":"2024-09-16T07:33:16.836812+0000","last_active":"2024-09-16T07:33:17.981739+0000","last_peered":"2024-09-16T07:33:17.981739+0000","last_clean":"2024-09-16T07:33:17.981739+0000","last_became_active":"2024-09-16T07:33:16.836424+0000","last_became_peered":"2024-09-16T07:33:16.836424+0000","last_unstale":"2024-09-16T07:33:17.981739+0000","last_undegraded":"2024-09-16T07:33:17.981739+0000","last_fullsized":"2024-09-16T07:33:17.981739+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:35:05.830093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818911+0000","last_change":"2024-09-16T07:33:15.821579+0000","last_active":"2024-09-16T07:33:17.818911+0000","last_peered":"2024-09-16T07:33:17.818911+0000","last_clean":"2024-09-16T07:33:17.818911+0000","last_became_active":"2024-09-16T07:33:15.821336+0000","last_became_peered":"2024-09-16T07:33:15.821336+0000","last_unstale":"2024-09-16T07:33:17.818911+0000","last_undegraded":"2024-09-16T07:33:17.818911+0000","last_fullsized":"2024-09-16T07:33:17.818911+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:25.483633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981650+0000","last_change":"2024-09-16T07:33:16.846375+0000","last_active":"2024-09-16T07:33:17.981650+0000","last_peered":"2024-09-16T07:33:17.981650+0000","last_clean":"2024-09-16T07:33:17.981650+0000","last_became_active":"2024-09-16T07:33:16.845171+0000","last_became_peered":"2024-09-16T07:33:16.845171+0000","last_unstale":"2024-09-16T07:33:17.981650+0000","last_undegraded":"2024-09-16T07:33:17.981650+0000","last_fullsized":"2024-09-16T07:33:17.981650+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:29.639164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839120+0000","last_change":"2024-09-16T07:33:15.830186+0000","last_active":"2024-09-16T07:33:17.839120+0000","last_peered":"2024-09-16T07:33:17.839120+0000","last_clean":"2024-09-16T07:33:17.839120+0000","last_became_active":"2024-09-16T07:33:15.829905+0000","last_became_peered":"2024-09-16T07:33:15.829905+0000","last_unstale":"2024-09-16T07:33:17.839120+0000","last_undegraded":"2024-09-16T07:33:17.839120+0000","last_fullsized":"2024-09-16T07:33:17.839120+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:59.478012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981082+0000","last_change":"2024-09-16T07:33:16.828296+0000","last_active":"2024-09-16T07:33:17.981082+0000","last_peered":"2024-09-16T07:33:17.981082+0000","last_clean":"2024-09-16T07:33:17.981082+0000","last_became_active":"2024-09-16T07:33:16.827749+0000","last_became_peered":"2024-09-16T07:33:16.827749+0000","last_unstale":"2024-09-16T07:33:17.981082+0000","last_undegraded":"2024-09-16T07:33:17.981082+0000","last_fullsized":"2024-09-16T07:33:17.981082+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:22.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"98'8","reported_seq":23,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979740+0000","last_change":"2024-09-16T07:33:15.834050+0000","last_active":"2024-09-16T07:33:17.979740+0000","last_peered":"2024-09-16T07:33:17.979740+0000","last_clean":"2024-09-16T07:33:17.979740+0000","last_became_active":"2024-09-16T07:33:15.833764+0000","last_became_peered":"2024-09-16T07:33:15.833764+0000","last_unstale":"2024-09-16T07:33:17.979740+0000","last_undegraded":"2024-09-16T07:33:17.979740+0000","last_fullsized":"2024-09-16T07:33:17.979740+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:57.999026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981140+0000","last_change":"2024-09-16T07:33:16.842614+0000","last_active":"2024-09-16T07:33:17.981140+0000","last_peered":"2024-09-16T07:33:17.981140+0000","last_clean":"2024-09-16T07:33:17.981140+0000","last_became_active":"2024-09-16T07:33:16.842282+0000","last_became_peered":"2024-09-16T07:33:16.842282+0000","last_unstale":"2024-09-16T07:33:17.981140+0000","last_undegraded":"2024-09-16T07:33:17.981140+0000","last_fullsized":"2024-09-16T07:33:17.981140+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:43.189736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981187+0000","last_change":"2024-09-16T07:33:15.832270+0000","last_active":"2024-09-16T07:33:17.981187+0000","last_peered":"2024-09-16T07:33:17.981187+0000","last_clean":"2024-09-16T07:33:17.981187+0000","last_became_active":"2024-09-16T07:33:15.831548+0000","last_became_peered":"2024-09-16T07:33:15.831548+0000","last_unstale":"2024-09-16T07:33:17.981187+0000","last_undegraded":"2024-09-16T07:33:17.981187+0000","last_fullsized":"2024-09-16T07:33:17.981187+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:05.052230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819479+0000","last_change":"2024-09-16T07:33:16.836800+0000","last_active":"2024-09-16T07:33:17.819479+0000","last_peered":"2024-09-16T07:33:17.819479+0000","last_clean":"2024-09-16T07:33:17.819479+0000","last_became_active":"2024-09-16T07:33:16.836591+0000","last_became_peered":"2024-09-16T07:33:16.836591+0000","last_unstale":"2024-09-16T07:33:17.819479+0000","last_undegraded":"2024-09-16T07:33:17.819479+0000","last_fullsized":"2024-09-16T07:33:17.819479+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:47:06.716453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981083+0000","last_change":"2024-09-16T07:33:15.818610+0000","last_active":"2024-09-16T07:33:17.981083+0000","last_peered":"2024-09-16T07:33:17.981083+0000","last_clean":"2024-09-16T07:33:17.981083+0000","last_became_active":"2024-09-16T07:33:15.818258+0000","last_became_peered":"2024-09-16T07:33:15.818258+0000","last_unstale":"2024-09-16T07:33:17.981083+0000","last_undegraded":"2024-09-16T07:33:17.981083+0000","last_fullsized":"2024-09-16T07:33:17.981083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:58.179784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978381+0000","last_change":"2024-09-16T07:33:16.848053+0000","last_active":"2024-09-16T07:33:17.978381+0000","last_peered":"2024-09-16T07:33:17.978381+0000","last_clean":"2024-09-16T07:33:17.978381+0000","last_became_active":"2024-09-16T07:33:16.847700+0000","last_became_peered":"2024-09-16T07:33:16.847700+0000","last_unstale":"2024-09-16T07:33:17.978381+0000","last_undegraded":"2024-09-16T07:33:17.978381+0000","last_fullsized":"2024-09-16T07:33:17.978381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:15.525294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839268+0000","last_change":"2024-09-16T07:33:15.815113+0000","last_active":"2024-09-16T07:33:17.839268+0000","last_peered":"2024-09-16T07:33:17.839268+0000","last_clean":"2024-09-16T07:33:17.839268+0000","last_became_active":"2024-09-16T07:33:15.814765+0000","last_became_peered":"2024-09-16T07:33:15.814765+0000","last_unstale":"2024-09-16T07:33:17.839268+0000","last_undegraded":"2024-09-16T07:33:17.839268+0000","last_fullsized":"2024-09-16T07:33:17.839268+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:54:40.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978919+0000","last_change":"2024-09-16T07:33:16.843938+0000","last_active":"2024-09-16T07:33:17.978919+0000","last_peered":"2024-09-16T07:33:17.978919+0000","last_clean":"2024-09-16T07:33:17.978919+0000","last_became_active":"2024-09-16T07:33:16.843680+0000","last_became_peered":"2024-09-16T07:33:16.843680+0000","last_unstale":"2024-09-16T07:33:17.978919+0000","last_undegraded":"2024-09-16T07:33:17.978919+0000","last_fullsized":"2024-09-16T07:33:17.978919+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:20:45.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822442+0000","last_change":"2024-09-16T07:33:15.826185+0000","last_active":"2024-09-16T07:33:17.822442+0000","last_peered":"2024-09-16T07:33:17.822442+0000","last_clean":"2024-09-16T07:33:17.822442+0000","last_became_active":"2024-09-16T07:33:15.825914+0000","last_became_peered":"2024-09-16T07:33:15.825914+0000","last_unstale":"2024-09-16T07:33:17.822442+0000","last_undegraded":"2024-09-16T07:33:17.822442+0000","last_fullsized":"2024-09-16T07:33:17.822442+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:46.512323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978330+0000","last_change":"2024-09-16T07:33:16.845695+0000","last_active":"2024-09-16T07:33:17.978330+0000","last_peered":"2024-09-16T07:33:17.978330+0000","last_clean":"2024-09-16T07:33:17.978330+0000","last_became_active":"2024-09-16T07:33:16.845398+0000","last_became_peered":"2024-09-16T07:33:16.845398+0000","last_unstale":"2024-09-16T07:33:17.978330+0000","last_undegraded":"2024-09-16T07:33:17.978330+0000","last_fullsized":"2024-09-16T07:33:17.978330+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:20.841282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819008+0000","last_change":"2024-09-16T07:33:15.820120+0000","last_active":"2024-09-16T07:33:17.819008+0000","last_peered":"2024-09-16T07:33:17.819008+0000","last_clean":"2024-09-16T07:33:17.819008+0000","last_became_active":"2024-09-16T07:33:15.819852+0000","last_became_peered":"2024-09-16T07:33:15.819852+0000","last_unstale":"2024-09-16T07:33:17.819008+0000","last_undegraded":"2024-09-16T07:33:17.819008+0000","last_fullsized":"2024-09-16T07:33:17.819008+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:32.475094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979876+0000","last_change":"2024-09-16T07:33:16.841399+0000","last_active":"2024-09-16T07:33:17.979876+0000","last_peered":"2024-09-16T07:33:17.979876+0000","last_clean":"2024-09-16T07:33:17.979876+0000","last_became_active":"2024-09-16T07:33:16.841115+0000","last_became_peered":"2024-09-16T07:33:16.841115+0000","last_unstale":"2024-09-16T07:33:17.979876+0000","last_undegraded":"2024-09-16T07:33:17.979876+0000","last_fullsized":"2024-09-16T07:33:17.979876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:27.651793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979765+0000","last_change":"2024-09-16T07:33:15.823691+0000","last_active":"2024-09-16T07:33:17.979765+0000","last_peered":"2024-09-16T07:33:17.979765+0000","last_clean":"2024-09-16T07:33:17.979765+0000","last_became_active":"2024-09-16T07:33:15.823396+0000","last_became_peered":"2024-09-16T07:33:15.823396+0000","last_unstale":"2024-09-16T07:33:17.979765+0000","last_undegraded":"2024-09-16T07:33:17.979765+0000","last_fullsized":"2024-09-16T07:33:17.979765+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:03.975852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978403+0000","last_change":"2024-09-16T07:33:16.849672+0000","last_active":"2024-09-16T07:33:17.978403+0000","last_peered":"2024-09-16T07:33:17.978403+0000","last_clean":"2024-09-16T07:33:17.978403+0000","last_became_active":"2024-09-16T07:33:16.849460+0000","last_became_peered":"2024-09-16T07:33:16.849460+0000","last_unstale":"2024-09-16T07:33:17.978403+0000","last_undegraded":"2024-09-16T07:33:17.978403+0000","last_fullsized":"2024-09-16T07:33:17.978403+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:14.810255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818727+0000","last_change":"2024-09-16T07:33:15.820114+0000","last_active":"2024-09-16T07:33:17.818727+0000","last_peered":"2024-09-16T07:33:17.818727+0000","last_clean":"2024-09-16T07:33:17.818727+0000","last_became_active":"2024-09-16T07:33:15.819828+0000","last_became_peered":"2024-09-16T07:33:15.819828+0000","last_unstale":"2024-09-16T07:33:17.818727+0000","last_undegraded":"2024-09-16T07:33:17.818727+0000","last_fullsized":"2024-09-16T07:33:17.818727+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:38.881196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981429+0000","last_change":"2024-09-16T07:33:16.842420+0000","last_active":"2024-09-16T07:33:17.981429+0000","last_peered":"2024-09-16T07:33:17.981429+0000","last_clean":"2024-09-16T07:33:17.981429+0000","last_became_active":"2024-09-16T07:33:16.842192+0000","last_became_peered":"2024-09-16T07:33:16.842192+0000","last_unstale":"2024-09-16T07:33:17.981429+0000","last_undegraded":"2024-09-16T07:33:17.981429+0000","last_fullsized":"2024-09-16T07:33:17.981429+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:03.267233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980061+0000","last_change":"2024-09-16T07:33:15.835441+0000","last_active":"2024-09-16T07:33:17.980061+0000","last_peered":"2024-09-16T07:33:17.980061+0000","last_clean":"2024-09-16T07:33:17.980061+0000","last_became_active":"2024-09-16T07:33:15.835145+0000","last_became_peered":"2024-09-16T07:33:15.835145+0000","last_unstale":"2024-09-16T07:33:17.980061+0000","last_undegraded":"2024-09-16T07:33:17.980061+0000","last_fullsized":"2024-09-16T07:33:17.980061+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:51.784997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839367+0000","last_change":"2024-09-16T07:33:16.839916+0000","last_active":"2024-09-16T07:33:17.839367+0000","last_peered":"2024-09-16T07:33:17.839367+0000","last_clean":"2024-09-16T07:33:17.839367+0000","last_became_active":"2024-09-16T07:33:16.839629+0000","last_became_peered":"2024-09-16T07:33:16.839629+0000","last_unstale":"2024-09-16T07:33:17.839367+0000","last_undegraded":"2024-09-16T07:33:17.839367+0000","last_fullsized":"2024-09-16T07:33:17.839367+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:22:26.968627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981734+0000","last_change":"2024-09-16T07:33:15.830425+0000","last_active":"2024-09-16T07:33:17.981734+0000","last_peered":"2024-09-16T07:33:17.981734+0000","last_clean":"2024-09-16T07:33:17.981734+0000","last_became_active":"2024-09-16T07:33:15.830292+0000","last_became_peered":"2024-09-16T07:33:15.830292+0000","last_unstale":"2024-09-16T07:33:17.981734+0000","last_undegraded":"2024-09-16T07:33:17.981734+0000","last_fullsized":"2024-09-16T07:33:17.981734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:50.377922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981028+0000","last_change":"2024-09-16T07:33:16.835716+0000","last_active":"2024-09-16T07:33:17.981028+0000","last_peered":"2024-09-16T07:33:17.981028+0000","last_clean":"2024-09-16T07:33:17.981028+0000","last_became_active":"2024-09-16T07:33:16.835415+0000","last_became_peered":"2024-09-16T07:33:16.835415+0000","last_unstale":"2024-09-16T07:33:17.981028+0000","last_undegraded":"2024-09-16T07:33:17.981028+0000","last_fullsized":"2024-09-16T07:33:17.981028+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:02.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"99'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.840786+0000","last_change":"2024-09-16T07:33:15.812821+0000","last_active":"2024-09-16T07:33:17.840786+0000","last_peered":"2024-09-16T07:33:17.840786+0000","last_clean":"2024-09-16T07:33:17.840786+0000","last_became_active":"2024-09-16T07:33:15.812154+0000","last_became_peered":"2024-09-16T07:33:15.812154+0000","last_unstale":"2024-09-16T07:33:17.840786+0000","last_undegraded":"2024-09-16T07:33:17.840786+0000","last_fullsized":"2024-09-16T07:33:17.840786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:47.245755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980437+0000","last_change":"2024-09-16T07:33:16.842948+0000","last_active":"2024-09-16T07:33:17.980437+0000","last_peered":"2024-09-16T07:33:17.980437+0000","last_clean":"2024-09-16T07:33:17.980437+0000","last_became_active":"2024-09-16T07:33:16.841819+0000","last_became_peered":"2024-09-16T07:33:16.841819+0000","last_unstale":"2024-09-16T07:33:17.980437+0000","last_undegraded":"2024-09-16T07:33:17.980437+0000","last_fullsized":"2024-09-16T07:33:17.980437+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:51.547941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980250+0000","last_change":"2024-09-16T07:33:15.827983+0000","last_active":"2024-09-16T07:33:17.980250+0000","last_peered":"2024-09-16T07:33:17.980250+0000","last_clean":"2024-09-16T07:33:17.980250+0000","last_became_active":"2024-09-16T07:33:15.827727+0000","last_became_peered":"2024-09-16T07:33:15.827727+0000","last_unstale":"2024-09-16T07:33:17.980250+0000","last_undegraded":"2024-09-16T07:33:17.980250+0000","last_fullsized":"2024-09-16T07:33:17.980250+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:06.969437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839324+0000","last_change":"2024-09-16T07:33:16.836128+0000","last_active":"2024-09-16T07:33:17.839324+0000","last_peered":"2024-09-16T07:33:17.839324+0000","last_clean":"2024-09-16T07:33:17.839324+0000","last_became_active":"2024-09-16T07:33:16.834944+0000","last_became_peered":"2024-09-16T07:33:16.834944+0000","last_unstale":"2024-09-16T07:33:17.839324+0000","last_undegraded":"2024-09-16T07:33:17.839324+0000","last_fullsized":"2024-09-16T07:33:17.839324+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:03.550593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981868+0000","last_change":"2024-09-16T07:33:15.829949+0000","last_active":"2024-09-16T07:33:17.981868+0000","last_peered":"2024-09-16T07:33:17.981868+0000","last_clean":"2024-09-16T07:33:17.981868+0000","last_became_active":"2024-09-16T07:33:15.829687+0000","last_became_peered":"2024-09-16T07:33:15.829687+0000","last_unstale":"2024-09-16T07:33:17.981868+0000","last_undegraded":"2024-09-16T07:33:17.981868+0000","last_fullsized":"2024-09-16T07:33:17.981868+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:50.398026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820699+0000","last_change":"2024-09-16T07:33:16.834986+0000","last_active":"2024-09-16T07:33:17.820699+0000","last_peered":"2024-09-16T07:33:17.820699+0000","last_clean":"2024-09-16T07:33:17.820699+0000","last_became_active":"2024-09-16T07:33:16.834427+0000","last_became_peered":"2024-09-16T07:33:16.834427+0000","last_unstale":"2024-09-16T07:33:17.820699+0000","last_undegraded":"2024-09-16T07:33:17.820699+0000","last_fullsized":"2024-09-16T07:33:17.820699+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:34.819097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822376+0000","last_change":"2024-09-16T07:33:15.816313+0000","last_active":"2024-09-16T07:33:17.822376+0000","last_peered":"2024-09-16T07:33:17.822376+0000","last_clean":"2024-09-16T07:33:17.822376+0000","last_became_active":"2024-09-16T07:33:15.815966+0000","last_became_peered":"2024-09-16T07:33:15.815966+0000","last_unstale":"2024-09-16T07:33:17.822376+0000","last_undegraded":"2024-09-16T07:33:17.822376+0000","last_fullsized":"2024-09-16T07:33:17.822376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:13.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821383+0000","last_change":"2024-09-16T07:33:16.834247+0000","last_active":"2024-09-16T07:33:17.821383+0000","last_peered":"2024-09-16T07:33:17.821383+0000","last_clean":"2024-09-16T07:33:17.821383+0000","last_became_active":"2024-09-16T07:33:16.833970+0000","last_became_peered":"2024-09-16T07:33:16.833970+0000","last_unstale":"2024-09-16T07:33:17.821383+0000","last_undegraded":"2024-09-16T07:33:17.821383+0000","last_fullsized":"2024-09-16T07:33:17.821383+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:14.236236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820892+0000","last_change":"2024-09-16T07:33:15.820850+0000","last_active":"2024-09-16T07:33:17.820892+0000","last_peered":"2024-09-16T07:33:17.820892+0000","last_clean":"2024-09-16T07:33:17.820892+0000","last_became_active":"2024-09-16T07:33:15.820526+0000","last_became_peered":"2024-09-16T07:33:15.820526+0000","last_unstale":"2024-09-16T07:33:17.820892+0000","last_undegraded":"2024-09-16T07:33:17.820892+0000","last_fullsized":"2024-09-16T07:33:17.820892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:23.793983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978577+0000","last_change":"2024-09-16T07:33:16.844160+0000","last_active":"2024-09-16T07:33:17.978577+0000","last_peered":"2024-09-16T07:33:17.978577+0000","last_clean":"2024-09-16T07:33:17.978577+0000","last_became_active":"2024-09-16T07:33:16.843905+0000","last_became_peered":"2024-09-16T07:33:16.843905+0000","last_unstale":"2024-09-16T07:33:17.978577+0000","last_undegraded":"2024-09-16T07:33:17.978577+0000","last_fullsized":"2024-09-16T07:33:17.978577+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:50.091395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979788+0000","last_change":"2024-09-16T07:33:15.823632+0000","last_active":"2024-09-16T07:33:17.979788+0000","last_peered":"2024-09-16T07:33:17.979788+0000","last_clean":"2024-09-16T07:33:17.979788+0000","last_became_active":"2024-09-16T07:33:15.823353+0000","last_became_peered":"2024-09-16T07:33:15.823353+0000","last_unstale":"2024-09-16T07:33:17.979788+0000","last_undegraded":"2024-09-16T07:33:17.979788+0000","last_fullsized":"2024-09-16T07:33:17.979788+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:32:11.864464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980922+0000","last_change":"2024-09-16T07:33:16.842469+0000","last_active":"2024-09-16T07:33:17.980922+0000","last_peered":"2024-09-16T07:33:17.980922+0000","last_clean":"2024-09-16T07:33:17.980922+0000","last_became_active":"2024-09-16T07:33:16.841897+0000","last_became_peered":"2024-09-16T07:33:16.841897+0000","last_unstale":"2024-09-16T07:33:17.980922+0000","last_undegraded":"2024-09-16T07:33:17.980922+0000","last_fullsized":"2024-09-16T07:33:17.980922+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:48.603184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980162+0000","last_change":"2024-09-16T07:33:15.833901+0000","last_active":"2024-09-16T07:33:17.980162+0000","last_peered":"2024-09-16T07:33:17.980162+0000","last_clean":"2024-09-16T07:33:17.980162+0000","last_became_active":"2024-09-16T07:33:15.833551+0000","last_became_peered":"2024-09-16T07:33:15.833551+0000","last_unstale":"2024-09-16T07:33:17.980162+0000","last_undegraded":"2024-09-16T07:33:17.980162+0000","last_fullsized":"2024-09-16T07:33:17.980162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:35:04.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981068+0000","last_change":"2024-09-16T07:33:16.840214+0000","last_active":"2024-09-16T07:33:17.981068+0000","last_peered":"2024-09-16T07:33:17.981068+0000","last_clean":"2024-09-16T07:33:17.981068+0000","last_became_active":"2024-09-16T07:33:16.839706+0000","last_became_peered":"2024-09-16T07:33:16.839706+0000","last_unstale":"2024-09-16T07:33:17.981068+0000","last_undegraded":"2024-09-16T07:33:17.981068+0000","last_fullsized":"2024-09-16T07:33:17.981068+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:23.768180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822279+0000","last_change":"2024-09-16T07:33:15.826771+0000","last_active":"2024-09-16T07:33:17.822279+0000","last_peered":"2024-09-16T07:33:17.822279+0000","last_clean":"2024-09-16T07:33:17.822279+0000","last_became_active":"2024-09-16T07:33:15.826577+0000","last_became_peered":"2024-09-16T07:33:15.826577+0000","last_unstale":"2024-09-16T07:33:17.822279+0000","last_undegraded":"2024-09-16T07:33:17.822279+0000","last_fullsized":"2024-09-16T07:33:17.822279+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:23.793983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":281,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978542+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:33:17.978542+0000","last_peered":"2024-09-16T07:33:17.978542+0000","last_clean":"2024-09-16T07:33:17.978542+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:33:17.978542+0000","last_undegraded":"2024-09-16T07:33:17.978542+0000","last_fullsized":"2024-09-16T07:33:17.978542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":1123001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1216512,"data_stored":525787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1220608,"data_stored":526321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1224704,"data_stored":532017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1241088,"data_stored":533699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1212416,"data_stored":525717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1232896,"data_stored":532141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509505,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1826816,"data_stored":1117809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:33:20.935 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:33:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.114+0000 7fa502400640 1 -- 172.21.15.114:0/1593602499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0cdb30 msgr2=0x7fa4fc0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.114+0000 7fa502400640 1 --2- 172.21.15.114:0/1593602499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0aeef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009bc0 tx=0x7fa4f401cba0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- 172.21.15.114:0/1593602499 shutdown_connections 2024-09-16T07:33:21.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 --2- 172.21.15.114:0/1593602499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0aeef0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 --2- 172.21.15.114:0/1593602499 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0ced80 0x7fa4fc0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- 172.21.15.114:0/1593602499 >> 172.21.15.114:0/1593602499 conn(0x7fa4fc0d1dc0 msgr2=0x7fa4fc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:21.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- 172.21.15.114:0/1593602499 shutdown_connections 2024-09-16T07:33:21.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- 172.21.15.114:0/1593602499 wait complete. 2024-09-16T07:33:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 Processor -- start 2024-09-16T07:33:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- start start 2024-09-16T07:33:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0ced80 0x7fa4fc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc15bea0 0x7fa4fc165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc169340 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc1691c0 con 0x7fa4fc15bea0 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa502400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc1694c0 con 0x7fa4fc0ced80 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35666/0 (socket says 172.21.15.114:35666) 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 -- 172.21.15.114:0/802354192 learned_addr learned my addr 172.21.15.114:0/802354192 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4f2a00640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0ced80 0x7fa4fc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fbe00640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc15bea0 0x7fa4fc165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 -- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0ced80 msgr2=0x7fa4fc15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0ced80 0x7fa4fc15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 -- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc15bea0 msgr2=0x7fa4fc165ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc15bea0 0x7fa4fc165ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 -- 172.21.15.114:0/802354192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc0ca940 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.118+0000 7fa4fb400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0c81b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00c430 tx=0x7fa4ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa4f3e00640 1 -- 172.21.15.114:0/802354192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec011790 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa4f3e00640 1 -- 172.21.15.114:0/802354192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4ec017070 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa4f3e00640 1 -- 172.21.15.114:0/802354192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec011ce0 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc0cac20 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc0cb1e0 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc0ce670 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa4f3e00640 1 -- 172.21.15.114:0/802354192 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fa4ec01c460 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa4f3e00640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4d8072fe0 0x7fa4d80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa4f3e00640 1 -- 172.21.15.114:0/802354192 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fa4ec093cd0 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.122+0000 7fa4f2a00640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4d8072fe0 0x7fa4d80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.126+0000 7fa4f2a00640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4d8072fe0 0x7fa4d80754a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0c54e0 tx=0x7fa4e40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:21.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.126+0000 7fa4f3e00640 1 -- 172.21.15.114:0/802354192 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa4ec05e770 con 0x7fa4fc0cdb30 2024-09-16T07:33:21.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.290+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4fc0aed50 con 0x7fa4d8072fe0 2024-09-16T07:33:21.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.294+0000 7fa4f3e00640 1 -- 172.21.15.114:0/802354192 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252073 (secure 0 0 0) 0x7fa4fc0aed50 con 0x7fa4d8072fe0 2024-09-16T07:33:21.297 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:21.298 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:33:21.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4d8072fe0 msgr2=0x7fa4d80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4d8072fe0 0x7fa4d80754a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0c54e0 tx=0x7fa4e40091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4fc0cdb30 msgr2=0x7fa4fc0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0c81b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00c430 tx=0x7fa4ec00c8f0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 shutdown_connections 2024-09-16T07:33:21.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4fc15bea0 0x7fa4fc165ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4d8072fe0 0x7fa4d80754a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4fc0ced80 0x7fa4fc15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 --2- 172.21.15.114:0/802354192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4fc0cdb30 0x7fa4fc0c81b0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 >> 172.21.15.114:0/802354192 conn(0x7fa4fc0d1dc0 msgr2=0x7fa4fc0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:21.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 shutdown_connections 2024-09-16T07:33:21.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.298+0000 7fa502400640 1 -- 172.21.15.114:0/802354192 wait complete. 2024-09-16T07:33:21.317 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-16T07:33:20.381232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260288,"kb_used_data":10744,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714432,"statfs":{"total":773094113280,"available":772827578368,"internally_reserved":0,"allocated":11001856,"data_stored":5416492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.583992"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980851+0000","last_change":"2024-09-16T07:33:16.834363+0000","last_active":"2024-09-16T07:33:17.980851+0000","last_peered":"2024-09-16T07:33:17.980851+0000","last_clean":"2024-09-16T07:33:17.980851+0000","last_became_active":"2024-09-16T07:33:16.834052+0000","last_became_peered":"2024-09-16T07:33:16.834052+0000","last_unstale":"2024-09-16T07:33:17.980851+0000","last_undegraded":"2024-09-16T07:33:17.980851+0000","last_fullsized":"2024-09-16T07:33:17.980851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:49.270329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821479+0000","last_change":"2024-09-16T07:33:16.846065+0000","last_active":"2024-09-16T07:33:17.821479+0000","last_peered":"2024-09-16T07:33:17.821479+0000","last_clean":"2024-09-16T07:33:17.821479+0000","last_became_active":"2024-09-16T07:33:16.845772+0000","last_became_peered":"2024-09-16T07:33:16.845772+0000","last_unstale":"2024-09-16T07:33:17.821479+0000","last_undegraded":"2024-09-16T07:33:17.821479+0000","last_fullsized":"2024-09-16T07:33:17.821479+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:23.768180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978694+0000","last_change":"2024-09-16T07:33:16.848143+0000","last_active":"2024-09-16T07:33:17.978694+0000","last_peered":"2024-09-16T07:33:17.978694+0000","last_clean":"2024-09-16T07:33:17.978694+0000","last_became_active":"2024-09-16T07:33:16.847703+0000","last_became_peered":"2024-09-16T07:33:16.847703+0000","last_unstale":"2024-09-16T07:33:17.978694+0000","last_undegraded":"2024-09-16T07:33:17.978694+0000","last_fullsized":"2024-09-16T07:33:17.978694+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:25.688843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980223+0000","last_change":"2024-09-16T07:33:16.833551+0000","last_active":"2024-09-16T07:33:17.980223+0000","last_peered":"2024-09-16T07:33:17.980223+0000","last_clean":"2024-09-16T07:33:17.980223+0000","last_became_active":"2024-09-16T07:33:16.832825+0000","last_became_peered":"2024-09-16T07:33:16.832825+0000","last_unstale":"2024-09-16T07:33:17.980223+0000","last_undegraded":"2024-09-16T07:33:17.980223+0000","last_fullsized":"2024-09-16T07:33:17.980223+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:09:12.584189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980096+0000","last_change":"2024-09-16T07:33:16.826026+0000","last_active":"2024-09-16T07:33:17.980096+0000","last_peered":"2024-09-16T07:33:17.980096+0000","last_clean":"2024-09-16T07:33:17.980096+0000","last_became_active":"2024-09-16T07:33:16.825750+0000","last_became_peered":"2024-09-16T07:33:16.825750+0000","last_unstale":"2024-09-16T07:33:17.980096+0000","last_undegraded":"2024-09-16T07:33:17.980096+0000","last_fullsized":"2024-09-16T07:33:17.980096+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:14.993187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818849+0000","last_change":"2024-09-16T07:33:16.824390+0000","last_active":"2024-09-16T07:33:17.818849+0000","last_peered":"2024-09-16T07:33:17.818849+0000","last_clean":"2024-09-16T07:33:17.818849+0000","last_became_active":"2024-09-16T07:33:16.824146+0000","last_became_peered":"2024-09-16T07:33:16.824146+0000","last_unstale":"2024-09-16T07:33:17.818849+0000","last_undegraded":"2024-09-16T07:33:17.818849+0000","last_fullsized":"2024-09-16T07:33:17.818849+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:25.022513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822320+0000","last_change":"2024-09-16T07:33:16.832839+0000","last_active":"2024-09-16T07:33:17.822320+0000","last_peered":"2024-09-16T07:33:17.822320+0000","last_clean":"2024-09-16T07:33:17.822320+0000","last_became_active":"2024-09-16T07:33:16.832401+0000","last_became_peered":"2024-09-16T07:33:16.832401+0000","last_unstale":"2024-09-16T07:33:17.822320+0000","last_undegraded":"2024-09-16T07:33:17.822320+0000","last_fullsized":"2024-09-16T07:33:17.822320+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:21:27.249087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978359+0000","last_change":"2024-09-16T07:33:16.845448+0000","last_active":"2024-09-16T07:33:17.978359+0000","last_peered":"2024-09-16T07:33:17.978359+0000","last_clean":"2024-09-16T07:33:17.978359+0000","last_became_active":"2024-09-16T07:33:16.845052+0000","last_became_peered":"2024-09-16T07:33:16.845052+0000","last_unstale":"2024-09-16T07:33:17.978359+0000","last_undegraded":"2024-09-16T07:33:17.978359+0000","last_fullsized":"2024-09-16T07:33:17.978359+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:08.751763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981159+0000","last_change":"2024-09-16T07:33:16.840530+0000","last_active":"2024-09-16T07:33:17.981159+0000","last_peered":"2024-09-16T07:33:17.981159+0000","last_clean":"2024-09-16T07:33:17.981159+0000","last_became_active":"2024-09-16T07:33:16.840275+0000","last_became_peered":"2024-09-16T07:33:16.840275+0000","last_unstale":"2024-09-16T07:33:17.981159+0000","last_undegraded":"2024-09-16T07:33:17.981159+0000","last_fullsized":"2024-09-16T07:33:17.981159+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:34:21.344020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980543+0000","last_change":"2024-09-16T07:33:16.838492+0000","last_active":"2024-09-16T07:33:17.980543+0000","last_peered":"2024-09-16T07:33:17.980543+0000","last_clean":"2024-09-16T07:33:17.980543+0000","last_became_active":"2024-09-16T07:33:16.836369+0000","last_became_peered":"2024-09-16T07:33:16.836369+0000","last_unstale":"2024-09-16T07:33:17.980543+0000","last_undegraded":"2024-09-16T07:33:17.980543+0000","last_fullsized":"2024-09-16T07:33:17.980543+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:11:50.142088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820972+0000","last_change":"2024-09-16T07:33:16.831017+0000","last_active":"2024-09-16T07:33:17.820972+0000","last_peered":"2024-09-16T07:33:17.820972+0000","last_clean":"2024-09-16T07:33:17.820972+0000","last_became_active":"2024-09-16T07:33:16.830673+0000","last_became_peered":"2024-09-16T07:33:16.830673+0000","last_unstale":"2024-09-16T07:33:17.820972+0000","last_undegraded":"2024-09-16T07:33:17.820972+0000","last_fullsized":"2024-09-16T07:33:17.820972+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:20.841282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980568+0000","last_change":"2024-09-16T07:33:16.833063+0000","last_active":"2024-09-16T07:33:17.980568+0000","last_peered":"2024-09-16T07:33:17.980568+0000","last_clean":"2024-09-16T07:33:17.980568+0000","last_became_active":"2024-09-16T07:33:16.832559+0000","last_became_peered":"2024-09-16T07:33:16.832559+0000","last_unstale":"2024-09-16T07:33:17.980568+0000","last_undegraded":"2024-09-16T07:33:17.980568+0000","last_fullsized":"2024-09-16T07:33:17.980568+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:43.316369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978519+0000","last_change":"2024-09-16T07:33:16.849709+0000","last_active":"2024-09-16T07:33:17.978519+0000","last_peered":"2024-09-16T07:33:17.978519+0000","last_clean":"2024-09-16T07:33:17.978519+0000","last_became_active":"2024-09-16T07:33:16.848902+0000","last_became_peered":"2024-09-16T07:33:16.848902+0000","last_unstale":"2024-09-16T07:33:17.978519+0000","last_undegraded":"2024-09-16T07:33:17.978519+0000","last_fullsized":"2024-09-16T07:33:17.978519+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:58.246640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978370+0000","last_change":"2024-09-16T07:33:16.845112+0000","last_active":"2024-09-16T07:33:17.978370+0000","last_peered":"2024-09-16T07:33:17.978370+0000","last_clean":"2024-09-16T07:33:17.978370+0000","last_became_active":"2024-09-16T07:33:16.844837+0000","last_became_peered":"2024-09-16T07:33:16.844837+0000","last_unstale":"2024-09-16T07:33:17.978370+0000","last_undegraded":"2024-09-16T07:33:17.978370+0000","last_fullsized":"2024-09-16T07:33:17.978370+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:02:18.512124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818813+0000","last_change":"2024-09-16T07:33:16.825253+0000","last_active":"2024-09-16T07:33:17.818813+0000","last_peered":"2024-09-16T07:33:17.818813+0000","last_clean":"2024-09-16T07:33:17.818813+0000","last_became_active":"2024-09-16T07:33:16.823912+0000","last_became_peered":"2024-09-16T07:33:16.823912+0000","last_unstale":"2024-09-16T07:33:17.818813+0000","last_undegraded":"2024-09-16T07:33:17.818813+0000","last_fullsized":"2024-09-16T07:33:17.818813+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:26.524753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980419+0000","last_change":"2024-09-16T07:33:16.841069+0000","last_active":"2024-09-16T07:33:17.980419+0000","last_peered":"2024-09-16T07:33:17.980419+0000","last_clean":"2024-09-16T07:33:17.980419+0000","last_became_active":"2024-09-16T07:33:16.840832+0000","last_became_peered":"2024-09-16T07:33:16.840832+0000","last_unstale":"2024-09-16T07:33:17.980419+0000","last_undegraded":"2024-09-16T07:33:17.980419+0000","last_fullsized":"2024-09-16T07:33:17.980419+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:08.271112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821272+0000","last_change":"2024-09-16T07:33:16.833212+0000","last_active":"2024-09-16T07:33:17.821272+0000","last_peered":"2024-09-16T07:33:17.821272+0000","last_clean":"2024-09-16T07:33:17.821272+0000","last_became_active":"2024-09-16T07:33:16.832636+0000","last_became_peered":"2024-09-16T07:33:16.832636+0000","last_unstale":"2024-09-16T07:33:17.821272+0000","last_undegraded":"2024-09-16T07:33:17.821272+0000","last_fullsized":"2024-09-16T07:33:17.821272+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:03.550593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839308+0000","last_change":"2024-09-16T07:33:16.830938+0000","last_active":"2024-09-16T07:33:17.839308+0000","last_peered":"2024-09-16T07:33:17.839308+0000","last_clean":"2024-09-16T07:33:17.839308+0000","last_became_active":"2024-09-16T07:33:16.830674+0000","last_became_peered":"2024-09-16T07:33:16.830674+0000","last_unstale":"2024-09-16T07:33:17.839308+0000","last_undegraded":"2024-09-16T07:33:17.839308+0000","last_fullsized":"2024-09-16T07:33:17.839308+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:58.919384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978736+0000","last_change":"2024-09-16T07:33:16.849344+0000","last_active":"2024-09-16T07:33:17.978736+0000","last_peered":"2024-09-16T07:33:17.978736+0000","last_clean":"2024-09-16T07:33:17.978736+0000","last_became_active":"2024-09-16T07:33:16.849029+0000","last_became_peered":"2024-09-16T07:33:16.849029+0000","last_unstale":"2024-09-16T07:33:17.978736+0000","last_undegraded":"2024-09-16T07:33:17.978736+0000","last_fullsized":"2024-09-16T07:33:17.978736+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:26.268640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820927+0000","last_change":"2024-09-16T07:33:16.841163+0000","last_active":"2024-09-16T07:33:17.820927+0000","last_peered":"2024-09-16T07:33:17.820927+0000","last_clean":"2024-09-16T07:33:17.820927+0000","last_became_active":"2024-09-16T07:33:16.840810+0000","last_became_peered":"2024-09-16T07:33:16.840810+0000","last_unstale":"2024-09-16T07:33:17.820927+0000","last_undegraded":"2024-09-16T07:33:17.820927+0000","last_fullsized":"2024-09-16T07:33:17.820927+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:57.265738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821516+0000","last_change":"2024-09-16T07:33:16.828348+0000","last_active":"2024-09-16T07:33:17.821516+0000","last_peered":"2024-09-16T07:33:17.821516+0000","last_clean":"2024-09-16T07:33:17.821516+0000","last_became_active":"2024-09-16T07:33:16.828054+0000","last_became_peered":"2024-09-16T07:33:16.828054+0000","last_unstale":"2024-09-16T07:33:17.821516+0000","last_undegraded":"2024-09-16T07:33:17.821516+0000","last_fullsized":"2024-09-16T07:33:17.821516+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:22.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981603+0000","last_change":"2024-09-16T07:33:16.826911+0000","last_active":"2024-09-16T07:33:17.981603+0000","last_peered":"2024-09-16T07:33:17.981603+0000","last_clean":"2024-09-16T07:33:17.981603+0000","last_became_active":"2024-09-16T07:33:16.826677+0000","last_became_peered":"2024-09-16T07:33:16.826677+0000","last_unstale":"2024-09-16T07:33:17.981603+0000","last_undegraded":"2024-09-16T07:33:17.981603+0000","last_fullsized":"2024-09-16T07:33:17.981603+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:52.791215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821094+0000","last_change":"2024-09-16T07:33:16.838558+0000","last_active":"2024-09-16T07:33:17.821094+0000","last_peered":"2024-09-16T07:33:17.821094+0000","last_clean":"2024-09-16T07:33:17.821094+0000","last_became_active":"2024-09-16T07:33:16.838211+0000","last_became_peered":"2024-09-16T07:33:16.838211+0000","last_unstale":"2024-09-16T07:33:17.821094+0000","last_undegraded":"2024-09-16T07:33:17.821094+0000","last_fullsized":"2024-09-16T07:33:17.821094+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:56:58.154763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981367+0000","last_change":"2024-09-16T07:33:16.845734+0000","last_active":"2024-09-16T07:33:17.981367+0000","last_peered":"2024-09-16T07:33:17.981367+0000","last_clean":"2024-09-16T07:33:17.981367+0000","last_became_active":"2024-09-16T07:33:16.839997+0000","last_became_peered":"2024-09-16T07:33:16.839997+0000","last_unstale":"2024-09-16T07:33:17.981367+0000","last_undegraded":"2024-09-16T07:33:17.981367+0000","last_fullsized":"2024-09-16T07:33:17.981367+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:10.376613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821220+0000","last_change":"2024-09-16T07:33:16.833491+0000","last_active":"2024-09-16T07:33:17.821220+0000","last_peered":"2024-09-16T07:33:17.821220+0000","last_clean":"2024-09-16T07:33:17.821220+0000","last_became_active":"2024-09-16T07:33:16.832974+0000","last_became_peered":"2024-09-16T07:33:16.832974+0000","last_unstale":"2024-09-16T07:33:17.821220+0000","last_undegraded":"2024-09-16T07:33:17.821220+0000","last_fullsized":"2024-09-16T07:33:17.821220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:03.766345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980528+0000","last_change":"2024-09-16T07:33:16.838198+0000","last_active":"2024-09-16T07:33:17.980528+0000","last_peered":"2024-09-16T07:33:17.980528+0000","last_clean":"2024-09-16T07:33:17.980528+0000","last_became_active":"2024-09-16T07:33:16.837846+0000","last_became_peered":"2024-09-16T07:33:16.837846+0000","last_unstale":"2024-09-16T07:33:17.980528+0000","last_undegraded":"2024-09-16T07:33:17.980528+0000","last_fullsized":"2024-09-16T07:33:17.980528+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:24.192257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819262+0000","last_change":"2024-09-16T07:33:16.835301+0000","last_active":"2024-09-16T07:33:17.819262+0000","last_peered":"2024-09-16T07:33:17.819262+0000","last_clean":"2024-09-16T07:33:17.819262+0000","last_became_active":"2024-09-16T07:33:16.834931+0000","last_became_peered":"2024-09-16T07:33:16.834931+0000","last_unstale":"2024-09-16T07:33:17.819262+0000","last_undegraded":"2024-09-16T07:33:17.819262+0000","last_fullsized":"2024-09-16T07:33:17.819262+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:52.775380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981825+0000","last_change":"2024-09-16T07:33:16.844468+0000","last_active":"2024-09-16T07:33:17.981825+0000","last_peered":"2024-09-16T07:33:17.981825+0000","last_clean":"2024-09-16T07:33:17.981825+0000","last_became_active":"2024-09-16T07:33:16.844232+0000","last_became_peered":"2024-09-16T07:33:16.844232+0000","last_unstale":"2024-09-16T07:33:17.981825+0000","last_undegraded":"2024-09-16T07:33:17.981825+0000","last_fullsized":"2024-09-16T07:33:17.981825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:35:30.071389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821221+0000","last_change":"2024-09-16T07:33:16.839359+0000","last_active":"2024-09-16T07:33:17.821221+0000","last_peered":"2024-09-16T07:33:17.821221+0000","last_clean":"2024-09-16T07:33:17.821221+0000","last_became_active":"2024-09-16T07:33:16.839084+0000","last_became_peered":"2024-09-16T07:33:16.839084+0000","last_unstale":"2024-09-16T07:33:17.821221+0000","last_undegraded":"2024-09-16T07:33:17.821221+0000","last_fullsized":"2024-09-16T07:33:17.821221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:52:46.807022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822372+0000","last_change":"2024-09-16T07:33:16.842137+0000","last_active":"2024-09-16T07:33:17.822372+0000","last_peered":"2024-09-16T07:33:17.822372+0000","last_clean":"2024-09-16T07:33:17.822372+0000","last_became_active":"2024-09-16T07:33:16.841801+0000","last_became_peered":"2024-09-16T07:33:16.841801+0000","last_unstale":"2024-09-16T07:33:17.822372+0000","last_undegraded":"2024-09-16T07:33:17.822372+0000","last_fullsized":"2024-09-16T07:33:17.822372+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:18.296919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980348+0000","last_change":"2024-09-16T07:33:16.842586+0000","last_active":"2024-09-16T07:33:17.980348+0000","last_peered":"2024-09-16T07:33:17.980348+0000","last_clean":"2024-09-16T07:33:17.980348+0000","last_became_active":"2024-09-16T07:33:16.842262+0000","last_became_peered":"2024-09-16T07:33:16.842262+0000","last_unstale":"2024-09-16T07:33:17.980348+0000","last_undegraded":"2024-09-16T07:33:17.980348+0000","last_fullsized":"2024-09-16T07:33:17.980348+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:58:15.501041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818988+0000","last_change":"2024-09-16T07:33:16.824138+0000","last_active":"2024-09-16T07:33:17.818988+0000","last_peered":"2024-09-16T07:33:17.818988+0000","last_clean":"2024-09-16T07:33:17.818988+0000","last_became_active":"2024-09-16T07:33:16.823880+0000","last_became_peered":"2024-09-16T07:33:16.823880+0000","last_unstale":"2024-09-16T07:33:17.818988+0000","last_undegraded":"2024-09-16T07:33:17.818988+0000","last_fullsized":"2024-09-16T07:33:17.818988+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:17.597750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819404+0000","last_change":"2024-09-16T07:33:16.828920+0000","last_active":"2024-09-16T07:33:17.819404+0000","last_peered":"2024-09-16T07:33:17.819404+0000","last_clean":"2024-09-16T07:33:17.819404+0000","last_became_active":"2024-09-16T07:33:16.828619+0000","last_became_peered":"2024-09-16T07:33:16.828619+0000","last_unstale":"2024-09-16T07:33:17.819404+0000","last_undegraded":"2024-09-16T07:33:17.819404+0000","last_fullsized":"2024-09-16T07:33:17.819404+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:55.660970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"98'4","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822585+0000","last_change":"2024-09-16T07:33:15.816591+0000","last_active":"2024-09-16T07:33:17.822585+0000","last_peered":"2024-09-16T07:33:17.822585+0000","last_clean":"2024-09-16T07:33:17.822585+0000","last_became_active":"2024-09-16T07:33:15.816111+0000","last_became_peered":"2024-09-16T07:33:15.816111+0000","last_unstale":"2024-09-16T07:33:17.822585+0000","last_undegraded":"2024-09-16T07:33:17.822585+0000","last_fullsized":"2024-09-16T07:33:17.822585+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:33.713908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839468+0000","last_change":"2024-09-16T07:33:16.843190+0000","last_active":"2024-09-16T07:33:17.839468+0000","last_peered":"2024-09-16T07:33:17.839468+0000","last_clean":"2024-09-16T07:33:17.839468+0000","last_became_active":"2024-09-16T07:33:16.842769+0000","last_became_peered":"2024-09-16T07:33:16.842769+0000","last_unstale":"2024-09-16T07:33:17.839468+0000","last_undegraded":"2024-09-16T07:33:17.839468+0000","last_fullsized":"2024-09-16T07:33:17.839468+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:02:18.512124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978249+0000","last_change":"2024-09-16T07:33:15.818256+0000","last_active":"2024-09-16T07:33:17.978249+0000","last_peered":"2024-09-16T07:33:17.978249+0000","last_clean":"2024-09-16T07:33:17.978249+0000","last_became_active":"2024-09-16T07:33:15.817975+0000","last_became_peered":"2024-09-16T07:33:15.817975+0000","last_unstale":"2024-09-16T07:33:17.978249+0000","last_undegraded":"2024-09-16T07:33:17.978249+0000","last_fullsized":"2024-09-16T07:33:17.978249+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:00.044484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819088+0000","last_change":"2024-09-16T07:33:16.825160+0000","last_active":"2024-09-16T07:33:17.819088+0000","last_peered":"2024-09-16T07:33:17.819088+0000","last_clean":"2024-09-16T07:33:17.819088+0000","last_became_active":"2024-09-16T07:33:16.824908+0000","last_became_peered":"2024-09-16T07:33:16.824908+0000","last_unstale":"2024-09-16T07:33:17.819088+0000","last_undegraded":"2024-09-16T07:33:17.819088+0000","last_fullsized":"2024-09-16T07:33:17.819088+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:27.823106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981008+0000","last_change":"2024-09-16T07:33:15.831135+0000","last_active":"2024-09-16T07:33:17.981008+0000","last_peered":"2024-09-16T07:33:17.981008+0000","last_clean":"2024-09-16T07:33:17.981008+0000","last_became_active":"2024-09-16T07:33:15.830870+0000","last_became_peered":"2024-09-16T07:33:15.830870+0000","last_unstale":"2024-09-16T07:33:17.981008+0000","last_undegraded":"2024-09-16T07:33:17.981008+0000","last_fullsized":"2024-09-16T07:33:17.981008+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:27:10.842957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978848+0000","last_change":"2024-09-16T07:33:16.849404+0000","last_active":"2024-09-16T07:33:17.978848+0000","last_peered":"2024-09-16T07:33:17.978848+0000","last_clean":"2024-09-16T07:33:17.978848+0000","last_became_active":"2024-09-16T07:33:16.849135+0000","last_became_peered":"2024-09-16T07:33:16.849135+0000","last_unstale":"2024-09-16T07:33:17.978848+0000","last_undegraded":"2024-09-16T07:33:17.978848+0000","last_fullsized":"2024-09-16T07:33:17.978848+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:39:34.866931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979951+0000","last_change":"2024-09-16T07:33:15.828234+0000","last_active":"2024-09-16T07:33:17.979951+0000","last_peered":"2024-09-16T07:33:17.979951+0000","last_clean":"2024-09-16T07:33:17.979951+0000","last_became_active":"2024-09-16T07:33:15.826974+0000","last_became_peered":"2024-09-16T07:33:15.826974+0000","last_unstale":"2024-09-16T07:33:17.979951+0000","last_undegraded":"2024-09-16T07:33:17.979951+0000","last_fullsized":"2024-09-16T07:33:17.979951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:58:30.628595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979884+0000","last_change":"2024-09-16T07:33:16.840718+0000","last_active":"2024-09-16T07:33:17.979884+0000","last_peered":"2024-09-16T07:33:17.979884+0000","last_clean":"2024-09-16T07:33:17.979884+0000","last_became_active":"2024-09-16T07:33:16.839210+0000","last_became_peered":"2024-09-16T07:33:16.839210+0000","last_unstale":"2024-09-16T07:33:17.979884+0000","last_undegraded":"2024-09-16T07:33:17.979884+0000","last_fullsized":"2024-09-16T07:33:17.979884+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:09:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822237+0000","last_change":"2024-09-16T07:33:15.822184+0000","last_active":"2024-09-16T07:33:17.822237+0000","last_peered":"2024-09-16T07:33:17.822237+0000","last_clean":"2024-09-16T07:33:17.822237+0000","last_became_active":"2024-09-16T07:33:15.821896+0000","last_became_peered":"2024-09-16T07:33:15.821896+0000","last_unstale":"2024-09-16T07:33:17.822237+0000","last_undegraded":"2024-09-16T07:33:17.822237+0000","last_fullsized":"2024-09-16T07:33:17.822237+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:13.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821154+0000","last_change":"2024-09-16T07:33:16.829011+0000","last_active":"2024-09-16T07:33:17.821154+0000","last_peered":"2024-09-16T07:33:17.821154+0000","last_clean":"2024-09-16T07:33:17.821154+0000","last_became_active":"2024-09-16T07:33:16.828739+0000","last_became_peered":"2024-09-16T07:33:16.828739+0000","last_unstale":"2024-09-16T07:33:17.821154+0000","last_undegraded":"2024-09-16T07:33:17.821154+0000","last_fullsized":"2024-09-16T07:33:17.821154+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:15.525294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981737+0000","last_change":"2024-09-16T07:33:15.815359+0000","last_active":"2024-09-16T07:33:17.981737+0000","last_peered":"2024-09-16T07:33:17.981737+0000","last_clean":"2024-09-16T07:33:17.981737+0000","last_became_active":"2024-09-16T07:33:15.814864+0000","last_became_peered":"2024-09-16T07:33:15.814864+0000","last_unstale":"2024-09-16T07:33:17.981737+0000","last_undegraded":"2024-09-16T07:33:17.981737+0000","last_fullsized":"2024-09-16T07:33:17.981737+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:51.638191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979786+0000","last_change":"2024-09-16T07:33:16.848868+0000","last_active":"2024-09-16T07:33:17.979786+0000","last_peered":"2024-09-16T07:33:17.979786+0000","last_clean":"2024-09-16T07:33:17.979786+0000","last_became_active":"2024-09-16T07:33:16.848342+0000","last_became_peered":"2024-09-16T07:33:16.848342+0000","last_unstale":"2024-09-16T07:33:17.979786+0000","last_undegraded":"2024-09-16T07:33:17.979786+0000","last_fullsized":"2024-09-16T07:33:17.979786+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:04:29.816618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820678+0000","last_change":"2024-09-16T07:33:15.814123+0000","last_active":"2024-09-16T07:33:17.820678+0000","last_peered":"2024-09-16T07:33:17.820678+0000","last_clean":"2024-09-16T07:33:17.820678+0000","last_became_active":"2024-09-16T07:33:15.813731+0000","last_became_peered":"2024-09-16T07:33:15.813731+0000","last_unstale":"2024-09-16T07:33:17.820678+0000","last_undegraded":"2024-09-16T07:33:17.820678+0000","last_fullsized":"2024-09-16T07:33:17.820678+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.712121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822196+0000","last_change":"2024-09-16T07:33:16.836301+0000","last_active":"2024-09-16T07:33:17.822196+0000","last_peered":"2024-09-16T07:33:17.822196+0000","last_clean":"2024-09-16T07:33:17.822196+0000","last_became_active":"2024-09-16T07:33:16.836019+0000","last_became_peered":"2024-09-16T07:33:16.836019+0000","last_unstale":"2024-09-16T07:33:17.822196+0000","last_undegraded":"2024-09-16T07:33:17.822196+0000","last_fullsized":"2024-09-16T07:33:17.822196+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:19.080853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979967+0000","last_change":"2024-09-16T07:33:15.832648+0000","last_active":"2024-09-16T07:33:17.979967+0000","last_peered":"2024-09-16T07:33:17.979967+0000","last_clean":"2024-09-16T07:33:17.979967+0000","last_became_active":"2024-09-16T07:33:15.832331+0000","last_became_peered":"2024-09-16T07:33:15.832331+0000","last_unstale":"2024-09-16T07:33:17.979967+0000","last_undegraded":"2024-09-16T07:33:17.979967+0000","last_fullsized":"2024-09-16T07:33:17.979967+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:02.261016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822721+0000","last_change":"2024-09-16T07:33:16.838015+0000","last_active":"2024-09-16T07:33:17.822721+0000","last_peered":"2024-09-16T07:33:17.822721+0000","last_clean":"2024-09-16T07:33:17.822721+0000","last_became_active":"2024-09-16T07:33:16.837720+0000","last_became_peered":"2024-09-16T07:33:16.837720+0000","last_unstale":"2024-09-16T07:33:17.822721+0000","last_undegraded":"2024-09-16T07:33:17.822721+0000","last_fullsized":"2024-09-16T07:33:17.822721+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:51.404243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981136+0000","last_change":"2024-09-16T07:33:15.829283+0000","last_active":"2024-09-16T07:33:17.981136+0000","last_peered":"2024-09-16T07:33:17.981136+0000","last_clean":"2024-09-16T07:33:17.981136+0000","last_became_active":"2024-09-16T07:33:15.827908+0000","last_became_peered":"2024-09-16T07:33:15.827908+0000","last_unstale":"2024-09-16T07:33:17.981136+0000","last_undegraded":"2024-09-16T07:33:17.981136+0000","last_fullsized":"2024-09-16T07:33:17.981136+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:29.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839510+0000","last_change":"2024-09-16T07:33:16.835561+0000","last_active":"2024-09-16T07:33:17.839510+0000","last_peered":"2024-09-16T07:33:17.839510+0000","last_clean":"2024-09-16T07:33:17.839510+0000","last_became_active":"2024-09-16T07:33:16.835270+0000","last_became_peered":"2024-09-16T07:33:16.835270+0000","last_unstale":"2024-09-16T07:33:17.839510+0000","last_undegraded":"2024-09-16T07:33:17.839510+0000","last_fullsized":"2024-09-16T07:33:17.839510+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:45.323919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981802+0000","last_change":"2024-09-16T07:33:15.821160+0000","last_active":"2024-09-16T07:33:17.981802+0000","last_peered":"2024-09-16T07:33:17.981802+0000","last_clean":"2024-09-16T07:33:17.981802+0000","last_became_active":"2024-09-16T07:33:15.820931+0000","last_became_peered":"2024-09-16T07:33:15.820931+0000","last_unstale":"2024-09-16T07:33:17.981802+0000","last_undegraded":"2024-09-16T07:33:17.981802+0000","last_fullsized":"2024-09-16T07:33:17.981802+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:41:27.110266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981811+0000","last_change":"2024-09-16T07:33:16.833482+0000","last_active":"2024-09-16T07:33:17.981811+0000","last_peered":"2024-09-16T07:33:17.981811+0000","last_clean":"2024-09-16T07:33:17.981811+0000","last_became_active":"2024-09-16T07:33:16.832916+0000","last_became_peered":"2024-09-16T07:33:16.832916+0000","last_unstale":"2024-09-16T07:33:17.981811+0000","last_undegraded":"2024-09-16T07:33:17.981811+0000","last_fullsized":"2024-09-16T07:33:17.981811+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:46:08.389557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"98'3","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980257+0000","last_change":"2024-09-16T07:33:15.835042+0000","last_active":"2024-09-16T07:33:17.980257+0000","last_peered":"2024-09-16T07:33:17.980257+0000","last_clean":"2024-09-16T07:33:17.980257+0000","last_became_active":"2024-09-16T07:33:15.834077+0000","last_became_peered":"2024-09-16T07:33:15.834077+0000","last_unstale":"2024-09-16T07:33:17.980257+0000","last_undegraded":"2024-09-16T07:33:17.980257+0000","last_fullsized":"2024-09-16T07:33:17.980257+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:52:47.595893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822648+0000","last_change":"2024-09-16T07:33:16.838571+0000","last_active":"2024-09-16T07:33:17.822648+0000","last_peered":"2024-09-16T07:33:17.822648+0000","last_clean":"2024-09-16T07:33:17.822648+0000","last_became_active":"2024-09-16T07:33:16.838306+0000","last_became_peered":"2024-09-16T07:33:16.838306+0000","last_unstale":"2024-09-16T07:33:17.822648+0000","last_undegraded":"2024-09-16T07:33:17.822648+0000","last_fullsized":"2024-09-16T07:33:17.822648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:41:28.116483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"98'6","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980612+0000","last_change":"2024-09-16T07:33:15.827718+0000","last_active":"2024-09-16T07:33:17.980612+0000","last_peered":"2024-09-16T07:33:17.980612+0000","last_clean":"2024-09-16T07:33:17.980612+0000","last_became_active":"2024-09-16T07:33:15.827439+0000","last_became_peered":"2024-09-16T07:33:15.827439+0000","last_unstale":"2024-09-16T07:33:17.980612+0000","last_undegraded":"2024-09-16T07:33:17.980612+0000","last_fullsized":"2024-09-16T07:33:17.980612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:22.020454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981739+0000","last_change":"2024-09-16T07:33:16.836812+0000","last_active":"2024-09-16T07:33:17.981739+0000","last_peered":"2024-09-16T07:33:17.981739+0000","last_clean":"2024-09-16T07:33:17.981739+0000","last_became_active":"2024-09-16T07:33:16.836424+0000","last_became_peered":"2024-09-16T07:33:16.836424+0000","last_unstale":"2024-09-16T07:33:17.981739+0000","last_undegraded":"2024-09-16T07:33:17.981739+0000","last_fullsized":"2024-09-16T07:33:17.981739+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:35:05.830093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818911+0000","last_change":"2024-09-16T07:33:15.821579+0000","last_active":"2024-09-16T07:33:17.818911+0000","last_peered":"2024-09-16T07:33:17.818911+0000","last_clean":"2024-09-16T07:33:17.818911+0000","last_became_active":"2024-09-16T07:33:15.821336+0000","last_became_peered":"2024-09-16T07:33:15.821336+0000","last_unstale":"2024-09-16T07:33:17.818911+0000","last_undegraded":"2024-09-16T07:33:17.818911+0000","last_fullsized":"2024-09-16T07:33:17.818911+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:09:25.483633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981650+0000","last_change":"2024-09-16T07:33:16.846375+0000","last_active":"2024-09-16T07:33:17.981650+0000","last_peered":"2024-09-16T07:33:17.981650+0000","last_clean":"2024-09-16T07:33:17.981650+0000","last_became_active":"2024-09-16T07:33:16.845171+0000","last_became_peered":"2024-09-16T07:33:16.845171+0000","last_unstale":"2024-09-16T07:33:17.981650+0000","last_undegraded":"2024-09-16T07:33:17.981650+0000","last_fullsized":"2024-09-16T07:33:17.981650+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:29.639164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839120+0000","last_change":"2024-09-16T07:33:15.830186+0000","last_active":"2024-09-16T07:33:17.839120+0000","last_peered":"2024-09-16T07:33:17.839120+0000","last_clean":"2024-09-16T07:33:17.839120+0000","last_became_active":"2024-09-16T07:33:15.829905+0000","last_became_peered":"2024-09-16T07:33:15.829905+0000","last_unstale":"2024-09-16T07:33:17.839120+0000","last_undegraded":"2024-09-16T07:33:17.839120+0000","last_fullsized":"2024-09-16T07:33:17.839120+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:59.478012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981082+0000","last_change":"2024-09-16T07:33:16.828296+0000","last_active":"2024-09-16T07:33:17.981082+0000","last_peered":"2024-09-16T07:33:17.981082+0000","last_clean":"2024-09-16T07:33:17.981082+0000","last_became_active":"2024-09-16T07:33:16.827749+0000","last_became_peered":"2024-09-16T07:33:16.827749+0000","last_unstale":"2024-09-16T07:33:17.981082+0000","last_undegraded":"2024-09-16T07:33:17.981082+0000","last_fullsized":"2024-09-16T07:33:17.981082+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:22.546908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"98'8","reported_seq":23,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979740+0000","last_change":"2024-09-16T07:33:15.834050+0000","last_active":"2024-09-16T07:33:17.979740+0000","last_peered":"2024-09-16T07:33:17.979740+0000","last_clean":"2024-09-16T07:33:17.979740+0000","last_became_active":"2024-09-16T07:33:15.833764+0000","last_became_peered":"2024-09-16T07:33:15.833764+0000","last_unstale":"2024-09-16T07:33:17.979740+0000","last_undegraded":"2024-09-16T07:33:17.979740+0000","last_fullsized":"2024-09-16T07:33:17.979740+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:04:57.999026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981140+0000","last_change":"2024-09-16T07:33:16.842614+0000","last_active":"2024-09-16T07:33:17.981140+0000","last_peered":"2024-09-16T07:33:17.981140+0000","last_clean":"2024-09-16T07:33:17.981140+0000","last_became_active":"2024-09-16T07:33:16.842282+0000","last_became_peered":"2024-09-16T07:33:16.842282+0000","last_unstale":"2024-09-16T07:33:17.981140+0000","last_undegraded":"2024-09-16T07:33:17.981140+0000","last_fullsized":"2024-09-16T07:33:17.981140+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:43.189736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981187+0000","last_change":"2024-09-16T07:33:15.832270+0000","last_active":"2024-09-16T07:33:17.981187+0000","last_peered":"2024-09-16T07:33:17.981187+0000","last_clean":"2024-09-16T07:33:17.981187+0000","last_became_active":"2024-09-16T07:33:15.831548+0000","last_became_peered":"2024-09-16T07:33:15.831548+0000","last_unstale":"2024-09-16T07:33:17.981187+0000","last_undegraded":"2024-09-16T07:33:17.981187+0000","last_fullsized":"2024-09-16T07:33:17.981187+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:05.052230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819479+0000","last_change":"2024-09-16T07:33:16.836800+0000","last_active":"2024-09-16T07:33:17.819479+0000","last_peered":"2024-09-16T07:33:17.819479+0000","last_clean":"2024-09-16T07:33:17.819479+0000","last_became_active":"2024-09-16T07:33:16.836591+0000","last_became_peered":"2024-09-16T07:33:16.836591+0000","last_unstale":"2024-09-16T07:33:17.819479+0000","last_undegraded":"2024-09-16T07:33:17.819479+0000","last_fullsized":"2024-09-16T07:33:17.819479+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:47:06.716453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981083+0000","last_change":"2024-09-16T07:33:15.818610+0000","last_active":"2024-09-16T07:33:17.981083+0000","last_peered":"2024-09-16T07:33:17.981083+0000","last_clean":"2024-09-16T07:33:17.981083+0000","last_became_active":"2024-09-16T07:33:15.818258+0000","last_became_peered":"2024-09-16T07:33:15.818258+0000","last_unstale":"2024-09-16T07:33:17.981083+0000","last_undegraded":"2024-09-16T07:33:17.981083+0000","last_fullsized":"2024-09-16T07:33:17.981083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:58.179784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978381+0000","last_change":"2024-09-16T07:33:16.848053+0000","last_active":"2024-09-16T07:33:17.978381+0000","last_peered":"2024-09-16T07:33:17.978381+0000","last_clean":"2024-09-16T07:33:17.978381+0000","last_became_active":"2024-09-16T07:33:16.847700+0000","last_became_peered":"2024-09-16T07:33:16.847700+0000","last_unstale":"2024-09-16T07:33:17.978381+0000","last_undegraded":"2024-09-16T07:33:17.978381+0000","last_fullsized":"2024-09-16T07:33:17.978381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:15.525294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"98'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839268+0000","last_change":"2024-09-16T07:33:15.815113+0000","last_active":"2024-09-16T07:33:17.839268+0000","last_peered":"2024-09-16T07:33:17.839268+0000","last_clean":"2024-09-16T07:33:17.839268+0000","last_became_active":"2024-09-16T07:33:15.814765+0000","last_became_peered":"2024-09-16T07:33:15.814765+0000","last_unstale":"2024-09-16T07:33:17.839268+0000","last_undegraded":"2024-09-16T07:33:17.839268+0000","last_fullsized":"2024-09-16T07:33:17.839268+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:54:40.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978919+0000","last_change":"2024-09-16T07:33:16.843938+0000","last_active":"2024-09-16T07:33:17.978919+0000","last_peered":"2024-09-16T07:33:17.978919+0000","last_clean":"2024-09-16T07:33:17.978919+0000","last_became_active":"2024-09-16T07:33:16.843680+0000","last_became_peered":"2024-09-16T07:33:16.843680+0000","last_unstale":"2024-09-16T07:33:17.978919+0000","last_undegraded":"2024-09-16T07:33:17.978919+0000","last_fullsized":"2024-09-16T07:33:17.978919+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:20:45.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822442+0000","last_change":"2024-09-16T07:33:15.826185+0000","last_active":"2024-09-16T07:33:17.822442+0000","last_peered":"2024-09-16T07:33:17.822442+0000","last_clean":"2024-09-16T07:33:17.822442+0000","last_became_active":"2024-09-16T07:33:15.825914+0000","last_became_peered":"2024-09-16T07:33:15.825914+0000","last_unstale":"2024-09-16T07:33:17.822442+0000","last_undegraded":"2024-09-16T07:33:17.822442+0000","last_fullsized":"2024-09-16T07:33:17.822442+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:46.512323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978330+0000","last_change":"2024-09-16T07:33:16.845695+0000","last_active":"2024-09-16T07:33:17.978330+0000","last_peered":"2024-09-16T07:33:17.978330+0000","last_clean":"2024-09-16T07:33:17.978330+0000","last_became_active":"2024-09-16T07:33:16.845398+0000","last_became_peered":"2024-09-16T07:33:16.845398+0000","last_unstale":"2024-09-16T07:33:17.978330+0000","last_undegraded":"2024-09-16T07:33:17.978330+0000","last_fullsized":"2024-09-16T07:33:17.978330+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:20.841282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.819008+0000","last_change":"2024-09-16T07:33:15.820120+0000","last_active":"2024-09-16T07:33:17.819008+0000","last_peered":"2024-09-16T07:33:17.819008+0000","last_clean":"2024-09-16T07:33:17.819008+0000","last_became_active":"2024-09-16T07:33:15.819852+0000","last_became_peered":"2024-09-16T07:33:15.819852+0000","last_unstale":"2024-09-16T07:33:17.819008+0000","last_undegraded":"2024-09-16T07:33:17.819008+0000","last_fullsized":"2024-09-16T07:33:17.819008+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:32.475094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979876+0000","last_change":"2024-09-16T07:33:16.841399+0000","last_active":"2024-09-16T07:33:17.979876+0000","last_peered":"2024-09-16T07:33:17.979876+0000","last_clean":"2024-09-16T07:33:17.979876+0000","last_became_active":"2024-09-16T07:33:16.841115+0000","last_became_peered":"2024-09-16T07:33:16.841115+0000","last_unstale":"2024-09-16T07:33:17.979876+0000","last_undegraded":"2024-09-16T07:33:17.979876+0000","last_fullsized":"2024-09-16T07:33:17.979876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:27.651793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979765+0000","last_change":"2024-09-16T07:33:15.823691+0000","last_active":"2024-09-16T07:33:17.979765+0000","last_peered":"2024-09-16T07:33:17.979765+0000","last_clean":"2024-09-16T07:33:17.979765+0000","last_became_active":"2024-09-16T07:33:15.823396+0000","last_became_peered":"2024-09-16T07:33:15.823396+0000","last_unstale":"2024-09-16T07:33:17.979765+0000","last_undegraded":"2024-09-16T07:33:17.979765+0000","last_fullsized":"2024-09-16T07:33:17.979765+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:03.975852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978403+0000","last_change":"2024-09-16T07:33:16.849672+0000","last_active":"2024-09-16T07:33:17.978403+0000","last_peered":"2024-09-16T07:33:17.978403+0000","last_clean":"2024-09-16T07:33:17.978403+0000","last_became_active":"2024-09-16T07:33:16.849460+0000","last_became_peered":"2024-09-16T07:33:16.849460+0000","last_unstale":"2024-09-16T07:33:17.978403+0000","last_undegraded":"2024-09-16T07:33:17.978403+0000","last_fullsized":"2024-09-16T07:33:17.978403+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:14.810255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.818727+0000","last_change":"2024-09-16T07:33:15.820114+0000","last_active":"2024-09-16T07:33:17.818727+0000","last_peered":"2024-09-16T07:33:17.818727+0000","last_clean":"2024-09-16T07:33:17.818727+0000","last_became_active":"2024-09-16T07:33:15.819828+0000","last_became_peered":"2024-09-16T07:33:15.819828+0000","last_unstale":"2024-09-16T07:33:17.818727+0000","last_undegraded":"2024-09-16T07:33:17.818727+0000","last_fullsized":"2024-09-16T07:33:17.818727+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:45:38.881196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981429+0000","last_change":"2024-09-16T07:33:16.842420+0000","last_active":"2024-09-16T07:33:17.981429+0000","last_peered":"2024-09-16T07:33:17.981429+0000","last_clean":"2024-09-16T07:33:17.981429+0000","last_became_active":"2024-09-16T07:33:16.842192+0000","last_became_peered":"2024-09-16T07:33:16.842192+0000","last_unstale":"2024-09-16T07:33:17.981429+0000","last_undegraded":"2024-09-16T07:33:17.981429+0000","last_fullsized":"2024-09-16T07:33:17.981429+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:03.267233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980061+0000","last_change":"2024-09-16T07:33:15.835441+0000","last_active":"2024-09-16T07:33:17.980061+0000","last_peered":"2024-09-16T07:33:17.980061+0000","last_clean":"2024-09-16T07:33:17.980061+0000","last_became_active":"2024-09-16T07:33:15.835145+0000","last_became_peered":"2024-09-16T07:33:15.835145+0000","last_unstale":"2024-09-16T07:33:17.980061+0000","last_undegraded":"2024-09-16T07:33:17.980061+0000","last_fullsized":"2024-09-16T07:33:17.980061+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:51.784997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839367+0000","last_change":"2024-09-16T07:33:16.839916+0000","last_active":"2024-09-16T07:33:17.839367+0000","last_peered":"2024-09-16T07:33:17.839367+0000","last_clean":"2024-09-16T07:33:17.839367+0000","last_became_active":"2024-09-16T07:33:16.839629+0000","last_became_peered":"2024-09-16T07:33:16.839629+0000","last_unstale":"2024-09-16T07:33:17.839367+0000","last_undegraded":"2024-09-16T07:33:17.839367+0000","last_fullsized":"2024-09-16T07:33:17.839367+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:22:26.968627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"98'2","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981734+0000","last_change":"2024-09-16T07:33:15.830425+0000","last_active":"2024-09-16T07:33:17.981734+0000","last_peered":"2024-09-16T07:33:17.981734+0000","last_clean":"2024-09-16T07:33:17.981734+0000","last_became_active":"2024-09-16T07:33:15.830292+0000","last_became_peered":"2024-09-16T07:33:15.830292+0000","last_unstale":"2024-09-16T07:33:17.981734+0000","last_undegraded":"2024-09-16T07:33:17.981734+0000","last_fullsized":"2024-09-16T07:33:17.981734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:50.377922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981028+0000","last_change":"2024-09-16T07:33:16.835716+0000","last_active":"2024-09-16T07:33:17.981028+0000","last_peered":"2024-09-16T07:33:17.981028+0000","last_clean":"2024-09-16T07:33:17.981028+0000","last_became_active":"2024-09-16T07:33:16.835415+0000","last_became_peered":"2024-09-16T07:33:16.835415+0000","last_unstale":"2024-09-16T07:33:17.981028+0000","last_undegraded":"2024-09-16T07:33:17.981028+0000","last_fullsized":"2024-09-16T07:33:17.981028+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:02.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"99'1","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.840786+0000","last_change":"2024-09-16T07:33:15.812821+0000","last_active":"2024-09-16T07:33:17.840786+0000","last_peered":"2024-09-16T07:33:17.840786+0000","last_clean":"2024-09-16T07:33:17.840786+0000","last_became_active":"2024-09-16T07:33:15.812154+0000","last_became_peered":"2024-09-16T07:33:15.812154+0000","last_unstale":"2024-09-16T07:33:17.840786+0000","last_undegraded":"2024-09-16T07:33:17.840786+0000","last_fullsized":"2024-09-16T07:33:17.840786+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:47.245755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980437+0000","last_change":"2024-09-16T07:33:16.842948+0000","last_active":"2024-09-16T07:33:17.980437+0000","last_peered":"2024-09-16T07:33:17.980437+0000","last_clean":"2024-09-16T07:33:17.980437+0000","last_became_active":"2024-09-16T07:33:16.841819+0000","last_became_peered":"2024-09-16T07:33:16.841819+0000","last_unstale":"2024-09-16T07:33:17.980437+0000","last_undegraded":"2024-09-16T07:33:17.980437+0000","last_fullsized":"2024-09-16T07:33:17.980437+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:51.547941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980250+0000","last_change":"2024-09-16T07:33:15.827983+0000","last_active":"2024-09-16T07:33:17.980250+0000","last_peered":"2024-09-16T07:33:17.980250+0000","last_clean":"2024-09-16T07:33:17.980250+0000","last_became_active":"2024-09-16T07:33:15.827727+0000","last_became_peered":"2024-09-16T07:33:15.827727+0000","last_unstale":"2024-09-16T07:33:17.980250+0000","last_undegraded":"2024-09-16T07:33:17.980250+0000","last_fullsized":"2024-09-16T07:33:17.980250+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:06.969437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.839324+0000","last_change":"2024-09-16T07:33:16.836128+0000","last_active":"2024-09-16T07:33:17.839324+0000","last_peered":"2024-09-16T07:33:17.839324+0000","last_clean":"2024-09-16T07:33:17.839324+0000","last_became_active":"2024-09-16T07:33:16.834944+0000","last_became_peered":"2024-09-16T07:33:16.834944+0000","last_unstale":"2024-09-16T07:33:17.839324+0000","last_undegraded":"2024-09-16T07:33:17.839324+0000","last_fullsized":"2024-09-16T07:33:17.839324+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:03.550593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981868+0000","last_change":"2024-09-16T07:33:15.829949+0000","last_active":"2024-09-16T07:33:17.981868+0000","last_peered":"2024-09-16T07:33:17.981868+0000","last_clean":"2024-09-16T07:33:17.981868+0000","last_became_active":"2024-09-16T07:33:15.829687+0000","last_became_peered":"2024-09-16T07:33:15.829687+0000","last_unstale":"2024-09-16T07:33:17.981868+0000","last_undegraded":"2024-09-16T07:33:17.981868+0000","last_fullsized":"2024-09-16T07:33:17.981868+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:32:50.398026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820699+0000","last_change":"2024-09-16T07:33:16.834986+0000","last_active":"2024-09-16T07:33:17.820699+0000","last_peered":"2024-09-16T07:33:17.820699+0000","last_clean":"2024-09-16T07:33:17.820699+0000","last_became_active":"2024-09-16T07:33:16.834427+0000","last_became_peered":"2024-09-16T07:33:16.834427+0000","last_unstale":"2024-09-16T07:33:17.820699+0000","last_undegraded":"2024-09-16T07:33:17.820699+0000","last_fullsized":"2024-09-16T07:33:17.820699+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:34.819097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822376+0000","last_change":"2024-09-16T07:33:15.816313+0000","last_active":"2024-09-16T07:33:17.822376+0000","last_peered":"2024-09-16T07:33:17.822376+0000","last_clean":"2024-09-16T07:33:17.822376+0000","last_became_active":"2024-09-16T07:33:15.815966+0000","last_became_peered":"2024-09-16T07:33:15.815966+0000","last_unstale":"2024-09-16T07:33:17.822376+0000","last_undegraded":"2024-09-16T07:33:17.822376+0000","last_fullsized":"2024-09-16T07:33:17.822376+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:13.967183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.821383+0000","last_change":"2024-09-16T07:33:16.834247+0000","last_active":"2024-09-16T07:33:17.821383+0000","last_peered":"2024-09-16T07:33:17.821383+0000","last_clean":"2024-09-16T07:33:17.821383+0000","last_became_active":"2024-09-16T07:33:16.833970+0000","last_became_peered":"2024-09-16T07:33:16.833970+0000","last_unstale":"2024-09-16T07:33:17.821383+0000","last_undegraded":"2024-09-16T07:33:17.821383+0000","last_fullsized":"2024-09-16T07:33:17.821383+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:14.236236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.820892+0000","last_change":"2024-09-16T07:33:15.820850+0000","last_active":"2024-09-16T07:33:17.820892+0000","last_peered":"2024-09-16T07:33:17.820892+0000","last_clean":"2024-09-16T07:33:17.820892+0000","last_became_active":"2024-09-16T07:33:15.820526+0000","last_became_peered":"2024-09-16T07:33:15.820526+0000","last_unstale":"2024-09-16T07:33:17.820892+0000","last_undegraded":"2024-09-16T07:33:17.820892+0000","last_fullsized":"2024-09-16T07:33:17.820892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:23.793983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978577+0000","last_change":"2024-09-16T07:33:16.844160+0000","last_active":"2024-09-16T07:33:17.978577+0000","last_peered":"2024-09-16T07:33:17.978577+0000","last_clean":"2024-09-16T07:33:17.978577+0000","last_became_active":"2024-09-16T07:33:16.843905+0000","last_became_peered":"2024-09-16T07:33:16.843905+0000","last_unstale":"2024-09-16T07:33:17.978577+0000","last_undegraded":"2024-09-16T07:33:17.978577+0000","last_fullsized":"2024-09-16T07:33:17.978577+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:50.091395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.979788+0000","last_change":"2024-09-16T07:33:15.823632+0000","last_active":"2024-09-16T07:33:17.979788+0000","last_peered":"2024-09-16T07:33:17.979788+0000","last_clean":"2024-09-16T07:33:17.979788+0000","last_became_active":"2024-09-16T07:33:15.823353+0000","last_became_peered":"2024-09-16T07:33:15.823353+0000","last_unstale":"2024-09-16T07:33:17.979788+0000","last_undegraded":"2024-09-16T07:33:17.979788+0000","last_fullsized":"2024-09-16T07:33:17.979788+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:32:11.864464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980922+0000","last_change":"2024-09-16T07:33:16.842469+0000","last_active":"2024-09-16T07:33:17.980922+0000","last_peered":"2024-09-16T07:33:17.980922+0000","last_clean":"2024-09-16T07:33:17.980922+0000","last_became_active":"2024-09-16T07:33:16.841897+0000","last_became_peered":"2024-09-16T07:33:16.841897+0000","last_unstale":"2024-09-16T07:33:17.980922+0000","last_undegraded":"2024-09-16T07:33:17.980922+0000","last_fullsized":"2024-09-16T07:33:17.980922+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:48.603184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.980162+0000","last_change":"2024-09-16T07:33:15.833901+0000","last_active":"2024-09-16T07:33:17.980162+0000","last_peered":"2024-09-16T07:33:17.980162+0000","last_clean":"2024-09-16T07:33:17.980162+0000","last_became_active":"2024-09-16T07:33:15.833551+0000","last_became_peered":"2024-09-16T07:33:15.833551+0000","last_unstale":"2024-09-16T07:33:17.980162+0000","last_undegraded":"2024-09-16T07:33:17.980162+0000","last_fullsized":"2024-09-16T07:33:17.980162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:35:04.823876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.981068+0000","last_change":"2024-09-16T07:33:16.840214+0000","last_active":"2024-09-16T07:33:17.981068+0000","last_peered":"2024-09-16T07:33:17.981068+0000","last_clean":"2024-09-16T07:33:17.981068+0000","last_became_active":"2024-09-16T07:33:16.839706+0000","last_became_peered":"2024-09-16T07:33:16.839706+0000","last_unstale":"2024-09-16T07:33:17.981068+0000","last_undegraded":"2024-09-16T07:33:17.981068+0000","last_fullsized":"2024-09-16T07:33:17.981068+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:15.796460+0000","last_clean_scrub_stamp":"2024-09-16T07:33:15.796460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:19:23.768180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.822279+0000","last_change":"2024-09-16T07:33:15.826771+0000","last_active":"2024-09-16T07:33:17.822279+0000","last_peered":"2024-09-16T07:33:17.822279+0000","last_clean":"2024-09-16T07:33:17.822279+0000","last_became_active":"2024-09-16T07:33:15.826577+0000","last_became_peered":"2024-09-16T07:33:15.826577+0000","last_unstale":"2024-09-16T07:33:17.822279+0000","last_undegraded":"2024-09-16T07:33:17.822279+0000","last_fullsized":"2024-09-16T07:33:17.822279+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:33:14.790242+0000","last_clean_scrub_stamp":"2024-09-16T07:33:14.790242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:23.793983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":281,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:33:17.978542+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:33:17.978542+0000","last_peered":"2024-09-16T07:33:17.978542+0000","last_clean":"2024-09-16T07:33:17.978542+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:33:17.978542+0000","last_undegraded":"2024-09-16T07:33:17.978542+0000","last_fullsized":"2024-09-16T07:33:17.978542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":1123001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1216512,"data_stored":525787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1220608,"data_stored":526321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509504,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1224704,"data_stored":532017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1241088,"data_stored":533699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1212416,"data_stored":525717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1232896,"data_stored":532141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509505,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1826816,"data_stored":1117809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:33:21.321 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:33:21.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:33:21.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 -- 172.21.15.114:0/4129887612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 msgr2=0x7f54f00cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 --2- 172.21.15.114:0/4129887612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 0x7f54f00cc940 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f54f00d0780 tx=0x7f54d801c620 comp rx=0 tx=0).stop 2024-09-16T07:33:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 -- 172.21.15.114:0/4129887612 shutdown_connections 2024-09-16T07:33:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 --2- 172.21.15.114:0/4129887612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 0x7f54f00cc940 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 -- 172.21.15.114:0/4129887612 >> 172.21.15.114:0/4129887612 conn(0x7f54f00d1ea0 msgr2=0x7f54f00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 -- 172.21.15.114:0/4129887612 shutdown_connections 2024-09-16T07:33:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 -- 172.21.15.114:0/4129887612 wait complete. 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 Processor -- start 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.514+0000 7f54f4e00640 1 -- start start 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 0x7f54f015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f015bd50 0x7f54f01509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015c130 0x7f54f00b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f54f016a5b0 con 0x7f54f015c130 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54f016a430 con 0x7f54f00cecf0 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f54f016a730 con 0x7f54f015bd50 2024-09-16T07:33:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015c130 0x7f54f00b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015c130 0x7f54f00b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35676/0 (socket says 172.21.15.114:35676) 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 -- 172.21.15.114:0/1347057465 learned_addr learned my addr 172.21.15.114:0/1347057465 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54e7e00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f015bd50 0x7f54f01509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ede00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 0x7f54f015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 -- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f015bd50 msgr2=0x7f54f01509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f015bd50 0x7f54f01509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 -- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 msgr2=0x7f54f015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 0x7f54f015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 -- 172.21.15.114:0/1347057465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f0159930 con 0x7f54f015c130 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54ee800640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015c130 0x7f54f00b7140 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c6e0 tx=0x7f54e800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54e6000640 1 -- 172.21.15.114:0/1347057465 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8003b80 con 0x7f54f015c130 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54e6000640 1 -- 172.21.15.114:0/1347057465 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54e8003d20 con 0x7f54f015c130 2024-09-16T07:33:21.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54e6000640 1 -- 172.21.15.114:0/1347057465 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8005330 con 0x7f54f015c130 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f0159c10 con 0x7f54f015c130 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f0159ef0 con 0x7f54f015c130 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.518+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f00ce5e0 con 0x7f54f015c130 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.522+0000 7f54e6000640 1 -- 172.21.15.114:0/1347057465 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f54e80054d0 con 0x7f54f015c130 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.522+0000 7f54e6000640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54cc072fe0 0x7f54cc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.522+0000 7f54e6000640 1 -- 172.21.15.114:0/1347057465 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f54e8093e90 con 0x7f54f015c130 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.522+0000 7f54ede00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54cc072fe0 0x7f54cc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.522+0000 7f54ede00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54cc072fe0 0x7f54cc0754a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f54e0001870 tx=0x7f54e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.526+0000 7f54e6000640 1 -- 172.21.15.114:0/1347057465 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f54e805ee20 con 0x7f54f015c130 2024-09-16T07:33:21.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.750+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f54f0154b70 con 0x7f54f015c130 2024-09-16T07:33:21.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.754+0000 7f54e6000640 1 -- 172.21.15.114:0/1347057465 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f54e805e720 con 0x7f54f015c130 2024-09-16T07:33:21.753 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:33:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:33:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:33:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:33:21.753 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:33:21.753 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:33:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54cc072fe0 msgr2=0x7f54cc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54cc072fe0 0x7f54cc0754a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f54e0001870 tx=0x7f54e0009040 comp rx=0 tx=0).stop 2024-09-16T07:33:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015c130 msgr2=0x7f54f00b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015c130 0x7f54f00b7140 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f54e800c6e0 tx=0x7f54e800cba0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 shutdown_connections 2024-09-16T07:33:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54f015c130 0x7f54f00b7140 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54cc072fe0 0x7f54cc0754a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f54f015bd50 0x7f54f01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 --2- 172.21.15.114:0/1347057465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f00cecf0 0x7f54f015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 >> 172.21.15.114:0/1347057465 conn(0x7f54f00d1ea0 msgr2=0x7f54f0157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:21.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 shutdown_connections 2024-09-16T07:33:21.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.758+0000 7f54f4e00640 1 -- 172.21.15.114:0/1347057465 wait complete. 2024-09-16T07:33:21.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:21.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- 172.21.15.114:0/1448591806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b4bd0 msgr2=0x7f83a40b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 --2- 172.21.15.114:0/1448591806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b4bd0 0x7f83a40b2bf0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8390009840 tx=0x7f839001c820 comp rx=0 tx=0).stop 2024-09-16T07:33:21.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- 172.21.15.114:0/1448591806 shutdown_connections 2024-09-16T07:33:21.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 --2- 172.21.15.114:0/1448591806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a40b4bd0 0x7f83a40b2bf0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- 172.21.15.114:0/1448591806 >> 172.21.15.114:0/1448591806 conn(0x7f83a40b18f0 msgr2=0x7f83a40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:21.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- 172.21.15.114:0/1448591806 shutdown_connections 2024-09-16T07:33:21.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- 172.21.15.114:0/1448591806 wait complete. 2024-09-16T07:33:21.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 Processor -- start 2024-09-16T07:33:21.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- start start 2024-09-16T07:33:21.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a40b3130 0x7f83a41f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a415b580 0x7f83a41f9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a41f9c70 0x7f83a409cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4168f70 con 0x7f83a41f9c70 2024-09-16T07:33:21.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83a4168df0 con 0x7f83a415b580 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83abe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83a41690f0 con 0x7f83a40b3130 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83a9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a41f9c70 0x7f83a409cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83a9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a41f9c70 0x7f83a409cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35700/0 (socket says 172.21.15.114:35700) 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83a9e00640 1 -- 172.21.15.114:0/3748780279 learned_addr learned my addr 172.21.15.114:0/3748780279 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83a8a00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a415b580 0x7f83a41f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.918+0000 7f83a9400640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a40b3130 0x7f83a41f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9e00640 1 -- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a40b3130 msgr2=0x7f83a41f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9e00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a40b3130 0x7f83a41f6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9e00640 1 -- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a415b580 msgr2=0x7f83a41f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9e00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a415b580 0x7f83a41f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:21.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9e00640 1 -- 172.21.15.114:0/3748780279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a414cab0 con 0x7f83a41f9c70 2024-09-16T07:33:21.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9400640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a40b3130 0x7f83a41f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:21.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9e00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a41f9c70 0x7f83a409cf10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c440 tx=0x7f839c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a1600640 1 -- 172.21.15.114:0/3748780279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c016020 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a1600640 1 -- 172.21.15.114:0/3748780279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f839c012920 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a409dae0 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a1600640 1 -- 172.21.15.114:0/3748780279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c012d90 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a414d030 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a40b2bf0 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a1600640 1 -- 172.21.15.114:0/3748780279 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f839c019020 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a1600640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8384072fe0 0x7f83840754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a1600640 1 -- 172.21.15.114:0/3748780279 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f839c093ae0 con 0x7f83a41f9c70 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.922+0000 7f83a9400640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8384072fe0 0x7f83840754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.926+0000 7f83a9400640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8384072fe0 0x7f83840754a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83a414e8a0 tx=0x7f8398009570 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:21.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:21.926+0000 7f83a1600640 1 -- 172.21.15.114:0/3748780279 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f839c020070 con 0x7f83a41f9c70 2024-09-16T07:33:22.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.126+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83a4069b00 con 0x7f83a41f9c70 2024-09-16T07:33:22.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.126+0000 7f83a1600640 1 -- 172.21.15.114:0/3748780279 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5234 (secure 0 0 0) 0x7f839c05ea70 con 0x7f83a41f9c70 2024-09-16T07:33:22.127 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:22.127 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":72,"btime":"2024-09-16T07:33:19:840176+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1374083886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1374083886},{"type":"v1","addr":"172.21.15.149:6835","nonce":1374083886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/320868897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":320868897},{"type":"v1","addr":"172.21.15.149:6801","nonce":320868897}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1288852592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1288852592},{"type":"v1","addr":"172.21.15.114:6834","nonce":1288852592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:33:16.201708+0000","modified":"2024-09-16T07:33:19.219727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/3128573512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3128573512},{"type":"v1","addr":"172.21.15.114:6835","nonce":3128573512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6984,"qdb_cluster":[6984]},"id":8}]} 2024-09-16T07:33:22.127 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 72 2024-09-16T07:33:22.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8384072fe0 msgr2=0x7f83840754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8384072fe0 0x7f83840754a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83a414e8a0 tx=0x7f8398009570 comp rx=0 tx=0).stop 2024-09-16T07:33:22.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a41f9c70 msgr2=0x7f83a409cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a41f9c70 0x7f83a409cf10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c440 tx=0x7f839c00c900 comp rx=0 tx=0).stop 2024-09-16T07:33:22.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 shutdown_connections 2024-09-16T07:33:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a41f9c70 0x7f83a409cf10 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83a415b580 0x7f83a41f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8384072fe0 0x7f83840754a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 --2- 172.21.15.114:0/3748780279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83a40b3130 0x7f83a41f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 >> 172.21.15.114:0/3748780279 conn(0x7f83a40b18f0 msgr2=0x7f83a40b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 shutdown_connections 2024-09-16T07:33:22.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.130+0000 7f83abe00640 1 -- 172.21.15.114:0/3748780279 wait complete. 2024-09-16T07:33:22.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:33:16.201708+0000', 'modified': '2024-09-16T07:33:19.219727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6984}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6984': {'gid': 6984, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/3128573512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 3128573512}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 3128573512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6984, 'qdb_cluster': [6984]} 2024-09-16T07:33:22.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:33:22.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T07:33:22.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.694+0000 7f6434c00640 1 -- 172.21.15.114:0/3629661315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 msgr2=0x7f6414004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.694+0000 7f6434c00640 1 --2- 172.21.15.114:0/3629661315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 0x7f6414004020 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6420001860 tx=0x7f642001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642e800640 1 -- 172.21.15.114:0/3629661315 reap_dead start 2024-09-16T07:33:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- 172.21.15.114:0/3629661315 shutdown_connections 2024-09-16T07:33:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- 172.21.15.114:0/3629661315 >> 172.21.15.114:0/3629661315 conn(0x7f64300b18f0 msgr2=0x7f64300b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- 172.21.15.114:0/3629661315 shutdown_connections 2024-09-16T07:33:22.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- 172.21.15.114:0/3629661315 wait complete. 2024-09-16T07:33:22.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 Processor -- start 2024-09-16T07:33:22.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- start start 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 0x7f6430146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f643009aa10 0x7f6430142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64301fbe00 0x7f6430159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6430167240 con 0x7f6414003c20 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f64301670c0 con 0x7f643009aa10 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6434c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f64301673c0 con 0x7f64301fbe00 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 0x7f6430146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 0x7f6430146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35722/0 (socket says 172.21.15.114:35722) 2024-09-16T07:33:22.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 -- 172.21.15.114:0/2122157604 learned_addr learned my addr 172.21.15.114:0/2122157604 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6425400640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f643009aa10 0x7f6430142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642e800640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64301fbe00 0x7f6430159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 -- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64301fbe00 msgr2=0x7f6430159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64301fbe00 0x7f6430159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 -- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f643009aa10 msgr2=0x7f6430142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f643009aa10 0x7f6430142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 -- 172.21.15.114:0/2122157604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643009afb0 con 0x7f6414003c20 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6425400640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f643009aa10 0x7f6430142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f642de00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 0x7f6430146340 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6420005040 tx=0x7f6420006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6426a00640 1 -- 172.21.15.114:0/2122157604 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420003900 con 0x7f6414003c20 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6426a00640 1 -- 172.21.15.114:0/2122157604 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64200b4070 con 0x7f6414003c20 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.698+0000 7f6426a00640 1 -- 172.21.15.114:0/2122157604 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420003df0 con 0x7f6414003c20 2024-09-16T07:33:22.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.702+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643009b290 con 0x7f6414003c20 2024-09-16T07:33:22.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.702+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301fb600 con 0x7f6414003c20 2024-09-16T07:33:22.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.702+0000 7f6426a00640 1 -- 172.21.15.114:0/2122157604 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f64200a5560 con 0x7f6414003c20 2024-09-16T07:33:22.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.702+0000 7f6426a00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f640c073010 0x7f640c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 Processor -- start 2024-09-16T07:33:22.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f6426a00640 1 -- 172.21.15.114:0/2122157604 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f642012e300 con 0x7f6414003c20 2024-09-16T07:33:22.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f6425400640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f640c073010 0x7f640c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- start start 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f6425400640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f640c073010 0x7f640c0754d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6418001ec0 tx=0x7f6418000ff0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c59d0 0x560cff0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff0798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff079e10 0x560cff07a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560cfef9a3f0 con 0x560cff0c59d0 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x560cfeed7b20 con 0x560cff0c62f0 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x560cfeec6f50 con 0x560cff079e10 2024-09-16T07:33:22.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c59d0 0x560cff0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c59d0 0x560cff0c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35734/0 (socket says 172.21.15.114:35734) 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 -- 172.21.15.114:0/1872038808 learned_addr learned my addr 172.21.15.114:0/1872038808 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f6425400640 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff0798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642e800640 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff079e10 0x560cff07a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 -- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff079e10 msgr2=0x560cff07a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff079e10 0x560cff07a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 -- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 msgr2=0x560cff0798d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff0798d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 -- 172.21.15.114:0/1872038808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfee8e590 con 0x560cff0c59d0 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f642de00640 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c59d0 0x560cff0c5db0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f64200f8cc0 tx=0x7f64200f84a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32182aa8d909f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f641ea00640 1 -- 172.21.15.114:0/1872038808 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64200fd030 con 0x560cff0c59d0 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f641ea00640 1 -- 172.21.15.114:0/1872038808 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64200f8d30 con 0x560cff0c59d0 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f641ea00640 1 -- 172.21.15.114:0/1872038808 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64200be040 con 0x560cff0c59d0 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- 172.21.15.114:0/1872038808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c59d0 msgr2=0x560cff0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c59d0 0x560cff0c5db0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f64200f8cc0 tx=0x7f64200f84a0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- 172.21.15.114:0/1872038808 shutdown_connections 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff079e10 0x560cff07a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff0798d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 --2- 172.21.15.114:0/1872038808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c59d0 0x560cff0c5db0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- 172.21.15.114:0/1872038808 >> 172.21.15.114:0/1872038808 conn(0x560cfef63130 msgr2=0x560cff0a8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- 172.21.15.114:0/1872038808 shutdown_connections 2024-09-16T07:33:22.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- 172.21.15.114:0/1872038808 wait complete. 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 -- start start 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.706+0000 7f643810b000 1 Processor -- start 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff079e10 0x560cff0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c62f0 0x560cff0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560cfee615d0 con 0x560cff0c62f0 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x560cfeecad60 con 0x560cff079e10 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x560cfee6d500 con 0x560cff0c59d0 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 10 client.0 _ll_register_callbacks cb 0x560cfee71810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:33:22.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c62f0 0x560cff0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c62f0 0x560cff0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35740/0 (socket says 172.21.15.114:35740) 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 -- 172.21.15.114:0/2462764342 learned_addr learned my addr 172.21.15.114:0/2462764342 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642de00640 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff079e10 0x560cff0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6425400640 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 -- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 msgr2=0x560cff0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff0cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 -- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff079e10 msgr2=0x560cff0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff079e10 0x560cff0ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 -- 172.21.15.114:0/2462764342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfee65170 con 0x560cff0c62f0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642e800640 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c62f0 0x560cff0cd7e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f643006e730 tx=0x7f6428004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293d7db6631ba99 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6413400640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6413400640 1 -- 172.21.15.114:0/2462764342 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428011710 con 0x560cff0c62f0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cfee5f0f0 con 0x560cff0c62f0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6413400640 1 -- 172.21.15.114:0/2462764342 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f64280118b0 con 0x560cff0c62f0 2024-09-16T07:33:22.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6413400640 1 -- 172.21.15.114:0/2462764342 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f6428024050 con 0x560cff0c62f0 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 10 client.7095 fetch_fsmap learned FSMap version 72 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x560cfef4bef0 con 0x560cff0c62f0 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6413400640 1 -- 172.21.15.114:0/2462764342 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560cfee5f0f0 con 0x560cff0c62f0 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6413400640 1 -- 172.21.15.114:0/2462764342 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f6428027020 con 0x560cff0c62f0 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 10 client.7095 fetch_fsmap finished waiting for FSMap version 72 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 10 client.7095 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 20 client.7095 populate_metadata read hostname 'smithi114' 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0d5130 0x560cff0d7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 4 client.7095 mds_command: new command op to 6984 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 --> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cfeed9a70 con 0x560cff0d5130 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642de00640 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0d5130 0x560cff0d7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f6413400640 10 client.7095 ms_handle_connect on v2:172.21.15.114:6833/3128573512 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.710+0000 7f642de00640 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0d5130 0x560cff0d7520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46fab71050276a07 server_cookie=155ea6c09cb10cb7 in_seq=0 out_seq=0 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f6413400640 1 -- 172.21.15.114:0/2462764342 <== mds.0 v2:172.21.15.114:6833/3128573512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560cfeed9a70 con 0x560cff0d5130 2024-09-16T07:33:22.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f6413400640 10 client.7095 handle_command_reply: tid=0 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 client.7095 shutdown 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c62f0 msgr2=0x560cff0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c62f0 0x560cff0cd7e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f643006e730 tx=0x7f6428004410 comp rx=0 tx=0).stop 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 shutdown_connections 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0d5130 0x560cff0d7520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff0c62f0 0x560cff0cd7e0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff0cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f6413400640 0 client.7095 ms_handle_reset on v2:172.21.15.114:6833/3128573512 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 --2- 172.21.15.114:0/2462764342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff079e10 0x560cff0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 >> 172.21.15.114:0/2462764342 conn(0x560cfef63130 msgr2=0x560cff078fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 shutdown_connections 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 1 -- 172.21.15.114:0/2462764342 wait complete. 2024-09-16T07:33:22.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.714+0000 7f643810b000 20 client.7095 trim_cache size 0 max 16384 2024-09-16T07:33:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.730+0000 7f643810b000 1 Processor -- start 2024-09-16T07:33:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.730+0000 7f643810b000 1 -- start start 2024-09-16T07:33:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff138040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff138580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff138ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6430204c20 con 0x560cff079e10 2024-09-16T07:33:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6430203c70 con 0x560cff0c62f0 2024-09-16T07:33:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f643009d430 con 0x560cff0c59d0 2024-09-16T07:33:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35744/0 (socket says 172.21.15.114:35744) 2024-09-16T07:33:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 -- 172.21.15.114:0/1847980634 learned_addr learned my addr 172.21.15.114:0/1847980634 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f6425400640 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642e800640 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff138ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 -- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 msgr2=0x560cff138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 -- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 msgr2=0x560cff138ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff138ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 -- 172.21.15.114:0/1847980634 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfef22d90 con 0x560cff079e10 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff138040 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f642001ce50 tx=0x7f6420003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac256234e4124017 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f641e000640 1 -- 172.21.15.114:0/1847980634 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64200be040 con 0x560cff079e10 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f641e000640 1 -- 172.21.15.114:0/1847980634 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f642011a3a0 con 0x560cff079e10 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f641e000640 1 -- 172.21.15.114:0/1847980634 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64200fd040 con 0x560cff079e10 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- 172.21.15.114:0/1847980634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 msgr2=0x560cff138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff138040 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f642001ce50 tx=0x7f6420003f90 comp rx=0 tx=0).stop 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- 172.21.15.114:0/1847980634 shutdown_connections 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff138ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- 172.21.15.114:0/1847980634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff138040 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- 172.21.15.114:0/1847980634 >> 172.21.15.114:0/1847980634 conn(0x560cfef63130 msgr2=0x560cff0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- 172.21.15.114:0/1847980634 shutdown_connections 2024-09-16T07:33:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- 172.21.15.114:0/1847980634 wait complete. 2024-09-16T07:33:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- start start 2024-09-16T07:33:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 Processor -- start 2024-09-16T07:33:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff13bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff13c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff13c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x560cfee92ec0 con 0x560cff079e10 2024-09-16T07:33:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f643009da80 con 0x560cff0c62f0 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x560cfeeca070 con 0x560cff0c59d0 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f643810b000 10 client.0 _ll_register_callbacks cb 0x7f6428003ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff13bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff13bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35754/0 (socket says 172.21.15.114:35754) 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642de00640 1 -- 172.21.15.114:0/1521766344 learned_addr learned my addr 172.21.15.114:0/1521766344 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.734+0000 7f642e800640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff13c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6425400640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff13c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f642de00640 1 -- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 msgr2=0x560cff13c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f642de00640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff13c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f642de00640 1 -- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 msgr2=0x560cff13c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f642de00640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff13c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f642de00640 1 -- 172.21.15.114:0/1521766344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfee8da90 con 0x560cff079e10 2024-09-16T07:33:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6425400640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff13c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f642de00640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff13bcd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f64200f8cc0 tx=0x7f64200013d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e0abfb82f6c08f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 1 -- 172.21.15.114:0/1521766344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64200be070 con 0x560cff079e10 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 1 -- 172.21.15.114:0/1521766344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f642012c780 con 0x560cff079e10 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cfeed5520 con 0x560cff079e10 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 1 -- 172.21.15.114:0/1521766344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f64200fd040 con 0x560cff079e10 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 10 client.7101 fetch_fsmap learned FSMap version 72 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x560cfee6c050 con 0x560cff079e10 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 1 -- 172.21.15.114:0/1521766344 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560cfeed5520 con 0x560cff079e10 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 1 -- 172.21.15.114:0/1521766344 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7f64200f8f90 con 0x560cff079e10 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 10 client.7101 fetch_fsmap finished waiting for FSMap version 72 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 10 client.7101 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:33:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 20 client.7101 populate_metadata read hostname 'smithi114' 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0db1d0 0x560cff0db5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 4 client.7101 mds_command: new command op to 6984 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 --> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] -- command(tid 0: {"prefix": "status"}) -- 0x560cfeed2950 con 0x560cff0db1d0 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6425400640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0db1d0 0x560cff0db5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 10 client.7101 ms_handle_connect on v2:172.21.15.114:6833/3128573512 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6425400640 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0db1d0 0x560cff0db5b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25649d5f4b9dc41d server_cookie=1961acd6d1ae56d6 in_seq=0 out_seq=0 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 1 -- 172.21.15.114:0/1521766344 <== mds.0 v2:172.21.15.114:6833/3128573512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560cfeed2950 con 0x560cff0db1d0 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 10 client.7101 handle_command_reply: tid=0 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 client.7101 shutdown 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 msgr2=0x560cff13bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff13bcd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f64200f8cc0 tx=0x7f64200013d0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 shutdown_connections 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:6833/3128573512,v1:172.21.15.114:6835/3128573512] conn(0x560cff0db1d0 0x560cff0db5b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cff0c62f0 0x560cff13c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x560cff0c59d0 0x560cff13c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 --2- 172.21.15.114:0/1521766344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560cff079e10 0x560cff13bcd0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 >> 172.21.15.114:0/1521766344 conn(0x560cfef63130 msgr2=0x560cff0788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6413400640 0 client.7101 ms_handle_reset on v2:172.21.15.114:6833/3128573512 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 shutdown_connections 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 1 -- 172.21.15.114:0/1521766344 wait complete. 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f643810b000 20 client.7101 trim_cache size 0 max 16384 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:33:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 6984, 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 5.9120875880000003, 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 72, 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 99, 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 99, 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 10.427189093999999 2024-09-16T07:33:22.745 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f640c073010 msgr2=0x7f640c0754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f640c073010 0x7f640c0754d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6418001ec0 tx=0x7f6418000ff0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 msgr2=0x7f6430146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 0x7f6430146340 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6420005040 tx=0x7f6420006950 comp rx=0 tx=0).stop 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 shutdown_connections 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f640c073010 0x7f640c0754d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64301fbe00 0x7f6430159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f643009aa10 0x7f6430142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 --2- 172.21.15.114:0/2122157604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6414003c20 0x7f6430146340 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 >> 172.21.15.114:0/2122157604 conn(0x7f64300b18f0 msgr2=0x7f64300aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 shutdown_connections 2024-09-16T07:33:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.738+0000 7f6434c00640 1 -- 172.21.15.114:0/2122157604 wait complete. 2024-09-16T07:33:22.758 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:33:22.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 -- 172.21.15.114:0/3253249854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203015f000 msgr2=0x7f20300d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 --2- 172.21.15.114:0/3253249854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203015f000 0x7f20300d01b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2020009900 tx=0x7f202001c850 comp rx=0 tx=0).stop 2024-09-16T07:33:22.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 -- 172.21.15.114:0/3253249854 shutdown_connections 2024-09-16T07:33:22.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 --2- 172.21.15.114:0/3253249854 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20300b2590 0x7f20300b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 --2- 172.21.15.114:0/3253249854 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f203015f000 0x7f20300d01b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 -- 172.21.15.114:0/3253249854 >> 172.21.15.114:0/3253249854 conn(0x7f203009aa10 msgr2=0x7f203009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:22.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 -- 172.21.15.114:0/3253249854 shutdown_connections 2024-09-16T07:33:22.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 -- 172.21.15.114:0/3253249854 wait complete. 2024-09-16T07:33:22.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 Processor -- start 2024-09-16T07:33:22.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.906+0000 7f2035400640 1 -- start start 2024-09-16T07:33:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20300b2590 0x7f203006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20300cefb0 0x7f20300b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203015f000 0x7f2030156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2030168f10 con 0x7f20300b2590 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2030168d90 con 0x7f20300cefb0 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2030169090 con 0x7f203015f000 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20300b2590 0x7f203006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20300b2590 0x7f203006f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35768/0 (socket says 172.21.15.114:35768) 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 -- 172.21.15.114:0/3963822830 learned_addr learned my addr 172.21.15.114:0/3963822830 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2027400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20300cefb0 0x7f20300b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2034a00640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203015f000 0x7f2030156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 -- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203015f000 msgr2=0x7f2030156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203015f000 0x7f2030156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 -- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20300cefb0 msgr2=0x7f20300b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20300cefb0 0x7f20300b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 -- 172.21.15.114:0/3963822830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203006fa80 con 0x7f20300b2590 2024-09-16T07:33:22.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202fe00640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20300b2590 0x7f203006f480 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f20200b0040 tx=0x7f2020005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202cc00640 1 -- 172.21.15.114:0/3963822830 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20200b2040 con 0x7f20300b2590 2024-09-16T07:33:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202cc00640 1 -- 172.21.15.114:0/3963822830 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2020004230 con 0x7f20300b2590 2024-09-16T07:33:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f202cc00640 1 -- 172.21.15.114:0/3963822830 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020005030 con 0x7f20300b2590 2024-09-16T07:33:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203006e870 con 0x7f20300b2590 2024-09-16T07:33:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203006ee30 con 0x7f20300b2590 2024-09-16T07:33:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.910+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20300cd030 con 0x7f20300b2590 2024-09-16T07:33:22.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.914+0000 7f202cc00640 1 -- 172.21.15.114:0/3963822830 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f20200051d0 con 0x7f20300b2590 2024-09-16T07:33:22.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.914+0000 7f202cc00640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f200c072fe0 0x7f200c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:22.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.914+0000 7f202cc00640 1 -- 172.21.15.114:0/3963822830 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5767+0+0 (secure 0 0 0) 0x7f202012dad0 con 0x7f20300b2590 2024-09-16T07:33:22.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.914+0000 7f2027400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f200c072fe0 0x7f200c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:22.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.914+0000 7f2027400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f200c072fe0 0x7f200c0754a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20300cdba0 tx=0x7f2018009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:22.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:22.918+0000 7f202cc00640 1 -- 172.21.15.114:0/3963822830 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f20200164d0 con 0x7f20300b2590 2024-09-16T07:33:23.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.118+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f20300b0920 con 0x7f20300b2590 2024-09-16T07:33:23.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.118+0000 7f202cc00640 1 -- 172.21.15.114:0/3963822830 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) ==== 53+0+73 (secure 0 0 0) 0x7f20200f8b20 con 0x7f20300b2590 2024-09-16T07:33:23.119 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f200c072fe0 msgr2=0x7f200c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f200c072fe0 0x7f200c0754a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20300cdba0 tx=0x7f2018009040 comp rx=0 tx=0).stop 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20300b2590 msgr2=0x7f203006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20300b2590 0x7f203006f480 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f20200b0040 tx=0x7f2020005de0 comp rx=0 tx=0).stop 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 shutdown_connections 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f200c072fe0 0x7f200c0754a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f203015f000 0x7f2030156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:23.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20300cefb0 0x7f20300b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:23.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 --2- 172.21.15.114:0/3963822830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20300b2590 0x7f203006f480 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:23.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 >> 172.21.15.114:0/3963822830 conn(0x7f203009aa10 msgr2=0x7f20300aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:23.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 shutdown_connections 2024-09-16T07:33:23.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23.122+0000 7f2035400640 1 -- 172.21.15.114:0/3963822830 wait complete. 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:33:23.139 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:33:23.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:23.140 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:33:23.152 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:33:23.152 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:33:23.152 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:33:23.152 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.152 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:23.153 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42138sec preferred_lft 42138sec 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.154 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:23.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:23.155 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:33:23.212 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:33:23.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:23.215 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:33:23.270 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:33:23.271 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:33:23.272 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:33:23.272 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:33:23.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:33:23.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:33:23.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:33:23.272 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:33:23.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:33:23.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:33:23.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:23.413 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:33:23.462 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:33:23.463 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:33:23.463 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:33:23.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:23.464 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:33:23.526 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:33:23.526 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:23.578 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:33:23.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:33:23.579 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:23.630 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:33:23.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:23.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:33:23.718 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:33:23.718 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:33:23.718 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:33:23.733 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:33:23.733 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:33:23.734 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:33:23.734 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:33:23.734 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:33:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:33:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:33:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:33:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:33:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:33:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:33:23.744 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:33:23.745 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:33:23.748 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:33:23.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:23.748 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:23.768 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:33:23.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:33:23.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:33:23.878 INFO:teuthology.orchestra.run.smithi114.stdout:client6775 2024-09-16T07:33:23.878 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:23.878 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:23.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:33:24.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- 172.21.15.114:0/3776049040 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 msgr2=0x7ff5e40ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:24.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3776049040 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 0x7ff5e40ccdf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009bc0 tx=0x7ff5dc01cba0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- 172.21.15.114:0/3776049040 shutdown_connections 2024-09-16T07:33:24.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3776049040 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 0x7ff5e40ccdf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3776049040 >> v2:172.21.15.149:3300/0 conn(0x7ff5e40cebf0 0x7ff5e40cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- 172.21.15.114:0/3776049040 >> 172.21.15.114:0/3776049040 conn(0x7ff5e40d1da0 msgr2=0x7ff5e40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:24.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- 172.21.15.114:0/3776049040 shutdown_connections 2024-09-16T07:33:24.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- 172.21.15.114:0/3776049040 wait complete. 2024-09-16T07:33:24.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 Processor -- start 2024-09-16T07:33:24.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- start start 2024-09-16T07:33:24.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 0x7ff5e41548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:24.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e40cebf0 0x7ff5e415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:24.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e415be80 0x7ff5e415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41692b0 con 0x7ff5e40cebf0 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e4169130 con 0x7ff5e415be80 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.074+0000 7ff5ec200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e4169430 con 0x7ff5e40b6400 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e40cebf0 0x7ff5e415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 0x7ff5e41548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e40cebf0 0x7ff5e415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35784/0 (socket says 172.21.15.114:35784) 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 0x7ff5e41548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:47336/0 (socket says 172.21.15.114:47336) 2024-09-16T07:33:24.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 -- 172.21.15.114:0/3159001321 learned_addr learned my addr 172.21.15.114:0/3159001321 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:24.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5ea200640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e415be80 0x7ff5e415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:24.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 -- 172.21.15.114:0/3159001321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 msgr2=0x7ff5e41548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:24.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 0x7ff5e41548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 -- 172.21.15.114:0/3159001321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e415be80 msgr2=0x7ff5e415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:24.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e415be80 0x7ff5e415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 -- 172.21.15.114:0/3159001321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e4143d90 con 0x7ff5e40cebf0 2024-09-16T07:33:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e8e00640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e40cebf0 0x7ff5e415ade0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000ea20 tx=0x7ff5d000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e1600640 1 -- 172.21.15.114:0/3159001321 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000cd80 con 0x7ff5e40cebf0 2024-09-16T07:33:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e1600640 1 -- 172.21.15.114:0/3159001321 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5d0010430 con 0x7ff5e40cebf0 2024-09-16T07:33:24.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e1600640 1 -- 172.21.15.114:0/3159001321 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0010860 con 0x7ff5e40cebf0 2024-09-16T07:33:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e41f8cf0 con 0x7ff5e40cebf0 2024-09-16T07:33:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e41f92b0 con 0x7ff5e40cebf0 2024-09-16T07:33:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e40ce4e0 con 0x7ff5e40cebf0 2024-09-16T07:33:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.078+0000 7ff5e1600640 1 -- 172.21.15.114:0/3159001321 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7ff5d0010a00 con 0x7ff5e40cebf0 2024-09-16T07:33:24.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.082+0000 7ff5e1600640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5c4073010 0x7ff5c40754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.082+0000 7ff5e1600640 1 -- 172.21.15.114:0/3159001321 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7ff5d0094c10 con 0x7ff5e40cebf0 2024-09-16T07:33:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.082+0000 7ff5e9800640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5c4073010 0x7ff5c40754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.082+0000 7ff5e9800640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5c4073010 0x7ff5c40754d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5e41f8c50 tx=0x7ff5d8007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:24.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.086+0000 7ff5e1600640 1 -- 172.21.15.114:0/3159001321 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff5d005f510 con 0x7ff5e40cebf0 2024-09-16T07:33:24.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff5e4076410 con 0x7ff5e40cebf0 2024-09-16T07:33:24.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5e1600640 1 -- 172.21.15.114:0/3159001321 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) ==== 53+0+73 (secure 0 0 0) 0x7ff5d0063f40 con 0x7ff5e40cebf0 2024-09-16T07:33:24.284 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:33:24.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5c4073010 msgr2=0x7ff5c40754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:24.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5c4073010 0x7ff5c40754d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5e41f8c50 tx=0x7ff5d8007ec0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e40cebf0 msgr2=0x7ff5e415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:24.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e40cebf0 0x7ff5e415ade0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000ea20 tx=0x7ff5d000eee0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 shutdown_connections 2024-09-16T07:33:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5e415be80 0x7ff5e415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5e40cebf0 0x7ff5e415ade0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5c4073010 0x7ff5c40754d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 --2- 172.21.15.114:0/3159001321 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5e40b6400 0x7ff5e41548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 >> 172.21.15.114:0/3159001321 conn(0x7ff5e40d1da0 msgr2=0x7ff5e4071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 shutdown_connections 2024-09-16T07:33:24.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:24.286+0000 7ff5ec200640 1 -- 172.21.15.114:0/3159001321 wait complete. 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:33:24.305 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:33:24.306 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:33:24.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:24.306 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:33:24.315 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:33:24.316 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42145sec preferred_lft 42145sec 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:33:24.317 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:33:24.318 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:33:24.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:24.319 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:33:24.383 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:33:24.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:24.385 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:33:24.443 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:33:24.443 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:33:24.443 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:33:24.443 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:33:24.443 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:33:24.443 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:33:24.444 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:33:24.444 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:33:24.444 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:33:24.444 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:33:24.444 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:33:24.444 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:33:24.444 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:33:24.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:33:24.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:33:24.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:33:24.445 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:33:24.538 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:33:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:33:24.581 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:33:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:33:24.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:24.594 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:33:24.605 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:33:24.605 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:33:24.605 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:33:24.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:24.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:33:24.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:33:24.668 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:33:24.719 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:33:24.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:33:24.720 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:33:24.770 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:33:24.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:24.770 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:33:24.862 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:33:24.863 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:33:24.863 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:33:24.880 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:33:24.880 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:33:24.880 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:33:24.880 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:33:24.880 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:33:24.888 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:33:24.888 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:33:24.888 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:33:24.888 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:33:24.889 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:33:24.889 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:33:24.889 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:33:24.889 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:33:24.892 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:33:24.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:24.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:33:24.912 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:33:25.002 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:33:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:33:25.005 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:33:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:33:25.011 INFO:teuthology.orchestra.run.smithi149.stdout:client6119 2024-09-16T07:33:25.011 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:25.011 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:25.063 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:33:25.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 -- 172.21.15.114:0/402619067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0415a8c0 msgr2=0x7fab0415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:25.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 --2- 172.21.15.114:0/402619067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0415a8c0 0x7fab0415f100 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fab0415b0f0 tx=0x7faaf401c600 comp rx=0 tx=0).stop 2024-09-16T07:33:25.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 -- 172.21.15.114:0/402619067 shutdown_connections 2024-09-16T07:33:25.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 --2- 172.21.15.114:0/402619067 >> v2:172.21.15.149:3300/0 conn(0x7fab04073660 0x7fab040ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 --2- 172.21.15.114:0/402619067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab0415aca0 0x7fab04073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 --2- 172.21.15.114:0/402619067 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab0415a8c0 0x7fab0415f100 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 -- 172.21.15.114:0/402619067 >> 172.21.15.114:0/402619067 conn(0x7fab040b2140 msgr2=0x7fab040b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:25.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 -- 172.21.15.114:0/402619067 shutdown_connections 2024-09-16T07:33:25.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 -- 172.21.15.114:0/402619067 wait complete. 2024-09-16T07:33:25.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 Processor -- start 2024-09-16T07:33:25.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.210+0000 7fab0aa00640 1 -- start start 2024-09-16T07:33:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04073660 0x7fab041521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab0415a8c0 0x7fab040cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0415aca0 0x7fab040cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab040700f0 con 0x7fab04073660 2024-09-16T07:33:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab0406ff70 con 0x7fab0415aca0 2024-09-16T07:33:25.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab04070270 con 0x7fab0415a8c0 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04073660 0x7fab041521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04073660 0x7fab041521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34748/0 (socket says 172.21.15.114:34748) 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 -- 172.21.15.114:0/2333870952 learned_addr learned my addr 172.21.15.114:0/2333870952 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7faafb400640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab0415a8c0 0x7fab040cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab08a00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0415aca0 0x7fab040cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 -- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab0415a8c0 msgr2=0x7fab040cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab0415a8c0 0x7fab040cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 -- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0415aca0 msgr2=0x7fab040cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0415aca0 0x7fab040cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 -- 172.21.15.114:0/2333870952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab041563e0 con 0x7fab04073660 2024-09-16T07:33:25.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab03e00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04073660 0x7fab041521d0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faaf401acb0 tx=0x7faaf40a9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:25.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab00c00640 1 -- 172.21.15.114:0/2333870952 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf40ad040 con 0x7fab04073660 2024-09-16T07:33:25.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab00c00640 1 -- 172.21.15.114:0/2333870952 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faaf40aad60 con 0x7fab04073660 2024-09-16T07:33:25.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab00c00640 1 -- 172.21.15.114:0/2333870952 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4005290 con 0x7fab04073660 2024-09-16T07:33:25.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab041566c0 con 0x7fab04073660 2024-09-16T07:33:25.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0415ce80 con 0x7fab04073660 2024-09-16T07:33:25.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.214+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0415f100 con 0x7fab04073660 2024-09-16T07:33:25.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.218+0000 7fab00c00640 1 -- 172.21.15.114:0/2333870952 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7faaf40b0070 con 0x7fab04073660 2024-09-16T07:33:25.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.218+0000 7fab00c00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae0072fe0 0x7faae00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:25.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.218+0000 7fab00c00640 1 -- 172.21.15.114:0/2333870952 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7faaf412e530 con 0x7fab04073660 2024-09-16T07:33:25.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.218+0000 7faafb400640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae0072fe0 0x7faae00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:25.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.218+0000 7faafb400640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae0072fe0 0x7faae00754a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab041f8bf0 tx=0x7faaec00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:25.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.222+0000 7fab00c00640 1 -- 172.21.15.114:0/2333870952 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7faaf40c3030 con 0x7fab04073660 2024-09-16T07:33:25.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.422+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fab040ce3b0 con 0x7fab04073660 2024-09-16T07:33:25.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.886+0000 7fab00c00640 1 -- 172.21.15.114:0/2333870952 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v73) ==== 136+0+0 (secure 0 0 0) 0x7faaf40164b0 con 0x7fab04073660 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae0072fe0 msgr2=0x7faae00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae0072fe0 0x7faae00754a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab041f8bf0 tx=0x7faaec00b2e0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04073660 msgr2=0x7fab041521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04073660 0x7fab041521d0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faaf401acb0 tx=0x7faaf40a9500 comp rx=0 tx=0).stop 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 shutdown_connections 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0415aca0 0x7fab040cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae0072fe0 0x7faae00754a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab0415a8c0 0x7fab040cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 --2- 172.21.15.114:0/2333870952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04073660 0x7fab041521d0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:25.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 >> 172.21.15.114:0/2333870952 conn(0x7fab040b2140 msgr2=0x7fab04070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:25.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 shutdown_connections 2024-09-16T07:33:25.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:25.890+0000 7fab0aa00640 1 -- 172.21.15.114:0/2333870952 wait complete. 2024-09-16T07:33:25.908 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:33:26.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 -- 172.21.15.114:0/928163935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183015ade0 msgr2=0x7f18300cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 --2- 172.21.15.114:0/928163935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183015ade0 0x7f18300cebf0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f1830070d80 tx=0x7f182001c5d0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 -- 172.21.15.114:0/928163935 shutdown_connections 2024-09-16T07:33:26.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 --2- 172.21.15.114:0/928163935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18300b4bd0 0x7f183015e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 --2- 172.21.15.114:0/928163935 >> v2:172.21.15.149:3300/0 conn(0x7f183006e810 0x7f18300cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 --2- 172.21.15.114:0/928163935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183015ade0 0x7f18300cebf0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 -- 172.21.15.114:0/928163935 >> 172.21.15.114:0/928163935 conn(0x7f18300b18f0 msgr2=0x7f18300b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 -- 172.21.15.114:0/928163935 shutdown_connections 2024-09-16T07:33:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.050+0000 7f1835a00640 1 -- 172.21.15.114:0/928163935 wait complete. 2024-09-16T07:33:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 Processor -- start 2024-09-16T07:33:26.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 -- start start 2024-09-16T07:33:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183006e810 0x7f18300ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18300b4bd0 0x7f18300aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f183015ade0 0x7f18300b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f183006f100 con 0x7f183006e810 2024-09-16T07:33:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f183006ef80 con 0x7f183015ade0 2024-09-16T07:33:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f183006f280 con 0x7f18300b4bd0 2024-09-16T07:33:26.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183006e810 0x7f18300ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183006e810 0x7f18300ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34776/0 (socket says 172.21.15.114:34776) 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 -- 172.21.15.114:0/3386603989 learned_addr learned my addr 172.21.15.114:0/3386603989 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182f400640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f183015ade0 0x7f18300b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182e000640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18300b4bd0 0x7f18300aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 -- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18300b4bd0 msgr2=0x7f18300aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18300b4bd0 0x7f18300aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 -- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f183015ade0 msgr2=0x7f18300b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f183015ade0 0x7f18300b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 -- 172.21.15.114:0/3386603989 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18300aef60 con 0x7f183006e810 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182f400640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f183015ade0 0x7f18300b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182e000640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18300b4bd0 0x7f18300aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f182ea00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183006e810 0x7f18300ad2f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f182001ac80 tx=0x7f18200a9470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1826a00640 1 -- 172.21.15.114:0/3386603989 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18200ad070 con 0x7f183006e810 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1826a00640 1 -- 172.21.15.114:0/3386603989 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18200a9d40 con 0x7f183006e810 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1826a00640 1 -- 172.21.15.114:0/3386603989 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820005290 con 0x7f183006e810 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18300ad980 con 0x7f183006e810 2024-09-16T07:33:26.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.054+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18300adf40 con 0x7f183006e810 2024-09-16T07:33:26.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.058+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183015e900 con 0x7f183006e810 2024-09-16T07:33:26.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.058+0000 7f1826a00640 1 -- 172.21.15.114:0/3386603989 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f18200b0070 con 0x7f183006e810 2024-09-16T07:33:26.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.058+0000 7f1826a00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1810072fe0 0x7f18100754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.058+0000 7f1826a00640 1 -- 172.21.15.114:0/3386603989 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f182012e560 con 0x7f183006e810 2024-09-16T07:33:26.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.058+0000 7f182e000640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1810072fe0 0x7f18100754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.058+0000 7f182e000640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1810072fe0 0x7f18100754a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18301550e0 tx=0x7f181c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:26.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.062+0000 7f1826a00640 1 -- 172.21.15.114:0/3386603989 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f18300aef60 con 0x7f183006e810 2024-09-16T07:33:26.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.250+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f18300cf720 con 0x7f1810072fe0 2024-09-16T07:33:26.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.250+0000 7f1826a00640 1 -- 172.21.15.114:0/3386603989 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f18300cf720 con 0x7f1810072fe0 2024-09-16T07:33:26.251 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:33:26.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:26.251 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:33:26.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:26.251 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:33:26.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1810072fe0 msgr2=0x7f18100754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1810072fe0 0x7f18100754a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18301550e0 tx=0x7f181c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183006e810 msgr2=0x7f18300ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183006e810 0x7f18300ad2f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f182001ac80 tx=0x7f18200a9470 comp rx=0 tx=0).stop 2024-09-16T07:33:26.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 shutdown_connections 2024-09-16T07:33:26.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f183015ade0 0x7f18300b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1810072fe0 0x7f18100754a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18300b4bd0 0x7f18300aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 --2- 172.21.15.114:0/3386603989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f183006e810 0x7f18300ad2f0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 >> 172.21.15.114:0/3386603989 conn(0x7f18300b18f0 msgr2=0x7f18301547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:26.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 shutdown_connections 2024-09-16T07:33:26.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.254+0000 7f1835a00640 1 -- 172.21.15.114:0/3386603989 wait complete. 2024-09-16T07:33:26.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:33:26.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- 172.21.15.114:0/3172179487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800d28c0 msgr2=0x7f75800cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 --2- 172.21.15.114:0/3172179487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800d28c0 0x7f75800cea20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7568009840 tx=0x7f756801c820 comp rx=0 tx=0).stop 2024-09-16T07:33:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- 172.21.15.114:0/3172179487 shutdown_connections 2024-09-16T07:33:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 --2- 172.21.15.114:0/3172179487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800d28c0 0x7f75800cea20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 --2- 172.21.15.114:0/3172179487 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f758015be80 0x7f75800ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- 172.21.15.114:0/3172179487 >> 172.21.15.114:0/3172179487 conn(0x7f75800d1da0 msgr2=0x7f75800d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- 172.21.15.114:0/3172179487 shutdown_connections 2024-09-16T07:33:26.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- 172.21.15.114:0/3172179487 wait complete. 2024-09-16T07:33:26.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 Processor -- start 2024-09-16T07:33:26.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- start start 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800b53f0 0x7f7580156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75800d28c0 0x7f7580156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f758015be80 0x7f75801f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75801691c0 con 0x7f75800d28c0 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7580169040 con 0x7f75800b53f0 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7586400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7580169340 con 0x7f758015be80 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7576a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75800d28c0 0x7f7580156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.422+0000 7f7576a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75800d28c0 0x7f7580156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34788/0 (socket says 172.21.15.114:34788) 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7576a00640 1 -- 172.21.15.114:0/527046315 learned_addr learned my addr 172.21.15.114:0/527046315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f757fe00640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f758015be80 0x7f75801f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f757f400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800b53f0 0x7f7580156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7576a00640 1 -- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f758015be80 msgr2=0x7f75801f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7576a00640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f758015be80 0x7f75801f6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7576a00640 1 -- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800b53f0 msgr2=0x7f7580156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7576a00640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800b53f0 0x7f7580156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7576a00640 1 -- 172.21.15.114:0/527046315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758015c6a0 con 0x7f75800d28c0 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f757fe00640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f758015be80 0x7f75801f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:26.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f757f400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800b53f0 0x7f7580156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:26.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7576a00640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75800d28c0 0x7f7580156ff0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f756801d0c0 tx=0x7f75680a6570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:26.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7577e00640 1 -- 172.21.15.114:0/527046315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568004240 con 0x7f75800d28c0 2024-09-16T07:33:26.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7577e00640 1 -- 172.21.15.114:0/527046315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75680c0070 con 0x7f75800d28c0 2024-09-16T07:33:26.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758015c980 con 0x7f75800d28c0 2024-09-16T07:33:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7577e00640 1 -- 172.21.15.114:0/527046315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568003800 con 0x7f75800d28c0 2024-09-16T07:33:26.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758015cf40 con 0x7f75800d28c0 2024-09-16T07:33:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75800b5880 con 0x7f75800d28c0 2024-09-16T07:33:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.426+0000 7f7577e00640 1 -- 172.21.15.114:0/527046315 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7f75680039a0 con 0x7f75800d28c0 2024-09-16T07:33:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.430+0000 7f7577e00640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f755c072fe0 0x7f755c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.430+0000 7f7577e00640 1 -- 172.21.15.114:0/527046315 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f756812f1b0 con 0x7f75800d28c0 2024-09-16T07:33:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.430+0000 7f757f400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f755c072fe0 0x7f755c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:26.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.430+0000 7f757f400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f755c072fe0 0x7f755c0754a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7570009b90 tx=0x7f7570009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:26.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.434+0000 7f7577e00640 1 -- 172.21.15.114:0/527046315 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7568016410 con 0x7f75800d28c0 2024-09-16T07:33:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7580159090 con 0x7f75800d28c0 2024-09-16T07:33:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7577e00640 1 -- 172.21.15.114:0/527046315 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f7568003c90 con 0x7f75800d28c0 2024-09-16T07:33:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f755c072fe0 msgr2=0x7f755c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f755c072fe0 0x7f755c0754a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7570009b90 tx=0x7f7570009260 comp rx=0 tx=0).stop 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75800d28c0 msgr2=0x7f7580156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75800d28c0 0x7f7580156ff0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f756801d0c0 tx=0x7f75680a6570 comp rx=0 tx=0).stop 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 shutdown_connections 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f755c072fe0 0x7f755c0754a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f758015be80 0x7f75801f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75800d28c0 0x7f7580156ff0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 --2- 172.21.15.114:0/527046315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75800b53f0 0x7f7580156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 >> 172.21.15.114:0/527046315 conn(0x7f75800d1da0 msgr2=0x7f75800b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 shutdown_connections 2024-09-16T07:33:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:26.602+0000 7f7586400640 1 -- 172.21.15.114:0/527046315 wait complete. 2024-09-16T07:33:26.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:26.623 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac) 2024-09-16T07:33:26.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:26.650 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/fake) 2024-09-16T07:33:26.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:26.722 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:33:26.776 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:33:26.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:26.777 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac) 2024-09-16T07:33:26.844 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:26.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol55200/.meta 2024-09-16T07:33:26.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol55200 2024-09-16T07:33:27.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 -- 172.21.15.114:0/3560860407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb180cecf0 msgr2=0x7ffb180cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 --2- 172.21.15.114:0/3560860407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb180cecf0 0x7ffb180cc940 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ffb180d0f60 tx=0x7ffb0001c7c0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 -- 172.21.15.114:0/3560860407 shutdown_connections 2024-09-16T07:33:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 --2- 172.21.15.114:0/3560860407 >> v2:172.21.15.149:3300/0 conn(0x7ffb1815c130 0x7ffb180cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 --2- 172.21.15.114:0/3560860407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb180cecf0 0x7ffb180cc940 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 -- 172.21.15.114:0/3560860407 >> 172.21.15.114:0/3560860407 conn(0x7ffb180d1ea0 msgr2=0x7ffb180d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 -- 172.21.15.114:0/3560860407 shutdown_connections 2024-09-16T07:33:27.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.098+0000 7ffb1e200640 1 -- 172.21.15.114:0/3560860407 wait complete. 2024-09-16T07:33:27.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 Processor -- start 2024-09-16T07:33:27.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 -- start start 2024-09-16T07:33:27.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb180cecf0 0x7ffb180b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb1815bd50 0x7ffb181f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1815c130 0x7ffb180af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18169570 con 0x7ffb1815c130 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181693f0 con 0x7ffb1815bd50 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffb181696f0 con 0x7ffb180cecf0 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1815c130 0x7ffb180af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1815c130 0x7ffb180af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34810/0 (socket says 172.21.15.114:34810) 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 -- 172.21.15.114:0/215501844 learned_addr learned my addr 172.21.15.114:0/215501844 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17400640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb180cecf0 0x7ffb180b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 -- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb180cecf0 msgr2=0x7ffb180b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb0ea00640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb1815bd50 0x7ffb181f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb180cecf0 0x7ffb180b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 -- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb1815bd50 msgr2=0x7ffb181f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb1815bd50 0x7ffb181f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 -- 172.21.15.114:0/215501844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb18155e50 con 0x7ffb1815c130 2024-09-16T07:33:27.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17400640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb180cecf0 0x7ffb180b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:27.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb0ea00640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb1815bd50 0x7ffb181f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:27.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb17e00640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1815c130 0x7ffb180af430 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000b490 tx=0x7ffb1000b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:27.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb0fe00640 1 -- 172.21.15.114:0/215501844 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10015020 con 0x7ffb1815c130 2024-09-16T07:33:27.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb0fe00640 1 -- 172.21.15.114:0/215501844 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb10011920 con 0x7ffb1815c130 2024-09-16T07:33:27.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb0fe00640 1 -- 172.21.15.114:0/215501844 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10011d70 con 0x7ffb1815c130 2024-09-16T07:33:27.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb18156130 con 0x7ffb1815c130 2024-09-16T07:33:27.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181566f0 con 0x7ffb1815c130 2024-09-16T07:33:27.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.102+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb180af210 con 0x7ffb1815c130 2024-09-16T07:33:27.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.106+0000 7ffb0fe00640 1 -- 172.21.15.114:0/215501844 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7ffb10018020 con 0x7ffb1815c130 2024-09-16T07:33:27.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.106+0000 7ffb0fe00640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffaf4072fe0 0x7ffaf40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.106+0000 7ffb0fe00640 1 -- 172.21.15.114:0/215501844 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7ffb10093fc0 con 0x7ffb1815c130 2024-09-16T07:33:27.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.106+0000 7ffb17400640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffaf4072fe0 0x7ffaf40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.106+0000 7ffb17400640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffaf4072fe0 0x7ffaf40754a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb080012f0 tx=0x7ffb08009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:27.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.110+0000 7ffb0fe00640 1 -- 172.21.15.114:0/215501844 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ffb1001f020 con 0x7ffb1815c130 2024-09-16T07:33:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.306+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol55200", "target": ["mon-mgr", ""]}) -- 0x7ffb180d2680 con 0x7ffaf4072fe0 2024-09-16T07:33:27.308 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:27.310+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:27.309 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:27.310+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:27.309 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:27.310+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:27.309 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:27.310+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:27.309 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:27.310+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:27.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.458+0000 7ffb0fe00640 1 -- 172.21.15.114:0/215501844 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7ffb180d2680 con 0x7ffaf4072fe0 2024-09-16T07:33:27.457 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac 2024-09-16T07:33:27.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffaf4072fe0 msgr2=0x7ffaf40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffaf4072fe0 0x7ffaf40754a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb080012f0 tx=0x7ffb08009040 comp rx=0 tx=0).stop 2024-09-16T07:33:27.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1815c130 msgr2=0x7ffb180af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1815c130 0x7ffb180af430 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000b490 tx=0x7ffb1000b950 comp rx=0 tx=0).stop 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 shutdown_connections 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb1815c130 0x7ffb180af430 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb1815bd50 0x7ffb181f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffaf4072fe0 0x7ffaf40754a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 --2- 172.21.15.114:0/215501844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb180cecf0 0x7ffb180b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 >> 172.21.15.114:0/215501844 conn(0x7ffb180d1ea0 msgr2=0x7ffb180b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 shutdown_connections 2024-09-16T07:33:27.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.462+0000 7ffb1e200640 1 -- 172.21.15.114:0/215501844 wait complete. 2024-09-16T07:33:27.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 -- 172.21.15.114:0/1677217532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3481603f0 msgr2=0x7fc3480b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 --2- 172.21.15.114:0/1677217532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3481603f0 0x7fc3480b2390 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc3480b20a0 tx=0x7fc33801c890 comp rx=0 tx=0).stop 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 -- 172.21.15.114:0/1677217532 shutdown_connections 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 --2- 172.21.15.114:0/1677217532 >> v2:172.21.15.149:3300/0 conn(0x7fc3480ce980 0x7fc3480cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 --2- 172.21.15.114:0/1677217532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3481603f0 0x7fc3480b2390 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 -- 172.21.15.114:0/1677217532 >> 172.21.15.114:0/1677217532 conn(0x7fc3480d1df0 msgr2=0x7fc3480d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 -- 172.21.15.114:0/1677217532 shutdown_connections 2024-09-16T07:33:27.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.622+0000 7fc34f200640 1 -- 172.21.15.114:0/1677217532 wait complete. 2024-09-16T07:33:27.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 Processor -- start 2024-09-16T07:33:27.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 -- start start 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3480b28d0 0x7fc3480aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3480ce980 0x7fc3480b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3481603f0 0x7fc3481653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3481694f0 con 0x7fc3480ce980 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480b34a0 con 0x7fc3481603f0 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc348169670 con 0x7fc3480b28d0 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3480ce980 0x7fc3480b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc347e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3480b28d0 0x7fc3480aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3480ce980 0x7fc3480b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34850/0 (socket says 172.21.15.114:34850) 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 -- 172.21.15.114:0/3304286338 learned_addr learned my addr 172.21.15.114:0/3304286338 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:27.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34d200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3481603f0 0x7fc3481653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 -- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3480b28d0 msgr2=0x7fc3480aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3480b28d0 0x7fc3480aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 -- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3481603f0 msgr2=0x7fc3481653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3481603f0 0x7fc3481653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 -- 172.21.15.114:0/3304286338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3480b0f70 con 0x7fc3480ce980 2024-09-16T07:33:27.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34d200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3481603f0 0x7fc3481653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc33f400640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3480ce980 0x7fc3480b0a30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc33000c4e0 tx=0x7fc33000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc344c00640 1 -- 172.21.15.114:0/3304286338 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300052d0 con 0x7fc3480ce980 2024-09-16T07:33:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc344c00640 1 -- 172.21.15.114:0/3304286338 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc330005470 con 0x7fc3480ce980 2024-09-16T07:33:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34806e1a0 con 0x7fc3480ce980 2024-09-16T07:33:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc344c00640 1 -- 172.21.15.114:0/3304286338 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330012890 con 0x7fc3480ce980 2024-09-16T07:33:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.626+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34806e760 con 0x7fc3480ce980 2024-09-16T07:33:27.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.630+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3480cf9c0 con 0x7fc3480ce980 2024-09-16T07:33:27.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.630+0000 7fc344c00640 1 -- 172.21.15.114:0/3304286338 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 17) ==== 97182+0+0 (secure 0 0 0) 0x7fc330003600 con 0x7fc3480ce980 2024-09-16T07:33:27.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.630+0000 7fc344c00640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc324072fe0 0x7fc3240754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:27.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.630+0000 7fc344c00640 1 -- 172.21.15.114:0/3304286338 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fc330093bd0 con 0x7fc3480ce980 2024-09-16T07:33:27.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.630+0000 7fc347e00640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc324072fe0 0x7fc3240754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:27.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.630+0000 7fc347e00640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc324072fe0 0x7fc3240754a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3380af000 tx=0x7fc33801b0d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:27.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.634+0000 7fc344c00640 1 -- 172.21.15.114:0/3304286338 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc33005ebb0 con 0x7fc3480ce980 2024-09-16T07:33:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.826+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7fc3480b1760 con 0x7fc324072fe0 2024-09-16T07:33:27.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.830+0000 7fc344c00640 1 -- 172.21.15.114:0/3304286338 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7fc3480b1760 con 0x7fc324072fe0 2024-09-16T07:33:27.829 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:33:27.830 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:27.830 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "subvol55200" 2024-09-16T07:33:27.830 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:27.830 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc324072fe0 msgr2=0x7fc3240754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc324072fe0 0x7fc3240754a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3380af000 tx=0x7fc33801b0d0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3480ce980 msgr2=0x7fc3480b0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3480ce980 0x7fc3480b0a30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc33000c4e0 tx=0x7fc33000c9a0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 shutdown_connections 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3481603f0 0x7fc3481653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3480ce980 0x7fc3480b0a30 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc324072fe0 0x7fc3240754a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 --2- 172.21.15.114:0/3304286338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3480b28d0 0x7fc3480aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 >> 172.21.15.114:0/3304286338 conn(0x7fc3480d1df0 msgr2=0x7fc3480722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 shutdown_connections 2024-09-16T07:33:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:27.834+0000 7fc34f200640 1 -- 172.21.15.114:0/3304286338 wait complete. 2024-09-16T07:33:27.850 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol55200 2024-09-16T07:33:28.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- 172.21.15.114:0/263761266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26c00cfe90 msgr2=0x7f26c00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 --2- 172.21.15.114:0/263761266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26c00cfe90 0x7f26c00d0270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009bc0 tx=0x7f26b001f3b0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- 172.21.15.114:0/263761266 shutdown_connections 2024-09-16T07:33:28.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 --2- 172.21.15.114:0/263761266 >> v2:172.21.15.149:3300/0 conn(0x7f26c00d07b0 0x7f26c015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 --2- 172.21.15.114:0/263761266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26c00cfe90 0x7f26c00d0270 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- 172.21.15.114:0/263761266 >> 172.21.15.114:0/263761266 conn(0x7f26c00d1dc0 msgr2=0x7f26c00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- 172.21.15.114:0/263761266 shutdown_connections 2024-09-16T07:33:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- 172.21.15.114:0/263761266 wait complete. 2024-09-16T07:33:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 Processor -- start 2024-09-16T07:33:28.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- start start 2024-09-16T07:33:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c00b2cf0 0x7f26c00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26c00cfe90 0x7f26c00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26c00d07b0 0x7f26c01f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f26c00afa90 con 0x7f26c00b2cf0 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f26c00af910 con 0x7f26c00d07b0 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26c6600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f26c00afc10 con 0x7f26c00cfe90 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c00b2cf0 0x7f26c00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c00b2cf0 0x7f26c00b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34862/0 (socket says 172.21.15.114:34862) 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bf400640 1 -- 172.21.15.114:0/1718041364 learned_addr learned my addr 172.21.15.114:0/1718041364 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bfe00640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26c00d07b0 0x7f26c01f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bf400640 1 -- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26c00cfe90 msgr2=0x7f26c00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bf400640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26c00cfe90 0x7f26c00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bf400640 1 -- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26c00d07b0 msgr2=0x7f26c01f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.002+0000 7f26bf400640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26c00d07b0 0x7f26c01f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26bf400640 1 -- 172.21.15.114:0/1718041364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c00cf590 con 0x7f26c00b2cf0 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26bfe00640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26c00d07b0 0x7f26c01f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26bf400640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c00b2cf0 0x7f26c00b4ea0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f26b001cfe0 tx=0x7f26b0005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26b7e00640 1 -- 172.21.15.114:0/1718041364 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b00b4040 con 0x7f26c00b2cf0 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c01f55f0 con 0x7f26c00b2cf0 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26b7e00640 1 -- 172.21.15.114:0/1718041364 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26b00af8a0 con 0x7f26c00b2cf0 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26b7e00640 1 -- 172.21.15.114:0/1718041364 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b00afc50 con 0x7f26c00b2cf0 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c00cad10 con 0x7f26c00b2cf0 2024-09-16T07:33:28.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c00d0270 con 0x7f26c00b2cf0 2024-09-16T07:33:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26b7e00640 1 -- 172.21.15.114:0/1718041364 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7f26b00c1020 con 0x7f26c00b2cf0 2024-09-16T07:33:28.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26b7e00640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f269c073070 0x7f269c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26b7e00640 1 -- 172.21.15.114:0/1718041364 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f26b0131cf0 con 0x7f26c00b2cf0 2024-09-16T07:33:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.006+0000 7f26b6a00640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f269c073070 0x7f269c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.010+0000 7f26b6a00640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f269c073070 0x7f269c075530 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26a8005d10 tx=0x7f26a8005c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:28.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.014+0000 7f26b7e00640 1 -- 172.21.15.114:0/1718041364 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f26b0136070 con 0x7f26c00b2cf0 2024-09-16T07:33:28.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.202+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol55200", "target": ["mon-mgr", ""]}) -- 0x7f26c00cf760 con 0x7f269c073070 2024-09-16T07:33:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26b7e00640 1 -- 172.21.15.114:0/1718041364 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+706 (secure 0 0 0) 0x7f26c00cf760 con 0x7f269c073070 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "atime": "2024-09-16 07:33:26", 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_pcent": "undefined", 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_quota": "infinite", 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_used": 0, 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "created_at": "2024-09-16 07:33:26", 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "ctime": "2024-09-16 07:33:27", 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "data_pool": "cephfs_data", 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "earmark": "", 2024-09-16T07:33:28.229 INFO:teuthology.orchestra.run.smithi114.stdout: "features": [ 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot-clone", 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot-autoprotect" 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "flavor": 1, 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "gid": 0, 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": 16877, 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "mon_addrs": [ 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.114:6789", 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.149:6789", 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.149:6790" 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "mtime": "2024-09-16 07:33:26", 2024-09-16T07:33:28.230 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac", 2024-09-16T07:33:28.231 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_namespace": "", 2024-09-16T07:33:28.231 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "complete", 2024-09-16T07:33:28.231 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "subvolume", 2024-09-16T07:33:28.231 INFO:teuthology.orchestra.run.smithi114.stdout: "uid": 0 2024-09-16T07:33:28.231 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f269c073070 msgr2=0x7f269c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f269c073070 0x7f269c075530 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26a8005d10 tx=0x7f26a8005c60 comp rx=0 tx=0).stop 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c00b2cf0 msgr2=0x7f26c00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c00b2cf0 0x7f26c00b4ea0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f26b001cfe0 tx=0x7f26b0005a80 comp rx=0 tx=0).stop 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 shutdown_connections 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26c00d07b0 0x7f26c01f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f269c073070 0x7f269c075530 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26c00cfe90 0x7f26c00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 --2- 172.21.15.114:0/1718041364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26c00b2cf0 0x7f26c00b4ea0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 >> 172.21.15.114:0/1718041364 conn(0x7f26c00d1dc0 msgr2=0x7f26c015fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 shutdown_connections 2024-09-16T07:33:28.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.230+0000 7f26c6600640 1 -- 172.21.15.114:0/1718041364 wait complete. 2024-09-16T07:33:28.250 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvol55200 10485760 2024-09-16T07:33:28.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.398+0000 7fcdf5600640 1 -- 172.21.15.114:0/2323435914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdd4003a60 msgr2=0x7fcdd4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.398+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2323435914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdd4003a60 0x7fcdd4003e80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fcde000c2e0 tx=0x7fcde001f6a0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.398+0000 7fcdf5600640 1 -- 172.21.15.114:0/2323435914 shutdown_connections 2024-09-16T07:33:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.398+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2323435914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdd4003a60 0x7fcdd4003e80 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.398+0000 7fcdf5600640 1 -- 172.21.15.114:0/2323435914 >> 172.21.15.114:0/2323435914 conn(0x7fcdf00d1da0 msgr2=0x7fcdf00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.398+0000 7fcdf5600640 1 -- 172.21.15.114:0/2323435914 shutdown_connections 2024-09-16T07:33:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.398+0000 7fcdf5600640 1 -- 172.21.15.114:0/2323435914 wait complete. 2024-09-16T07:33:28.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 Processor -- start 2024-09-16T07:33:28.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 -- start start 2024-09-16T07:33:28.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd4003a60 0x7fcdf01f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdf0156830 0x7fcdf00c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf0155cc0 0x7fcdf00c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf00ceae0 con 0x7fcdf0155cc0 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf00ce960 con 0x7fcdf0156830 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf00cec60 con 0x7fcdd4003a60 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf0155cc0 0x7fcdf00c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf0155cc0 0x7fcdf00c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34876/0 (socket says 172.21.15.114:34876) 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 -- 172.21.15.114:0/2449127606 learned_addr learned my addr 172.21.15.114:0/2449127606 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdeea00640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd4003a60 0x7fcdf01f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcde6000640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdf0156830 0x7fcdf00c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 -- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd4003a60 msgr2=0x7fcdf01f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd4003a60 0x7fcdf01f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 -- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdf0156830 msgr2=0x7fcdf00c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdf0156830 0x7fcdf00c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 -- 172.21.15.114:0/2449127606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf01f5a60 con 0x7fcdf0155cc0 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcde6000640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdf0156830 0x7fcdf00c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdef400640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf0155cc0 0x7fcdf00c7af0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0074e00 tx=0x7fcde800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcde7400640 1 -- 172.21.15.114:0/2449127606 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8004b30 con 0x7fcdf0155cc0 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcde7400640 1 -- 172.21.15.114:0/2449127606 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcde8004cd0 con 0x7fcdf0155cc0 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcde7400640 1 -- 172.21.15.114:0/2449127606 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8003be0 con 0x7fcdf0155cc0 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf00c96c0 con 0x7fcdf0155cc0 2024-09-16T07:33:28.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.402+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf01f4d20 con 0x7fcdf0155cc0 2024-09-16T07:33:28.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.406+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf00cf1c0 con 0x7fcdf0155cc0 2024-09-16T07:33:28.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.406+0000 7fcde7400640 1 -- 172.21.15.114:0/2449127606 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7fcde8004030 con 0x7fcdf0155cc0 2024-09-16T07:33:28.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.406+0000 7fcde7400640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcdcc0730a0 0x7fcdcc075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.406+0000 7fcde7400640 1 -- 172.21.15.114:0/2449127606 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fcde8095150 con 0x7fcdf0155cc0 2024-09-16T07:33:28.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.406+0000 7fcdeea00640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcdcc0730a0 0x7fcdcc075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.406+0000 7fcdeea00640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcdcc0730a0 0x7fcdcc075560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcde00b0000 tx=0x7fcde001c4e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:28.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.410+0000 7fcde7400640 1 -- 172.21.15.114:0/2449127606 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcde801f060 con 0x7fcdf0155cc0 2024-09-16T07:33:28.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.610+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "cephfs", "sub_name": "subvol55200", "new_size": "10485760", "target": ["mon-mgr", ""]}) -- 0x7fcdf0070350 con 0x7fcdcc0730a0 2024-09-16T07:33:28.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcde7400640 1 -- 172.21.15.114:0/2449127606 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+128 (secure 0 0 0) 0x7fcdf0070350 con 0x7fcdcc0730a0 2024-09-16T07:33:28.636 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:33:28.636 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:28.636 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_used": 0 2024-09-16T07:33:28.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:28.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:28.637 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_quota": 10485760 2024-09-16T07:33:28.637 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:28.637 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:28.637 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_pcent": "0.00" 2024-09-16T07:33:28.637 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:28.638 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:33:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcdcc0730a0 msgr2=0x7fcdcc075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcdcc0730a0 0x7fcdcc075560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcde00b0000 tx=0x7fcde001c4e0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf0155cc0 msgr2=0x7fcdf00c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf0155cc0 0x7fcdf00c7af0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0074e00 tx=0x7fcde800f3c0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 shutdown_connections 2024-09-16T07:33:28.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcdf0155cc0 0x7fcdf00c7af0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdf0156830 0x7fcdf00c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcdcc0730a0 0x7fcdcc075560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 --2- 172.21.15.114:0/2449127606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd4003a60 0x7fcdf01f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 >> 172.21.15.114:0/2449127606 conn(0x7fcdf00d1da0 msgr2=0x7fcdf0071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:28.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 shutdown_connections 2024-09-16T07:33:28.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.638+0000 7fcdf5600640 1 -- 172.21.15.114:0/2449127606 wait complete. 2024-09-16T07:33:28.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol55200 2024-09-16T07:33:28.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.802+0000 7f647fc00640 1 -- 172.21.15.114:0/860262568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815bd50 msgr2=0x7f64780ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.802+0000 7f647fc00640 1 --2- 172.21.15.114:0/860262568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815bd50 0x7f64780ce5e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6468009900 tx=0x7f646801c7c0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- 172.21.15.114:0/860262568 shutdown_connections 2024-09-16T07:33:28.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 --2- 172.21.15.114:0/860262568 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f647815c130 0x7f64780ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 --2- 172.21.15.114:0/860262568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815bd50 0x7f64780ce5e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- 172.21.15.114:0/860262568 >> 172.21.15.114:0/860262568 conn(0x7f64780d1ea0 msgr2=0x7f64780d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:28.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- 172.21.15.114:0/860262568 shutdown_connections 2024-09-16T07:33:28.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- 172.21.15.114:0/860262568 wait complete. 2024-09-16T07:33:28.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 Processor -- start 2024-09-16T07:33:28.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- start start 2024-09-16T07:33:28.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64780cf4e0 0x7f6478154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f647815bd50 0x7f647809f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815c130 0x7f6478070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6478168e50 con 0x7f647815c130 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6478168cd0 con 0x7f647815bd50 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647fc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6478168fd0 con 0x7f64780cf4e0 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815c130 0x7f6478070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815c130 0x7f6478070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34892/0 (socket says 172.21.15.114:34892) 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 -- 172.21.15.114:0/738126745 learned_addr learned my addr 172.21.15.114:0/738126745 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f646fe00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f647815bd50 0x7f647809f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647d200640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64780cf4e0 0x7f6478154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 -- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64780cf4e0 msgr2=0x7f6478154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64780cf4e0 0x7f6478154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 -- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f647815bd50 msgr2=0x7f647809f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f647815bd50 0x7f647809f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 -- 172.21.15.114:0/738126745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64781fb2b0 con 0x7f647815c130 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647d200640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64780cf4e0 0x7f6478154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.806+0000 7f647dc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815c130 0x7f6478070fa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f647000c7c0 tx=0x7f647000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f6475600640 1 -- 172.21.15.114:0/738126745 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470003b80 con 0x7f647815c130 2024-09-16T07:33:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f6475600640 1 -- 172.21.15.114:0/738126745 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6470003d20 con 0x7f647815c130 2024-09-16T07:33:28.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f6475600640 1 -- 172.21.15.114:0/738126745 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647000aab0 con 0x7f647815c130 2024-09-16T07:33:28.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64780c9bf0 con 0x7f647815c130 2024-09-16T07:33:28.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64780c9ed0 con 0x7f647815c130 2024-09-16T07:33:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64780c5dd0 con 0x7f647815c130 2024-09-16T07:33:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f6475600640 1 -- 172.21.15.114:0/738126745 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7f647000ac50 con 0x7f647815c130 2024-09-16T07:33:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f6475600640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6454073070 0x7f6454075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f6475600640 1 -- 172.21.15.114:0/738126745 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f6470093fc0 con 0x7f647815c130 2024-09-16T07:33:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.810+0000 7f647d200640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6454073070 0x7f6454075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:28.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.814+0000 7f647d200640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6454073070 0x7f6454075530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64680af000 tx=0x7f646801b000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:28.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:28.814+0000 7f6475600640 1 -- 172.21.15.114:0/738126745 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f647005eed0 con 0x7f647815c130 2024-09-16T07:33:29.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.010+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol55200", "target": ["mon-mgr", ""]}) -- 0x7f6478070d40 con 0x7f6454073070 2024-09-16T07:33:29.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.034+0000 7f6475600640 1 -- 172.21.15.114:0/738126745 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+699 (secure 0 0 0) 0x7f6478070d40 con 0x7f6454073070 2024-09-16T07:33:29.035 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:29.035 INFO:teuthology.orchestra.run.smithi114.stdout: "atime": "2024-09-16 07:33:26", 2024-09-16T07:33:29.035 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_pcent": "0.00", 2024-09-16T07:33:29.036 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_quota": 10485760, 2024-09-16T07:33:29.036 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_used": 0, 2024-09-16T07:33:29.036 INFO:teuthology.orchestra.run.smithi114.stdout: "created_at": "2024-09-16 07:33:26", 2024-09-16T07:33:29.036 INFO:teuthology.orchestra.run.smithi114.stdout: "ctime": "2024-09-16 07:33:28", 2024-09-16T07:33:29.037 INFO:teuthology.orchestra.run.smithi114.stdout: "data_pool": "cephfs_data", 2024-09-16T07:33:29.037 INFO:teuthology.orchestra.run.smithi114.stdout: "earmark": "", 2024-09-16T07:33:29.037 INFO:teuthology.orchestra.run.smithi114.stdout: "features": [ 2024-09-16T07:33:29.037 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot-clone", 2024-09-16T07:33:29.037 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot-autoprotect" 2024-09-16T07:33:29.038 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:33:29.038 INFO:teuthology.orchestra.run.smithi114.stdout: "flavor": 1, 2024-09-16T07:33:29.038 INFO:teuthology.orchestra.run.smithi114.stdout: "gid": 0, 2024-09-16T07:33:29.038 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": 16877, 2024-09-16T07:33:29.038 INFO:teuthology.orchestra.run.smithi114.stdout: "mon_addrs": [ 2024-09-16T07:33:29.038 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.114:6789", 2024-09-16T07:33:29.038 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.149:6789", 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.149:6790" 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: "mtime": "2024-09-16 07:33:26", 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac", 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_namespace": "", 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "complete", 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "subvolume", 2024-09-16T07:33:29.039 INFO:teuthology.orchestra.run.smithi114.stdout: "uid": 0 2024-09-16T07:33:29.040 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:29.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6454073070 msgr2=0x7f6454075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6454073070 0x7f6454075530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f64680af000 tx=0x7f646801b000 comp rx=0 tx=0).stop 2024-09-16T07:33:29.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815c130 msgr2=0x7f6478070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815c130 0x7f6478070fa0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f647000c7c0 tx=0x7f647000cc80 comp rx=0 tx=0).stop 2024-09-16T07:33:29.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 shutdown_connections 2024-09-16T07:33:29.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f647815c130 0x7f6478070fa0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f647815bd50 0x7f647809f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6454073070 0x7f6454075530 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 --2- 172.21.15.114:0/738126745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f64780cf4e0 0x7f6478154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 >> 172.21.15.114:0/738126745 conn(0x7f64780d1ea0 msgr2=0x7f64780d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:29.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 shutdown_connections 2024-09-16T07:33:29.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.038+0000 7f647fc00640 1 -- 172.21.15.114:0/738126745 wait complete. 2024-09-16T07:33:29.055 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol55200 --mode 777 --uid 1000 --gid 1000 2024-09-16T07:33:29.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 -- 172.21.15.114:0/2095174090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b5380 msgr2=0x7fec840b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 --2- 172.21.15.114:0/2095174090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b5380 0x7fec840b34f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec70009840 tx=0x7fec7001c820 comp rx=0 tx=0).stop 2024-09-16T07:33:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 -- 172.21.15.114:0/2095174090 shutdown_connections 2024-09-16T07:33:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 --2- 172.21.15.114:0/2095174090 >> v2:172.21.15.149:3300/0 conn(0x7fec840b3a30 0x7fec840b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 --2- 172.21.15.114:0/2095174090 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b5380 0x7fec840b34f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 -- 172.21.15.114:0/2095174090 >> 172.21.15.114:0/2095174090 conn(0x7fec840d3e00 msgr2=0x7fec840d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 -- 172.21.15.114:0/2095174090 shutdown_connections 2024-09-16T07:33:29.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 -- 172.21.15.114:0/2095174090 wait complete. 2024-09-16T07:33:29.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.206+0000 7fec89e00640 1 Processor -- start 2024-09-16T07:33:29.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 -- start start 2024-09-16T07:33:29.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b3a30 0x7fec840b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840b5380 0x7fec841535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec840d1f60 0x7fec840d0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fec840b2750 con 0x7fec840d1f60 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec840b25d0 con 0x7fec840b5380 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec840b28d0 con 0x7fec840b3a30 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec840d1f60 0x7fec840d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec840d1f60 0x7fec840d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34908/0 (socket says 172.21.15.114:34908) 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 -- 172.21.15.114:0/37531586 learned_addr learned my addr 172.21.15.114:0/37531586 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec88a00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b3a30 0x7fec840b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec83e00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840b5380 0x7fec841535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 -- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b3a30 msgr2=0x7fec840b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b3a30 0x7fec840b6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 -- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840b5380 msgr2=0x7fec841535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840b5380 0x7fec841535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 -- 172.21.15.114:0/37531586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec840b7170 con 0x7fec840d1f60 2024-09-16T07:33:29.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89400640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec840d1f60 0x7fec840d0550 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00eae0 tx=0x7fec7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:29.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec80c00640 1 -- 172.21.15.114:0/37531586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c004b30 con 0x7fec840d1f60 2024-09-16T07:33:29.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec80c00640 1 -- 172.21.15.114:0/37531586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec7c004cd0 con 0x7fec840d1f60 2024-09-16T07:33:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec80c00640 1 -- 172.21.15.114:0/37531586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c005280 con 0x7fec840d1f60 2024-09-16T07:33:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec840b7410 con 0x7fec840d1f60 2024-09-16T07:33:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec840b79d0 con 0x7fec840d1f60 2024-09-16T07:33:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.210+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec840b3e70 con 0x7fec840d1f60 2024-09-16T07:33:29.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.214+0000 7fec80c00640 1 -- 172.21.15.114:0/37531586 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7fec7c005420 con 0x7fec840d1f60 2024-09-16T07:33:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.214+0000 7fec80c00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec64073070 0x7fec64075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.214+0000 7fec80c00640 1 -- 172.21.15.114:0/37531586 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fec7c094f00 con 0x7fec840d1f60 2024-09-16T07:33:29.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.214+0000 7fec88a00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec64073070 0x7fec64075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.214+0000 7fec88a00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec64073070 0x7fec64075530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec78001640 tx=0x7fec78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:29.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.218+0000 7fec80c00640 1 -- 172.21.15.114:0/37531586 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fec7c05fd80 con 0x7fec840d1f60 2024-09-16T07:33:29.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.406+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol55200", "mode": "777", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}) -- 0x7fec840b9c80 con 0x7fec64073070 2024-09-16T07:33:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec80c00640 1 -- 172.21.15.114:0/37531586 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fec840b9c80 con 0x7fec64073070 2024-09-16T07:33:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec64073070 msgr2=0x7fec64075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec64073070 0x7fec64075530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec78001640 tx=0x7fec78009040 comp rx=0 tx=0).stop 2024-09-16T07:33:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec840d1f60 msgr2=0x7fec840d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec840d1f60 0x7fec840d0550 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00eae0 tx=0x7fec7c00c2d0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 shutdown_connections 2024-09-16T07:33:29.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec840d1f60 0x7fec840d0550 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec840b5380 0x7fec841535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec64073070 0x7fec64075530 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 --2- 172.21.15.114:0/37531586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec840b3a30 0x7fec840b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.438+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 >> 172.21.15.114:0/37531586 conn(0x7fec840d3e00 msgr2=0x7fec840d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.442+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 shutdown_connections 2024-09-16T07:33:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.442+0000 7fec89e00640 1 -- 172.21.15.114:0/37531586 wait complete. 2024-09-16T07:33:29.458 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol55200 2024-09-16T07:33:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 -- 172.21.15.114:0/1320725254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c0b6350 msgr2=0x7fd27c06fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 --2- 172.21.15.114:0/1320725254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c0b6350 0x7fd27c06fff0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fd27c071910 tx=0x7fd26c01cd50 comp rx=0 tx=0).stop 2024-09-16T07:33:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 -- 172.21.15.114:0/1320725254 shutdown_connections 2024-09-16T07:33:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 --2- 172.21.15.114:0/1320725254 >> v2:172.21.15.149:3300/0 conn(0x7fd27c06cc20 0x7fd27c06d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 --2- 172.21.15.114:0/1320725254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c0b6350 0x7fd27c06fff0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 -- 172.21.15.114:0/1320725254 >> 172.21.15.114:0/1320725254 conn(0x7fd27c0d0cd0 msgr2=0x7fd27c0d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 -- 172.21.15.114:0/1320725254 shutdown_connections 2024-09-16T07:33:29.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.602+0000 7fd280c00640 1 -- 172.21.15.114:0/1320725254 wait complete. 2024-09-16T07:33:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 Processor -- start 2024-09-16T07:33:29.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 -- start start 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c06cc20 0x7fd27c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd27c0b6350 0x7fd27c1fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c15c2d0 0x7fd27c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c168fb0 con 0x7fd27c15c2d0 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c168e30 con 0x7fd27c06cc20 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd27c169130 con 0x7fd27c0b6350 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c15c2d0 0x7fd27c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c15c2d0 0x7fd27c0b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34928/0 (socket says 172.21.15.114:34928) 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 -- 172.21.15.114:0/3368492291 learned_addr learned my addr 172.21.15.114:0/3368492291 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd279e00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c06cc20 0x7fd27c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd271400640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd27c0b6350 0x7fd27c1fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 -- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd27c0b6350 msgr2=0x7fd27c1fb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd27c0b6350 0x7fd27c1fb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 -- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c06cc20 msgr2=0x7fd27c14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c06cc20 0x7fd27c14fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 -- 172.21.15.114:0/3368492291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27c1502d0 con 0x7fd27c15c2d0 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd27a800640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c15c2d0 0x7fd27c0b4f30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd27400e8c0 tx=0x7fd27400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd272a00640 1 -- 172.21.15.114:0/3368492291 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27400ccc0 con 0x7fd27c15c2d0 2024-09-16T07:33:29.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd272a00640 1 -- 172.21.15.114:0/3368492291 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd27400ce60 con 0x7fd27c15c2d0 2024-09-16T07:33:29.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27c1fbcd0 con 0x7fd27c15c2d0 2024-09-16T07:33:29.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd272a00640 1 -- 172.21.15.114:0/3368492291 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274005280 con 0x7fd27c15c2d0 2024-09-16T07:33:29.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.606+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27c0cebd0 con 0x7fd27c15c2d0 2024-09-16T07:33:29.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.610+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd27c1fc1f0 con 0x7fd27c15c2d0 2024-09-16T07:33:29.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.610+0000 7fd272a00640 1 -- 172.21.15.114:0/3368492291 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7fd274005420 con 0x7fd27c15c2d0 2024-09-16T07:33:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.610+0000 7fd272a00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd258073070 0x7fd258075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.610+0000 7fd272a00640 1 -- 172.21.15.114:0/3368492291 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fd274094c60 con 0x7fd27c15c2d0 2024-09-16T07:33:29.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.610+0000 7fd279e00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd258073070 0x7fd258075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:29.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.610+0000 7fd279e00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd258073070 0x7fd258075530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0af000 tx=0x7fd26c01b590 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:29.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.614+0000 7fd272a00640 1 -- 172.21.15.114:0/3368492291 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd27405f3f0 con 0x7fd27c15c2d0 2024-09-16T07:33:29.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.806+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol55200", "target": ["mon-mgr", ""]}) -- 0x7fd27c06d090 con 0x7fd258073070 2024-09-16T07:33:29.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.830+0000 7fd272a00640 1 -- 172.21.15.114:0/3368492291 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fd27c06d090 con 0x7fd258073070 2024-09-16T07:33:29.829 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac 2024-09-16T07:33:29.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.830+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd258073070 msgr2=0x7fd258075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.830+0000 7fd280c00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd258073070 0x7fd258075530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0af000 tx=0x7fd26c01b590 comp rx=0 tx=0).stop 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.830+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c15c2d0 msgr2=0x7fd27c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.830+0000 7fd280c00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c15c2d0 0x7fd27c0b4f30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd27400e8c0 tx=0x7fd27400ed80 comp rx=0 tx=0).stop 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 shutdown_connections 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27c15c2d0 0x7fd27c0b4f30 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd258073070 0x7fd258075530 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd27c0b6350 0x7fd27c1fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 --2- 172.21.15.114:0/3368492291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd27c06cc20 0x7fd27c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 >> 172.21.15.114:0/3368492291 conn(0x7fd27c0d0cd0 msgr2=0x7fd27c0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 shutdown_connections 2024-09-16T07:33:29.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:29.834+0000 7fd280c00640 1 -- 172.21.15.114:0/3368492291 wait complete. 2024-09-16T07:33:29.850 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol55200 with 8 files each 1MB size under directory volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac 2024-09-16T07:33:29.850 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:29.850 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:29.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:29.859 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:29.932 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:29.932 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:29.932 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202125 s, 51.9 MB/s 2024-09-16T07:33:29.933 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:29.934 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:29.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:29.987 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:30.064 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:30.064 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:30.065 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216598 s, 48.4 MB/s 2024-09-16T07:33:30.066 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:30.066 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:30.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:30.115 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:30.188 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211351 s, 49.6 MB/s 2024-09-16T07:33:30.189 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:30.189 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:30.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:30.239 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:30.312 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:30.312 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:30.312 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210071 s, 49.9 MB/s 2024-09-16T07:33:30.313 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:30.313 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:30.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:30.363 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:30.438 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:30.438 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:30.438 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191385 s, 54.8 MB/s 2024-09-16T07:33:30.439 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:30.440 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:30.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:30.491 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:30.563 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:30.563 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:30.563 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196776 s, 53.3 MB/s 2024-09-16T07:33:30.564 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:30.564 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:30.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:30.615 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:30.684 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:30.684 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:30.685 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177357 s, 59.1 MB/s 2024-09-16T07:33:30.685 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:30.686 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:30.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:30.739 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-16T07:33:30.811 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T07:33:30.812 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T07:33:30.812 INFO:teuthology.orchestra.run.smithi114.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201245 s, 52.1 MB/s 2024-09-16T07:33:30.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol55200 subvol_snap60510 2024-09-16T07:33:31.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3888828324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80734f0 msgr2=0x7fb8d815a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3888828324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80734f0 0x7fb8d815a9d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009bc0 tx=0x7fb8cc01cba0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3888828324 shutdown_connections 2024-09-16T07:33:31.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3888828324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8d80cf440 0x7fb8d80ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3888828324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80734f0 0x7fb8d815a9d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3888828324 >> 172.21.15.114:0/3888828324 conn(0x7fb8d80cfbc0 msgr2=0x7fb8d80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3888828324 shutdown_connections 2024-09-16T07:33:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.002+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3888828324 wait complete. 2024-09-16T07:33:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 Processor -- start 2024-09-16T07:33:31.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 -- start start 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8d80734f0 0x7fb8d80ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80ce890 0x7fb8d814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8d80cf440 0x7fb8d814f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8167360 con 0x7fb8d80ce890 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d815edb0 con 0x7fb8d80cf440 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d81674e0 con 0x7fb8d80734f0 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80ce890 0x7fb8d814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80ce890 0x7fb8d814d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34950/0 (socket says 172.21.15.114:34950) 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 -- 172.21.15.114:0/3018358122 learned_addr learned my addr 172.21.15.114:0/3018358122 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dd400640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8d80734f0 0x7fb8d80ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dde00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8d80cf440 0x7fb8d814f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 -- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8d80734f0 msgr2=0x7fb8d80ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8d80734f0 0x7fb8d80ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 -- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8d80cf440 msgr2=0x7fb8d814f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8d80cf440 0x7fb8d814f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 -- 172.21.15.114:0/3018358122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d814daf0 con 0x7fb8d80ce890 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dd400640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8d80734f0 0x7fb8d80ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dca00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80ce890 0x7fb8d814d5b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400ea90 tx=0x7fb8c400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8d5600640 1 -- 172.21.15.114:0/3018358122 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c401b070 con 0x7fb8d80ce890 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8d5600640 1 -- 172.21.15.114:0/3018358122 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8c400ccb0 con 0x7fb8d80ce890 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8d5600640 1 -- 172.21.15.114:0/3018358122 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4016670 con 0x7fb8d80ce890 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d80aebf0 con 0x7fb8d80ce890 2024-09-16T07:33:31.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d81fba70 con 0x7fb8d80ce890 2024-09-16T07:33:31.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.006+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d8069410 con 0x7fb8d80ce890 2024-09-16T07:33:31.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.010+0000 7fb8d5600640 1 -- 172.21.15.114:0/3018358122 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7fb8c401e070 con 0x7fb8d80ce890 2024-09-16T07:33:31.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.010+0000 7fb8d5600640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb8b8073070 0x7fb8b8075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.010+0000 7fb8d5600640 1 -- 172.21.15.114:0/3018358122 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fb8c4094330 con 0x7fb8d80ce890 2024-09-16T07:33:31.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.010+0000 7fb8dd400640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb8b8073070 0x7fb8b8075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.010+0000 7fb8dd400640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb8b8073070 0x7fb8b8075530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0af000 tx=0x7fb8cc01b3e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:31.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.014+0000 7fb8d5600640 1 -- 172.21.15.114:0/3018358122 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb8c405ebf0 con 0x7fb8d80ce890 2024-09-16T07:33:31.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.210+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol55200", "snap_name": "subvol_snap60510", "target": ["mon-mgr", ""]}) -- 0x7fb8d80ce670 con 0x7fb8b8073070 2024-09-16T07:33:31.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8d5600640 1 -- 172.21.15.114:0/3018358122 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb8d80ce670 con 0x7fb8b8073070 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb8b8073070 msgr2=0x7fb8b8075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb8b8073070 0x7fb8b8075530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0af000 tx=0x7fb8cc01b3e0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80ce890 msgr2=0x7fb8d814d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80ce890 0x7fb8d814d5b0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400ea90 tx=0x7fb8c400ef50 comp rx=0 tx=0).stop 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 shutdown_connections 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8d80cf440 0x7fb8d814f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8d80ce890 0x7fb8d814d5b0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb8b8073070 0x7fb8b8075530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 --2- 172.21.15.114:0/3018358122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb8d80734f0 0x7fb8d80ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 >> 172.21.15.114:0/3018358122 conn(0x7fb8d80cfbc0 msgr2=0x7fb8d815bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 shutdown_connections 2024-09-16T07:33:31.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.238+0000 7fb8dfe00640 1 -- 172.21.15.114:0/3018358122 wait complete. 2024-09-16T07:33:31.257 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol55200 subvol_snap60510 subvol_clone13670 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 -- 172.21.15.114:0/2769239379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc0b3190 msgr2=0x7f70bc0b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 --2- 172.21.15.114:0/2769239379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc0b3190 0x7f70bc0b1450 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009c80 tx=0x7f70b401cc50 comp rx=0 tx=0).stop 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 -- 172.21.15.114:0/2769239379 shutdown_connections 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 --2- 172.21.15.114:0/2769239379 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc0b3190 0x7f70bc0b1450 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 --2- 172.21.15.114:0/2769239379 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70bc1613c0 0x7f70bc161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 -- 172.21.15.114:0/2769239379 >> 172.21.15.114:0/2769239379 conn(0x7f70bc0d1dd0 msgr2=0x7f70bc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 -- 172.21.15.114:0/2769239379 shutdown_connections 2024-09-16T07:33:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.406+0000 7f70c4000640 1 -- 172.21.15.114:0/2769239379 wait complete. 2024-09-16T07:33:31.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 Processor -- start 2024-09-16T07:33:31.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 -- start start 2024-09-16T07:33:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70bc0b3190 0x7f70bc153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc1613c0 0x7f70bc158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70bc1617a0 0x7f70bc158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc16b0b0 con 0x7f70bc1613c0 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc16af30 con 0x7f70bc1617a0 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f70bc16b230 con 0x7f70bc0b3190 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc1613c0 0x7f70bc158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc1613c0 0x7f70bc158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34976/0 (socket says 172.21.15.114:34976) 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 -- 172.21.15.114:0/3913534374 learned_addr learned my addr 172.21.15.114:0/3913534374 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c2000640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70bc1617a0 0x7f70bc158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c1600640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70bc0b3190 0x7f70bc153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 -- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70bc0b3190 msgr2=0x7f70bc153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70bc0b3190 0x7f70bc153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 -- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70bc1617a0 msgr2=0x7f70bc158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70bc1617a0 0x7f70bc158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 -- 172.21.15.114:0/3913534374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc154500 con 0x7f70bc1613c0 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c0c00640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc1613c0 0x7f70bc158340 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c3c0 tx=0x7f70a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70b9600640 1 -- 172.21.15.114:0/3913534374 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8017070 con 0x7f70bc1613c0 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70b9600640 1 -- 172.21.15.114:0/3913534374 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a80053c0 con 0x7f70bc1613c0 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc160530 con 0x7f70bc1613c0 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70b9600640 1 -- 172.21.15.114:0/3913534374 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8003860 con 0x7f70bc1613c0 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc15fa50 con 0x7f70bc1613c0 2024-09-16T07:33:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.410+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc154800 con 0x7f70bc1613c0 2024-09-16T07:33:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.414+0000 7f70b9600640 1 -- 172.21.15.114:0/3913534374 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7f70a801a070 con 0x7f70bc1613c0 2024-09-16T07:33:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.414+0000 7f70b9600640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f709c073070 0x7f709c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.414+0000 7f70b9600640 1 -- 172.21.15.114:0/3913534374 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f70a8093390 con 0x7f70bc1613c0 2024-09-16T07:33:31.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.414+0000 7f70c1600640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f709c073070 0x7f709c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.414+0000 7f70c1600640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f709c073070 0x7f709c075530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009be0 tx=0x7f70b00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:31.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.418+0000 7f70b9600640 1 -- 172.21.15.114:0/3913534374 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f70bc154500 con 0x7f70bc1613c0 2024-09-16T07:33:31.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.618+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol55200", "snap_name": "subvol_snap60510", "target_sub_name": "subvol_clone13670", "target": ["mon-mgr", ""]}) -- 0x7f70bc15b120 con 0x7f709c073070 2024-09-16T07:33:31.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70b9600640 1 -- 172.21.15.114:0/3913534374 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70bc15b120 con 0x7f709c073070 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f709c073070 msgr2=0x7f709c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f709c073070 0x7f709c075530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009be0 tx=0x7f70b00091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc1613c0 msgr2=0x7f70bc158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc1613c0 0x7f70bc158340 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c3c0 tx=0x7f70a800c880 comp rx=0 tx=0).stop 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 shutdown_connections 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70bc1617a0 0x7f70bc158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70bc1613c0 0x7f70bc158340 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f709c073070 0x7f709c075530 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 --2- 172.21.15.114:0/3913534374 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70bc0b3190 0x7f70bc153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 >> 172.21.15.114:0/3913534374 conn(0x7f70bc0d1dd0 msgr2=0x7f70bc15e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:31.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 shutdown_connections 2024-09-16T07:33:31.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.694+0000 7f70c4000640 1 -- 172.21.15.114:0/3913534374 wait complete. 2024-09-16T07:33:31.696 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.698+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.696 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.698+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.696 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.698+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.697 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.698+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.697 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.698+0000 7f4e19c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.714 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.714+0000 7f4e18800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.714 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.714+0000 7f4e18800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.715 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.714+0000 7f4e18800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.715 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.714+0000 7f4e18800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.715 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:31.714+0000 7f4e18800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:31.718 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone13670 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- 172.21.15.114:0/4049938585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac1605d0 msgr2=0x7f26ac0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 --2- 172.21.15.114:0/4049938585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac1605d0 0x7f26ac0d0690 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f26ac073990 tx=0x7f269c01c720 comp rx=0 tx=0).stop 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- 172.21.15.114:0/4049938585 shutdown_connections 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 --2- 172.21.15.114:0/4049938585 >> v2:172.21.15.149:3300/0 conn(0x7f26ac0b1650 0x7f26ac0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 --2- 172.21.15.114:0/4049938585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac1605d0 0x7f26ac0d0690 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- 172.21.15.114:0/4049938585 >> 172.21.15.114:0/4049938585 conn(0x7f26ac0d1dd0 msgr2=0x7f26ac0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- 172.21.15.114:0/4049938585 shutdown_connections 2024-09-16T07:33:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- 172.21.15.114:0/4049938585 wait complete. 2024-09-16T07:33:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 Processor -- start 2024-09-16T07:33:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- start start 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac0aeb00 0x7f26ac1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26ac0b1650 0x7f26ac15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26ac1605d0 0x7f26ac0aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac0b0ee0 con 0x7f26ac0aeb00 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac0b0840 con 0x7f26ac1605d0 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26b1a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f26ac0b1220 con 0x7f26ac0b1650 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26aaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac0aeb00 0x7f26ac1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.906+0000 7f26aaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac0aeb00 0x7f26ac1599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35024/0 (socket says 172.21.15.114:35024) 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aaa00640 1 -- 172.21.15.114:0/690970260 learned_addr learned my addr 172.21.15.114:0/690970260 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aa000640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26ac0b1650 0x7f26ac15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26ab400640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26ac1605d0 0x7f26ac0aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aaa00640 1 -- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26ac0b1650 msgr2=0x7f26ac15caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aaa00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26ac0b1650 0x7f26ac15caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aaa00640 1 -- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26ac1605d0 msgr2=0x7f26ac0aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aaa00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26ac1605d0 0x7f26ac0aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aaa00640 1 -- 172.21.15.114:0/690970260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac15d560 con 0x7f26ac0aeb00 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26aaa00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac0aeb00 0x7f26ac1599b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f269c01a350 tx=0x7f269c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26a2a00640 1 -- 172.21.15.114:0/690970260 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0ad070 con 0x7f26ac0aeb00 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26a2a00640 1 -- 172.21.15.114:0/690970260 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f269c0043e0 con 0x7f26ac0aeb00 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26a2a00640 1 -- 172.21.15.114:0/690970260 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0a9910 con 0x7f26ac0aeb00 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac15d840 con 0x7f26ac0aeb00 2024-09-16T07:33:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac0b5080 con 0x7f26ac0aeb00 2024-09-16T07:33:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ac15da80 con 0x7f26ac0aeb00 2024-09-16T07:33:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.910+0000 7f26a2a00640 1 -- 172.21.15.114:0/690970260 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7f269c0b0070 con 0x7f26ac0aeb00 2024-09-16T07:33:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.914+0000 7f26a2a00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f268c073070 0x7f268c075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:31.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.914+0000 7f26a2a00640 1 -- 172.21.15.114:0/690970260 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f269c12e570 con 0x7f26ac0aeb00 2024-09-16T07:33:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.914+0000 7f26aa000640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f268c073070 0x7f268c075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.914+0000 7f26aa000640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f268c073070 0x7f268c075530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2698009600 tx=0x7f26980091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:31.922+0000 7f26a2a00640 1 -- 172.21.15.114:0/690970260 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f269c0b8070 con 0x7f26ac0aeb00 2024-09-16T07:33:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.142+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone13670", "target": ["mon-mgr", ""]}) -- 0x7f26ac0d1080 con 0x7f268c073070 2024-09-16T07:33:32.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26a2a00640 1 -- 172.21.15.114:0/690970260 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f26ac0d1080 con 0x7f268c073070 2024-09-16T07:33:32.328 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:32.328 INFO:teuthology.orchestra.run.smithi114.stdout: "status": { 2024-09-16T07:33:32.328 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "complete" 2024-09-16T07:33:32.328 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:32.328 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f268c073070 msgr2=0x7f268c075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f268c073070 0x7f268c075530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2698009600 tx=0x7f26980091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac0aeb00 msgr2=0x7f26ac1599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac0aeb00 0x7f26ac1599b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f269c01a350 tx=0x7f269c005750 comp rx=0 tx=0).stop 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 shutdown_connections 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26ac1605d0 0x7f26ac0aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f268c073070 0x7f268c075530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26ac0b1650 0x7f26ac15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 --2- 172.21.15.114:0/690970260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f26ac0aeb00 0x7f26ac1599b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 >> 172.21.15.114:0/690970260 conn(0x7f26ac0d1dd0 msgr2=0x7f26ac071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 shutdown_connections 2024-09-16T07:33:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.330+0000 7f26b1a00640 1 -- 172.21.15.114:0/690970260 wait complete. 2024-09-16T07:33:32.350 DEBUG:tasks.cephfs.test_volumes:current clone state = complete 2024-09-16T07:33:32.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:32.350 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone13670/.meta) 2024-09-16T07:33:32.370 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:33:32.370 INFO:teuthology.orchestra.run.smithi114.stdout:version = 2 2024-09-16T07:33:32.370 INFO:teuthology.orchestra.run.smithi114.stdout:type = clone 2024-09-16T07:33:32.371 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075 2024-09-16T07:33:32.371 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:33:32.371 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:32.373 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol55200 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 -- 172.21.15.114:0/3810117905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10815ade0 msgr2=0x7fe1080cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 --2- 172.21.15.114:0/3810117905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10815ade0 0x7fe1080cebf0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009bc0 tx=0x7fe0f801cba0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 -- 172.21.15.114:0/3810117905 shutdown_connections 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 --2- 172.21.15.114:0/3810117905 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1080b4bd0 0x7fe1080cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 --2- 172.21.15.114:0/3810117905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10815ade0 0x7fe1080cebf0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 -- 172.21.15.114:0/3810117905 >> 172.21.15.114:0/3810117905 conn(0x7fe1080b18f0 msgr2=0x7fe1080b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 -- 172.21.15.114:0/3810117905 shutdown_connections 2024-09-16T07:33:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.558+0000 7fe10f200640 1 -- 172.21.15.114:0/3810117905 wait complete. 2024-09-16T07:33:32.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 Processor -- start 2024-09-16T07:33:32.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 -- start start 2024-09-16T07:33:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10806e810 0x7fe108164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1080b4bd0 0x7fe10814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10815ade0 0x7fe108073960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe108168190 con 0x7fe10806e810 2024-09-16T07:33:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe108168010 con 0x7fe10815ade0 2024-09-16T07:33:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe108168310 con 0x7fe1080b4bd0 2024-09-16T07:33:32.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10806e810 0x7fe108164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10806e810 0x7fe108164730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35034/0 (socket says 172.21.15.114:35034) 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 -- 172.21.15.114:0/3500646365 learned_addr learned my addr 172.21.15.114:0/3500646365 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 -- 172.21.15.114:0/3500646365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1080b4bd0 msgr2=0x7fe10814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1080b4bd0 0x7fe10814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 -- 172.21.15.114:0/3500646365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10815ade0 msgr2=0x7fe108073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10815ade0 0x7fe108073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 -- 172.21.15.114:0/3500646365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10814bc70 con 0x7fe10806e810 2024-09-16T07:33:32.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe107e00640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10806e810 0x7fe108164730 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe0f801b250 tx=0x7fe0f80092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe104c00640 1 -- 172.21.15.114:0/3500646365 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80bb070 con 0x7fe10806e810 2024-09-16T07:33:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe104c00640 1 -- 172.21.15.114:0/3500646365 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0f8004d40 con 0x7fe10806e810 2024-09-16T07:33:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe104c00640 1 -- 172.21.15.114:0/3500646365 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80b2040 con 0x7fe10806e810 2024-09-16T07:33:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe108073ea0 con 0x7fe10806e810 2024-09-16T07:33:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.562+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe108072e80 con 0x7fe10806e810 2024-09-16T07:33:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.566+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe108069410 con 0x7fe10806e810 2024-09-16T07:33:32.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.566+0000 7fe104c00640 1 -- 172.21.15.114:0/3500646365 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7fe0f8004260 con 0x7fe10806e810 2024-09-16T07:33:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.566+0000 7fe104c00640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0e4073070 0x7fe0e4075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.566+0000 7fe104c00640 1 -- 172.21.15.114:0/3500646365 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fe0f812e050 con 0x7fe10806e810 2024-09-16T07:33:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.566+0000 7fe0ff400640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0e4073070 0x7fe0e4075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.566+0000 7fe0ff400640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0e4073070 0x7fe0e4075530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0007fd0 tx=0x7fe0f00078c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.570+0000 7fe104c00640 1 -- 172.21.15.114:0/3500646365 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe0f8016790 con 0x7fe10806e810 2024-09-16T07:33:32.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.762+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol55200", "target": ["mon-mgr", ""]}) -- 0x7fe108072950 con 0x7fe0e4073070 2024-09-16T07:33:32.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.774+0000 7fe104c00640 1 -- 172.21.15.114:0/3500646365 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fe108072950 con 0x7fe0e4073070 2024-09-16T07:33:32.775 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac 2024-09-16T07:33:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0e4073070 msgr2=0x7fe0e4075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0e4073070 0x7fe0e4075530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0007fd0 tx=0x7fe0f00078c0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10806e810 msgr2=0x7fe108164730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10806e810 0x7fe108164730 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe0f801b250 tx=0x7fe0f80092a0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 shutdown_connections 2024-09-16T07:33:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe10815ade0 0x7fe108073960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0e4073070 0x7fe0e4075530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe1080b4bd0 0x7fe10814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 --2- 172.21.15.114:0/3500646365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe10806e810 0x7fe108164730 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 >> 172.21.15.114:0/3500646365 conn(0x7fe1080b18f0 msgr2=0x7fe108155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 shutdown_connections 2024-09-16T07:33:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.778+0000 7fe10f200640 1 -- 172.21.15.114:0/3500646365 wait complete. 2024-09-16T07:33:32.796 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol_clone13670 2024-09-16T07:33:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- 172.21.15.114:0/3090851055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4240cc2a0 msgr2=0x7fc42406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 --2- 172.21.15.114:0/3090851055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4240cc2a0 0x7fc42406eab0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc410009900 tx=0x7fc41001c850 comp rx=0 tx=0).stop 2024-09-16T07:33:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- 172.21.15.114:0/3090851055 shutdown_connections 2024-09-16T07:33:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 --2- 172.21.15.114:0/3090851055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4240cc2a0 0x7fc42406eab0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- 172.21.15.114:0/3090851055 >> 172.21.15.114:0/3090851055 conn(0x7fc4240b18f0 msgr2=0x7fc4240b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- 172.21.15.114:0/3090851055 shutdown_connections 2024-09-16T07:33:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- 172.21.15.114:0/3090851055 wait complete. 2024-09-16T07:33:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 Processor -- start 2024-09-16T07:33:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- start start 2024-09-16T07:33:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4240b4cf0 0x7fc424166270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc42415e260 0x7fc4241f9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4241f7f60 0x7fc4241567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc424169360 con 0x7fc4241f7f60 2024-09-16T07:33:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241691e0 con 0x7fc4240b4cf0 2024-09-16T07:33:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc429000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc4241694e0 con 0x7fc42415e260 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4241f7f60 0x7fc4241567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4241f7f60 0x7fc4241567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35060/0 (socket says 172.21.15.114:35060) 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 -- 172.21.15.114:0/3729108446 learned_addr learned my addr 172.21.15.114:0/3729108446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc421e00640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4240b4cf0 0x7fc424166270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc421400640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc42415e260 0x7fc4241f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 -- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc42415e260 msgr2=0x7fc4241f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc42415e260 0x7fc4241f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 -- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4240b4cf0 msgr2=0x7fc424166270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4240b4cf0 0x7fc424166270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 -- 172.21.15.114:0/3729108446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4241f8460 con 0x7fc4241f7f60 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc422800640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4241f7f60 0x7fc4241567a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c780 tx=0x7fc41c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.950+0000 7fc41a000640 1 -- 172.21.15.114:0/3729108446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c003b80 con 0x7fc4241f7f60 2024-09-16T07:33:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc41a000640 1 -- 172.21.15.114:0/3729108446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc41c003d20 con 0x7fc4241f7f60 2024-09-16T07:33:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4241f8740 con 0x7fc4241f7f60 2024-09-16T07:33:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc41a000640 1 -- 172.21.15.114:0/3729108446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00aab0 con 0x7fc4241f7f60 2024-09-16T07:33:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4241f8d00 con 0x7fc4241f7f60 2024-09-16T07:33:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4240b2bf0 con 0x7fc4241f7f60 2024-09-16T07:33:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc41a000640 1 -- 172.21.15.114:0/3729108446 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7fc41c00ac50 con 0x7fc4241f7f60 2024-09-16T07:33:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc41a000640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc404073070 0x7fc404075530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc41a000640 1 -- 172.21.15.114:0/3729108446 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fc41c093f40 con 0x7fc4241f7f60 2024-09-16T07:33:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc421e00640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc404073070 0x7fc404075530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.954+0000 7fc421e00640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc404073070 0x7fc404075530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc414007fd0 tx=0x7fc414009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:32.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:32.958+0000 7fc41a000640 1 -- 172.21.15.114:0/3729108446 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc41c05e770 con 0x7fc4241f7f60 2024-09-16T07:33:33.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.150+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol_clone13670", "target": ["mon-mgr", ""]}) -- 0x7fc42409dcf0 con 0x7fc404073070 2024-09-16T07:33:33.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.158+0000 7fc41a000640 1 -- 172.21.15.114:0/3729108446 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+73 (secure 0 0 0) 0x7fc42409dcf0 con 0x7fc404073070 2024-09-16T07:33:33.157 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075 2024-09-16T07:33:33.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc404073070 msgr2=0x7fc404075530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc404073070 0x7fc404075530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc414007fd0 tx=0x7fc414009040 comp rx=0 tx=0).stop 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4241f7f60 msgr2=0x7fc4241567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4241f7f60 0x7fc4241567a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c780 tx=0x7fc41c00cc40 comp rx=0 tx=0).stop 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 shutdown_connections 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4241f7f60 0x7fc4241567a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc404073070 0x7fc404075530 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc42415e260 0x7fc4241f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 --2- 172.21.15.114:0/3729108446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4240b4cf0 0x7fc424166270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 >> 172.21.15.114:0/3729108446 conn(0x7fc4240b18f0 msgr2=0x7fc4240af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 shutdown_connections 2024-09-16T07:33:33.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.162+0000 7fc429000640 1 -- 172.21.15.114:0/3729108446 wait complete. 2024-09-16T07:33:33.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.178 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:33.189 INFO:teuthology.orchestra.run.smithi114.stdout:9 2024-09-16T07:33:33.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.189 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075) 2024-09-16T07:33:33.240 INFO:teuthology.orchestra.run.smithi114.stdout:9 2024-09-16T07:33:33.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol_clone13670 2024-09-16T07:33:33.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- 172.21.15.114:0/2496985174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 msgr2=0x7ff9a00ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:33.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 --2- 172.21.15.114:0/2496985174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00ce8a0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff994009900 tx=0x7ff99401c810 comp rx=0 tx=0).stop 2024-09-16T07:33:33.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- 172.21.15.114:0/2496985174 shutdown_connections 2024-09-16T07:33:33.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 --2- 172.21.15.114:0/2496985174 >> v2:172.21.15.149:3300/0 conn(0x7ff9a0073860 0x7ff9a0073cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 --2- 172.21.15.114:0/2496985174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00ce8a0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- 172.21.15.114:0/2496985174 >> 172.21.15.114:0/2496985174 conn(0x7ff9a00d0cd0 msgr2=0x7ff9a00d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:33.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- 172.21.15.114:0/2496985174 shutdown_connections 2024-09-16T07:33:33.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- 172.21.15.114:0/2496985174 wait complete. 2024-09-16T07:33:33.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 Processor -- start 2024-09-16T07:33:33.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- start start 2024-09-16T07:33:33.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9a0073860 0x7ff9a0164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:33.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9a00d01a0 0x7ff9a01553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:33.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a01678c0 con 0x7ff9a015ab80 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a0071a70 con 0x7ff9a00d01a0 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.430+0000 7ff9a8600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a0167a40 con 0x7ff9a0073860 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35078/0 (socket says 172.21.15.114:35078) 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 -- 172.21.15.114:0/3398202344 learned_addr learned my addr 172.21.15.114:0/3398202344 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a5200640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9a00d01a0 0x7ff9a01553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a5c00640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9a0073860 0x7ff9a0164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 -- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9a0073860 msgr2=0x7ff9a0164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9a0073860 0x7ff9a0164880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 -- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9a00d01a0 msgr2=0x7ff9a01553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9a00d01a0 0x7ff9a01553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 -- 172.21.15.114:0/3398202344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a00b41c0 con 0x7ff9a015ab80 2024-09-16T07:33:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a6600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00b4500 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff99800eb50 tx=0x7ff99800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff99d600640 1 -- 172.21.15.114:0/3398202344 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998004d30 con 0x7ff9a015ab80 2024-09-16T07:33:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff99d600640 1 -- 172.21.15.114:0/3398202344 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff99800ee50 con 0x7ff9a015ab80 2024-09-16T07:33:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff99d600640 1 -- 172.21.15.114:0/3398202344 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998005280 con 0x7ff9a015ab80 2024-09-16T07:33:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a01f7920 con 0x7ff9a015ab80 2024-09-16T07:33:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a00b3ee0 con 0x7ff9a015ab80 2024-09-16T07:33:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a0073cf0 con 0x7ff9a015ab80 2024-09-16T07:33:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.434+0000 7ff99d600640 1 -- 172.21.15.114:0/3398202344 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 97233+0+0 (secure 0 0 0) 0x7ff998005420 con 0x7ff9a015ab80 2024-09-16T07:33:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.438+0000 7ff99d600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff9800730a0 0x7ff980075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.438+0000 7ff99d600640 1 -- 172.21.15.114:0/3398202344 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7ff998094e10 con 0x7ff9a015ab80 2024-09-16T07:33:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.438+0000 7ff9a5c00640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff9800730a0 0x7ff980075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:33.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.438+0000 7ff9a5c00640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff9800730a0 0x7ff980075560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9940af000 tx=0x7ff99401b050 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.442+0000 7ff99d600640 1 -- 172.21.15.114:0/3398202344 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff99805f640 con 0x7ff9a015ab80 2024-09-16T07:33:33.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.630+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol_clone13670", "target": ["mon-mgr", ""]}) -- 0x7ff9a015e970 con 0x7ff9800730a0 2024-09-16T07:33:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff99d600640 1 -- 172.21.15.114:0/3398202344 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+744 (secure 0 0 0) 0x7ff9a015e970 con 0x7ff9800730a0 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "atime": "2024-09-16 07:33:26", 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_pcent": "80.00", 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_quota": 10485760, 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "bytes_used": 8388608, 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "created_at": "2024-09-16 07:33:31", 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "ctime": "2024-09-16 07:33:31", 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "data_pool": "cephfs_data", 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "earmark": "", 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "features": [ 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot-clone", 2024-09-16T07:33:33.640 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot-autoprotect", 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot-retention" 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "flavor": 2, 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "gid": 1000, 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": 16895, 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "mon_addrs": [ 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.114:6789", 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.149:6789", 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "172.21.15.149:6790" 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "mtime": "2024-09-16 07:33:30", 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "path": "/volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075", 2024-09-16T07:33:33.641 INFO:teuthology.orchestra.run.smithi114.stdout: "pool_namespace": "", 2024-09-16T07:33:33.642 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "complete", 2024-09-16T07:33:33.642 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "clone", 2024-09-16T07:33:33.642 INFO:teuthology.orchestra.run.smithi114.stdout: "uid": 1000 2024-09-16T07:33:33.642 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff9800730a0 msgr2=0x7ff980075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff9800730a0 0x7ff980075560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9940af000 tx=0x7ff99401b050 comp rx=0 tx=0).stop 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 msgr2=0x7ff9a00b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00b4500 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff99800eb50 tx=0x7ff99800c6a0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 shutdown_connections 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9a015ab80 0x7ff9a00b4500 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9a00d01a0 0x7ff9a01553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff9800730a0 0x7ff980075560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 --2- 172.21.15.114:0/3398202344 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff9a0073860 0x7ff9a0164880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 >> 172.21.15.114:0/3398202344 conn(0x7ff9a00d0cd0 msgr2=0x7ff9a01595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:33.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 shutdown_connections 2024-09-16T07:33:33.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:33.642+0000 7ff9a8600640 1 -- 172.21.15.114:0/3398202344 wait complete. 2024-09-16T07:33:33.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.661 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:33.669 INFO:teuthology.orchestra.run.smithi114.stderr:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510: ceph.quota.max_bytes: No such attribute 2024-09-16T07:33:33.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:33:33.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.670 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:33.719 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:33:33.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.720 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:33.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.772 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.2 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.5 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.4 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.7 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.6 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.0 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.3 2024-09-16T07:33:33.829 INFO:teuthology.orchestra.run.smithi114.stdout:volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.1 2024-09-16T07:33:33.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.831 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:33.883 INFO:teuthology.orchestra.run.smithi114.stdout:41ff 2024-09-16T07:33:33.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.884 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/) 2024-09-16T07:33:33.941 INFO:teuthology.orchestra.run.smithi114.stdout:41ff 2024-09-16T07:33:33.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.942 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:33.990 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:33.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:33.991 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/) 2024-09-16T07:33:34.042 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:34.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.043 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:34.098 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:34.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.099 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/) 2024-09-16T07:33:34.150 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:34.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.151 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510) 2024-09-16T07:33:34.206 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:34.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.207 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/) 2024-09-16T07:33:34.258 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:34.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.259 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.2) 2024-09-16T07:33:34.317 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:34.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.318 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.2) 2024-09-16T07:33:34.371 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:34.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.372 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.2) 2024-09-16T07:33:34.425 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:34.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.426 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.2) 2024-09-16T07:33:34.478 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:34.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.479 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.2) 2024-09-16T07:33:34.530 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:34.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.532 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.2) 2024-09-16T07:33:34.582 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:34.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.583 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.2) 2024-09-16T07:33:34.634 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:34.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.636 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.2) 2024-09-16T07:33:34.686 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:34.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.688 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.5) 2024-09-16T07:33:34.740 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:34.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.741 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.5) 2024-09-16T07:33:34.797 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:34.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.798 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.5) 2024-09-16T07:33:34.846 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:34.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.847 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.5) 2024-09-16T07:33:34.898 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:34.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.899 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.5) 2024-09-16T07:33:34.950 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:34.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:34.951 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.5) 2024-09-16T07:33:35.006 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:35.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.007 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.5) 2024-09-16T07:33:35.059 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:35.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.060 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.5) 2024-09-16T07:33:35.115 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:35.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.116 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.4) 2024-09-16T07:33:35.168 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:35.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.170 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.4) 2024-09-16T07:33:35.222 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:35.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.223 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.4) 2024-09-16T07:33:35.274 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:35.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.275 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.4) 2024-09-16T07:33:35.326 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:35.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.327 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.4) 2024-09-16T07:33:35.378 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:35.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.379 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.4) 2024-09-16T07:33:35.434 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:35.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:35.435 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.4) 2024-09-16T07:33:37.318 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:37.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.320 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.4) 2024-09-16T07:33:37.330 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:37.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.331 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.7) 2024-09-16T07:33:37.388 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:37.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.390 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.7) 2024-09-16T07:33:37.445 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:37.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.446 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.7) 2024-09-16T07:33:37.499 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:37.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.500 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.7) 2024-09-16T07:33:37.551 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:37.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.552 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.7) 2024-09-16T07:33:37.607 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:37.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.608 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.7) 2024-09-16T07:33:37.662 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:37.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.664 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.7) 2024-09-16T07:33:37.716 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:37.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.717 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.7) 2024-09-16T07:33:37.768 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:37.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.769 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.6) 2024-09-16T07:33:37.820 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:37.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.821 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.6) 2024-09-16T07:33:37.875 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:37.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.876 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.6) 2024-09-16T07:33:37.927 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:37.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.928 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.6) 2024-09-16T07:33:37.982 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:37.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:37.983 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.6) 2024-09-16T07:33:38.039 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:38.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.040 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.6) 2024-09-16T07:33:38.091 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:38.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.092 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.6) 2024-09-16T07:33:38.143 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:38.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.145 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.6) 2024-09-16T07:33:38.196 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:38.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.197 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.0) 2024-09-16T07:33:38.248 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:38.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.250 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.0) 2024-09-16T07:33:38.300 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:38.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.301 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.0) 2024-09-16T07:33:38.355 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:38.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.356 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.0) 2024-09-16T07:33:38.411 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:38.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.413 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.0) 2024-09-16T07:33:38.463 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:38.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.465 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.0) 2024-09-16T07:33:38.519 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:38.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.521 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.0) 2024-09-16T07:33:38.574 INFO:teuthology.orchestra.run.smithi114.stdout:1726472009 2024-09-16T07:33:38.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.576 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.0) 2024-09-16T07:33:38.627 INFO:teuthology.orchestra.run.smithi114.stdout:1726472009 2024-09-16T07:33:38.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.628 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.3) 2024-09-16T07:33:38.680 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:38.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.681 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.3) 2024-09-16T07:33:38.731 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:38.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.733 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.3) 2024-09-16T07:33:38.783 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:38.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.784 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.3) 2024-09-16T07:33:38.839 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:38.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.840 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.3) 2024-09-16T07:33:38.890 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:38.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.892 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.3) 2024-09-16T07:33:38.942 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:38.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.944 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.3) 2024-09-16T07:33:38.997 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:38.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:38.999 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.3) 2024-09-16T07:33:39.051 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:39.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.052 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.1) 2024-09-16T07:33:39.104 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:39.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.106 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.1) 2024-09-16T07:33:39.160 INFO:teuthology.orchestra.run.smithi114.stdout:81b4 2024-09-16T07:33:39.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.161 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.1) 2024-09-16T07:33:39.211 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:39.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.212 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.1) 2024-09-16T07:33:39.267 INFO:teuthology.orchestra.run.smithi114.stdout:1000 2024-09-16T07:33:39.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.268 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.1) 2024-09-16T07:33:39.319 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:39.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.320 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.1) 2024-09-16T07:33:39.371 INFO:teuthology.orchestra.run.smithi114.stdout:1271 2024-09-16T07:33:39.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.372 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac/.snap/subvol_snap60510/subvolume_file.1) 2024-09-16T07:33:39.430 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:39.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:39.431 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone13670/619cea33-a61f-4534-866b-0fb94b458075/subvolume_file.1) 2024-09-16T07:33:39.483 INFO:teuthology.orchestra.run.smithi114.stdout:1726472010 2024-09-16T07:33:39.484 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol55200 fake subvol_clone50921 2024-09-16T07:33:39.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.686+0000 7f3ce8400640 1 -- 172.21.15.114:0/2258539222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cc8004810 msgr2=0x7f3cc8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:39.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.686+0000 7f3ce8400640 1 --2- 172.21.15.114:0/2258539222 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cc8004810 0x7f3cc8004c90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00b2830 tx=0x7f3ccc01f510 comp rx=0 tx=0).stop 2024-09-16T07:33:39.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.686+0000 7f3ce6400640 1 -- 172.21.15.114:0/2258539222 reap_dead start 2024-09-16T07:33:39.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.686+0000 7f3ce8400640 1 -- 172.21.15.114:0/2258539222 shutdown_connections 2024-09-16T07:33:39.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.686+0000 7f3ce8400640 1 -- 172.21.15.114:0/2258539222 >> 172.21.15.114:0/2258539222 conn(0x7f3ce00b18f0 msgr2=0x7f3ce00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:39.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.686+0000 7f3ce8400640 1 -- 172.21.15.114:0/2258539222 shutdown_connections 2024-09-16T07:33:39.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.686+0000 7f3ce8400640 1 -- 172.21.15.114:0/2258539222 wait complete. 2024-09-16T07:33:39.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 Processor -- start 2024-09-16T07:33:39.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 -- start start 2024-09-16T07:33:39.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cc8004810 0x7f3ce014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:39.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce0157590 0x7f3ce015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:39.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ce01548e0 0x7f3ce015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:39.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce015c7c0 con 0x7f3ce01548e0 2024-09-16T07:33:39.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0074960 con 0x7f3ce0157590 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce015c940 con 0x7f3cc8004810 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ce01548e0 0x7f3ce015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ce01548e0 0x7f3ce015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56532/0 (socket says 172.21.15.114:56532) 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 -- 172.21.15.114:0/2711442304 learned_addr learned my addr 172.21.15.114:0/2711442304 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce5000640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce0157590 0x7f3ce015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce5a00640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cc8004810 0x7f3ce014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 -- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cc8004810 msgr2=0x7f3ce014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cc8004810 0x7f3ce014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 -- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce0157590 msgr2=0x7f3ce015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce0157590 0x7f3ce015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:39.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 -- 172.21.15.114:0/2711442304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01f8250 con 0x7f3ce01548e0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce6400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ce01548e0 0x7f3ce015ee20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8001340 tx=0x7f3cd8006450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3cdd600640 1 -- 172.21.15.114:0/2711442304 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8015070 con 0x7f3ce01548e0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3cdd600640 1 -- 172.21.15.114:0/2711442304 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd8011900 con 0x7f3ce01548e0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3cdd600640 1 -- 172.21.15.114:0/2711442304 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8011d50 con 0x7f3ce01548e0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce01f8fd0 con 0x7f3ce01548e0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.690+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01f87d0 con 0x7f3ce01548e0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.694+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce0069410 con 0x7f3ce01548e0 2024-09-16T07:33:39.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.694+0000 7f3cdd600640 1 -- 172.21.15.114:0/2711442304 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 97335+0+0 (secure 0 0 0) 0x7f3cd8018070 con 0x7f3ce01548e0 2024-09-16T07:33:39.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.694+0000 7f3cdd600640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3cc0073190 0x7f3cc0075650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:39.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.694+0000 7f3cdd600640 1 -- 172.21.15.114:0/2711442304 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f3cd8095080 con 0x7f3ce01548e0 2024-09-16T07:33:39.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.694+0000 7f3ce5a00640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3cc0073190 0x7f3cc0075650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:39.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.694+0000 7f3ce5a00640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3cc0073190 0x7f3cc0075650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009b80 tx=0x7f3cd40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:39.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.698+0000 7f3cdd600640 1 -- 172.21.15.114:0/2711442304 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3cd805f830 con 0x7f3ce01548e0 2024-09-16T07:33:39.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.902+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol55200", "snap_name": "fake", "target_sub_name": "subvol_clone50921", "target": ["mon-mgr", ""]}) -- 0x7f3ce006f4b0 con 0x7f3cc0073190 2024-09-16T07:33:39.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3cdd600640 1 -- 172.21.15.114:0/2711442304 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ce006f4b0 con 0x7f3cc0073190 2024-09-16T07:33:39.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3cc0073190 msgr2=0x7f3cc0075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3cc0073190 0x7f3cc0075650 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009b80 tx=0x7f3cd40091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ce01548e0 msgr2=0x7f3ce015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ce01548e0 0x7f3ce015ee20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8001340 tx=0x7f3cd8006450 comp rx=0 tx=0).stop 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 shutdown_connections 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ce01548e0 0x7f3ce015ee20 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ce0157590 0x7f3ce015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3cc0073190 0x7f3cc0075650 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 --2- 172.21.15.114:0/2711442304 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cc8004810 0x7f3ce014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 >> 172.21.15.114:0/2711442304 conn(0x7f3ce00b18f0 msgr2=0x7f3ce00cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 shutdown_connections 2024-09-16T07:33:39.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:39.962+0000 7f3ce8400640 1 -- 172.21.15.114:0/2711442304 wait complete. 2024-09-16T07:33:39.983 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone50921 2024-09-16T07:33:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.130+0000 7f6fdec00640 1 -- 172.21.15.114:0/1544370543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 msgr2=0x7f6fbc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.130+0000 7f6fdec00640 1 --2- 172.21.15.114:0/1544370543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 0x7f6fbc0051d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c640 tx=0x7f6fd001fa80 comp rx=0 tx=0).stop 2024-09-16T07:33:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.130+0000 7f6fdcc00640 1 -- 172.21.15.114:0/1544370543 reap_dead start 2024-09-16T07:33:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.130+0000 7f6fdec00640 1 -- 172.21.15.114:0/1544370543 shutdown_connections 2024-09-16T07:33:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.130+0000 7f6fdec00640 1 -- 172.21.15.114:0/1544370543 >> 172.21.15.114:0/1544370543 conn(0x7f6fd80b18f0 msgr2=0x7f6fd80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.130+0000 7f6fdec00640 1 -- 172.21.15.114:0/1544370543 shutdown_connections 2024-09-16T07:33:40.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.130+0000 7f6fdec00640 1 -- 172.21.15.114:0/1544370543 wait complete. 2024-09-16T07:33:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 Processor -- start 2024-09-16T07:33:40.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 -- start start 2024-09-16T07:33:40.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 0x7f6fd809d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fd8158600 0x7f6fd814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fd814e6d0 0x7f6fd8148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd80b4630 con 0x7f6fbc004d50 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd80b44b0 con 0x7f6fd814e6d0 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd8070ae0 con 0x7f6fd8158600 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 0x7f6fd809d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 0x7f6fd809d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56560/0 (socket says 172.21.15.114:56560) 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 -- 172.21.15.114:0/3146530521 learned_addr learned my addr 172.21.15.114:0/3146530521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7400640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fd8158600 0x7f6fd814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdcc00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fd814e6d0 0x7f6fd8148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 -- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fd8158600 msgr2=0x7f6fd814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fd8158600 0x7f6fd814e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:40.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 -- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fd814e6d0 msgr2=0x7f6fd8148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:40.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fd814e6d0 0x7f6fd8148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:40.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 -- 172.21.15.114:0/3146530521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd814eb30 con 0x7f6fbc004d50 2024-09-16T07:33:40.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fd7e00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 0x7f6fd809d600 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8011b10 tx=0x7f6fc8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fcfe00640 1 -- 172.21.15.114:0/3146530521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc801e070 con 0x7f6fbc004d50 2024-09-16T07:33:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fcfe00640 1 -- 172.21.15.114:0/3146530521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fc800fbd0 con 0x7f6fbc004d50 2024-09-16T07:33:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fcfe00640 1 -- 172.21.15.114:0/3146530521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8019410 con 0x7f6fbc004d50 2024-09-16T07:33:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd80c4c00 con 0x7f6fbc004d50 2024-09-16T07:33:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.134+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd8157e00 con 0x7f6fbc004d50 2024-09-16T07:33:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.138+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd80c5120 con 0x7f6fbc004d50 2024-09-16T07:33:40.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.138+0000 7f6fcfe00640 1 -- 172.21.15.114:0/3146530521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 97335+0+0 (secure 0 0 0) 0x7f6fc8021070 con 0x7f6fbc004d50 2024-09-16T07:33:40.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.138+0000 7f6fcfe00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6fb8073190 0x7f6fb8075650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:40.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.138+0000 7f6fcfe00640 1 -- 172.21.15.114:0/3146530521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f6fc8094b10 con 0x7f6fbc004d50 2024-09-16T07:33:40.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.138+0000 7f6fd7400640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6fb8073190 0x7f6fb8075650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:40.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.138+0000 7f6fd7400640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6fb8073190 0x7f6fb8075650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80b16c0 tx=0x7f6fc400a2f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:40.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.142+0000 7f6fcfe00640 1 -- 172.21.15.114:0/3146530521 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6fc805f230 con 0x7f6fbc004d50 2024-09-16T07:33:40.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:40.342+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone50921", "target": ["mon-mgr", ""]}) -- 0x7f6fd8069410 con 0x7f6fb8073190 2024-09-16T07:33:42.330 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:42.330+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:42.330 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:42.330+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:42.330 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:42.330+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:42.331 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:42.330+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:42.331 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:42.330+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.346+0000 7f6fcfe00640 1 -- 172.21.15.114:0/3146530521 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+153 (secure 0 0 0) 0x7f6fd8069410 con 0x7f6fb8073190 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: "status": { 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "pending", 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: "source": { 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: "volume": "cephfs", 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: "subvolume": "subvol55200", 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot": "fake" 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:42.346 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:42.347 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6fb8073190 msgr2=0x7f6fb8075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6fb8073190 0x7f6fb8075650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80b16c0 tx=0x7f6fc400a2f0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 msgr2=0x7f6fd809d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 0x7f6fd809d600 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8011b10 tx=0x7f6fc8011f10 comp rx=0 tx=0).stop 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 shutdown_connections 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6fd814e6d0 0x7f6fd8148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6fb8073190 0x7f6fb8075650 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6fd8158600 0x7f6fd814e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 --2- 172.21.15.114:0/3146530521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6fbc004d50 0x7f6fd809d600 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 >> 172.21.15.114:0/3146530521 conn(0x7f6fd80b18f0 msgr2=0x7f6fd8156780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 shutdown_connections 2024-09-16T07:33:42.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:42.350+0000 7f6fdec00640 1 -- 172.21.15.114:0/3146530521 wait complete. 2024-09-16T07:33:42.376 DEBUG:tasks.cephfs.test_volumes:current clone state = pending 2024-09-16T07:33:43.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone50921 2024-09-16T07:33:43.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 -- 172.21.15.114:0/627161442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f140 msgr2=0x7f4e480738b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 --2- 172.21.15.114:0/627161442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f140 0x7f4e480738b0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009840 tx=0x7f4e38020240 comp rx=0 tx=0).stop 2024-09-16T07:33:43.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 -- 172.21.15.114:0/627161442 shutdown_connections 2024-09-16T07:33:43.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 --2- 172.21.15.114:0/627161442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f140 0x7f4e480738b0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 -- 172.21.15.114:0/627161442 >> 172.21.15.114:0/627161442 conn(0x7f4e480cfa00 msgr2=0x7f4e480cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:43.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 -- 172.21.15.114:0/627161442 shutdown_connections 2024-09-16T07:33:43.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 -- 172.21.15.114:0/627161442 wait complete. 2024-09-16T07:33:43.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 Processor -- start 2024-09-16T07:33:43.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 -- start start 2024-09-16T07:33:43.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e4806f140 0x7f4e481d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.538+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f520 0x7f4e481cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e480d0640 0x7f4e481f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4e480aec20 con 0x7f4e4806f520 2024-09-16T07:33:43.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e480aeaa0 con 0x7f4e480d0640 2024-09-16T07:33:43.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4e480ce6f0 con 0x7f4e4806f140 2024-09-16T07:33:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f520 0x7f4e481cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f520 0x7f4e481cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56584/0 (socket says 172.21.15.114:56584) 2024-09-16T07:33:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e46a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e4806f140 0x7f4e481d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 -- 172.21.15.114:0/4020598630 learned_addr learned my addr 172.21.15.114:0/4020598630 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47400640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e480d0640 0x7f4e481f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 -- 172.21.15.114:0/4020598630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e4806f140 msgr2=0x7f4e481d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e4806f140 0x7f4e481d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 -- 172.21.15.114:0/4020598630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e480d0640 msgr2=0x7f4e481f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e480d0640 0x7f4e481f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 -- 172.21.15.114:0/4020598630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e480c9d00 con 0x7f4e4806f520 2024-09-16T07:33:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3e000640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f520 0x7f4e481cd4b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000c450 tx=0x7f4e3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e300052d0 con 0x7f4e4806f520 2024-09-16T07:33:43.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e30005470 con 0x7f4e4806f520 2024-09-16T07:33:43.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30012870 con 0x7f4e4806f520 2024-09-16T07:33:43.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e480c9a20 con 0x7f4e4806f520 2024-09-16T07:33:43.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e481d0220 con 0x7f4e4806f520 2024-09-16T07:33:43.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e480738b0 con 0x7f4e4806f520 2024-09-16T07:33:43.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.542+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 97335+0+0 (secure 0 0 0) 0x7f4e30003600 con 0x7f4e4806f520 2024-09-16T07:33:43.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.546+0000 7f4e3f400640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4e24073190 0x7f4e24075650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:43.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.546+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f4e30093d60 con 0x7f4e4806f520 2024-09-16T07:33:43.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.546+0000 7f4e46a00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4e24073190 0x7f4e24075650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:43.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.546+0000 7f4e46a00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4e24073190 0x7f4e24075650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e380b2000 tx=0x7f4e3801ea80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:43.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.550+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4e3005e480 con 0x7f4e4806f520 2024-09-16T07:33:43.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:43.750+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone50921", "target": ["mon-mgr", ""]}) -- 0x7f4e480cd540 con 0x7f4e24073190 2024-09-16T07:33:44.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:44.458+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7f4e3005a6f0 con 0x7f4e4806f520 2024-09-16T07:33:47.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.330+0000 7f4e3f400640 1 -- 172.21.15.114:0/4020598630 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f4e480cd540 con 0x7f4e24073190 2024-09-16T07:33:47.328 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:47.328 INFO:teuthology.orchestra.run.smithi114.stdout: "status": { 2024-09-16T07:33:47.329 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "complete" 2024-09-16T07:33:47.329 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:47.329 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:47.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4e24073190 msgr2=0x7f4e24075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4e24073190 0x7f4e24075650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e380b2000 tx=0x7f4e3801ea80 comp rx=0 tx=0).stop 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f520 msgr2=0x7f4e481cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f520 0x7f4e481cd4b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000c450 tx=0x7f4e3000c910 comp rx=0 tx=0).stop 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 shutdown_connections 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e480d0640 0x7f4e481f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e4806f520 0x7f4e481cd4b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4e24073190 0x7f4e24075650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 --2- 172.21.15.114:0/4020598630 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4e4806f140 0x7f4e481d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 >> 172.21.15.114:0/4020598630 conn(0x7f4e480cfa00 msgr2=0x7f4e480afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 shutdown_connections 2024-09-16T07:33:47.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.334+0000 7f4e47e00640 1 -- 172.21.15.114:0/4020598630 wait complete. 2024-09-16T07:33:47.355 DEBUG:tasks.cephfs.test_volumes:current clone state = complete 2024-09-16T07:33:47.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:47.355 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone50921/.meta) 2024-09-16T07:33:47.376 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:33:47.377 INFO:teuthology.orchestra.run.smithi114.stdout:version = 2 2024-09-16T07:33:47.377 INFO:teuthology.orchestra.run.smithi114.stdout:type = clone 2024-09-16T07:33:47.377 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol_clone50921/d578ec00-134c-4ada-b1f3-71fc5fd2b40c 2024-09-16T07:33:47.377 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:33:47.377 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:47.379 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol55200 subvol_snap60510 2024-09-16T07:33:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- 172.21.15.114:0/2330441512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf280d28e0 msgr2=0x7fbf280d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/2330441512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf280d28e0 0x7fbf280d0170 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009840 tx=0x7fbf1001c820 comp rx=0 tx=0).stop 2024-09-16T07:33:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- 172.21.15.114:0/2330441512 shutdown_connections 2024-09-16T07:33:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/2330441512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf280d28e0 0x7fbf280d0170 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/2330441512 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf2815f390 0x7fbf280cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- 172.21.15.114:0/2330441512 >> 172.21.15.114:0/2330441512 conn(0x7fbf280d1dc0 msgr2=0x7fbf280d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- 172.21.15.114:0/2330441512 shutdown_connections 2024-09-16T07:33:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- 172.21.15.114:0/2330441512 wait complete. 2024-09-16T07:33:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 Processor -- start 2024-09-16T07:33:47.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- start start 2024-09-16T07:33:47.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf280d06b0 0x7fbf2815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf280d28e0 0x7fbf2806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf2815f390 0x7fbf281561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281690b0 con 0x7fbf2815f390 2024-09-16T07:33:47.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28168f30 con 0x7fbf280d28e0 2024-09-16T07:33:47.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.578+0000 7fbf2ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbf28169230 con 0x7fbf280d06b0 2024-09-16T07:33:47.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf2815f390 0x7fbf281561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf2815f390 0x7fbf281561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45596/0 (socket says 172.21.15.114:45596) 2024-09-16T07:33:47.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 -- 172.21.15.114:0/520127290 learned_addr learned my addr 172.21.15.114:0/520127290 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:47.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf1d400640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf280d28e0 0x7fbf2806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf25e00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf280d06b0 0x7fbf2815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 -- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf280d06b0 msgr2=0x7fbf2815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf280d06b0 0x7fbf2815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 -- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf280d28e0 msgr2=0x7fbf2806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf280d28e0 0x7fbf2806dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 -- 172.21.15.114:0/520127290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf280715c0 con 0x7fbf2815f390 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf1d400640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf280d28e0 0x7fbf2806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:47.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf26800640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf2815f390 0x7fbf281561a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c3a0 tx=0x7fbf2000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:47.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf1ea00640 1 -- 172.21.15.114:0/520127290 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20017070 con 0x7fbf2815f390 2024-09-16T07:33:47.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf1ea00640 1 -- 172.21.15.114:0/520127290 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf20003600 con 0x7fbf2815f390 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2815beb0 con 0x7fbf2815f390 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf1ea00640 1 -- 172.21.15.114:0/520127290 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20003a50 con 0x7fbf2815f390 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf28154e60 con 0x7fbf2815f390 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf280b1350 con 0x7fbf2815f390 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf1ea00640 1 -- 172.21.15.114:0/520127290 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7fbf2001a070 con 0x7fbf2815f390 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.582+0000 7fbf1ea00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbf04073220 0x7fbf040756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.586+0000 7fbf1ea00640 1 -- 172.21.15.114:0/520127290 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fbf200937b0 con 0x7fbf2815f390 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.586+0000 7fbf25e00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbf04073220 0x7fbf040756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.586+0000 7fbf25e00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbf04073220 0x7fbf040756e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf18005c50 tx=0x7fbf18005be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:47.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.590+0000 7fbf1ea00640 1 -- 172.21.15.114:0/520127290 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbf2005e480 con 0x7fbf2815f390 2024-09-16T07:33:47.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.782+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "cephfs", "sub_name": "subvol55200", "snap_name": "subvol_snap60510", "target": ["mon-mgr", ""]}) -- 0x7fbf2815c870 con 0x7fbf04073220 2024-09-16T07:33:47.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf1ea00640 1 -- 172.21.15.114:0/520127290 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+115 (secure 0 0 0) 0x7fbf2815c870 con 0x7fbf04073220 2024-09-16T07:33:47.796 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:33:47.797 INFO:teuthology.orchestra.run.smithi114.stdout: "created_at": "2024-09-16 07:33:31.235969", 2024-09-16T07:33:47.797 INFO:teuthology.orchestra.run.smithi114.stdout: "data_pool": "cephfs_data", 2024-09-16T07:33:47.797 INFO:teuthology.orchestra.run.smithi114.stdout: "has_pending_clones": "no" 2024-09-16T07:33:47.797 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:33:47.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbf04073220 msgr2=0x7fbf040756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbf04073220 0x7fbf040756e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf18005c50 tx=0x7fbf18005be0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf2815f390 msgr2=0x7fbf281561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf2815f390 0x7fbf281561a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c3a0 tx=0x7fbf2000c860 comp rx=0 tx=0).stop 2024-09-16T07:33:47.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 shutdown_connections 2024-09-16T07:33:47.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf2815f390 0x7fbf281561a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbf280d28e0 0x7fbf2806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbf04073220 0x7fbf040756e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 --2- 172.21.15.114:0/520127290 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbf280d06b0 0x7fbf2815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 >> 172.21.15.114:0/520127290 conn(0x7fbf280d1dc0 msgr2=0x7fbf2815d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:47.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 shutdown_connections 2024-09-16T07:33:47.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.798+0000 7fbf2ca00640 1 -- 172.21.15.114:0/520127290 wait complete. 2024-09-16T07:33:47.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs subvol55200 2024-09-16T07:33:47.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.966+0000 7fa53b200640 1 -- 172.21.15.114:0/3596263635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5180052e0 msgr2=0x7fa518005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.966+0000 7fa53b200640 1 --2- 172.21.15.114:0/3596263635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5180052e0 0x7fa518005920 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa53409e090 tx=0x7fa51c01f380 comp rx=0 tx=0).stop 2024-09-16T07:33:47.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.966+0000 7fa539200640 1 -- 172.21.15.114:0/3596263635 reap_dead start 2024-09-16T07:33:47.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.966+0000 7fa53b200640 1 -- 172.21.15.114:0/3596263635 shutdown_connections 2024-09-16T07:33:47.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.966+0000 7fa53b200640 1 -- 172.21.15.114:0/3596263635 >> 172.21.15.114:0/3596263635 conn(0x7fa5340cfbc0 msgr2=0x7fa5340cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:47.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- 172.21.15.114:0/3596263635 shutdown_connections 2024-09-16T07:33:47.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- 172.21.15.114:0/3596263635 wait complete. 2024-09-16T07:33:47.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 Processor -- start 2024-09-16T07:33:47.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- start start 2024-09-16T07:33:47.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5180052e0 0x7fa5340b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5340b3c40 0x7fa534142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5341448b0 0x7fa534144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa5340cdac0 con 0x7fa5341448b0 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa53415acf0 con 0x7fa5340b3c40 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa5340cdc40 con 0x7fa5180052e0 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5341448b0 0x7fa534144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5341448b0 0x7fa534144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45618/0 (socket says 172.21.15.114:45618) 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 -- 172.21.15.114:0/667433259 learned_addr learned my addr 172.21.15.114:0/667433259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa52b400640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5340b3c40 0x7fa534142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa533e00640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5180052e0 0x7fa5340b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 -- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5180052e0 msgr2=0x7fa5340b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5180052e0 0x7fa5340b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 -- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5340b3c40 msgr2=0x7fa534142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5340b3c40 0x7fa534142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 -- 172.21.15.114:0/667433259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5340b40d0 con 0x7fa5341448b0 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa539200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5341448b0 0x7fa534144d60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa534072820 tx=0x7fa52c00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa530c00640 1 -- 172.21.15.114:0/667433259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0107d0 con 0x7fa5341448b0 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa530c00640 1 -- 172.21.15.114:0/667433259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa52c016070 con 0x7fa5341448b0 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5340b43b0 con 0x7fa5341448b0 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa530c00640 1 -- 172.21.15.114:0/667433259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c010d20 con 0x7fa5341448b0 2024-09-16T07:33:47.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.970+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5340b4970 con 0x7fa5341448b0 2024-09-16T07:33:47.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.974+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa534069410 con 0x7fa5341448b0 2024-09-16T07:33:47.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.974+0000 7fa530c00640 1 -- 172.21.15.114:0/667433259 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7fa52c01b460 con 0x7fa5341448b0 2024-09-16T07:33:47.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.974+0000 7fa530c00640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa510073250 0x7fa510075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:47.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.974+0000 7fa530c00640 1 -- 172.21.15.114:0/667433259 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fa52c0948c0 con 0x7fa5341448b0 2024-09-16T07:33:47.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.974+0000 7fa533e00640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa510073250 0x7fa510075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:47.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.974+0000 7fa533e00640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa510073250 0x7fa510075710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa524009ac0 tx=0x7fa5240091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:47.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:47.978+0000 7fa530c00640 1 -- 172.21.15.114:0/667433259 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa52c05f570 con 0x7fa5341448b0 2024-09-16T07:33:48.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.174+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "subvol55200", "target": ["mon-mgr", ""]}) -- 0x7fa5340ce1d0 con 0x7fa510073250 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa530c00640 1 -- 172.21.15.114:0/667433259 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+87 (secure 0 0 0) 0x7fa5340ce1d0 con 0x7fa510073250 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "fake" 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "subvol_snap60510" 2024-09-16T07:33:48.188 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:33:48.189 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa510073250 msgr2=0x7fa510075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa510073250 0x7fa510075710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa524009ac0 tx=0x7fa5240091e0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5341448b0 msgr2=0x7fa534144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5341448b0 0x7fa534144d60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa534072820 tx=0x7fa52c00e9a0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 shutdown_connections 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5341448b0 0x7fa534144d60 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5340b3c40 0x7fa534142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa510073250 0x7fa510075710 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 --2- 172.21.15.114:0/667433259 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5180052e0 0x7fa5340b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 >> 172.21.15.114:0/667433259 conn(0x7fa5340cfbc0 msgr2=0x7fa53406eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:48.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 shutdown_connections 2024-09-16T07:33:48.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.190+0000 7fa53b200640 1 -- 172.21.15.114:0/667433259 wait complete. 2024-09-16T07:33:48.209 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol55200 subvol_snap60510 2024-09-16T07:33:48.253 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:33:48.261 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:33:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.358+0000 7fcb67c00640 1 -- 172.21.15.114:0/1215376839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb44004b50 msgr2=0x7fcb44004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.358+0000 7fcb67c00640 1 --2- 172.21.15.114:0/1215376839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb44004b50 0x7fcb44004f70 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fcb500016f0 tx=0x7fcb5001c7b0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.358+0000 7fcb65c00640 1 -- 172.21.15.114:0/1215376839 reap_dead start 2024-09-16T07:33:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.358+0000 7fcb67c00640 1 -- 172.21.15.114:0/1215376839 shutdown_connections 2024-09-16T07:33:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.358+0000 7fcb67c00640 1 -- 172.21.15.114:0/1215376839 >> 172.21.15.114:0/1215376839 conn(0x7fcb600cfbc0 msgr2=0x7fcb600cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.358+0000 7fcb67c00640 1 -- 172.21.15.114:0/1215376839 shutdown_connections 2024-09-16T07:33:48.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.358+0000 7fcb67c00640 1 -- 172.21.15.114:0/1215376839 wait complete. 2024-09-16T07:33:48.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 Processor -- start 2024-09-16T07:33:48.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 -- start start 2024-09-16T07:33:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb44004b50 0x7fcb601f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb600b2bf0 0x7fcb6014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb600af860 0x7fcb600afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcb60165ba0 con 0x7fcb600b2bf0 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb60165a20 con 0x7fcb44004b50 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcb60165d20 con 0x7fcb600af860 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb600b2bf0 0x7fcb6014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb600b2bf0 0x7fcb6014f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45634/0 (socket says 172.21.15.114:45634) 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 -- 172.21.15.114:0/3767030044 learned_addr learned my addr 172.21.15.114:0/3767030044 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb65c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb600af860 0x7fcb600afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb65200640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb44004b50 0x7fcb601f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 -- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb600af860 msgr2=0x7fcb600afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb600af860 0x7fcb600afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 -- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb44004b50 msgr2=0x7fcb601f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb44004b50 0x7fcb601f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 -- 172.21.15.114:0/3767030044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb600b3080 con 0x7fcb600b2bf0 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb65c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb600af860 0x7fcb600afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb57e00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb600b2bf0 0x7fcb6014f6c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcb480066b0 tx=0x7fcb480039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb5d600640 1 -- 172.21.15.114:0/3767030044 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011700 con 0x7fcb600b2bf0 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb5d600640 1 -- 172.21.15.114:0/3767030044 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb48016020 con 0x7fcb600b2bf0 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb5d600640 1 -- 172.21.15.114:0/3767030044 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011b80 con 0x7fcb600b2bf0 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb600b3360 con 0x7fcb600b2bf0 2024-09-16T07:33:48.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.362+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb600b3920 con 0x7fcb600b2bf0 2024-09-16T07:33:48.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.366+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb60069410 con 0x7fcb600b2bf0 2024-09-16T07:33:48.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.366+0000 7fcb5d600640 1 -- 172.21.15.114:0/3767030044 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7fcb4800f430 con 0x7fcb600b2bf0 2024-09-16T07:33:48.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.366+0000 7fcb5d600640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb3c073220 0x7fcb3c0756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.366+0000 7fcb5d600640 1 -- 172.21.15.114:0/3767030044 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fcb48094c10 con 0x7fcb600b2bf0 2024-09-16T07:33:48.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.366+0000 7fcb65200640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb3c073220 0x7fcb3c0756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.366+0000 7fcb65200640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb3c073220 0x7fcb3c0756e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb500016c0 tx=0x7fcb500195a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.370+0000 7fcb5d600640 1 -- 172.21.15.114:0/3767030044 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcb48020030 con 0x7fcb600b2bf0 2024-09-16T07:33:48.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.574+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol55200", "snap_name": "subvol_snap60510", "target": ["mon-mgr", ""]}) -- 0x7fcb600d0850 con 0x7fcb3c073220 2024-09-16T07:33:48.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb5d600640 1 -- 172.21.15.114:0/3767030044 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcb600d0850 con 0x7fcb3c073220 2024-09-16T07:33:48.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb3c073220 msgr2=0x7fcb3c0756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb3c073220 0x7fcb3c0756e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb500016c0 tx=0x7fcb500195a0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb600b2bf0 msgr2=0x7fcb6014f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb600b2bf0 0x7fcb6014f6c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcb480066b0 tx=0x7fcb480039d0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 shutdown_connections 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcb3c073220 0x7fcb3c0756e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcb600af860 0x7fcb600afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb600b2bf0 0x7fcb6014f6c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 --2- 172.21.15.114:0/3767030044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb44004b50 0x7fcb601f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 >> 172.21.15.114:0/3767030044 conn(0x7fcb600cfbc0 msgr2=0x7fcb600b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:48.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 shutdown_connections 2024-09-16T07:33:48.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.602+0000 7fcb67c00640 1 -- 172.21.15.114:0/3767030044 wait complete. 2024-09-16T07:33:48.621 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol55200 fake 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- 172.21.15.114:0/1441322630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e4815f390 msgr2=0x7f1e480cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 --2- 172.21.15.114:0/1441322630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e4815f390 0x7f1e480cfc30 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1e480b3850 tx=0x7f1e3801c890 comp rx=0 tx=0).stop 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- 172.21.15.114:0/1441322630 shutdown_connections 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 --2- 172.21.15.114:0/1441322630 >> v2:172.21.15.149:3300/0 conn(0x7f1e480af850 0x7f1e480afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 --2- 172.21.15.114:0/1441322630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e4815f390 0x7f1e480cfc30 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- 172.21.15.114:0/1441322630 >> 172.21.15.114:0/1441322630 conn(0x7f1e480d1dc0 msgr2=0x7f1e480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- 172.21.15.114:0/1441322630 shutdown_connections 2024-09-16T07:33:48.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- 172.21.15.114:0/1441322630 wait complete. 2024-09-16T07:33:48.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 Processor -- start 2024-09-16T07:33:48.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- start start 2024-09-16T07:33:48.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e480af850 0x7f1e4806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e480d28e0 0x7f1e4814a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e4815f390 0x7f1e4815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1e48168ea0 con 0x7f1e480af850 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e48168d20 con 0x7f1e4815f390 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4f600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1e48169020 con 0x7f1e480d28e0 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e480af850 0x7f1e4806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e480af850 0x7f1e4806dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45656/0 (socket says 172.21.15.114:45656) 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.770+0000 7f1e4cc00640 1 -- 172.21.15.114:0/4067468968 learned_addr learned my addr 172.21.15.114:0/4067468968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e480d28e0 0x7f1e4814a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4d600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e4815f390 0x7f1e4815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4cc00640 1 -- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e480d28e0 msgr2=0x7f1e4814a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4cc00640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e480d28e0 0x7f1e4814a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4cc00640 1 -- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e4815f390 msgr2=0x7f1e4815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4cc00640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e4815f390 0x7f1e4815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4cc00640 1 -- 172.21.15.114:0/4067468968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4806e3c0 con 0x7f1e480af850 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4d600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e4815f390 0x7f1e4815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4cc00640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e480af850 0x7f1e4806dd30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009850 tx=0x7f1e380a5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e45600640 1 -- 172.21.15.114:0/4067468968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380ba020 con 0x7f1e480af850 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e45600640 1 -- 172.21.15.114:0/4067468968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e380044b0 con 0x7f1e480af850 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e45600640 1 -- 172.21.15.114:0/4067468968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380b2040 con 0x7f1e480af850 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4806e6a0 con 0x7f1e480af850 2024-09-16T07:33:48.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4806ec60 con 0x7f1e480af850 2024-09-16T07:33:48.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e480afc30 con 0x7f1e480af850 2024-09-16T07:33:48.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.774+0000 7f1e45600640 1 -- 172.21.15.114:0/4067468968 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7f1e38005290 con 0x7f1e480af850 2024-09-16T07:33:48.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.778+0000 7f1e45600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e24073250 0x7f1e24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:48.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.778+0000 7f1e45600640 1 -- 172.21.15.114:0/4067468968 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f1e3812e350 con 0x7f1e480af850 2024-09-16T07:33:48.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.778+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e24073250 0x7f1e24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:48.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.778+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e24073250 0x7f1e24075710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1e480c54d0 tx=0x7f1e30007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:48.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.782+0000 7f1e45600640 1 -- 172.21.15.114:0/4067468968 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1e380c4060 con 0x7f1e480af850 2024-09-16T07:33:48.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:48.982+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol55200", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f1e480d0520 con 0x7f1e24073250 2024-09-16T07:33:49.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.010+0000 7f1e45600640 1 -- 172.21.15.114:0/4067468968 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1e480d0520 con 0x7f1e24073250 2024-09-16T07:33:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e24073250 msgr2=0x7f1e24075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e24073250 0x7f1e24075710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1e480c54d0 tx=0x7f1e30007e40 comp rx=0 tx=0).stop 2024-09-16T07:33:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e480af850 msgr2=0x7f1e4806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e480af850 0x7f1e4806dd30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009850 tx=0x7f1e380a5890 comp rx=0 tx=0).stop 2024-09-16T07:33:49.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 shutdown_connections 2024-09-16T07:33:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e4815f390 0x7f1e4815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e24073250 0x7f1e24075710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e480d28e0 0x7f1e4814a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 --2- 172.21.15.114:0/4067468968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e480af850 0x7f1e4806dd30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 >> 172.21.15.114:0/4067468968 conn(0x7f1e480d1dc0 msgr2=0x7f1e4815d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 shutdown_connections 2024-09-16T07:33:49.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.014+0000 7f1e4f600640 1 -- 172.21.15.114:0/4067468968 wait complete. 2024-09-16T07:33:49.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:49.032 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol55200/.meta) 2024-09-16T07:33:49.052 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:33:49.053 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:33:49.053 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:33:49.053 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol55200/c4916945-df71-4aea-ba24-bdaefe2c30ac 2024-09-16T07:33:49.053 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:33:49.053 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:49.055 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol55200 2024-09-16T07:33:49.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- 172.21.15.114:0/2041848422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 msgr2=0x7f6ad80b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 --2- 172.21.15.114:0/2041848422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad80b42d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6ad806aab0 tx=0x7f6ad001c7a0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- 172.21.15.114:0/2041848422 shutdown_connections 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 --2- 172.21.15.114:0/2041848422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad80b42d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 --2- 172.21.15.114:0/2041848422 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80cd100 0x7f6ad80acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 --2- 172.21.15.114:0/2041848422 >> v2:172.21.15.149:3300/0 conn(0x7f6ad806f8b0 0x7f6ad815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- 172.21.15.114:0/2041848422 >> 172.21.15.114:0/2041848422 conn(0x7f6ad80b18f0 msgr2=0x7f6ad80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- 172.21.15.114:0/2041848422 shutdown_connections 2024-09-16T07:33:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- 172.21.15.114:0/2041848422 wait complete. 2024-09-16T07:33:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 Processor -- start 2024-09-16T07:33:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- start start 2024-09-16T07:33:49.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad806f8b0 0x7f6ad8158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad809c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80cd100 0x7f6ad81506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad80b4990 con 0x7f6ad80cc620 2024-09-16T07:33:49.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad80b4810 con 0x7f6ad806f8b0 2024-09-16T07:33:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6add000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad80b4b10 con 0x7f6ad80cd100 2024-09-16T07:33:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6ad5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad809c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6ad5e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad806f8b0 0x7f6ad8158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6ad5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad809c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45672/0 (socket says 172.21.15.114:45672) 2024-09-16T07:33:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6ad5400640 1 -- 172.21.15.114:0/2625678769 learned_addr learned my addr 172.21.15.114:0/2625678769 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6ad6800640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80cd100 0x7f6ad81506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6ad5400640 1 -- 172.21.15.114:0/2625678769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80cd100 msgr2=0x7f6ad81506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.246+0000 7f6ad5400640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80cd100 0x7f6ad81506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ad5400640 1 -- 172.21.15.114:0/2625678769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad806f8b0 msgr2=0x7f6ad8158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ad5400640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad806f8b0 0x7f6ad8158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ad5400640 1 -- 172.21.15.114:0/2625678769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad81fb070 con 0x7f6ad80cc620 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ad5400640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad809c260 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400c970 tx=0x7f6ac400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ace000640 1 -- 172.21.15.114:0/2625678769 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4007bb0 con 0x7f6ad80cc620 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ace000640 1 -- 172.21.15.114:0/2625678769 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ac4007e40 con 0x7f6ad80cc620 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad81fb350 con 0x7f6ad80cc620 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ace000640 1 -- 172.21.15.114:0/2625678769 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400f6b0 con 0x7f6ad80cc620 2024-09-16T07:33:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad81fb910 con 0x7f6ad80cc620 2024-09-16T07:33:49.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad81f7740 con 0x7f6ad80cc620 2024-09-16T07:33:49.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ace000640 1 -- 172.21.15.114:0/2625678769 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7f6ac400f850 con 0x7f6ad80cc620 2024-09-16T07:33:49.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ace000640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ab8073220 0x7f6ab80756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ace000640 1 -- 172.21.15.114:0/2625678769 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f6ac4094b80 con 0x7f6ad80cc620 2024-09-16T07:33:49.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.250+0000 7f6ad5e00640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ab8073220 0x7f6ab80756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.254+0000 7f6ad5e00640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ab8073220 0x7f6ab80756e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8005fd0 tx=0x7f6ac8007600 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.254+0000 7f6ace000640 1 -- 172.21.15.114:0/2625678769 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6ad81f7740 con 0x7f6ad80cc620 2024-09-16T07:33:49.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.446+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol55200", "target": ["mon-mgr", ""]}) -- 0x7f6ad80b42d0 con 0x7f6ab8073220 2024-09-16T07:33:49.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.482+0000 7f6ace000640 1 -- 172.21.15.114:0/2625678769 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ad80b42d0 con 0x7f6ab8073220 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ab8073220 msgr2=0x7f6ab80756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ab8073220 0x7f6ab80756e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8005fd0 tx=0x7f6ac8007600 comp rx=0 tx=0).stop 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 msgr2=0x7f6ad809c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad809c260 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400c970 tx=0x7f6ac400ce30 comp rx=0 tx=0).stop 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 shutdown_connections 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ab8073220 0x7f6ab80756e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ad80cd100 0x7f6ad81506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ad80cc620 0x7f6ad809c260 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 --2- 172.21.15.114:0/2625678769 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ad806f8b0 0x7f6ad8158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 >> 172.21.15.114:0/2625678769 conn(0x7f6ad80b18f0 msgr2=0x7f6ad815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:49.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 shutdown_connections 2024-09-16T07:33:49.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.486+0000 7f6add000640 1 -- 172.21.15.114:0/2625678769 wait complete. 2024-09-16T07:33:49.487 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.490+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.488 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.490+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.488 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.490+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.488 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.490+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.488 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.490+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.504 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.506+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.504 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.506+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.504 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.506+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.505 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.506+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.505 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:33:49.506+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:33:49.512 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone13670 2024-09-16T07:33:49.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 -- 172.21.15.114:0/3969520789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200d02d0 msgr2=0x7f0f200d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 --2- 172.21.15.114:0/3969520789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200d02d0 0x7f0f200d06b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0f200afd50 tx=0x7f0f1401c7d0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 -- 172.21.15.114:0/3969520789 shutdown_connections 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 --2- 172.21.15.114:0/3969520789 >> v2:172.21.15.149:3300/0 conn(0x7f0f200cef90 0x7f0f20068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 --2- 172.21.15.114:0/3969520789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200d02d0 0x7f0f200d06b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 -- 172.21.15.114:0/3969520789 >> 172.21.15.114:0/3969520789 conn(0x7f0f200742f0 msgr2=0x7f0f20074700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 -- 172.21.15.114:0/3969520789 shutdown_connections 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 -- 172.21.15.114:0/3969520789 wait complete. 2024-09-16T07:33:49.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.670+0000 7f0f27000640 1 Processor -- start 2024-09-16T07:33:49.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 -- start start 2024-09-16T07:33:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f200cea90 0x7f0f20098f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200cef90 0x7f0f20099460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f200d02d0 0x7f0f20154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20160720 con 0x7f0f200cef90 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f201605a0 con 0x7f0f200cea90 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0f20168c10 con 0x7f0f200d02d0 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200cef90 0x7f0f20099460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200cef90 0x7f0f20099460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45756/0 (socket says 172.21.15.114:45756) 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 -- 172.21.15.114:0/1476147902 learned_addr learned my addr 172.21.15.114:0/1476147902 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25c00640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f200cea90 0x7f0f20098f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f26600640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f200d02d0 0x7f0f20154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 -- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f200d02d0 msgr2=0x7f0f20154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f200d02d0 0x7f0f20154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 -- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f200cea90 msgr2=0x7f0f20098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f200cea90 0x7f0f20098f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 -- 172.21.15.114:0/1476147902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f20099b10 con 0x7f0f200cef90 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f25200640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200cef90 0x7f0f20099460 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00d950 tx=0x7f0f0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f1d600640 1 -- 172.21.15.114:0/1476147902 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c017070 con 0x7f0f200cef90 2024-09-16T07:33:49.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f1d600640 1 -- 172.21.15.114:0/1476147902 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f0c009d20 con 0x7f0f200cef90 2024-09-16T07:33:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f1d600640 1 -- 172.21.15.114:0/1476147902 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0106c0 con 0x7f0f200cef90 2024-09-16T07:33:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2015d030 con 0x7f0f200cef90 2024-09-16T07:33:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.674+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2015d5f0 con 0x7f0f200cef90 2024-09-16T07:33:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.678+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f20068960 con 0x7f0f200cef90 2024-09-16T07:33:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.678+0000 7f0f1d600640 1 -- 172.21.15.114:0/1476147902 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7f0f0c010860 con 0x7f0f200cef90 2024-09-16T07:33:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.678+0000 7f0f1d600640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f00073220 0x7f0f000756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.678+0000 7f0f1d600640 1 -- 172.21.15.114:0/1476147902 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f0f0c094910 con 0x7f0f200cef90 2024-09-16T07:33:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.678+0000 7f0f25c00640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f00073220 0x7f0f000756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.678+0000 7f0f25c00640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f00073220 0x7f0f000756e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0f140af000 tx=0x7f0f1401b010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.682+0000 7f0f1d600640 1 -- 172.21.15.114:0/1476147902 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0f0c05ee70 con 0x7f0f200cef90 2024-09-16T07:33:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.874+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone13670", "target": ["mon-mgr", ""]}) -- 0x7f0f20099df0 con 0x7f0f00073220 2024-09-16T07:33:49.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.890+0000 7f0f1d600640 1 -- 172.21.15.114:0/1476147902 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f20099df0 con 0x7f0f00073220 2024-09-16T07:33:49.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f00073220 msgr2=0x7f0f000756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f00073220 0x7f0f000756e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0f140af000 tx=0x7f0f1401b010 comp rx=0 tx=0).stop 2024-09-16T07:33:49.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200cef90 msgr2=0x7f0f20099460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:49.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200cef90 0x7f0f20099460 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00d950 tx=0x7f0f0c00de10 comp rx=0 tx=0).stop 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 shutdown_connections 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f00073220 0x7f0f000756e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f200d02d0 0x7f0f20154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f200cef90 0x7f0f20099460 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 --2- 172.21.15.114:0/1476147902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f200cea90 0x7f0f20098f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 >> 172.21.15.114:0/1476147902 conn(0x7f0f200742f0 msgr2=0x7f0f200b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 shutdown_connections 2024-09-16T07:33:49.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:49.894+0000 7f0f27000640 1 -- 172.21.15.114:0/1476147902 wait complete. 2024-09-16T07:33:49.916 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone50921 2024-09-16T07:33:50.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 -- 172.21.15.114:0/599850498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340d28c0 msgr2=0x7fb7340cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 --2- 172.21.15.114:0/599850498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340d28c0 0x7fb7340cea20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb720009900 tx=0x7fb72001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 -- 172.21.15.114:0/599850498 shutdown_connections 2024-09-16T07:33:50.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 --2- 172.21.15.114:0/599850498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340d28c0 0x7fb7340cea20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 --2- 172.21.15.114:0/599850498 >> v2:172.21.15.149:3300/0 conn(0x7fb73415be80 0x7fb7340ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 -- 172.21.15.114:0/599850498 >> 172.21.15.114:0/599850498 conn(0x7fb7340d1da0 msgr2=0x7fb7340d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:50.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 -- 172.21.15.114:0/599850498 shutdown_connections 2024-09-16T07:33:50.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.066+0000 7fb73c400640 1 -- 172.21.15.114:0/599850498 wait complete. 2024-09-16T07:33:50.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 Processor -- start 2024-09-16T07:33:50.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 -- start start 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340b53f0 0x7fb734157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7340d28c0 0x7fb734154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb73415be80 0x7fb7340c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb7341691f0 con 0x7fb7340d28c0 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb734169070 con 0x7fb73415be80 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb734169370 con 0x7fb7340b53f0 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7340d28c0 0x7fb734154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340b53f0 0x7fb734157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340b53f0 0x7fb734157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:43774/0 (socket says 172.21.15.114:43774) 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 -- 172.21.15.114:0/391294466 learned_addr learned my addr 172.21.15.114:0/391294466 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73a400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb73415be80 0x7fb7340c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 -- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb73415be80 msgr2=0x7fb7340c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb73415be80 0x7fb7340c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 -- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7340d28c0 msgr2=0x7fb734154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7340d28c0 0x7fb734154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 -- 172.21.15.114:0/391294466 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7340b2660 con 0x7fb7340b53f0 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739000640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7340d28c0 0x7fb734154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73a400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb73415be80 0x7fb7340c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb739a00640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340b53f0 0x7fb734157a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e7a0 tx=0x7fb72800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb731600640 1 -- 172.21.15.114:0/391294466 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72800ccc0 con 0x7fb7340b53f0 2024-09-16T07:33:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb731600640 1 -- 172.21.15.114:0/391294466 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb728010430 con 0x7fb7340b53f0 2024-09-16T07:33:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb731600640 1 -- 172.21.15.114:0/391294466 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728010860 con 0x7fb7340b53f0 2024-09-16T07:33:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.070+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7341554f0 con 0x7fb7340b53f0 2024-09-16T07:33:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.074+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7340c7260 con 0x7fb7340b53f0 2024-09-16T07:33:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.074+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7340b5860 con 0x7fb7340b53f0 2024-09-16T07:33:50.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.074+0000 7fb731600640 1 -- 172.21.15.114:0/391294466 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 20) ==== 97386+0+0 (secure 0 0 0) 0x7fb728010a00 con 0x7fb7340b53f0 2024-09-16T07:33:50.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.074+0000 7fb731600640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb714073220 0x7fb7140756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.074+0000 7fb731600640 1 -- 172.21.15.114:0/391294466 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fb728095170 con 0x7fb7340b53f0 2024-09-16T07:33:50.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.074+0000 7fb739000640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb714073220 0x7fb7140756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.074+0000 7fb739000640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb714073220 0x7fb7140756e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7200af000 tx=0x7fb72001b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:50.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.078+0000 7fb731600640 1 -- 172.21.15.114:0/391294466 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb72805f850 con 0x7fb7340b53f0 2024-09-16T07:33:50.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.270+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone50921", "target": ["mon-mgr", ""]}) -- 0x7fb734152960 con 0x7fb714073220 2024-09-16T07:33:50.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb731600640 1 -- 172.21.15.114:0/391294466 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb734152960 con 0x7fb714073220 2024-09-16T07:33:50.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb714073220 msgr2=0x7fb7140756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb714073220 0x7fb7140756e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7200af000 tx=0x7fb72001b120 comp rx=0 tx=0).stop 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340b53f0 msgr2=0x7fb734157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340b53f0 0x7fb734157a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e7a0 tx=0x7fb72800ec60 comp rx=0 tx=0).stop 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 shutdown_connections 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb73415be80 0x7fb7340c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7340d28c0 0x7fb734154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb714073220 0x7fb7140756e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 --2- 172.21.15.114:0/391294466 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7340b53f0 0x7fb734157a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 >> 172.21.15.114:0/391294466 conn(0x7fb7340d1da0 msgr2=0x7fb7340d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 shutdown_connections 2024-09-16T07:33:50.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.286+0000 7fb73c400640 1 -- 172.21.15.114:0/391294466 wait complete. 2024-09-16T07:33:50.311 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T07:33:50.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:33:50.373 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-09-16T07:33:50.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:33:50.381 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:33:50.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:33:50.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:33:50.534 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:33:50.534 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:50.534 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:50.534 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:50.543 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:50.543 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:50.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 -- 172.21.15.114:0/887328487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 msgr2=0x7f269c0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 --2- 172.21.15.114:0/887328487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c0cebb0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f269c0745d0 tx=0x7f269401c980 comp rx=0 tx=0).stop 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 -- 172.21.15.114:0/887328487 shutdown_connections 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 --2- 172.21.15.114:0/887328487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c0cebb0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 --2- 172.21.15.114:0/887328487 >> v2:172.21.15.149:3300/0 conn(0x7f269c15bea0 0x7f269c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 -- 172.21.15.114:0/887328487 >> 172.21.15.114:0/887328487 conn(0x7f269c0d1dc0 msgr2=0x7f269c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 -- 172.21.15.114:0/887328487 shutdown_connections 2024-09-16T07:33:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 -- 172.21.15.114:0/887328487 wait complete. 2024-09-16T07:33:50.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 Processor -- start 2024-09-16T07:33:50.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.790+0000 7f26a3400640 1 -- start start 2024-09-16T07:33:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f269c0cdb30 0x7f269c0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f269c15bea0 0x7f269c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f269c15c490 con 0x7f269c0d28e0 2024-09-16T07:33:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0cfb50 con 0x7f269c0cdb30 2024-09-16T07:33:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f269c0cd0e0 con 0x7f269c15bea0 2024-09-16T07:33:50.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c15b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45788/0 (socket says 172.21.15.114:45788) 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 -- 172.21.15.114:0/1576235483 learned_addr learned my addr 172.21.15.114:0/1576235483 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a0a00640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f269c0cdb30 0x7f269c0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a1400640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f269c15bea0 0x7f269c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 -- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f269c15bea0 msgr2=0x7f269c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f269c15bea0 0x7f269c0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 -- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f269c0cdb30 msgr2=0x7f269c0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f269c0cdb30 0x7f269c0ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 -- 172.21.15.114:0/1576235483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c1f47f0 con 0x7f269c0d28e0 2024-09-16T07:33:50.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f269be00640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c15b270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f268800fa70 tx=0x7f268800ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f2698c00640 1 -- 172.21.15.114:0/1576235483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268801a070 con 0x7f269c0d28e0 2024-09-16T07:33:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f2698c00640 1 -- 172.21.15.114:0/1576235483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2688008570 con 0x7f269c0d28e0 2024-09-16T07:33:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f2698c00640 1 -- 172.21.15.114:0/1576235483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268800da20 con 0x7f269c0d28e0 2024-09-16T07:33:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1f4ad0 con 0x7f269c0d28e0 2024-09-16T07:33:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1f5090 con 0x7f269c0d28e0 2024-09-16T07:33:50.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.794+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c0cd670 con 0x7f269c0d28e0 2024-09-16T07:33:50.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.798+0000 7f2698c00640 1 -- 172.21.15.114:0/1576235483 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) ==== 97437+0+0 (secure 0 0 0) 0x7f268801d070 con 0x7f269c0d28e0 2024-09-16T07:33:50.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.798+0000 7f2698c00640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f267c0732b0 0x7f267c075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:50.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.798+0000 7f2698c00640 1 -- 172.21.15.114:0/1576235483 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f2688096f10 con 0x7f269c0d28e0 2024-09-16T07:33:50.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.798+0000 7f26a0a00640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f267c0732b0 0x7f267c075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:50.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.798+0000 7f26a0a00640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f267c0732b0 0x7f267c075770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f269c09f9e0 tx=0x7f269000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:50.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.802+0000 7f2698c00640 1 -- 172.21.15.114:0/1576235483 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2688061430 con 0x7f269c0d28e0 2024-09-16T07:33:50.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.982+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f269c1f5430 con 0x7f269c0d28e0 2024-09-16T07:33:50.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.982+0000 7f2698c00640 1 -- 172.21.15.114:0/1576235483 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) ==== 80+0+0 (secure 0 0 0) 0x7f2688065e60 con 0x7f269c0d28e0 2024-09-16T07:33:50.983 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:33:50.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f267c0732b0 msgr2=0x7f267c075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f267c0732b0 0x7f267c075770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f269c09f9e0 tx=0x7f269000b2e0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 msgr2=0x7f269c15b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c15b270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f268800fa70 tx=0x7f268800ff30 comp rx=0 tx=0).stop 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 shutdown_connections 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f267c0732b0 0x7f267c075770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f269c15bea0 0x7f269c0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f269c0d28e0 0x7f269c15b270 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 --2- 172.21.15.114:0/1576235483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f269c0cdb30 0x7f269c0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 >> 172.21.15.114:0/1576235483 conn(0x7f269c0d1dc0 msgr2=0x7f269c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 shutdown_connections 2024-09-16T07:33:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:50.986+0000 7f26a3400640 1 -- 172.21.15.114:0/1576235483 wait complete. 2024-09-16T07:33:51.004 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:33:51.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:51.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:33:51.062 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:33:51.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:51.063 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:33:51.080 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:51.081 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:51.081 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:51.090 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:51.090 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:51.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:33:51.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 -- 172.21.15.114:0/1234169311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc0afca0 msgr2=0x7fbddc0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 --2- 172.21.15.114:0/1234169311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc0afca0 0x7fbddc0b00d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0cfb60 tx=0x7fbdd401c740 comp rx=0 tx=0).stop 2024-09-16T07:33:51.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 -- 172.21.15.114:0/1234169311 shutdown_connections 2024-09-16T07:33:51.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 --2- 172.21.15.114:0/1234169311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc0afca0 0x7fbddc0b00d0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 --2- 172.21.15.114:0/1234169311 >> v2:172.21.15.149:3300/0 conn(0x7fbddc15f490 0x7fbddc0b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 -- 172.21.15.114:0/1234169311 >> 172.21.15.114:0/1234169311 conn(0x7fbddc0d1e30 msgr2=0x7fbddc0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:51.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 -- 172.21.15.114:0/1234169311 shutdown_connections 2024-09-16T07:33:51.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.282+0000 7fbde2200640 1 -- 172.21.15.114:0/1234169311 wait complete. 2024-09-16T07:33:51.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 Processor -- start 2024-09-16T07:33:51.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 -- start start 2024-09-16T07:33:51.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbddc0afca0 0x7fbddc14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbddc0b2e80 0x7fbddc1f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc15f490 0x7fbddc0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc168e00 con 0x7fbddc15f490 2024-09-16T07:33:51.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc168c80 con 0x7fbddc0b2e80 2024-09-16T07:33:51.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc168f80 con 0x7fbddc0afca0 2024-09-16T07:33:51.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc15f490 0x7fbddc0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc15f490 0x7fbddc0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45808/0 (socket says 172.21.15.114:45808) 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 -- 172.21.15.114:0/1223461425 learned_addr learned my addr 172.21.15.114:0/1223461425 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddb400640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbddc0afca0 0x7fbddc14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddaa00640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbddc0b2e80 0x7fbddc1f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 -- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbddc0afca0 msgr2=0x7fbddc14d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbddc0afca0 0x7fbddc14d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 -- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbddc0b2e80 msgr2=0x7fbddc1f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbddc0b2e80 0x7fbddc1f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 -- 172.21.15.114:0/1223461425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc09fe50 con 0x7fbddc15f490 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddb400640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbddc0afca0 0x7fbddc14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbddbe00640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc15f490 0x7fbddc0ce1c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009790 tx=0x7fbdd40a57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbdd3400640 1 -- 172.21.15.114:0/1223461425 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40bb070 con 0x7fbddc15f490 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbdd3400640 1 -- 172.21.15.114:0/1223461425 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd40044b0 con 0x7fbddc15f490 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbdd3400640 1 -- 172.21.15.114:0/1223461425 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40b2040 con 0x7fbddc15f490 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc0b5d50 con 0x7fbddc15f490 2024-09-16T07:33:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc0b6310 con 0x7fbddc15f490 2024-09-16T07:33:51.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.286+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbddc0b00d0 con 0x7fbddc15f490 2024-09-16T07:33:51.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.290+0000 7fbdd3400640 1 -- 172.21.15.114:0/1223461425 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) ==== 97437+0+0 (secure 0 0 0) 0x7fbdd40be070 con 0x7fbddc15f490 2024-09-16T07:33:51.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.290+0000 7fbdd3400640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbdbc0732b0 0x7fbdbc075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.290+0000 7fbdd3400640 1 -- 172.21.15.114:0/1223461425 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7fbdd412df70 con 0x7fbddc15f490 2024-09-16T07:33:51.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.290+0000 7fbddb400640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbdbc0732b0 0x7fbdbc075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.290+0000 7fbddb400640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbdbc0732b0 0x7fbdbc075770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009e70 tx=0x7fbdcc009850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:51.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.294+0000 7fbdd3400640 1 -- 172.21.15.114:0/1223461425 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbdd40163f0 con 0x7fbddc15f490 2024-09-16T07:33:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.470+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbddc0cdca0 con 0x7fbddc15f490 2024-09-16T07:33:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.470+0000 7fbdd3400640 1 -- 172.21.15.114:0/1223461425 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) ==== 80+0+0 (secure 0 0 0) 0x7fbdd40f89c0 con 0x7fbddc15f490 2024-09-16T07:33:51.470 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbdbc0732b0 msgr2=0x7fbdbc075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbdbc0732b0 0x7fbdbc075770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009e70 tx=0x7fbdcc009850 comp rx=0 tx=0).stop 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc15f490 msgr2=0x7fbddc0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc15f490 0x7fbddc0ce1c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009790 tx=0x7fbdd40a57a0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 shutdown_connections 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc15f490 0x7fbddc0ce1c0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbddc0b2e80 0x7fbddc1f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbdbc0732b0 0x7fbdbc075770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 --2- 172.21.15.114:0/1223461425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbddc0afca0 0x7fbddc14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 >> 172.21.15.114:0/1223461425 conn(0x7fbddc0d1e30 msgr2=0x7fbddc0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 shutdown_connections 2024-09-16T07:33:51.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.474+0000 7fbde2200640 1 -- 172.21.15.114:0/1223461425 wait complete. 2024-09-16T07:33:51.491 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:33:51.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:51.492 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:33:51.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:33:51.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:33:51.518 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:33:51.567 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:51.568 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:33:51.568 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:51.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:33:51.577 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:33:51.577 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:33:51.577 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:33:51.623 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:33:51.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.766+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3497229975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29fc004d50 msgr2=0x7f29fc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.766+0000 7f2a1ca00640 1 --2- 172.21.15.114:0/3497229975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29fc004d50 0x7f29fc0051d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009e90 tx=0x7f2a1001d5b0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.766+0000 7f2a17e00640 1 -- 172.21.15.114:0/3497229975 reap_dead start 2024-09-16T07:33:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.766+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3497229975 shutdown_connections 2024-09-16T07:33:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.766+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3497229975 >> 172.21.15.114:0/3497229975 conn(0x7f2a1806dd30 msgr2=0x7f2a1806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.766+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3497229975 shutdown_connections 2024-09-16T07:33:51.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.766+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3497229975 wait complete. 2024-09-16T07:33:51.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 Processor -- start 2024-09-16T07:33:51.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 -- start start 2024-09-16T07:33:51.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29fc004d50 0x7f2a181f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a180c5c70 0x7f2a180c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a180c9fb0 0x7f2a180ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18163b50 con 0x7f2a180c9fb0 2024-09-16T07:33:51.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18163cd0 con 0x7f29fc004d50 2024-09-16T07:33:51.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a18163e50 con 0x7f2a180c5c70 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a180c9fb0 0x7f2a180ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29fc004d50 0x7f2a181f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a180c9fb0 0x7f2a180ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45832/0 (socket says 172.21.15.114:45832) 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a0fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a180c5c70 0x7f2a180c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 -- 172.21.15.114:0/3781215646 learned_addr learned my addr 172.21.15.114:0/3781215646 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 -- 172.21.15.114:0/3781215646 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a180c5c70 msgr2=0x7f2a180c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a180c5c70 0x7f2a180c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 -- 172.21.15.114:0/3781215646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29fc004d50 msgr2=0x7f2a181f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29fc004d50 0x7f2a181f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 -- 172.21.15.114:0/3781215646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a180c4a10 con 0x7f2a180c9fb0 2024-09-16T07:33:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a17e00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a180c9fb0 0x7f2a180ca430 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2a1001d020 tx=0x7f2a10004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a0f400640 1 -- 172.21.15.114:0/3781215646 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10009a90 con 0x7f2a180c9fb0 2024-09-16T07:33:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a0f400640 1 -- 172.21.15.114:0/3781215646 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a100a94f0 con 0x7f2a180c9fb0 2024-09-16T07:33:51.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a0f400640 1 -- 172.21.15.114:0/3781215646 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a100a9b00 con 0x7f2a180c9fb0 2024-09-16T07:33:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a180c4cf0 con 0x7f2a180c9fb0 2024-09-16T07:33:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a180c52b0 con 0x7f2a180c9fb0 2024-09-16T07:33:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.770+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a180cbf10 con 0x7f2a180c9fb0 2024-09-16T07:33:51.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.774+0000 7f2a0f400640 1 -- 172.21.15.114:0/3781215646 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) ==== 97437+0+0 (secure 0 0 0) 0x7f2a100a9ca0 con 0x7f2a180c9fb0 2024-09-16T07:33:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.774+0000 7f2a0f400640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29f40732b0 0x7f29f4075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.774+0000 7f2a0f400640 1 -- 172.21.15.114:0/3781215646 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f2a1012f650 con 0x7f2a180c9fb0 2024-09-16T07:33:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.774+0000 7f2a17400640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29f40732b0 0x7f29f4075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:51.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.774+0000 7f2a17400640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29f40732b0 0x7f29f4075770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a180b1a40 tx=0x7f2a08006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:51.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.778+0000 7f2a0f400640 1 -- 172.21.15.114:0/3781215646 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2a100ad070 con 0x7f2a180c9fb0 2024-09-16T07:33:51.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.986+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a180b0340 con 0x7f2a180c9fb0 2024-09-16T07:33:51.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a0f400640 1 -- 172.21.15.114:0/3781215646 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5234 (secure 0 0 0) 0x7f2a100172c0 con 0x7f2a180c9fb0 2024-09-16T07:33:51.987 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:51.987 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":73,"btime":"2024-09-16T07:33:25:879532+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1374083886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1374083886},{"type":"v1","addr":"172.21.15.149:6835","nonce":1374083886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/320868897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":320868897},{"type":"v1","addr":"172.21.15.149:6801","nonce":320868897}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1288852592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1288852592},{"type":"v1","addr":"172.21.15.114:6834","nonce":1288852592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:33:16.201708+0000","modified":"2024-09-16T07:33:19.219727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/3128573512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3128573512},{"type":"v1","addr":"172.21.15.114:6835","nonce":3128573512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6984,"qdb_cluster":[6984]},"id":8}]} 2024-09-16T07:33:51.987 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 73 2024-09-16T07:33:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29f40732b0 msgr2=0x7f29f4075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29f40732b0 0x7f29f4075770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a180b1a40 tx=0x7f2a08006b20 comp rx=0 tx=0).stop 2024-09-16T07:33:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a180c9fb0 msgr2=0x7f2a180ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a180c9fb0 0x7f2a180ca430 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2a1001d020 tx=0x7f2a10004f10 comp rx=0 tx=0).stop 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 shutdown_connections 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a180c9fb0 0x7f2a180ca430 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29f40732b0 0x7f29f4075770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a180c5c70 0x7f2a180c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 --2- 172.21.15.114:0/3781215646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29fc004d50 0x7f2a181f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 >> 172.21.15.114:0/3781215646 conn(0x7f2a1806dd30 msgr2=0x7f2a180b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 shutdown_connections 2024-09-16T07:33:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:51.990+0000 7f2a1ca00640 1 -- 172.21.15.114:0/3781215646 wait complete. 2024-09-16T07:33:52.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 -- 172.21.15.114:0/2561143612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 msgr2=0x7f7e8406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 --2- 172.21.15.114:0/2561143612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 0x7f7e8406fca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400a950 tx=0x7f7e7401dae0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 -- 172.21.15.114:0/2561143612 shutdown_connections 2024-09-16T07:33:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 --2- 172.21.15.114:0/2561143612 >> v2:172.21.15.149:3300/0 conn(0x7f7e840cc740 0x7f7e840ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 --2- 172.21.15.114:0/2561143612 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 0x7f7e8406fca0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 -- 172.21.15.114:0/2561143612 >> 172.21.15.114:0/2561143612 conn(0x7f7e840b18f0 msgr2=0x7f7e840b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 -- 172.21.15.114:0/2561143612 shutdown_connections 2024-09-16T07:33:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 -- 172.21.15.114:0/2561143612 wait complete. 2024-09-16T07:33:52.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.150+0000 7f7e88e00640 1 Processor -- start 2024-09-16T07:33:52.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 -- start start 2024-09-16T07:33:52.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8406e7a0 0x7f7e8413c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 0x7f7e841556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e840cc740 0x7f7e84073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84167970 con 0x7f7e840cc740 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841677f0 con 0x7f7e8406e7a0 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7e84167af0 con 0x7f7e8406f8c0 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e840cc740 0x7f7e84073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e840cc740 0x7f7e84073bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45836/0 (socket says 172.21.15.114:45836) 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 -- 172.21.15.114:0/1715691991 learned_addr learned my addr 172.21.15.114:0/1715691991 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e79400640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 0x7f7e841556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e81e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8406e7a0 0x7f7e8413c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 -- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 msgr2=0x7f7e841556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 0x7f7e841556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 -- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8406e7a0 msgr2=0x7f7e8413c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8406e7a0 0x7f7e8413c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 -- 172.21.15.114:0/1715691991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e84072870 con 0x7f7e840cc740 2024-09-16T07:33:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e82800640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e840cc740 0x7f7e84073bf0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00caa0 tx=0x7f7e7c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e7aa00640 1 -- 172.21.15.114:0/1715691991 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c016020 con 0x7f7e840cc740 2024-09-16T07:33:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e84072b50 con 0x7f7e840cc740 2024-09-16T07:33:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e84073110 con 0x7f7e840cc740 2024-09-16T07:33:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e7aa00640 1 -- 172.21.15.114:0/1715691991 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e7c00a7e0 con 0x7f7e840cc740 2024-09-16T07:33:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e7aa00640 1 -- 172.21.15.114:0/1715691991 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c00ac10 con 0x7f7e840cc740 2024-09-16T07:33:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.154+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e840ccb80 con 0x7f7e840cc740 2024-09-16T07:33:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.158+0000 7f7e7aa00640 1 -- 172.21.15.114:0/1715691991 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 21) ==== 97437+0+0 (secure 0 0 0) 0x7f7e7c019020 con 0x7f7e840cc740 2024-09-16T07:33:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.158+0000 7f7e7aa00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e600732b0 0x7f7e60075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.158+0000 7f7e7aa00640 1 -- 172.21.15.114:0/1715691991 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f7e7c094970 con 0x7f7e840cc740 2024-09-16T07:33:52.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.158+0000 7f7e81e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e600732b0 0x7f7e60075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.158+0000 7f7e81e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e600732b0 0x7f7e60075770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e740b0000 tx=0x7f7e7401c320 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.162+0000 7f7e7aa00640 1 -- 172.21.15.114:0/1715691991 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7e7c020020 con 0x7f7e840cc740 2024-09-16T07:33:52.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.366+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e8413c610 con 0x7f7e840cc740 2024-09-16T07:33:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.366+0000 7f7e7aa00640 1 -- 172.21.15.114:0/1715691991 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5234 (secure 0 0 0) 0x7f7e7c05ee90 con 0x7f7e840cc740 2024-09-16T07:33:52.365 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:52.365 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":73,"btime":"2024-09-16T07:33:25:879532+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1374083886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1374083886},{"type":"v1","addr":"172.21.15.149:6835","nonce":1374083886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/320868897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":320868897},{"type":"v1","addr":"172.21.15.149:6801","nonce":320868897}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1288852592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1288852592},{"type":"v1","addr":"172.21.15.114:6834","nonce":1288852592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:33:16.201708+0000","modified":"2024-09-16T07:33:19.219727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/3128573512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3128573512},{"type":"v1","addr":"172.21.15.114:6835","nonce":3128573512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6984,"qdb_cluster":[6984]},"id":8}]} 2024-09-16T07:33:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 73 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e600732b0 msgr2=0x7f7e60075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e600732b0 0x7f7e60075770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e740b0000 tx=0x7f7e7401c320 comp rx=0 tx=0).stop 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e840cc740 msgr2=0x7f7e84073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e840cc740 0x7f7e84073bf0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00caa0 tx=0x7f7e7c00cb90 comp rx=0 tx=0).stop 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 shutdown_connections 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7e840cc740 0x7f7e84073bf0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e600732b0 0x7f7e60075770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7e8406f8c0 0x7f7e841556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 --2- 172.21.15.114:0/1715691991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8406e7a0 0x7f7e8413c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 >> 172.21.15.114:0/1715691991 conn(0x7f7e840b18f0 msgr2=0x7f7e840b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 shutdown_connections 2024-09-16T07:33:52.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.370+0000 7f7e88e00640 1 -- 172.21.15.114:0/1715691991 wait complete. 2024-09-16T07:33:52.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:52.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 -- 172.21.15.114:0/3599279821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac06cc20 msgr2=0x7fc6ac06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 --2- 172.21.15.114:0/3599279821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac06cc20 0x7fc6ac06d090 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009c80 tx=0x7fc6a401cd70 comp rx=0 tx=0).stop 2024-09-16T07:33:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 -- 172.21.15.114:0/3599279821 shutdown_connections 2024-09-16T07:33:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 --2- 172.21.15.114:0/3599279821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac06cc20 0x7fc6ac06d090 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 --2- 172.21.15.114:0/3599279821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac15bc70 0x7fc6ac0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 -- 172.21.15.114:0/3599279821 >> 172.21.15.114:0/3599279821 conn(0x7fc6ac06dd30 msgr2=0x7fc6ac06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 -- 172.21.15.114:0/3599279821 shutdown_connections 2024-09-16T07:33:52.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.538+0000 7fc6b1800640 1 -- 172.21.15.114:0/3599279821 wait complete. 2024-09-16T07:33:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 Processor -- start 2024-09-16T07:33:52.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 -- start start 2024-09-16T07:33:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac06cc20 0x7fc6ac1f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac15b890 0x7fc6ac15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac15bc70 0x7fc6ac15f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac1687a0 con 0x7fc6ac15b890 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0746c0 con 0x7fc6ac15bc70 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac168920 con 0x7fc6ac06cc20 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac15b890 0x7fc6ac15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac15b890 0x7fc6ac15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45848/0 (socket says 172.21.15.114:45848) 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 -- 172.21.15.114:0/2530092809 learned_addr learned my addr 172.21.15.114:0/2530092809 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b0e00640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac15bc70 0x7fc6ac15f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6abe00640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac06cc20 0x7fc6ac1f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 -- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac06cc20 msgr2=0x7fc6ac1f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac06cc20 0x7fc6ac1f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 -- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac15bc70 msgr2=0x7fc6ac15f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac15bc70 0x7fc6ac15f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 -- 172.21.15.114:0/2530092809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac15c780 con 0x7fc6ac15b890 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a3400640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac15b890 0x7fc6ac15eb10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc69400e9f0 tx=0x7fc69400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a8c00640 1 -- 172.21.15.114:0/2530092809 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69400ccc0 con 0x7fc6ac15b890 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a8c00640 1 -- 172.21.15.114:0/2530092809 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc694010430 con 0x7fc6ac15b890 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6a8c00640 1 -- 172.21.15.114:0/2530092809 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694010880 con 0x7fc6ac15b890 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac156fb0 con 0x7fc6ac15b890 2024-09-16T07:33:52.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.542+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac0cb4c0 con 0x7fc6ac15b890 2024-09-16T07:33:52.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.546+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac06d090 con 0x7fc6ac15b890 2024-09-16T07:33:52.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.546+0000 7fc6a8c00640 1 -- 172.21.15.114:0/2530092809 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fc694010a20 con 0x7fc6ac15b890 2024-09-16T07:33:52.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.546+0000 7fc6a8c00640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc688073340 0x7fc688075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.546+0000 7fc6a8c00640 1 -- 172.21.15.114:0/2530092809 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5823+0+0 (secure 0 0 0) 0x7fc694095180 con 0x7fc6ac15b890 2024-09-16T07:33:52.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.546+0000 7fc6abe00640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc688073340 0x7fc688075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.546+0000 7fc6abe00640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc688073340 0x7fc688075800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc69c000f70 tx=0x7fc69c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.550+0000 7fc6a8c00640 1 -- 172.21.15.114:0/2530092809 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc69405f5d0 con 0x7fc6ac15b890 2024-09-16T07:33:52.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.726+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6ac0cbfd0 con 0x7fc6ac15b890 2024-09-16T07:33:52.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.726+0000 7fc6a8c00640 1 -- 172.21.15.114:0/2530092809 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16933 (secure 0 0 0) 0x7fc694064000 con 0x7fc6ac15b890 2024-09-16T07:33:52.726 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:52.727 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":102,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:52.479179+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:33:13.921061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-16T07:33:15.169498+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.18","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc688073340 msgr2=0x7fc688075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc688073340 0x7fc688075800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc69c000f70 tx=0x7fc69c009040 comp rx=0 tx=0).stop 2024-09-16T07:33:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac15b890 msgr2=0x7fc6ac15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac15b890 0x7fc6ac15eb10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc69400e9f0 tx=0x7fc69400eeb0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 shutdown_connections 2024-09-16T07:33:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc6ac15bc70 0x7fc6ac15f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6ac15b890 0x7fc6ac15eb10 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc688073340 0x7fc688075800 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 --2- 172.21.15.114:0/2530092809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc6ac06cc20 0x7fc6ac1f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 >> 172.21.15.114:0/2530092809 conn(0x7fc6ac06dd30 msgr2=0x7fc6ac15aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 shutdown_connections 2024-09-16T07:33:52.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.730+0000 7fc6b1800640 1 -- 172.21.15.114:0/2530092809 wait complete. 2024-09-16T07:33:52.747 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:33:52.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:52.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 -- 172.21.15.114:0/685284295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415bd50 msgr2=0x7f8f940ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 --2- 172.21.15.114:0/685284295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415bd50 0x7f8f940ce5e0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f8f940d0a60 tx=0x7f8f8401c780 comp rx=0 tx=0).stop 2024-09-16T07:33:52.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 -- 172.21.15.114:0/685284295 shutdown_connections 2024-09-16T07:33:52.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 --2- 172.21.15.114:0/685284295 >> v2:172.21.15.149:3300/0 conn(0x7f8f940cf4e0 0x7f8f940c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 --2- 172.21.15.114:0/685284295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9415c130 0x7f8f940ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 --2- 172.21.15.114:0/685284295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415bd50 0x7f8f940ce5e0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 -- 172.21.15.114:0/685284295 >> 172.21.15.114:0/685284295 conn(0x7f8f940d1ea0 msgr2=0x7f8f940d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:52.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 -- 172.21.15.114:0/685284295 shutdown_connections 2024-09-16T07:33:52.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.890+0000 7f8f98a00640 1 -- 172.21.15.114:0/685284295 wait complete. 2024-09-16T07:33:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 Processor -- start 2024-09-16T07:33:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 -- start start 2024-09-16T07:33:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f940cf4e0 0x7f8f9415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9415bd50 0x7f8f94152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415c130 0x7f8f94152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f940ccac0 con 0x7f8f9415c130 2024-09-16T07:33:52.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f940cc940 con 0x7f8f9415bd50 2024-09-16T07:33:52.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8f940ccc40 con 0x7f8f940cf4e0 2024-09-16T07:33:52.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415c130 0x7f8f94152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415c130 0x7f8f94152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45872/0 (socket says 172.21.15.114:45872) 2024-09-16T07:33:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 -- 172.21.15.114:0/1494223447 learned_addr learned my addr 172.21.15.114:0/1494223447 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f91e00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f940cf4e0 0x7f8f9415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f91400640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9415bd50 0x7f8f94152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 -- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f940cf4e0 msgr2=0x7f8f9415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f940cf4e0 0x7f8f9415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 -- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9415bd50 msgr2=0x7f8f94152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9415bd50 0x7f8f94152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 -- 172.21.15.114:0/1494223447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f94154090 con 0x7f8f9415c130 2024-09-16T07:33:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f92800640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415c130 0x7f8f94152980 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00e990 tx=0x7f8f8c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f8a000640 1 -- 172.21.15.114:0/1494223447 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c004d30 con 0x7f8f9415c130 2024-09-16T07:33:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f8a000640 1 -- 172.21.15.114:0/1494223447 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f8c00cb00 con 0x7f8f9415c130 2024-09-16T07:33:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f94154370 con 0x7f8f9415c130 2024-09-16T07:33:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f8a000640 1 -- 172.21.15.114:0/1494223447 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c005020 con 0x7f8f9415c130 2024-09-16T07:33:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.894+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f94157650 con 0x7f8f9415c130 2024-09-16T07:33:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.898+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f940c5dd0 con 0x7f8f9415c130 2024-09-16T07:33:52.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.898+0000 7f8f8a000640 1 -- 172.21.15.114:0/1494223447 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f8f8c0051c0 con 0x7f8f9415c130 2024-09-16T07:33:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.898+0000 7f8f8a000640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f74073340 0x7f8f74075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.898+0000 7f8f8a000640 1 -- 172.21.15.114:0/1494223447 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5823+0+0 (secure 0 0 0) 0x7f8f8c094fe0 con 0x7f8f9415c130 2024-09-16T07:33:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.898+0000 7f8f91e00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f74073340 0x7f8f74075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.898+0000 7f8f91e00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f74073340 0x7f8f74075800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f840af000 tx=0x7f8f8401afc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:52.902+0000 7f8f8a000640 1 -- 172.21.15.114:0/1494223447 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8f8c016030 con 0x7f8f9415c130 2024-09-16T07:33:53.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f94154540 con 0x7f8f9415c130 2024-09-16T07:33:53.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f8a000640 1 -- 172.21.15.114:0/1494223447 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5234 (secure 0 0 0) 0x7f8f8c05f430 con 0x7f8f9415c130 2024-09-16T07:33:53.116 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:53.116 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":73,"btime":"2024-09-16T07:33:25:879532+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1374083886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1374083886},{"type":"v1","addr":"172.21.15.149:6835","nonce":1374083886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/320868897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":320868897},{"type":"v1","addr":"172.21.15.149:6801","nonce":320868897}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1288852592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1288852592},{"type":"v1","addr":"172.21.15.114:6834","nonce":1288852592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:33:16.201708+0000","modified":"2024-09-16T07:33:19.219727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/3128573512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3128573512},{"type":"v1","addr":"172.21.15.114:6835","nonce":3128573512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6984,"qdb_cluster":[6984]},"id":8}]} 2024-09-16T07:33:53.116 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 73 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f74073340 msgr2=0x7f8f74075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f74073340 0x7f8f74075800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f840af000 tx=0x7f8f8401afc0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415c130 msgr2=0x7f8f94152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415c130 0x7f8f94152980 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00e990 tx=0x7f8f8c00ee50 comp rx=0 tx=0).stop 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 shutdown_connections 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f9415c130 0x7f8f94152980 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f9415bd50 0x7f8f94152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8f74073340 0x7f8f74075800 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 --2- 172.21.15.114:0/1494223447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f940cf4e0 0x7f8f9415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 >> 172.21.15.114:0/1494223447 conn(0x7f8f940d1ea0 msgr2=0x7f8f940c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:53.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 shutdown_connections 2024-09-16T07:33:53.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.118+0000 7f8f98a00640 1 -- 172.21.15.114:0/1494223447 wait complete. 2024-09-16T07:33:53.138 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 -- 172.21.15.114:0/1824726339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc40d28c0 msgr2=0x7febc40cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 --2- 172.21.15.114:0/1824726339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc40d28c0 0x7febc40cea20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7febb0009840 tx=0x7febb001c820 comp rx=0 tx=0).stop 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 -- 172.21.15.114:0/1824726339 shutdown_connections 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 --2- 172.21.15.114:0/1824726339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc40d28c0 0x7febc40cea20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 --2- 172.21.15.114:0/1824726339 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc415be80 0x7febc40ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 -- 172.21.15.114:0/1824726339 >> 172.21.15.114:0/1824726339 conn(0x7febc40d1da0 msgr2=0x7febc40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 -- 172.21.15.114:0/1824726339 shutdown_connections 2024-09-16T07:33:53.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.278+0000 7febcbc00640 1 -- 172.21.15.114:0/1824726339 wait complete. 2024-09-16T07:33:53.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 Processor -- start 2024-09-16T07:33:53.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 -- start start 2024-09-16T07:33:53.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc40b53f0 0x7febc4153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40d28c0 0x7febc40c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415be80 0x7febc40c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7febc4169160 con 0x7febc40d28c0 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7febc4168fe0 con 0x7febc415be80 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7febc41692e0 con 0x7febc40b53f0 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40d28c0 0x7febc40c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40d28c0 0x7febc40c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45884/0 (socket says 172.21.15.114:45884) 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 -- 172.21.15.114:0/18513830 learned_addr learned my addr 172.21.15.114:0/18513830 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc9200640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc40b53f0 0x7febc4153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc9c00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415be80 0x7febc40c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 -- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc40b53f0 msgr2=0x7febc4153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc40b53f0 0x7febc4153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 -- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415be80 msgr2=0x7febc40c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415be80 0x7febc40c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 -- 172.21.15.114:0/18513830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc40c98c0 con 0x7febc40d28c0 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc9c00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415be80 0x7febc40c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc3e00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40d28c0 0x7febc40c5890 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7febb0009790 tx=0x7febb00a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc0c00640 1 -- 172.21.15.114:0/18513830 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00bf020 con 0x7febc40d28c0 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc0c00640 1 -- 172.21.15.114:0/18513830 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febb00043b0 con 0x7febc40d28c0 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febc0c00640 1 -- 172.21.15.114:0/18513830 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0005280 con 0x7febc40d28c0 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc40c9ba0 con 0x7febc40d28c0 2024-09-16T07:33:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.282+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc4153a80 con 0x7febc40d28c0 2024-09-16T07:33:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.286+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc40b5880 con 0x7febc40d28c0 2024-09-16T07:33:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.286+0000 7febc0c00640 1 -- 172.21.15.114:0/18513830 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7febb00c2070 con 0x7febc40d28c0 2024-09-16T07:33:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.286+0000 7febc0c00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073340 0x7feba4075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.286+0000 7febc0c00640 1 -- 172.21.15.114:0/18513830 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5823+0+0 (secure 0 0 0) 0x7febb012ecb0 con 0x7febc40d28c0 2024-09-16T07:33:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.286+0000 7febc9200640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073340 0x7feba4075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.286+0000 7febc9200640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073340 0x7feba4075800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febc40b2350 tx=0x7febb4009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.290+0000 7febc0c00640 1 -- 172.21.15.114:0/18513830 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7febb0016410 con 0x7febc40d28c0 2024-09-16T07:33:53.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.494+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febc41597e0 con 0x7febc40d28c0 2024-09-16T07:33:53.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.494+0000 7febc0c00640 1 -- 172.21.15.114:0/18513830 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5234 (secure 0 0 0) 0x7febb00f9150 con 0x7febc40d28c0 2024-09-16T07:33:53.494 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:53.494 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":73,"btime":"2024-09-16T07:33:25:879532+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1374083886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1374083886},{"type":"v1","addr":"172.21.15.149:6835","nonce":1374083886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/320868897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":320868897},{"type":"v1","addr":"172.21.15.149:6801","nonce":320868897}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1288852592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1288852592},{"type":"v1","addr":"172.21.15.114:6834","nonce":1288852592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:33:16.201708+0000","modified":"2024-09-16T07:33:19.219727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6984},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6984":{"gid":6984,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/3128573512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":3128573512},{"type":"v1","addr":"172.21.15.114:6835","nonce":3128573512}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6984,"qdb_cluster":[6984]},"id":8}]} 2024-09-16T07:33:53.495 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 73 2024-09-16T07:33:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073340 msgr2=0x7feba4075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073340 0x7feba4075800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febc40b2350 tx=0x7febb4009260 comp rx=0 tx=0).stop 2024-09-16T07:33:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40d28c0 msgr2=0x7febc40c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40d28c0 0x7febc40c5890 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7febb0009790 tx=0x7febb00a66d0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 shutdown_connections 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7febc415be80 0x7febc40c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc40d28c0 0x7febc40c5890 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feba4073340 0x7feba4075800 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 --2- 172.21.15.114:0/18513830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7febc40b53f0 0x7febc4153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 >> 172.21.15.114:0/18513830 conn(0x7febc40d1da0 msgr2=0x7febc4155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 shutdown_connections 2024-09-16T07:33:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.498+0000 7febcbc00640 1 -- 172.21.15.114:0/18513830 wait complete. 2024-09-16T07:33:53.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:53.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.662+0000 7fb856e00640 1 -- 172.21.15.114:0/515018331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb838003a10 msgr2=0x7fb838003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.662+0000 7fb856e00640 1 --2- 172.21.15.114:0/515018331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb838003a10 0x7fb838003e30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb84400c310 tx=0x7fb84401f720 comp rx=0 tx=0).stop 2024-09-16T07:33:53.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.662+0000 7fb856400640 1 -- 172.21.15.114:0/515018331 reap_dead start 2024-09-16T07:33:53.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.662+0000 7fb856e00640 1 -- 172.21.15.114:0/515018331 shutdown_connections 2024-09-16T07:33:53.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.662+0000 7fb856e00640 1 -- 172.21.15.114:0/515018331 >> 172.21.15.114:0/515018331 conn(0x7fb85009aa10 msgr2=0x7fb85009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.662+0000 7fb856e00640 1 -- 172.21.15.114:0/515018331 shutdown_connections 2024-09-16T07:33:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.662+0000 7fb856e00640 1 -- 172.21.15.114:0/515018331 wait complete. 2024-09-16T07:33:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 Processor -- start 2024-09-16T07:33:53.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 -- start start 2024-09-16T07:33:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb838003a10 0x7fb8500c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb85015c630 0x7fb8500cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb85009bb20 0x7fb8500c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb8500cf130 con 0x7fb85015c630 2024-09-16T07:33:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8500cefb0 con 0x7fb838003a10 2024-09-16T07:33:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8500cf2b0 con 0x7fb85009bb20 2024-09-16T07:33:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb85015c630 0x7fb8500cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb85015c630 0x7fb8500cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45898/0 (socket says 172.21.15.114:45898) 2024-09-16T07:33:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 -- 172.21.15.114:0/2429137672 learned_addr learned my addr 172.21.15.114:0/2429137672 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856400640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb85009bb20 0x7fb8500c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855a00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb838003a10 0x7fb8500c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 -- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb85009bb20 msgr2=0x7fb8500c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb85009bb20 0x7fb8500c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 -- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb838003a10 msgr2=0x7fb8500c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb838003a10 0x7fb8500c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 -- 172.21.15.114:0/2429137672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8500c5500 con 0x7fb85015c630 2024-09-16T07:33:53.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856400640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb85009bb20 0x7fb8500c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:53.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb855000640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb85015c630 0x7fb8500cac20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb83c011a80 tx=0x7fb83c011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:53.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb84d600640 1 -- 172.21.15.114:0/2429137672 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c004250 con 0x7fb85015c630 2024-09-16T07:33:53.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb84d600640 1 -- 172.21.15.114:0/2429137672 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb83c0044e0 con 0x7fb85015c630 2024-09-16T07:33:53.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8500cb160 con 0x7fb85015c630 2024-09-16T07:33:53.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb84d600640 1 -- 172.21.15.114:0/2429137672 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c003840 con 0x7fb85015c630 2024-09-16T07:33:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.666+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8500c9120 con 0x7fb85015c630 2024-09-16T07:33:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.670+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8500b2a00 con 0x7fb85015c630 2024-09-16T07:33:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.670+0000 7fb84d600640 1 -- 172.21.15.114:0/2429137672 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fb83c0039e0 con 0x7fb85015c630 2024-09-16T07:33:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.670+0000 7fb84d600640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb830073370 0x7fb830075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.670+0000 7fb84d600640 1 -- 172.21.15.114:0/2429137672 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5823+0+0 (secure 0 0 0) 0x7fb83c095670 con 0x7fb85015c630 2024-09-16T07:33:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.670+0000 7fb855a00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb830073370 0x7fb830075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.670+0000 7fb855a00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb830073370 0x7fb830075830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8440b0000 tx=0x7fb84401c560 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:53.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.674+0000 7fb84d600640 1 -- 172.21.15.114:0/2429137672 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb8500cb160 con 0x7fb85015c630 2024-09-16T07:33:53.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.842+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb85015cab0 con 0x7fb85015c630 2024-09-16T07:33:53.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb84d600640 1 -- 172.21.15.114:0/2429137672 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16933 (secure 0 0 0) 0x7fb83c0600d0 con 0x7fb85015c630 2024-09-16T07:33:53.843 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:53.843 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":102,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:52.479179+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:33:13.921061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-16T07:33:15.169498+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.18","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb830073370 msgr2=0x7fb830075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb830073370 0x7fb830075830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8440b0000 tx=0x7fb84401c560 comp rx=0 tx=0).stop 2024-09-16T07:33:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb85015c630 msgr2=0x7fb8500cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb85015c630 0x7fb8500cac20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb83c011a80 tx=0x7fb83c011f40 comp rx=0 tx=0).stop 2024-09-16T07:33:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 shutdown_connections 2024-09-16T07:33:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb830073370 0x7fb830075830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb85009bb20 0x7fb8500c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb85015c630 0x7fb8500cac20 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 --2- 172.21.15.114:0/2429137672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb838003a10 0x7fb8500c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 >> 172.21.15.114:0/2429137672 conn(0x7fb85009aa10 msgr2=0x7fb8500ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 shutdown_connections 2024-09-16T07:33:53.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:53.846+0000 7fb856e00640 1 -- 172.21.15.114:0/2429137672 wait complete. 2024-09-16T07:33:53.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:33:54.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- 172.21.15.114:0/3224648618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b40cebf0 msgr2=0x7fd9b40cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 --2- 172.21.15.114:0/3224648618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b40cebf0 0x7fd9b40cc8b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009840 tx=0x7fd9a001c820 comp rx=0 tx=0).stop 2024-09-16T07:33:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- 172.21.15.114:0/3224648618 shutdown_connections 2024-09-16T07:33:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 --2- 172.21.15.114:0/3224648618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40b6400 0x7fd9b40ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 --2- 172.21.15.114:0/3224648618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b40cebf0 0x7fd9b40cc8b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- 172.21.15.114:0/3224648618 >> 172.21.15.114:0/3224648618 conn(0x7fd9b40d1da0 msgr2=0x7fd9b40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- 172.21.15.114:0/3224648618 shutdown_connections 2024-09-16T07:33:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- 172.21.15.114:0/3224648618 wait complete. 2024-09-16T07:33:54.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 Processor -- start 2024-09-16T07:33:54.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- start start 2024-09-16T07:33:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40b6400 0x7fd9b41525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b40cebf0 0x7fd9b4156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b415be80 0x7fd9b4156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b41692b0 con 0x7fd9b40cebf0 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4169130 con 0x7fd9b415be80 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b9600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b4169430 con 0x7fd9b40b6400 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b40cebf0 0x7fd9b4156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b40cebf0 0x7fd9b4156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45914/0 (socket says 172.21.15.114:45914) 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 -- 172.21.15.114:0/1937877993 learned_addr learned my addr 172.21.15.114:0/1937877993 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b3400640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b415be80 0x7fd9b4156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2a00640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40b6400 0x7fd9b41525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 -- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40b6400 msgr2=0x7fd9b41525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40b6400 0x7fd9b41525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 -- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b415be80 msgr2=0x7fd9b4156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b415be80 0x7fd9b4156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.010+0000 7fd9b2000640 1 -- 172.21.15.114:0/1937877993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b4152ae0 con 0x7fd9b40cebf0 2024-09-16T07:33:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9b2000640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b40cebf0 0x7fd9b4156200 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009790 tx=0x7fd9a00a5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9aaa00640 1 -- 172.21.15.114:0/1937877993 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00ba020 con 0x7fd9b40cebf0 2024-09-16T07:33:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9aaa00640 1 -- 172.21.15.114:0/1937877993 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9a0004430 con 0x7fd9b40cebf0 2024-09-16T07:33:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b4152d80 con 0x7fd9b40cebf0 2024-09-16T07:33:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9aaa00640 1 -- 172.21.15.114:0/1937877993 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00b2040 con 0x7fd9b40cebf0 2024-09-16T07:33:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b4153340 con 0x7fd9b40cebf0 2024-09-16T07:33:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b40ce4e0 con 0x7fd9b40cebf0 2024-09-16T07:33:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9aaa00640 1 -- 172.21.15.114:0/1937877993 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fd9a0005280 con 0x7fd9b40cebf0 2024-09-16T07:33:54.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9aaa00640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd994073340 0x7fd994075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9aaa00640 1 -- 172.21.15.114:0/1937877993 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5823+0+0 (secure 0 0 0) 0x7fd9a012e6b0 con 0x7fd9b40cebf0 2024-09-16T07:33:54.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.014+0000 7fd9b2a00640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd994073340 0x7fd994075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.018+0000 7fd9b2a00640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd994073340 0x7fd994075800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40046c0 tx=0x7fd9a4007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:54.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.018+0000 7fd9aaa00640 1 -- 172.21.15.114:0/1937877993 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd9a00c4020 con 0x7fd9b40cebf0 2024-09-16T07:33:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.218+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd9b40b45d0 con 0x7fd9b40cebf0 2024-09-16T07:33:54.219 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:33:54.222+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:33:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.222+0000 7fd9aaa00640 1 -- 172.21.15.114:0/1937877993 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) ==== 161+0+0 (secure 0 0 0) 0x7fd9a0016410 con 0x7fd9b40cebf0 2024-09-16T07:33:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd994073340 msgr2=0x7fd994075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd994073340 0x7fd994075800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40046c0 tx=0x7fd9a4007ec0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b40cebf0 msgr2=0x7fd9b4156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b40cebf0 0x7fd9b4156200 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009790 tx=0x7fd9a00a5700 comp rx=0 tx=0).stop 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 shutdown_connections 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9b415be80 0x7fd9b4156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9b40cebf0 0x7fd9b4156200 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd994073340 0x7fd994075800 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 --2- 172.21.15.114:0/1937877993 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9b40b6400 0x7fd9b41525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 >> 172.21.15.114:0/1937877993 conn(0x7fd9b40d1da0 msgr2=0x7fd9b40c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 shutdown_connections 2024-09-16T07:33:54.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.226+0000 7fd9b9600640 1 -- 172.21.15.114:0/1937877993 wait complete. 2024-09-16T07:33:54.245 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:33:54.290 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:33:54.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 -- 172.21.15.114:0/2948210982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0af220 msgr2=0x7f96ec15ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 --2- 172.21.15.114:0/2948210982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0af220 0x7f96ec15ef00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f96ec06e140 tx=0x7f96d801c830 comp rx=0 tx=0).stop 2024-09-16T07:33:54.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 -- 172.21.15.114:0/2948210982 shutdown_connections 2024-09-16T07:33:54.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 --2- 172.21.15.114:0/2948210982 >> v2:172.21.15.149:3300/0 conn(0x7f96ec0cddd0 0x7f96ec0ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 --2- 172.21.15.114:0/2948210982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0af220 0x7f96ec15ef00 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 -- 172.21.15.114:0/2948210982 >> 172.21.15.114:0/2948210982 conn(0x7f96ec0cfc20 msgr2=0x7f96ec0d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:54.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 -- 172.21.15.114:0/2948210982 shutdown_connections 2024-09-16T07:33:54.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 -- 172.21.15.114:0/2948210982 wait complete. 2024-09-16T07:33:54.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 Processor -- start 2024-09-16T07:33:54.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.394+0000 7f96f4000640 1 -- start start 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96ec06fea0 0x7f96ec15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96ec0af220 0x7f96ec157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0cddd0 0x7f96ec0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec168370 con 0x7f96ec0cddd0 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1681f0 con 0x7f96ec06fea0 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec1684f0 con 0x7f96ec0af220 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0cddd0 0x7f96ec0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0cddd0 0x7f96ec0b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36760/0 (socket says 172.21.15.114:36760) 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 -- 172.21.15.114:0/1426106865 learned_addr learned my addr 172.21.15.114:0/1426106865 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f0c00640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96ec0af220 0x7f96ec157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f1600640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96ec06fea0 0x7f96ec15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 -- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96ec0af220 msgr2=0x7f96ec157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96ec0af220 0x7f96ec157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 -- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96ec06fea0 msgr2=0x7f96ec15e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96ec06fea0 0x7f96ec15e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 -- 172.21.15.114:0/1426106865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec15ed40 con 0x7f96ec0cddd0 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f1600640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96ec06fea0 0x7f96ec15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f2000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0cddd0 0x7f96ec0b4ef0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f96e400ea20 tx=0x7f96e400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96e9600640 1 -- 172.21.15.114:0/1426106865 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e400cde0 con 0x7f96ec0cddd0 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96e9600640 1 -- 172.21.15.114:0/1426106865 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96e4004c40 con 0x7f96ec0cddd0 2024-09-16T07:33:54.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec1585c0 con 0x7f96ec0cddd0 2024-09-16T07:33:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96e9600640 1 -- 172.21.15.114:0/1426106865 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4005280 con 0x7f96ec0cddd0 2024-09-16T07:33:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec158b80 con 0x7f96ec0cddd0 2024-09-16T07:33:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec0ca270 con 0x7f96ec0cddd0 2024-09-16T07:33:54.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.398+0000 7f96e9600640 1 -- 172.21.15.114:0/1426106865 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f96e4005420 con 0x7f96ec0cddd0 2024-09-16T07:33:54.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.402+0000 7f96e9600640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f96cc073340 0x7f96cc075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:54.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.402+0000 7f96e9600640 1 -- 172.21.15.114:0/1426106865 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5881+0+0 (secure 0 0 0) 0x7f96e4095070 con 0x7f96ec0cddd0 2024-09-16T07:33:54.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.402+0000 7f96f1600640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f96cc073340 0x7f96cc075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:54.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.402+0000 7f96f1600640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f96cc073340 0x7f96cc075800 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f96e00098b0 tx=0x7f96e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:54.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.406+0000 7f96e9600640 1 -- 172.21.15.114:0/1426106865 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f96e4016030 con 0x7f96ec0cddd0 2024-09-16T07:33:54.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:54.610+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f96ec15f220 con 0x7f96ec0cddd0 2024-09-16T07:33:55.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96e9600640 1 -- 172.21.15.114:0/1426106865 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v75) ==== 104+0+0 (secure 0 0 0) 0x7f96e405f3f0 con 0x7f96ec0cddd0 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f96cc073340 msgr2=0x7f96cc075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f96cc073340 0x7f96cc075800 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f96e00098b0 tx=0x7f96e0008040 comp rx=0 tx=0).stop 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0cddd0 msgr2=0x7f96ec0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0cddd0 0x7f96ec0b4ef0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f96e400ea20 tx=0x7f96e400eee0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 shutdown_connections 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ec0cddd0 0x7f96ec0b4ef0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f96cc073340 0x7f96cc075800 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96ec0af220 0x7f96ec157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 --2- 172.21.15.114:0/1426106865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96ec06fea0 0x7f96ec15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.230+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 >> 172.21.15.114:0/1426106865 conn(0x7f96ec0cfc20 msgr2=0x7f96ec0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.234+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 shutdown_connections 2024-09-16T07:33:55.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.234+0000 7f96f4000640 1 -- 172.21.15.114:0/1426106865 wait complete. 2024-09-16T07:33:55.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:33:55.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 -- 172.21.15.114:0/4215503074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa34c003a60 msgr2=0x7fa34c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 --2- 172.21.15.114:0/4215503074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa34c003a60 0x7fa34c003e80 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa358009b40 tx=0x7fa35801d290 comp rx=0 tx=0).stop 2024-09-16T07:33:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa366800640 1 -- 172.21.15.114:0/4215503074 reap_dead start 2024-09-16T07:33:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 -- 172.21.15.114:0/4215503074 shutdown_connections 2024-09-16T07:33:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 -- 172.21.15.114:0/4215503074 >> 172.21.15.114:0/4215503074 conn(0x7fa3680d3f90 msgr2=0x7fa3680d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 -- 172.21.15.114:0/4215503074 shutdown_connections 2024-09-16T07:33:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 -- 172.21.15.114:0/4215503074 wait complete. 2024-09-16T07:33:55.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 Processor -- start 2024-09-16T07:33:55.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.450+0000 7fa36ca00640 1 -- start start 2024-09-16T07:33:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa34c003a60 0x7fa3680b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa368157320 0x7fa36815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa36815f4b0 0x7fa3680b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa368168f10 con 0x7fa368157320 2024-09-16T07:33:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680b4350 con 0x7fa36815f4b0 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa368169090 con 0x7fa34c003a60 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa368157320 0x7fa36815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa368157320 0x7fa36815ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36776/0 (socket says 172.21.15.114:36776) 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 -- 172.21.15.114:0/857018688 learned_addr learned my addr 172.21.15.114:0/857018688 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365e00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa34c003a60 0x7fa3680b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa366800640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa36815f4b0 0x7fa3680b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 -- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa34c003a60 msgr2=0x7fa3680b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa34c003a60 0x7fa3680b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 -- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa36815f4b0 msgr2=0x7fa3680b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa36815f4b0 0x7fa3680b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 -- 172.21.15.114:0/857018688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680b7300 con 0x7fa368157320 2024-09-16T07:33:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa366800640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa36815f4b0 0x7fa3680b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa365400640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa368157320 0x7fa36815ef70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa354006450 tx=0x7fa3540039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa35e000640 1 -- 172.21.15.114:0/857018688 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354015070 con 0x7fa368157320 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa35e000640 1 -- 172.21.15.114:0/857018688 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa354011840 con 0x7fa368157320 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa35e000640 1 -- 172.21.15.114:0/857018688 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354011c70 con 0x7fa368157320 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36815f930 con 0x7fa368157320 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3680cc630 con 0x7fa368157320 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3680b9f10 con 0x7fa368157320 2024-09-16T07:33:55.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.454+0000 7fa35e000640 1 -- 172.21.15.114:0/857018688 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fa354018070 con 0x7fa368157320 2024-09-16T07:33:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.458+0000 7fa35e000640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa348073340 0x7fa348075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.458+0000 7fa35e000640 1 -- 172.21.15.114:0/857018688 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5881+0+0 (secure 0 0 0) 0x7fa3540953d0 con 0x7fa368157320 2024-09-16T07:33:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.458+0000 7fa365e00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa348073340 0x7fa348075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.458+0000 7fa365e00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa348073340 0x7fa348075800 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3580ad000 tx=0x7fa35801a030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:55.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.462+0000 7fa35e000640 1 -- 172.21.15.114:0/857018688 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa35405f7a0 con 0x7fa368157320 2024-09-16T07:33:55.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:55.634+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3680cefc0 con 0x7fa368157320 2024-09-16T07:33:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa35e000640 1 -- 172.21.15.114:0/857018688 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fa3540641d0 con 0x7fa368157320 2024-09-16T07:33:56.544 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa348073340 msgr2=0x7fa348075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa348073340 0x7fa348075800 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3580ad000 tx=0x7fa35801a030 comp rx=0 tx=0).stop 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa368157320 msgr2=0x7fa36815ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa368157320 0x7fa36815ef70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa354006450 tx=0x7fa3540039d0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 shutdown_connections 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa36815f4b0 0x7fa3680b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa368157320 0x7fa36815ef70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa348073340 0x7fa348075800 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 --2- 172.21.15.114:0/857018688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa34c003a60 0x7fa3680b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 >> 172.21.15.114:0/857018688 conn(0x7fa3680d3f90 msgr2=0x7fa36815cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 shutdown_connections 2024-09-16T07:33:56.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.546+0000 7fa36ca00640 1 -- 172.21.15.114:0/857018688 wait complete. 2024-09-16T07:33:56.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:33:56.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a09200640 1 -- 172.21.15.114:0/2397915019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8004d50 msgr2=0x7f89e80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a09200640 1 --2- 172.21.15.114:0/2397915019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8004d50 0x7f89e80051d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009f10 tx=0x7f89fc01d610 comp rx=0 tx=0).stop 2024-09-16T07:33:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a02800640 1 -- 172.21.15.114:0/2397915019 reap_dead start 2024-09-16T07:33:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a09200640 1 -- 172.21.15.114:0/2397915019 shutdown_connections 2024-09-16T07:33:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a09200640 1 -- 172.21.15.114:0/2397915019 >> 172.21.15.114:0/2397915019 conn(0x7f8a040cfbc0 msgr2=0x7f8a040cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a09200640 1 -- 172.21.15.114:0/2397915019 shutdown_connections 2024-09-16T07:33:56.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a09200640 1 -- 172.21.15.114:0/2397915019 wait complete. 2024-09-16T07:33:56.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.714+0000 7f8a09200640 1 Processor -- start 2024-09-16T07:33:56.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 -- start start 2024-09-16T07:33:56.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89e8004d50 0x7f8a040b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0415bb90 0x7f8a0415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a04142260 0x7f8a041426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a040cde50 con 0x7f8a0415bb90 2024-09-16T07:33:56.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a040cdcd0 con 0x7f89e8004d50 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a040cdfd0 con 0x7f8a04142260 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0415bb90 0x7f8a0415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0415bb90 0x7f8a0415bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36782/0 (socket says 172.21.15.114:36782) 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 -- 172.21.15.114:0/2563503609 learned_addr learned my addr 172.21.15.114:0/2563503609 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a01e00640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89e8004d50 0x7f8a040b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a02800640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a04142260 0x7f8a041426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 -- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a04142260 msgr2=0x7f8a041426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a04142260 0x7f8a041426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 -- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89e8004d50 msgr2=0x7f8a040b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:56.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89e8004d50 0x7f8a040b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 -- 172.21.15.114:0/2563503609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a04142c20 con 0x7f8a0415bb90 2024-09-16T07:33:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fbe00640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0415bb90 0x7f8a0415bfd0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00ea70 tx=0x7f89ec00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fa000640 1 -- 172.21.15.114:0/2563503609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00dc90 con 0x7f8a0415bb90 2024-09-16T07:33:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fa000640 1 -- 172.21.15.114:0/2563503609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89ec00de30 con 0x7f8a0415bb90 2024-09-16T07:33:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f89fa000640 1 -- 172.21.15.114:0/2563503609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec004270 con 0x7f8a0415bb90 2024-09-16T07:33:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0415c630 con 0x7f8a0415bb90 2024-09-16T07:33:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a04151850 con 0x7f8a0415bb90 2024-09-16T07:33:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.718+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a04069410 con 0x7f8a0415bb90 2024-09-16T07:33:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.722+0000 7f89fa000640 1 -- 172.21.15.114:0/2563503609 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f89ec003600 con 0x7f8a0415bb90 2024-09-16T07:33:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.722+0000 7f89fa000640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89e0073340 0x7f89e0075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.722+0000 7f89fa000640 1 -- 172.21.15.114:0/2563503609 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5415+0+0 (secure 0 0 0) 0x7f89ec095100 con 0x7f8a0415bb90 2024-09-16T07:33:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.722+0000 7f8a01e00640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89e0073340 0x7f89e0075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.722+0000 7f8a01e00640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89e0073340 0x7f89e0075800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89f4001a10 tx=0x7f89f4006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:56.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.726+0000 7f89fa000640 1 -- 172.21.15.114:0/2563503609 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f89ec05f610 con 0x7f8a0415bb90 2024-09-16T07:33:56.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:56.898+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8a0415cb50 con 0x7f8a0415bb90 2024-09-16T07:33:57.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.554+0000 7f89fa000640 1 -- 172.21.15.114:0/2563503609 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7f8a0415cb50 con 0x7f8a0415bb90 2024-09-16T07:33:57.552 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:33:57.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89e0073340 msgr2=0x7f89e0075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89e0073340 0x7f89e0075800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89f4001a10 tx=0x7f89f4006040 comp rx=0 tx=0).stop 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0415bb90 msgr2=0x7f8a0415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0415bb90 0x7f8a0415bfd0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00ea70 tx=0x7f89ec00ef30 comp rx=0 tx=0).stop 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 shutdown_connections 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89e0073340 0x7f89e0075800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a04142260 0x7f8a041426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0415bb90 0x7f8a0415bfd0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 --2- 172.21.15.114:0/2563503609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89e8004d50 0x7f8a040b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 >> 172.21.15.114:0/2563503609 conn(0x7f8a040cfbc0 msgr2=0x7f8a0414f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 shutdown_connections 2024-09-16T07:33:57.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.558+0000 7f8a09200640 1 -- 172.21.15.114:0/2563503609 wait complete. 2024-09-16T07:33:57.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:33:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 -- 172.21.15.114:0/3016239850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c1602b0 msgr2=0x7ff64c074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 --2- 172.21.15.114:0/3016239850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c1602b0 0x7ff64c074340 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff638009840 tx=0x7ff63801c560 comp rx=0 tx=0).stop 2024-09-16T07:33:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 -- 172.21.15.114:0/3016239850 shutdown_connections 2024-09-16T07:33:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 --2- 172.21.15.114:0/3016239850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c1602b0 0x7ff64c074340 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 -- 172.21.15.114:0/3016239850 >> 172.21.15.114:0/3016239850 conn(0x7ff64c073490 msgr2=0x7ff64c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 -- 172.21.15.114:0/3016239850 shutdown_connections 2024-09-16T07:33:57.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 -- 172.21.15.114:0/3016239850 wait complete. 2024-09-16T07:33:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 Processor -- start 2024-09-16T07:33:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.730+0000 7ff64be00640 1 -- start start 2024-09-16T07:33:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c074880 0x7ff64c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff64c0cccd0 0x7ff64c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff64c1602b0 0x7ff64c099820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c16a310 con 0x7ff64c074880 2024-09-16T07:33:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c16a190 con 0x7ff64c0cccd0 2024-09-16T07:33:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff64c16a490 con 0x7ff64c1602b0 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c074880 0x7ff64c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c074880 0x7ff64c0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36802/0 (socket says 172.21.15.114:36802) 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 -- 172.21.15.114:0/2454824549 learned_addr learned my addr 172.21.15.114:0/2454824549 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64a000640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff64c0cccd0 0x7ff64c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64b400640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff64c1602b0 0x7ff64c099820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 -- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff64c1602b0 msgr2=0x7ff64c099820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff64c1602b0 0x7ff64c099820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 -- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff64c0cccd0 msgr2=0x7ff64c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff64c0cccd0 0x7ff64c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 -- 172.21.15.114:0/2454824549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c0c7430 con 0x7ff64c074880 2024-09-16T07:33:57.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64a000640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff64c0cccd0 0x7ff64c1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:57.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64aa00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c074880 0x7ff64c0c6150 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c500 tx=0x7ff63c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff642a00640 1 -- 172.21.15.114:0/2454824549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c017070 con 0x7ff64c074880 2024-09-16T07:33:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff642a00640 1 -- 172.21.15.114:0/2454824549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff63c0053c0 con 0x7ff64c074880 2024-09-16T07:33:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff642a00640 1 -- 172.21.15.114:0/2454824549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c012890 con 0x7ff64c074880 2024-09-16T07:33:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64c1538d0 con 0x7ff64c074880 2024-09-16T07:33:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64c0ca130 con 0x7ff64c074880 2024-09-16T07:33:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.734+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64c153d50 con 0x7ff64c074880 2024-09-16T07:33:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.738+0000 7ff642a00640 1 -- 172.21.15.114:0/2454824549 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7ff63c01a070 con 0x7ff64c074880 2024-09-16T07:33:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.738+0000 7ff642a00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff62c073370 0x7ff62c075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.738+0000 7ff642a00640 1 -- 172.21.15.114:0/2454824549 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7ff63c093750 con 0x7ff64c074880 2024-09-16T07:33:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.738+0000 7ff64a000640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff62c073370 0x7ff62c075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.738+0000 7ff64a000640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff62c073370 0x7ff62c075830 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6380af000 tx=0x7ff63801ada0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:57.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.742+0000 7ff642a00640 1 -- 172.21.15.114:0/2454824549 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff63c05e4a0 con 0x7ff64c074880 2024-09-16T07:33:57.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.910+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7ff64c0cdc50 con 0x7ff64c074880 2024-09-16T07:33:57.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.914+0000 7ff642a00640 1 -- 172.21.15.114:0/2454824549 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7ff63c05dda0 con 0x7ff64c074880 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff62c073370 msgr2=0x7ff62c075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff62c073370 0x7ff62c075830 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6380af000 tx=0x7ff63801ada0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c074880 msgr2=0x7ff64c0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c074880 0x7ff64c0c6150 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c500 tx=0x7ff63c00c9c0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 shutdown_connections 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff62c073370 0x7ff62c075830 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff64c1602b0 0x7ff64c099820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff64c0cccd0 0x7ff64c1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 --2- 172.21.15.114:0/2454824549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff64c074880 0x7ff64c0c6150 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 >> 172.21.15.114:0/2454824549 conn(0x7ff64c073490 msgr2=0x7ff64c0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 shutdown_connections 2024-09-16T07:33:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:57.918+0000 7ff64be00640 1 -- 172.21.15.114:0/2454824549 wait complete. 2024-09-16T07:33:57.935 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-16T07:33:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.078+0000 7f2626800640 1 -- 172.21.15.114:0/1243189110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 msgr2=0x7f2604003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.078+0000 7f2626800640 1 --2- 172.21.15.114:0/1243189110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 0x7f2604003e30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2610009b90 tx=0x7f261001d270 comp rx=0 tx=0).stop 2024-09-16T07:33:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.078+0000 7f261fe00640 1 -- 172.21.15.114:0/1243189110 reap_dead start 2024-09-16T07:33:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.078+0000 7f2626800640 1 -- 172.21.15.114:0/1243189110 shutdown_connections 2024-09-16T07:33:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.078+0000 7f2626800640 1 -- 172.21.15.114:0/1243189110 >> 172.21.15.114:0/1243189110 conn(0x7f26200d1dc0 msgr2=0x7f26200d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.078+0000 7f2626800640 1 -- 172.21.15.114:0/1243189110 shutdown_connections 2024-09-16T07:33:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 -- 172.21.15.114:0/1243189110 wait complete. 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 Processor -- start 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 -- start start 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 0x7f262015b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26200c8e90 0x7f262014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26201f7a90 0x7f26200c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2620166f00 con 0x7f2604003a10 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2620166d80 con 0x7f26201f7a90 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2620167080 con 0x7f26200c8e90 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 0x7f262015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 0x7f262015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36830/0 (socket says 172.21.15.114:36830) 2024-09-16T07:33:58.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 -- 172.21.15.114:0/3076124498 learned_addr learned my addr 172.21.15.114:0/3076124498 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261ea00640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26200c8e90 0x7f262014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261fe00640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26201f7a90 0x7f26200c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 -- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26200c8e90 msgr2=0x7f262014fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26200c8e90 0x7f262014fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 -- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26201f7a90 msgr2=0x7f26200c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26201f7a90 0x7f26200c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 -- 172.21.15.114:0/3076124498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26201f7f10 con 0x7f2604003a10 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f261f400640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 0x7f262015b520 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f26100af040 tx=0x7f2610005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2617400640 1 -- 172.21.15.114:0/3076124498 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26100b1040 con 0x7f2604003a10 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2617400640 1 -- 172.21.15.114:0/3076124498 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26100bb070 con 0x7f2604003a10 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26200c9320 con 0x7f2604003a10 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2617400640 1 -- 172.21.15.114:0/3076124498 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610004290 con 0x7f2604003a10 2024-09-16T07:33:58.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.082+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2620163fb0 con 0x7f2604003a10 2024-09-16T07:33:58.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.086+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26200ceb90 con 0x7f2604003a10 2024-09-16T07:33:58.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.086+0000 7f2617400640 1 -- 172.21.15.114:0/3076124498 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f26100046d0 con 0x7f2604003a10 2024-09-16T07:33:58.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.086+0000 7f2617400640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2600073340 0x7f2600075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.086+0000 7f2617400640 1 -- 172.21.15.114:0/3076124498 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7f261012f1c0 con 0x7f2604003a10 2024-09-16T07:33:58.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.086+0000 7f261ea00640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2600073340 0x7f2600075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.086+0000 7f261ea00640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2600073340 0x7f2600075800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2620165c50 tx=0x7f260c001c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.090+0000 7f2617400640 1 -- 172.21.15.114:0/3076124498 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2610016fc0 con 0x7f2604003a10 2024-09-16T07:33:58.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.318+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f26200d2370 con 0x7f2604003a10 2024-09-16T07:33:58.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.554+0000 7f2617400640 1 -- 172.21.15.114:0/3076124498 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v317) ==== 149+0+0 (secure 0 0 0) 0x7f26100fa0c0 con 0x7f2604003a10 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2600073340 msgr2=0x7f2600075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2600073340 0x7f2600075800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2620165c50 tx=0x7f260c001c10 comp rx=0 tx=0).stop 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 msgr2=0x7f262015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 0x7f262015b520 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f26100af040 tx=0x7f2610005590 comp rx=0 tx=0).stop 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 shutdown_connections 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f26201f7a90 0x7f26200c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2600073340 0x7f2600075800 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26200c8e90 0x7f262014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 --2- 172.21.15.114:0/3076124498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2604003a10 0x7f262015b520 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 >> 172.21.15.114:0/3076124498 conn(0x7f26200d1dc0 msgr2=0x7f26200b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 shutdown_connections 2024-09-16T07:33:58.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.558+0000 7f2626800640 1 -- 172.21.15.114:0/3076124498 wait complete. 2024-09-16T07:33:58.577 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-16T07:33:58.578 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-16T07:33:58.578 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:33:58.578 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:33:58.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- 172.21.15.114:0/3793835320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc06e810 msgr2=0x7fe9cc0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 --2- 172.21.15.114:0/3793835320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc06e810 0x7fe9cc0cf130 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc06e730 tx=0x7fe9b801c5d0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- 172.21.15.114:0/3793835320 shutdown_connections 2024-09-16T07:33:58.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 --2- 172.21.15.114:0/3793835320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc06e810 0x7fe9cc0cf130 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 --2- 172.21.15.114:0/3793835320 >> v2:172.21.15.149:3300/0 conn(0x7fe9cc0b4bd0 0x7fe9cc15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 --2- 172.21.15.114:0/3793835320 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9cc15ade0 0x7fe9cc0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- 172.21.15.114:0/3793835320 >> 172.21.15.114:0/3793835320 conn(0x7fe9cc0b18f0 msgr2=0x7fe9cc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- 172.21.15.114:0/3793835320 shutdown_connections 2024-09-16T07:33:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- 172.21.15.114:0/3793835320 wait complete. 2024-09-16T07:33:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 Processor -- start 2024-09-16T07:33:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- start start 2024-09-16T07:33:58.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9cc06e810 0x7fe9cc1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b4bd0 0x7fe9cc155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9cc15ade0 0x7fe9cc1f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc06f150 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc06efd0 con 0x7fe9cc06e810 2024-09-16T07:33:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9d2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc06f2d0 con 0x7fe9cc15ade0 2024-09-16T07:33:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b4bd0 0x7fe9cc155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9caa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b4bd0 0x7fe9cc155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36852/0 (socket says 172.21.15.114:36852) 2024-09-16T07:33:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9cb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9cc06e810 0x7fe9cc1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9caa00640 1 -- 172.21.15.114:0/4272240815 learned_addr learned my addr 172.21.15.114:0/4272240815 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.722+0000 7fe9cbe00640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9cc15ade0 0x7fe9cc1f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9caa00640 1 -- 172.21.15.114:0/4272240815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9cc15ade0 msgr2=0x7fe9cc1f7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9caa00640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9cc15ade0 0x7fe9cc1f7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9caa00640 1 -- 172.21.15.114:0/4272240815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9cc06e810 msgr2=0x7fe9cc1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9caa00640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9cc06e810 0x7fe9cc1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9caa00640 1 -- 172.21.15.114:0/4272240815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc0b2fe0 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9caa00640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b4bd0 0x7fe9cc155b60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe9b801cab0 tx=0x7fe9b80a94f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9c3400640 1 -- 172.21.15.114:0/4272240815 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b80ad040 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9c3400640 1 -- 172.21.15.114:0/4272240815 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b80aad50 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc09c320 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9c3400640 1 -- 172.21.15.114:0/4272240815 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8005290 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc09c8e0 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9cc15e900 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.726+0000 7fe9c3400640 1 -- 172.21.15.114:0/4272240815 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fe9b80b0070 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.730+0000 7fe9c3400640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe9ac073340 0x7fe9ac075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.730+0000 7fe9c3400640 1 -- 172.21.15.114:0/4272240815 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7fe9b812eba0 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.730+0000 7fe9cb400640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe9ac073340 0x7fe9ac075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.730+0000 7fe9cb400640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe9ac073340 0x7fe9ac075800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc09c0d0 tx=0x7fe9bc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.734+0000 7fe9c3400640 1 -- 172.21.15.114:0/4272240815 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe9b80164b0 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.902+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9cc165190 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.902+0000 7fe9c3400640 1 -- 172.21.15.114:0/4272240815 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+13086 (secure 0 0 0) 0x7fe9b80f92a0 con 0x7fe9cc0b4bd0 2024-09-16T07:33:58.901 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:33:58.902 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":106,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:33:57.549623+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/3128573512":"2024-09-17T07:33:54.224283+0000","172.21.15.114:6833/3128573512":"2024-09-17T07:33:54.224283+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:33:58.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe9ac073340 msgr2=0x7fe9ac075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe9ac073340 0x7fe9ac075800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc09c0d0 tx=0x7fe9bc00b2e0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b4bd0 msgr2=0x7fe9cc155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:58.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b4bd0 0x7fe9cc155b60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe9b801cab0 tx=0x7fe9b80a94f0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 shutdown_connections 2024-09-16T07:33:58.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe9ac073340 0x7fe9ac075800 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe9cc15ade0 0x7fe9cc1f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9cc0b4bd0 0x7fe9cc155b60 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 --2- 172.21.15.114:0/4272240815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9cc06e810 0x7fe9cc1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:58.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 >> 172.21.15.114:0/4272240815 conn(0x7fe9cc0b18f0 msgr2=0x7fe9cc06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:58.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 shutdown_connections 2024-09-16T07:33:58.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:58.906+0000 7fe9d2200640 1 -- 172.21.15.114:0/4272240815 wait complete. 2024-09-16T07:33:58.923 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:33:58.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:33:59.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- 172.21.15.114:0/1169401818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 msgr2=0x7fb0240ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 --2- 172.21.15.114:0/1169401818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 0x7fb0240ce670 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb0240cf780 tx=0x7fb01c01ca60 comp rx=0 tx=0).stop 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- 172.21.15.114:0/1169401818 shutdown_connections 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 --2- 172.21.15.114:0/1169401818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 0x7fb0240ce670 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 --2- 172.21.15.114:0/1169401818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0240b0d10 0x7fb0240d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 --2- 172.21.15.114:0/1169401818 >> v2:172.21.15.149:3300/0 conn(0x7fb02415bd40 0x7fb0240d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- 172.21.15.114:0/1169401818 >> 172.21.15.114:0/1169401818 conn(0x7fb02409aa10 msgr2=0x7fb02409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- 172.21.15.114:0/1169401818 shutdown_connections 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- 172.21.15.114:0/1169401818 wait complete. 2024-09-16T07:33:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 Processor -- start 2024-09-16T07:33:59.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- start start 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0240b0d10 0x7fb02415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 0x7fb02414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb02415bd40 0x7fb0240c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240cce60 con 0x7fb0240d20f0 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240ccce0 con 0x7fb0240b0d10 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.070+0000 7fb02a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0240ccfe0 con 0x7fb02415bd40 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb01be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 0x7fb02414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb029200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0240b0d10 0x7fb02415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb029200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0240b0d10 0x7fb02415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:39804/0 (socket says 172.21.15.114:39804) 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb029200640 1 -- 172.21.15.114:0/3874113929 learned_addr learned my addr 172.21.15.114:0/3874113929 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb029c00640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb02415bd40 0x7fb0240c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb01be00640 1 -- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb02415bd40 msgr2=0x7fb0240c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb01be00640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb02415bd40 0x7fb0240c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb01be00640 1 -- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0240b0d10 msgr2=0x7fb02415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb01be00640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0240b0d10 0x7fb02415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb01be00640 1 -- 172.21.15.114:0/3874113929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02415ccd0 con 0x7fb0240d20f0 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb029200640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0240b0d10 0x7fb02415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb01be00640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 0x7fb02414c100 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00d660 tx=0x7fb00c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb021600640 1 -- 172.21.15.114:0/3874113929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c017070 con 0x7fb0240d20f0 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb021600640 1 -- 172.21.15.114:0/3874113929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb00c005310 con 0x7fb0240d20f0 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb021600640 1 -- 172.21.15.114:0/3874113929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c009820 con 0x7fb0240d20f0 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb02415cfb0 con 0x7fb0240d20f0 2024-09-16T07:33:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb02415d570 con 0x7fb0240d20f0 2024-09-16T07:33:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0240cd500 con 0x7fb0240d20f0 2024-09-16T07:33:59.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.074+0000 7fb021600640 1 -- 172.21.15.114:0/3874113929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fb00c0099c0 con 0x7fb0240d20f0 2024-09-16T07:33:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.078+0000 7fb021600640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb000073370 0x7fb000075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.078+0000 7fb021600640 1 -- 172.21.15.114:0/3874113929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7fb00c0947b0 con 0x7fb0240d20f0 2024-09-16T07:33:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.078+0000 7fb029200640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb000073370 0x7fb000075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.078+0000 7fb029200640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb000073370 0x7fb000075830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb014005fd0 tx=0x7fb01400b410 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:59.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.078+0000 7fb021600640 1 -- 172.21.15.114:0/3874113929 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb00c05ef20 con 0x7fb0240d20f0 2024-09-16T07:33:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.246+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb0240b4b30 con 0x7fb0240d20f0 2024-09-16T07:33:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.246+0000 7fb021600640 1 -- 172.21.15.114:0/3874113929 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7fb00c063950 con 0x7fb0240d20f0 2024-09-16T07:33:59.245 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.246+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb000073370 msgr2=0x7fb000075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.246+0000 7fb02a600640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb000073370 0x7fb000075830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb014005fd0 tx=0x7fb01400b410 comp rx=0 tx=0).stop 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.246+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 msgr2=0x7fb02414c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.246+0000 7fb02a600640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 0x7fb02414c100 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00d660 tx=0x7fb00c00db20 comp rx=0 tx=0).stop 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 shutdown_connections 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb000073370 0x7fb000075830 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb02415bd40 0x7fb0240c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0240d20f0 0x7fb02414c100 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 --2- 172.21.15.114:0/3874113929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0240b0d10 0x7fb02415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 >> 172.21.15.114:0/3874113929 conn(0x7fb02409aa10 msgr2=0x7fb02409adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 shutdown_connections 2024-09-16T07:33:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.250+0000 7fb02a600640 1 -- 172.21.15.114:0/3874113929 wait complete. 2024-09-16T07:33:59.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-16T07:33:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 -- 172.21.15.114:0/3861399462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00cd100 msgr2=0x7f7bb006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 --2- 172.21.15.114:0/3861399462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00cd100 0x7f7bb006f7b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00af830 tx=0x7f7b9c01c6e0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 -- 172.21.15.114:0/3861399462 shutdown_connections 2024-09-16T07:33:59.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 --2- 172.21.15.114:0/3861399462 >> v2:172.21.15.149:3300/0 conn(0x7f7bb00b49e0 0x7f7bb00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 --2- 172.21.15.114:0/3861399462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00cd100 0x7f7bb006f7b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 -- 172.21.15.114:0/3861399462 >> 172.21.15.114:0/3861399462 conn(0x7f7bb00b18f0 msgr2=0x7f7bb00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:33:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 -- 172.21.15.114:0/3861399462 shutdown_connections 2024-09-16T07:33:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 -- 172.21.15.114:0/3861399462 wait complete. 2024-09-16T07:33:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 Processor -- start 2024-09-16T07:33:59.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.410+0000 7f7bb5800640 1 -- start start 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00b49e0 0x7f7bb009db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bb00cd100 0x7f7bb006e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb015dae0 0x7f7bb006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb00cf0f0 con 0x7f7bb00b49e0 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb00cef70 con 0x7f7bb00cd100 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb00cf270 con 0x7f7bb015dae0 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00b49e0 0x7f7bb009db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00b49e0 0x7f7bb009db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36898/0 (socket says 172.21.15.114:36898) 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 -- 172.21.15.114:0/1258031729 learned_addr learned my addr 172.21.15.114:0/1258031729 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:33:59.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bae000640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bb00cd100 0x7f7bb006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baf400640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb015dae0 0x7f7bb006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 -- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb015dae0 msgr2=0x7f7bb006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb015dae0 0x7f7bb006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 -- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bb00cd100 msgr2=0x7f7bb006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bb00cd100 0x7f7bb006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 -- 172.21.15.114:0/1258031729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb014b520 con 0x7f7bb00b49e0 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bae000640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bb00cd100 0x7f7bb006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baf400640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb015dae0 0x7f7bb006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7baea00640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00b49e0 0x7f7bb009db50 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c430 tx=0x7f7ba000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:59.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7ba6a00640 1 -- 172.21.15.114:0/1258031729 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011790 con 0x7f7bb00b49e0 2024-09-16T07:33:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7ba6a00640 1 -- 172.21.15.114:0/1258031729 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ba0017070 con 0x7f7bb00b49e0 2024-09-16T07:33:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7ba6a00640 1 -- 172.21.15.114:0/1258031729 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011cc0 con 0x7f7bb00b49e0 2024-09-16T07:33:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb00b0110 con 0x7f7bb00b49e0 2024-09-16T07:33:59.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb00b06d0 con 0x7f7bb00b49e0 2024-09-16T07:33:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.414+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb00acd40 con 0x7f7bb00b49e0 2024-09-16T07:33:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.418+0000 7f7ba6a00640 1 -- 172.21.15.114:0/1258031729 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f7ba001c460 con 0x7f7bb00b49e0 2024-09-16T07:33:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.418+0000 7f7ba6a00640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b90073340 0x7f7b90075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:33:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.418+0000 7f7ba6a00640 1 -- 172.21.15.114:0/1258031729 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7f7ba0094080 con 0x7f7bb00b49e0 2024-09-16T07:33:59.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.418+0000 7f7bae000640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b90073340 0x7f7b90075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:33:59.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.418+0000 7f7bae000640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b90073340 0x7f7b90075800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0af000 tx=0x7f7b9c01af20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:33:59.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.422+0000 7f7ba6a00640 1 -- 172.21.15.114:0/1258031729 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7ba005efc0 con 0x7f7bb00b49e0 2024-09-16T07:33:59.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:33:59.650+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7f7bb015bc20 con 0x7f7bb00b49e0 2024-09-16T07:34:00.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7ba6a00640 1 -- 172.21.15.114:0/1258031729 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v319) ==== 151+0+0 (secure 0 0 0) 0x7f7ba005e8c0 con 0x7f7bb00b49e0 2024-09-16T07:34:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b90073340 msgr2=0x7f7b90075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b90073340 0x7f7b90075800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0af000 tx=0x7f7b9c01af20 comp rx=0 tx=0).stop 2024-09-16T07:34:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00b49e0 msgr2=0x7f7bb009db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00b49e0 0x7f7bb009db50 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c430 tx=0x7f7ba000c8f0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 shutdown_connections 2024-09-16T07:34:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b90073340 0x7f7b90075800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7bb015dae0 0x7f7bb006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7bb00cd100 0x7f7bb006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 --2- 172.21.15.114:0/1258031729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bb00b49e0 0x7f7bb009db50 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 >> 172.21.15.114:0/1258031729 conn(0x7f7bb00b18f0 msgr2=0x7f7bb015afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 shutdown_connections 2024-09-16T07:34:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.566+0000 7f7bb5800640 1 -- 172.21.15.114:0/1258031729 wait complete. 2024-09-16T07:34:00.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:34:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 -- 172.21.15.114:0/2038899705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0d2060 msgr2=0x7f6bbc0cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2038899705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0d2060 0x7f6bbc0cf660 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009900 tx=0x7f6bac01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 -- 172.21.15.114:0/2038899705 shutdown_connections 2024-09-16T07:34:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2038899705 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bbc0b7ab0 0x7f6bbc0b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2038899705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0d2060 0x7f6bbc0cf660 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 -- 172.21.15.114:0/2038899705 >> 172.21.15.114:0/2038899705 conn(0x7f6bbc0d3fe0 msgr2=0x7f6bbc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 -- 172.21.15.114:0/2038899705 shutdown_connections 2024-09-16T07:34:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.730+0000 7f6bc3800640 1 -- 172.21.15.114:0/2038899705 wait complete. 2024-09-16T07:34:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 Processor -- start 2024-09-16T07:34:00.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 -- start start 2024-09-16T07:34:00.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0b7ab0 0x7f6bbc1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bbc0d2060 0x7f6bbc0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bbc0d2440 0x7f6bbc15ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc16b690 con 0x7f6bbc0d2440 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc16b510 con 0x7f6bbc0b7ab0 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc16b810 con 0x7f6bbc0d2060 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bbc0d2440 0x7f6bbc15ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bbc0d2440 0x7f6bbc15ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36914/0 (socket says 172.21.15.114:36914) 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 -- 172.21.15.114:0/2069809122 learned_addr learned my addr 172.21.15.114:0/2069809122 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc0e00640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0b7ab0 0x7f6bbc1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bb3e00640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bbc0d2060 0x7f6bbc0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:00.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 -- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bbc0d2060 msgr2=0x7f6bbc0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:00.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bbc0d2060 0x7f6bbc0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 -- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0b7ab0 msgr2=0x7f6bbc1591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:00.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0b7ab0 0x7f6bbc1591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 -- 172.21.15.114:0/2069809122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc159a40 con 0x7f6bbc0d2440 2024-09-16T07:34:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc1800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bbc0d2440 0x7f6bbc15ccf0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400eb20 tx=0x7f6bb400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bb9600640 1 -- 172.21.15.114:0/2069809122 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004b30 con 0x7f6bbc0d2440 2024-09-16T07:34:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bb9600640 1 -- 172.21.15.114:0/2069809122 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bb4004cf0 con 0x7f6bbc0d2440 2024-09-16T07:34:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bb9600640 1 -- 172.21.15.114:0/2069809122 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4005280 con 0x7f6bbc0d2440 2024-09-16T07:34:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bbc15d5f0 con 0x7f6bbc0d2440 2024-09-16T07:34:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.734+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bbc159730 con 0x7f6bbc0d2440 2024-09-16T07:34:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.738+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bbc0b7ec0 con 0x7f6bbc0d2440 2024-09-16T07:34:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.738+0000 7f6bb9600640 1 -- 172.21.15.114:0/2069809122 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f6bb4005420 con 0x7f6bbc0d2440 2024-09-16T07:34:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.738+0000 7f6bb9600640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b98073370 0x7f6b98075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.738+0000 7f6bb9600640 1 -- 172.21.15.114:0/2069809122 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7f6bb4094f20 con 0x7f6bbc0d2440 2024-09-16T07:34:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.738+0000 7f6bc0e00640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b98073370 0x7f6b98075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.738+0000 7f6bc0e00640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b98073370 0x7f6b98075830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0af000 tx=0x7f6bac01b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.742+0000 7f6bb9600640 1 -- 172.21.15.114:0/2069809122 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6bb405f6a0 con 0x7f6bbc0d2440 2024-09-16T07:34:00.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.910+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f6bbc0d07d0 con 0x7f6bbc0d2440 2024-09-16T07:34:00.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bb9600640 1 -- 172.21.15.114:0/2069809122 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+1998 (secure 0 0 0) 0x7f6bb40640d0 con 0x7f6bbc0d2440 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:34:00.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:34:00.913 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:34:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:34:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:34:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:34:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:34:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:34:00.914 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:34:00.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b98073370 msgr2=0x7f6b98075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b98073370 0x7f6b98075830 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0af000 tx=0x7f6bac01b120 comp rx=0 tx=0).stop 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bbc0d2440 msgr2=0x7f6bbc15ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bbc0d2440 0x7f6bbc15ccf0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400eb20 tx=0x7f6bb400c2d0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 shutdown_connections 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6bbc0d2440 0x7f6bbc15ccf0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b98073370 0x7f6b98075830 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6bbc0d2060 0x7f6bbc0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 --2- 172.21.15.114:0/2069809122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6bbc0b7ab0 0x7f6bbc1591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 >> 172.21.15.114:0/2069809122 conn(0x7f6bbc0d3fe0 msgr2=0x7f6bbc06e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 shutdown_connections 2024-09-16T07:34:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:00.914+0000 7f6bc3800640 1 -- 172.21.15.114:0/2069809122 wait complete. 2024-09-16T07:34:00.933 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:34:01.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 -- 172.21.15.114:0/4227363105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d0840 msgr2=0x7ff3b40b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/4227363105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d0840 0x7ff3b40b1bd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009840 tx=0x7ff3ac01f010 comp rx=0 tx=0).stop 2024-09-16T07:34:01.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 -- 172.21.15.114:0/4227363105 shutdown_connections 2024-09-16T07:34:01.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/4227363105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40d0840 0x7ff3b40b1bd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/4227363105 >> v2:172.21.15.149:3300/0 conn(0x7ff3b40cff20 0x7ff3b40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 -- 172.21.15.114:0/4227363105 >> 172.21.15.114:0/4227363105 conn(0x7ff3b40d1dc0 msgr2=0x7ff3b40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:01.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 -- 172.21.15.114:0/4227363105 shutdown_connections 2024-09-16T07:34:01.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 -- 172.21.15.114:0/4227363105 wait complete. 2024-09-16T07:34:01.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.078+0000 7ff3b8a00640 1 Processor -- start 2024-09-16T07:34:01.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 -- start start 2024-09-16T07:34:01.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40b2d80 0x7ff3b40cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40cff20 0x7ff3b406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40d0840 0x7ff3b406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b40af800 con 0x7ff3b40cff20 2024-09-16T07:34:01.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b40af680 con 0x7ff3b40d0840 2024-09-16T07:34:01.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b40af980 con 0x7ff3b40b2d80 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40cff20 0x7ff3b406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40cff20 0x7ff3b406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36928/0 (socket says 172.21.15.114:36928) 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 -- 172.21.15.114:0/1931094444 learned_addr learned my addr 172.21.15.114:0/1931094444 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b1e00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40b2d80 0x7ff3b40cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b2800640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40d0840 0x7ff3b406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 -- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40b2d80 msgr2=0x7ff3b40cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40b2d80 0x7ff3b40cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 -- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40d0840 msgr2=0x7ff3b406f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40d0840 0x7ff3b406f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 -- 172.21.15.114:0/1931094444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b41f49e0 con 0x7ff3b40cff20 2024-09-16T07:34:01.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3a9400640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40cff20 0x7ff3b406ed80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c490 tx=0x7ff39c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:01.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3aaa00640 1 -- 172.21.15.114:0/1931094444 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c011790 con 0x7ff3b40cff20 2024-09-16T07:34:01.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3aaa00640 1 -- 172.21.15.114:0/1931094444 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff39c017070 con 0x7ff3b40cff20 2024-09-16T07:34:01.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3aaa00640 1 -- 172.21.15.114:0/1931094444 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c011ce0 con 0x7ff3b40cff20 2024-09-16T07:34:01.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b41f4cc0 con 0x7ff3b40cff20 2024-09-16T07:34:01.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b41f5280 con 0x7ff3b40cff20 2024-09-16T07:34:01.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.082+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b41f5480 con 0x7ff3b40cff20 2024-09-16T07:34:01.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.086+0000 7ff3aaa00640 1 -- 172.21.15.114:0/1931094444 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7ff39c01c460 con 0x7ff3b40cff20 2024-09-16T07:34:01.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.086+0000 7ff3aaa00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff390073370 0x7ff390075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.086+0000 7ff3aaa00640 1 -- 172.21.15.114:0/1931094444 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7ff39c093f10 con 0x7ff3b40cff20 2024-09-16T07:34:01.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.086+0000 7ff3b1e00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff390073370 0x7ff390075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.086+0000 7ff3b1e00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff390073370 0x7ff390075830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009f60 tx=0x7ff3a4009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:01.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.090+0000 7ff3aaa00640 1 -- 172.21.15.114:0/1931094444 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff3b41f5480 con 0x7ff3b40cff20 2024-09-16T07:34:01.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.254+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff3b40d0300 con 0x7ff3b40cff20 2024-09-16T07:34:01.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.258+0000 7ff3aaa00640 1 -- 172.21.15.114:0/1931094444 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7ff39c05e8c0 con 0x7ff3b40cff20 2024-09-16T07:34:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff390073370 msgr2=0x7ff390075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff390073370 0x7ff390075830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009f60 tx=0x7ff3a4009500 comp rx=0 tx=0).stop 2024-09-16T07:34:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40cff20 msgr2=0x7ff3b406ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40cff20 0x7ff3b406ed80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c490 tx=0x7ff39c00c950 comp rx=0 tx=0).stop 2024-09-16T07:34:01.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 shutdown_connections 2024-09-16T07:34:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3b40d0840 0x7ff3b406f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3b40cff20 0x7ff3b406ed80 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff390073370 0x7ff390075830 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 --2- 172.21.15.114:0/1931094444 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3b40b2d80 0x7ff3b40cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 >> 172.21.15.114:0/1931094444 conn(0x7ff3b40d1dc0 msgr2=0x7ff3b4152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 shutdown_connections 2024-09-16T07:34:01.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.262+0000 7ff3b8a00640 1 -- 172.21.15.114:0/1931094444 wait complete. 2024-09-16T07:34:01.279 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:34:01.279 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:34:01.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:34:01.478 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:34:01.478 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:01.478 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:01.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:34:01.486 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:01.486 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:01.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:34:01.497 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:01.497 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:01.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:34:01.538 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:01.538 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:01.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:34:01.547 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:34:01.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:01.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 -- 172.21.15.114:0/1800583375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 msgr2=0x7f10cc004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 --2- 172.21.15.114:0/1800583375 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 0x7f10cc004020 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009f10 tx=0x7f10d801d5d0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10e7e00640 1 -- 172.21.15.114:0/1800583375 reap_dead start 2024-09-16T07:34:01.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 -- 172.21.15.114:0/1800583375 shutdown_connections 2024-09-16T07:34:01.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 -- 172.21.15.114:0/1800583375 >> 172.21.15.114:0/1800583375 conn(0x7f10e80d1da0 msgr2=0x7f10e80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:01.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 -- 172.21.15.114:0/1800583375 shutdown_connections 2024-09-16T07:34:01.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 -- 172.21.15.114:0/1800583375 wait complete. 2024-09-16T07:34:01.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 Processor -- start 2024-09-16T07:34:01.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.722+0000 7f10ee000640 1 -- start start 2024-09-16T07:34:01.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 0x7f10e8156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80cbed0 0x7f10e80b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e80b7570 0x7f10e80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8167ff0 con 0x7f10cc003c20 2024-09-16T07:34:01.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8167e70 con 0x7f10e80cbed0 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f10e8168170 con 0x7f10e80b7570 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 0x7f10e8156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 0x7f10e8156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36944/0 (socket says 172.21.15.114:36944) 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 -- 172.21.15.114:0/2433936299 learned_addr learned my addr 172.21.15.114:0/2433936299 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10dea00640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80cbed0 0x7f10e80b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7e00640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e80b7570 0x7f10e80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 -- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e80b7570 msgr2=0x7f10e80c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e80b7570 0x7f10e80c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 -- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80cbed0 msgr2=0x7f10e80b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80cbed0 0x7f10e80b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 -- 172.21.15.114:0/2433936299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e80cb170 con 0x7f10cc003c20 2024-09-16T07:34:01.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10e7400640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 0x7f10e8156e30 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f10d80ae040 tx=0x7f10d8009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10dfe00640 1 -- 172.21.15.114:0/2433936299 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8003b80 con 0x7f10cc003c20 2024-09-16T07:34:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10dfe00640 1 -- 172.21.15.114:0/2433936299 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10d8003e10 con 0x7f10cc003c20 2024-09-16T07:34:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e80c9a50 con 0x7f10cc003c20 2024-09-16T07:34:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10dfe00640 1 -- 172.21.15.114:0/2433936299 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8004270 con 0x7f10cc003c20 2024-09-16T07:34:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e80cb6d0 con 0x7f10cc003c20 2024-09-16T07:34:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e80b7980 con 0x7f10cc003c20 2024-09-16T07:34:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.726+0000 7f10dfe00640 1 -- 172.21.15.114:0/2433936299 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f10d8004410 con 0x7f10cc003c20 2024-09-16T07:34:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.730+0000 7f10dfe00640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4073370 0x7f10c4075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.730+0000 7f10dfe00640 1 -- 172.21.15.114:0/2433936299 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4943+0+0 (secure 0 0 0) 0x7f10d812ff20 con 0x7f10cc003c20 2024-09-16T07:34:01.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.730+0000 7f10dea00640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4073370 0x7f10c4075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:01.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.730+0000 7f10dea00640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4073370 0x7f10c4075830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10e80c8180 tx=0x7f10d0006c80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:01.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.734+0000 7f10dfe00640 1 -- 172.21.15.114:0/2433936299 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f10e80b7980 con 0x7f10cc003c20 2024-09-16T07:34:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10e80b53f0 con 0x7f10cc003c20 2024-09-16T07:34:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10dfe00640 1 -- 172.21.15.114:0/2433936299 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+3920 (secure 0 0 0) 0x7f10e80cb170 con 0x7f10cc003c20 2024-09-16T07:34:01.933 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:01.933 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":75,"btime":"2024-09-16T07:33:55:226822+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/1374083886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1374083886},{"type":"v1","addr":"172.21.15.149:6835","nonce":1374083886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6637,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/320868897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":320868897},{"type":"v1","addr":"172.21.15.149:6801","nonce":320868897}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/1288852592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":1288852592},{"type":"v1","addr":"172.21.15.114:6834","nonce":1288852592}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1694504004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1694504004},{"type":"v1","addr":"172.21.15.114:6835","nonce":1694504004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[]} 2024-09-16T07:34:01.933 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 75 2024-09-16T07:34:01.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4073370 msgr2=0x7f10c4075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4073370 0x7f10c4075830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10e80c8180 tx=0x7f10d0006c80 comp rx=0 tx=0).stop 2024-09-16T07:34:01.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 msgr2=0x7f10e8156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:01.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 0x7f10e8156e30 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f10d80ae040 tx=0x7f10d8009ab0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 shutdown_connections 2024-09-16T07:34:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f10c4073370 0x7f10c4075830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10e80b7570 0x7f10e80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10e80cbed0 0x7f10e80b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 --2- 172.21.15.114:0/2433936299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10cc003c20 0x7f10e8156e30 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.934+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 >> 172.21.15.114:0/2433936299 conn(0x7f10e80d1da0 msgr2=0x7f10e80b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.938+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 shutdown_connections 2024-09-16T07:34:01.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:01.938+0000 7f10ee000640 1 -- 172.21.15.114:0/2433936299 wait complete. 2024-09-16T07:34:01.955 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:34:01.955 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:34:01.955 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:34:01.955 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:01.956 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:34:01.956 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:34:01.956 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:34:01.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:01.957 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:34:01.957 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:34:01.957 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:34:01.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:01.958 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:34:01.958 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:34:01.959 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:34:01.959 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:01.969 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:34:01.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:34:01.974 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:34:01.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:34:01.976 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:34:01.976 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:34:02.013 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:34:02.013 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:02.022 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:34:02.022 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:02.023 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:34:02.024 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:02.095 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:34:02.114 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:34:02.115 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:34:07.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-16T07:34:07.969 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:34:07.969 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:34:07.973 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:34:07.973 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:07.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:34:08.067 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:34:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 -- 172.21.15.114:0/1268977131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c0b4cf0 msgr2=0x7f853c06eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 --2- 172.21.15.114:0/1268977131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c0b4cf0 0x7f853c06eff0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8534009840 tx=0x7f853401c790 comp rx=0 tx=0).stop 2024-09-16T07:34:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 -- 172.21.15.114:0/1268977131 shutdown_connections 2024-09-16T07:34:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 --2- 172.21.15.114:0/1268977131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c0b4cf0 0x7f853c06eff0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 --2- 172.21.15.114:0/1268977131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f853c0cc2a0 0x7f853c06eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 -- 172.21.15.114:0/1268977131 >> 172.21.15.114:0/1268977131 conn(0x7f853c0b18f0 msgr2=0x7f853c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 -- 172.21.15.114:0/1268977131 shutdown_connections 2024-09-16T07:34:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.130+0000 7f8544600640 1 -- 172.21.15.114:0/1268977131 wait complete. 2024-09-16T07:34:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 Processor -- start 2024-09-16T07:34:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 -- start start 2024-09-16T07:34:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f853c0b4cf0 0x7f853c09d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c15e260 0x7f853c164c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f853c15d790 0x7f853c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f853c168210 con 0x7f853c15d790 2024-09-16T07:34:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f853c168090 con 0x7f853c15e260 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f853c168390 con 0x7f853c0b4cf0 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f853c15d790 0x7f853c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f853c15d790 0x7f853c157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54114/0 (socket says 172.21.15.114:54114) 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 -- 172.21.15.114:0/893725239 learned_addr learned my addr 172.21.15.114:0/893725239 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8541c00640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f853c0b4cf0 0x7f853c09d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8541200640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c15e260 0x7f853c164c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 -- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f853c0b4cf0 msgr2=0x7f853c09d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f853c0b4cf0 0x7f853c09d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 -- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c15e260 msgr2=0x7f853c164c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:08.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c15e260 0x7f853c164c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 -- 172.21.15.114:0/893725239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853c15a910 con 0x7f853c15d790 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8541200640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c15e260 0x7f853c164c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8542600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f853c15d790 0x7f853c157720 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f853401a3c0 tx=0x7f85340a57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8539600640 1 -- 172.21.15.114:0/893725239 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85340b2040 con 0x7f853c15d790 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853c15abf0 con 0x7f853c15d790 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8539600640 1 -- 172.21.15.114:0/893725239 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85340044b0 con 0x7f853c15d790 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8539600640 1 -- 172.21.15.114:0/893725239 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534005260 con 0x7f853c15d790 2024-09-16T07:34:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853c15b1b0 con 0x7f853c15d790 2024-09-16T07:34:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.134+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f853c069410 con 0x7f853c15d790 2024-09-16T07:34:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.138+0000 7f8539600640 1 -- 172.21.15.114:0/893725239 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f85340be060 con 0x7f853c15d790 2024-09-16T07:34:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.138+0000 7f8539600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f851c073340 0x7f851c075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.138+0000 7f8539600640 1 -- 172.21.15.114:0/893725239 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f853412dc40 con 0x7f853c15d790 2024-09-16T07:34:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.138+0000 7f8541c00640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f851c073340 0x7f851c075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.138+0000 7f8541c00640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f851c073340 0x7f851c075800 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85300020c0 tx=0x7f8530009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.142+0000 7f8539600640 1 -- 172.21.15.114:0/893725239 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8534016410 con 0x7f853c15d790 2024-09-16T07:34:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:08.318+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f853c0b2bf0 con 0x7f853c15d790 2024-09-16T07:34:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.594+0000 7f8539600640 1 -- 172.21.15.114:0/893725239 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7f85340f8900 con 0x7f853c15d790 2024-09-16T07:34:09.595 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:34:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f851c073340 msgr2=0x7f851c075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f851c073340 0x7f851c075800 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f85300020c0 tx=0x7f8530009040 comp rx=0 tx=0).stop 2024-09-16T07:34:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f853c15d790 msgr2=0x7f853c157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f853c15d790 0x7f853c157720 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f853401a3c0 tx=0x7f85340a57d0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 shutdown_connections 2024-09-16T07:34:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f853c15d790 0x7f853c157720 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f853c15e260 0x7f853c164c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f851c073340 0x7f851c075800 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 --2- 172.21.15.114:0/893725239 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f853c0b4cf0 0x7f853c09d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 >> 172.21.15.114:0/893725239 conn(0x7f853c0b18f0 msgr2=0x7f853c072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 shutdown_connections 2024-09-16T07:34:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.598+0000 7f8544600640 1 -- 172.21.15.114:0/893725239 wait complete. 2024-09-16T07:34:09.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:34:09.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- 172.21.15.114:0/1698533507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680cc2a0 msgr2=0x7f9a6806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:09.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 --2- 172.21.15.114:0/1698533507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680cc2a0 0x7f9a6806eab0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009840 tx=0x7f9a5401c790 comp rx=0 tx=0).stop 2024-09-16T07:34:09.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- 172.21.15.114:0/1698533507 shutdown_connections 2024-09-16T07:34:09.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 --2- 172.21.15.114:0/1698533507 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680cc2a0 0x7f9a6806eab0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- 172.21.15.114:0/1698533507 >> 172.21.15.114:0/1698533507 conn(0x7f9a680b18f0 msgr2=0x7f9a680b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:09.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- 172.21.15.114:0/1698533507 shutdown_connections 2024-09-16T07:34:09.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- 172.21.15.114:0/1698533507 wait complete. 2024-09-16T07:34:09.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 Processor -- start 2024-09-16T07:34:09.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- start start 2024-09-16T07:34:09.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680b4cf0 0x7f9a681558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:09.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a6815e260 0x7f9a68149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:09.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a681f9500 0x7f9a681f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:09.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68169340 con 0x7f9a680b4cf0 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681691c0 con 0x7f9a681f9500 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a70400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9a681694c0 con 0x7f9a6815e260 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680b4cf0 0x7f9a681558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680b4cf0 0x7f9a681558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54132/0 (socket says 172.21.15.114:54132) 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 -- 172.21.15.114:0/509641286 learned_addr learned my addr 172.21.15.114:0/509641286 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6e400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a681f9500 0x7f9a681f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6d000640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a6815e260 0x7f9a68149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 -- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a6815e260 msgr2=0x7f9a68149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a6815e260 0x7f9a68149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 -- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a681f9500 msgr2=0x7f9a681f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a681f9500 0x7f9a681f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:09.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6da00640 1 -- 172.21.15.114:0/509641286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a681498b0 con 0x7f9a680b4cf0 2024-09-16T07:34:09.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.770+0000 7f9a6e400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a681f9500 0x7f9a681f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:09.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a6da00640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680b4cf0 0x7f9a681558e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c450 tx=0x7f9a5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:09.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a65600640 1 -- 172.21.15.114:0/509641286 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0052d0 con 0x7f9a680b4cf0 2024-09-16T07:34:09.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a65600640 1 -- 172.21.15.114:0/509641286 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a5c005470 con 0x7f9a680b4cf0 2024-09-16T07:34:09.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a65600640 1 -- 172.21.15.114:0/509641286 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c012870 con 0x7f9a680b4cf0 2024-09-16T07:34:09.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6814abf0 con 0x7f9a680b4cf0 2024-09-16T07:34:09.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a68149e30 con 0x7f9a680b4cf0 2024-09-16T07:34:09.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a680b2bf0 con 0x7f9a680b4cf0 2024-09-16T07:34:09.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a65600640 1 -- 172.21.15.114:0/509641286 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f9a5c003600 con 0x7f9a680b4cf0 2024-09-16T07:34:09.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a65600640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a48073340 0x7f9a48075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:09.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a65600640 1 -- 172.21.15.114:0/509641286 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f9a5c093db0 con 0x7f9a680b4cf0 2024-09-16T07:34:09.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.774+0000 7f9a6d000640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a48073340 0x7f9a48075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:09.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.778+0000 7f9a6d000640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a48073340 0x7f9a48075800 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a540af000 tx=0x7f9a5401afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:09.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:09.778+0000 7f9a65600640 1 -- 172.21.15.114:0/509641286 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9a5c05ed40 con 0x7f9a680b4cf0 2024-09-16T07:34:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9a680b0070 con 0x7f9a680b4cf0 2024-09-16T07:34:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a65600640 1 -- 172.21.15.114:0/509641286 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f9a5c05e640 con 0x7f9a680b4cf0 2024-09-16T07:34:10.003 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.004 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:34:10.005 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:10.006 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.008 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.010 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.011 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:34:10.014 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:34:10.015 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:34:10.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:34:10.017 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:34:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a48073340 msgr2=0x7f9a48075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a48073340 0x7f9a48075800 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9a540af000 tx=0x7f9a5401afd0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680b4cf0 msgr2=0x7f9a681558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680b4cf0 0x7f9a681558e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00c450 tx=0x7f9a5c00c910 comp rx=0 tx=0).stop 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 shutdown_connections 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a681f9500 0x7f9a681f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a48073340 0x7f9a48075800 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a6815e260 0x7f9a68149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 --2- 172.21.15.114:0/509641286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a680b4cf0 0x7f9a681558e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 >> 172.21.15.114:0/509641286 conn(0x7f9a680b18f0 msgr2=0x7f9a680b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 shutdown_connections 2024-09-16T07:34:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.006+0000 7f9a70400640 1 -- 172.21.15.114:0/509641286 wait complete. 2024-09-16T07:34:10.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:34:10.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 -- 172.21.15.114:0/2398598164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40cfe00 msgr2=0x7f08d415f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 --2- 172.21.15.114:0/2398598164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40cfe00 0x7f08d415f2d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f08d40d1a20 tx=0x7f08c001c6e0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 -- 172.21.15.114:0/2398598164 shutdown_connections 2024-09-16T07:34:10.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 --2- 172.21.15.114:0/2398598164 >> v2:172.21.15.149:3300/0 conn(0x7f08d4073880 0x7f08d4073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 --2- 172.21.15.114:0/2398598164 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40cfe00 0x7f08d415f2d0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 -- 172.21.15.114:0/2398598164 >> 172.21.15.114:0/2398598164 conn(0x7f08d40d0d50 msgr2=0x7f08d40d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:10.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 -- 172.21.15.114:0/2398598164 shutdown_connections 2024-09-16T07:34:10.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 -- 172.21.15.114:0/2398598164 wait complete. 2024-09-16T07:34:10.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 Processor -- start 2024-09-16T07:34:10.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.170+0000 7f08dc000640 1 -- start start 2024-09-16T07:34:10.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08d4073880 0x7f08d41fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40affd0 0x7f08d40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d40cfe00 0x7f08d4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f08d40cc530 con 0x7f08d40affd0 2024-09-16T07:34:10.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f08d40cc3b0 con 0x7f08d40cfe00 2024-09-16T07:34:10.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f08d40cc6b0 con 0x7f08d4073880 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40affd0 0x7f08d40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40affd0 0x7f08d40b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54162/0 (socket says 172.21.15.114:54162) 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 -- 172.21.15.114:0/2703293614 learned_addr learned my addr 172.21.15.114:0/2703293614 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08da000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d40cfe00 0x7f08d4071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 -- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08d4073880 msgr2=0x7f08d41fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d9600640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08d4073880 0x7f08d41fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08d4073880 0x7f08d41fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 -- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d40cfe00 msgr2=0x7f08d4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d40cfe00 0x7f08d4071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 -- 172.21.15.114:0/2703293614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d4159180 con 0x7f08d40affd0 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08da000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d40cfe00 0x7f08d4071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:10.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d9600640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08d4073880 0x7f08d41fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:10.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d8c00640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40affd0 0x7f08d40b1c00 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f08c001a310 tx=0x7f08c00a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:10.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d1600640 1 -- 172.21.15.114:0/2703293614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c00be070 con 0x7f08d40affd0 2024-09-16T07:34:10.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d1600640 1 -- 172.21.15.114:0/2703293614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08c0005040 con 0x7f08d40affd0 2024-09-16T07:34:10.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d415af40 con 0x7f08d40affd0 2024-09-16T07:34:10.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08d1600640 1 -- 172.21.15.114:0/2703293614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0005470 con 0x7f08d40affd0 2024-09-16T07:34:10.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d41fb1e0 con 0x7f08d40affd0 2024-09-16T07:34:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.174+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d4073cd0 con 0x7f08d40affd0 2024-09-16T07:34:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.178+0000 7f08d1600640 1 -- 172.21.15.114:0/2703293614 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f08c00046d0 con 0x7f08d40affd0 2024-09-16T07:34:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.178+0000 7f08d1600640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f08b4073340 0x7f08b4075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.178+0000 7f08d1600640 1 -- 172.21.15.114:0/2703293614 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f08c012e350 con 0x7f08d40affd0 2024-09-16T07:34:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.178+0000 7f08d9600640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f08b4073340 0x7f08b4075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.178+0000 7f08d9600640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f08b4073340 0x7f08b4075800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08c80012f0 tx=0x7f08c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:10.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.182+0000 7f08d1600640 1 -- 172.21.15.114:0/2703293614 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f08c00ac030 con 0x7f08d40affd0 2024-09-16T07:34:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.350+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f08d4074b20 con 0x7f08d40affd0 2024-09-16T07:34:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.350+0000 7f08d1600640 1 -- 172.21.15.114:0/2703293614 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) ==== 84+0+65 (secure 0 0 0) 0x7f08c00163f0 con 0x7f08d40affd0 2024-09-16T07:34:10.350 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:10.351 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:34:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:34:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:34:10.351 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:10.351 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f08b4073340 msgr2=0x7f08b4075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f08b4073340 0x7f08b4075800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f08c80012f0 tx=0x7f08c8009040 comp rx=0 tx=0).stop 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40affd0 msgr2=0x7f08d40b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40affd0 0x7f08d40b1c00 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f08c001a310 tx=0x7f08c00a6600 comp rx=0 tx=0).stop 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 shutdown_connections 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d40cfe00 0x7f08d4071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f08d40affd0 0x7f08d40b1c00 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f08b4073340 0x7f08b4075800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 --2- 172.21.15.114:0/2703293614 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f08d4073880 0x7f08d41fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 >> 172.21.15.114:0/2703293614 conn(0x7f08d40d0d50 msgr2=0x7f08d40cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 shutdown_connections 2024-09-16T07:34:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.354+0000 7f08dc000640 1 -- 172.21.15.114:0/2703293614 wait complete. 2024-09-16T07:34:10.371 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:34:10.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:34:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.518+0000 7f2707a00640 1 -- 172.21.15.114:0/1296590562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f270015fe70 msgr2=0x7f27000cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.518+0000 7f2707a00640 1 --2- 172.21.15.114:0/1296590562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f270015fe70 0x7f27000cd7f0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009870 tx=0x7f26ec01c6c0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.518+0000 7f2707a00640 1 -- 172.21.15.114:0/1296590562 shutdown_connections 2024-09-16T07:34:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.518+0000 7f2707a00640 1 --2- 172.21.15.114:0/1296590562 >> v2:172.21.15.149:3300/0 conn(0x7f27000b3440 0x7f2700073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.518+0000 7f2707a00640 1 --2- 172.21.15.114:0/1296590562 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f270015fe70 0x7f27000cd7f0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.518+0000 7f2707a00640 1 -- 172.21.15.114:0/1296590562 >> 172.21.15.114:0/1296590562 conn(0x7f27000b2140 msgr2=0x7f27000b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.518+0000 7f2707a00640 1 -- 172.21.15.114:0/1296590562 shutdown_connections 2024-09-16T07:34:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 -- 172.21.15.114:0/1296590562 wait complete. 2024-09-16T07:34:10.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 Processor -- start 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 -- start start 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000b3440 0x7f270014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27001561a0 0x7f27000b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f270015fe70 0x7f270015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2700168ed0 con 0x7f27000b3440 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2700168d50 con 0x7f270015fe70 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2700169050 con 0x7f27001561a0 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000b3440 0x7f270014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000b3440 0x7f270014f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54180/0 (socket says 172.21.15.114:54180) 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 -- 172.21.15.114:0/3815165112 learned_addr learned my addr 172.21.15.114:0/3815165112 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 -- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27001561a0 msgr2=0x7f27000b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27001561a0 0x7f27000b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 -- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f270015fe70 msgr2=0x7f270015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f270015fe70 0x7f270015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f270015fe70 0x7f270015b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 -- 172.21.15.114:0/3815165112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270014f8a0 con 0x7f27000b3440 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f270015fe70 0x7f270015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2705000640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000b3440 0x7f270014f360 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c7f0 tx=0x7f26f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f26fcc00640 1 -- 172.21.15.114:0/3815165112 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0017070 con 0x7f27000b3440 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f26fcc00640 1 -- 172.21.15.114:0/3815165112 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26f0005070 con 0x7f27000b3440 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2700159ea0 con 0x7f27000b3440 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f26fcc00640 1 -- 172.21.15.114:0/3815165112 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f00054c0 con 0x7f27000b3440 2024-09-16T07:34:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.522+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270015a460 con 0x7f27000b3440 2024-09-16T07:34:10.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.526+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700073120 con 0x7f27000b3440 2024-09-16T07:34:10.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.526+0000 7f26fcc00640 1 -- 172.21.15.114:0/3815165112 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f26f001a070 con 0x7f27000b3440 2024-09-16T07:34:10.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.526+0000 7f26fcc00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f26e0073340 0x7f26e0075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:10.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.526+0000 7f26fcc00640 1 -- 172.21.15.114:0/3815165112 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f26f0093b00 con 0x7f27000b3440 2024-09-16T07:34:10.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.526+0000 7f26ffe00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f26e0073340 0x7f26e0075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:10.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.530+0000 7f26ffe00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f26e0073340 0x7f26e0075800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0af000 tx=0x7f26ec019460 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:10.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.530+0000 7f26fcc00640 1 -- 172.21.15.114:0/3815165112 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f26f0095e20 con 0x7f27000b3440 2024-09-16T07:34:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:10.702+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f27000cd360 con 0x7f27000b3440 2024-09-16T07:34:11.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f26fcc00640 1 -- 172.21.15.114:0/3815165112 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) ==== 138+0+0 (secure 0 0 0) 0x7f26f005e890 con 0x7f27000b3440 2024-09-16T07:34:11.620 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:34:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f26e0073340 msgr2=0x7f26e0075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f26e0073340 0x7f26e0075800 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0af000 tx=0x7f26ec019460 comp rx=0 tx=0).stop 2024-09-16T07:34:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000b3440 msgr2=0x7f270014f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000b3440 0x7f270014f360 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f26f000c7f0 tx=0x7f26f000ccb0 comp rx=0 tx=0).stop 2024-09-16T07:34:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 shutdown_connections 2024-09-16T07:34:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f270015fe70 0x7f270015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f26e0073340 0x7f26e0075800 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27001561a0 0x7f27000b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 --2- 172.21.15.114:0/3815165112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27000b3440 0x7f270014f360 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.622+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 >> 172.21.15.114:0/3815165112 conn(0x7f27000b2140 msgr2=0x7f270006fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.626+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 shutdown_connections 2024-09-16T07:34:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.626+0000 7f2707a00640 1 -- 172.21.15.114:0/3815165112 wait complete. 2024-09-16T07:34:11.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:34:11.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 -- 172.21.15.114:0/1681299883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 msgr2=0x7fdb18003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:11.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 --2- 172.21.15.114:0/1681299883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 0x7fdb18003e30 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400c2e0 tx=0x7fdb2401cf60 comp rx=0 tx=0).stop 2024-09-16T07:34:11.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb39000640 1 -- 172.21.15.114:0/1681299883 reap_dead start 2024-09-16T07:34:11.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 -- 172.21.15.114:0/1681299883 shutdown_connections 2024-09-16T07:34:11.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 -- 172.21.15.114:0/1681299883 >> 172.21.15.114:0/1681299883 conn(0x7fdb340b18f0 msgr2=0x7fdb340b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:11.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 -- 172.21.15.114:0/1681299883 shutdown_connections 2024-09-16T07:34:11.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 -- 172.21.15.114:0/1681299883 wait complete. 2024-09-16T07:34:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 Processor -- start 2024-09-16T07:34:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.806+0000 7fdb3b000640 1 -- start start 2024-09-16T07:34:11.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 0x7fdb341fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:11.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb340b0230 0x7fdb341626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:11.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb340b06b0 0x7fdb341413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:11.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340cf050 con 0x7fdb18003a10 2024-09-16T07:34:11.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340ceed0 con 0x7fdb340b06b0 2024-09-16T07:34:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdb340cf1d0 con 0x7fdb340b0230 2024-09-16T07:34:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 0x7fdb341fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 0x7fdb341fbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54194/0 (socket says 172.21.15.114:54194) 2024-09-16T07:34:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 -- 172.21.15.114:0/1569187595 learned_addr learned my addr 172.21.15.114:0/1569187595 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb39000640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb340b06b0 0x7fdb341413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb2b400640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb340b0230 0x7fdb341626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 -- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb340b0230 msgr2=0x7fdb341626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb340b0230 0x7fdb341626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 -- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb340b06b0 msgr2=0x7fdb341413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb340b06b0 0x7fdb341413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 -- 172.21.15.114:0/1569187595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb341fbff0 con 0x7fdb18003a10 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb33e00640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 0x7fdb341fbab0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fdb24006040 tx=0x7fdb24006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb30c00640 1 -- 172.21.15.114:0/1569187595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb240a5b70 con 0x7fdb18003a10 2024-09-16T07:34:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb30c00640 1 -- 172.21.15.114:0/1569187595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb240014e0 con 0x7fdb18003a10 2024-09-16T07:34:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3409ad40 con 0x7fdb18003a10 2024-09-16T07:34:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb30c00640 1 -- 172.21.15.114:0/1569187595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24006330 con 0x7fdb18003a10 2024-09-16T07:34:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb340afa30 con 0x7fdb18003a10 2024-09-16T07:34:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.810+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb34069410 con 0x7fdb18003a10 2024-09-16T07:34:11.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.814+0000 7fdb30c00640 1 -- 172.21.15.114:0/1569187595 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fdb240c2440 con 0x7fdb18003a10 2024-09-16T07:34:11.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.814+0000 7fdb30c00640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb10073340 0x7fdb10075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:11.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.814+0000 7fdb30c00640 1 -- 172.21.15.114:0/1569187595 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5227+0+0 (secure 0 0 0) 0x7fdb2412e270 con 0x7fdb18003a10 2024-09-16T07:34:11.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.814+0000 7fdb2b400640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb10073340 0x7fdb10075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:11.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.814+0000 7fdb2b400640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb10073340 0x7fdb10075800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb3415cfc0 tx=0x7fdb1c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.818+0000 7fdb30c00640 1 -- 172.21.15.114:0/1569187595 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdb341fbff0 con 0x7fdb18003a10 2024-09-16T07:34:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:11.986+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdb340b42d0 con 0x7fdb18003a10 2024-09-16T07:34:12.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb30c00640 1 -- 172.21.15.114:0/1569187595 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) ==== 170+0+0 (secure 0 0 0) 0x7fdb24016d10 con 0x7fdb18003a10 2024-09-16T07:34:12.627 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb10073340 msgr2=0x7fdb10075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb10073340 0x7fdb10075800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb3415cfc0 tx=0x7fdb1c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 msgr2=0x7fdb341fbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 0x7fdb341fbab0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fdb24006040 tx=0x7fdb24006d30 comp rx=0 tx=0).stop 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 shutdown_connections 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb340b06b0 0x7fdb341413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb10073340 0x7fdb10075800 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdb340b0230 0x7fdb341626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 --2- 172.21.15.114:0/1569187595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb18003a10 0x7fdb341fbab0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 >> 172.21.15.114:0/1569187595 conn(0x7fdb340b18f0 msgr2=0x7fdb340cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:12.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 shutdown_connections 2024-09-16T07:34:12.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.630+0000 7fdb3b000640 1 -- 172.21.15.114:0/1569187595 wait complete. 2024-09-16T07:34:12.666 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:34:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.814+0000 7fab92800640 1 -- 172.21.15.114:0/3888365646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74003c20 msgr2=0x7fab74004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.814+0000 7fab92800640 1 --2- 172.21.15.114:0/3888365646 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74003c20 0x7fab74004020 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab80006fd0 tx=0x7fab8001f660 comp rx=0 tx=0).stop 2024-09-16T07:34:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.814+0000 7fab91e00640 1 -- 172.21.15.114:0/3888365646 reap_dead start 2024-09-16T07:34:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.814+0000 7fab92800640 1 -- 172.21.15.114:0/3888365646 shutdown_connections 2024-09-16T07:34:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.814+0000 7fab92800640 1 -- 172.21.15.114:0/3888365646 >> 172.21.15.114:0/3888365646 conn(0x7fab8c09aa10 msgr2=0x7fab8c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.814+0000 7fab92800640 1 -- 172.21.15.114:0/3888365646 shutdown_connections 2024-09-16T07:34:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.814+0000 7fab92800640 1 -- 172.21.15.114:0/3888365646 wait complete. 2024-09-16T07:34:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 Processor -- start 2024-09-16T07:34:12.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 -- start start 2024-09-16T07:34:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74003c20 0x7fab8c1f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8c0b5ae0 0x7fab8c14c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8c0afbb0 0x7fab8c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c0ccd30 con 0x7fab8c0afbb0 2024-09-16T07:34:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c0d1f30 con 0x7fab74003c20 2024-09-16T07:34:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab8c0cceb0 con 0x7fab8c0b5ae0 2024-09-16T07:34:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8c0afbb0 0x7fab8c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8c0afbb0 0x7fab8c0b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54216/0 (socket says 172.21.15.114:54216) 2024-09-16T07:34:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 -- 172.21.15.114:0/958357461 learned_addr learned my addr 172.21.15.114:0/958357461 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91400640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74003c20 0x7fab8c1f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab90a00640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8c0b5ae0 0x7fab8c14c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 -- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8c0b5ae0 msgr2=0x7fab8c14c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8c0b5ae0 0x7fab8c14c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 -- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74003c20 msgr2=0x7fab8c1f8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74003c20 0x7fab8c1f8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 -- 172.21.15.114:0/958357461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c0c6920 con 0x7fab8c0afbb0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab91e00640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8c0afbb0 0x7fab8c0b0030 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0731c0 tx=0x7fab84006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab89600640 1 -- 172.21.15.114:0/958357461 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84001ba0 con 0x7fab8c0afbb0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab89600640 1 -- 172.21.15.114:0/958357461 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab84018070 con 0x7fab8c0afbb0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab89600640 1 -- 172.21.15.114:0/958357461 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8400fd00 con 0x7fab8c0afbb0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c0b6020 con 0x7fab8c0afbb0 2024-09-16T07:34:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.818+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c0b62e0 con 0x7fab8c0afbb0 2024-09-16T07:34:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.822+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c0b0570 con 0x7fab8c0afbb0 2024-09-16T07:34:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.822+0000 7fab89600640 1 -- 172.21.15.114:0/958357461 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fab8401d460 con 0x7fab8c0afbb0 2024-09-16T07:34:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.822+0000 7fab89600640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fab6c073340 0x7fab6c075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.822+0000 7fab89600640 1 -- 172.21.15.114:0/958357461 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5609+0+0 (secure 0 0 0) 0x7fab84095600 con 0x7fab8c0afbb0 2024-09-16T07:34:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.822+0000 7fab91400640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fab6c073340 0x7fab6c075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.826+0000 7fab91400640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fab6c073340 0x7fab6c075800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fab800b0000 tx=0x7fab8001c4a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:12.826+0000 7fab89600640 1 -- 172.21.15.114:0/958357461 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fab84060310 con 0x7fab8c0afbb0 2024-09-16T07:34:13.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.026+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fab8c0c6af0 con 0x7fab8c0afbb0 2024-09-16T07:34:13.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.630+0000 7fab89600640 1 -- 172.21.15.114:0/958357461 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v79) ==== 174+0+0 (secure 0 0 0) 0x7fab8405fc10 con 0x7fab8c0afbb0 2024-09-16T07:34:13.629 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 18 and data pool 19 2024-09-16T07:34:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.634+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fab6c073340 msgr2=0x7fab6c075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.634+0000 7fab92800640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fab6c073340 0x7fab6c075800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fab800b0000 tx=0x7fab8001c4a0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.634+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8c0afbb0 msgr2=0x7fab8c0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.634+0000 7fab92800640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8c0afbb0 0x7fab8c0b0030 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0731c0 tx=0x7fab84006660 comp rx=0 tx=0).stop 2024-09-16T07:34:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 shutdown_connections 2024-09-16T07:34:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab8c0afbb0 0x7fab8c0b0030 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fab6c073340 0x7fab6c075800 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab8c0b5ae0 0x7fab8c14c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 --2- 172.21.15.114:0/958357461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab74003c20 0x7fab8c1f8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 >> 172.21.15.114:0/958357461 conn(0x7fab8c09aa10 msgr2=0x7fab8c071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:13.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 shutdown_connections 2024-09-16T07:34:13.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.638+0000 7fab92800640 1 -- 172.21.15.114:0/958357461 wait complete. 2024-09-16T07:34:13.679 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- 172.21.15.114:0/128582652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 msgr2=0x7fa6540cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 --2- 172.21.15.114:0/128582652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa6540cf660 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa6540c7920 tx=0x7fa64801d7e0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- 172.21.15.114:0/128582652 shutdown_connections 2024-09-16T07:34:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 --2- 172.21.15.114:0/128582652 >> v2:172.21.15.149:3300/0 conn(0x7fa6540d2440 0x7fa6540d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 --2- 172.21.15.114:0/128582652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa6540cf660 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- 172.21.15.114:0/128582652 >> 172.21.15.114:0/128582652 conn(0x7fa6540d3fe0 msgr2=0x7fa6540d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- 172.21.15.114:0/128582652 shutdown_connections 2024-09-16T07:34:13.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- 172.21.15.114:0/128582652 wait complete. 2024-09-16T07:34:13.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 Processor -- start 2024-09-16T07:34:13.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- start start 2024-09-16T07:34:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6540d09f0 0x7fa65414e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa65415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6540d2440 0x7fa654158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa65416ba40 con 0x7fa6540d2060 2024-09-16T07:34:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa65416b8c0 con 0x7fa6540d09f0 2024-09-16T07:34:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa65c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa65416bbc0 con 0x7fa6540d2440 2024-09-16T07:34:13.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa658c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa65415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:13.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa658c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa65415c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54230/0 (socket says 172.21.15.114:54230) 2024-09-16T07:34:13.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa658c00640 1 -- 172.21.15.114:0/2918851733 learned_addr learned my addr 172.21.15.114:0/2918851733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:13.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.826+0000 7fa659600640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6540d09f0 0x7fa65414e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:13.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa65a000640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6540d2440 0x7fa654158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:13.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa658c00640 1 -- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6540d2440 msgr2=0x7fa654158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:13.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa658c00640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6540d2440 0x7fa654158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa658c00640 1 -- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6540d09f0 msgr2=0x7fa65414e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:13.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa658c00640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6540d09f0 0x7fa65414e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:13.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa658c00640 1 -- 172.21.15.114:0/2918851733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65415b040 con 0x7fa6540d2060 2024-09-16T07:34:13.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa658c00640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa65415c0e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa64000d950 tx=0x7fa64000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:13.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa651600640 1 -- 172.21.15.114:0/2918851733 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640017070 con 0x7fa6540d2060 2024-09-16T07:34:13.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa651600640 1 -- 172.21.15.114:0/2918851733 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa640009d20 con 0x7fa6540d2060 2024-09-16T07:34:13.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa651600640 1 -- 172.21.15.114:0/2918851733 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6400106c0 con 0x7fa6540d2060 2024-09-16T07:34:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65415b320 con 0x7fa6540d2060 2024-09-16T07:34:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65415b8e0 con 0x7fa6540d2060 2024-09-16T07:34:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6540cf660 con 0x7fa6540d2060 2024-09-16T07:34:13.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa651600640 1 -- 172.21.15.114:0/2918851733 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fa64001a070 con 0x7fa6540d2060 2024-09-16T07:34:13.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa651600640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa634073340 0x7fa634075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.830+0000 7fa651600640 1 -- 172.21.15.114:0/2918851733 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fa640094860 con 0x7fa6540d2060 2024-09-16T07:34:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.834+0000 7fa659600640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa634073340 0x7fa634075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.834+0000 7fa659600640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa634073340 0x7fa634075800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa6480af000 tx=0x7fa64801b5c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:13.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:13.838+0000 7fa651600640 1 -- 172.21.15.114:0/2918851733 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa64005ec50 con 0x7fa6540d2060 2024-09-16T07:34:14.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.002+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6540d07d0 con 0x7fa6540d2060 2024-09-16T07:34:14.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa651600640 1 -- 172.21.15.114:0/2918851733 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16800 (secure 0 0 0) 0x7fa640063680 con 0x7fa6540d2060 2024-09-16T07:34:14.004 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:14.004 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:13.032385+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:10.716126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:12.002125+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa634073340 msgr2=0x7fa634075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa634073340 0x7fa634075800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa6480af000 tx=0x7fa64801b5c0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 msgr2=0x7fa65415c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa65415c0e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa64000d950 tx=0x7fa64000de10 comp rx=0 tx=0).stop 2024-09-16T07:34:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 shutdown_connections 2024-09-16T07:34:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa634073340 0x7fa634075800 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6540d2440 0x7fa654158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6540d2060 0x7fa65415c0e0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 --2- 172.21.15.114:0/2918851733 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6540d09f0 0x7fa65414e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 >> 172.21.15.114:0/2918851733 conn(0x7fa6540d3fe0 msgr2=0x7fa6540d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 shutdown_connections 2024-09-16T07:34:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.006+0000 7fa65c000640 1 -- 172.21.15.114:0/2918851733 wait complete. 2024-09-16T07:34:14.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:14.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-16T07:34:14.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 -- 172.21.15.114:0/3830628993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 msgr2=0x7fb8000cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 --2- 172.21.15.114:0/3830628993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb8000cb020 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009840 tx=0x7fb7ec01f010 comp rx=0 tx=0).stop 2024-09-16T07:34:14.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 -- 172.21.15.114:0/3830628993 shutdown_connections 2024-09-16T07:34:14.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 --2- 172.21.15.114:0/3830628993 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb8000cb020 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 -- 172.21.15.114:0/3830628993 >> 172.21.15.114:0/3830628993 conn(0x7fb800073490 msgr2=0x7fb8000d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:14.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 -- 172.21.15.114:0/3830628993 shutdown_connections 2024-09-16T07:34:14.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 -- 172.21.15.114:0/3830628993 wait complete. 2024-09-16T07:34:14.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 Processor -- start 2024-09-16T07:34:14.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.170+0000 7fb7ff200640 1 -- start start 2024-09-16T07:34:14.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb800157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8000af400 0x7fb80009bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb80015f0c0 0x7fb80009c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb8000cbc70 con 0x7fb800074a50 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb80015f6b0 con 0x7fb8000af400 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb8000cbdf0 con 0x7fb80015f0c0 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb800157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb800157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41966/0 (socket says 172.21.15.114:41966) 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 -- 172.21.15.114:0/2429493027 learned_addr learned my addr 172.21.15.114:0/2429493027 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fe800640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb80015f0c0 0x7fb80009c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fd400640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8000af400 0x7fb80009bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 -- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb80015f0c0 msgr2=0x7fb80009c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb80015f0c0 0x7fb80009c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 -- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8000af400 msgr2=0x7fb80009bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8000af400 0x7fb80009bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 -- 172.21.15.114:0/2429493027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8000ca550 con 0x7fb800074a50 2024-09-16T07:34:14.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7fde00640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb800157140 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c400 tx=0x7fb7f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7f6000640 1 -- 172.21.15.114:0/2429493027 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0011790 con 0x7fb800074a50 2024-09-16T07:34:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7f6000640 1 -- 172.21.15.114:0/2429493027 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7f0017070 con 0x7fb800074a50 2024-09-16T07:34:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80009ad30 con 0x7fb800074a50 2024-09-16T07:34:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7f6000640 1 -- 172.21.15.114:0/2429493027 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0011cc0 con 0x7fb800074a50 2024-09-16T07:34:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb800157680 con 0x7fb800074a50 2024-09-16T07:34:14.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.174+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb800074340 con 0x7fb800074a50 2024-09-16T07:34:14.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.178+0000 7fb7f6000640 1 -- 172.21.15.114:0/2429493027 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fb7f001c460 con 0x7fb800074a50 2024-09-16T07:34:14.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.178+0000 7fb7f6000640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7e0073340 0x7fb7e0075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.178+0000 7fb7f6000640 1 -- 172.21.15.114:0/2429493027 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fb7f0094290 con 0x7fb800074a50 2024-09-16T07:34:14.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.178+0000 7fb7fd400640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7e0073340 0x7fb7e0075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.178+0000 7fb7fd400640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7e0073340 0x7fb7e0075800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0b2000 tx=0x7fb7ec01d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:14.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.182+0000 7fb7f6000640 1 -- 172.21.15.114:0/2429493027 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb7f005e7b0 con 0x7fb800074a50 2024-09-16T07:34:14.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.350+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb800069dd0 con 0x7fb800074a50 2024-09-16T07:34:14.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.350+0000 7fb7f6000640 1 -- 172.21.15.114:0/2429493027 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16800 (secure 0 0 0) 0x7fb7f00631e0 con 0x7fb800074a50 2024-09-16T07:34:14.349 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:14.350 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:13.032385+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:10.716126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:12.002125+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7e0073340 msgr2=0x7fb7e0075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7e0073340 0x7fb7e0075800 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0b2000 tx=0x7fb7ec01d850 comp rx=0 tx=0).stop 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 msgr2=0x7fb800157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb800157140 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c400 tx=0x7fb7f000c8c0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 shutdown_connections 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7e0073340 0x7fb7e0075800 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb80015f0c0 0x7fb80009c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8000af400 0x7fb80009bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 --2- 172.21.15.114:0/2429493027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb800074a50 0x7fb800157140 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 >> 172.21.15.114:0/2429493027 conn(0x7fb800073490 msgr2=0x7fb8000ad310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 shutdown_connections 2024-09-16T07:34:14.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.354+0000 7fb7ff200640 1 -- 172.21.15.114:0/2429493027 wait complete. 2024-09-16T07:34:14.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:34:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- 172.21.15.114:0/540062829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 msgr2=0x7f1e680affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 --2- 172.21.15.114:0/540062829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680affc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f1e68073990 tx=0x7f1e6001cd80 comp rx=0 tx=0).stop 2024-09-16T07:34:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- 172.21.15.114:0/540062829 shutdown_connections 2024-09-16T07:34:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 --2- 172.21.15.114:0/540062829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680affc0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 --2- 172.21.15.114:0/540062829 >> v2:172.21.15.149:3300/0 conn(0x7f1e680b1650 0x7f1e680b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- 172.21.15.114:0/540062829 >> 172.21.15.114:0/540062829 conn(0x7f1e680d1dd0 msgr2=0x7f1e680d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:14.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- 172.21.15.114:0/540062829 shutdown_connections 2024-09-16T07:34:14.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- 172.21.15.114:0/540062829 wait complete. 2024-09-16T07:34:14.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 Processor -- start 2024-09-16T07:34:14.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- start start 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e680b1650 0x7f1e6815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e681605d0 0x7f1e680b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68169540 con 0x7f1e680afb10 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e680b1430 con 0x7f1e680b1650 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6f600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1e681696c0 con 0x7f1e681605d0 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41984/0 (socket says 172.21.15.114:41984) 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 -- 172.21.15.114:0/287933598 learned_addr learned my addr 172.21.15.114:0/287933598 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e5fe00640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e680b1650 0x7f1e6815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6d600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e681605d0 0x7f1e680b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 -- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e681605d0 msgr2=0x7f1e680b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e681605d0 0x7f1e680b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 -- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e680b1650 msgr2=0x7f1e6815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e680b1650 0x7f1e6815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 -- 172.21.15.114:0/287933598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e680ce410 con 0x7f1e680afb10 2024-09-16T07:34:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.518+0000 7f1e6cc00640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680ce710 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800c3c0 tx=0x7f1e5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e65600640 1 -- 172.21.15.114:0/287933598 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58017070 con 0x7f1e680afb10 2024-09-16T07:34:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e65600640 1 -- 172.21.15.114:0/287933598 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e580053c0 con 0x7f1e680afb10 2024-09-16T07:34:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e680ccd20 con 0x7f1e680afb10 2024-09-16T07:34:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e65600640 1 -- 172.21.15.114:0/287933598 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58003860 con 0x7f1e680afb10 2024-09-16T07:34:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e680cd2e0 con 0x7f1e680afb10 2024-09-16T07:34:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e680affc0 con 0x7f1e680afb10 2024-09-16T07:34:14.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e65600640 1 -- 172.21.15.114:0/287933598 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f1e5801a070 con 0x7f1e680afb10 2024-09-16T07:34:14.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e65600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e44073340 0x7f1e44075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e65600640 1 -- 172.21.15.114:0/287933598 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f1e58093a00 con 0x7f1e680afb10 2024-09-16T07:34:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.522+0000 7f1e5fe00640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e44073340 0x7f1e44075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.526+0000 7f1e5fe00640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e44073340 0x7f1e44075800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e680cec50 tx=0x7f1e5000b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.526+0000 7f1e65600640 1 -- 172.21.15.114:0/287933598 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1e5805de30 con 0x7f1e680afb10 2024-09-16T07:34:14.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:14.734+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1e680d1080 con 0x7f1e680afb10 2024-09-16T07:34:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.658+0000 7f1e65600640 1 -- 172.21.15.114:0/287933598 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7f1e58062860 con 0x7f1e680afb10 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e44073340 msgr2=0x7f1e44075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e44073340 0x7f1e44075800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e680cec50 tx=0x7f1e5000b390 comp rx=0 tx=0).stop 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 msgr2=0x7f1e680ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680ce710 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800c3c0 tx=0x7f1e5800c880 comp rx=0 tx=0).stop 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 shutdown_connections 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e44073340 0x7f1e44075800 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e681605d0 0x7f1e680b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e680b1650 0x7f1e6815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 --2- 172.21.15.114:0/287933598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e680afb10 0x7f1e680ce710 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:15.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 >> 172.21.15.114:0/287933598 conn(0x7f1e680d1dd0 msgr2=0x7f1e6815c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 shutdown_connections 2024-09-16T07:34:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.662+0000 7f1e6f600640 1 -- 172.21.15.114:0/287933598 wait complete. 2024-09-16T07:34:15.681 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:34:15.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:34:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 -- 172.21.15.114:0/3302085056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93940b49e0 msgr2=0x7f939406f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 --2- 172.21.15.114:0/3302085056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93940b49e0 0x7f939406f7b0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f938c009840 tx=0x7f938c01c700 comp rx=0 tx=0).stop 2024-09-16T07:34:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 -- 172.21.15.114:0/3302085056 shutdown_connections 2024-09-16T07:34:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 --2- 172.21.15.114:0/3302085056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f93940b49e0 0x7f939406f7b0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 -- 172.21.15.114:0/3302085056 >> 172.21.15.114:0/3302085056 conn(0x7f93940b18f0 msgr2=0x7f93940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 -- 172.21.15.114:0/3302085056 shutdown_connections 2024-09-16T07:34:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 -- 172.21.15.114:0/3302085056 wait complete. 2024-09-16T07:34:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 Processor -- start 2024-09-16T07:34:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.830+0000 7f939b400640 1 -- start start 2024-09-16T07:34:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93940b49e0 0x7f93941502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93940cd100 0x7f93941564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939415dae0 0x7f93940735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9394168e90 con 0x7f939415dae0 2024-09-16T07:34:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9394168d10 con 0x7f93940cd100 2024-09-16T07:34:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9394169010 con 0x7f93940b49e0 2024-09-16T07:34:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939415dae0 0x7f93940735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939415dae0 0x7f93940735b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42000/0 (socket says 172.21.15.114:42000) 2024-09-16T07:34:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 -- 172.21.15.114:0/2931416296 learned_addr learned my addr 172.21.15.114:0/2931416296 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9393e00640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93940cd100 0x7f93941564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9398a00640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93940b49e0 0x7f93941502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 -- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93940b49e0 msgr2=0x7f93941502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93940b49e0 0x7f93941502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 -- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93940cd100 msgr2=0x7f93941564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93940cd100 0x7f93941564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 -- 172.21.15.114:0/2931416296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93941fcaa0 con 0x7f939415dae0 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9398a00640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93940b49e0 0x7f93941502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9399400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939415dae0 0x7f93940735b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f938c01a330 tx=0x7f938c0a8720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:15.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9390c00640 1 -- 172.21.15.114:0/2931416296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c004030 con 0x7f939415dae0 2024-09-16T07:34:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9390c00640 1 -- 172.21.15.114:0/2931416296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f938c0041d0 con 0x7f939415dae0 2024-09-16T07:34:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f9390c00640 1 -- 172.21.15.114:0/2931416296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c005140 con 0x7f939415dae0 2024-09-16T07:34:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93941fbf20 con 0x7f939415dae0 2024-09-16T07:34:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93941fc4e0 con 0x7f939415dae0 2024-09-16T07:34:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.834+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93940ce810 con 0x7f939415dae0 2024-09-16T07:34:15.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.838+0000 7f9390c00640 1 -- 172.21.15.114:0/2931416296 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f938c0052e0 con 0x7f939415dae0 2024-09-16T07:34:15.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.838+0000 7f9390c00640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9374073340 0x7f9374075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:15.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.838+0000 7f9390c00640 1 -- 172.21.15.114:0/2931416296 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f938c12ebe0 con 0x7f939415dae0 2024-09-16T07:34:15.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.838+0000 7f9398a00640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9374073340 0x7f9374075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:15.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.838+0000 7f9398a00640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9374073340 0x7f9374075800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93940cc5f0 tx=0x7f9384009570 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:15.842+0000 7f9390c00640 1 -- 172.21.15.114:0/2931416296 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f938c0ac030 con 0x7f939415dae0 2024-09-16T07:34:16.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.042+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f93940adeb0 con 0x7f939415dae0 2024-09-16T07:34:16.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.666+0000 7f9390c00640 1 -- 172.21.15.114:0/2931416296 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7f938c016410 con 0x7f939415dae0 2024-09-16T07:34:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9374073340 msgr2=0x7f9374075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9374073340 0x7f9374075800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93940cc5f0 tx=0x7f9384009570 comp rx=0 tx=0).stop 2024-09-16T07:34:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939415dae0 msgr2=0x7f93940735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939415dae0 0x7f93940735b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f938c01a330 tx=0x7f938c0a8720 comp rx=0 tx=0).stop 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 shutdown_connections 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f939415dae0 0x7f93940735b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93940cd100 0x7f93941564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9374073340 0x7f9374075800 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 --2- 172.21.15.114:0/2931416296 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f93940b49e0 0x7f93941502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 >> 172.21.15.114:0/2931416296 conn(0x7f93940b18f0 msgr2=0x7f93940cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 shutdown_connections 2024-09-16T07:34:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.670+0000 7f939b400640 1 -- 172.21.15.114:0/2931416296 wait complete. 2024-09-16T07:34:16.688 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:34:16.689 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 -- 172.21.15.114:0/1203004328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04980b2590 msgr2=0x7f04980b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 --2- 172.21.15.114:0/1203004328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04980b2590 0x7f04980b2a00 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0490009c80 tx=0x7f049001cd10 comp rx=0 tx=0).stop 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 -- 172.21.15.114:0/1203004328 shutdown_connections 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 --2- 172.21.15.114:0/1203004328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04980b2590 0x7f04980b2a00 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 --2- 172.21.15.114:0/1203004328 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04980d01b0 0x7f04980cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 -- 172.21.15.114:0/1203004328 >> 172.21.15.114:0/1203004328 conn(0x7f049809aa10 msgr2=0x7f049809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 -- 172.21.15.114:0/1203004328 shutdown_connections 2024-09-16T07:34:16.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 -- 172.21.15.114:0/1203004328 wait complete. 2024-09-16T07:34:16.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 Processor -- start 2024-09-16T07:34:16.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.834+0000 7f0497200640 1 -- start start 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2590 0x7f049806f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04980d01b0 0x7f0498159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f049815f000 0x7f04980ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0498168ea0 con 0x7f049815f000 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0498168d20 con 0x7f04980b2590 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0498169020 con 0x7f04980d01b0 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f049815f000 0x7f04980ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:16.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f049815f000 0x7f04980ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42012/0 (socket says 172.21.15.114:42012) 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 -- 172.21.15.114:0/2753041666 learned_addr learned my addr 172.21.15.114:0/2753041666 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0495e00640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2590 0x7f049806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0495400640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04980d01b0 0x7f0498159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 -- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04980d01b0 msgr2=0x7f0498159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04980d01b0 0x7f0498159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 -- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2590 msgr2=0x7f049806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2590 0x7f049806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 -- 172.21.15.114:0/2753041666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04981f7d50 con 0x7f049815f000 2024-09-16T07:34:16.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0496800640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f049815f000 0x7f04980ae9a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0490009bd0 tx=0x7f0490009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:16.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f048e000640 1 -- 172.21.15.114:0/2753041666 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900bb070 con 0x7f049815f000 2024-09-16T07:34:16.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f048e000640 1 -- 172.21.15.114:0/2753041666 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0490004c00 con 0x7f049815f000 2024-09-16T07:34:16.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049806dd30 con 0x7f049815f000 2024-09-16T07:34:16.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f048e000640 1 -- 172.21.15.114:0/2753041666 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900b2040 con 0x7f049815f000 2024-09-16T07:34:16.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04981f82d0 con 0x7f049815f000 2024-09-16T07:34:16.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.838+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04980b2a00 con 0x7f049815f000 2024-09-16T07:34:16.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.842+0000 7f048e000640 1 -- 172.21.15.114:0/2753041666 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f04900be070 con 0x7f049815f000 2024-09-16T07:34:16.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.842+0000 7f048e000640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0478073340 0x7f0478075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:16.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.842+0000 7f048e000640 1 -- 172.21.15.114:0/2753041666 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f049012e510 con 0x7f049815f000 2024-09-16T07:34:16.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.842+0000 7f0495e00640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0478073340 0x7f0478075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:16.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.842+0000 7f0495e00640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0478073340 0x7f0478075800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f048800b810 tx=0x7f0488008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:16.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:16.846+0000 7f048e000640 1 -- 172.21.15.114:0/2753041666 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0490016990 con 0x7f049815f000 2024-09-16T07:34:17.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.046+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04980cd480 con 0x7f049815f000 2024-09-16T07:34:17.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.046+0000 7f048e000640 1 -- 172.21.15.114:0/2753041666 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5231 (secure 0 0 0) 0x7f049012ce20 con 0x7f049815f000 2024-09-16T07:34:17.045 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:17.045 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"btime":"2024-09-16T07:34:16:663795+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/229459534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":229459534},{"type":"v1","addr":"172.21.15.149:6801","nonce":229459534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2285177306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2285177306},{"type":"v1","addr":"172.21.15.149:6835","nonce":2285177306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/146376277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":146376277},{"type":"v1","addr":"172.21.15.114:6833","nonce":146376277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:13.032352+0000","modified":"2024-09-16T07:34:16.048792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7467":{"gid":7467,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1571071623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1571071623},{"type":"v1","addr":"172.21.15.114:6835","nonce":1571071623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7467,"qdb_cluster":[7467]},"id":9}]} 2024-09-16T07:34:17.045 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 83 2024-09-16T07:34:17.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0478073340 msgr2=0x7f0478075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0478073340 0x7f0478075800 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f048800b810 tx=0x7f0488008040 comp rx=0 tx=0).stop 2024-09-16T07:34:17.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f049815f000 msgr2=0x7f04980ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f049815f000 0x7f04980ae9a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0490009bd0 tx=0x7f0490009390 comp rx=0 tx=0).stop 2024-09-16T07:34:17.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 shutdown_connections 2024-09-16T07:34:17.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f049815f000 0x7f04980ae9a0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0478073340 0x7f0478075800 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f04980d01b0 0x7f0498159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 --2- 172.21.15.114:0/2753041666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04980b2590 0x7f049806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 >> 172.21.15.114:0/2753041666 conn(0x7f049809aa10 msgr2=0x7f0498075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:17.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 shutdown_connections 2024-09-16T07:34:17.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.050+0000 7f0497200640 1 -- 172.21.15.114:0/2753041666 wait complete. 2024-09-16T07:34:17.067 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:17.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 -- 172.21.15.114:0/73478502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 msgr2=0x7fc58c073da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 --2- 172.21.15.114:0/73478502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c073da0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc58c069eb0 tx=0x7fc58401cd50 comp rx=0 tx=0).stop 2024-09-16T07:34:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 -- 172.21.15.114:0/73478502 shutdown_connections 2024-09-16T07:34:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 --2- 172.21.15.114:0/73478502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c073da0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 --2- 172.21.15.114:0/73478502 >> v2:172.21.15.149:3300/0 conn(0x7fc58c0cc720 0x7fc58c15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 -- 172.21.15.114:0/73478502 >> 172.21.15.114:0/73478502 conn(0x7fc58c06dd30 msgr2=0x7fc58c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 -- 172.21.15.114:0/73478502 shutdown_connections 2024-09-16T07:34:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 -- 172.21.15.114:0/73478502 wait complete. 2024-09-16T07:34:17.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 Processor -- start 2024-09-16T07:34:17.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.210+0000 7fc592800640 1 -- start start 2024-09-16T07:34:17.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc58c0c70b0 0x7fc58c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc58c0cc720 0x7fc58c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c1689a0 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c168820 con 0x7fc58c0cc720 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc58c168b20 con 0x7fc58c0c70b0 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c0b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42026/0 (socket says 172.21.15.114:42026) 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 -- 172.21.15.114:0/3127078053 learned_addr learned my addr 172.21.15.114:0/3127078053 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc590a00640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc58c0cc720 0x7fc58c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591400640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc58c0c70b0 0x7fc58c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 -- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc58c0c70b0 msgr2=0x7fc58c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc58c0c70b0 0x7fc58c0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 -- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc58c0cc720 msgr2=0x7fc58c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc58c0cc720 0x7fc58c155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 -- 172.21.15.114:0/3127078053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c1f7d80 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc591e00640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c0b1c10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc584019960 tx=0x7fc584005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:17.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc589600640 1 -- 172.21.15.114:0/3127078053 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840bb070 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc589600640 1 -- 172.21.15.114:0/3127078053 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc584004d40 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58c1f8060 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc589600640 1 -- 172.21.15.114:0/3127078053 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840b2040 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc58c1f8620 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc58c15cc90 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.214+0000 7fc589600640 1 -- 172.21.15.114:0/3127078053 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fc5840ad850 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.218+0000 7fc589600640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc56c073340 0x7fc56c075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.218+0000 7fc589600640 1 -- 172.21.15.114:0/3127078053 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fc58412e610 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.218+0000 7fc591400640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc56c073340 0x7fc56c075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.218+0000 7fc591400640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc56c073340 0x7fc56c075800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5800058d0 tx=0x7fc580005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:17.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.222+0000 7fc589600640 1 -- 172.21.15.114:0/3127078053 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc584016970 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.390+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc58c15bf90 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.390+0000 7fc589600640 1 -- 172.21.15.114:0/3127078053 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16787 (secure 0 0 0) 0x7fc5840f91a0 con 0x7fc58c0cd0d0 2024-09-16T07:34:17.389 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:17.389 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":115,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:14.649144+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:10.716126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:12.002125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.390+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc56c073340 msgr2=0x7fc56c075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.390+0000 7fc592800640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc56c073340 0x7fc56c075800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5800058d0 tx=0x7fc580005860 comp rx=0 tx=0).stop 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 msgr2=0x7fc58c0b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c0b1c10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc584019960 tx=0x7fc584005b00 comp rx=0 tx=0).stop 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 shutdown_connections 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc58c0cd0d0 0x7fc58c0b1c10 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc58c0cc720 0x7fc58c155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc56c073340 0x7fc56c075800 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 --2- 172.21.15.114:0/3127078053 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc58c0c70b0 0x7fc58c0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 >> 172.21.15.114:0/3127078053 conn(0x7fc58c06dd30 msgr2=0x7fc58c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:17.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 shutdown_connections 2024-09-16T07:34:17.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.394+0000 7fc592800640 1 -- 172.21.15.114:0/3127078053 wait complete. 2024-09-16T07:34:17.410 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:34:17.411 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:17.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 -- 172.21.15.114:0/3614226185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800b24b0 msgr2=0x7f2c800ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/3614226185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800b24b0 0x7f2c800ce4e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009900 tx=0x7f2c6c01c790 comp rx=0 tx=0).stop 2024-09-16T07:34:17.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 -- 172.21.15.114:0/3614226185 shutdown_connections 2024-09-16T07:34:17.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/3614226185 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800b24b0 0x7f2c800ce4e0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 -- 172.21.15.114:0/3614226185 >> 172.21.15.114:0/3614226185 conn(0x7f2c8009aa10 msgr2=0x7f2c8009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:17.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 -- 172.21.15.114:0/3614226185 shutdown_connections 2024-09-16T07:34:17.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 -- 172.21.15.114:0/3614226185 wait complete. 2024-09-16T07:34:17.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 Processor -- start 2024-09-16T07:34:17.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.554+0000 7f2c7fe00640 1 -- start start 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c800b24b0 0x7f2c800b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800cea20 0x7f2c80150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c800d1b60 0x7f2c80155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8016c980 con 0x7f2c800cea20 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8016c800 con 0x7f2c800b24b0 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8016cb00 con 0x7f2c800d1b60 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800cea20 0x7f2c80150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800cea20 0x7f2c80150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42038/0 (socket says 172.21.15.114:42038) 2024-09-16T07:34:17.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 -- 172.21.15.114:0/1580193206 learned_addr learned my addr 172.21.15.114:0/1580193206 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7ea00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c800b24b0 0x7f2c800b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 -- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c800d1b60 msgr2=0x7f2c80155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c800d1b60 0x7f2c80155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 -- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c800b24b0 msgr2=0x7f2c800b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c800b24b0 0x7f2c800b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 -- 172.21.15.114:0/1580193206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c800b7980 con 0x7f2c800cea20 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7ea00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c800b24b0 0x7f2c800b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7e000640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800cea20 0x7f2c80150500 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0193a0 tx=0x7f2c6c0a5690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c76a00640 1 -- 172.21.15.114:0/1580193206 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0b2040 con 0x7f2c800cea20 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c76a00640 1 -- 172.21.15.114:0/1580193206 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c6c0044b0 con 0x7f2c800cea20 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c76a00640 1 -- 172.21.15.114:0/1580193206 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c005280 con 0x7f2c800cea20 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c800b4ba0 con 0x7f2c800cea20 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c800b5160 con 0x7f2c800cea20 2024-09-16T07:34:17.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.558+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c800ce4e0 con 0x7f2c800cea20 2024-09-16T07:34:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.562+0000 7f2c76a00640 1 -- 172.21.15.114:0/1580193206 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f2c6c005420 con 0x7f2c800cea20 2024-09-16T07:34:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.562+0000 7f2c76a00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2c60073340 0x7f2c60075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.562+0000 7f2c76a00640 1 -- 172.21.15.114:0/1580193206 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f2c6c12e8f0 con 0x7f2c800cea20 2024-09-16T07:34:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.562+0000 7f2c7ea00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2c60073340 0x7f2c60075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.562+0000 7f2c7ea00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2c60073340 0x7f2c60075800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c70000f70 tx=0x7f2c70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:17.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.562+0000 7f2c76a00640 1 -- 172.21.15.114:0/1580193206 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2c6c0164d0 con 0x7f2c800cea20 2024-09-16T07:34:17.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.738+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c800d1940 con 0x7f2c60073340 2024-09-16T07:34:17.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.742+0000 7f2c76a00640 1 -- 172.21.15.114:0/1580193206 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247115 (secure 0 0 0) 0x7f2c800d1940 con 0x7f2c60073340 2024-09-16T07:34:17.743 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2c60073340 msgr2=0x7f2c60075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2c60073340 0x7f2c60075800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c70000f70 tx=0x7f2c70009040 comp rx=0 tx=0).stop 2024-09-16T07:34:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800cea20 msgr2=0x7f2c80150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800cea20 0x7f2c80150500 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0193a0 tx=0x7f2c6c0a5690 comp rx=0 tx=0).stop 2024-09-16T07:34:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 shutdown_connections 2024-09-16T07:34:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2c60073340 0x7f2c60075800 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2c800d1b60 0x7f2c80155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2c800cea20 0x7f2c80150500 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 --2- 172.21.15.114:0/1580193206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c800b24b0 0x7f2c800b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 >> 172.21.15.114:0/1580193206 conn(0x7f2c8009aa10 msgr2=0x7f2c800d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 shutdown_connections 2024-09-16T07:34:17.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.746+0000 7f2c7fe00640 1 -- 172.21.15.114:0/1580193206 wait complete. 2024-09-16T07:34:17.763 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-09-16T07:34:16.393132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261608,"kb_used_data":12100,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713112,"statfs":{"total":773094113280,"available":772826226688,"internally_reserved":0,"allocated":12390400,"data_stored":6059463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.765234"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641410+0000","last_change":"2024-09-16T07:34:12.641410+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641410+0000","last_undegraded":"2024-09-16T07:34:12.641410+0000","last_fullsized":"2024-09-16T07:34:12.641410+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.647468+0000","last_change":"2024-09-16T07:34:12.647468+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.647468+0000","last_undegraded":"2024-09-16T07:34:12.647468+0000","last_fullsized":"2024-09-16T07:34:12.647468+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636940+0000","last_change":"2024-09-16T07:34:12.636940+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636940+0000","last_undegraded":"2024-09-16T07:34:12.636940+0000","last_fullsized":"2024-09-16T07:34:12.636940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639706+0000","last_change":"2024-09-16T07:34:12.639706+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639706+0000","last_undegraded":"2024-09-16T07:34:12.639706+0000","last_fullsized":"2024-09-16T07:34:12.639706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642553+0000","last_change":"2024-09-16T07:34:12.642553+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642553+0000","last_undegraded":"2024-09-16T07:34:12.642553+0000","last_fullsized":"2024-09-16T07:34:12.642553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639995+0000","last_change":"2024-09-16T07:34:12.639995+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639995+0000","last_undegraded":"2024-09-16T07:34:12.639995+0000","last_fullsized":"2024-09-16T07:34:12.639995+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638649+0000","last_change":"2024-09-16T07:34:12.638649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638649+0000","last_undegraded":"2024-09-16T07:34:12.638649+0000","last_fullsized":"2024-09-16T07:34:12.638649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636706+0000","last_change":"2024-09-16T07:34:12.636706+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636706+0000","last_undegraded":"2024-09-16T07:34:12.636706+0000","last_fullsized":"2024-09-16T07:34:12.636706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636675+0000","last_change":"2024-09-16T07:34:12.636675+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636675+0000","last_undegraded":"2024-09-16T07:34:12.636675+0000","last_fullsized":"2024-09-16T07:34:12.636675+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.647075+0000","last_change":"2024-09-16T07:34:12.647075+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.647075+0000","last_undegraded":"2024-09-16T07:34:12.647075+0000","last_fullsized":"2024-09-16T07:34:12.647075+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.649776+0000","last_change":"2024-09-16T07:34:12.649776+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.649776+0000","last_undegraded":"2024-09-16T07:34:12.649776+0000","last_fullsized":"2024-09-16T07:34:12.649776+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636919+0000","last_change":"2024-09-16T07:34:12.636919+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636919+0000","last_undegraded":"2024-09-16T07:34:12.636919+0000","last_fullsized":"2024-09-16T07:34:12.636919+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643306+0000","last_change":"2024-09-16T07:34:12.643306+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643306+0000","last_undegraded":"2024-09-16T07:34:12.643306+0000","last_fullsized":"2024-09-16T07:34:12.643306+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646623+0000","last_change":"2024-09-16T07:34:12.646623+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646623+0000","last_undegraded":"2024-09-16T07:34:12.646623+0000","last_fullsized":"2024-09-16T07:34:12.646623+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639315+0000","last_change":"2024-09-16T07:34:12.639315+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639315+0000","last_undegraded":"2024-09-16T07:34:12.639315+0000","last_fullsized":"2024-09-16T07:34:12.639315+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641965+0000","last_change":"2024-09-16T07:34:12.641965+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641965+0000","last_undegraded":"2024-09-16T07:34:12.641965+0000","last_fullsized":"2024-09-16T07:34:12.641965+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638367+0000","last_change":"2024-09-16T07:34:12.638367+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638367+0000","last_undegraded":"2024-09-16T07:34:12.638367+0000","last_fullsized":"2024-09-16T07:34:12.638367+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644800+0000","last_change":"2024-09-16T07:34:12.644800+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644800+0000","last_undegraded":"2024-09-16T07:34:12.644800+0000","last_fullsized":"2024-09-16T07:34:12.644800+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646183+0000","last_change":"2024-09-16T07:34:12.646183+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646183+0000","last_undegraded":"2024-09-16T07:34:12.646183+0000","last_fullsized":"2024-09-16T07:34:12.646183+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642625+0000","last_change":"2024-09-16T07:34:12.642625+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642625+0000","last_undegraded":"2024-09-16T07:34:12.642625+0000","last_fullsized":"2024-09-16T07:34:12.642625+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646721+0000","last_change":"2024-09-16T07:34:12.646721+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646721+0000","last_undegraded":"2024-09-16T07:34:12.646721+0000","last_fullsized":"2024-09-16T07:34:12.646721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644941+0000","last_change":"2024-09-16T07:34:12.644941+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644941+0000","last_undegraded":"2024-09-16T07:34:12.644941+0000","last_fullsized":"2024-09-16T07:34:12.644941+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636457+0000","last_change":"2024-09-16T07:34:12.636457+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636457+0000","last_undegraded":"2024-09-16T07:34:12.636457+0000","last_fullsized":"2024-09-16T07:34:12.636457+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645512+0000","last_change":"2024-09-16T07:34:12.645512+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645512+0000","last_undegraded":"2024-09-16T07:34:12.645512+0000","last_fullsized":"2024-09-16T07:34:12.645512+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.648448+0000","last_change":"2024-09-16T07:34:12.648448+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.648448+0000","last_undegraded":"2024-09-16T07:34:12.648448+0000","last_fullsized":"2024-09-16T07:34:12.648448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644390+0000","last_change":"2024-09-16T07:34:12.644390+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644390+0000","last_undegraded":"2024-09-16T07:34:12.644390+0000","last_fullsized":"2024-09-16T07:34:12.644390+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640940+0000","last_change":"2024-09-16T07:34:12.640940+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640940+0000","last_undegraded":"2024-09-16T07:34:12.640940+0000","last_fullsized":"2024-09-16T07:34:12.640940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639493+0000","last_change":"2024-09-16T07:34:12.639493+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639493+0000","last_undegraded":"2024-09-16T07:34:12.639493+0000","last_fullsized":"2024-09-16T07:34:12.639493+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642886+0000","last_change":"2024-09-16T07:34:12.642886+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642886+0000","last_undegraded":"2024-09-16T07:34:12.642886+0000","last_fullsized":"2024-09-16T07:34:12.642886+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640278+0000","last_change":"2024-09-16T07:34:12.640278+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640278+0000","last_undegraded":"2024-09-16T07:34:12.640278+0000","last_fullsized":"2024-09-16T07:34:12.640278+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645262+0000","last_change":"2024-09-16T07:34:12.645262+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645262+0000","last_undegraded":"2024-09-16T07:34:12.645262+0000","last_fullsized":"2024-09-16T07:34:12.645262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639312+0000","last_change":"2024-09-16T07:34:12.639312+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639312+0000","last_undegraded":"2024-09-16T07:34:12.639312+0000","last_fullsized":"2024-09-16T07:34:12.639312+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641806+0000","last_change":"2024-09-16T07:34:12.641806+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641806+0000","last_undegraded":"2024-09-16T07:34:12.641806+0000","last_fullsized":"2024-09-16T07:34:12.641806+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659094+0000","last_change":"2024-09-16T07:34:12.657427+0000","last_active":"2024-09-16T07:34:12.659094+0000","last_peered":"2024-09-16T07:34:12.659094+0000","last_clean":"2024-09-16T07:34:12.659094+0000","last_became_active":"2024-09-16T07:34:12.657135+0000","last_became_peered":"2024-09-16T07:34:12.657135+0000","last_unstale":"2024-09-16T07:34:12.659094+0000","last_undegraded":"2024-09-16T07:34:12.659094+0000","last_fullsized":"2024-09-16T07:34:12.659094+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:05:25.633905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635673+0000","last_change":"2024-09-16T07:34:12.635673+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635673+0000","last_undegraded":"2024-09-16T07:34:12.635673+0000","last_fullsized":"2024-09-16T07:34:12.635673+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.662924+0000","last_change":"2024-09-16T07:34:12.659539+0000","last_active":"2024-09-16T07:34:12.662924+0000","last_peered":"2024-09-16T07:34:12.662924+0000","last_clean":"2024-09-16T07:34:12.662924+0000","last_became_active":"2024-09-16T07:34:12.659264+0000","last_became_peered":"2024-09-16T07:34:12.659264+0000","last_unstale":"2024-09-16T07:34:12.662924+0000","last_undegraded":"2024-09-16T07:34:12.662924+0000","last_fullsized":"2024-09-16T07:34:12.662924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:25.888675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643971+0000","last_change":"2024-09-16T07:34:12.643971+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643971+0000","last_undegraded":"2024-09-16T07:34:12.643971+0000","last_fullsized":"2024-09-16T07:34:12.643971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663218+0000","last_change":"2024-09-16T07:34:12.661205+0000","last_active":"2024-09-16T07:34:12.663218+0000","last_peered":"2024-09-16T07:34:12.663218+0000","last_clean":"2024-09-16T07:34:12.663218+0000","last_became_active":"2024-09-16T07:34:12.659902+0000","last_became_peered":"2024-09-16T07:34:12.659902+0000","last_unstale":"2024-09-16T07:34:12.663218+0000","last_undegraded":"2024-09-16T07:34:12.663218+0000","last_fullsized":"2024-09-16T07:34:12.663218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:33:19.504500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644503+0000","last_change":"2024-09-16T07:34:12.644503+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644503+0000","last_undegraded":"2024-09-16T07:34:12.644503+0000","last_fullsized":"2024-09-16T07:34:12.644503+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.664154+0000","last_change":"2024-09-16T07:34:12.662760+0000","last_active":"2024-09-16T07:34:12.664154+0000","last_peered":"2024-09-16T07:34:12.664154+0000","last_clean":"2024-09-16T07:34:12.664154+0000","last_became_active":"2024-09-16T07:34:12.662244+0000","last_became_peered":"2024-09-16T07:34:12.662244+0000","last_unstale":"2024-09-16T07:34:12.664154+0000","last_undegraded":"2024-09-16T07:34:12.664154+0000","last_fullsized":"2024-09-16T07:34:12.664154+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:23:22.785913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641852+0000","last_change":"2024-09-16T07:34:12.641852+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641852+0000","last_undegraded":"2024-09-16T07:34:12.641852+0000","last_fullsized":"2024-09-16T07:34:12.641852+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660334+0000","last_change":"2024-09-16T07:34:12.651655+0000","last_active":"2024-09-16T07:34:12.660334+0000","last_peered":"2024-09-16T07:34:12.660334+0000","last_clean":"2024-09-16T07:34:12.660334+0000","last_became_active":"2024-09-16T07:34:12.651346+0000","last_became_peered":"2024-09-16T07:34:12.651346+0000","last_unstale":"2024-09-16T07:34:12.660334+0000","last_undegraded":"2024-09-16T07:34:12.660334+0000","last_fullsized":"2024-09-16T07:34:12.660334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:31.459443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639978+0000","last_change":"2024-09-16T07:34:12.639978+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639978+0000","last_undegraded":"2024-09-16T07:34:12.639978+0000","last_fullsized":"2024-09-16T07:34:12.639978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659100+0000","last_change":"2024-09-16T07:34:12.654728+0000","last_active":"2024-09-16T07:34:12.659100+0000","last_peered":"2024-09-16T07:34:12.659100+0000","last_clean":"2024-09-16T07:34:12.659100+0000","last_became_active":"2024-09-16T07:34:12.654406+0000","last_became_peered":"2024-09-16T07:34:12.654406+0000","last_unstale":"2024-09-16T07:34:12.659100+0000","last_undegraded":"2024-09-16T07:34:12.659100+0000","last_fullsized":"2024-09-16T07:34:12.659100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:11.318328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635740+0000","last_change":"2024-09-16T07:34:12.635740+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635740+0000","last_undegraded":"2024-09-16T07:34:12.635740+0000","last_fullsized":"2024-09-16T07:34:12.635740+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653163+0000","last_change":"2024-09-16T07:34:12.649721+0000","last_active":"2024-09-16T07:34:12.653163+0000","last_peered":"2024-09-16T07:34:12.653163+0000","last_clean":"2024-09-16T07:34:12.653163+0000","last_became_active":"2024-09-16T07:34:12.649243+0000","last_became_peered":"2024-09-16T07:34:12.649243+0000","last_unstale":"2024-09-16T07:34:12.653163+0000","last_undegraded":"2024-09-16T07:34:12.653163+0000","last_fullsized":"2024-09-16T07:34:12.653163+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:49:52.693597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646592+0000","last_change":"2024-09-16T07:34:12.646592+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646592+0000","last_undegraded":"2024-09-16T07:34:12.646592+0000","last_fullsized":"2024-09-16T07:34:12.646592+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660950+0000","last_change":"2024-09-16T07:34:12.655113+0000","last_active":"2024-09-16T07:34:12.660950+0000","last_peered":"2024-09-16T07:34:12.660950+0000","last_clean":"2024-09-16T07:34:12.660950+0000","last_became_active":"2024-09-16T07:34:12.654835+0000","last_became_peered":"2024-09-16T07:34:12.654835+0000","last_unstale":"2024-09-16T07:34:12.660950+0000","last_undegraded":"2024-09-16T07:34:12.660950+0000","last_fullsized":"2024-09-16T07:34:12.660950+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:54.736670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641705+0000","last_change":"2024-09-16T07:34:12.641705+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641705+0000","last_undegraded":"2024-09-16T07:34:12.641705+0000","last_fullsized":"2024-09-16T07:34:12.641705+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653560+0000","last_change":"2024-09-16T07:34:12.651609+0000","last_active":"2024-09-16T07:34:12.653560+0000","last_peered":"2024-09-16T07:34:12.653560+0000","last_clean":"2024-09-16T07:34:12.653560+0000","last_became_active":"2024-09-16T07:34:12.651303+0000","last_became_peered":"2024-09-16T07:34:12.651303+0000","last_unstale":"2024-09-16T07:34:12.653560+0000","last_undegraded":"2024-09-16T07:34:12.653560+0000","last_fullsized":"2024-09-16T07:34:12.653560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:34.672199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638763+0000","last_change":"2024-09-16T07:34:12.638763+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638763+0000","last_undegraded":"2024-09-16T07:34:12.638763+0000","last_fullsized":"2024-09-16T07:34:12.638763+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661932+0000","last_change":"2024-09-16T07:34:12.660262+0000","last_active":"2024-09-16T07:34:12.661932+0000","last_peered":"2024-09-16T07:34:12.661932+0000","last_clean":"2024-09-16T07:34:12.661932+0000","last_became_active":"2024-09-16T07:34:12.655867+0000","last_became_peered":"2024-09-16T07:34:12.655867+0000","last_unstale":"2024-09-16T07:34:12.661932+0000","last_undegraded":"2024-09-16T07:34:12.661932+0000","last_fullsized":"2024-09-16T07:34:12.661932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:20.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643497+0000","last_change":"2024-09-16T07:34:12.643497+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643497+0000","last_undegraded":"2024-09-16T07:34:12.643497+0000","last_fullsized":"2024-09-16T07:34:12.643497+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658384+0000","last_change":"2024-09-16T07:34:12.655601+0000","last_active":"2024-09-16T07:34:12.658384+0000","last_peered":"2024-09-16T07:34:12.658384+0000","last_clean":"2024-09-16T07:34:12.658384+0000","last_became_active":"2024-09-16T07:34:12.655398+0000","last_became_peered":"2024-09-16T07:34:12.655398+0000","last_unstale":"2024-09-16T07:34:12.658384+0000","last_undegraded":"2024-09-16T07:34:12.658384+0000","last_fullsized":"2024-09-16T07:34:12.658384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:20.670017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644089+0000","last_change":"2024-09-16T07:34:12.644089+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644089+0000","last_undegraded":"2024-09-16T07:34:12.644089+0000","last_fullsized":"2024-09-16T07:34:12.644089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653306+0000","last_change":"2024-09-16T07:34:12.649697+0000","last_active":"2024-09-16T07:34:12.653306+0000","last_peered":"2024-09-16T07:34:12.653306+0000","last_clean":"2024-09-16T07:34:12.653306+0000","last_became_active":"2024-09-16T07:34:12.649391+0000","last_became_peered":"2024-09-16T07:34:12.649391+0000","last_unstale":"2024-09-16T07:34:12.653306+0000","last_undegraded":"2024-09-16T07:34:12.653306+0000","last_fullsized":"2024-09-16T07:34:12.653306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:01.202262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640179+0000","last_change":"2024-09-16T07:34:12.640179+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640179+0000","last_undegraded":"2024-09-16T07:34:12.640179+0000","last_fullsized":"2024-09-16T07:34:12.640179+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.655663+0000","last_change":"2024-09-16T07:34:12.649804+0000","last_active":"2024-09-16T07:34:12.655663+0000","last_peered":"2024-09-16T07:34:12.655663+0000","last_clean":"2024-09-16T07:34:12.655663+0000","last_became_active":"2024-09-16T07:34:12.649503+0000","last_became_peered":"2024-09-16T07:34:12.649503+0000","last_unstale":"2024-09-16T07:34:12.655663+0000","last_undegraded":"2024-09-16T07:34:12.655663+0000","last_fullsized":"2024-09-16T07:34:12.655663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:25:52.356971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645414+0000","last_change":"2024-09-16T07:34:12.645414+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645414+0000","last_undegraded":"2024-09-16T07:34:12.645414+0000","last_fullsized":"2024-09-16T07:34:12.645414+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660269+0000","last_change":"2024-09-16T07:34:12.654539+0000","last_active":"2024-09-16T07:34:12.660269+0000","last_peered":"2024-09-16T07:34:12.660269+0000","last_clean":"2024-09-16T07:34:12.660269+0000","last_became_active":"2024-09-16T07:34:12.654289+0000","last_became_peered":"2024-09-16T07:34:12.654289+0000","last_unstale":"2024-09-16T07:34:12.660269+0000","last_undegraded":"2024-09-16T07:34:12.660269+0000","last_fullsized":"2024-09-16T07:34:12.660269+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:34:50.364140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635737+0000","last_change":"2024-09-16T07:34:12.635737+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635737+0000","last_undegraded":"2024-09-16T07:34:12.635737+0000","last_fullsized":"2024-09-16T07:34:12.635737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658046+0000","last_change":"2024-09-16T07:34:12.654029+0000","last_active":"2024-09-16T07:34:12.658046+0000","last_peered":"2024-09-16T07:34:12.658046+0000","last_clean":"2024-09-16T07:34:12.658046+0000","last_became_active":"2024-09-16T07:34:12.653755+0000","last_became_peered":"2024-09-16T07:34:12.653755+0000","last_unstale":"2024-09-16T07:34:12.658046+0000","last_undegraded":"2024-09-16T07:34:12.658046+0000","last_fullsized":"2024-09-16T07:34:12.658046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:02.861959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635649+0000","last_change":"2024-09-16T07:34:12.635649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635649+0000","last_undegraded":"2024-09-16T07:34:12.635649+0000","last_fullsized":"2024-09-16T07:34:12.635649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653539+0000","last_change":"2024-09-16T07:34:12.650903+0000","last_active":"2024-09-16T07:34:12.653539+0000","last_peered":"2024-09-16T07:34:12.653539+0000","last_clean":"2024-09-16T07:34:12.653539+0000","last_became_active":"2024-09-16T07:34:12.650413+0000","last_became_peered":"2024-09-16T07:34:12.650413+0000","last_unstale":"2024-09-16T07:34:12.653539+0000","last_undegraded":"2024-09-16T07:34:12.653539+0000","last_fullsized":"2024-09-16T07:34:12.653539+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:21:41.801683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638333+0000","last_change":"2024-09-16T07:34:12.638333+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638333+0000","last_undegraded":"2024-09-16T07:34:12.638333+0000","last_fullsized":"2024-09-16T07:34:12.638333+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663242+0000","last_change":"2024-09-16T07:34:12.660836+0000","last_active":"2024-09-16T07:34:12.663242+0000","last_peered":"2024-09-16T07:34:12.663242+0000","last_clean":"2024-09-16T07:34:12.663242+0000","last_became_active":"2024-09-16T07:34:12.660027+0000","last_became_peered":"2024-09-16T07:34:12.660027+0000","last_unstale":"2024-09-16T07:34:12.663242+0000","last_undegraded":"2024-09-16T07:34:12.663242+0000","last_fullsized":"2024-09-16T07:34:12.663242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:09.425387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642270+0000","last_change":"2024-09-16T07:34:12.642270+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642270+0000","last_undegraded":"2024-09-16T07:34:12.642270+0000","last_fullsized":"2024-09-16T07:34:12.642270+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658845+0000","last_change":"2024-09-16T07:34:12.657295+0000","last_active":"2024-09-16T07:34:12.658845+0000","last_peered":"2024-09-16T07:34:12.658845+0000","last_clean":"2024-09-16T07:34:12.658845+0000","last_became_active":"2024-09-16T07:34:12.656864+0000","last_became_peered":"2024-09-16T07:34:12.656864+0000","last_unstale":"2024-09-16T07:34:12.658845+0000","last_undegraded":"2024-09-16T07:34:12.658845+0000","last_fullsized":"2024-09-16T07:34:12.658845+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.065868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645790+0000","last_change":"2024-09-16T07:34:12.645790+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645790+0000","last_undegraded":"2024-09-16T07:34:12.645790+0000","last_fullsized":"2024-09-16T07:34:12.645790+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663298+0000","last_change":"2024-09-16T07:34:12.660110+0000","last_active":"2024-09-16T07:34:12.663298+0000","last_peered":"2024-09-16T07:34:12.663298+0000","last_clean":"2024-09-16T07:34:12.663298+0000","last_became_active":"2024-09-16T07:34:12.659784+0000","last_became_peered":"2024-09-16T07:34:12.659784+0000","last_unstale":"2024-09-16T07:34:12.663298+0000","last_undegraded":"2024-09-16T07:34:12.663298+0000","last_fullsized":"2024-09-16T07:34:12.663298+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:36:51.960957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639858+0000","last_change":"2024-09-16T07:34:12.639858+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639858+0000","last_undegraded":"2024-09-16T07:34:12.639858+0000","last_fullsized":"2024-09-16T07:34:12.639858+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653472+0000","last_change":"2024-09-16T07:34:12.651711+0000","last_active":"2024-09-16T07:34:12.653472+0000","last_peered":"2024-09-16T07:34:12.653472+0000","last_clean":"2024-09-16T07:34:12.653472+0000","last_became_active":"2024-09-16T07:34:12.651345+0000","last_became_peered":"2024-09-16T07:34:12.651345+0000","last_unstale":"2024-09-16T07:34:12.653472+0000","last_undegraded":"2024-09-16T07:34:12.653472+0000","last_fullsized":"2024-09-16T07:34:12.653472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:25.456450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639595+0000","last_change":"2024-09-16T07:34:12.639595+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639595+0000","last_undegraded":"2024-09-16T07:34:12.639595+0000","last_fullsized":"2024-09-16T07:34:12.639595+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659125+0000","last_change":"2024-09-16T07:34:12.655035+0000","last_active":"2024-09-16T07:34:12.659125+0000","last_peered":"2024-09-16T07:34:12.659125+0000","last_clean":"2024-09-16T07:34:12.659125+0000","last_became_active":"2024-09-16T07:34:12.654389+0000","last_became_peered":"2024-09-16T07:34:12.654389+0000","last_unstale":"2024-09-16T07:34:12.659125+0000","last_undegraded":"2024-09-16T07:34:12.659125+0000","last_fullsized":"2024-09-16T07:34:12.659125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:04.088398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639788+0000","last_change":"2024-09-16T07:34:12.639788+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639788+0000","last_undegraded":"2024-09-16T07:34:12.639788+0000","last_fullsized":"2024-09-16T07:34:12.639788+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660503+0000","last_change":"2024-09-16T07:34:12.657796+0000","last_active":"2024-09-16T07:34:12.660503+0000","last_peered":"2024-09-16T07:34:12.660503+0000","last_clean":"2024-09-16T07:34:12.660503+0000","last_became_active":"2024-09-16T07:34:12.657514+0000","last_became_peered":"2024-09-16T07:34:12.657514+0000","last_unstale":"2024-09-16T07:34:12.660503+0000","last_undegraded":"2024-09-16T07:34:12.660503+0000","last_fullsized":"2024-09-16T07:34:12.660503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:47.365227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646101+0000","last_change":"2024-09-16T07:34:12.646101+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646101+0000","last_undegraded":"2024-09-16T07:34:12.646101+0000","last_fullsized":"2024-09-16T07:34:12.646101+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661888+0000","last_change":"2024-09-16T07:34:12.655999+0000","last_active":"2024-09-16T07:34:12.661888+0000","last_peered":"2024-09-16T07:34:12.661888+0000","last_clean":"2024-09-16T07:34:12.661888+0000","last_became_active":"2024-09-16T07:34:12.652081+0000","last_became_peered":"2024-09-16T07:34:12.652081+0000","last_unstale":"2024-09-16T07:34:12.661888+0000","last_undegraded":"2024-09-16T07:34:12.661888+0000","last_fullsized":"2024-09-16T07:34:12.661888+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:44.395472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640318+0000","last_change":"2024-09-16T07:34:12.640318+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640318+0000","last_undegraded":"2024-09-16T07:34:12.640318+0000","last_fullsized":"2024-09-16T07:34:12.640318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660583+0000","last_change":"2024-09-16T07:34:12.658649+0000","last_active":"2024-09-16T07:34:12.660583+0000","last_peered":"2024-09-16T07:34:12.660583+0000","last_clean":"2024-09-16T07:34:12.660583+0000","last_became_active":"2024-09-16T07:34:12.656266+0000","last_became_peered":"2024-09-16T07:34:12.656266+0000","last_unstale":"2024-09-16T07:34:12.660583+0000","last_undegraded":"2024-09-16T07:34:12.660583+0000","last_fullsized":"2024-09-16T07:34:12.660583+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:02.441212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643484+0000","last_change":"2024-09-16T07:34:12.643484+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643484+0000","last_undegraded":"2024-09-16T07:34:12.643484+0000","last_fullsized":"2024-09-16T07:34:12.643484+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.655133+0000","last_change":"2024-09-16T07:34:12.652868+0000","last_active":"2024-09-16T07:34:12.655133+0000","last_peered":"2024-09-16T07:34:12.655133+0000","last_clean":"2024-09-16T07:34:12.655133+0000","last_became_active":"2024-09-16T07:34:12.652597+0000","last_became_peered":"2024-09-16T07:34:12.652597+0000","last_unstale":"2024-09-16T07:34:12.655133+0000","last_undegraded":"2024-09-16T07:34:12.655133+0000","last_fullsized":"2024-09-16T07:34:12.655133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:58.027181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640512+0000","last_change":"2024-09-16T07:34:12.640512+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640512+0000","last_undegraded":"2024-09-16T07:34:12.640512+0000","last_fullsized":"2024-09-16T07:34:12.640512+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661158+0000","last_change":"2024-09-16T07:34:12.655139+0000","last_active":"2024-09-16T07:34:12.661158+0000","last_peered":"2024-09-16T07:34:12.661158+0000","last_clean":"2024-09-16T07:34:12.661158+0000","last_became_active":"2024-09-16T07:34:12.654832+0000","last_became_peered":"2024-09-16T07:34:12.654832+0000","last_unstale":"2024-09-16T07:34:12.661158+0000","last_undegraded":"2024-09-16T07:34:12.661158+0000","last_fullsized":"2024-09-16T07:34:12.661158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:04:04.569049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640542+0000","last_change":"2024-09-16T07:34:12.640542+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640542+0000","last_undegraded":"2024-09-16T07:34:12.640542+0000","last_fullsized":"2024-09-16T07:34:12.640542+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661868+0000","last_change":"2024-09-16T07:34:12.658546+0000","last_active":"2024-09-16T07:34:12.661868+0000","last_peered":"2024-09-16T07:34:12.661868+0000","last_clean":"2024-09-16T07:34:12.661868+0000","last_became_active":"2024-09-16T07:34:12.658298+0000","last_became_peered":"2024-09-16T07:34:12.658298+0000","last_unstale":"2024-09-16T07:34:12.661868+0000","last_undegraded":"2024-09-16T07:34:12.661868+0000","last_fullsized":"2024-09-16T07:34:12.661868+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:37.081850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642596+0000","last_change":"2024-09-16T07:34:12.642596+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642596+0000","last_undegraded":"2024-09-16T07:34:12.642596+0000","last_fullsized":"2024-09-16T07:34:12.642596+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660361+0000","last_change":"2024-09-16T07:34:12.652258+0000","last_active":"2024-09-16T07:34:12.660361+0000","last_peered":"2024-09-16T07:34:12.660361+0000","last_clean":"2024-09-16T07:34:12.660361+0000","last_became_active":"2024-09-16T07:34:12.652016+0000","last_became_peered":"2024-09-16T07:34:12.652016+0000","last_unstale":"2024-09-16T07:34:12.660361+0000","last_undegraded":"2024-09-16T07:34:12.660361+0000","last_fullsized":"2024-09-16T07:34:12.660361+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:21.360924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638730+0000","last_change":"2024-09-16T07:34:12.638730+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638730+0000","last_undegraded":"2024-09-16T07:34:12.638730+0000","last_fullsized":"2024-09-16T07:34:12.638730+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663014+0000","last_change":"2024-09-16T07:34:12.659752+0000","last_active":"2024-09-16T07:34:12.663014+0000","last_peered":"2024-09-16T07:34:12.663014+0000","last_clean":"2024-09-16T07:34:12.663014+0000","last_became_active":"2024-09-16T07:34:12.659431+0000","last_became_peered":"2024-09-16T07:34:12.659431+0000","last_unstale":"2024-09-16T07:34:12.663014+0000","last_undegraded":"2024-09-16T07:34:12.663014+0000","last_fullsized":"2024-09-16T07:34:12.663014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:54.845908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641134+0000","last_change":"2024-09-16T07:34:12.641134+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641134+0000","last_undegraded":"2024-09-16T07:34:12.641134+0000","last_fullsized":"2024-09-16T07:34:12.641134+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659175+0000","last_change":"2024-09-16T07:34:12.654352+0000","last_active":"2024-09-16T07:34:12.659175+0000","last_peered":"2024-09-16T07:34:12.659175+0000","last_clean":"2024-09-16T07:34:12.659175+0000","last_became_active":"2024-09-16T07:34:12.654042+0000","last_became_peered":"2024-09-16T07:34:12.654042+0000","last_unstale":"2024-09-16T07:34:12.659175+0000","last_undegraded":"2024-09-16T07:34:12.659175+0000","last_fullsized":"2024-09-16T07:34:12.659175+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:10:08.401475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639643+0000","last_change":"2024-09-16T07:34:12.639643+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639643+0000","last_undegraded":"2024-09-16T07:34:12.639643+0000","last_fullsized":"2024-09-16T07:34:12.639643+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661665+0000","last_change":"2024-09-16T07:34:12.651035+0000","last_active":"2024-09-16T07:34:12.661665+0000","last_peered":"2024-09-16T07:34:12.661665+0000","last_clean":"2024-09-16T07:34:12.661665+0000","last_became_active":"2024-09-16T07:34:12.650831+0000","last_became_peered":"2024-09-16T07:34:12.650831+0000","last_unstale":"2024-09-16T07:34:12.661665+0000","last_undegraded":"2024-09-16T07:34:12.661665+0000","last_fullsized":"2024-09-16T07:34:12.661665+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:01.450699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643093+0000","last_change":"2024-09-16T07:34:12.643093+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643093+0000","last_undegraded":"2024-09-16T07:34:12.643093+0000","last_fullsized":"2024-09-16T07:34:12.643093+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659023+0000","last_change":"2024-09-16T07:34:12.657665+0000","last_active":"2024-09-16T07:34:12.659023+0000","last_peered":"2024-09-16T07:34:12.659023+0000","last_clean":"2024-09-16T07:34:12.659023+0000","last_became_active":"2024-09-16T07:34:12.657331+0000","last_became_peered":"2024-09-16T07:34:12.657331+0000","last_unstale":"2024-09-16T07:34:12.659023+0000","last_undegraded":"2024-09-16T07:34:12.659023+0000","last_fullsized":"2024-09-16T07:34:12.659023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:23.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.647051+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:12.647051+0000","last_peered":"2024-09-16T07:34:12.647051+0000","last_clean":"2024-09-16T07:34:12.647051+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:12.647051+0000","last_undegraded":"2024-09-16T07:34:12.647051+0000","last_fullsized":"2024-09-16T07:34:12.647051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:17.769 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:17.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 -- 172.21.15.114:0/3783326191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0b2d00 msgr2=0x7fbe0c1605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 --2- 172.21.15.114:0/3783326191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0b2d00 0x7fbe0c1605d0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009900 tx=0x7fbe0401c670 comp rx=0 tx=0).stop 2024-09-16T07:34:17.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 -- 172.21.15.114:0/3783326191 shutdown_connections 2024-09-16T07:34:17.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 --2- 172.21.15.114:0/3783326191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0b2d00 0x7fbe0c1605d0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 --2- 172.21.15.114:0/3783326191 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe0c0b2760 0x7fbe0c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 -- 172.21.15.114:0/3783326191 >> 172.21.15.114:0/3783326191 conn(0x7fbe0c0d1e40 msgr2=0x7fbe0c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 -- 172.21.15.114:0/3783326191 shutdown_connections 2024-09-16T07:34:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 -- 172.21.15.114:0/3783326191 wait complete. 2024-09-16T07:34:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 Processor -- start 2024-09-16T07:34:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.954+0000 7fbe12200640 1 -- start start 2024-09-16T07:34:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe0c0b2760 0x7fbe0c14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0c0b2d00 0x7fbe0c0c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0cfe80 0x7fbe0c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c0b0900 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c0b0780 con 0x7fbe0c0b2d00 2024-09-16T07:34:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c0b0a80 con 0x7fbe0c0b2760 2024-09-16T07:34:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0cfe80 0x7fbe0c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0cfe80 0x7fbe0c0b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42056/0 (socket says 172.21.15.114:42056) 2024-09-16T07:34:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 -- 172.21.15.114:0/1034292915 learned_addr learned my addr 172.21.15.114:0/1034292915 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe02a00640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0c0b2d00 0x7fbe0c0c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0b400640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe0c0b2760 0x7fbe0c14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 -- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe0c0b2760 msgr2=0x7fbe0c14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe0c0b2760 0x7fbe0c14a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 -- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0c0b2d00 msgr2=0x7fbe0c0c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0c0b2d00 0x7fbe0c0c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 -- 172.21.15.114:0/1034292915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c14a790 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe0be00640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0cfe80 0x7fbe0c0b58b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ac040 tx=0x7fbe040aa4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe03e00640 1 -- 172.21.15.114:0/1034292915 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe040aaaf0 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe03e00640 1 -- 172.21.15.114:0/1034292915 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe040b8070 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c0c7320 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe03e00640 1 -- 172.21.15.114:0/1034292915 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04005030 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c0c78e0 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c0d0260 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.958+0000 7fbe03e00640 1 -- 172.21.15.114:0/1034292915 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fbe040051d0 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.962+0000 7fbe03e00640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbde8073340 0x7fbde8075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.962+0000 7fbe03e00640 1 -- 172.21.15.114:0/1034292915 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fbe0412f180 con 0x7fbe0c0cfe80 2024-09-16T07:34:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.962+0000 7fbe0b400640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbde8073340 0x7fbde8075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.962+0000 7fbe0b400640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbde8073340 0x7fbde8075800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00b450 tx=0x7fbdfc00d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:17.966+0000 7fbe03e00640 1 -- 172.21.15.114:0/1034292915 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbe0c0d0c80 con 0x7fbe0c0cfe80 2024-09-16T07:34:18.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.130+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe0c0717d0 con 0x7fbde8073340 2024-09-16T07:34:18.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.134+0000 7fbe03e00640 1 -- 172.21.15.114:0/1034292915 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247115 (secure 0 0 0) 0x7fbe0c0717d0 con 0x7fbde8073340 2024-09-16T07:34:18.135 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:18.137 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbde8073340 msgr2=0x7fbde8075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbde8073340 0x7fbde8075800 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00b450 tx=0x7fbdfc00d040 comp rx=0 tx=0).stop 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0cfe80 msgr2=0x7fbe0c0b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0cfe80 0x7fbe0c0b58b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ac040 tx=0x7fbe040aa4e0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 shutdown_connections 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0c0cfe80 0x7fbe0c0b58b0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbe0c0b2d00 0x7fbe0c0c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbde8073340 0x7fbde8075800 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 --2- 172.21.15.114:0/1034292915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbe0c0b2760 0x7fbe0c14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 >> 172.21.15.114:0/1034292915 conn(0x7fbe0c0d1e40 msgr2=0x7fbe0c071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 shutdown_connections 2024-09-16T07:34:18.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.138+0000 7fbe12200640 1 -- 172.21.15.114:0/1034292915 wait complete. 2024-09-16T07:34:18.156 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-09-16T07:34:16.393132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261608,"kb_used_data":12100,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713112,"statfs":{"total":773094113280,"available":772826226688,"internally_reserved":0,"allocated":12390400,"data_stored":6059463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.765234"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641410+0000","last_change":"2024-09-16T07:34:12.641410+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641410+0000","last_undegraded":"2024-09-16T07:34:12.641410+0000","last_fullsized":"2024-09-16T07:34:12.641410+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.647468+0000","last_change":"2024-09-16T07:34:12.647468+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.647468+0000","last_undegraded":"2024-09-16T07:34:12.647468+0000","last_fullsized":"2024-09-16T07:34:12.647468+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636940+0000","last_change":"2024-09-16T07:34:12.636940+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636940+0000","last_undegraded":"2024-09-16T07:34:12.636940+0000","last_fullsized":"2024-09-16T07:34:12.636940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639706+0000","last_change":"2024-09-16T07:34:12.639706+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639706+0000","last_undegraded":"2024-09-16T07:34:12.639706+0000","last_fullsized":"2024-09-16T07:34:12.639706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642553+0000","last_change":"2024-09-16T07:34:12.642553+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642553+0000","last_undegraded":"2024-09-16T07:34:12.642553+0000","last_fullsized":"2024-09-16T07:34:12.642553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639995+0000","last_change":"2024-09-16T07:34:12.639995+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639995+0000","last_undegraded":"2024-09-16T07:34:12.639995+0000","last_fullsized":"2024-09-16T07:34:12.639995+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638649+0000","last_change":"2024-09-16T07:34:12.638649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638649+0000","last_undegraded":"2024-09-16T07:34:12.638649+0000","last_fullsized":"2024-09-16T07:34:12.638649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636706+0000","last_change":"2024-09-16T07:34:12.636706+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636706+0000","last_undegraded":"2024-09-16T07:34:12.636706+0000","last_fullsized":"2024-09-16T07:34:12.636706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636675+0000","last_change":"2024-09-16T07:34:12.636675+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636675+0000","last_undegraded":"2024-09-16T07:34:12.636675+0000","last_fullsized":"2024-09-16T07:34:12.636675+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.647075+0000","last_change":"2024-09-16T07:34:12.647075+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.647075+0000","last_undegraded":"2024-09-16T07:34:12.647075+0000","last_fullsized":"2024-09-16T07:34:12.647075+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.649776+0000","last_change":"2024-09-16T07:34:12.649776+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.649776+0000","last_undegraded":"2024-09-16T07:34:12.649776+0000","last_fullsized":"2024-09-16T07:34:12.649776+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636919+0000","last_change":"2024-09-16T07:34:12.636919+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636919+0000","last_undegraded":"2024-09-16T07:34:12.636919+0000","last_fullsized":"2024-09-16T07:34:12.636919+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643306+0000","last_change":"2024-09-16T07:34:12.643306+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643306+0000","last_undegraded":"2024-09-16T07:34:12.643306+0000","last_fullsized":"2024-09-16T07:34:12.643306+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646623+0000","last_change":"2024-09-16T07:34:12.646623+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646623+0000","last_undegraded":"2024-09-16T07:34:12.646623+0000","last_fullsized":"2024-09-16T07:34:12.646623+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639315+0000","last_change":"2024-09-16T07:34:12.639315+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639315+0000","last_undegraded":"2024-09-16T07:34:12.639315+0000","last_fullsized":"2024-09-16T07:34:12.639315+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641965+0000","last_change":"2024-09-16T07:34:12.641965+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641965+0000","last_undegraded":"2024-09-16T07:34:12.641965+0000","last_fullsized":"2024-09-16T07:34:12.641965+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638367+0000","last_change":"2024-09-16T07:34:12.638367+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638367+0000","last_undegraded":"2024-09-16T07:34:12.638367+0000","last_fullsized":"2024-09-16T07:34:12.638367+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644800+0000","last_change":"2024-09-16T07:34:12.644800+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644800+0000","last_undegraded":"2024-09-16T07:34:12.644800+0000","last_fullsized":"2024-09-16T07:34:12.644800+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646183+0000","last_change":"2024-09-16T07:34:12.646183+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646183+0000","last_undegraded":"2024-09-16T07:34:12.646183+0000","last_fullsized":"2024-09-16T07:34:12.646183+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642625+0000","last_change":"2024-09-16T07:34:12.642625+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642625+0000","last_undegraded":"2024-09-16T07:34:12.642625+0000","last_fullsized":"2024-09-16T07:34:12.642625+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646721+0000","last_change":"2024-09-16T07:34:12.646721+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646721+0000","last_undegraded":"2024-09-16T07:34:12.646721+0000","last_fullsized":"2024-09-16T07:34:12.646721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644941+0000","last_change":"2024-09-16T07:34:12.644941+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644941+0000","last_undegraded":"2024-09-16T07:34:12.644941+0000","last_fullsized":"2024-09-16T07:34:12.644941+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636457+0000","last_change":"2024-09-16T07:34:12.636457+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636457+0000","last_undegraded":"2024-09-16T07:34:12.636457+0000","last_fullsized":"2024-09-16T07:34:12.636457+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645512+0000","last_change":"2024-09-16T07:34:12.645512+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645512+0000","last_undegraded":"2024-09-16T07:34:12.645512+0000","last_fullsized":"2024-09-16T07:34:12.645512+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.648448+0000","last_change":"2024-09-16T07:34:12.648448+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.648448+0000","last_undegraded":"2024-09-16T07:34:12.648448+0000","last_fullsized":"2024-09-16T07:34:12.648448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644390+0000","last_change":"2024-09-16T07:34:12.644390+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644390+0000","last_undegraded":"2024-09-16T07:34:12.644390+0000","last_fullsized":"2024-09-16T07:34:12.644390+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640940+0000","last_change":"2024-09-16T07:34:12.640940+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640940+0000","last_undegraded":"2024-09-16T07:34:12.640940+0000","last_fullsized":"2024-09-16T07:34:12.640940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639493+0000","last_change":"2024-09-16T07:34:12.639493+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639493+0000","last_undegraded":"2024-09-16T07:34:12.639493+0000","last_fullsized":"2024-09-16T07:34:12.639493+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642886+0000","last_change":"2024-09-16T07:34:12.642886+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642886+0000","last_undegraded":"2024-09-16T07:34:12.642886+0000","last_fullsized":"2024-09-16T07:34:12.642886+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640278+0000","last_change":"2024-09-16T07:34:12.640278+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640278+0000","last_undegraded":"2024-09-16T07:34:12.640278+0000","last_fullsized":"2024-09-16T07:34:12.640278+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645262+0000","last_change":"2024-09-16T07:34:12.645262+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645262+0000","last_undegraded":"2024-09-16T07:34:12.645262+0000","last_fullsized":"2024-09-16T07:34:12.645262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639312+0000","last_change":"2024-09-16T07:34:12.639312+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639312+0000","last_undegraded":"2024-09-16T07:34:12.639312+0000","last_fullsized":"2024-09-16T07:34:12.639312+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641806+0000","last_change":"2024-09-16T07:34:12.641806+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641806+0000","last_undegraded":"2024-09-16T07:34:12.641806+0000","last_fullsized":"2024-09-16T07:34:12.641806+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659094+0000","last_change":"2024-09-16T07:34:12.657427+0000","last_active":"2024-09-16T07:34:12.659094+0000","last_peered":"2024-09-16T07:34:12.659094+0000","last_clean":"2024-09-16T07:34:12.659094+0000","last_became_active":"2024-09-16T07:34:12.657135+0000","last_became_peered":"2024-09-16T07:34:12.657135+0000","last_unstale":"2024-09-16T07:34:12.659094+0000","last_undegraded":"2024-09-16T07:34:12.659094+0000","last_fullsized":"2024-09-16T07:34:12.659094+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:05:25.633905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635673+0000","last_change":"2024-09-16T07:34:12.635673+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635673+0000","last_undegraded":"2024-09-16T07:34:12.635673+0000","last_fullsized":"2024-09-16T07:34:12.635673+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.662924+0000","last_change":"2024-09-16T07:34:12.659539+0000","last_active":"2024-09-16T07:34:12.662924+0000","last_peered":"2024-09-16T07:34:12.662924+0000","last_clean":"2024-09-16T07:34:12.662924+0000","last_became_active":"2024-09-16T07:34:12.659264+0000","last_became_peered":"2024-09-16T07:34:12.659264+0000","last_unstale":"2024-09-16T07:34:12.662924+0000","last_undegraded":"2024-09-16T07:34:12.662924+0000","last_fullsized":"2024-09-16T07:34:12.662924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:25.888675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643971+0000","last_change":"2024-09-16T07:34:12.643971+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643971+0000","last_undegraded":"2024-09-16T07:34:12.643971+0000","last_fullsized":"2024-09-16T07:34:12.643971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663218+0000","last_change":"2024-09-16T07:34:12.661205+0000","last_active":"2024-09-16T07:34:12.663218+0000","last_peered":"2024-09-16T07:34:12.663218+0000","last_clean":"2024-09-16T07:34:12.663218+0000","last_became_active":"2024-09-16T07:34:12.659902+0000","last_became_peered":"2024-09-16T07:34:12.659902+0000","last_unstale":"2024-09-16T07:34:12.663218+0000","last_undegraded":"2024-09-16T07:34:12.663218+0000","last_fullsized":"2024-09-16T07:34:12.663218+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:33:19.504500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644503+0000","last_change":"2024-09-16T07:34:12.644503+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644503+0000","last_undegraded":"2024-09-16T07:34:12.644503+0000","last_fullsized":"2024-09-16T07:34:12.644503+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.664154+0000","last_change":"2024-09-16T07:34:12.662760+0000","last_active":"2024-09-16T07:34:12.664154+0000","last_peered":"2024-09-16T07:34:12.664154+0000","last_clean":"2024-09-16T07:34:12.664154+0000","last_became_active":"2024-09-16T07:34:12.662244+0000","last_became_peered":"2024-09-16T07:34:12.662244+0000","last_unstale":"2024-09-16T07:34:12.664154+0000","last_undegraded":"2024-09-16T07:34:12.664154+0000","last_fullsized":"2024-09-16T07:34:12.664154+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:23:22.785913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641852+0000","last_change":"2024-09-16T07:34:12.641852+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641852+0000","last_undegraded":"2024-09-16T07:34:12.641852+0000","last_fullsized":"2024-09-16T07:34:12.641852+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660334+0000","last_change":"2024-09-16T07:34:12.651655+0000","last_active":"2024-09-16T07:34:12.660334+0000","last_peered":"2024-09-16T07:34:12.660334+0000","last_clean":"2024-09-16T07:34:12.660334+0000","last_became_active":"2024-09-16T07:34:12.651346+0000","last_became_peered":"2024-09-16T07:34:12.651346+0000","last_unstale":"2024-09-16T07:34:12.660334+0000","last_undegraded":"2024-09-16T07:34:12.660334+0000","last_fullsized":"2024-09-16T07:34:12.660334+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:31.459443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639978+0000","last_change":"2024-09-16T07:34:12.639978+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639978+0000","last_undegraded":"2024-09-16T07:34:12.639978+0000","last_fullsized":"2024-09-16T07:34:12.639978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659100+0000","last_change":"2024-09-16T07:34:12.654728+0000","last_active":"2024-09-16T07:34:12.659100+0000","last_peered":"2024-09-16T07:34:12.659100+0000","last_clean":"2024-09-16T07:34:12.659100+0000","last_became_active":"2024-09-16T07:34:12.654406+0000","last_became_peered":"2024-09-16T07:34:12.654406+0000","last_unstale":"2024-09-16T07:34:12.659100+0000","last_undegraded":"2024-09-16T07:34:12.659100+0000","last_fullsized":"2024-09-16T07:34:12.659100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:11.318328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635740+0000","last_change":"2024-09-16T07:34:12.635740+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635740+0000","last_undegraded":"2024-09-16T07:34:12.635740+0000","last_fullsized":"2024-09-16T07:34:12.635740+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653163+0000","last_change":"2024-09-16T07:34:12.649721+0000","last_active":"2024-09-16T07:34:12.653163+0000","last_peered":"2024-09-16T07:34:12.653163+0000","last_clean":"2024-09-16T07:34:12.653163+0000","last_became_active":"2024-09-16T07:34:12.649243+0000","last_became_peered":"2024-09-16T07:34:12.649243+0000","last_unstale":"2024-09-16T07:34:12.653163+0000","last_undegraded":"2024-09-16T07:34:12.653163+0000","last_fullsized":"2024-09-16T07:34:12.653163+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:49:52.693597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646592+0000","last_change":"2024-09-16T07:34:12.646592+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646592+0000","last_undegraded":"2024-09-16T07:34:12.646592+0000","last_fullsized":"2024-09-16T07:34:12.646592+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660950+0000","last_change":"2024-09-16T07:34:12.655113+0000","last_active":"2024-09-16T07:34:12.660950+0000","last_peered":"2024-09-16T07:34:12.660950+0000","last_clean":"2024-09-16T07:34:12.660950+0000","last_became_active":"2024-09-16T07:34:12.654835+0000","last_became_peered":"2024-09-16T07:34:12.654835+0000","last_unstale":"2024-09-16T07:34:12.660950+0000","last_undegraded":"2024-09-16T07:34:12.660950+0000","last_fullsized":"2024-09-16T07:34:12.660950+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:54.736670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641705+0000","last_change":"2024-09-16T07:34:12.641705+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641705+0000","last_undegraded":"2024-09-16T07:34:12.641705+0000","last_fullsized":"2024-09-16T07:34:12.641705+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653560+0000","last_change":"2024-09-16T07:34:12.651609+0000","last_active":"2024-09-16T07:34:12.653560+0000","last_peered":"2024-09-16T07:34:12.653560+0000","last_clean":"2024-09-16T07:34:12.653560+0000","last_became_active":"2024-09-16T07:34:12.651303+0000","last_became_peered":"2024-09-16T07:34:12.651303+0000","last_unstale":"2024-09-16T07:34:12.653560+0000","last_undegraded":"2024-09-16T07:34:12.653560+0000","last_fullsized":"2024-09-16T07:34:12.653560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:34.672199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638763+0000","last_change":"2024-09-16T07:34:12.638763+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638763+0000","last_undegraded":"2024-09-16T07:34:12.638763+0000","last_fullsized":"2024-09-16T07:34:12.638763+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661932+0000","last_change":"2024-09-16T07:34:12.660262+0000","last_active":"2024-09-16T07:34:12.661932+0000","last_peered":"2024-09-16T07:34:12.661932+0000","last_clean":"2024-09-16T07:34:12.661932+0000","last_became_active":"2024-09-16T07:34:12.655867+0000","last_became_peered":"2024-09-16T07:34:12.655867+0000","last_unstale":"2024-09-16T07:34:12.661932+0000","last_undegraded":"2024-09-16T07:34:12.661932+0000","last_fullsized":"2024-09-16T07:34:12.661932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:20.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643497+0000","last_change":"2024-09-16T07:34:12.643497+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643497+0000","last_undegraded":"2024-09-16T07:34:12.643497+0000","last_fullsized":"2024-09-16T07:34:12.643497+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658384+0000","last_change":"2024-09-16T07:34:12.655601+0000","last_active":"2024-09-16T07:34:12.658384+0000","last_peered":"2024-09-16T07:34:12.658384+0000","last_clean":"2024-09-16T07:34:12.658384+0000","last_became_active":"2024-09-16T07:34:12.655398+0000","last_became_peered":"2024-09-16T07:34:12.655398+0000","last_unstale":"2024-09-16T07:34:12.658384+0000","last_undegraded":"2024-09-16T07:34:12.658384+0000","last_fullsized":"2024-09-16T07:34:12.658384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:20.670017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644089+0000","last_change":"2024-09-16T07:34:12.644089+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644089+0000","last_undegraded":"2024-09-16T07:34:12.644089+0000","last_fullsized":"2024-09-16T07:34:12.644089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653306+0000","last_change":"2024-09-16T07:34:12.649697+0000","last_active":"2024-09-16T07:34:12.653306+0000","last_peered":"2024-09-16T07:34:12.653306+0000","last_clean":"2024-09-16T07:34:12.653306+0000","last_became_active":"2024-09-16T07:34:12.649391+0000","last_became_peered":"2024-09-16T07:34:12.649391+0000","last_unstale":"2024-09-16T07:34:12.653306+0000","last_undegraded":"2024-09-16T07:34:12.653306+0000","last_fullsized":"2024-09-16T07:34:12.653306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:01.202262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640179+0000","last_change":"2024-09-16T07:34:12.640179+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640179+0000","last_undegraded":"2024-09-16T07:34:12.640179+0000","last_fullsized":"2024-09-16T07:34:12.640179+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.655663+0000","last_change":"2024-09-16T07:34:12.649804+0000","last_active":"2024-09-16T07:34:12.655663+0000","last_peered":"2024-09-16T07:34:12.655663+0000","last_clean":"2024-09-16T07:34:12.655663+0000","last_became_active":"2024-09-16T07:34:12.649503+0000","last_became_peered":"2024-09-16T07:34:12.649503+0000","last_unstale":"2024-09-16T07:34:12.655663+0000","last_undegraded":"2024-09-16T07:34:12.655663+0000","last_fullsized":"2024-09-16T07:34:12.655663+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:25:52.356971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645414+0000","last_change":"2024-09-16T07:34:12.645414+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645414+0000","last_undegraded":"2024-09-16T07:34:12.645414+0000","last_fullsized":"2024-09-16T07:34:12.645414+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660269+0000","last_change":"2024-09-16T07:34:12.654539+0000","last_active":"2024-09-16T07:34:12.660269+0000","last_peered":"2024-09-16T07:34:12.660269+0000","last_clean":"2024-09-16T07:34:12.660269+0000","last_became_active":"2024-09-16T07:34:12.654289+0000","last_became_peered":"2024-09-16T07:34:12.654289+0000","last_unstale":"2024-09-16T07:34:12.660269+0000","last_undegraded":"2024-09-16T07:34:12.660269+0000","last_fullsized":"2024-09-16T07:34:12.660269+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:34:50.364140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635737+0000","last_change":"2024-09-16T07:34:12.635737+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635737+0000","last_undegraded":"2024-09-16T07:34:12.635737+0000","last_fullsized":"2024-09-16T07:34:12.635737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658046+0000","last_change":"2024-09-16T07:34:12.654029+0000","last_active":"2024-09-16T07:34:12.658046+0000","last_peered":"2024-09-16T07:34:12.658046+0000","last_clean":"2024-09-16T07:34:12.658046+0000","last_became_active":"2024-09-16T07:34:12.653755+0000","last_became_peered":"2024-09-16T07:34:12.653755+0000","last_unstale":"2024-09-16T07:34:12.658046+0000","last_undegraded":"2024-09-16T07:34:12.658046+0000","last_fullsized":"2024-09-16T07:34:12.658046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:02.861959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635649+0000","last_change":"2024-09-16T07:34:12.635649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635649+0000","last_undegraded":"2024-09-16T07:34:12.635649+0000","last_fullsized":"2024-09-16T07:34:12.635649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653539+0000","last_change":"2024-09-16T07:34:12.650903+0000","last_active":"2024-09-16T07:34:12.653539+0000","last_peered":"2024-09-16T07:34:12.653539+0000","last_clean":"2024-09-16T07:34:12.653539+0000","last_became_active":"2024-09-16T07:34:12.650413+0000","last_became_peered":"2024-09-16T07:34:12.650413+0000","last_unstale":"2024-09-16T07:34:12.653539+0000","last_undegraded":"2024-09-16T07:34:12.653539+0000","last_fullsized":"2024-09-16T07:34:12.653539+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:21:41.801683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638333+0000","last_change":"2024-09-16T07:34:12.638333+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638333+0000","last_undegraded":"2024-09-16T07:34:12.638333+0000","last_fullsized":"2024-09-16T07:34:12.638333+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663242+0000","last_change":"2024-09-16T07:34:12.660836+0000","last_active":"2024-09-16T07:34:12.663242+0000","last_peered":"2024-09-16T07:34:12.663242+0000","last_clean":"2024-09-16T07:34:12.663242+0000","last_became_active":"2024-09-16T07:34:12.660027+0000","last_became_peered":"2024-09-16T07:34:12.660027+0000","last_unstale":"2024-09-16T07:34:12.663242+0000","last_undegraded":"2024-09-16T07:34:12.663242+0000","last_fullsized":"2024-09-16T07:34:12.663242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:09.425387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642270+0000","last_change":"2024-09-16T07:34:12.642270+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642270+0000","last_undegraded":"2024-09-16T07:34:12.642270+0000","last_fullsized":"2024-09-16T07:34:12.642270+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658845+0000","last_change":"2024-09-16T07:34:12.657295+0000","last_active":"2024-09-16T07:34:12.658845+0000","last_peered":"2024-09-16T07:34:12.658845+0000","last_clean":"2024-09-16T07:34:12.658845+0000","last_became_active":"2024-09-16T07:34:12.656864+0000","last_became_peered":"2024-09-16T07:34:12.656864+0000","last_unstale":"2024-09-16T07:34:12.658845+0000","last_undegraded":"2024-09-16T07:34:12.658845+0000","last_fullsized":"2024-09-16T07:34:12.658845+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.065868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645790+0000","last_change":"2024-09-16T07:34:12.645790+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645790+0000","last_undegraded":"2024-09-16T07:34:12.645790+0000","last_fullsized":"2024-09-16T07:34:12.645790+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663298+0000","last_change":"2024-09-16T07:34:12.660110+0000","last_active":"2024-09-16T07:34:12.663298+0000","last_peered":"2024-09-16T07:34:12.663298+0000","last_clean":"2024-09-16T07:34:12.663298+0000","last_became_active":"2024-09-16T07:34:12.659784+0000","last_became_peered":"2024-09-16T07:34:12.659784+0000","last_unstale":"2024-09-16T07:34:12.663298+0000","last_undegraded":"2024-09-16T07:34:12.663298+0000","last_fullsized":"2024-09-16T07:34:12.663298+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:36:51.960957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639858+0000","last_change":"2024-09-16T07:34:12.639858+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639858+0000","last_undegraded":"2024-09-16T07:34:12.639858+0000","last_fullsized":"2024-09-16T07:34:12.639858+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653472+0000","last_change":"2024-09-16T07:34:12.651711+0000","last_active":"2024-09-16T07:34:12.653472+0000","last_peered":"2024-09-16T07:34:12.653472+0000","last_clean":"2024-09-16T07:34:12.653472+0000","last_became_active":"2024-09-16T07:34:12.651345+0000","last_became_peered":"2024-09-16T07:34:12.651345+0000","last_unstale":"2024-09-16T07:34:12.653472+0000","last_undegraded":"2024-09-16T07:34:12.653472+0000","last_fullsized":"2024-09-16T07:34:12.653472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:25.456450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639595+0000","last_change":"2024-09-16T07:34:12.639595+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639595+0000","last_undegraded":"2024-09-16T07:34:12.639595+0000","last_fullsized":"2024-09-16T07:34:12.639595+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659125+0000","last_change":"2024-09-16T07:34:12.655035+0000","last_active":"2024-09-16T07:34:12.659125+0000","last_peered":"2024-09-16T07:34:12.659125+0000","last_clean":"2024-09-16T07:34:12.659125+0000","last_became_active":"2024-09-16T07:34:12.654389+0000","last_became_peered":"2024-09-16T07:34:12.654389+0000","last_unstale":"2024-09-16T07:34:12.659125+0000","last_undegraded":"2024-09-16T07:34:12.659125+0000","last_fullsized":"2024-09-16T07:34:12.659125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:04.088398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639788+0000","last_change":"2024-09-16T07:34:12.639788+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639788+0000","last_undegraded":"2024-09-16T07:34:12.639788+0000","last_fullsized":"2024-09-16T07:34:12.639788+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660503+0000","last_change":"2024-09-16T07:34:12.657796+0000","last_active":"2024-09-16T07:34:12.660503+0000","last_peered":"2024-09-16T07:34:12.660503+0000","last_clean":"2024-09-16T07:34:12.660503+0000","last_became_active":"2024-09-16T07:34:12.657514+0000","last_became_peered":"2024-09-16T07:34:12.657514+0000","last_unstale":"2024-09-16T07:34:12.660503+0000","last_undegraded":"2024-09-16T07:34:12.660503+0000","last_fullsized":"2024-09-16T07:34:12.660503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:47.365227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646101+0000","last_change":"2024-09-16T07:34:12.646101+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646101+0000","last_undegraded":"2024-09-16T07:34:12.646101+0000","last_fullsized":"2024-09-16T07:34:12.646101+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661888+0000","last_change":"2024-09-16T07:34:12.655999+0000","last_active":"2024-09-16T07:34:12.661888+0000","last_peered":"2024-09-16T07:34:12.661888+0000","last_clean":"2024-09-16T07:34:12.661888+0000","last_became_active":"2024-09-16T07:34:12.652081+0000","last_became_peered":"2024-09-16T07:34:12.652081+0000","last_unstale":"2024-09-16T07:34:12.661888+0000","last_undegraded":"2024-09-16T07:34:12.661888+0000","last_fullsized":"2024-09-16T07:34:12.661888+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:44.395472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640318+0000","last_change":"2024-09-16T07:34:12.640318+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640318+0000","last_undegraded":"2024-09-16T07:34:12.640318+0000","last_fullsized":"2024-09-16T07:34:12.640318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660583+0000","last_change":"2024-09-16T07:34:12.658649+0000","last_active":"2024-09-16T07:34:12.660583+0000","last_peered":"2024-09-16T07:34:12.660583+0000","last_clean":"2024-09-16T07:34:12.660583+0000","last_became_active":"2024-09-16T07:34:12.656266+0000","last_became_peered":"2024-09-16T07:34:12.656266+0000","last_unstale":"2024-09-16T07:34:12.660583+0000","last_undegraded":"2024-09-16T07:34:12.660583+0000","last_fullsized":"2024-09-16T07:34:12.660583+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:02.441212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643484+0000","last_change":"2024-09-16T07:34:12.643484+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643484+0000","last_undegraded":"2024-09-16T07:34:12.643484+0000","last_fullsized":"2024-09-16T07:34:12.643484+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.655133+0000","last_change":"2024-09-16T07:34:12.652868+0000","last_active":"2024-09-16T07:34:12.655133+0000","last_peered":"2024-09-16T07:34:12.655133+0000","last_clean":"2024-09-16T07:34:12.655133+0000","last_became_active":"2024-09-16T07:34:12.652597+0000","last_became_peered":"2024-09-16T07:34:12.652597+0000","last_unstale":"2024-09-16T07:34:12.655133+0000","last_undegraded":"2024-09-16T07:34:12.655133+0000","last_fullsized":"2024-09-16T07:34:12.655133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:58.027181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640512+0000","last_change":"2024-09-16T07:34:12.640512+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640512+0000","last_undegraded":"2024-09-16T07:34:12.640512+0000","last_fullsized":"2024-09-16T07:34:12.640512+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661158+0000","last_change":"2024-09-16T07:34:12.655139+0000","last_active":"2024-09-16T07:34:12.661158+0000","last_peered":"2024-09-16T07:34:12.661158+0000","last_clean":"2024-09-16T07:34:12.661158+0000","last_became_active":"2024-09-16T07:34:12.654832+0000","last_became_peered":"2024-09-16T07:34:12.654832+0000","last_unstale":"2024-09-16T07:34:12.661158+0000","last_undegraded":"2024-09-16T07:34:12.661158+0000","last_fullsized":"2024-09-16T07:34:12.661158+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:04:04.569049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640542+0000","last_change":"2024-09-16T07:34:12.640542+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640542+0000","last_undegraded":"2024-09-16T07:34:12.640542+0000","last_fullsized":"2024-09-16T07:34:12.640542+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661868+0000","last_change":"2024-09-16T07:34:12.658546+0000","last_active":"2024-09-16T07:34:12.661868+0000","last_peered":"2024-09-16T07:34:12.661868+0000","last_clean":"2024-09-16T07:34:12.661868+0000","last_became_active":"2024-09-16T07:34:12.658298+0000","last_became_peered":"2024-09-16T07:34:12.658298+0000","last_unstale":"2024-09-16T07:34:12.661868+0000","last_undegraded":"2024-09-16T07:34:12.661868+0000","last_fullsized":"2024-09-16T07:34:12.661868+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:37.081850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642596+0000","last_change":"2024-09-16T07:34:12.642596+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642596+0000","last_undegraded":"2024-09-16T07:34:12.642596+0000","last_fullsized":"2024-09-16T07:34:12.642596+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660361+0000","last_change":"2024-09-16T07:34:12.652258+0000","last_active":"2024-09-16T07:34:12.660361+0000","last_peered":"2024-09-16T07:34:12.660361+0000","last_clean":"2024-09-16T07:34:12.660361+0000","last_became_active":"2024-09-16T07:34:12.652016+0000","last_became_peered":"2024-09-16T07:34:12.652016+0000","last_unstale":"2024-09-16T07:34:12.660361+0000","last_undegraded":"2024-09-16T07:34:12.660361+0000","last_fullsized":"2024-09-16T07:34:12.660361+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:21.360924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638730+0000","last_change":"2024-09-16T07:34:12.638730+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638730+0000","last_undegraded":"2024-09-16T07:34:12.638730+0000","last_fullsized":"2024-09-16T07:34:12.638730+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663014+0000","last_change":"2024-09-16T07:34:12.659752+0000","last_active":"2024-09-16T07:34:12.663014+0000","last_peered":"2024-09-16T07:34:12.663014+0000","last_clean":"2024-09-16T07:34:12.663014+0000","last_became_active":"2024-09-16T07:34:12.659431+0000","last_became_peered":"2024-09-16T07:34:12.659431+0000","last_unstale":"2024-09-16T07:34:12.663014+0000","last_undegraded":"2024-09-16T07:34:12.663014+0000","last_fullsized":"2024-09-16T07:34:12.663014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:54.845908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641134+0000","last_change":"2024-09-16T07:34:12.641134+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641134+0000","last_undegraded":"2024-09-16T07:34:12.641134+0000","last_fullsized":"2024-09-16T07:34:12.641134+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659175+0000","last_change":"2024-09-16T07:34:12.654352+0000","last_active":"2024-09-16T07:34:12.659175+0000","last_peered":"2024-09-16T07:34:12.659175+0000","last_clean":"2024-09-16T07:34:12.659175+0000","last_became_active":"2024-09-16T07:34:12.654042+0000","last_became_peered":"2024-09-16T07:34:12.654042+0000","last_unstale":"2024-09-16T07:34:12.659175+0000","last_undegraded":"2024-09-16T07:34:12.659175+0000","last_fullsized":"2024-09-16T07:34:12.659175+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:10:08.401475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639643+0000","last_change":"2024-09-16T07:34:12.639643+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639643+0000","last_undegraded":"2024-09-16T07:34:12.639643+0000","last_fullsized":"2024-09-16T07:34:12.639643+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661665+0000","last_change":"2024-09-16T07:34:12.651035+0000","last_active":"2024-09-16T07:34:12.661665+0000","last_peered":"2024-09-16T07:34:12.661665+0000","last_clean":"2024-09-16T07:34:12.661665+0000","last_became_active":"2024-09-16T07:34:12.650831+0000","last_became_peered":"2024-09-16T07:34:12.650831+0000","last_unstale":"2024-09-16T07:34:12.661665+0000","last_undegraded":"2024-09-16T07:34:12.661665+0000","last_fullsized":"2024-09-16T07:34:12.661665+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:01.450699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643093+0000","last_change":"2024-09-16T07:34:12.643093+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643093+0000","last_undegraded":"2024-09-16T07:34:12.643093+0000","last_fullsized":"2024-09-16T07:34:12.643093+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659023+0000","last_change":"2024-09-16T07:34:12.657665+0000","last_active":"2024-09-16T07:34:12.659023+0000","last_peered":"2024-09-16T07:34:12.659023+0000","last_clean":"2024-09-16T07:34:12.659023+0000","last_became_active":"2024-09-16T07:34:12.657331+0000","last_became_peered":"2024-09-16T07:34:12.657331+0000","last_unstale":"2024-09-16T07:34:12.659023+0000","last_undegraded":"2024-09-16T07:34:12.659023+0000","last_fullsized":"2024-09-16T07:34:12.659023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:23.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.647051+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:12.647051+0000","last_peered":"2024-09-16T07:34:12.647051+0000","last_clean":"2024-09-16T07:34:12.647051+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:12.647051+0000","last_undegraded":"2024-09-16T07:34:12.647051+0000","last_fullsized":"2024-09-16T07:34:12.647051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:18.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:18.309 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:34:18.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:34:18.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.346+0000 7f036be00640 1 -- 172.21.15.114:0/3609590718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 msgr2=0x7f034c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.346+0000 7f036be00640 1 --2- 172.21.15.114:0/3609590718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 0x7f034c004c90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f0350009b60 tx=0x7f035001d270 comp rx=0 tx=0).stop 2024-09-16T07:34:18.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.346+0000 7f0369e00640 1 -- 172.21.15.114:0/3609590718 reap_dead start 2024-09-16T07:34:18.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.346+0000 7f036be00640 1 -- 172.21.15.114:0/3609590718 shutdown_connections 2024-09-16T07:34:18.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.346+0000 7f036be00640 1 -- 172.21.15.114:0/3609590718 >> 172.21.15.114:0/3609590718 conn(0x7f03640d1dc0 msgr2=0x7f03640d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:18.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.346+0000 7f036be00640 1 -- 172.21.15.114:0/3609590718 shutdown_connections 2024-09-16T07:34:18.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 -- 172.21.15.114:0/3609590718 wait complete. 2024-09-16T07:34:18.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 Processor -- start 2024-09-16T07:34:18.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 -- start start 2024-09-16T07:34:18.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 0x7f0364154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03641610e0 0x7f036415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0364161520 0x7f036415f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f036416a520 con 0x7f034c004810 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03640d1430 con 0x7f03641610e0 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f036416a6a0 con 0x7f0364161520 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 0x7f0364154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 0x7f0364154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42082/0 (socket says 172.21.15.114:42082) 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 -- 172.21.15.114:0/953847889 learned_addr learned my addr 172.21.15.114:0/953847889 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369e00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0364161520 0x7f036415f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0368a00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03641610e0 0x7f036415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 -- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0364161520 msgr2=0x7f036415f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0364161520 0x7f036415f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 -- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03641610e0 msgr2=0x7f036415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03641610e0 0x7f036415f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 -- 172.21.15.114:0/953847889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03641599a0 con 0x7f034c004810 2024-09-16T07:34:18.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0369400640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 0x7f0364154fe0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0358003ef0 tx=0x7f0358001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0361600640 1 -- 172.21.15.114:0/953847889 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358011640 con 0x7f034c004810 2024-09-16T07:34:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0361600640 1 -- 172.21.15.114:0/953847889 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0358016020 con 0x7f034c004810 2024-09-16T07:34:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0364159c20 con 0x7f034c004810 2024-09-16T07:34:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f0361600640 1 -- 172.21.15.114:0/953847889 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358011a60 con 0x7f034c004810 2024-09-16T07:34:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.350+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036415a1e0 con 0x7f034c004810 2024-09-16T07:34:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.354+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03640b2660 con 0x7f034c004810 2024-09-16T07:34:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.354+0000 7f0361600640 1 -- 172.21.15.114:0/953847889 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f0358011c00 con 0x7f034c004810 2024-09-16T07:34:18.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.354+0000 7f0361600640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0344073340 0x7f0344075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.354+0000 7f0361600640 1 -- 172.21.15.114:0/953847889 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f0358095340 con 0x7f034c004810 2024-09-16T07:34:18.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.354+0000 7f0368a00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0344073340 0x7f0344075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:18.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.354+0000 7f0368a00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0344073340 0x7f0344075800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f03500ae000 tx=0x7f035001a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:18.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.358+0000 7f0361600640 1 -- 172.21.15.114:0/953847889 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0358020020 con 0x7f034c004810 2024-09-16T07:34:18.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.526+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0364169740 con 0x7f0344073340 2024-09-16T07:34:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.530+0000 7f0361600640 1 -- 172.21.15.114:0/953847889 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249192 (secure 0 0 0) 0x7f0364169740 con 0x7f0344073340 2024-09-16T07:34:18.531 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:18.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0344073340 msgr2=0x7f0344075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0344073340 0x7f0344075800 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f03500ae000 tx=0x7f035001a010 comp rx=0 tx=0).stop 2024-09-16T07:34:18.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 msgr2=0x7f0364154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 0x7f0364154fe0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0358003ef0 tx=0x7f0358001640 comp rx=0 tx=0).stop 2024-09-16T07:34:18.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 shutdown_connections 2024-09-16T07:34:18.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0344073340 0x7f0344075800 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0364161520 0x7f036415f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03641610e0 0x7f036415f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 --2- 172.21.15.114:0/953847889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034c004810 0x7f0364154fe0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 >> 172.21.15.114:0/953847889 conn(0x7f03640d1dc0 msgr2=0x7f03640b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:18.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 shutdown_connections 2024-09-16T07:34:18.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.534+0000 7f036be00640 1 -- 172.21.15.114:0/953847889 wait complete. 2024-09-16T07:34:18.552 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-16T07:34:18.393647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261708,"kb_used_data":12192,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713012,"statfs":{"total":773094113280,"available":772826124288,"internally_reserved":0,"allocated":12484608,"data_stored":6105579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001215"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504440+0000","last_change":"2024-09-16T07:34:13.672956+0000","last_active":"2024-09-16T07:34:15.504440+0000","last_peered":"2024-09-16T07:34:15.504440+0000","last_clean":"2024-09-16T07:34:15.504440+0000","last_became_active":"2024-09-16T07:34:13.672692+0000","last_became_peered":"2024-09-16T07:34:13.672692+0000","last_unstale":"2024-09-16T07:34:15.504440+0000","last_undegraded":"2024-09-16T07:34:15.504440+0000","last_fullsized":"2024-09-16T07:34:15.504440+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:15:17.185363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505192+0000","last_change":"2024-09-16T07:34:13.658636+0000","last_active":"2024-09-16T07:34:15.505192+0000","last_peered":"2024-09-16T07:34:15.505192+0000","last_clean":"2024-09-16T07:34:15.505192+0000","last_became_active":"2024-09-16T07:34:13.653889+0000","last_became_peered":"2024-09-16T07:34:13.653889+0000","last_unstale":"2024-09-16T07:34:15.505192+0000","last_undegraded":"2024-09-16T07:34:15.505192+0000","last_fullsized":"2024-09-16T07:34:15.505192+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:05.800033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636940+0000","last_change":"2024-09-16T07:34:12.636940+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636940+0000","last_undegraded":"2024-09-16T07:34:12.636940+0000","last_fullsized":"2024-09-16T07:34:12.636940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504132+0000","last_change":"2024-09-16T07:34:13.665797+0000","last_active":"2024-09-16T07:34:15.504132+0000","last_peered":"2024-09-16T07:34:15.504132+0000","last_clean":"2024-09-16T07:34:15.504132+0000","last_became_active":"2024-09-16T07:34:13.665546+0000","last_became_peered":"2024-09-16T07:34:13.665546+0000","last_unstale":"2024-09-16T07:34:15.504132+0000","last_undegraded":"2024-09-16T07:34:15.504132+0000","last_fullsized":"2024-09-16T07:34:15.504132+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:57.220531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642553+0000","last_change":"2024-09-16T07:34:12.642553+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642553+0000","last_undegraded":"2024-09-16T07:34:12.642553+0000","last_fullsized":"2024-09-16T07:34:12.642553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639995+0000","last_change":"2024-09-16T07:34:12.639995+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639995+0000","last_undegraded":"2024-09-16T07:34:12.639995+0000","last_fullsized":"2024-09-16T07:34:12.639995+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638649+0000","last_change":"2024-09-16T07:34:12.638649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638649+0000","last_undegraded":"2024-09-16T07:34:12.638649+0000","last_fullsized":"2024-09-16T07:34:12.638649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636706+0000","last_change":"2024-09-16T07:34:12.636706+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636706+0000","last_undegraded":"2024-09-16T07:34:12.636706+0000","last_fullsized":"2024-09-16T07:34:12.636706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636675+0000","last_change":"2024-09-16T07:34:12.636675+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636675+0000","last_undegraded":"2024-09-16T07:34:12.636675+0000","last_fullsized":"2024-09-16T07:34:12.636675+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505362+0000","last_change":"2024-09-16T07:34:13.659200+0000","last_active":"2024-09-16T07:34:15.505362+0000","last_peered":"2024-09-16T07:34:15.505362+0000","last_clean":"2024-09-16T07:34:15.505362+0000","last_became_active":"2024-09-16T07:34:13.653501+0000","last_became_peered":"2024-09-16T07:34:13.653501+0000","last_unstale":"2024-09-16T07:34:15.505362+0000","last_undegraded":"2024-09-16T07:34:15.505362+0000","last_fullsized":"2024-09-16T07:34:15.505362+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:39.862878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504022+0000","last_change":"2024-09-16T07:34:13.665084+0000","last_active":"2024-09-16T07:34:15.504022+0000","last_peered":"2024-09-16T07:34:15.504022+0000","last_clean":"2024-09-16T07:34:15.504022+0000","last_became_active":"2024-09-16T07:34:13.664845+0000","last_became_peered":"2024-09-16T07:34:13.664845+0000","last_unstale":"2024-09-16T07:34:15.504022+0000","last_undegraded":"2024-09-16T07:34:15.504022+0000","last_fullsized":"2024-09-16T07:34:15.504022+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:47:55.045374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636919+0000","last_change":"2024-09-16T07:34:12.636919+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636919+0000","last_undegraded":"2024-09-16T07:34:12.636919+0000","last_fullsized":"2024-09-16T07:34:12.636919+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503588+0000","last_change":"2024-09-16T07:34:13.673461+0000","last_active":"2024-09-16T07:34:15.503588+0000","last_peered":"2024-09-16T07:34:15.503588+0000","last_clean":"2024-09-16T07:34:15.503588+0000","last_became_active":"2024-09-16T07:34:13.672601+0000","last_became_peered":"2024-09-16T07:34:13.672601+0000","last_unstale":"2024-09-16T07:34:15.503588+0000","last_undegraded":"2024-09-16T07:34:15.503588+0000","last_fullsized":"2024-09-16T07:34:15.503588+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:10.214596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505006+0000","last_change":"2024-09-16T07:34:13.648794+0000","last_active":"2024-09-16T07:34:15.505006+0000","last_peered":"2024-09-16T07:34:15.505006+0000","last_clean":"2024-09-16T07:34:15.505006+0000","last_became_active":"2024-09-16T07:34:13.648501+0000","last_became_peered":"2024-09-16T07:34:13.648501+0000","last_unstale":"2024-09-16T07:34:15.505006+0000","last_undegraded":"2024-09-16T07:34:15.505006+0000","last_fullsized":"2024-09-16T07:34:15.505006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:21:50.957200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503241+0000","last_change":"2024-09-16T07:34:13.672924+0000","last_active":"2024-09-16T07:34:15.503241+0000","last_peered":"2024-09-16T07:34:15.503241+0000","last_clean":"2024-09-16T07:34:15.503241+0000","last_became_active":"2024-09-16T07:34:13.672578+0000","last_became_peered":"2024-09-16T07:34:13.672578+0000","last_unstale":"2024-09-16T07:34:15.503241+0000","last_undegraded":"2024-09-16T07:34:15.503241+0000","last_fullsized":"2024-09-16T07:34:15.503241+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.466316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641965+0000","last_change":"2024-09-16T07:34:12.641965+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641965+0000","last_undegraded":"2024-09-16T07:34:12.641965+0000","last_fullsized":"2024-09-16T07:34:12.641965+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638367+0000","last_change":"2024-09-16T07:34:12.638367+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638367+0000","last_undegraded":"2024-09-16T07:34:12.638367+0000","last_fullsized":"2024-09-16T07:34:12.638367+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644800+0000","last_change":"2024-09-16T07:34:12.644800+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644800+0000","last_undegraded":"2024-09-16T07:34:12.644800+0000","last_fullsized":"2024-09-16T07:34:12.644800+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504161+0000","last_change":"2024-09-16T07:34:13.664503+0000","last_active":"2024-09-16T07:34:15.504161+0000","last_peered":"2024-09-16T07:34:15.504161+0000","last_clean":"2024-09-16T07:34:15.504161+0000","last_became_active":"2024-09-16T07:34:13.664228+0000","last_became_peered":"2024-09-16T07:34:13.664228+0000","last_unstale":"2024-09-16T07:34:15.504161+0000","last_undegraded":"2024-09-16T07:34:15.504161+0000","last_fullsized":"2024-09-16T07:34:15.504161+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:04.104863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642625+0000","last_change":"2024-09-16T07:34:12.642625+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642625+0000","last_undegraded":"2024-09-16T07:34:12.642625+0000","last_fullsized":"2024-09-16T07:34:12.642625+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646721+0000","last_change":"2024-09-16T07:34:12.646721+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646721+0000","last_undegraded":"2024-09-16T07:34:12.646721+0000","last_fullsized":"2024-09-16T07:34:12.646721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504041+0000","last_change":"2024-09-16T07:34:13.662414+0000","last_active":"2024-09-16T07:34:15.504041+0000","last_peered":"2024-09-16T07:34:15.504041+0000","last_clean":"2024-09-16T07:34:15.504041+0000","last_became_active":"2024-09-16T07:34:13.661920+0000","last_became_peered":"2024-09-16T07:34:13.661920+0000","last_unstale":"2024-09-16T07:34:15.504041+0000","last_undegraded":"2024-09-16T07:34:15.504041+0000","last_fullsized":"2024-09-16T07:34:15.504041+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:22:27.338480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636457+0000","last_change":"2024-09-16T07:34:12.636457+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636457+0000","last_undegraded":"2024-09-16T07:34:12.636457+0000","last_fullsized":"2024-09-16T07:34:12.636457+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503280+0000","last_change":"2024-09-16T07:34:13.657266+0000","last_active":"2024-09-16T07:34:15.503280+0000","last_peered":"2024-09-16T07:34:15.503280+0000","last_clean":"2024-09-16T07:34:15.503280+0000","last_became_active":"2024-09-16T07:34:13.656981+0000","last_became_peered":"2024-09-16T07:34:13.656981+0000","last_unstale":"2024-09-16T07:34:15.503280+0000","last_undegraded":"2024-09-16T07:34:15.503280+0000","last_fullsized":"2024-09-16T07:34:15.503280+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:44.477595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505206+0000","last_change":"2024-09-16T07:34:13.650758+0000","last_active":"2024-09-16T07:34:15.505206+0000","last_peered":"2024-09-16T07:34:15.505206+0000","last_clean":"2024-09-16T07:34:15.505206+0000","last_became_active":"2024-09-16T07:34:13.649398+0000","last_became_peered":"2024-09-16T07:34:13.649398+0000","last_unstale":"2024-09-16T07:34:15.505206+0000","last_undegraded":"2024-09-16T07:34:15.505206+0000","last_fullsized":"2024-09-16T07:34:15.505206+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:48.900154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644390+0000","last_change":"2024-09-16T07:34:12.644390+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644390+0000","last_undegraded":"2024-09-16T07:34:12.644390+0000","last_fullsized":"2024-09-16T07:34:12.644390+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503798+0000","last_change":"2024-09-16T07:34:13.673776+0000","last_active":"2024-09-16T07:34:15.503798+0000","last_peered":"2024-09-16T07:34:15.503798+0000","last_clean":"2024-09-16T07:34:15.503798+0000","last_became_active":"2024-09-16T07:34:13.673409+0000","last_became_peered":"2024-09-16T07:34:13.673409+0000","last_unstale":"2024-09-16T07:34:15.503798+0000","last_undegraded":"2024-09-16T07:34:15.503798+0000","last_fullsized":"2024-09-16T07:34:15.503798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:42.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639493+0000","last_change":"2024-09-16T07:34:12.639493+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639493+0000","last_undegraded":"2024-09-16T07:34:12.639493+0000","last_fullsized":"2024-09-16T07:34:12.639493+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503614+0000","last_change":"2024-09-16T07:34:13.657581+0000","last_active":"2024-09-16T07:34:15.503614+0000","last_peered":"2024-09-16T07:34:15.503614+0000","last_clean":"2024-09-16T07:34:15.503614+0000","last_became_active":"2024-09-16T07:34:13.656345+0000","last_became_peered":"2024-09-16T07:34:13.656345+0000","last_unstale":"2024-09-16T07:34:15.503614+0000","last_undegraded":"2024-09-16T07:34:15.503614+0000","last_fullsized":"2024-09-16T07:34:15.503614+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:50.709786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503254+0000","last_change":"2024-09-16T07:34:13.654484+0000","last_active":"2024-09-16T07:34:15.503254+0000","last_peered":"2024-09-16T07:34:15.503254+0000","last_clean":"2024-09-16T07:34:15.503254+0000","last_became_active":"2024-09-16T07:34:13.654207+0000","last_became_peered":"2024-09-16T07:34:13.654207+0000","last_unstale":"2024-09-16T07:34:15.503254+0000","last_undegraded":"2024-09-16T07:34:15.503254+0000","last_fullsized":"2024-09-16T07:34:15.503254+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:33:41.661619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645262+0000","last_change":"2024-09-16T07:34:12.645262+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645262+0000","last_undegraded":"2024-09-16T07:34:12.645262+0000","last_fullsized":"2024-09-16T07:34:12.645262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639312+0000","last_change":"2024-09-16T07:34:12.639312+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639312+0000","last_undegraded":"2024-09-16T07:34:12.639312+0000","last_fullsized":"2024-09-16T07:34:12.639312+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641806+0000","last_change":"2024-09-16T07:34:12.641806+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641806+0000","last_undegraded":"2024-09-16T07:34:12.641806+0000","last_fullsized":"2024-09-16T07:34:12.641806+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659094+0000","last_change":"2024-09-16T07:34:12.657427+0000","last_active":"2024-09-16T07:34:12.659094+0000","last_peered":"2024-09-16T07:34:12.659094+0000","last_clean":"2024-09-16T07:34:12.659094+0000","last_became_active":"2024-09-16T07:34:12.657135+0000","last_became_peered":"2024-09-16T07:34:12.657135+0000","last_unstale":"2024-09-16T07:34:12.659094+0000","last_undegraded":"2024-09-16T07:34:12.659094+0000","last_fullsized":"2024-09-16T07:34:12.659094+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:05:25.633905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635673+0000","last_change":"2024-09-16T07:34:12.635673+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635673+0000","last_undegraded":"2024-09-16T07:34:12.635673+0000","last_fullsized":"2024-09-16T07:34:12.635673+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.662924+0000","last_change":"2024-09-16T07:34:12.659539+0000","last_active":"2024-09-16T07:34:12.662924+0000","last_peered":"2024-09-16T07:34:12.662924+0000","last_clean":"2024-09-16T07:34:12.662924+0000","last_became_active":"2024-09-16T07:34:12.659264+0000","last_became_peered":"2024-09-16T07:34:12.659264+0000","last_unstale":"2024-09-16T07:34:12.662924+0000","last_undegraded":"2024-09-16T07:34:12.662924+0000","last_fullsized":"2024-09-16T07:34:12.662924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:25.888675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643971+0000","last_change":"2024-09-16T07:34:12.643971+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643971+0000","last_undegraded":"2024-09-16T07:34:12.643971+0000","last_fullsized":"2024-09-16T07:34:12.643971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504220+0000","last_change":"2024-09-16T07:34:12.661205+0000","last_active":"2024-09-16T07:34:15.504220+0000","last_peered":"2024-09-16T07:34:15.504220+0000","last_clean":"2024-09-16T07:34:15.504220+0000","last_became_active":"2024-09-16T07:34:12.659902+0000","last_became_peered":"2024-09-16T07:34:12.659902+0000","last_unstale":"2024-09-16T07:34:15.504220+0000","last_undegraded":"2024-09-16T07:34:15.504220+0000","last_fullsized":"2024-09-16T07:34:15.504220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:26.143139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644503+0000","last_change":"2024-09-16T07:34:12.644503+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644503+0000","last_undegraded":"2024-09-16T07:34:12.644503+0000","last_fullsized":"2024-09-16T07:34:12.644503+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505187+0000","last_change":"2024-09-16T07:34:12.662760+0000","last_active":"2024-09-16T07:34:15.505187+0000","last_peered":"2024-09-16T07:34:15.505187+0000","last_clean":"2024-09-16T07:34:15.505187+0000","last_became_active":"2024-09-16T07:34:12.662244+0000","last_became_peered":"2024-09-16T07:34:12.662244+0000","last_unstale":"2024-09-16T07:34:15.505187+0000","last_undegraded":"2024-09-16T07:34:15.505187+0000","last_fullsized":"2024-09-16T07:34:15.505187+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.908681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641852+0000","last_change":"2024-09-16T07:34:12.641852+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641852+0000","last_undegraded":"2024-09-16T07:34:12.641852+0000","last_fullsized":"2024-09-16T07:34:12.641852+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505005+0000","last_change":"2024-09-16T07:34:12.651655+0000","last_active":"2024-09-16T07:34:15.505005+0000","last_peered":"2024-09-16T07:34:15.505005+0000","last_clean":"2024-09-16T07:34:15.505005+0000","last_became_active":"2024-09-16T07:34:12.651346+0000","last_became_peered":"2024-09-16T07:34:12.651346+0000","last_unstale":"2024-09-16T07:34:15.505005+0000","last_undegraded":"2024-09-16T07:34:15.505005+0000","last_fullsized":"2024-09-16T07:34:15.505005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:52:10.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639978+0000","last_change":"2024-09-16T07:34:12.639978+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639978+0000","last_undegraded":"2024-09-16T07:34:12.639978+0000","last_fullsized":"2024-09-16T07:34:12.639978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659100+0000","last_change":"2024-09-16T07:34:12.654728+0000","last_active":"2024-09-16T07:34:12.659100+0000","last_peered":"2024-09-16T07:34:12.659100+0000","last_clean":"2024-09-16T07:34:12.659100+0000","last_became_active":"2024-09-16T07:34:12.654406+0000","last_became_peered":"2024-09-16T07:34:12.654406+0000","last_unstale":"2024-09-16T07:34:12.659100+0000","last_undegraded":"2024-09-16T07:34:12.659100+0000","last_fullsized":"2024-09-16T07:34:12.659100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:11.318328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635740+0000","last_change":"2024-09-16T07:34:12.635740+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635740+0000","last_undegraded":"2024-09-16T07:34:12.635740+0000","last_fullsized":"2024-09-16T07:34:12.635740+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653163+0000","last_change":"2024-09-16T07:34:12.649721+0000","last_active":"2024-09-16T07:34:12.653163+0000","last_peered":"2024-09-16T07:34:12.653163+0000","last_clean":"2024-09-16T07:34:12.653163+0000","last_became_active":"2024-09-16T07:34:12.649243+0000","last_became_peered":"2024-09-16T07:34:12.649243+0000","last_unstale":"2024-09-16T07:34:12.653163+0000","last_undegraded":"2024-09-16T07:34:12.653163+0000","last_fullsized":"2024-09-16T07:34:12.653163+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:49:52.693597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504633+0000","last_change":"2024-09-16T07:34:13.665563+0000","last_active":"2024-09-16T07:34:15.504633+0000","last_peered":"2024-09-16T07:34:15.504633+0000","last_clean":"2024-09-16T07:34:15.504633+0000","last_became_active":"2024-09-16T07:34:13.664995+0000","last_became_peered":"2024-09-16T07:34:13.664995+0000","last_unstale":"2024-09-16T07:34:15.504633+0000","last_undegraded":"2024-09-16T07:34:15.504633+0000","last_fullsized":"2024-09-16T07:34:15.504633+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:00.535299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504772+0000","last_change":"2024-09-16T07:34:12.655113+0000","last_active":"2024-09-16T07:34:15.504772+0000","last_peered":"2024-09-16T07:34:15.504772+0000","last_clean":"2024-09-16T07:34:15.504772+0000","last_became_active":"2024-09-16T07:34:12.654835+0000","last_became_peered":"2024-09-16T07:34:12.654835+0000","last_unstale":"2024-09-16T07:34:15.504772+0000","last_undegraded":"2024-09-16T07:34:15.504772+0000","last_fullsized":"2024-09-16T07:34:15.504772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:14.329410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503991+0000","last_change":"2024-09-16T07:34:13.659687+0000","last_active":"2024-09-16T07:34:15.503991+0000","last_peered":"2024-09-16T07:34:15.503991+0000","last_clean":"2024-09-16T07:34:15.503991+0000","last_became_active":"2024-09-16T07:34:13.659385+0000","last_became_peered":"2024-09-16T07:34:13.659385+0000","last_unstale":"2024-09-16T07:34:15.503991+0000","last_undegraded":"2024-09-16T07:34:15.503991+0000","last_fullsized":"2024-09-16T07:34:15.503991+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:24.855532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653560+0000","last_change":"2024-09-16T07:34:12.651609+0000","last_active":"2024-09-16T07:34:12.653560+0000","last_peered":"2024-09-16T07:34:12.653560+0000","last_clean":"2024-09-16T07:34:12.653560+0000","last_became_active":"2024-09-16T07:34:12.651303+0000","last_became_peered":"2024-09-16T07:34:12.651303+0000","last_unstale":"2024-09-16T07:34:12.653560+0000","last_undegraded":"2024-09-16T07:34:12.653560+0000","last_fullsized":"2024-09-16T07:34:12.653560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:34.672199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638763+0000","last_change":"2024-09-16T07:34:12.638763+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638763+0000","last_undegraded":"2024-09-16T07:34:12.638763+0000","last_fullsized":"2024-09-16T07:34:12.638763+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661932+0000","last_change":"2024-09-16T07:34:12.660262+0000","last_active":"2024-09-16T07:34:12.661932+0000","last_peered":"2024-09-16T07:34:12.661932+0000","last_clean":"2024-09-16T07:34:12.661932+0000","last_became_active":"2024-09-16T07:34:12.655867+0000","last_became_peered":"2024-09-16T07:34:12.655867+0000","last_unstale":"2024-09-16T07:34:12.661932+0000","last_undegraded":"2024-09-16T07:34:12.661932+0000","last_fullsized":"2024-09-16T07:34:12.661932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:20.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643497+0000","last_change":"2024-09-16T07:34:12.643497+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643497+0000","last_undegraded":"2024-09-16T07:34:12.643497+0000","last_fullsized":"2024-09-16T07:34:12.643497+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658384+0000","last_change":"2024-09-16T07:34:12.655601+0000","last_active":"2024-09-16T07:34:12.658384+0000","last_peered":"2024-09-16T07:34:12.658384+0000","last_clean":"2024-09-16T07:34:12.658384+0000","last_became_active":"2024-09-16T07:34:12.655398+0000","last_became_peered":"2024-09-16T07:34:12.655398+0000","last_unstale":"2024-09-16T07:34:12.658384+0000","last_undegraded":"2024-09-16T07:34:12.658384+0000","last_fullsized":"2024-09-16T07:34:12.658384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:20.670017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644089+0000","last_change":"2024-09-16T07:34:12.644089+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644089+0000","last_undegraded":"2024-09-16T07:34:12.644089+0000","last_fullsized":"2024-09-16T07:34:12.644089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653306+0000","last_change":"2024-09-16T07:34:12.649697+0000","last_active":"2024-09-16T07:34:12.653306+0000","last_peered":"2024-09-16T07:34:12.653306+0000","last_clean":"2024-09-16T07:34:12.653306+0000","last_became_active":"2024-09-16T07:34:12.649391+0000","last_became_peered":"2024-09-16T07:34:12.649391+0000","last_unstale":"2024-09-16T07:34:12.653306+0000","last_undegraded":"2024-09-16T07:34:12.653306+0000","last_fullsized":"2024-09-16T07:34:12.653306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:01.202262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503828+0000","last_change":"2024-09-16T07:34:13.658621+0000","last_active":"2024-09-16T07:34:15.503828+0000","last_peered":"2024-09-16T07:34:15.503828+0000","last_clean":"2024-09-16T07:34:15.503828+0000","last_became_active":"2024-09-16T07:34:13.658272+0000","last_became_peered":"2024-09-16T07:34:13.658272+0000","last_unstale":"2024-09-16T07:34:15.503828+0000","last_undegraded":"2024-09-16T07:34:15.503828+0000","last_fullsized":"2024-09-16T07:34:15.503828+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:45.856837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504062+0000","last_change":"2024-09-16T07:34:12.649804+0000","last_active":"2024-09-16T07:34:15.504062+0000","last_peered":"2024-09-16T07:34:15.504062+0000","last_clean":"2024-09-16T07:34:15.504062+0000","last_became_active":"2024-09-16T07:34:12.649503+0000","last_became_peered":"2024-09-16T07:34:12.649503+0000","last_unstale":"2024-09-16T07:34:15.504062+0000","last_undegraded":"2024-09-16T07:34:15.504062+0000","last_fullsized":"2024-09-16T07:34:15.504062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:39.034313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504591+0000","last_change":"2024-09-16T07:34:13.652673+0000","last_active":"2024-09-16T07:34:15.504591+0000","last_peered":"2024-09-16T07:34:15.504591+0000","last_clean":"2024-09-16T07:34:15.504591+0000","last_became_active":"2024-09-16T07:34:13.652336+0000","last_became_peered":"2024-09-16T07:34:13.652336+0000","last_unstale":"2024-09-16T07:34:15.504591+0000","last_undegraded":"2024-09-16T07:34:15.504591+0000","last_fullsized":"2024-09-16T07:34:15.504591+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:03.873944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504802+0000","last_change":"2024-09-16T07:34:12.654539+0000","last_active":"2024-09-16T07:34:15.504802+0000","last_peered":"2024-09-16T07:34:15.504802+0000","last_clean":"2024-09-16T07:34:15.504802+0000","last_became_active":"2024-09-16T07:34:12.654289+0000","last_became_peered":"2024-09-16T07:34:12.654289+0000","last_unstale":"2024-09-16T07:34:15.504802+0000","last_undegraded":"2024-09-16T07:34:15.504802+0000","last_fullsized":"2024-09-16T07:34:15.504802+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:21.506130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635737+0000","last_change":"2024-09-16T07:34:12.635737+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635737+0000","last_undegraded":"2024-09-16T07:34:12.635737+0000","last_fullsized":"2024-09-16T07:34:12.635737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658046+0000","last_change":"2024-09-16T07:34:12.654029+0000","last_active":"2024-09-16T07:34:12.658046+0000","last_peered":"2024-09-16T07:34:12.658046+0000","last_clean":"2024-09-16T07:34:12.658046+0000","last_became_active":"2024-09-16T07:34:12.653755+0000","last_became_peered":"2024-09-16T07:34:12.653755+0000","last_unstale":"2024-09-16T07:34:12.658046+0000","last_undegraded":"2024-09-16T07:34:12.658046+0000","last_fullsized":"2024-09-16T07:34:12.658046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:02.861959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635649+0000","last_change":"2024-09-16T07:34:12.635649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635649+0000","last_undegraded":"2024-09-16T07:34:12.635649+0000","last_fullsized":"2024-09-16T07:34:12.635649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653539+0000","last_change":"2024-09-16T07:34:12.650903+0000","last_active":"2024-09-16T07:34:12.653539+0000","last_peered":"2024-09-16T07:34:12.653539+0000","last_clean":"2024-09-16T07:34:12.653539+0000","last_became_active":"2024-09-16T07:34:12.650413+0000","last_became_peered":"2024-09-16T07:34:12.650413+0000","last_unstale":"2024-09-16T07:34:12.653539+0000","last_undegraded":"2024-09-16T07:34:12.653539+0000","last_fullsized":"2024-09-16T07:34:12.653539+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:21:41.801683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638333+0000","last_change":"2024-09-16T07:34:12.638333+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638333+0000","last_undegraded":"2024-09-16T07:34:12.638333+0000","last_fullsized":"2024-09-16T07:34:12.638333+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503554+0000","last_change":"2024-09-16T07:34:12.660836+0000","last_active":"2024-09-16T07:34:15.503554+0000","last_peered":"2024-09-16T07:34:15.503554+0000","last_clean":"2024-09-16T07:34:15.503554+0000","last_became_active":"2024-09-16T07:34:12.660027+0000","last_became_peered":"2024-09-16T07:34:12.660027+0000","last_unstale":"2024-09-16T07:34:15.503554+0000","last_undegraded":"2024-09-16T07:34:15.503554+0000","last_fullsized":"2024-09-16T07:34:15.503554+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:44.950170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642270+0000","last_change":"2024-09-16T07:34:12.642270+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642270+0000","last_undegraded":"2024-09-16T07:34:12.642270+0000","last_fullsized":"2024-09-16T07:34:12.642270+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658845+0000","last_change":"2024-09-16T07:34:12.657295+0000","last_active":"2024-09-16T07:34:12.658845+0000","last_peered":"2024-09-16T07:34:12.658845+0000","last_clean":"2024-09-16T07:34:12.658845+0000","last_became_active":"2024-09-16T07:34:12.656864+0000","last_became_peered":"2024-09-16T07:34:12.656864+0000","last_unstale":"2024-09-16T07:34:12.658845+0000","last_undegraded":"2024-09-16T07:34:12.658845+0000","last_fullsized":"2024-09-16T07:34:12.658845+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.065868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505443+0000","last_change":"2024-09-16T07:34:13.669369+0000","last_active":"2024-09-16T07:34:15.505443+0000","last_peered":"2024-09-16T07:34:15.505443+0000","last_clean":"2024-09-16T07:34:15.505443+0000","last_became_active":"2024-09-16T07:34:13.669117+0000","last_became_peered":"2024-09-16T07:34:13.669117+0000","last_unstale":"2024-09-16T07:34:15.505443+0000","last_undegraded":"2024-09-16T07:34:15.505443+0000","last_fullsized":"2024-09-16T07:34:15.505443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:58:26.021603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663298+0000","last_change":"2024-09-16T07:34:12.660110+0000","last_active":"2024-09-16T07:34:12.663298+0000","last_peered":"2024-09-16T07:34:12.663298+0000","last_clean":"2024-09-16T07:34:12.663298+0000","last_became_active":"2024-09-16T07:34:12.659784+0000","last_became_peered":"2024-09-16T07:34:12.659784+0000","last_unstale":"2024-09-16T07:34:12.663298+0000","last_undegraded":"2024-09-16T07:34:12.663298+0000","last_fullsized":"2024-09-16T07:34:12.663298+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:36:51.960957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503912+0000","last_change":"2024-09-16T07:34:13.658163+0000","last_active":"2024-09-16T07:34:15.503912+0000","last_peered":"2024-09-16T07:34:15.503912+0000","last_clean":"2024-09-16T07:34:15.503912+0000","last_became_active":"2024-09-16T07:34:13.657868+0000","last_became_peered":"2024-09-16T07:34:13.657868+0000","last_unstale":"2024-09-16T07:34:15.503912+0000","last_undegraded":"2024-09-16T07:34:15.503912+0000","last_fullsized":"2024-09-16T07:34:15.503912+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:23:29.828380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653472+0000","last_change":"2024-09-16T07:34:12.651711+0000","last_active":"2024-09-16T07:34:12.653472+0000","last_peered":"2024-09-16T07:34:12.653472+0000","last_clean":"2024-09-16T07:34:12.653472+0000","last_became_active":"2024-09-16T07:34:12.651345+0000","last_became_peered":"2024-09-16T07:34:12.651345+0000","last_unstale":"2024-09-16T07:34:12.653472+0000","last_undegraded":"2024-09-16T07:34:12.653472+0000","last_fullsized":"2024-09-16T07:34:12.653472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:25.456450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639595+0000","last_change":"2024-09-16T07:34:12.639595+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639595+0000","last_undegraded":"2024-09-16T07:34:12.639595+0000","last_fullsized":"2024-09-16T07:34:12.639595+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659125+0000","last_change":"2024-09-16T07:34:12.655035+0000","last_active":"2024-09-16T07:34:12.659125+0000","last_peered":"2024-09-16T07:34:12.659125+0000","last_clean":"2024-09-16T07:34:12.659125+0000","last_became_active":"2024-09-16T07:34:12.654389+0000","last_became_peered":"2024-09-16T07:34:12.654389+0000","last_unstale":"2024-09-16T07:34:12.659125+0000","last_undegraded":"2024-09-16T07:34:12.659125+0000","last_fullsized":"2024-09-16T07:34:12.659125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:04.088398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504635+0000","last_change":"2024-09-16T07:34:13.660598+0000","last_active":"2024-09-16T07:34:15.504635+0000","last_peered":"2024-09-16T07:34:15.504635+0000","last_clean":"2024-09-16T07:34:15.504635+0000","last_became_active":"2024-09-16T07:34:13.660316+0000","last_became_peered":"2024-09-16T07:34:13.660316+0000","last_unstale":"2024-09-16T07:34:15.504635+0000","last_undegraded":"2024-09-16T07:34:15.504635+0000","last_fullsized":"2024-09-16T07:34:15.504635+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:02.887719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660503+0000","last_change":"2024-09-16T07:34:12.657796+0000","last_active":"2024-09-16T07:34:12.660503+0000","last_peered":"2024-09-16T07:34:12.660503+0000","last_clean":"2024-09-16T07:34:12.660503+0000","last_became_active":"2024-09-16T07:34:12.657514+0000","last_became_peered":"2024-09-16T07:34:12.657514+0000","last_unstale":"2024-09-16T07:34:12.660503+0000","last_undegraded":"2024-09-16T07:34:12.660503+0000","last_fullsized":"2024-09-16T07:34:12.660503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:47.365227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646101+0000","last_change":"2024-09-16T07:34:12.646101+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646101+0000","last_undegraded":"2024-09-16T07:34:12.646101+0000","last_fullsized":"2024-09-16T07:34:12.646101+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503265+0000","last_change":"2024-09-16T07:34:12.655999+0000","last_active":"2024-09-16T07:34:15.503265+0000","last_peered":"2024-09-16T07:34:15.503265+0000","last_clean":"2024-09-16T07:34:15.503265+0000","last_became_active":"2024-09-16T07:34:12.652081+0000","last_became_peered":"2024-09-16T07:34:12.652081+0000","last_unstale":"2024-09-16T07:34:15.503265+0000","last_undegraded":"2024-09-16T07:34:15.503265+0000","last_fullsized":"2024-09-16T07:34:15.503265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:38:31.307496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640318+0000","last_change":"2024-09-16T07:34:12.640318+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640318+0000","last_undegraded":"2024-09-16T07:34:12.640318+0000","last_fullsized":"2024-09-16T07:34:12.640318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504217+0000","last_change":"2024-09-16T07:34:12.658649+0000","last_active":"2024-09-16T07:34:15.504217+0000","last_peered":"2024-09-16T07:34:15.504217+0000","last_clean":"2024-09-16T07:34:15.504217+0000","last_became_active":"2024-09-16T07:34:12.656266+0000","last_became_peered":"2024-09-16T07:34:12.656266+0000","last_unstale":"2024-09-16T07:34:15.504217+0000","last_undegraded":"2024-09-16T07:34:15.504217+0000","last_fullsized":"2024-09-16T07:34:15.504217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:21:26.790697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504056+0000","last_change":"2024-09-16T07:34:13.655934+0000","last_active":"2024-09-16T07:34:15.504056+0000","last_peered":"2024-09-16T07:34:15.504056+0000","last_clean":"2024-09-16T07:34:15.504056+0000","last_became_active":"2024-09-16T07:34:13.655311+0000","last_became_peered":"2024-09-16T07:34:13.655311+0000","last_unstale":"2024-09-16T07:34:15.504056+0000","last_undegraded":"2024-09-16T07:34:15.504056+0000","last_fullsized":"2024-09-16T07:34:15.504056+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:01:00.397244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.655133+0000","last_change":"2024-09-16T07:34:12.652868+0000","last_active":"2024-09-16T07:34:12.655133+0000","last_peered":"2024-09-16T07:34:12.655133+0000","last_clean":"2024-09-16T07:34:12.655133+0000","last_became_active":"2024-09-16T07:34:12.652597+0000","last_became_peered":"2024-09-16T07:34:12.652597+0000","last_unstale":"2024-09-16T07:34:12.655133+0000","last_undegraded":"2024-09-16T07:34:12.655133+0000","last_fullsized":"2024-09-16T07:34:12.655133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:58.027181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505200+0000","last_change":"2024-09-16T07:34:13.657928+0000","last_active":"2024-09-16T07:34:15.505200+0000","last_peered":"2024-09-16T07:34:15.505200+0000","last_clean":"2024-09-16T07:34:15.505200+0000","last_became_active":"2024-09-16T07:34:13.657656+0000","last_became_peered":"2024-09-16T07:34:13.657656+0000","last_unstale":"2024-09-16T07:34:15.505200+0000","last_undegraded":"2024-09-16T07:34:15.505200+0000","last_fullsized":"2024-09-16T07:34:15.505200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:43.797652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505364+0000","last_change":"2024-09-16T07:34:12.655139+0000","last_active":"2024-09-16T07:34:15.505364+0000","last_peered":"2024-09-16T07:34:15.505364+0000","last_clean":"2024-09-16T07:34:15.505364+0000","last_became_active":"2024-09-16T07:34:12.654832+0000","last_became_peered":"2024-09-16T07:34:12.654832+0000","last_unstale":"2024-09-16T07:34:15.505364+0000","last_undegraded":"2024-09-16T07:34:15.505364+0000","last_fullsized":"2024-09-16T07:34:15.505364+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:41.141205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640542+0000","last_change":"2024-09-16T07:34:12.640542+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640542+0000","last_undegraded":"2024-09-16T07:34:12.640542+0000","last_fullsized":"2024-09-16T07:34:12.640542+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503686+0000","last_change":"2024-09-16T07:34:12.658546+0000","last_active":"2024-09-16T07:34:15.503686+0000","last_peered":"2024-09-16T07:34:15.503686+0000","last_clean":"2024-09-16T07:34:15.503686+0000","last_became_active":"2024-09-16T07:34:12.658298+0000","last_became_peered":"2024-09-16T07:34:12.658298+0000","last_unstale":"2024-09-16T07:34:15.503686+0000","last_undegraded":"2024-09-16T07:34:15.503686+0000","last_fullsized":"2024-09-16T07:34:15.503686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:57:08.175670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642596+0000","last_change":"2024-09-16T07:34:12.642596+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642596+0000","last_undegraded":"2024-09-16T07:34:12.642596+0000","last_fullsized":"2024-09-16T07:34:12.642596+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505013+0000","last_change":"2024-09-16T07:34:12.652258+0000","last_active":"2024-09-16T07:34:15.505013+0000","last_peered":"2024-09-16T07:34:15.505013+0000","last_clean":"2024-09-16T07:34:15.505013+0000","last_became_active":"2024-09-16T07:34:12.652016+0000","last_became_peered":"2024-09-16T07:34:12.652016+0000","last_unstale":"2024-09-16T07:34:15.505013+0000","last_undegraded":"2024-09-16T07:34:15.505013+0000","last_fullsized":"2024-09-16T07:34:15.505013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:58:54.063927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638730+0000","last_change":"2024-09-16T07:34:12.638730+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638730+0000","last_undegraded":"2024-09-16T07:34:12.638730+0000","last_fullsized":"2024-09-16T07:34:12.638730+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663014+0000","last_change":"2024-09-16T07:34:12.659752+0000","last_active":"2024-09-16T07:34:12.663014+0000","last_peered":"2024-09-16T07:34:12.663014+0000","last_clean":"2024-09-16T07:34:12.663014+0000","last_became_active":"2024-09-16T07:34:12.659431+0000","last_became_peered":"2024-09-16T07:34:12.659431+0000","last_unstale":"2024-09-16T07:34:12.663014+0000","last_undegraded":"2024-09-16T07:34:12.663014+0000","last_fullsized":"2024-09-16T07:34:12.663014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:54.845908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641134+0000","last_change":"2024-09-16T07:34:12.641134+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641134+0000","last_undegraded":"2024-09-16T07:34:12.641134+0000","last_fullsized":"2024-09-16T07:34:12.641134+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659175+0000","last_change":"2024-09-16T07:34:12.654352+0000","last_active":"2024-09-16T07:34:12.659175+0000","last_peered":"2024-09-16T07:34:12.659175+0000","last_clean":"2024-09-16T07:34:12.659175+0000","last_became_active":"2024-09-16T07:34:12.654042+0000","last_became_peered":"2024-09-16T07:34:12.654042+0000","last_unstale":"2024-09-16T07:34:12.659175+0000","last_undegraded":"2024-09-16T07:34:12.659175+0000","last_fullsized":"2024-09-16T07:34:12.659175+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:10:08.401475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504640+0000","last_change":"2024-09-16T07:34:13.655824+0000","last_active":"2024-09-16T07:34:15.504640+0000","last_peered":"2024-09-16T07:34:15.504640+0000","last_clean":"2024-09-16T07:34:15.504640+0000","last_became_active":"2024-09-16T07:34:13.655556+0000","last_became_peered":"2024-09-16T07:34:13.655556+0000","last_unstale":"2024-09-16T07:34:15.504640+0000","last_undegraded":"2024-09-16T07:34:15.504640+0000","last_fullsized":"2024-09-16T07:34:15.504640+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:19:01.327496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503389+0000","last_change":"2024-09-16T07:34:12.651035+0000","last_active":"2024-09-16T07:34:15.503389+0000","last_peered":"2024-09-16T07:34:15.503389+0000","last_clean":"2024-09-16T07:34:15.503389+0000","last_became_active":"2024-09-16T07:34:12.650831+0000","last_became_peered":"2024-09-16T07:34:12.650831+0000","last_unstale":"2024-09-16T07:34:15.503389+0000","last_undegraded":"2024-09-16T07:34:15.503389+0000","last_fullsized":"2024-09-16T07:34:15.503389+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:27.636448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643093+0000","last_change":"2024-09-16T07:34:12.643093+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643093+0000","last_undegraded":"2024-09-16T07:34:12.643093+0000","last_fullsized":"2024-09-16T07:34:12.643093+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659023+0000","last_change":"2024-09-16T07:34:12.657665+0000","last_active":"2024-09-16T07:34:12.659023+0000","last_peered":"2024-09-16T07:34:12.659023+0000","last_clean":"2024-09-16T07:34:12.659023+0000","last_became_active":"2024-09-16T07:34:12.657331+0000","last_became_peered":"2024-09-16T07:34:12.657331+0000","last_unstale":"2024-09-16T07:34:12.659023+0000","last_undegraded":"2024-09-16T07:34:12.659023+0000","last_fullsized":"2024-09-16T07:34:12.659023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:23.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.647051+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:12.647051+0000","last_peered":"2024-09-16T07:34:12.647051+0000","last_clean":"2024-09-16T07:34:12.647051+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:12.647051+0000","last_undegraded":"2024-09-16T07:34:12.647051+0000","last_fullsized":"2024-09-16T07:34:12.647051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1437696,"data_stored":625885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1429504,"data_stored":625269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1215637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:18.556 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-16T07:34:18.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.636940+0000', 'last_change': '2024-09-16T07:34:12.636940+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.636940+0000', 'last_undegraded': '2024-09-16T07:34:12.636940+0000', 'last_fullsized': '2024-09-16T07:34:12.636940+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.556 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3b is not active+clean 2024-09-16T07:34:18.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.642553+0000', 'last_change': '2024-09-16T07:34:12.642553+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.642553+0000', 'last_undegraded': '2024-09-16T07:34:12.642553+0000', 'last_fullsized': '2024-09-16T07:34:12.642553+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.556 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-09-16T07:34:18.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.639995+0000', 'last_change': '2024-09-16T07:34:12.639995+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.639995+0000', 'last_undegraded': '2024-09-16T07:34:12.639995+0000', 'last_fullsized': '2024-09-16T07:34:12.639995+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.638649+0000', 'last_change': '2024-09-16T07:34:12.638649+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.638649+0000', 'last_undegraded': '2024-09-16T07:34:12.638649+0000', 'last_fullsized': '2024-09-16T07:34:12.638649+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.636706+0000', 'last_change': '2024-09-16T07:34:12.636706+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.636706+0000', 'last_undegraded': '2024-09-16T07:34:12.636706+0000', 'last_fullsized': '2024-09-16T07:34:12.636706+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.636675+0000', 'last_change': '2024-09-16T07:34:12.636675+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.636675+0000', 'last_undegraded': '2024-09-16T07:34:12.636675+0000', 'last_fullsized': '2024-09-16T07:34:12.636675+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.636919+0000', 'last_change': '2024-09-16T07:34:12.636919+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.636919+0000', 'last_undegraded': '2024-09-16T07:34:12.636919+0000', 'last_fullsized': '2024-09-16T07:34:12.636919+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:PG 19.30 is not active+clean 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.641965+0000', 'last_change': '2024-09-16T07:34:12.641965+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.641965+0000', 'last_undegraded': '2024-09-16T07:34:12.641965+0000', 'last_fullsized': '2024-09-16T07:34:12.641965+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.557 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.638367+0000', 'last_change': '2024-09-16T07:34:12.638367+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.638367+0000', 'last_undegraded': '2024-09-16T07:34:12.638367+0000', 'last_fullsized': '2024-09-16T07:34:12.638367+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2e is not active+clean 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.644800+0000', 'last_change': '2024-09-16T07:34:12.644800+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.644800+0000', 'last_undegraded': '2024-09-16T07:34:12.644800+0000', 'last_fullsized': '2024-09-16T07:34:12.644800+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2c is not active+clean 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.642625+0000', 'last_change': '2024-09-16T07:34:12.642625+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.642625+0000', 'last_undegraded': '2024-09-16T07:34:12.642625+0000', 'last_fullsized': '2024-09-16T07:34:12.642625+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2b is not active+clean 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.646721+0000', 'last_change': '2024-09-16T07:34:12.646721+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.646721+0000', 'last_undegraded': '2024-09-16T07:34:12.646721+0000', 'last_fullsized': '2024-09-16T07:34:12.646721+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.636457+0000', 'last_change': '2024-09-16T07:34:12.636457+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.636457+0000', 'last_undegraded': '2024-09-16T07:34:12.636457+0000', 'last_fullsized': '2024-09-16T07:34:12.636457+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:PG 19.26 is not active+clean 2024-09-16T07:34:18.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.644390+0000', 'last_change': '2024-09-16T07:34:12.644390+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.644390+0000', 'last_undegraded': '2024-09-16T07:34:12.644390+0000', 'last_fullsized': '2024-09-16T07:34:12.644390+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:PG 19.24 is not active+clean 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.639493+0000', 'last_change': '2024-09-16T07:34:12.639493+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.639493+0000', 'last_undegraded': '2024-09-16T07:34:12.639493+0000', 'last_fullsized': '2024-09-16T07:34:12.639493+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.645262+0000', 'last_change': '2024-09-16T07:34:12.645262+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.645262+0000', 'last_undegraded': '2024-09-16T07:34:12.645262+0000', 'last_fullsized': '2024-09-16T07:34:12.645262+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.639312+0000', 'last_change': '2024-09-16T07:34:12.639312+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.639312+0000', 'last_undegraded': '2024-09-16T07:34:12.639312+0000', 'last_fullsized': '2024-09-16T07:34:12.639312+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1e is not active+clean 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.641806+0000', 'last_change': '2024-09-16T07:34:12.641806+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.641806+0000', 'last_undegraded': '2024-09-16T07:34:12.641806+0000', 'last_fullsized': '2024-09-16T07:34:12.641806+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.635673+0000', 'last_change': '2024-09-16T07:34:12.635673+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.635673+0000', 'last_undegraded': '2024-09-16T07:34:12.635673+0000', 'last_fullsized': '2024-09-16T07:34:12.635673+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.559 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1c is not active+clean 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.643971+0000', 'last_change': '2024-09-16T07:34:12.643971+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.643971+0000', 'last_undegraded': '2024-09-16T07:34:12.643971+0000', 'last_fullsized': '2024-09-16T07:34:12.643971+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1d is not active+clean 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.644503+0000', 'last_change': '2024-09-16T07:34:12.644503+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.644503+0000', 'last_undegraded': '2024-09-16T07:34:12.644503+0000', 'last_fullsized': '2024-09-16T07:34:12.644503+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1a is not active+clean 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.641852+0000', 'last_change': '2024-09-16T07:34:12.641852+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.641852+0000', 'last_undegraded': '2024-09-16T07:34:12.641852+0000', 'last_fullsized': '2024-09-16T07:34:12.641852+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.639978+0000', 'last_change': '2024-09-16T07:34:12.639978+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.639978+0000', 'last_undegraded': '2024-09-16T07:34:12.639978+0000', 'last_fullsized': '2024-09-16T07:34:12.639978+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.635740+0000', 'last_change': '2024-09-16T07:34:12.635740+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.635740+0000', 'last_undegraded': '2024-09-16T07:34:12.635740+0000', 'last_fullsized': '2024-09-16T07:34:12.635740+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:PG 19.17 is not active+clean 2024-09-16T07:34:18.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.638763+0000', 'last_change': '2024-09-16T07:34:12.638763+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.638763+0000', 'last_undegraded': '2024-09-16T07:34:12.638763+0000', 'last_fullsized': '2024-09-16T07:34:12.638763+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:PG 19.14 is not active+clean 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.643497+0000', 'last_change': '2024-09-16T07:34:12.643497+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.643497+0000', 'last_undegraded': '2024-09-16T07:34:12.643497+0000', 'last_fullsized': '2024-09-16T07:34:12.643497+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:PG 19.15 is not active+clean 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.644089+0000', 'last_change': '2024-09-16T07:34:12.644089+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.644089+0000', 'last_undegraded': '2024-09-16T07:34:12.644089+0000', 'last_fullsized': '2024-09-16T07:34:12.644089+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.635737+0000', 'last_change': '2024-09-16T07:34:12.635737+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.635737+0000', 'last_undegraded': '2024-09-16T07:34:12.635737+0000', 'last_fullsized': '2024-09-16T07:34:12.635737+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.635649+0000', 'last_change': '2024-09-16T07:34:12.635649+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.635649+0000', 'last_undegraded': '2024-09-16T07:34:12.635649+0000', 'last_fullsized': '2024-09-16T07:34:12.635649+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:PG 19.f is not active+clean 2024-09-16T07:34:18.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.638333+0000', 'last_change': '2024-09-16T07:34:12.638333+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.638333+0000', 'last_undegraded': '2024-09-16T07:34:12.638333+0000', 'last_fullsized': '2024-09-16T07:34:12.638333+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:PG 19.c is not active+clean 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.642270+0000', 'last_change': '2024-09-16T07:34:12.642270+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.642270+0000', 'last_undegraded': '2024-09-16T07:34:12.642270+0000', 'last_fullsized': '2024-09-16T07:34:12.642270+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.639595+0000', 'last_change': '2024-09-16T07:34:12.639595+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.639595+0000', 'last_undegraded': '2024-09-16T07:34:12.639595+0000', 'last_fullsized': '2024-09-16T07:34:12.639595+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:PG 19.9 is not active+clean 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.646101+0000', 'last_change': '2024-09-16T07:34:12.646101+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.646101+0000', 'last_undegraded': '2024-09-16T07:34:12.646101+0000', 'last_fullsized': '2024-09-16T07:34:12.646101+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.640318+0000', 'last_change': '2024-09-16T07:34:12.640318+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.640318+0000', 'last_undegraded': '2024-09-16T07:34:12.640318+0000', 'last_fullsized': '2024-09-16T07:34:12.640318+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-09-16T07:34:18.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.640542+0000', 'last_change': '2024-09-16T07:34:12.640542+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.640542+0000', 'last_undegraded': '2024-09-16T07:34:12.640542+0000', 'last_fullsized': '2024-09-16T07:34:12.640542+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2 is not active+clean 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.642596+0000', 'last_change': '2024-09-16T07:34:12.642596+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.642596+0000', 'last_undegraded': '2024-09-16T07:34:12.642596+0000', 'last_fullsized': '2024-09-16T07:34:12.642596+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3 is not active+clean 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.638730+0000', 'last_change': '2024-09-16T07:34:12.638730+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.638730+0000', 'last_undegraded': '2024-09-16T07:34:12.638730+0000', 'last_fullsized': '2024-09-16T07:34:12.638730+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:PG 19.0 is not active+clean 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.641134+0000', 'last_change': '2024-09-16T07:34:12.641134+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.641134+0000', 'last_undegraded': '2024-09-16T07:34:12.641134+0000', 'last_fullsized': '2024-09-16T07:34:12.641134+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:PG 19.12 is not active+clean 2024-09-16T07:34:18.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 113, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:34:12.643093+0000', 'last_change': '2024-09-16T07:34:12.643093+0000', 'last_active': '2024-09-16T07:34:12.625732+0000', 'last_peered': '2024-09-16T07:34:12.625732+0000', 'last_clean': '2024-09-16T07:34:12.625732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:34:12.643093+0000', 'last_undegraded': '2024-09-16T07:34:12.643093+0000', 'last_fullsized': '2024-09-16T07:34:12.643093+0000', 'mapping_epoch': 113, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 113, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'last_clean_scrub_stamp': '2024-09-16T07:34:12.625732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:34:18.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:34:18.603 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-16T07:34:18.606+0000 7f41f4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:34:18.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.742+0000 7f0745200640 1 -- 172.21.15.114:0/3107445949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 msgr2=0x7f072400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.742+0000 7f0745200640 1 --2- 172.21.15.114:0/3107445949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 0x7f072400b9d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0738009fc0 tx=0x7f073801c920 comp rx=0 tx=0).stop 2024-09-16T07:34:18.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.742+0000 7f073e800640 1 -- 172.21.15.114:0/3107445949 reap_dead start 2024-09-16T07:34:18.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.742+0000 7f0745200640 1 -- 172.21.15.114:0/3107445949 shutdown_connections 2024-09-16T07:34:18.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.742+0000 7f0745200640 1 -- 172.21.15.114:0/3107445949 >> 172.21.15.114:0/3107445949 conn(0x7f07400d1e40 msgr2=0x7f07400d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:18.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.742+0000 7f0745200640 1 -- 172.21.15.114:0/3107445949 shutdown_connections 2024-09-16T07:34:18.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.742+0000 7f0745200640 1 -- 172.21.15.114:0/3107445949 wait complete. 2024-09-16T07:34:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 Processor -- start 2024-09-16T07:34:18.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 -- start start 2024-09-16T07:34:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 0x7f074015b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07400c5940 0x7f074006ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f074015bf20 0x7f074006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0740168100 con 0x7f0724004f70 2024-09-16T07:34:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0740167f80 con 0x7f07400c5940 2024-09-16T07:34:18.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0740168280 con 0x7f074015bf20 2024-09-16T07:34:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 0x7f074015b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 0x7f074015b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42100/0 (socket says 172.21.15.114:42100) 2024-09-16T07:34:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 -- 172.21.15.114:0/399726704 learned_addr learned my addr 172.21.15.114:0/399726704 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073d400640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07400c5940 0x7f074006ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:18.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 -- 172.21.15.114:0/399726704 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f074015bf20 msgr2=0x7f074006f2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T07:34:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f074015bf20 0x7f074006f2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 -- 172.21.15.114:0/399726704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07400c5940 msgr2=0x7f074006ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07400c5940 0x7f074006ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 -- 172.21.15.114:0/399726704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07400c8600 con 0x7f0724004f70 2024-09-16T07:34:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f073de00640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 0x7f074015b9e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0730006f40 tx=0x7f07300039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:18.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0736000640 1 -- 172.21.15.114:0/399726704 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730015070 con 0x7f0724004f70 2024-09-16T07:34:18.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0736000640 1 -- 172.21.15.114:0/399726704 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0730011900 con 0x7f0724004f70 2024-09-16T07:34:18.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07400c8b80 con 0x7f0724004f70 2024-09-16T07:34:18.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0736000640 1 -- 172.21.15.114:0/399726704 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730011d30 con 0x7f0724004f70 2024-09-16T07:34:18.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07400c88a0 con 0x7f0724004f70 2024-09-16T07:34:18.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.746+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074015fec0 con 0x7f0724004f70 2024-09-16T07:34:18.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.750+0000 7f0736000640 1 -- 172.21.15.114:0/399726704 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f0730018070 con 0x7f0724004f70 2024-09-16T07:34:18.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.750+0000 7f0736000640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0720073340 0x7f0720075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:18.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.750+0000 7f0736000640 1 -- 172.21.15.114:0/399726704 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f07300954a0 con 0x7f0724004f70 2024-09-16T07:34:18.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.750+0000 7f073d400640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0720073340 0x7f0720075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:18.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.750+0000 7f073d400640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0720073340 0x7f0720075800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f07400aebb0 tx=0x7f072c006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:18.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.754+0000 7f0736000640 1 -- 172.21.15.114:0/399726704 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f07400d0c80 con 0x7f0724004f70 2024-09-16T07:34:18.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.978+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f074015ad30 con 0x7f0724004f70 2024-09-16T07:34:18.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0736000640 1 -- 172.21.15.114:0/399726704 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1558 (secure 0 0 0) 0x7f073005ff70 con 0x7f0724004f70 2024-09-16T07:34:18.979 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:18.979 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":383,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":115,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":58},{"state_name":"creating+peering","count":39}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590368,"bytes_used":267988992,"bytes_avail":772826124288,"bytes_total":773094113280,"inactive_pgs_ratio":0.40206184983253479,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":83,"btime":"2024-09-16T07:34:16:663795+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":7467}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-16T07:33:54.388897+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0720073340 msgr2=0x7f0720075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0720073340 0x7f0720075800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f07400aebb0 tx=0x7f072c006b80 comp rx=0 tx=0).stop 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 msgr2=0x7f074015b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 0x7f074015b9e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f0730006f40 tx=0x7f07300039d0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 shutdown_connections 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0720073340 0x7f0720075800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f074015bf20 0x7f074006f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f07400c5940 0x7f074006ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 --2- 172.21.15.114:0/399726704 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0724004f70 0x7f074015b9e0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:18.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 >> 172.21.15.114:0/399726704 conn(0x7f07400d1e40 msgr2=0x7f074015b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:18.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 shutdown_connections 2024-09-16T07:34:18.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:18.982+0000 7f0745200640 1 -- 172.21.15.114:0/399726704 wait complete. 2024-09-16T07:34:19.001 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:34:19.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:19.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 -- 172.21.15.114:0/1397353922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f300 msgr2=0x7f3a680ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 --2- 172.21.15.114:0/1397353922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f300 0x7f3a680ccd40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009840 tx=0x7f3a5c01c760 comp rx=0 tx=0).stop 2024-09-16T07:34:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 -- 172.21.15.114:0/1397353922 shutdown_connections 2024-09-16T07:34:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 --2- 172.21.15.114:0/1397353922 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a680cdae0 0x7f3a680cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 --2- 172.21.15.114:0/1397353922 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f300 0x7f3a680ccd40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 -- 172.21.15.114:0/1397353922 >> 172.21.15.114:0/1397353922 conn(0x7f3a680b18f0 msgr2=0x7f3a680b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 -- 172.21.15.114:0/1397353922 shutdown_connections 2024-09-16T07:34:19.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.182+0000 7f3a70200640 1 -- 172.21.15.114:0/1397353922 wait complete. 2024-09-16T07:34:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 Processor -- start 2024-09-16T07:34:19.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 -- start start 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a680cdae0 0x7f3a68152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a6815f300 0x7f3a68154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f900 0x7f3a680b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68169630 con 0x7f3a6815f900 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a681694b0 con 0x7f3a680cdae0 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3a681697b0 con 0x7f3a6815f300 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f900 0x7f3a680b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f900 0x7f3a680b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42120/0 (socket says 172.21.15.114:42120) 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 -- 172.21.15.114:0/1974979289 learned_addr learned my addr 172.21.15.114:0/1974979289 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:19.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6ce00640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a6815f300 0x7f3a68154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:19.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6d800640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a680cdae0 0x7f3a68152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 -- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a6815f300 msgr2=0x7f3a68154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a6815f300 0x7f3a68154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 -- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a680cdae0 msgr2=0x7f3a68152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a680cdae0 0x7f3a68152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 -- 172.21.15.114:0/1974979289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a681fb8d0 con 0x7f3a6815f900 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6d800640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a680cdae0 0x7f3a68152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6ce00640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a6815f300 0x7f3a68154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a6e200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f900 0x7f3a680b0a70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000cae0 tx=0x7f3a6000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a65600640 1 -- 172.21.15.114:0/1974979289 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60016020 con 0x7f3a6815f900 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a65600640 1 -- 172.21.15.114:0/1974979289 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a6000ab40 con 0x7f3a6815f900 2024-09-16T07:34:19.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a681fbbb0 con 0x7f3a6815f900 2024-09-16T07:34:19.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a65600640 1 -- 172.21.15.114:0/1974979289 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000ce20 con 0x7f3a6815f900 2024-09-16T07:34:19.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.186+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681fc170 con 0x7f3a6815f900 2024-09-16T07:34:19.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.190+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a68069410 con 0x7f3a6815f900 2024-09-16T07:34:19.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.190+0000 7f3a65600640 1 -- 172.21.15.114:0/1974979289 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f3a60019020 con 0x7f3a6815f900 2024-09-16T07:34:19.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.190+0000 7f3a65600640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a48073340 0x7f3a48075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:19.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.190+0000 7f3a65600640 1 -- 172.21.15.114:0/1974979289 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f3a60094690 con 0x7f3a6815f900 2024-09-16T07:34:19.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.190+0000 7f3a6d800640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a48073340 0x7f3a48075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:19.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.190+0000 7f3a6d800640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a48073340 0x7f3a48075800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0af000 tx=0x7f3a5c01afa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:19.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.194+0000 7f3a65600640 1 -- 172.21.15.114:0/1974979289 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3a60020030 con 0x7f3a6815f900 2024-09-16T07:34:19.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.362+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a681f8100 con 0x7f3a48073340 2024-09-16T07:34:19.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a65600640 1 -- 172.21.15.114:0/1974979289 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249192 (secure 0 0 0) 0x7f3a5c004460 con 0x7f3a48073340 2024-09-16T07:34:19.365 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:19.366 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a48073340 msgr2=0x7f3a48075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a48073340 0x7f3a48075800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0af000 tx=0x7f3a5c01afa0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f900 msgr2=0x7f3a680b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f900 0x7f3a680b0a70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000cae0 tx=0x7f3a6000cbd0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 shutdown_connections 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a6815f900 0x7f3a680b0a70 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a48073340 0x7f3a48075800 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a6815f300 0x7f3a68154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 --2- 172.21.15.114:0/1974979289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a680cdae0 0x7f3a68152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.366+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 >> 172.21.15.114:0/1974979289 conn(0x7f3a680b18f0 msgr2=0x7f3a680cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.370+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 shutdown_connections 2024-09-16T07:34:19.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:19.370+0000 7f3a70200640 1 -- 172.21.15.114:0/1974979289 wait complete. 2024-09-16T07:34:19.386 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-16T07:34:18.393647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261708,"kb_used_data":12192,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713012,"statfs":{"total":773094113280,"available":772826124288,"internally_reserved":0,"allocated":12484608,"data_stored":6105579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001215"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504440+0000","last_change":"2024-09-16T07:34:13.672956+0000","last_active":"2024-09-16T07:34:15.504440+0000","last_peered":"2024-09-16T07:34:15.504440+0000","last_clean":"2024-09-16T07:34:15.504440+0000","last_became_active":"2024-09-16T07:34:13.672692+0000","last_became_peered":"2024-09-16T07:34:13.672692+0000","last_unstale":"2024-09-16T07:34:15.504440+0000","last_undegraded":"2024-09-16T07:34:15.504440+0000","last_fullsized":"2024-09-16T07:34:15.504440+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:15:17.185363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505192+0000","last_change":"2024-09-16T07:34:13.658636+0000","last_active":"2024-09-16T07:34:15.505192+0000","last_peered":"2024-09-16T07:34:15.505192+0000","last_clean":"2024-09-16T07:34:15.505192+0000","last_became_active":"2024-09-16T07:34:13.653889+0000","last_became_peered":"2024-09-16T07:34:13.653889+0000","last_unstale":"2024-09-16T07:34:15.505192+0000","last_undegraded":"2024-09-16T07:34:15.505192+0000","last_fullsized":"2024-09-16T07:34:15.505192+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:05.800033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636940+0000","last_change":"2024-09-16T07:34:12.636940+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636940+0000","last_undegraded":"2024-09-16T07:34:12.636940+0000","last_fullsized":"2024-09-16T07:34:12.636940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504132+0000","last_change":"2024-09-16T07:34:13.665797+0000","last_active":"2024-09-16T07:34:15.504132+0000","last_peered":"2024-09-16T07:34:15.504132+0000","last_clean":"2024-09-16T07:34:15.504132+0000","last_became_active":"2024-09-16T07:34:13.665546+0000","last_became_peered":"2024-09-16T07:34:13.665546+0000","last_unstale":"2024-09-16T07:34:15.504132+0000","last_undegraded":"2024-09-16T07:34:15.504132+0000","last_fullsized":"2024-09-16T07:34:15.504132+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:57.220531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642553+0000","last_change":"2024-09-16T07:34:12.642553+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642553+0000","last_undegraded":"2024-09-16T07:34:12.642553+0000","last_fullsized":"2024-09-16T07:34:12.642553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639995+0000","last_change":"2024-09-16T07:34:12.639995+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639995+0000","last_undegraded":"2024-09-16T07:34:12.639995+0000","last_fullsized":"2024-09-16T07:34:12.639995+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638649+0000","last_change":"2024-09-16T07:34:12.638649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638649+0000","last_undegraded":"2024-09-16T07:34:12.638649+0000","last_fullsized":"2024-09-16T07:34:12.638649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636706+0000","last_change":"2024-09-16T07:34:12.636706+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636706+0000","last_undegraded":"2024-09-16T07:34:12.636706+0000","last_fullsized":"2024-09-16T07:34:12.636706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636675+0000","last_change":"2024-09-16T07:34:12.636675+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636675+0000","last_undegraded":"2024-09-16T07:34:12.636675+0000","last_fullsized":"2024-09-16T07:34:12.636675+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505362+0000","last_change":"2024-09-16T07:34:13.659200+0000","last_active":"2024-09-16T07:34:15.505362+0000","last_peered":"2024-09-16T07:34:15.505362+0000","last_clean":"2024-09-16T07:34:15.505362+0000","last_became_active":"2024-09-16T07:34:13.653501+0000","last_became_peered":"2024-09-16T07:34:13.653501+0000","last_unstale":"2024-09-16T07:34:15.505362+0000","last_undegraded":"2024-09-16T07:34:15.505362+0000","last_fullsized":"2024-09-16T07:34:15.505362+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:39.862878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504022+0000","last_change":"2024-09-16T07:34:13.665084+0000","last_active":"2024-09-16T07:34:15.504022+0000","last_peered":"2024-09-16T07:34:15.504022+0000","last_clean":"2024-09-16T07:34:15.504022+0000","last_became_active":"2024-09-16T07:34:13.664845+0000","last_became_peered":"2024-09-16T07:34:13.664845+0000","last_unstale":"2024-09-16T07:34:15.504022+0000","last_undegraded":"2024-09-16T07:34:15.504022+0000","last_fullsized":"2024-09-16T07:34:15.504022+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:47:55.045374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636919+0000","last_change":"2024-09-16T07:34:12.636919+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636919+0000","last_undegraded":"2024-09-16T07:34:12.636919+0000","last_fullsized":"2024-09-16T07:34:12.636919+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503588+0000","last_change":"2024-09-16T07:34:13.673461+0000","last_active":"2024-09-16T07:34:15.503588+0000","last_peered":"2024-09-16T07:34:15.503588+0000","last_clean":"2024-09-16T07:34:15.503588+0000","last_became_active":"2024-09-16T07:34:13.672601+0000","last_became_peered":"2024-09-16T07:34:13.672601+0000","last_unstale":"2024-09-16T07:34:15.503588+0000","last_undegraded":"2024-09-16T07:34:15.503588+0000","last_fullsized":"2024-09-16T07:34:15.503588+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:10.214596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505006+0000","last_change":"2024-09-16T07:34:13.648794+0000","last_active":"2024-09-16T07:34:15.505006+0000","last_peered":"2024-09-16T07:34:15.505006+0000","last_clean":"2024-09-16T07:34:15.505006+0000","last_became_active":"2024-09-16T07:34:13.648501+0000","last_became_peered":"2024-09-16T07:34:13.648501+0000","last_unstale":"2024-09-16T07:34:15.505006+0000","last_undegraded":"2024-09-16T07:34:15.505006+0000","last_fullsized":"2024-09-16T07:34:15.505006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:21:50.957200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503241+0000","last_change":"2024-09-16T07:34:13.672924+0000","last_active":"2024-09-16T07:34:15.503241+0000","last_peered":"2024-09-16T07:34:15.503241+0000","last_clean":"2024-09-16T07:34:15.503241+0000","last_became_active":"2024-09-16T07:34:13.672578+0000","last_became_peered":"2024-09-16T07:34:13.672578+0000","last_unstale":"2024-09-16T07:34:15.503241+0000","last_undegraded":"2024-09-16T07:34:15.503241+0000","last_fullsized":"2024-09-16T07:34:15.503241+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.466316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641965+0000","last_change":"2024-09-16T07:34:12.641965+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641965+0000","last_undegraded":"2024-09-16T07:34:12.641965+0000","last_fullsized":"2024-09-16T07:34:12.641965+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638367+0000","last_change":"2024-09-16T07:34:12.638367+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638367+0000","last_undegraded":"2024-09-16T07:34:12.638367+0000","last_fullsized":"2024-09-16T07:34:12.638367+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644800+0000","last_change":"2024-09-16T07:34:12.644800+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644800+0000","last_undegraded":"2024-09-16T07:34:12.644800+0000","last_fullsized":"2024-09-16T07:34:12.644800+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504161+0000","last_change":"2024-09-16T07:34:13.664503+0000","last_active":"2024-09-16T07:34:15.504161+0000","last_peered":"2024-09-16T07:34:15.504161+0000","last_clean":"2024-09-16T07:34:15.504161+0000","last_became_active":"2024-09-16T07:34:13.664228+0000","last_became_peered":"2024-09-16T07:34:13.664228+0000","last_unstale":"2024-09-16T07:34:15.504161+0000","last_undegraded":"2024-09-16T07:34:15.504161+0000","last_fullsized":"2024-09-16T07:34:15.504161+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:04.104863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642625+0000","last_change":"2024-09-16T07:34:12.642625+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642625+0000","last_undegraded":"2024-09-16T07:34:12.642625+0000","last_fullsized":"2024-09-16T07:34:12.642625+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646721+0000","last_change":"2024-09-16T07:34:12.646721+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646721+0000","last_undegraded":"2024-09-16T07:34:12.646721+0000","last_fullsized":"2024-09-16T07:34:12.646721+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504041+0000","last_change":"2024-09-16T07:34:13.662414+0000","last_active":"2024-09-16T07:34:15.504041+0000","last_peered":"2024-09-16T07:34:15.504041+0000","last_clean":"2024-09-16T07:34:15.504041+0000","last_became_active":"2024-09-16T07:34:13.661920+0000","last_became_peered":"2024-09-16T07:34:13.661920+0000","last_unstale":"2024-09-16T07:34:15.504041+0000","last_undegraded":"2024-09-16T07:34:15.504041+0000","last_fullsized":"2024-09-16T07:34:15.504041+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:22:27.338480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.636457+0000","last_change":"2024-09-16T07:34:12.636457+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.636457+0000","last_undegraded":"2024-09-16T07:34:12.636457+0000","last_fullsized":"2024-09-16T07:34:12.636457+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503280+0000","last_change":"2024-09-16T07:34:13.657266+0000","last_active":"2024-09-16T07:34:15.503280+0000","last_peered":"2024-09-16T07:34:15.503280+0000","last_clean":"2024-09-16T07:34:15.503280+0000","last_became_active":"2024-09-16T07:34:13.656981+0000","last_became_peered":"2024-09-16T07:34:13.656981+0000","last_unstale":"2024-09-16T07:34:15.503280+0000","last_undegraded":"2024-09-16T07:34:15.503280+0000","last_fullsized":"2024-09-16T07:34:15.503280+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:44.477595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505206+0000","last_change":"2024-09-16T07:34:13.650758+0000","last_active":"2024-09-16T07:34:15.505206+0000","last_peered":"2024-09-16T07:34:15.505206+0000","last_clean":"2024-09-16T07:34:15.505206+0000","last_became_active":"2024-09-16T07:34:13.649398+0000","last_became_peered":"2024-09-16T07:34:13.649398+0000","last_unstale":"2024-09-16T07:34:15.505206+0000","last_undegraded":"2024-09-16T07:34:15.505206+0000","last_fullsized":"2024-09-16T07:34:15.505206+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:48.900154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644390+0000","last_change":"2024-09-16T07:34:12.644390+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644390+0000","last_undegraded":"2024-09-16T07:34:12.644390+0000","last_fullsized":"2024-09-16T07:34:12.644390+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503798+0000","last_change":"2024-09-16T07:34:13.673776+0000","last_active":"2024-09-16T07:34:15.503798+0000","last_peered":"2024-09-16T07:34:15.503798+0000","last_clean":"2024-09-16T07:34:15.503798+0000","last_became_active":"2024-09-16T07:34:13.673409+0000","last_became_peered":"2024-09-16T07:34:13.673409+0000","last_unstale":"2024-09-16T07:34:15.503798+0000","last_undegraded":"2024-09-16T07:34:15.503798+0000","last_fullsized":"2024-09-16T07:34:15.503798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:42.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639493+0000","last_change":"2024-09-16T07:34:12.639493+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639493+0000","last_undegraded":"2024-09-16T07:34:12.639493+0000","last_fullsized":"2024-09-16T07:34:12.639493+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503614+0000","last_change":"2024-09-16T07:34:13.657581+0000","last_active":"2024-09-16T07:34:15.503614+0000","last_peered":"2024-09-16T07:34:15.503614+0000","last_clean":"2024-09-16T07:34:15.503614+0000","last_became_active":"2024-09-16T07:34:13.656345+0000","last_became_peered":"2024-09-16T07:34:13.656345+0000","last_unstale":"2024-09-16T07:34:15.503614+0000","last_undegraded":"2024-09-16T07:34:15.503614+0000","last_fullsized":"2024-09-16T07:34:15.503614+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:50.709786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503254+0000","last_change":"2024-09-16T07:34:13.654484+0000","last_active":"2024-09-16T07:34:15.503254+0000","last_peered":"2024-09-16T07:34:15.503254+0000","last_clean":"2024-09-16T07:34:15.503254+0000","last_became_active":"2024-09-16T07:34:13.654207+0000","last_became_peered":"2024-09-16T07:34:13.654207+0000","last_unstale":"2024-09-16T07:34:15.503254+0000","last_undegraded":"2024-09-16T07:34:15.503254+0000","last_fullsized":"2024-09-16T07:34:15.503254+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:33:41.661619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.645262+0000","last_change":"2024-09-16T07:34:12.645262+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.645262+0000","last_undegraded":"2024-09-16T07:34:12.645262+0000","last_fullsized":"2024-09-16T07:34:12.645262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639312+0000","last_change":"2024-09-16T07:34:12.639312+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639312+0000","last_undegraded":"2024-09-16T07:34:12.639312+0000","last_fullsized":"2024-09-16T07:34:12.639312+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641806+0000","last_change":"2024-09-16T07:34:12.641806+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641806+0000","last_undegraded":"2024-09-16T07:34:12.641806+0000","last_fullsized":"2024-09-16T07:34:12.641806+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659094+0000","last_change":"2024-09-16T07:34:12.657427+0000","last_active":"2024-09-16T07:34:12.659094+0000","last_peered":"2024-09-16T07:34:12.659094+0000","last_clean":"2024-09-16T07:34:12.659094+0000","last_became_active":"2024-09-16T07:34:12.657135+0000","last_became_peered":"2024-09-16T07:34:12.657135+0000","last_unstale":"2024-09-16T07:34:12.659094+0000","last_undegraded":"2024-09-16T07:34:12.659094+0000","last_fullsized":"2024-09-16T07:34:12.659094+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:05:25.633905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635673+0000","last_change":"2024-09-16T07:34:12.635673+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635673+0000","last_undegraded":"2024-09-16T07:34:12.635673+0000","last_fullsized":"2024-09-16T07:34:12.635673+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.662924+0000","last_change":"2024-09-16T07:34:12.659539+0000","last_active":"2024-09-16T07:34:12.662924+0000","last_peered":"2024-09-16T07:34:12.662924+0000","last_clean":"2024-09-16T07:34:12.662924+0000","last_became_active":"2024-09-16T07:34:12.659264+0000","last_became_peered":"2024-09-16T07:34:12.659264+0000","last_unstale":"2024-09-16T07:34:12.662924+0000","last_undegraded":"2024-09-16T07:34:12.662924+0000","last_fullsized":"2024-09-16T07:34:12.662924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:25.888675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643971+0000","last_change":"2024-09-16T07:34:12.643971+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643971+0000","last_undegraded":"2024-09-16T07:34:12.643971+0000","last_fullsized":"2024-09-16T07:34:12.643971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504220+0000","last_change":"2024-09-16T07:34:12.661205+0000","last_active":"2024-09-16T07:34:15.504220+0000","last_peered":"2024-09-16T07:34:15.504220+0000","last_clean":"2024-09-16T07:34:15.504220+0000","last_became_active":"2024-09-16T07:34:12.659902+0000","last_became_peered":"2024-09-16T07:34:12.659902+0000","last_unstale":"2024-09-16T07:34:15.504220+0000","last_undegraded":"2024-09-16T07:34:15.504220+0000","last_fullsized":"2024-09-16T07:34:15.504220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:26.143139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644503+0000","last_change":"2024-09-16T07:34:12.644503+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644503+0000","last_undegraded":"2024-09-16T07:34:12.644503+0000","last_fullsized":"2024-09-16T07:34:12.644503+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505187+0000","last_change":"2024-09-16T07:34:12.662760+0000","last_active":"2024-09-16T07:34:15.505187+0000","last_peered":"2024-09-16T07:34:15.505187+0000","last_clean":"2024-09-16T07:34:15.505187+0000","last_became_active":"2024-09-16T07:34:12.662244+0000","last_became_peered":"2024-09-16T07:34:12.662244+0000","last_unstale":"2024-09-16T07:34:15.505187+0000","last_undegraded":"2024-09-16T07:34:15.505187+0000","last_fullsized":"2024-09-16T07:34:15.505187+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.908681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641852+0000","last_change":"2024-09-16T07:34:12.641852+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641852+0000","last_undegraded":"2024-09-16T07:34:12.641852+0000","last_fullsized":"2024-09-16T07:34:12.641852+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505005+0000","last_change":"2024-09-16T07:34:12.651655+0000","last_active":"2024-09-16T07:34:15.505005+0000","last_peered":"2024-09-16T07:34:15.505005+0000","last_clean":"2024-09-16T07:34:15.505005+0000","last_became_active":"2024-09-16T07:34:12.651346+0000","last_became_peered":"2024-09-16T07:34:12.651346+0000","last_unstale":"2024-09-16T07:34:15.505005+0000","last_undegraded":"2024-09-16T07:34:15.505005+0000","last_fullsized":"2024-09-16T07:34:15.505005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:52:10.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639978+0000","last_change":"2024-09-16T07:34:12.639978+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639978+0000","last_undegraded":"2024-09-16T07:34:12.639978+0000","last_fullsized":"2024-09-16T07:34:12.639978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659100+0000","last_change":"2024-09-16T07:34:12.654728+0000","last_active":"2024-09-16T07:34:12.659100+0000","last_peered":"2024-09-16T07:34:12.659100+0000","last_clean":"2024-09-16T07:34:12.659100+0000","last_became_active":"2024-09-16T07:34:12.654406+0000","last_became_peered":"2024-09-16T07:34:12.654406+0000","last_unstale":"2024-09-16T07:34:12.659100+0000","last_undegraded":"2024-09-16T07:34:12.659100+0000","last_fullsized":"2024-09-16T07:34:12.659100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:11.318328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635740+0000","last_change":"2024-09-16T07:34:12.635740+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635740+0000","last_undegraded":"2024-09-16T07:34:12.635740+0000","last_fullsized":"2024-09-16T07:34:12.635740+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653163+0000","last_change":"2024-09-16T07:34:12.649721+0000","last_active":"2024-09-16T07:34:12.653163+0000","last_peered":"2024-09-16T07:34:12.653163+0000","last_clean":"2024-09-16T07:34:12.653163+0000","last_became_active":"2024-09-16T07:34:12.649243+0000","last_became_peered":"2024-09-16T07:34:12.649243+0000","last_unstale":"2024-09-16T07:34:12.653163+0000","last_undegraded":"2024-09-16T07:34:12.653163+0000","last_fullsized":"2024-09-16T07:34:12.653163+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:49:52.693597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504633+0000","last_change":"2024-09-16T07:34:13.665563+0000","last_active":"2024-09-16T07:34:15.504633+0000","last_peered":"2024-09-16T07:34:15.504633+0000","last_clean":"2024-09-16T07:34:15.504633+0000","last_became_active":"2024-09-16T07:34:13.664995+0000","last_became_peered":"2024-09-16T07:34:13.664995+0000","last_unstale":"2024-09-16T07:34:15.504633+0000","last_undegraded":"2024-09-16T07:34:15.504633+0000","last_fullsized":"2024-09-16T07:34:15.504633+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:00.535299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504772+0000","last_change":"2024-09-16T07:34:12.655113+0000","last_active":"2024-09-16T07:34:15.504772+0000","last_peered":"2024-09-16T07:34:15.504772+0000","last_clean":"2024-09-16T07:34:15.504772+0000","last_became_active":"2024-09-16T07:34:12.654835+0000","last_became_peered":"2024-09-16T07:34:12.654835+0000","last_unstale":"2024-09-16T07:34:15.504772+0000","last_undegraded":"2024-09-16T07:34:15.504772+0000","last_fullsized":"2024-09-16T07:34:15.504772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:14.329410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503991+0000","last_change":"2024-09-16T07:34:13.659687+0000","last_active":"2024-09-16T07:34:15.503991+0000","last_peered":"2024-09-16T07:34:15.503991+0000","last_clean":"2024-09-16T07:34:15.503991+0000","last_became_active":"2024-09-16T07:34:13.659385+0000","last_became_peered":"2024-09-16T07:34:13.659385+0000","last_unstale":"2024-09-16T07:34:15.503991+0000","last_undegraded":"2024-09-16T07:34:15.503991+0000","last_fullsized":"2024-09-16T07:34:15.503991+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:24.855532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653560+0000","last_change":"2024-09-16T07:34:12.651609+0000","last_active":"2024-09-16T07:34:12.653560+0000","last_peered":"2024-09-16T07:34:12.653560+0000","last_clean":"2024-09-16T07:34:12.653560+0000","last_became_active":"2024-09-16T07:34:12.651303+0000","last_became_peered":"2024-09-16T07:34:12.651303+0000","last_unstale":"2024-09-16T07:34:12.653560+0000","last_undegraded":"2024-09-16T07:34:12.653560+0000","last_fullsized":"2024-09-16T07:34:12.653560+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:01:34.672199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638763+0000","last_change":"2024-09-16T07:34:12.638763+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638763+0000","last_undegraded":"2024-09-16T07:34:12.638763+0000","last_fullsized":"2024-09-16T07:34:12.638763+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.661932+0000","last_change":"2024-09-16T07:34:12.660262+0000","last_active":"2024-09-16T07:34:12.661932+0000","last_peered":"2024-09-16T07:34:12.661932+0000","last_clean":"2024-09-16T07:34:12.661932+0000","last_became_active":"2024-09-16T07:34:12.655867+0000","last_became_peered":"2024-09-16T07:34:12.655867+0000","last_unstale":"2024-09-16T07:34:12.661932+0000","last_undegraded":"2024-09-16T07:34:12.661932+0000","last_fullsized":"2024-09-16T07:34:12.661932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:20.009544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643497+0000","last_change":"2024-09-16T07:34:12.643497+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643497+0000","last_undegraded":"2024-09-16T07:34:12.643497+0000","last_fullsized":"2024-09-16T07:34:12.643497+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658384+0000","last_change":"2024-09-16T07:34:12.655601+0000","last_active":"2024-09-16T07:34:12.658384+0000","last_peered":"2024-09-16T07:34:12.658384+0000","last_clean":"2024-09-16T07:34:12.658384+0000","last_became_active":"2024-09-16T07:34:12.655398+0000","last_became_peered":"2024-09-16T07:34:12.655398+0000","last_unstale":"2024-09-16T07:34:12.658384+0000","last_undegraded":"2024-09-16T07:34:12.658384+0000","last_fullsized":"2024-09-16T07:34:12.658384+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:20.670017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.644089+0000","last_change":"2024-09-16T07:34:12.644089+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.644089+0000","last_undegraded":"2024-09-16T07:34:12.644089+0000","last_fullsized":"2024-09-16T07:34:12.644089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653306+0000","last_change":"2024-09-16T07:34:12.649697+0000","last_active":"2024-09-16T07:34:12.653306+0000","last_peered":"2024-09-16T07:34:12.653306+0000","last_clean":"2024-09-16T07:34:12.653306+0000","last_became_active":"2024-09-16T07:34:12.649391+0000","last_became_peered":"2024-09-16T07:34:12.649391+0000","last_unstale":"2024-09-16T07:34:12.653306+0000","last_undegraded":"2024-09-16T07:34:12.653306+0000","last_fullsized":"2024-09-16T07:34:12.653306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:01.202262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503828+0000","last_change":"2024-09-16T07:34:13.658621+0000","last_active":"2024-09-16T07:34:15.503828+0000","last_peered":"2024-09-16T07:34:15.503828+0000","last_clean":"2024-09-16T07:34:15.503828+0000","last_became_active":"2024-09-16T07:34:13.658272+0000","last_became_peered":"2024-09-16T07:34:13.658272+0000","last_unstale":"2024-09-16T07:34:15.503828+0000","last_undegraded":"2024-09-16T07:34:15.503828+0000","last_fullsized":"2024-09-16T07:34:15.503828+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:45.856837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504062+0000","last_change":"2024-09-16T07:34:12.649804+0000","last_active":"2024-09-16T07:34:15.504062+0000","last_peered":"2024-09-16T07:34:15.504062+0000","last_clean":"2024-09-16T07:34:15.504062+0000","last_became_active":"2024-09-16T07:34:12.649503+0000","last_became_peered":"2024-09-16T07:34:12.649503+0000","last_unstale":"2024-09-16T07:34:15.504062+0000","last_undegraded":"2024-09-16T07:34:15.504062+0000","last_fullsized":"2024-09-16T07:34:15.504062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:39.034313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504591+0000","last_change":"2024-09-16T07:34:13.652673+0000","last_active":"2024-09-16T07:34:15.504591+0000","last_peered":"2024-09-16T07:34:15.504591+0000","last_clean":"2024-09-16T07:34:15.504591+0000","last_became_active":"2024-09-16T07:34:13.652336+0000","last_became_peered":"2024-09-16T07:34:13.652336+0000","last_unstale":"2024-09-16T07:34:15.504591+0000","last_undegraded":"2024-09-16T07:34:15.504591+0000","last_fullsized":"2024-09-16T07:34:15.504591+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:03.873944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504802+0000","last_change":"2024-09-16T07:34:12.654539+0000","last_active":"2024-09-16T07:34:15.504802+0000","last_peered":"2024-09-16T07:34:15.504802+0000","last_clean":"2024-09-16T07:34:15.504802+0000","last_became_active":"2024-09-16T07:34:12.654289+0000","last_became_peered":"2024-09-16T07:34:12.654289+0000","last_unstale":"2024-09-16T07:34:15.504802+0000","last_undegraded":"2024-09-16T07:34:15.504802+0000","last_fullsized":"2024-09-16T07:34:15.504802+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:21.506130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635737+0000","last_change":"2024-09-16T07:34:12.635737+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635737+0000","last_undegraded":"2024-09-16T07:34:12.635737+0000","last_fullsized":"2024-09-16T07:34:12.635737+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658046+0000","last_change":"2024-09-16T07:34:12.654029+0000","last_active":"2024-09-16T07:34:12.658046+0000","last_peered":"2024-09-16T07:34:12.658046+0000","last_clean":"2024-09-16T07:34:12.658046+0000","last_became_active":"2024-09-16T07:34:12.653755+0000","last_became_peered":"2024-09-16T07:34:12.653755+0000","last_unstale":"2024-09-16T07:34:12.658046+0000","last_undegraded":"2024-09-16T07:34:12.658046+0000","last_fullsized":"2024-09-16T07:34:12.658046+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:02.861959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.635649+0000","last_change":"2024-09-16T07:34:12.635649+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.635649+0000","last_undegraded":"2024-09-16T07:34:12.635649+0000","last_fullsized":"2024-09-16T07:34:12.635649+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653539+0000","last_change":"2024-09-16T07:34:12.650903+0000","last_active":"2024-09-16T07:34:12.653539+0000","last_peered":"2024-09-16T07:34:12.653539+0000","last_clean":"2024-09-16T07:34:12.653539+0000","last_became_active":"2024-09-16T07:34:12.650413+0000","last_became_peered":"2024-09-16T07:34:12.650413+0000","last_unstale":"2024-09-16T07:34:12.653539+0000","last_undegraded":"2024-09-16T07:34:12.653539+0000","last_fullsized":"2024-09-16T07:34:12.653539+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:21:41.801683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638333+0000","last_change":"2024-09-16T07:34:12.638333+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638333+0000","last_undegraded":"2024-09-16T07:34:12.638333+0000","last_fullsized":"2024-09-16T07:34:12.638333+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503554+0000","last_change":"2024-09-16T07:34:12.660836+0000","last_active":"2024-09-16T07:34:15.503554+0000","last_peered":"2024-09-16T07:34:15.503554+0000","last_clean":"2024-09-16T07:34:15.503554+0000","last_became_active":"2024-09-16T07:34:12.660027+0000","last_became_peered":"2024-09-16T07:34:12.660027+0000","last_unstale":"2024-09-16T07:34:15.503554+0000","last_undegraded":"2024-09-16T07:34:15.503554+0000","last_fullsized":"2024-09-16T07:34:15.503554+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:44.950170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642270+0000","last_change":"2024-09-16T07:34:12.642270+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642270+0000","last_undegraded":"2024-09-16T07:34:12.642270+0000","last_fullsized":"2024-09-16T07:34:12.642270+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.658845+0000","last_change":"2024-09-16T07:34:12.657295+0000","last_active":"2024-09-16T07:34:12.658845+0000","last_peered":"2024-09-16T07:34:12.658845+0000","last_clean":"2024-09-16T07:34:12.658845+0000","last_became_active":"2024-09-16T07:34:12.656864+0000","last_became_peered":"2024-09-16T07:34:12.656864+0000","last_unstale":"2024-09-16T07:34:12.658845+0000","last_undegraded":"2024-09-16T07:34:12.658845+0000","last_fullsized":"2024-09-16T07:34:12.658845+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.065868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505443+0000","last_change":"2024-09-16T07:34:13.669369+0000","last_active":"2024-09-16T07:34:15.505443+0000","last_peered":"2024-09-16T07:34:15.505443+0000","last_clean":"2024-09-16T07:34:15.505443+0000","last_became_active":"2024-09-16T07:34:13.669117+0000","last_became_peered":"2024-09-16T07:34:13.669117+0000","last_unstale":"2024-09-16T07:34:15.505443+0000","last_undegraded":"2024-09-16T07:34:15.505443+0000","last_fullsized":"2024-09-16T07:34:15.505443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:58:26.021603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663298+0000","last_change":"2024-09-16T07:34:12.660110+0000","last_active":"2024-09-16T07:34:12.663298+0000","last_peered":"2024-09-16T07:34:12.663298+0000","last_clean":"2024-09-16T07:34:12.663298+0000","last_became_active":"2024-09-16T07:34:12.659784+0000","last_became_peered":"2024-09-16T07:34:12.659784+0000","last_unstale":"2024-09-16T07:34:12.663298+0000","last_undegraded":"2024-09-16T07:34:12.663298+0000","last_fullsized":"2024-09-16T07:34:12.663298+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:36:51.960957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503912+0000","last_change":"2024-09-16T07:34:13.658163+0000","last_active":"2024-09-16T07:34:15.503912+0000","last_peered":"2024-09-16T07:34:15.503912+0000","last_clean":"2024-09-16T07:34:15.503912+0000","last_became_active":"2024-09-16T07:34:13.657868+0000","last_became_peered":"2024-09-16T07:34:13.657868+0000","last_unstale":"2024-09-16T07:34:15.503912+0000","last_undegraded":"2024-09-16T07:34:15.503912+0000","last_fullsized":"2024-09-16T07:34:15.503912+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:23:29.828380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.653472+0000","last_change":"2024-09-16T07:34:12.651711+0000","last_active":"2024-09-16T07:34:12.653472+0000","last_peered":"2024-09-16T07:34:12.653472+0000","last_clean":"2024-09-16T07:34:12.653472+0000","last_became_active":"2024-09-16T07:34:12.651345+0000","last_became_peered":"2024-09-16T07:34:12.651345+0000","last_unstale":"2024-09-16T07:34:12.653472+0000","last_undegraded":"2024-09-16T07:34:12.653472+0000","last_fullsized":"2024-09-16T07:34:12.653472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:25.456450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.639595+0000","last_change":"2024-09-16T07:34:12.639595+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.639595+0000","last_undegraded":"2024-09-16T07:34:12.639595+0000","last_fullsized":"2024-09-16T07:34:12.639595+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659125+0000","last_change":"2024-09-16T07:34:12.655035+0000","last_active":"2024-09-16T07:34:12.659125+0000","last_peered":"2024-09-16T07:34:12.659125+0000","last_clean":"2024-09-16T07:34:12.659125+0000","last_became_active":"2024-09-16T07:34:12.654389+0000","last_became_peered":"2024-09-16T07:34:12.654389+0000","last_unstale":"2024-09-16T07:34:12.659125+0000","last_undegraded":"2024-09-16T07:34:12.659125+0000","last_fullsized":"2024-09-16T07:34:12.659125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:04.088398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504635+0000","last_change":"2024-09-16T07:34:13.660598+0000","last_active":"2024-09-16T07:34:15.504635+0000","last_peered":"2024-09-16T07:34:15.504635+0000","last_clean":"2024-09-16T07:34:15.504635+0000","last_became_active":"2024-09-16T07:34:13.660316+0000","last_became_peered":"2024-09-16T07:34:13.660316+0000","last_unstale":"2024-09-16T07:34:15.504635+0000","last_undegraded":"2024-09-16T07:34:15.504635+0000","last_fullsized":"2024-09-16T07:34:15.504635+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:02.887719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.660503+0000","last_change":"2024-09-16T07:34:12.657796+0000","last_active":"2024-09-16T07:34:12.660503+0000","last_peered":"2024-09-16T07:34:12.660503+0000","last_clean":"2024-09-16T07:34:12.660503+0000","last_became_active":"2024-09-16T07:34:12.657514+0000","last_became_peered":"2024-09-16T07:34:12.657514+0000","last_unstale":"2024-09-16T07:34:12.660503+0000","last_undegraded":"2024-09-16T07:34:12.660503+0000","last_fullsized":"2024-09-16T07:34:12.660503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:47.365227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.646101+0000","last_change":"2024-09-16T07:34:12.646101+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.646101+0000","last_undegraded":"2024-09-16T07:34:12.646101+0000","last_fullsized":"2024-09-16T07:34:12.646101+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503265+0000","last_change":"2024-09-16T07:34:12.655999+0000","last_active":"2024-09-16T07:34:15.503265+0000","last_peered":"2024-09-16T07:34:15.503265+0000","last_clean":"2024-09-16T07:34:15.503265+0000","last_became_active":"2024-09-16T07:34:12.652081+0000","last_became_peered":"2024-09-16T07:34:12.652081+0000","last_unstale":"2024-09-16T07:34:15.503265+0000","last_undegraded":"2024-09-16T07:34:15.503265+0000","last_fullsized":"2024-09-16T07:34:15.503265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:38:31.307496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640318+0000","last_change":"2024-09-16T07:34:12.640318+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640318+0000","last_undegraded":"2024-09-16T07:34:12.640318+0000","last_fullsized":"2024-09-16T07:34:12.640318+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504217+0000","last_change":"2024-09-16T07:34:12.658649+0000","last_active":"2024-09-16T07:34:15.504217+0000","last_peered":"2024-09-16T07:34:15.504217+0000","last_clean":"2024-09-16T07:34:15.504217+0000","last_became_active":"2024-09-16T07:34:12.656266+0000","last_became_peered":"2024-09-16T07:34:12.656266+0000","last_unstale":"2024-09-16T07:34:15.504217+0000","last_undegraded":"2024-09-16T07:34:15.504217+0000","last_fullsized":"2024-09-16T07:34:15.504217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:21:26.790697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504056+0000","last_change":"2024-09-16T07:34:13.655934+0000","last_active":"2024-09-16T07:34:15.504056+0000","last_peered":"2024-09-16T07:34:15.504056+0000","last_clean":"2024-09-16T07:34:15.504056+0000","last_became_active":"2024-09-16T07:34:13.655311+0000","last_became_peered":"2024-09-16T07:34:13.655311+0000","last_unstale":"2024-09-16T07:34:15.504056+0000","last_undegraded":"2024-09-16T07:34:15.504056+0000","last_fullsized":"2024-09-16T07:34:15.504056+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:01:00.397244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.655133+0000","last_change":"2024-09-16T07:34:12.652868+0000","last_active":"2024-09-16T07:34:12.655133+0000","last_peered":"2024-09-16T07:34:12.655133+0000","last_clean":"2024-09-16T07:34:12.655133+0000","last_became_active":"2024-09-16T07:34:12.652597+0000","last_became_peered":"2024-09-16T07:34:12.652597+0000","last_unstale":"2024-09-16T07:34:12.655133+0000","last_undegraded":"2024-09-16T07:34:12.655133+0000","last_fullsized":"2024-09-16T07:34:12.655133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:58.027181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505200+0000","last_change":"2024-09-16T07:34:13.657928+0000","last_active":"2024-09-16T07:34:15.505200+0000","last_peered":"2024-09-16T07:34:15.505200+0000","last_clean":"2024-09-16T07:34:15.505200+0000","last_became_active":"2024-09-16T07:34:13.657656+0000","last_became_peered":"2024-09-16T07:34:13.657656+0000","last_unstale":"2024-09-16T07:34:15.505200+0000","last_undegraded":"2024-09-16T07:34:15.505200+0000","last_fullsized":"2024-09-16T07:34:15.505200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:43.797652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505364+0000","last_change":"2024-09-16T07:34:12.655139+0000","last_active":"2024-09-16T07:34:15.505364+0000","last_peered":"2024-09-16T07:34:15.505364+0000","last_clean":"2024-09-16T07:34:15.505364+0000","last_became_active":"2024-09-16T07:34:12.654832+0000","last_became_peered":"2024-09-16T07:34:12.654832+0000","last_unstale":"2024-09-16T07:34:15.505364+0000","last_undegraded":"2024-09-16T07:34:15.505364+0000","last_fullsized":"2024-09-16T07:34:15.505364+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:41.141205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.640542+0000","last_change":"2024-09-16T07:34:12.640542+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.640542+0000","last_undegraded":"2024-09-16T07:34:12.640542+0000","last_fullsized":"2024-09-16T07:34:12.640542+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503686+0000","last_change":"2024-09-16T07:34:12.658546+0000","last_active":"2024-09-16T07:34:15.503686+0000","last_peered":"2024-09-16T07:34:15.503686+0000","last_clean":"2024-09-16T07:34:15.503686+0000","last_became_active":"2024-09-16T07:34:12.658298+0000","last_became_peered":"2024-09-16T07:34:12.658298+0000","last_unstale":"2024-09-16T07:34:15.503686+0000","last_undegraded":"2024-09-16T07:34:15.503686+0000","last_fullsized":"2024-09-16T07:34:15.503686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:57:08.175670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.642596+0000","last_change":"2024-09-16T07:34:12.642596+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.642596+0000","last_undegraded":"2024-09-16T07:34:12.642596+0000","last_fullsized":"2024-09-16T07:34:12.642596+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505013+0000","last_change":"2024-09-16T07:34:12.652258+0000","last_active":"2024-09-16T07:34:15.505013+0000","last_peered":"2024-09-16T07:34:15.505013+0000","last_clean":"2024-09-16T07:34:15.505013+0000","last_became_active":"2024-09-16T07:34:12.652016+0000","last_became_peered":"2024-09-16T07:34:12.652016+0000","last_unstale":"2024-09-16T07:34:15.505013+0000","last_undegraded":"2024-09-16T07:34:15.505013+0000","last_fullsized":"2024-09-16T07:34:15.505013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:58:54.063927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.638730+0000","last_change":"2024-09-16T07:34:12.638730+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.638730+0000","last_undegraded":"2024-09-16T07:34:12.638730+0000","last_fullsized":"2024-09-16T07:34:12.638730+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.663014+0000","last_change":"2024-09-16T07:34:12.659752+0000","last_active":"2024-09-16T07:34:12.663014+0000","last_peered":"2024-09-16T07:34:12.663014+0000","last_clean":"2024-09-16T07:34:12.663014+0000","last_became_active":"2024-09-16T07:34:12.659431+0000","last_became_peered":"2024-09-16T07:34:12.659431+0000","last_unstale":"2024-09-16T07:34:12.663014+0000","last_undegraded":"2024-09-16T07:34:12.663014+0000","last_fullsized":"2024-09-16T07:34:12.663014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:54.845908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.641134+0000","last_change":"2024-09-16T07:34:12.641134+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.641134+0000","last_undegraded":"2024-09-16T07:34:12.641134+0000","last_fullsized":"2024-09-16T07:34:12.641134+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659175+0000","last_change":"2024-09-16T07:34:12.654352+0000","last_active":"2024-09-16T07:34:12.659175+0000","last_peered":"2024-09-16T07:34:12.659175+0000","last_clean":"2024-09-16T07:34:12.659175+0000","last_became_active":"2024-09-16T07:34:12.654042+0000","last_became_peered":"2024-09-16T07:34:12.654042+0000","last_unstale":"2024-09-16T07:34:12.659175+0000","last_undegraded":"2024-09-16T07:34:12.659175+0000","last_fullsized":"2024-09-16T07:34:12.659175+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:10:08.401475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504640+0000","last_change":"2024-09-16T07:34:13.655824+0000","last_active":"2024-09-16T07:34:15.504640+0000","last_peered":"2024-09-16T07:34:15.504640+0000","last_clean":"2024-09-16T07:34:15.504640+0000","last_became_active":"2024-09-16T07:34:13.655556+0000","last_became_peered":"2024-09-16T07:34:13.655556+0000","last_unstale":"2024-09-16T07:34:15.504640+0000","last_undegraded":"2024-09-16T07:34:15.504640+0000","last_fullsized":"2024-09-16T07:34:15.504640+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:19:01.327496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503389+0000","last_change":"2024-09-16T07:34:12.651035+0000","last_active":"2024-09-16T07:34:15.503389+0000","last_peered":"2024-09-16T07:34:15.503389+0000","last_clean":"2024-09-16T07:34:15.503389+0000","last_became_active":"2024-09-16T07:34:12.650831+0000","last_became_peered":"2024-09-16T07:34:12.650831+0000","last_unstale":"2024-09-16T07:34:15.503389+0000","last_undegraded":"2024-09-16T07:34:15.503389+0000","last_fullsized":"2024-09-16T07:34:15.503389+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:27.636448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-16T07:34:12.643093+0000","last_change":"2024-09-16T07:34:12.643093+0000","last_active":"2024-09-16T07:34:12.625732+0000","last_peered":"2024-09-16T07:34:12.625732+0000","last_clean":"2024-09-16T07:34:12.625732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:12.643093+0000","last_undegraded":"2024-09-16T07:34:12.643093+0000","last_fullsized":"2024-09-16T07:34:12.643093+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.659023+0000","last_change":"2024-09-16T07:34:12.657665+0000","last_active":"2024-09-16T07:34:12.659023+0000","last_peered":"2024-09-16T07:34:12.659023+0000","last_clean":"2024-09-16T07:34:12.659023+0000","last_became_active":"2024-09-16T07:34:12.657331+0000","last_became_peered":"2024-09-16T07:34:12.657331+0000","last_unstale":"2024-09-16T07:34:12.659023+0000","last_undegraded":"2024-09-16T07:34:12.659023+0000","last_fullsized":"2024-09-16T07:34:12.659023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:23.469080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T07:34:12.647051+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:12.647051+0000","last_peered":"2024-09-16T07:34:12.647051+0000","last_clean":"2024-09-16T07:34:12.647051+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:12.647051+0000","last_undegraded":"2024-09-16T07:34:12.647051+0000","last_fullsized":"2024-09-16T07:34:12.647051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1202562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":612194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":605919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1437696,"data_stored":625885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1429504,"data_stored":625269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1215637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:22.391 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:22.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- 172.21.15.114:0/1384929175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 msgr2=0x7f6d100acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 --2- 172.21.15.114:0/1384929175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 0x7f6d100acd40 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009c80 tx=0x7f6d0001cd10 comp rx=0 tx=0).stop 2024-09-16T07:34:22.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- 172.21.15.114:0/1384929175 shutdown_connections 2024-09-16T07:34:22.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 --2- 172.21.15.114:0/1384929175 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d100b4a50 0x7f6d100ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 --2- 172.21.15.114:0/1384929175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 0x7f6d100acd40 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- 172.21.15.114:0/1384929175 >> 172.21.15.114:0/1384929175 conn(0x7f6d100b18f0 msgr2=0x7f6d100b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:22.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- 172.21.15.114:0/1384929175 shutdown_connections 2024-09-16T07:34:22.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- 172.21.15.114:0/1384929175 wait complete. 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 Processor -- start 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- start start 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d100b4a50 0x7f6d10148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d100cd100 0x7f6d101fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 0x7f6d1015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10167120 con 0x7f6d1015db50 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d100cf5a0 con 0x7f6d100b4a50 2024-09-16T07:34:22.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d16000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d101672a0 con 0x7f6d100cd100 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d0f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d100b4a50 0x7f6d10148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d0fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 0x7f6d1015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d0f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d100b4a50 0x7f6d10148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:55744/0 (socket says 172.21.15.114:55744) 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d0f400640 1 -- 172.21.15.114:0/1487623469 learned_addr learned my addr 172.21.15.114:0/1487623469 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.550+0000 7f6d06a00640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d100cd100 0x7f6d101fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0fe00640 1 -- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d100cd100 msgr2=0x7f6d101fbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0fe00640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d100cd100 0x7f6d101fbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0fe00640 1 -- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d100b4a50 msgr2=0x7f6d10148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0fe00640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d100b4a50 0x7f6d10148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0fe00640 1 -- 172.21.15.114:0/1487623469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d101fc4e0 con 0x7f6d1015db50 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d06a00640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d100cd100 0x7f6d101fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:34:22.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0f400640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d100b4a50 0x7f6d10148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0fe00640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 0x7f6d1015cb30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800da80 tx=0x7f6d0800df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d07e00640 1 -- 172.21.15.114:0/1487623469 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0800ae20 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d07e00640 1 -- 172.21.15.114:0/1487623469 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d08005130 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1014ae60 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d07e00640 1 -- 172.21.15.114:0/1487623469 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08005580 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1014b420 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d10069410 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d07e00640 1 -- 172.21.15.114:0/1487623469 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f6d080047b0 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d07e00640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6cec073340 0x7f6cec075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d07e00640 1 -- 172.21.15.114:0/1487623469 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f6d08094b90 con 0x7f6d1015db50 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.554+0000 7f6d0f400640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6cec073340 0x7f6cec075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.558+0000 7f6d0f400640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6cec073340 0x7f6cec075800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d0001cb40 tx=0x7f6d0001b550 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:22.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.558+0000 7f6d07e00640 1 -- 172.21.15.114:0/1487623469 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6d101fc4e0 con 0x7f6d1015db50 2024-09-16T07:34:22.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.726+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d1015c400 con 0x7f6cec073340 2024-09-16T07:34:22.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.730+0000 7f6d07e00640 1 -- 172.21.15.114:0/1487623469 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7f6d1015c400 con 0x7f6cec073340 2024-09-16T07:34:22.731 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6cec073340 msgr2=0x7f6cec075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6cec073340 0x7f6cec075800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d0001cb40 tx=0x7f6d0001b550 comp rx=0 tx=0).stop 2024-09-16T07:34:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 msgr2=0x7f6d1015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 0x7f6d1015cb30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800da80 tx=0x7f6d0800df40 comp rx=0 tx=0).stop 2024-09-16T07:34:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 shutdown_connections 2024-09-16T07:34:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1015db50 0x7f6d1015cb30 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6cec073340 0x7f6cec075800 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d100cd100 0x7f6d101fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 --2- 172.21.15.114:0/1487623469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d100b4a50 0x7f6d10148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 >> 172.21.15.114:0/1487623469 conn(0x7f6d100b18f0 msgr2=0x7f6d1015a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 shutdown_connections 2024-09-16T07:34:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.734+0000 7f6d16000640 1 -- 172.21.15.114:0/1487623469 wait complete. 2024-09-16T07:34:22.751 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-16T07:34:22.394871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261928,"kb_used_data":12392,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712792,"statfs":{"total":773094113280,"available":772825899008,"internally_reserved":0,"allocated":12689408,"data_stored":6187708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.758817"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504440+0000","last_change":"2024-09-16T07:34:13.672956+0000","last_active":"2024-09-16T07:34:15.504440+0000","last_peered":"2024-09-16T07:34:15.504440+0000","last_clean":"2024-09-16T07:34:15.504440+0000","last_became_active":"2024-09-16T07:34:13.672692+0000","last_became_peered":"2024-09-16T07:34:13.672692+0000","last_unstale":"2024-09-16T07:34:15.504440+0000","last_undegraded":"2024-09-16T07:34:15.504440+0000","last_fullsized":"2024-09-16T07:34:15.504440+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:15:17.185363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505192+0000","last_change":"2024-09-16T07:34:13.658636+0000","last_active":"2024-09-16T07:34:15.505192+0000","last_peered":"2024-09-16T07:34:15.505192+0000","last_clean":"2024-09-16T07:34:15.505192+0000","last_became_active":"2024-09-16T07:34:13.653889+0000","last_became_peered":"2024-09-16T07:34:13.653889+0000","last_unstale":"2024-09-16T07:34:15.505192+0000","last_undegraded":"2024-09-16T07:34:15.505192+0000","last_fullsized":"2024-09-16T07:34:15.505192+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:05.800033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501759+0000","last_change":"2024-09-16T07:34:13.652316+0000","last_active":"2024-09-16T07:34:15.501759+0000","last_peered":"2024-09-16T07:34:15.501759+0000","last_clean":"2024-09-16T07:34:15.501759+0000","last_became_active":"2024-09-16T07:34:13.652065+0000","last_became_peered":"2024-09-16T07:34:13.652065+0000","last_unstale":"2024-09-16T07:34:15.501759+0000","last_undegraded":"2024-09-16T07:34:15.501759+0000","last_fullsized":"2024-09-16T07:34:15.501759+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:12.330313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504132+0000","last_change":"2024-09-16T07:34:13.665797+0000","last_active":"2024-09-16T07:34:15.504132+0000","last_peered":"2024-09-16T07:34:15.504132+0000","last_clean":"2024-09-16T07:34:15.504132+0000","last_became_active":"2024-09-16T07:34:13.665546+0000","last_became_peered":"2024-09-16T07:34:13.665546+0000","last_unstale":"2024-09-16T07:34:15.504132+0000","last_undegraded":"2024-09-16T07:34:15.504132+0000","last_fullsized":"2024-09-16T07:34:15.504132+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:57.220531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500858+0000","last_change":"2024-09-16T07:34:13.659885+0000","last_active":"2024-09-16T07:34:15.500858+0000","last_peered":"2024-09-16T07:34:15.500858+0000","last_clean":"2024-09-16T07:34:15.500858+0000","last_became_active":"2024-09-16T07:34:13.659324+0000","last_became_peered":"2024-09-16T07:34:13.659324+0000","last_unstale":"2024-09-16T07:34:15.500858+0000","last_undegraded":"2024-09-16T07:34:15.500858+0000","last_fullsized":"2024-09-16T07:34:15.500858+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:46.420301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657408+0000","last_change":"2024-09-16T07:34:13.648293+0000","last_active":"2024-09-16T07:34:14.657408+0000","last_peered":"2024-09-16T07:34:14.657408+0000","last_clean":"2024-09-16T07:34:14.657408+0000","last_became_active":"2024-09-16T07:34:13.646944+0000","last_became_peered":"2024-09-16T07:34:13.646944+0000","last_unstale":"2024-09-16T07:34:14.657408+0000","last_undegraded":"2024-09-16T07:34:14.657408+0000","last_fullsized":"2024-09-16T07:34:14.657408+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:33:45.432456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656752+0000","last_change":"2024-09-16T07:34:13.649936+0000","last_active":"2024-09-16T07:34:14.656752+0000","last_peered":"2024-09-16T07:34:14.656752+0000","last_clean":"2024-09-16T07:34:14.656752+0000","last_became_active":"2024-09-16T07:34:13.649499+0000","last_became_peered":"2024-09-16T07:34:13.649499+0000","last_unstale":"2024-09-16T07:34:14.656752+0000","last_undegraded":"2024-09-16T07:34:14.656752+0000","last_fullsized":"2024-09-16T07:34:14.656752+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:03.507859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500817+0000","last_change":"2024-09-16T07:34:13.661068+0000","last_active":"2024-09-16T07:34:15.500817+0000","last_peered":"2024-09-16T07:34:15.500817+0000","last_clean":"2024-09-16T07:34:15.500817+0000","last_became_active":"2024-09-16T07:34:13.659415+0000","last_became_peered":"2024-09-16T07:34:13.659415+0000","last_unstale":"2024-09-16T07:34:15.500817+0000","last_undegraded":"2024-09-16T07:34:15.500817+0000","last_fullsized":"2024-09-16T07:34:15.500817+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:05:26.645890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501797+0000","last_change":"2024-09-16T07:34:13.649774+0000","last_active":"2024-09-16T07:34:15.501797+0000","last_peered":"2024-09-16T07:34:15.501797+0000","last_clean":"2024-09-16T07:34:15.501797+0000","last_became_active":"2024-09-16T07:34:13.648209+0000","last_became_peered":"2024-09-16T07:34:13.648209+0000","last_unstale":"2024-09-16T07:34:15.501797+0000","last_undegraded":"2024-09-16T07:34:15.501797+0000","last_fullsized":"2024-09-16T07:34:15.501797+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:48.377213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505362+0000","last_change":"2024-09-16T07:34:13.659200+0000","last_active":"2024-09-16T07:34:15.505362+0000","last_peered":"2024-09-16T07:34:15.505362+0000","last_clean":"2024-09-16T07:34:15.505362+0000","last_became_active":"2024-09-16T07:34:13.653501+0000","last_became_peered":"2024-09-16T07:34:13.653501+0000","last_unstale":"2024-09-16T07:34:15.505362+0000","last_undegraded":"2024-09-16T07:34:15.505362+0000","last_fullsized":"2024-09-16T07:34:15.505362+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:39.862878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504022+0000","last_change":"2024-09-16T07:34:13.665084+0000","last_active":"2024-09-16T07:34:15.504022+0000","last_peered":"2024-09-16T07:34:15.504022+0000","last_clean":"2024-09-16T07:34:15.504022+0000","last_became_active":"2024-09-16T07:34:13.664845+0000","last_became_peered":"2024-09-16T07:34:13.664845+0000","last_unstale":"2024-09-16T07:34:15.504022+0000","last_undegraded":"2024-09-16T07:34:15.504022+0000","last_fullsized":"2024-09-16T07:34:15.504022+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:47:55.045374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501822+0000","last_change":"2024-09-16T07:34:13.649717+0000","last_active":"2024-09-16T07:34:15.501822+0000","last_peered":"2024-09-16T07:34:15.501822+0000","last_clean":"2024-09-16T07:34:15.501822+0000","last_became_active":"2024-09-16T07:34:13.649129+0000","last_became_peered":"2024-09-16T07:34:13.649129+0000","last_unstale":"2024-09-16T07:34:15.501822+0000","last_undegraded":"2024-09-16T07:34:15.501822+0000","last_fullsized":"2024-09-16T07:34:15.501822+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:21.021529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503588+0000","last_change":"2024-09-16T07:34:13.673461+0000","last_active":"2024-09-16T07:34:15.503588+0000","last_peered":"2024-09-16T07:34:15.503588+0000","last_clean":"2024-09-16T07:34:15.503588+0000","last_became_active":"2024-09-16T07:34:13.672601+0000","last_became_peered":"2024-09-16T07:34:13.672601+0000","last_unstale":"2024-09-16T07:34:15.503588+0000","last_undegraded":"2024-09-16T07:34:15.503588+0000","last_fullsized":"2024-09-16T07:34:15.503588+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:10.214596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505006+0000","last_change":"2024-09-16T07:34:13.648794+0000","last_active":"2024-09-16T07:34:15.505006+0000","last_peered":"2024-09-16T07:34:15.505006+0000","last_clean":"2024-09-16T07:34:15.505006+0000","last_became_active":"2024-09-16T07:34:13.648501+0000","last_became_peered":"2024-09-16T07:34:13.648501+0000","last_unstale":"2024-09-16T07:34:15.505006+0000","last_undegraded":"2024-09-16T07:34:15.505006+0000","last_fullsized":"2024-09-16T07:34:15.505006+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:21:50.957200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503241+0000","last_change":"2024-09-16T07:34:13.672924+0000","last_active":"2024-09-16T07:34:15.503241+0000","last_peered":"2024-09-16T07:34:15.503241+0000","last_clean":"2024-09-16T07:34:15.503241+0000","last_became_active":"2024-09-16T07:34:13.672578+0000","last_became_peered":"2024-09-16T07:34:13.672578+0000","last_unstale":"2024-09-16T07:34:15.503241+0000","last_undegraded":"2024-09-16T07:34:15.503241+0000","last_fullsized":"2024-09-16T07:34:15.503241+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.466316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658236+0000","last_change":"2024-09-16T07:34:13.670562+0000","last_active":"2024-09-16T07:34:14.658236+0000","last_peered":"2024-09-16T07:34:14.658236+0000","last_clean":"2024-09-16T07:34:14.658236+0000","last_became_active":"2024-09-16T07:34:13.670276+0000","last_became_peered":"2024-09-16T07:34:13.670276+0000","last_unstale":"2024-09-16T07:34:14.658236+0000","last_undegraded":"2024-09-16T07:34:14.658236+0000","last_fullsized":"2024-09-16T07:34:14.658236+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:51:55.802204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657627+0000","last_change":"2024-09-16T07:34:13.654026+0000","last_active":"2024-09-16T07:34:14.657627+0000","last_peered":"2024-09-16T07:34:14.657627+0000","last_clean":"2024-09-16T07:34:14.657627+0000","last_became_active":"2024-09-16T07:34:13.653795+0000","last_became_peered":"2024-09-16T07:34:13.653795+0000","last_unstale":"2024-09-16T07:34:14.657627+0000","last_undegraded":"2024-09-16T07:34:14.657627+0000","last_fullsized":"2024-09-16T07:34:14.657627+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:07:39.355831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658695+0000","last_change":"2024-09-16T07:34:13.660952+0000","last_active":"2024-09-16T07:34:14.658695+0000","last_peered":"2024-09-16T07:34:14.658695+0000","last_clean":"2024-09-16T07:34:14.658695+0000","last_became_active":"2024-09-16T07:34:13.660725+0000","last_became_peered":"2024-09-16T07:34:13.660725+0000","last_unstale":"2024-09-16T07:34:14.658695+0000","last_undegraded":"2024-09-16T07:34:14.658695+0000","last_fullsized":"2024-09-16T07:34:14.658695+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:24.505032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504161+0000","last_change":"2024-09-16T07:34:13.664503+0000","last_active":"2024-09-16T07:34:15.504161+0000","last_peered":"2024-09-16T07:34:15.504161+0000","last_clean":"2024-09-16T07:34:15.504161+0000","last_became_active":"2024-09-16T07:34:13.664228+0000","last_became_peered":"2024-09-16T07:34:13.664228+0000","last_unstale":"2024-09-16T07:34:15.504161+0000","last_undegraded":"2024-09-16T07:34:15.504161+0000","last_fullsized":"2024-09-16T07:34:15.504161+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:04.104863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658595+0000","last_change":"2024-09-16T07:34:13.660913+0000","last_active":"2024-09-16T07:34:14.658595+0000","last_peered":"2024-09-16T07:34:14.658595+0000","last_clean":"2024-09-16T07:34:14.658595+0000","last_became_active":"2024-09-16T07:34:13.660554+0000","last_became_peered":"2024-09-16T07:34:13.660554+0000","last_unstale":"2024-09-16T07:34:14.658595+0000","last_undegraded":"2024-09-16T07:34:14.658595+0000","last_fullsized":"2024-09-16T07:34:14.658595+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:40:13.940211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500481+0000","last_change":"2024-09-16T07:34:13.659555+0000","last_active":"2024-09-16T07:34:15.500481+0000","last_peered":"2024-09-16T07:34:15.500481+0000","last_clean":"2024-09-16T07:34:15.500481+0000","last_became_active":"2024-09-16T07:34:13.658995+0000","last_became_peered":"2024-09-16T07:34:13.658995+0000","last_unstale":"2024-09-16T07:34:15.500481+0000","last_undegraded":"2024-09-16T07:34:15.500481+0000","last_fullsized":"2024-09-16T07:34:15.500481+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:36.323192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504041+0000","last_change":"2024-09-16T07:34:13.662414+0000","last_active":"2024-09-16T07:34:15.504041+0000","last_peered":"2024-09-16T07:34:15.504041+0000","last_clean":"2024-09-16T07:34:15.504041+0000","last_became_active":"2024-09-16T07:34:13.661920+0000","last_became_peered":"2024-09-16T07:34:13.661920+0000","last_unstale":"2024-09-16T07:34:15.504041+0000","last_undegraded":"2024-09-16T07:34:15.504041+0000","last_fullsized":"2024-09-16T07:34:15.504041+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:22:27.338480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501171+0000","last_change":"2024-09-16T07:34:13.654080+0000","last_active":"2024-09-16T07:34:15.501171+0000","last_peered":"2024-09-16T07:34:15.501171+0000","last_clean":"2024-09-16T07:34:15.501171+0000","last_became_active":"2024-09-16T07:34:13.653776+0000","last_became_peered":"2024-09-16T07:34:13.653776+0000","last_unstale":"2024-09-16T07:34:15.501171+0000","last_undegraded":"2024-09-16T07:34:15.501171+0000","last_fullsized":"2024-09-16T07:34:15.501171+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:55.857893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503280+0000","last_change":"2024-09-16T07:34:13.657266+0000","last_active":"2024-09-16T07:34:15.503280+0000","last_peered":"2024-09-16T07:34:15.503280+0000","last_clean":"2024-09-16T07:34:15.503280+0000","last_became_active":"2024-09-16T07:34:13.656981+0000","last_became_peered":"2024-09-16T07:34:13.656981+0000","last_unstale":"2024-09-16T07:34:15.503280+0000","last_undegraded":"2024-09-16T07:34:15.503280+0000","last_fullsized":"2024-09-16T07:34:15.503280+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:44.477595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505206+0000","last_change":"2024-09-16T07:34:13.650758+0000","last_active":"2024-09-16T07:34:15.505206+0000","last_peered":"2024-09-16T07:34:15.505206+0000","last_clean":"2024-09-16T07:34:15.505206+0000","last_became_active":"2024-09-16T07:34:13.649398+0000","last_became_peered":"2024-09-16T07:34:13.649398+0000","last_unstale":"2024-09-16T07:34:15.505206+0000","last_undegraded":"2024-09-16T07:34:15.505206+0000","last_fullsized":"2024-09-16T07:34:15.505206+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:48.900154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658889+0000","last_change":"2024-09-16T07:34:13.669901+0000","last_active":"2024-09-16T07:34:14.658889+0000","last_peered":"2024-09-16T07:34:14.658889+0000","last_clean":"2024-09-16T07:34:14.658889+0000","last_became_active":"2024-09-16T07:34:13.669627+0000","last_became_peered":"2024-09-16T07:34:13.669627+0000","last_unstale":"2024-09-16T07:34:14.658889+0000","last_undegraded":"2024-09-16T07:34:14.658889+0000","last_fullsized":"2024-09-16T07:34:14.658889+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:09.100315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503798+0000","last_change":"2024-09-16T07:34:13.673776+0000","last_active":"2024-09-16T07:34:15.503798+0000","last_peered":"2024-09-16T07:34:15.503798+0000","last_clean":"2024-09-16T07:34:15.503798+0000","last_became_active":"2024-09-16T07:34:13.673409+0000","last_became_peered":"2024-09-16T07:34:13.673409+0000","last_unstale":"2024-09-16T07:34:15.503798+0000","last_undegraded":"2024-09-16T07:34:15.503798+0000","last_fullsized":"2024-09-16T07:34:15.503798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:42.455977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656593+0000","last_change":"2024-09-16T07:34:13.659788+0000","last_active":"2024-09-16T07:34:14.656593+0000","last_peered":"2024-09-16T07:34:14.656593+0000","last_clean":"2024-09-16T07:34:14.656593+0000","last_became_active":"2024-09-16T07:34:13.659541+0000","last_became_peered":"2024-09-16T07:34:13.659541+0000","last_unstale":"2024-09-16T07:34:14.656593+0000","last_undegraded":"2024-09-16T07:34:14.656593+0000","last_fullsized":"2024-09-16T07:34:14.656593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:58:26.021603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503614+0000","last_change":"2024-09-16T07:34:13.657581+0000","last_active":"2024-09-16T07:34:15.503614+0000","last_peered":"2024-09-16T07:34:15.503614+0000","last_clean":"2024-09-16T07:34:15.503614+0000","last_became_active":"2024-09-16T07:34:13.656345+0000","last_became_peered":"2024-09-16T07:34:13.656345+0000","last_unstale":"2024-09-16T07:34:15.503614+0000","last_undegraded":"2024-09-16T07:34:15.503614+0000","last_fullsized":"2024-09-16T07:34:15.503614+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:50.709786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503254+0000","last_change":"2024-09-16T07:34:13.654484+0000","last_active":"2024-09-16T07:34:15.503254+0000","last_peered":"2024-09-16T07:34:15.503254+0000","last_clean":"2024-09-16T07:34:15.503254+0000","last_became_active":"2024-09-16T07:34:13.654207+0000","last_became_peered":"2024-09-16T07:34:13.654207+0000","last_unstale":"2024-09-16T07:34:15.503254+0000","last_undegraded":"2024-09-16T07:34:15.503254+0000","last_fullsized":"2024-09-16T07:34:15.503254+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:33:41.661619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500422+0000","last_change":"2024-09-16T07:34:13.671176+0000","last_active":"2024-09-16T07:34:15.500422+0000","last_peered":"2024-09-16T07:34:15.500422+0000","last_clean":"2024-09-16T07:34:15.500422+0000","last_became_active":"2024-09-16T07:34:13.670929+0000","last_became_peered":"2024-09-16T07:34:13.670929+0000","last_unstale":"2024-09-16T07:34:15.500422+0000","last_undegraded":"2024-09-16T07:34:15.500422+0000","last_fullsized":"2024-09-16T07:34:15.500422+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:43.208319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656468+0000","last_change":"2024-09-16T07:34:13.655397+0000","last_active":"2024-09-16T07:34:14.656468+0000","last_peered":"2024-09-16T07:34:14.656468+0000","last_clean":"2024-09-16T07:34:14.656468+0000","last_became_active":"2024-09-16T07:34:13.655114+0000","last_became_peered":"2024-09-16T07:34:13.655114+0000","last_unstale":"2024-09-16T07:34:14.656468+0000","last_undegraded":"2024-09-16T07:34:14.656468+0000","last_fullsized":"2024-09-16T07:34:14.656468+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:31:50.936146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658920+0000","last_change":"2024-09-16T07:34:13.662153+0000","last_active":"2024-09-16T07:34:14.658920+0000","last_peered":"2024-09-16T07:34:14.658920+0000","last_clean":"2024-09-16T07:34:14.658920+0000","last_became_active":"2024-09-16T07:34:13.661299+0000","last_became_peered":"2024-09-16T07:34:13.661299+0000","last_unstale":"2024-09-16T07:34:14.658920+0000","last_undegraded":"2024-09-16T07:34:14.658920+0000","last_fullsized":"2024-09-16T07:34:14.658920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:04.227433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"114'4","reported_seq":19,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501044+0000","last_change":"2024-09-16T07:34:12.657427+0000","last_active":"2024-09-16T07:34:15.501044+0000","last_peered":"2024-09-16T07:34:15.501044+0000","last_clean":"2024-09-16T07:34:15.501044+0000","last_became_active":"2024-09-16T07:34:12.657135+0000","last_became_peered":"2024-09-16T07:34:12.657135+0000","last_unstale":"2024-09-16T07:34:15.501044+0000","last_undegraded":"2024-09-16T07:34:15.501044+0000","last_fullsized":"2024-09-16T07:34:15.501044+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:04.088398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501876+0000","last_change":"2024-09-16T07:34:13.655283+0000","last_active":"2024-09-16T07:34:15.501876+0000","last_peered":"2024-09-16T07:34:15.501876+0000","last_clean":"2024-09-16T07:34:15.501876+0000","last_became_active":"2024-09-16T07:34:13.655027+0000","last_became_peered":"2024-09-16T07:34:13.655027+0000","last_unstale":"2024-09-16T07:34:15.501876+0000","last_undegraded":"2024-09-16T07:34:15.501876+0000","last_fullsized":"2024-09-16T07:34:15.501876+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:46:00.693755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657184+0000","last_change":"2024-09-16T07:34:12.659539+0000","last_active":"2024-09-16T07:34:14.657184+0000","last_peered":"2024-09-16T07:34:14.657184+0000","last_clean":"2024-09-16T07:34:14.657184+0000","last_became_active":"2024-09-16T07:34:12.659264+0000","last_became_peered":"2024-09-16T07:34:12.659264+0000","last_unstale":"2024-09-16T07:34:14.657184+0000","last_undegraded":"2024-09-16T07:34:14.657184+0000","last_fullsized":"2024-09-16T07:34:14.657184+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:26:03.133124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500815+0000","last_change":"2024-09-16T07:34:13.657349+0000","last_active":"2024-09-16T07:34:15.500815+0000","last_peered":"2024-09-16T07:34:15.500815+0000","last_clean":"2024-09-16T07:34:15.500815+0000","last_became_active":"2024-09-16T07:34:13.657097+0000","last_became_peered":"2024-09-16T07:34:13.657097+0000","last_unstale":"2024-09-16T07:34:15.500815+0000","last_undegraded":"2024-09-16T07:34:15.500815+0000","last_fullsized":"2024-09-16T07:34:15.500815+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:52.579054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504220+0000","last_change":"2024-09-16T07:34:12.661205+0000","last_active":"2024-09-16T07:34:15.504220+0000","last_peered":"2024-09-16T07:34:15.504220+0000","last_clean":"2024-09-16T07:34:15.504220+0000","last_became_active":"2024-09-16T07:34:12.659902+0000","last_became_peered":"2024-09-16T07:34:12.659902+0000","last_unstale":"2024-09-16T07:34:15.504220+0000","last_undegraded":"2024-09-16T07:34:15.504220+0000","last_fullsized":"2024-09-16T07:34:15.504220+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:26.143139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500962+0000","last_change":"2024-09-16T07:34:13.665792+0000","last_active":"2024-09-16T07:34:15.500962+0000","last_peered":"2024-09-16T07:34:15.500962+0000","last_clean":"2024-09-16T07:34:15.500962+0000","last_became_active":"2024-09-16T07:34:13.665526+0000","last_became_peered":"2024-09-16T07:34:13.665526+0000","last_unstale":"2024-09-16T07:34:15.500962+0000","last_undegraded":"2024-09-16T07:34:15.500962+0000","last_fullsized":"2024-09-16T07:34:15.500962+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:44:53.001651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505187+0000","last_change":"2024-09-16T07:34:12.662760+0000","last_active":"2024-09-16T07:34:15.505187+0000","last_peered":"2024-09-16T07:34:15.505187+0000","last_clean":"2024-09-16T07:34:15.505187+0000","last_became_active":"2024-09-16T07:34:12.662244+0000","last_became_peered":"2024-09-16T07:34:12.662244+0000","last_unstale":"2024-09-16T07:34:15.505187+0000","last_undegraded":"2024-09-16T07:34:15.505187+0000","last_fullsized":"2024-09-16T07:34:15.505187+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.908681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658224+0000","last_change":"2024-09-16T07:34:13.662250+0000","last_active":"2024-09-16T07:34:14.658224+0000","last_peered":"2024-09-16T07:34:14.658224+0000","last_clean":"2024-09-16T07:34:14.658224+0000","last_became_active":"2024-09-16T07:34:13.661989+0000","last_became_peered":"2024-09-16T07:34:13.661989+0000","last_unstale":"2024-09-16T07:34:14.658224+0000","last_undegraded":"2024-09-16T07:34:14.658224+0000","last_fullsized":"2024-09-16T07:34:14.658224+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:48:12.074693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505005+0000","last_change":"2024-09-16T07:34:12.651655+0000","last_active":"2024-09-16T07:34:15.505005+0000","last_peered":"2024-09-16T07:34:15.505005+0000","last_clean":"2024-09-16T07:34:15.505005+0000","last_became_active":"2024-09-16T07:34:12.651346+0000","last_became_peered":"2024-09-16T07:34:12.651346+0000","last_unstale":"2024-09-16T07:34:15.505005+0000","last_undegraded":"2024-09-16T07:34:15.505005+0000","last_fullsized":"2024-09-16T07:34:15.505005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:52:10.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657504+0000","last_change":"2024-09-16T07:34:13.656448+0000","last_active":"2024-09-16T07:34:14.657504+0000","last_peered":"2024-09-16T07:34:14.657504+0000","last_clean":"2024-09-16T07:34:14.657504+0000","last_became_active":"2024-09-16T07:34:13.656189+0000","last_became_peered":"2024-09-16T07:34:13.656189+0000","last_unstale":"2024-09-16T07:34:14.657504+0000","last_undegraded":"2024-09-16T07:34:14.657504+0000","last_fullsized":"2024-09-16T07:34:14.657504+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:59.253123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658354+0000","last_change":"2024-09-16T07:34:12.654728+0000","last_active":"2024-09-16T07:34:14.658354+0000","last_peered":"2024-09-16T07:34:14.658354+0000","last_clean":"2024-09-16T07:34:14.658354+0000","last_became_active":"2024-09-16T07:34:12.654406+0000","last_became_peered":"2024-09-16T07:34:12.654406+0000","last_unstale":"2024-09-16T07:34:14.658354+0000","last_undegraded":"2024-09-16T07:34:14.658354+0000","last_fullsized":"2024-09-16T07:34:14.658354+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:02.495873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501060+0000","last_change":"2024-09-16T07:34:13.661261+0000","last_active":"2024-09-16T07:34:15.501060+0000","last_peered":"2024-09-16T07:34:15.501060+0000","last_clean":"2024-09-16T07:34:15.501060+0000","last_became_active":"2024-09-16T07:34:13.659772+0000","last_became_peered":"2024-09-16T07:34:13.659772+0000","last_unstale":"2024-09-16T07:34:15.501060+0000","last_undegraded":"2024-09-16T07:34:15.501060+0000","last_fullsized":"2024-09-16T07:34:15.501060+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:24.481065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656975+0000","last_change":"2024-09-16T07:34:12.649721+0000","last_active":"2024-09-16T07:34:14.656975+0000","last_peered":"2024-09-16T07:34:14.656975+0000","last_clean":"2024-09-16T07:34:14.656975+0000","last_became_active":"2024-09-16T07:34:12.649243+0000","last_became_peered":"2024-09-16T07:34:12.649243+0000","last_unstale":"2024-09-16T07:34:14.656975+0000","last_undegraded":"2024-09-16T07:34:14.656975+0000","last_fullsized":"2024-09-16T07:34:14.656975+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:41:26.245063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504633+0000","last_change":"2024-09-16T07:34:13.665563+0000","last_active":"2024-09-16T07:34:15.504633+0000","last_peered":"2024-09-16T07:34:15.504633+0000","last_clean":"2024-09-16T07:34:15.504633+0000","last_became_active":"2024-09-16T07:34:13.664995+0000","last_became_peered":"2024-09-16T07:34:13.664995+0000","last_unstale":"2024-09-16T07:34:15.504633+0000","last_undegraded":"2024-09-16T07:34:15.504633+0000","last_fullsized":"2024-09-16T07:34:15.504633+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:00.535299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504772+0000","last_change":"2024-09-16T07:34:12.655113+0000","last_active":"2024-09-16T07:34:15.504772+0000","last_peered":"2024-09-16T07:34:15.504772+0000","last_clean":"2024-09-16T07:34:15.504772+0000","last_became_active":"2024-09-16T07:34:12.654835+0000","last_became_peered":"2024-09-16T07:34:12.654835+0000","last_unstale":"2024-09-16T07:34:15.504772+0000","last_undegraded":"2024-09-16T07:34:15.504772+0000","last_fullsized":"2024-09-16T07:34:15.504772+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:03:14.329410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503991+0000","last_change":"2024-09-16T07:34:13.659687+0000","last_active":"2024-09-16T07:34:15.503991+0000","last_peered":"2024-09-16T07:34:15.503991+0000","last_clean":"2024-09-16T07:34:15.503991+0000","last_became_active":"2024-09-16T07:34:13.659385+0000","last_became_peered":"2024-09-16T07:34:13.659385+0000","last_unstale":"2024-09-16T07:34:15.503991+0000","last_undegraded":"2024-09-16T07:34:15.503991+0000","last_fullsized":"2024-09-16T07:34:15.503991+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:24.855532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656970+0000","last_change":"2024-09-16T07:34:12.651609+0000","last_active":"2024-09-16T07:34:14.656970+0000","last_peered":"2024-09-16T07:34:14.656970+0000","last_clean":"2024-09-16T07:34:14.656970+0000","last_became_active":"2024-09-16T07:34:12.651303+0000","last_became_peered":"2024-09-16T07:34:12.651303+0000","last_unstale":"2024-09-16T07:34:14.656970+0000","last_undegraded":"2024-09-16T07:34:14.656970+0000","last_fullsized":"2024-09-16T07:34:14.656970+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:01.875734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656795+0000","last_change":"2024-09-16T07:34:13.661937+0000","last_active":"2024-09-16T07:34:14.656795+0000","last_peered":"2024-09-16T07:34:14.656795+0000","last_clean":"2024-09-16T07:34:14.656795+0000","last_became_active":"2024-09-16T07:34:13.661647+0000","last_became_peered":"2024-09-16T07:34:13.661647+0000","last_unstale":"2024-09-16T07:34:14.656795+0000","last_undegraded":"2024-09-16T07:34:14.656795+0000","last_fullsized":"2024-09-16T07:34:14.656795+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:46.298680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.659038+0000","last_change":"2024-09-16T07:34:12.660262+0000","last_active":"2024-09-16T07:34:14.659038+0000","last_peered":"2024-09-16T07:34:14.659038+0000","last_clean":"2024-09-16T07:34:14.659038+0000","last_became_active":"2024-09-16T07:34:12.655867+0000","last_became_peered":"2024-09-16T07:34:12.655867+0000","last_unstale":"2024-09-16T07:34:14.659038+0000","last_undegraded":"2024-09-16T07:34:14.659038+0000","last_fullsized":"2024-09-16T07:34:14.659038+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:58.241137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501083+0000","last_change":"2024-09-16T07:34:13.660436+0000","last_active":"2024-09-16T07:34:15.501083+0000","last_peered":"2024-09-16T07:34:15.501083+0000","last_clean":"2024-09-16T07:34:15.501083+0000","last_became_active":"2024-09-16T07:34:13.660175+0000","last_became_peered":"2024-09-16T07:34:13.660175+0000","last_unstale":"2024-09-16T07:34:15.501083+0000","last_undegraded":"2024-09-16T07:34:15.501083+0000","last_fullsized":"2024-09-16T07:34:15.501083+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:18.957492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"114'3","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656595+0000","last_change":"2024-09-16T07:34:12.655601+0000","last_active":"2024-09-16T07:34:14.656595+0000","last_peered":"2024-09-16T07:34:14.656595+0000","last_clean":"2024-09-16T07:34:14.656595+0000","last_became_active":"2024-09-16T07:34:12.655398+0000","last_became_peered":"2024-09-16T07:34:12.655398+0000","last_unstale":"2024-09-16T07:34:14.656595+0000","last_undegraded":"2024-09-16T07:34:14.656595+0000","last_fullsized":"2024-09-16T07:34:14.656595+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:30.729701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501134+0000","last_change":"2024-09-16T07:34:13.650823+0000","last_active":"2024-09-16T07:34:15.501134+0000","last_peered":"2024-09-16T07:34:15.501134+0000","last_clean":"2024-09-16T07:34:15.501134+0000","last_became_active":"2024-09-16T07:34:13.650562+0000","last_became_peered":"2024-09-16T07:34:13.650562+0000","last_unstale":"2024-09-16T07:34:15.501134+0000","last_undegraded":"2024-09-16T07:34:15.501134+0000","last_fullsized":"2024-09-16T07:34:15.501134+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:16:04.822338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"114'6","reported_seq":21,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501509+0000","last_change":"2024-09-16T07:34:12.649697+0000","last_active":"2024-09-16T07:34:15.501509+0000","last_peered":"2024-09-16T07:34:15.501509+0000","last_clean":"2024-09-16T07:34:15.501509+0000","last_became_active":"2024-09-16T07:34:12.649391+0000","last_became_peered":"2024-09-16T07:34:12.649391+0000","last_unstale":"2024-09-16T07:34:15.501509+0000","last_undegraded":"2024-09-16T07:34:15.501509+0000","last_fullsized":"2024-09-16T07:34:15.501509+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:59.523313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503828+0000","last_change":"2024-09-16T07:34:13.658621+0000","last_active":"2024-09-16T07:34:15.503828+0000","last_peered":"2024-09-16T07:34:15.503828+0000","last_clean":"2024-09-16T07:34:15.503828+0000","last_became_active":"2024-09-16T07:34:13.658272+0000","last_became_peered":"2024-09-16T07:34:13.658272+0000","last_unstale":"2024-09-16T07:34:15.503828+0000","last_undegraded":"2024-09-16T07:34:15.503828+0000","last_fullsized":"2024-09-16T07:34:15.503828+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:45.856837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504062+0000","last_change":"2024-09-16T07:34:12.649804+0000","last_active":"2024-09-16T07:34:15.504062+0000","last_peered":"2024-09-16T07:34:15.504062+0000","last_clean":"2024-09-16T07:34:15.504062+0000","last_became_active":"2024-09-16T07:34:12.649503+0000","last_became_peered":"2024-09-16T07:34:12.649503+0000","last_unstale":"2024-09-16T07:34:15.504062+0000","last_undegraded":"2024-09-16T07:34:15.504062+0000","last_fullsized":"2024-09-16T07:34:15.504062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:39.034313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504591+0000","last_change":"2024-09-16T07:34:13.652673+0000","last_active":"2024-09-16T07:34:15.504591+0000","last_peered":"2024-09-16T07:34:15.504591+0000","last_clean":"2024-09-16T07:34:15.504591+0000","last_became_active":"2024-09-16T07:34:13.652336+0000","last_became_peered":"2024-09-16T07:34:13.652336+0000","last_unstale":"2024-09-16T07:34:15.504591+0000","last_undegraded":"2024-09-16T07:34:15.504591+0000","last_fullsized":"2024-09-16T07:34:15.504591+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:03.873944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504802+0000","last_change":"2024-09-16T07:34:12.654539+0000","last_active":"2024-09-16T07:34:15.504802+0000","last_peered":"2024-09-16T07:34:15.504802+0000","last_clean":"2024-09-16T07:34:15.504802+0000","last_became_active":"2024-09-16T07:34:12.654289+0000","last_became_peered":"2024-09-16T07:34:12.654289+0000","last_unstale":"2024-09-16T07:34:15.504802+0000","last_undegraded":"2024-09-16T07:34:15.504802+0000","last_fullsized":"2024-09-16T07:34:15.504802+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:21.506130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501407+0000","last_change":"2024-09-16T07:34:13.649828+0000","last_active":"2024-09-16T07:34:15.501407+0000","last_peered":"2024-09-16T07:34:15.501407+0000","last_clean":"2024-09-16T07:34:15.501407+0000","last_became_active":"2024-09-16T07:34:13.649483+0000","last_became_peered":"2024-09-16T07:34:13.649483+0000","last_unstale":"2024-09-16T07:34:15.501407+0000","last_undegraded":"2024-09-16T07:34:15.501407+0000","last_fullsized":"2024-09-16T07:34:15.501407+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:10:09.413461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"114'8","reported_seq":23,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501205+0000","last_change":"2024-09-16T07:34:12.654029+0000","last_active":"2024-09-16T07:34:15.501205+0000","last_peered":"2024-09-16T07:34:15.501205+0000","last_clean":"2024-09-16T07:34:15.501205+0000","last_became_active":"2024-09-16T07:34:12.653755+0000","last_became_peered":"2024-09-16T07:34:12.653755+0000","last_unstale":"2024-09-16T07:34:15.501205+0000","last_undegraded":"2024-09-16T07:34:15.501205+0000","last_fullsized":"2024-09-16T07:34:15.501205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:21:01.740283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501793+0000","last_change":"2024-09-16T07:34:13.656031+0000","last_active":"2024-09-16T07:34:15.501793+0000","last_peered":"2024-09-16T07:34:15.501793+0000","last_clean":"2024-09-16T07:34:15.501793+0000","last_became_active":"2024-09-16T07:34:13.655772+0000","last_became_peered":"2024-09-16T07:34:13.655772+0000","last_unstale":"2024-09-16T07:34:15.501793+0000","last_undegraded":"2024-09-16T07:34:15.501793+0000","last_fullsized":"2024-09-16T07:34:15.501793+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:05.100384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657054+0000","last_change":"2024-09-16T07:34:12.650903+0000","last_active":"2024-09-16T07:34:14.657054+0000","last_peered":"2024-09-16T07:34:14.657054+0000","last_clean":"2024-09-16T07:34:14.657054+0000","last_became_active":"2024-09-16T07:34:12.650413+0000","last_became_peered":"2024-09-16T07:34:12.650413+0000","last_unstale":"2024-09-16T07:34:14.657054+0000","last_undegraded":"2024-09-16T07:34:14.657054+0000","last_fullsized":"2024-09-16T07:34:14.657054+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:41.973494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656815+0000","last_change":"2024-09-16T07:34:13.656774+0000","last_active":"2024-09-16T07:34:14.656815+0000","last_peered":"2024-09-16T07:34:14.656815+0000","last_clean":"2024-09-16T07:34:14.656815+0000","last_became_active":"2024-09-16T07:34:13.653960+0000","last_became_peered":"2024-09-16T07:34:13.653960+0000","last_unstale":"2024-09-16T07:34:14.656815+0000","last_undegraded":"2024-09-16T07:34:14.656815+0000","last_fullsized":"2024-09-16T07:34:14.656815+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:59.039166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503554+0000","last_change":"2024-09-16T07:34:12.660836+0000","last_active":"2024-09-16T07:34:15.503554+0000","last_peered":"2024-09-16T07:34:15.503554+0000","last_clean":"2024-09-16T07:34:15.503554+0000","last_became_active":"2024-09-16T07:34:12.660027+0000","last_became_peered":"2024-09-16T07:34:12.660027+0000","last_unstale":"2024-09-16T07:34:15.503554+0000","last_undegraded":"2024-09-16T07:34:15.503554+0000","last_fullsized":"2024-09-16T07:34:15.503554+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:44.950170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658650+0000","last_change":"2024-09-16T07:34:13.670063+0000","last_active":"2024-09-16T07:34:14.658650+0000","last_peered":"2024-09-16T07:34:14.658650+0000","last_clean":"2024-09-16T07:34:14.658650+0000","last_became_active":"2024-09-16T07:34:13.669059+0000","last_became_peered":"2024-09-16T07:34:13.669059+0000","last_unstale":"2024-09-16T07:34:14.658650+0000","last_undegraded":"2024-09-16T07:34:14.658650+0000","last_fullsized":"2024-09-16T07:34:14.658650+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:57:26.475500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657929+0000","last_change":"2024-09-16T07:34:12.657295+0000","last_active":"2024-09-16T07:34:14.657929+0000","last_peered":"2024-09-16T07:34:14.657929+0000","last_clean":"2024-09-16T07:34:14.657929+0000","last_became_active":"2024-09-16T07:34:12.656864+0000","last_became_peered":"2024-09-16T07:34:12.656864+0000","last_unstale":"2024-09-16T07:34:14.657929+0000","last_undegraded":"2024-09-16T07:34:14.657929+0000","last_fullsized":"2024-09-16T07:34:14.657929+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:05.257413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505443+0000","last_change":"2024-09-16T07:34:13.669369+0000","last_active":"2024-09-16T07:34:15.505443+0000","last_peered":"2024-09-16T07:34:15.505443+0000","last_clean":"2024-09-16T07:34:15.505443+0000","last_became_active":"2024-09-16T07:34:13.669117+0000","last_became_peered":"2024-09-16T07:34:13.669117+0000","last_unstale":"2024-09-16T07:34:15.505443+0000","last_undegraded":"2024-09-16T07:34:15.505443+0000","last_fullsized":"2024-09-16T07:34:15.505443+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:58:26.021603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656768+0000","last_change":"2024-09-16T07:34:12.660110+0000","last_active":"2024-09-16T07:34:14.656768+0000","last_peered":"2024-09-16T07:34:14.656768+0000","last_clean":"2024-09-16T07:34:14.656768+0000","last_became_active":"2024-09-16T07:34:12.659784+0000","last_became_peered":"2024-09-16T07:34:12.659784+0000","last_unstale":"2024-09-16T07:34:14.656768+0000","last_undegraded":"2024-09-16T07:34:14.656768+0000","last_fullsized":"2024-09-16T07:34:14.656768+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:36.035218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503912+0000","last_change":"2024-09-16T07:34:13.658163+0000","last_active":"2024-09-16T07:34:15.503912+0000","last_peered":"2024-09-16T07:34:15.503912+0000","last_clean":"2024-09-16T07:34:15.503912+0000","last_became_active":"2024-09-16T07:34:13.657868+0000","last_became_peered":"2024-09-16T07:34:13.657868+0000","last_unstale":"2024-09-16T07:34:15.503912+0000","last_undegraded":"2024-09-16T07:34:15.503912+0000","last_fullsized":"2024-09-16T07:34:15.503912+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:23:29.828380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657094+0000","last_change":"2024-09-16T07:34:12.651711+0000","last_active":"2024-09-16T07:34:14.657094+0000","last_peered":"2024-09-16T07:34:14.657094+0000","last_clean":"2024-09-16T07:34:14.657094+0000","last_became_active":"2024-09-16T07:34:12.651345+0000","last_became_peered":"2024-09-16T07:34:12.651345+0000","last_unstale":"2024-09-16T07:34:14.657094+0000","last_undegraded":"2024-09-16T07:34:14.657094+0000","last_fullsized":"2024-09-16T07:34:14.657094+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:11.553427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657771+0000","last_change":"2024-09-16T07:34:13.646888+0000","last_active":"2024-09-16T07:34:14.657771+0000","last_peered":"2024-09-16T07:34:14.657771+0000","last_clean":"2024-09-16T07:34:14.657771+0000","last_became_active":"2024-09-16T07:34:13.643989+0000","last_became_peered":"2024-09-16T07:34:13.643989+0000","last_unstale":"2024-09-16T07:34:14.657771+0000","last_undegraded":"2024-09-16T07:34:14.657771+0000","last_fullsized":"2024-09-16T07:34:14.657771+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:46.946229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658391+0000","last_change":"2024-09-16T07:34:12.655035+0000","last_active":"2024-09-16T07:34:14.658391+0000","last_peered":"2024-09-16T07:34:14.658391+0000","last_clean":"2024-09-16T07:34:14.658391+0000","last_became_active":"2024-09-16T07:34:12.654389+0000","last_became_peered":"2024-09-16T07:34:12.654389+0000","last_unstale":"2024-09-16T07:34:14.658391+0000","last_undegraded":"2024-09-16T07:34:14.658391+0000","last_fullsized":"2024-09-16T07:34:14.658391+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:33:44.420470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504635+0000","last_change":"2024-09-16T07:34:13.660598+0000","last_active":"2024-09-16T07:34:15.504635+0000","last_peered":"2024-09-16T07:34:15.504635+0000","last_clean":"2024-09-16T07:34:15.504635+0000","last_became_active":"2024-09-16T07:34:13.660316+0000","last_became_peered":"2024-09-16T07:34:13.660316+0000","last_unstale":"2024-09-16T07:34:15.504635+0000","last_undegraded":"2024-09-16T07:34:15.504635+0000","last_fullsized":"2024-09-16T07:34:15.504635+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:02.887719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658145+0000","last_change":"2024-09-16T07:34:12.657796+0000","last_active":"2024-09-16T07:34:14.658145+0000","last_peered":"2024-09-16T07:34:14.658145+0000","last_clean":"2024-09-16T07:34:14.658145+0000","last_became_active":"2024-09-16T07:34:12.657514+0000","last_became_peered":"2024-09-16T07:34:12.657514+0000","last_unstale":"2024-09-16T07:34:14.658145+0000","last_undegraded":"2024-09-16T07:34:14.658145+0000","last_fullsized":"2024-09-16T07:34:14.658145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:27:08.813193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500449+0000","last_change":"2024-09-16T07:34:13.671232+0000","last_active":"2024-09-16T07:34:15.500449+0000","last_peered":"2024-09-16T07:34:15.500449+0000","last_clean":"2024-09-16T07:34:15.500449+0000","last_became_active":"2024-09-16T07:34:13.670944+0000","last_became_peered":"2024-09-16T07:34:13.670944+0000","last_unstale":"2024-09-16T07:34:15.500449+0000","last_undegraded":"2024-09-16T07:34:15.500449+0000","last_fullsized":"2024-09-16T07:34:15.500449+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:47.406407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503265+0000","last_change":"2024-09-16T07:34:12.655999+0000","last_active":"2024-09-16T07:34:15.503265+0000","last_peered":"2024-09-16T07:34:15.503265+0000","last_clean":"2024-09-16T07:34:15.503265+0000","last_became_active":"2024-09-16T07:34:12.652081+0000","last_became_peered":"2024-09-16T07:34:12.652081+0000","last_unstale":"2024-09-16T07:34:15.503265+0000","last_undegraded":"2024-09-16T07:34:15.503265+0000","last_fullsized":"2024-09-16T07:34:15.503265+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:38:31.307496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657864+0000","last_change":"2024-09-16T07:34:13.641398+0000","last_active":"2024-09-16T07:34:14.657864+0000","last_peered":"2024-09-16T07:34:14.657864+0000","last_clean":"2024-09-16T07:34:14.657864+0000","last_became_active":"2024-09-16T07:34:13.641128+0000","last_became_peered":"2024-09-16T07:34:13.641128+0000","last_unstale":"2024-09-16T07:34:14.657864+0000","last_undegraded":"2024-09-16T07:34:14.657864+0000","last_fullsized":"2024-09-16T07:34:14.657864+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:05.842481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504217+0000","last_change":"2024-09-16T07:34:12.658649+0000","last_active":"2024-09-16T07:34:15.504217+0000","last_peered":"2024-09-16T07:34:15.504217+0000","last_clean":"2024-09-16T07:34:15.504217+0000","last_became_active":"2024-09-16T07:34:12.656266+0000","last_became_peered":"2024-09-16T07:34:12.656266+0000","last_unstale":"2024-09-16T07:34:15.504217+0000","last_undegraded":"2024-09-16T07:34:15.504217+0000","last_fullsized":"2024-09-16T07:34:15.504217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:21:26.790697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504056+0000","last_change":"2024-09-16T07:34:13.655934+0000","last_active":"2024-09-16T07:34:15.504056+0000","last_peered":"2024-09-16T07:34:15.504056+0000","last_clean":"2024-09-16T07:34:15.504056+0000","last_became_active":"2024-09-16T07:34:13.655311+0000","last_became_peered":"2024-09-16T07:34:13.655311+0000","last_unstale":"2024-09-16T07:34:15.504056+0000","last_undegraded":"2024-09-16T07:34:15.504056+0000","last_fullsized":"2024-09-16T07:34:15.504056+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:01:00.397244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"115'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500846+0000","last_change":"2024-09-16T07:34:12.652868+0000","last_active":"2024-09-16T07:34:15.500846+0000","last_peered":"2024-09-16T07:34:15.500846+0000","last_clean":"2024-09-16T07:34:15.500846+0000","last_became_active":"2024-09-16T07:34:12.652597+0000","last_became_peered":"2024-09-16T07:34:12.652597+0000","last_unstale":"2024-09-16T07:34:15.500846+0000","last_undegraded":"2024-09-16T07:34:15.500846+0000","last_fullsized":"2024-09-16T07:34:15.500846+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:10:08.401475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505200+0000","last_change":"2024-09-16T07:34:13.657928+0000","last_active":"2024-09-16T07:34:15.505200+0000","last_peered":"2024-09-16T07:34:15.505200+0000","last_clean":"2024-09-16T07:34:15.505200+0000","last_became_active":"2024-09-16T07:34:13.657656+0000","last_became_peered":"2024-09-16T07:34:13.657656+0000","last_unstale":"2024-09-16T07:34:15.505200+0000","last_undegraded":"2024-09-16T07:34:15.505200+0000","last_fullsized":"2024-09-16T07:34:15.505200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:43.797652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505364+0000","last_change":"2024-09-16T07:34:12.655139+0000","last_active":"2024-09-16T07:34:15.505364+0000","last_peered":"2024-09-16T07:34:15.505364+0000","last_clean":"2024-09-16T07:34:15.505364+0000","last_became_active":"2024-09-16T07:34:12.654832+0000","last_became_peered":"2024-09-16T07:34:12.654832+0000","last_unstale":"2024-09-16T07:34:15.505364+0000","last_undegraded":"2024-09-16T07:34:15.505364+0000","last_fullsized":"2024-09-16T07:34:15.505364+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:41.141205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.657755+0000","last_change":"2024-09-16T07:34:13.653361+0000","last_active":"2024-09-16T07:34:14.657755+0000","last_peered":"2024-09-16T07:34:14.657755+0000","last_clean":"2024-09-16T07:34:14.657755+0000","last_became_active":"2024-09-16T07:34:13.653092+0000","last_became_peered":"2024-09-16T07:34:13.653092+0000","last_unstale":"2024-09-16T07:34:14.657755+0000","last_undegraded":"2024-09-16T07:34:14.657755+0000","last_fullsized":"2024-09-16T07:34:14.657755+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:49:03.984396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503686+0000","last_change":"2024-09-16T07:34:12.658546+0000","last_active":"2024-09-16T07:34:15.503686+0000","last_peered":"2024-09-16T07:34:15.503686+0000","last_clean":"2024-09-16T07:34:15.503686+0000","last_became_active":"2024-09-16T07:34:12.658298+0000","last_became_peered":"2024-09-16T07:34:12.658298+0000","last_unstale":"2024-09-16T07:34:15.503686+0000","last_undegraded":"2024-09-16T07:34:15.503686+0000","last_fullsized":"2024-09-16T07:34:15.503686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:57:08.175670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500424+0000","last_change":"2024-09-16T07:34:13.656944+0000","last_active":"2024-09-16T07:34:15.500424+0000","last_peered":"2024-09-16T07:34:15.500424+0000","last_clean":"2024-09-16T07:34:15.500424+0000","last_became_active":"2024-09-16T07:34:13.656665+0000","last_became_peered":"2024-09-16T07:34:13.656665+0000","last_unstale":"2024-09-16T07:34:15.500424+0000","last_undegraded":"2024-09-16T07:34:15.500424+0000","last_fullsized":"2024-09-16T07:34:15.500424+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:17.637496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.505013+0000","last_change":"2024-09-16T07:34:12.652258+0000","last_active":"2024-09-16T07:34:15.505013+0000","last_peered":"2024-09-16T07:34:15.505013+0000","last_clean":"2024-09-16T07:34:15.505013+0000","last_became_active":"2024-09-16T07:34:12.652016+0000","last_became_peered":"2024-09-16T07:34:12.652016+0000","last_unstale":"2024-09-16T07:34:15.505013+0000","last_undegraded":"2024-09-16T07:34:15.505013+0000","last_fullsized":"2024-09-16T07:34:15.505013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:58:54.063927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.656748+0000","last_change":"2024-09-16T07:34:13.653241+0000","last_active":"2024-09-16T07:34:14.656748+0000","last_peered":"2024-09-16T07:34:14.656748+0000","last_clean":"2024-09-16T07:34:14.656748+0000","last_became_active":"2024-09-16T07:34:13.652952+0000","last_became_peered":"2024-09-16T07:34:13.652952+0000","last_unstale":"2024-09-16T07:34:14.656748+0000","last_undegraded":"2024-09-16T07:34:14.656748+0000","last_fullsized":"2024-09-16T07:34:14.656748+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:44.764237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500636+0000","last_change":"2024-09-16T07:34:12.659752+0000","last_active":"2024-09-16T07:34:15.500636+0000","last_peered":"2024-09-16T07:34:15.500636+0000","last_clean":"2024-09-16T07:34:15.500636+0000","last_became_active":"2024-09-16T07:34:12.659431+0000","last_became_peered":"2024-09-16T07:34:12.659431+0000","last_unstale":"2024-09-16T07:34:15.500636+0000","last_undegraded":"2024-09-16T07:34:15.500636+0000","last_fullsized":"2024-09-16T07:34:15.500636+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:25:47.365227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658291+0000","last_change":"2024-09-16T07:34:13.655772+0000","last_active":"2024-09-16T07:34:14.658291+0000","last_peered":"2024-09-16T07:34:14.658291+0000","last_clean":"2024-09-16T07:34:14.658291+0000","last_became_active":"2024-09-16T07:34:13.655415+0000","last_became_peered":"2024-09-16T07:34:13.655415+0000","last_unstale":"2024-09-16T07:34:14.658291+0000","last_undegraded":"2024-09-16T07:34:14.658291+0000","last_fullsized":"2024-09-16T07:34:14.658291+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:45:40.647097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:14.658200+0000","last_change":"2024-09-16T07:34:12.654352+0000","last_active":"2024-09-16T07:34:14.658200+0000","last_peered":"2024-09-16T07:34:14.658200+0000","last_clean":"2024-09-16T07:34:14.658200+0000","last_became_active":"2024-09-16T07:34:12.654042+0000","last_became_peered":"2024-09-16T07:34:12.654042+0000","last_unstale":"2024-09-16T07:34:14.658200+0000","last_undegraded":"2024-09-16T07:34:14.658200+0000","last_fullsized":"2024-09-16T07:34:14.658200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:31:49.924161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.504640+0000","last_change":"2024-09-16T07:34:13.655824+0000","last_active":"2024-09-16T07:34:15.504640+0000","last_peered":"2024-09-16T07:34:15.504640+0000","last_clean":"2024-09-16T07:34:15.504640+0000","last_became_active":"2024-09-16T07:34:13.655556+0000","last_became_peered":"2024-09-16T07:34:13.655556+0000","last_unstale":"2024-09-16T07:34:15.504640+0000","last_undegraded":"2024-09-16T07:34:15.504640+0000","last_fullsized":"2024-09-16T07:34:15.504640+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:19:01.327496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.503389+0000","last_change":"2024-09-16T07:34:12.651035+0000","last_active":"2024-09-16T07:34:15.503389+0000","last_peered":"2024-09-16T07:34:15.503389+0000","last_clean":"2024-09-16T07:34:15.503389+0000","last_became_active":"2024-09-16T07:34:12.650831+0000","last_became_peered":"2024-09-16T07:34:12.650831+0000","last_unstale":"2024-09-16T07:34:15.503389+0000","last_undegraded":"2024-09-16T07:34:15.503389+0000","last_fullsized":"2024-09-16T07:34:15.503389+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:27.636448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500363+0000","last_change":"2024-09-16T07:34:13.666719+0000","last_active":"2024-09-16T07:34:15.500363+0000","last_peered":"2024-09-16T07:34:15.500363+0000","last_clean":"2024-09-16T07:34:15.500363+0000","last_became_active":"2024-09-16T07:34:13.666430+0000","last_became_peered":"2024-09-16T07:34:13.666430+0000","last_unstale":"2024-09-16T07:34:15.500363+0000","last_undegraded":"2024-09-16T07:34:15.500363+0000","last_fullsized":"2024-09-16T07:34:15.500363+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:12.625732+0000","last_clean_scrub_stamp":"2024-09-16T07:34:12.625732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:52.485766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.501236+0000","last_change":"2024-09-16T07:34:12.657665+0000","last_active":"2024-09-16T07:34:15.501236+0000","last_peered":"2024-09-16T07:34:15.501236+0000","last_clean":"2024-09-16T07:34:15.501236+0000","last_became_active":"2024-09-16T07:34:12.657331+0000","last_became_peered":"2024-09-16T07:34:12.657331+0000","last_unstale":"2024-09-16T07:34:15.501236+0000","last_undegraded":"2024-09-16T07:34:15.501236+0000","last_fullsized":"2024-09-16T07:34:15.501236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:11.613746+0000","last_clean_scrub_stamp":"2024-09-16T07:34:11.613746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:11.318328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":312,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-16T07:34:15.500257+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:15.500257+0000","last_peered":"2024-09-16T07:34:15.500257+0000","last_clean":"2024-09-16T07:34:15.500257+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:15.500257+0000","last_undegraded":"2024-09-16T07:34:15.500257+0000","last_fullsized":"2024-09-16T07:34:15.500257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2048000,"data_stored":1217887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1441792,"data_stored":626881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1437696,"data_stored":625381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1433600,"data_stored":625339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1437696,"data_stored":625429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542221,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1437696,"data_stored":625885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1429504,"data_stored":625269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1215637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:22.755 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:34:22.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:34:22.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 -- 172.21.15.114:0/454431119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f920015c130 msgr2=0x7f92000cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 --2- 172.21.15.114:0/454431119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f920015c130 0x7f92000cce80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009840 tx=0x7f91f801c700 comp rx=0 tx=0).stop 2024-09-16T07:34:22.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 -- 172.21.15.114:0/454431119 shutdown_connections 2024-09-16T07:34:22.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 --2- 172.21.15.114:0/454431119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f920015c130 0x7f92000cce80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 --2- 172.21.15.114:0/454431119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92000cecf0 0x7f92000cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 -- 172.21.15.114:0/454431119 >> 172.21.15.114:0/454431119 conn(0x7f92000d1ea0 msgr2=0x7f92000d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:22.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 -- 172.21.15.114:0/454431119 shutdown_connections 2024-09-16T07:34:22.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 -- 172.21.15.114:0/454431119 wait complete. 2024-09-16T07:34:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 Processor -- start 2024-09-16T07:34:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.946+0000 7f9204c00640 1 -- start start 2024-09-16T07:34:22.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000cecf0 0x7f92000b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f920015bd50 0x7f92001f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920015c130 0x7f920006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92001695e0 con 0x7f920015c130 2024-09-16T07:34:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9200169460 con 0x7f92000cecf0 2024-09-16T07:34:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9200169760 con 0x7f920015bd50 2024-09-16T07:34:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920015c130 0x7f920006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920015c130 0x7f920006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42142/0 (socket says 172.21.15.114:42142) 2024-09-16T07:34:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 -- 172.21.15.114:0/712619186 learned_addr learned my addr 172.21.15.114:0/712619186 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fd400640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f920015bd50 0x7f92001f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fde00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000cecf0 0x7f92000b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 -- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f920015bd50 msgr2=0x7f92001f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f920015bd50 0x7f92001f8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 -- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000cecf0 msgr2=0x7f92000b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000cecf0 0x7f92000b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 -- 172.21.15.114:0/712619186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92000b6f50 con 0x7f920015c130 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fde00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000cecf0 0x7f92000b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fd400640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f920015bd50 0x7f92001f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91fe800640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920015c130 0x7f920006f360 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f91f801a330 tx=0x7f91f80a55e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91f6000640 1 -- 172.21.15.114:0/712619186 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80bb070 con 0x7f920015c130 2024-09-16T07:34:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91f6000640 1 -- 172.21.15.114:0/712619186 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91f8004470 con 0x7f920015c130 2024-09-16T07:34:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92000b7230 con 0x7f920015c130 2024-09-16T07:34:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f91f6000640 1 -- 172.21.15.114:0/712619186 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80b2040 con 0x7f920015c130 2024-09-16T07:34:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92001f8aa0 con 0x7f920015c130 2024-09-16T07:34:22.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.950+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92000ce5e0 con 0x7f920015c130 2024-09-16T07:34:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.954+0000 7f91f6000640 1 -- 172.21.15.114:0/712619186 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f91f80be070 con 0x7f920015c130 2024-09-16T07:34:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.954+0000 7f91f6000640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91e0073340 0x7f91e0075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.954+0000 7f91f6000640 1 -- 172.21.15.114:0/712619186 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f91f812de30 con 0x7f920015c130 2024-09-16T07:34:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.954+0000 7f91fde00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91e0073340 0x7f91e0075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.954+0000 7f91fde00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91e0073340 0x7f91e0075800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f91f00012f0 tx=0x7f91f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:22.958+0000 7f91f6000640 1 -- 172.21.15.114:0/712619186 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f91f8132070 con 0x7f920015c130 2024-09-16T07:34:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.186+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9200070b60 con 0x7f920015c130 2024-09-16T07:34:23.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.186+0000 7f91f6000640 1 -- 172.21.15.114:0/712619186 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7f91f8016410 con 0x7f920015c130 2024-09-16T07:34:23.189 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:34:23.189 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:34:23.189 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:34:23.190 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:34:23.190 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:34:23.191 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:34:23.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91e0073340 msgr2=0x7f91e0075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:23.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91e0073340 0x7f91e0075800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f91f00012f0 tx=0x7f91f0009040 comp rx=0 tx=0).stop 2024-09-16T07:34:23.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920015c130 msgr2=0x7f920006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920015c130 0x7f920006f360 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f91f801a330 tx=0x7f91f80a55e0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 shutdown_connections 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920015c130 0x7f920006f360 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91e0073340 0x7f91e0075800 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f920015bd50 0x7f92001f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 --2- 172.21.15.114:0/712619186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92000cecf0 0x7f92000b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 >> 172.21.15.114:0/712619186 conn(0x7f92000d1ea0 msgr2=0x7f92000d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 shutdown_connections 2024-09-16T07:34:23.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.190+0000 7f9204c00640 1 -- 172.21.15.114:0/712619186 wait complete. 2024-09-16T07:34:23.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 -- 172.21.15.114:0/3810335008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe600cdb30 msgr2=0x7efe600aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 --2- 172.21.15.114:0/3810335008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe600cdb30 0x7efe600aeef0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7efe58009900 tx=0x7efe5801c8e0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 -- 172.21.15.114:0/3810335008 shutdown_connections 2024-09-16T07:34:23.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 --2- 172.21.15.114:0/3810335008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe600cdb30 0x7efe600aeef0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 --2- 172.21.15.114:0/3810335008 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe600ced80 0x7efe600ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 -- 172.21.15.114:0/3810335008 >> 172.21.15.114:0/3810335008 conn(0x7efe600d1dc0 msgr2=0x7efe600d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 -- 172.21.15.114:0/3810335008 shutdown_connections 2024-09-16T07:34:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.350+0000 7efe66c00640 1 -- 172.21.15.114:0/3810335008 wait complete. 2024-09-16T07:34:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 Processor -- start 2024-09-16T07:34:23.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 -- start start 2024-09-16T07:34:23.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe600cdb30 0x7efe6015a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:23.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe600ced80 0x7efe600c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:23.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe6015bea0 0x7efe600c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:23.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efe60169340 con 0x7efe6015bea0 2024-09-16T07:34:23.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe601691c0 con 0x7efe600ced80 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe601694c0 con 0x7efe600cdb30 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe6015bea0 0x7efe600c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe6015bea0 0x7efe600c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42156/0 (socket says 172.21.15.114:42156) 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 -- 172.21.15.114:0/2938687971 learned_addr learned my addr 172.21.15.114:0/2938687971 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 -- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe600cdb30 msgr2=0x7efe6015a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe5fe00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe600cdb30 0x7efe6015a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe600cdb30 0x7efe6015a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe57400640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe600ced80 0x7efe600c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 -- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe600ced80 msgr2=0x7efe600c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe600ced80 0x7efe600c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 -- 172.21.15.114:0/2938687971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6015aee0 con 0x7efe6015bea0 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe5fe00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe600cdb30 0x7efe6015a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe57400640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe600ced80 0x7efe600c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe64c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe6015bea0 0x7efe600c7000 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0040 tx=0x7efe580a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:23.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe5cc00640 1 -- 172.21.15.114:0/2938687971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580b2040 con 0x7efe6015bea0 2024-09-16T07:34:23.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe5cc00640 1 -- 172.21.15.114:0/2938687971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe58004400 con 0x7efe6015bea0 2024-09-16T07:34:23.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe5cc00640 1 -- 172.21.15.114:0/2938687971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580052d0 con 0x7efe6015bea0 2024-09-16T07:34:23.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6015ac00 con 0x7efe6015bea0 2024-09-16T07:34:23.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe600c6300 con 0x7efe6015bea0 2024-09-16T07:34:23.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.354+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe600cc1c0 con 0x7efe6015bea0 2024-09-16T07:34:23.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.358+0000 7efe5cc00640 1 -- 172.21.15.114:0/2938687971 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7efe58005470 con 0x7efe6015bea0 2024-09-16T07:34:23.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.358+0000 7efe5cc00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe3c073340 0x7efe3c075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:23.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.358+0000 7efe5cc00640 1 -- 172.21.15.114:0/2938687971 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7efe5812ddf0 con 0x7efe6015bea0 2024-09-16T07:34:23.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.358+0000 7efe5fe00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe3c073340 0x7efe3c075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:23.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.358+0000 7efe5fe00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe3c073340 0x7efe3c075800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe50007fd0 tx=0x7efe50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:23.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.362+0000 7efe5cc00640 1 -- 172.21.15.114:0/2938687971 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efe600cc1c0 con 0x7efe6015bea0 2024-09-16T07:34:23.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe600ce670 con 0x7efe6015bea0 2024-09-16T07:34:23.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe5cc00640 1 -- 172.21.15.114:0/2938687971 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5231 (secure 0 0 0) 0x7efe580164d0 con 0x7efe6015bea0 2024-09-16T07:34:23.563 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:23.563 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":83,"btime":"2024-09-16T07:34:16:663795+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/229459534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":229459534},{"type":"v1","addr":"172.21.15.149:6801","nonce":229459534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2285177306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2285177306},{"type":"v1","addr":"172.21.15.149:6835","nonce":2285177306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/146376277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":146376277},{"type":"v1","addr":"172.21.15.114:6833","nonce":146376277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:13.032352+0000","modified":"2024-09-16T07:34:16.048792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7467":{"gid":7467,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1571071623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1571071623},{"type":"v1","addr":"172.21.15.114:6835","nonce":1571071623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7467,"qdb_cluster":[7467]},"id":9}]} 2024-09-16T07:34:23.564 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 83 2024-09-16T07:34:23.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe3c073340 msgr2=0x7efe3c075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:23.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe3c073340 0x7efe3c075800 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe50007fd0 tx=0x7efe50009040 comp rx=0 tx=0).stop 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe6015bea0 msgr2=0x7efe600c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe6015bea0 0x7efe600c7000 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7efe580b0040 tx=0x7efe580a56a0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 shutdown_connections 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe6015bea0 0x7efe600c7000 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe600ced80 0x7efe600c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe3c073340 0x7efe3c075800 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 --2- 172.21.15.114:0/2938687971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe600cdb30 0x7efe6015a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 >> 172.21.15.114:0/2938687971 conn(0x7efe600d1dc0 msgr2=0x7efe600d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 shutdown_connections 2024-09-16T07:34:23.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:23.566+0000 7efe66c00640 1 -- 172.21.15.114:0/2938687971 wait complete. 2024-09-16T07:34:23.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:34:13.032352+0000', 'modified': '2024-09-16T07:34:16.048792+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7467': {'gid': 7467, 'name': 'a', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/1571071623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 1571071623}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 1571071623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7467, 'qdb_cluster': [7467]} 2024-09-16T07:34:23.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:34:23.988 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T07:34:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 -- 172.21.15.114:0/4249559249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa00015dae0 msgr2=0x7fa0000acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 --2- 172.21.15.114:0/4249559249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa00015dae0 0x7fa0000acd40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000a980 tx=0x7f9ff001db00 comp rx=0 tx=0).stop 2024-09-16T07:34:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 -- 172.21.15.114:0/4249559249 shutdown_connections 2024-09-16T07:34:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 --2- 172.21.15.114:0/4249559249 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa00015dae0 0x7fa0000acd40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 -- 172.21.15.114:0/4249559249 >> 172.21.15.114:0/4249559249 conn(0x7fa0000b18f0 msgr2=0x7fa0000b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 -- 172.21.15.114:0/4249559249 shutdown_connections 2024-09-16T07:34:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 -- 172.21.15.114:0/4249559249 wait complete. 2024-09-16T07:34:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 Processor -- start 2024-09-16T07:34:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.134+0000 7fa007a00640 1 -- start start 2024-09-16T07:34:24.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0000b49e0 0x7fa0001f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000cd100 0x7fa0000cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa00015dae0 0x7fa0000ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa000168580 con 0x7fa0000b49e0 2024-09-16T07:34:24.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa000168400 con 0x7fa0000cd100 2024-09-16T07:34:24.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa000168700 con 0x7fa00015dae0 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0000b49e0 0x7fa0001f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0000b49e0 0x7fa0001f8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42158/0 (socket says 172.21.15.114:42158) 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 -- 172.21.15.114:0/681941976 learned_addr learned my addr 172.21.15.114:0/681941976 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 -- 172.21.15.114:0/681941976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa00015dae0 msgr2=0x7fa0000ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa00015dae0 0x7fa0000ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 -- 172.21.15.114:0/681941976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000cd100 msgr2=0x7fa0000cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000cd100 0x7fa0000cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 -- 172.21.15.114:0/681941976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0001f8670 con 0x7fa0000b49e0 2024-09-16T07:34:24.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa005000640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0000b49e0 0x7fa0001f8130 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9ff001b730 tx=0x7f9ff0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7f9ffcc00640 1 -- 172.21.15.114:0/681941976 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00b3040 con 0x7fa0000b49e0 2024-09-16T07:34:24.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7f9ffcc00640 1 -- 172.21.15.114:0/681941976 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ff0005230 con 0x7fa0000b49e0 2024-09-16T07:34:24.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0001f8920 con 0x7fa0000b49e0 2024-09-16T07:34:24.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7f9ffcc00640 1 -- 172.21.15.114:0/681941976 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00046d0 con 0x7fa0000b49e0 2024-09-16T07:34:24.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0001f8ee0 con 0x7fa0000b49e0 2024-09-16T07:34:24.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.138+0000 7f9ffcc00640 1 -- 172.21.15.114:0/681941976 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f9ff0004870 con 0x7fa0000b49e0 2024-09-16T07:34:24.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 Processor -- start 2024-09-16T07:34:24.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9ffcc00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fe0073340 0x7f9fe0075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- start start 2024-09-16T07:34:24.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9ffcc00640 1 -- 172.21.15.114:0/681941976 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7f9ff012ebf0 con 0x7fa0000b49e0 2024-09-16T07:34:24.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fe0073340 0x7f9fe0075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fe0073340 0x7f9fe0075800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa000150090 tx=0x7f9fec007910 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf48db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbefc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbefd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f1bbe1d3f0 con 0x55f1bbf492f0 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f1bbd5ab20 con 0x55f1bbefce10 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55f1bbd49f50 con 0x55f1bbf489d0 2024-09-16T07:34:24.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbefc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbefc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42174/0 (socket says 172.21.15.114:42174) 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 -- 172.21.15.114:0/2520633201 learned_addr learned my addr 172.21.15.114:0/2520633201 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa005000640 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf48db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa005a00640 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbefd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 -- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 msgr2=0x55f1bbf48db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf48db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 -- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 msgr2=0x55f1bbefd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbefd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 -- 172.21.15.114:0/2520633201 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bbd11590 con 0x55f1bbf492f0 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa005a00640 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbefd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9fffe00640 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbefc8d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9fec016840 tx=0x7f9fec001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c35a0dab90af3e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9ff5600640 1 -- 172.21.15.114:0/2520633201 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec024070 con 0x55f1bbf492f0 2024-09-16T07:34:24.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9ff5600640 1 -- 172.21.15.114:0/2520633201 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fec016e20 con 0x55f1bbf492f0 2024-09-16T07:34:24.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7f9ff5600640 1 -- 172.21.15.114:0/2520633201 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0138b0 con 0x55f1bbf492f0 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- 172.21.15.114:0/2520633201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 msgr2=0x55f1bbefc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbefc8d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f9fec016840 tx=0x7f9fec001e80 comp rx=0 tx=0).stop 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- 172.21.15.114:0/2520633201 shutdown_connections 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbefd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbefc8d0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 --2- 172.21.15.114:0/2520633201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf48db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- 172.21.15.114:0/2520633201 >> 172.21.15.114:0/2520633201 conn(0x55f1bbde6130 msgr2=0x55f1bbf2be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- 172.21.15.114:0/2520633201 shutdown_connections 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.142+0000 7fa00adeb000 1 -- 172.21.15.114:0/2520633201 wait complete. 2024-09-16T07:34:24.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 -- start start 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 Processor -- start 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbf296a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf29e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf2a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f1bbce45d0 con 0x55f1bbf492f0 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f1bbd4dd60 con 0x55f1bbefce10 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55f1bbcf0500 con 0x55f1bbf489d0 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 10 client.0 _ll_register_callbacks cb 0x55f1bbcf4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf2a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf2a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42184/0 (socket says 172.21.15.114:42184) 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 -- 172.21.15.114:0/1905715216 learned_addr learned my addr 172.21.15.114:0/1905715216 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fffe00640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf29e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005000640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbf296a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 -- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 msgr2=0x55f1bbf29e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf29e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 -- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 msgr2=0x55f1bbf296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbf296a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 -- 172.21.15.114:0/1905715216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1bbce8170 con 0x55f1bbf492f0 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005000640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbf296a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005a00640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf2a3b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800d3b0 tx=0x7f9ff800d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65311f6363446ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fea000640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fea000640 1 -- 172.21.15.114:0/1905715216 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8016020 con 0x55f1bbf492f0 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1bbce20f0 con 0x55f1bbf492f0 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fea000640 1 -- 172.21.15.114:0/1905715216 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7f9ff8012800 con 0x55f1bbf492f0 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fea000640 1 -- 172.21.15.114:0/1905715216 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9ff8020050 con 0x55f1bbf492f0 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 10 client.7620 fetch_fsmap learned FSMap version 83 2024-09-16T07:34:24.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55f1bbdceef0 con 0x55f1bbf492f0 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fea000640 1 -- 172.21.15.114:0/1905715216 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f1bbce20f0 con 0x55f1bbf492f0 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fea000640 1 -- 172.21.15.114:0/1905715216 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7f9ff8023020 con 0x55f1bbf492f0 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 10 client.7620 fetch_fsmap finished waiting for FSMap version 83 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 10 client.7620 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 20 client.7620 populate_metadata read hostname 'smithi114' 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf2b0f0 0x55f1bbf5ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 4 client.7620 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 --> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1bbd5ca70 con 0x55f1bbf2b0f0 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005000640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf2b0f0 0x55f1bbf5ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7fa005000640 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf2b0f0 0x55f1bbf5ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0d22ba04916d286 server_cookie=9624836c15d0a6c5 in_seq=0 out_seq=0 2024-09-16T07:34:24.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.146+0000 7f9fea000640 10 client.7620 ms_handle_connect on v2:172.21.15.114:6834/1571071623 2024-09-16T07:34:24.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7f9fea000640 1 -- 172.21.15.114:0/1905715216 <== mds.0 v2:172.21.15.114:6834/1571071623 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1bbd5ca70 con 0x55f1bbf2b0f0 2024-09-16T07:34:24.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7f9fea000640 10 client.7620 handle_command_reply: tid=0 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 client.7620 shutdown 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 msgr2=0x55f1bbf2a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf2a3b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800d3b0 tx=0x7f9ff800d870 comp rx=0 tx=0).stop 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 shutdown_connections 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf2b0f0 0x55f1bbf5ac90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf2a3b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbf29e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7f9fea000640 0 client.7620 ms_handle_reset on v2:172.21.15.114:6834/1571071623 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 --2- 172.21.15.114:0/1905715216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbefce10 0x55f1bbf296a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 >> 172.21.15.114:0/1905715216 conn(0x55f1bbde6130 msgr2=0x55f1bbefbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 shutdown_connections 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 1 -- 172.21.15.114:0/1905715216 wait complete. 2024-09-16T07:34:24.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.150+0000 7fa00adeb000 20 client.7620 trim_cache size 0 max 16384 2024-09-16T07:34:24.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.166+0000 7fa00adeb000 1 Processor -- start 2024-09-16T07:34:24.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.166+0000 7fa00adeb000 1 -- start start 2024-09-16T07:34:24.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbefce10 0x55f1bbfc35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbfc3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf492f0 0x55f1bbfc4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa000204920 con 0x55f1bbefce10 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa000203ac0 con 0x55f1bbf492f0 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa0001fb960 con 0x55f1bbf489d0 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbefce10 0x55f1bbfc35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbefce10 0x55f1bbfc35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60394/0 (socket says 172.21.15.114:60394) 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 -- 172.21.15.114:0/996247790 learned_addr learned my addr 172.21.15.114:0/996247790 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7f9fffe00640 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbfc3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005a00640 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf492f0 0x55f1bbfc4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 -- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 msgr2=0x55f1bbfc3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbfc3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 -- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf492f0 msgr2=0x55f1bbfc4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf492f0 0x55f1bbfc4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 -- 172.21.15.114:0/996247790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bbda5d90 con 0x55f1bbefce10 2024-09-16T07:34:24.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005a00640 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf492f0 0x55f1bbfc4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:24.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa005000640 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbefce10 0x55f1bbfc35e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00f8f10 tx=0x7f9ff0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8f571819012905 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7f9ff4c00640 1 -- 172.21.15.114:0/996247790 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00f9680 con 0x55f1bbefce10 2024-09-16T07:34:24.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7f9ff4c00640 1 -- 172.21.15.114:0/996247790 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ff00f8f80 con 0x55f1bbefce10 2024-09-16T07:34:24.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7f9ff4c00640 1 -- 172.21.15.114:0/996247790 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff01026e0 con 0x55f1bbefce10 2024-09-16T07:34:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- 172.21.15.114:0/996247790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbefce10 msgr2=0x55f1bbfc35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbefce10 0x55f1bbfc35e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00f8f10 tx=0x7f9ff0005780 comp rx=0 tx=0).stop 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- 172.21.15.114:0/996247790 shutdown_connections 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf492f0 0x55f1bbfc4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbf489d0 0x55f1bbfc3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- 172.21.15.114:0/996247790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbefce10 0x55f1bbfc35e0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- 172.21.15.114:0/996247790 >> 172.21.15.114:0/996247790 conn(0x55f1bbde6130 msgr2=0x55f1bbf04a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- 172.21.15.114:0/996247790 shutdown_connections 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- 172.21.15.114:0/996247790 wait complete. 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- start start 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 Processor -- start 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbefce10 0x55f1bbf5cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf489d0 0x55f1bbf5d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf5da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f1bbf5fce0 con 0x55f1bbf492f0 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f1bbd52390 con 0x55f1bbf489d0 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55f1bbdcea60 con 0x55f1bbefce10 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.170+0000 7fa00adeb000 10 client.0 _ll_register_callbacks cb 0x7f9ff8001680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf5da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf5da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60400/0 (socket says 172.21.15.114:60400) 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 -- 172.21.15.114:0/80275648 learned_addr learned my addr 172.21.15.114:0/80275648 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005000640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbefce10 0x55f1bbf5cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fffe00640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf489d0 0x55f1bbf5d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 -- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbefce10 msgr2=0x55f1bbf5cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbefce10 0x55f1bbf5cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 -- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf489d0 msgr2=0x55f1bbf5d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf489d0 0x55f1bbf5d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 -- 172.21.15.114:0/80275648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1bbd10a90 con 0x55f1bbf492f0 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005000640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbefce10 0x55f1bbf5cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005a00640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf5da50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8001270 tx=0x7f9ff8012970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa62067089d7842 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 1 -- 172.21.15.114:0/80275648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8028070 con 0x55f1bbf492f0 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 1 -- 172.21.15.114:0/80275648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7f9ff8003d90 con 0x55f1bbf492f0 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff00f8f80 con 0x55f1bbf492f0 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 1 -- 172.21.15.114:0/80275648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9ff8033050 con 0x55f1bbf492f0 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 10 client.7626 fetch_fsmap learned FSMap version 83 2024-09-16T07:34:24.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55f1bbcef050 con 0x55f1bbf492f0 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 1 -- 172.21.15.114:0/80275648 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ff00f8f80 con 0x55f1bbf492f0 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 1 -- 172.21.15.114:0/80275648 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7f9ff8036020 con 0x55f1bbf492f0 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 10 client.7626 fetch_fsmap finished waiting for FSMap version 83 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 10 client.7626 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 20 client.7626 populate_metadata read hostname 'smithi114' 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf5e3b0 0x55f1bbfcf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 4 client.7626 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 --> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] -- command(tid 0: {"prefix": "status"}) -- 0x55f1bbd58520 con 0x55f1bbf5e3b0 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005000640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf5e3b0 0x55f1bbfcf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa005000640 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf5e3b0 0x55f1bbfcf660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5d460a69cdbdaeb server_cookie=369a90b0e0bc355 in_seq=0 out_seq=0 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 10 client.7626 ms_handle_connect on v2:172.21.15.114:6834/1571071623 2024-09-16T07:34:24.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 1 -- 172.21.15.114:0/80275648 <== mds.0 v2:172.21.15.114:6834/1571071623 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55f1bbd58520 con 0x55f1bbf5e3b0 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 10 client.7626 handle_command_reply: tid=0 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 client.7626 shutdown 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 msgr2=0x55f1bbf5da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf5da50 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8001270 tx=0x7f9ff8012970 comp rx=0 tx=0).stop 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 shutdown_connections 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:6834/1571071623,v1:172.21.15.114:6835/1571071623] conn(0x55f1bbf5e3b0 0x55f1bbfcf660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f1bbf492f0 0x55f1bbf5da50 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f1bbf489d0 0x55f1bbf5d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 --2- 172.21.15.114:0/80275648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f1bbefce10 0x55f1bbf5cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7f9fea000640 0 client.7626 ms_handle_reset on v2:172.21.15.114:6834/1571071623 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 >> 172.21.15.114:0/80275648 conn(0x55f1bbde6130 msgr2=0x55f1bbf475b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 shutdown_connections 2024-09-16T07:34:24.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 1 -- 172.21.15.114:0/80275648 wait complete. 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa00adeb000 20 client.7626 trim_cache size 0 max 16384 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7467, 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:34:24.178 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.543156925, 2024-09-16T07:34:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 83, 2024-09-16T07:34:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 116, 2024-09-16T07:34:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 115, 2024-09-16T07:34:24.179 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 16.103541649 2024-09-16T07:34:24.179 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fe0073340 msgr2=0x7f9fe0075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.174+0000 7fa007a00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fe0073340 0x7f9fe0075800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa000150090 tx=0x7f9fec007910 comp rx=0 tx=0).stop 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0000b49e0 msgr2=0x7fa0001f8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0000b49e0 0x7fa0001f8130 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9ff001b730 tx=0x7f9ff0004600 comp rx=0 tx=0).stop 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 shutdown_connections 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fe0073340 0x7f9fe0075800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa00015dae0 0x7fa0000ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa0000cd100 0x7fa0000cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 --2- 172.21.15.114:0/681941976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0000b49e0 0x7fa0001f8130 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 >> 172.21.15.114:0/681941976 conn(0x7fa0000b18f0 msgr2=0x7fa0000ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 shutdown_connections 2024-09-16T07:34:24.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.178+0000 7fa007a00640 1 -- 172.21.15.114:0/681941976 wait complete. 2024-09-16T07:34:24.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:34:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- 172.21.15.114:0/3564367363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c0003fe0 msgr2=0x7f29c0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 --2- 172.21.15.114:0/3564367363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c0003fe0 0x7f29c0004810 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0b7e50 tx=0x7f29c401fa00 comp rx=0 tx=0).stop 2024-09-16T07:34:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e0a00640 1 -- 172.21.15.114:0/3564367363 reap_dead start 2024-09-16T07:34:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- 172.21.15.114:0/3564367363 shutdown_connections 2024-09-16T07:34:24.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- 172.21.15.114:0/3564367363 >> 172.21.15.114:0/3564367363 conn(0x7f29dc0d1da0 msgr2=0x7f29dc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- 172.21.15.114:0/3564367363 shutdown_connections 2024-09-16T07:34:24.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- 172.21.15.114:0/3564367363 wait complete. 2024-09-16T07:34:24.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 Processor -- start 2024-09-16T07:34:24.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- start start 2024-09-16T07:34:24.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c0003fe0 0x7f29dc1f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29dc14c540 0x7f29dc14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29dc14cf00 0x7f29dc15c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0ce870 con 0x7f29dc14c540 2024-09-16T07:34:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0ce6f0 con 0x7f29dc14cf00 2024-09-16T07:34:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e2a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc15c310 con 0x7f29c0003fe0 2024-09-16T07:34:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29dc14c540 0x7f29dc14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29dc14c540 0x7f29dc14c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60424/0 (socket says 172.21.15.114:60424) 2024-09-16T07:34:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 -- 172.21.15.114:0/2641115656 learned_addr learned my addr 172.21.15.114:0/2641115656 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e0a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29dc14cf00 0x7f29dc15c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29dbe00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c0003fe0 0x7f29dc1f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 -- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c0003fe0 msgr2=0x7f29dc1f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c0003fe0 0x7f29dc1f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 -- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29dc14cf00 msgr2=0x7f29dc15c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29dc14cf00 0x7f29dc15c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29d3400640 1 -- 172.21.15.114:0/2641115656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0c78e0 con 0x7f29dc14c540 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.338+0000 7f29e0a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29dc14cf00 0x7f29dc15c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29d3400640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29dc14c540 0x7f29dc14c9c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f29c401e100 tx=0x7f29c400c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29d8c00640 1 -- 172.21.15.114:0/2641115656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c40039a0 con 0x7f29dc14c540 2024-09-16T07:34:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29d8c00640 1 -- 172.21.15.114:0/2641115656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29c4003b60 con 0x7f29dc14c540 2024-09-16T07:34:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc0c7b50 con 0x7f29dc14c540 2024-09-16T07:34:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29d8c00640 1 -- 172.21.15.114:0/2641115656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c40a95d0 con 0x7f29dc14c540 2024-09-16T07:34:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc0c8110 con 0x7f29dc14c540 2024-09-16T07:34:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc0cea20 con 0x7f29dc14c540 2024-09-16T07:34:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29d8c00640 1 -- 172.21.15.114:0/2641115656 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f29c40a9770 con 0x7f29dc14c540 2024-09-16T07:34:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29d8c00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29b8073370 0x7f29b8075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29d8c00640 1 -- 172.21.15.114:0/2641115656 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7f29c4131960 con 0x7f29dc14c540 2024-09-16T07:34:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.342+0000 7f29dbe00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29b8073370 0x7f29b8075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.346+0000 7f29dbe00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29b8073370 0x7f29b8075830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0058d0 tx=0x7f29cc005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:24.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.346+0000 7f29d8c00640 1 -- 172.21.15.114:0/2641115656 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f29dc0d0350 con 0x7f29dc14c540 2024-09-16T07:34:24.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.550+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f29dc0b3370 con 0x7f29dc14c540 2024-09-16T07:34:24.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.550+0000 7f29d8c00640 1 -- 172.21.15.114:0/2641115656 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f29c40fc430 con 0x7f29dc14c540 2024-09-16T07:34:24.550 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29b8073370 msgr2=0x7f29b8075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29b8073370 0x7f29b8075830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0058d0 tx=0x7f29cc005860 comp rx=0 tx=0).stop 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29dc14c540 msgr2=0x7f29dc14c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29dc14c540 0x7f29dc14c9c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f29c401e100 tx=0x7f29c400c470 comp rx=0 tx=0).stop 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 shutdown_connections 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29dc14cf00 0x7f29dc15c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29dc14c540 0x7f29dc14c9c0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f29b8073370 0x7f29b8075830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 --2- 172.21.15.114:0/2641115656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f29c0003fe0 0x7f29dc1f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 >> 172.21.15.114:0/2641115656 conn(0x7f29dc0d1da0 msgr2=0x7f29dc0b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:24.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 shutdown_connections 2024-09-16T07:34:24.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24.554+0000 7f29e2a00640 1 -- 172.21.15.114:0/2641115656 wait complete. 2024-09-16T07:34:24.571 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:34:24.571 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:34:24.571 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:34:24.571 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:34:24.571 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:34:24.571 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:34:24.572 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:34:24.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:34:24.572 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:34:24.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:24.572 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:34:24.581 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:34:24.581 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:34:24.581 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:34:24.581 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.581 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:34:24.582 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42076sec preferred_lft 42076sec 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.583 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:34:24.584 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:24.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:24.585 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:34:24.648 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:34:24.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:24.651 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:34:24.706 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:34:24.706 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:34:24.706 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:34:24.706 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:34:24.706 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:34:24.707 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:34:24.707 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:34:24.707 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:34:24.707 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:34:24.707 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:34:24.707 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:34:24.707 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:34:24.707 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:34:24.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:34:24.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:34:24.708 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:34:24.708 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:34:24.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:34:24.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:34:24.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:24.843 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:34:24.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:34:24.852 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:34:24.853 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:34:24.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:24.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:34:24.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:34:24.918 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:34:24.970 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:34:24.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:34:24.970 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:34:25.021 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:34:25.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:25.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:34:25.110 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:34:25.110 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:34:25.110 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:34:25.125 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:34:25.125 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:34:25.125 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:34:25.125 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:34:25.125 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:34:25.135 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:34:25.139 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:34:25.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:25.139 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:34:25.159 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:34:25.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:34:25.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:34:25.262 INFO:teuthology.orchestra.run.smithi114.stdout:client7635 2024-09-16T07:34:25.262 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:25.263 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:25.318 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:34:25.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1687801463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bf70 msgr2=0x7fe4f00b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:25.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1687801463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bf70 0x7fe4f00b53e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009840 tx=0x7fe4e801c790 comp rx=0 tx=0).stop 2024-09-16T07:34:25.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1687801463 shutdown_connections 2024-09-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1687801463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bf70 0x7fe4f00b53e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1687801463 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4f015bb90 0x7fe4f015f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1687801463 >> 172.21.15.114:0/1687801463 conn(0x7fe4f00d1d90 msgr2=0x7fe4f00d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1687801463 shutdown_connections 2024-09-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1687801463 wait complete. 2024-09-16T07:34:25.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 Processor -- start 2024-09-16T07:34:25.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.506+0000 7fe4f7e00640 1 -- start start 2024-09-16T07:34:25.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4f00d2940 0x7fe4f01f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:25.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bb90 0x7fe4f00c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:25.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4f015bf70 0x7fe4f00c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:25.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00b6710 con 0x7fe4f015bb90 2024-09-16T07:34:25.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00b6590 con 0x7fe4f015bf70 2024-09-16T07:34:25.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f0168ca0 con 0x7fe4f00d2940 2024-09-16T07:34:25.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bb90 0x7fe4f00c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bb90 0x7fe4f00c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60454/0 (socket says 172.21.15.114:60454) 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 -- 172.21.15.114:0/1016483131 learned_addr learned my addr 172.21.15.114:0/1016483131 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f5e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4f015bf70 0x7fe4f00c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f5400640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4f00d2940 0x7fe4f01f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 -- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4f00d2940 msgr2=0x7fe4f01f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4f00d2940 0x7fe4f01f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 -- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4f015bf70 msgr2=0x7fe4f00c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4f015bf70 0x7fe4f00c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 -- 172.21.15.114:0/1016483131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f01f5e60 con 0x7fe4f015bb90 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f5e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4f015bf70 0x7fe4f00c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f4a00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bb90 0x7fe4f00c31f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c490 tx=0x7fe4dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:25.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4ed600640 1 -- 172.21.15.114:0/1016483131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc016020 con 0x7fe4f015bb90 2024-09-16T07:34:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4ed600640 1 -- 172.21.15.114:0/1016483131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4dc012940 con 0x7fe4f015bb90 2024-09-16T07:34:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f01f6140 con 0x7fe4f015bb90 2024-09-16T07:34:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4ed600640 1 -- 172.21.15.114:0/1016483131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc012d90 con 0x7fe4f015bb90 2024-09-16T07:34:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f0152f40 con 0x7fe4f015bb90 2024-09-16T07:34:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f00b53e0 con 0x7fe4f015bb90 2024-09-16T07:34:25.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.510+0000 7fe4ed600640 1 -- 172.21.15.114:0/1016483131 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fe4dc019020 con 0x7fe4f015bb90 2024-09-16T07:34:25.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.514+0000 7fe4ed600640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe4d0073370 0x7fe4d0075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:25.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.514+0000 7fe4ed600640 1 -- 172.21.15.114:0/1016483131 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fe4dc0946c0 con 0x7fe4f015bb90 2024-09-16T07:34:25.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.514+0000 7fe4f5400640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe4d0073370 0x7fe4d0075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:25.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.514+0000 7fe4f5400640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe4d0073370 0x7fe4d0075830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005c50 tx=0x7fe4e4005be0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:25.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.518+0000 7fe4ed600640 1 -- 172.21.15.114:0/1016483131 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe4dc020020 con 0x7fe4f015bb90 2024-09-16T07:34:25.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.722+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe4f0070270 con 0x7fe4f015bb90 2024-09-16T07:34:25.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.722+0000 7fe4ed600640 1 -- 172.21.15.114:0/1016483131 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7fe4dc05f250 con 0x7fe4f015bb90 2024-09-16T07:34:25.721 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:34:25.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe4d0073370 msgr2=0x7fe4d0075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:25.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe4d0073370 0x7fe4d0075830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005c50 tx=0x7fe4e4005be0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bb90 msgr2=0x7fe4f00c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:25.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bb90 0x7fe4f00c31f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c490 tx=0x7fe4dc00c950 comp rx=0 tx=0).stop 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 shutdown_connections 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4f015bf70 0x7fe4f00c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4f015bb90 0x7fe4f00c31f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe4d0073370 0x7fe4d0075830 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 --2- 172.21.15.114:0/1016483131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe4f00d2940 0x7fe4f01f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 >> 172.21.15.114:0/1016483131 conn(0x7fe4f00d1d90 msgr2=0x7fe4f0070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 shutdown_connections 2024-09-16T07:34:25.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:25.726+0000 7fe4f7e00640 1 -- 172.21.15.114:0/1016483131 wait complete. 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:34:25.743 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:34:25.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:25.744 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:34:25.753 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:34:25.753 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:34:25.754 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42084sec preferred_lft 42084sec 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:34:25.755 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:34:25.756 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:34:25.756 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.756 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:34:25.756 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:34:25.756 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:34:25.756 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:34:25.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:25.757 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:34:25.817 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:34:25.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:25.820 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:34:25.875 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:34:25.875 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:34:25.876 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:34:25.876 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:34:25.877 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:34:25.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:34:25.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:34:25.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:34:25.877 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:34:25.974 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:34:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:34:26.017 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:34:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:34:26.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:26.023 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:34:26.033 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:34:26.033 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:34:26.033 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:34:26.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:26.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:34:26.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:34:26.094 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:34:26.147 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:34:26.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:34:26.147 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:34:26.198 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:34:26.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:26.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:34:26.286 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:34:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:34:26.287 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:34:26.302 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:34:26.302 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:34:26.302 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:34:26.302 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:34:26.302 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:34:26.312 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:34:26.316 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:34:26.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:26.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:34:26.336 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:34:26.425 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:34:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:34:26.428 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:34:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:34:26.435 INFO:teuthology.orchestra.run.smithi149.stdout:client7647 2024-09-16T07:34:26.435 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:26.435 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:26.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 -- 172.21.15.114:0/3022291746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f740cf2b0 msgr2=0x7f9f7415b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/3022291746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f740cf2b0 0x7f9f7415b000 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9f74076610 tx=0x7f9f6001c8c0 comp rx=0 tx=0).stop 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 -- 172.21.15.114:0/3022291746 shutdown_connections 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/3022291746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f740cf2b0 0x7f9f7415b000 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/3022291746 >> v2:172.21.15.149:3300/0 conn(0x7f9f74070960 0x7f9f7406fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 -- 172.21.15.114:0/3022291746 >> 172.21.15.114:0/3022291746 conn(0x7f9f740cfbc0 msgr2=0x7f9f740cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 -- 172.21.15.114:0/3022291746 shutdown_connections 2024-09-16T07:34:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 -- 172.21.15.114:0/3022291746 wait complete. 2024-09-16T07:34:26.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.598+0000 7f9f7ae00640 1 Processor -- start 2024-09-16T07:34:26.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 -- start start 2024-09-16T07:34:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f74070960 0x7f9f741f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f740cf2b0 0x7f9f740ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7415e580 0x7f9f7414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9f740ce660 con 0x7f9f74070960 2024-09-16T07:34:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f740ce4e0 con 0x7f9f7415e580 2024-09-16T07:34:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f74168020 con 0x7f9f740cf2b0 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f74070960 0x7f9f741f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f74070960 0x7f9f741f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60482/0 (socket says 172.21.15.114:60482) 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 -- 172.21.15.114:0/2608080819 learned_addr learned my addr 172.21.15.114:0/2608080819 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73400640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f740cf2b0 0x7f9f740ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f78e00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7415e580 0x7f9f7414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 -- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f740cf2b0 msgr2=0x7f9f740ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f740cf2b0 0x7f9f740ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 -- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7415e580 msgr2=0x7f9f7414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7415e580 0x7f9f7414c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 -- 172.21.15.114:0/2608080819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f741fb930 con 0x7f9f74070960 2024-09-16T07:34:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f73e00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f74070960 0x7f9f741f8410 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400d980 tx=0x7f9f6400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f6be00640 1 -- 172.21.15.114:0/2608080819 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64017070 con 0x7f9f74070960 2024-09-16T07:34:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f6be00640 1 -- 172.21.15.114:0/2608080819 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f64009d60 con 0x7f9f74070960 2024-09-16T07:34:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f6be00640 1 -- 172.21.15.114:0/2608080819 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64005280 con 0x7f9f74070960 2024-09-16T07:34:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f741fbc10 con 0x7f9f74070960 2024-09-16T07:34:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f741f7c10 con 0x7f9f74070960 2024-09-16T07:34:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.602+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f74069410 con 0x7f9f74070960 2024-09-16T07:34:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.606+0000 7f9f6be00640 1 -- 172.21.15.114:0/2608080819 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f9f64005420 con 0x7f9f74070960 2024-09-16T07:34:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.606+0000 7f9f6be00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f54073340 0x7f9f54075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.606+0000 7f9f6be00640 1 -- 172.21.15.114:0/2608080819 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f9f64094890 con 0x7f9f74070960 2024-09-16T07:34:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.606+0000 7f9f73400640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f54073340 0x7f9f54075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:26.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.606+0000 7f9f73400640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f54073340 0x7f9f54075800 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f600af000 tx=0x7f9f6001b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:26.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.610+0000 7f9f6be00640 1 -- 172.21.15.114:0/2608080819 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9f6405ecd0 con 0x7f9f74070960 2024-09-16T07:34:26.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:26.818+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f9f7406fcc0 con 0x7f9f74070960 2024-09-16T07:34:27.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f6be00640 1 -- 172.21.15.114:0/2608080819 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v84) ==== 136+0+0 (secure 0 0 0) 0x7f9f64063700 con 0x7f9f74070960 2024-09-16T07:34:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f54073340 msgr2=0x7f9f54075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f54073340 0x7f9f54075800 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f600af000 tx=0x7f9f6001b100 comp rx=0 tx=0).stop 2024-09-16T07:34:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f74070960 msgr2=0x7f9f741f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f74070960 0x7f9f741f8410 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400d980 tx=0x7f9f6400de40 comp rx=0 tx=0).stop 2024-09-16T07:34:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 shutdown_connections 2024-09-16T07:34:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f7415e580 0x7f9f7414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f54073340 0x7f9f54075800 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f740cf2b0 0x7f9f740ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 --2- 172.21.15.114:0/2608080819 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f74070960 0x7f9f741f8410 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 >> 172.21.15.114:0/2608080819 conn(0x7f9f740cfbc0 msgr2=0x7f9f740aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:27.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.713+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 shutdown_connections 2024-09-16T07:34:27.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.717+0000 7f9f7ae00640 1 -- 172.21.15.114:0/2608080819 wait complete. 2024-09-16T07:34:27.739 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:34:27.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 -- 172.21.15.114:0/737701896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 msgr2=0x7f6da80b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 --2- 172.21.15.114:0/737701896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 0x7f6da80b1bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009840 tx=0x7f6d9001c6d0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 -- 172.21.15.114:0/737701896 shutdown_connections 2024-09-16T07:34:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 --2- 172.21.15.114:0/737701896 >> v2:172.21.15.149:3300/0 conn(0x7f6da80afca0 0x7f6da80b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 --2- 172.21.15.114:0/737701896 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 0x7f6da80b1bd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 -- 172.21.15.114:0/737701896 >> 172.21.15.114:0/737701896 conn(0x7f6da80d1e30 msgr2=0x7f6da80d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:27.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 -- 172.21.15.114:0/737701896 shutdown_connections 2024-09-16T07:34:27.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.885+0000 7f6daf000640 1 -- 172.21.15.114:0/737701896 wait complete. 2024-09-16T07:34:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 Processor -- start 2024-09-16T07:34:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 -- start start 2024-09-16T07:34:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6da80afca0 0x7f6da8150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 0x7f6da80b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da815f490 0x7f6da81596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8168c80 con 0x7f6da815f490 2024-09-16T07:34:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6da80b2350 con 0x7f6da80afca0 2024-09-16T07:34:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6da8168e00 con 0x7f6da80b2e80 2024-09-16T07:34:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da815f490 0x7f6da81596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da815f490 0x7f6da81596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60494/0 (socket says 172.21.15.114:60494) 2024-09-16T07:34:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 -- 172.21.15.114:0/2791205306 learned_addr learned my addr 172.21.15.114:0/2791205306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6d9f400640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 0x7f6da80b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6da7e00640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6da80afca0 0x7f6da8150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 -- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 msgr2=0x7f6da80b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:27.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 0x7f6da80b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 -- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6da80afca0 msgr2=0x7f6da8150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:27.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6da80afca0 0x7f6da8150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:27.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 -- 172.21.15.114:0/2791205306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81513a0 con 0x7f6da815f490 2024-09-16T07:34:27.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6dad000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da815f490 0x7f6da81596f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c370 tx=0x7f6da000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:27.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6da4c00640 1 -- 172.21.15.114:0/2791205306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0003980 con 0x7f6da815f490 2024-09-16T07:34:27.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6da4c00640 1 -- 172.21.15.114:0/2791205306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6da0003c30 con 0x7f6da815f490 2024-09-16T07:34:27.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da80b66d0 con 0x7f6da815f490 2024-09-16T07:34:27.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6da4c00640 1 -- 172.21.15.114:0/2791205306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0004280 con 0x7f6da815f490 2024-09-16T07:34:27.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da80b6c90 con 0x7f6da815f490 2024-09-16T07:34:27.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.889+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da80b0130 con 0x7f6da815f490 2024-09-16T07:34:27.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.893+0000 7f6da4c00640 1 -- 172.21.15.114:0/2791205306 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f6da0004420 con 0x7f6da815f490 2024-09-16T07:34:27.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.893+0000 7f6da4c00640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6d84073340 0x7f6d84075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:27.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.893+0000 7f6da4c00640 1 -- 172.21.15.114:0/2791205306 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f6da0094f20 con 0x7f6da815f490 2024-09-16T07:34:27.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.893+0000 7f6da7e00640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6d84073340 0x7f6d84075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:27.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.893+0000 7f6da7e00640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6d84073340 0x7f6d84075800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d98001780 tx=0x7f6d98009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:27.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:27.897+0000 7f6da4c00640 1 -- 172.21.15.114:0/2791205306 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6da005f3a0 con 0x7f6da815f490 2024-09-16T07:34:28.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.081+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f6da806f210 con 0x7f6d84073340 2024-09-16T07:34:28.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6da4c00640 1 -- 172.21.15.114:0/2791205306 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f6da806f210 con 0x7f6d84073340 2024-09-16T07:34:28.083 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:34:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:28.083 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:34:28.084 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:28.084 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:34:28.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6d84073340 msgr2=0x7f6d84075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:28.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6d84073340 0x7f6d84075800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d98001780 tx=0x7f6d98009040 comp rx=0 tx=0).stop 2024-09-16T07:34:28.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da815f490 msgr2=0x7f6da81596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:28.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da815f490 0x7f6da81596f0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6da000c370 tx=0x7f6da000c830 comp rx=0 tx=0).stop 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 shutdown_connections 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6da815f490 0x7f6da81596f0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6d84073340 0x7f6d84075800 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6da80b2e80 0x7f6da80b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 --2- 172.21.15.114:0/2791205306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6da80afca0 0x7f6da8150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 >> 172.21.15.114:0/2791205306 conn(0x7f6da80d1e30 msgr2=0x7f6da806f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 shutdown_connections 2024-09-16T07:34:28.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.085+0000 7f6daf000640 1 -- 172.21.15.114:0/2791205306 wait complete. 2024-09-16T07:34:28.106 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:34:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 -- 172.21.15.114:0/1613337480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140cf1d0 msgr2=0x7fb214160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 --2- 172.21.15.114:0/1613337480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140cf1d0 0x7fb214160490 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009840 tx=0x7fb1fc01c7f0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 -- 172.21.15.114:0/1613337480 shutdown_connections 2024-09-16T07:34:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 --2- 172.21.15.114:0/1613337480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2140cf1d0 0x7fb214160490 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 -- 172.21.15.114:0/1613337480 >> 172.21.15.114:0/1613337480 conn(0x7fb2140b18f0 msgr2=0x7fb2140b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 -- 172.21.15.114:0/1613337480 shutdown_connections 2024-09-16T07:34:28.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 -- 172.21.15.114:0/1613337480 wait complete. 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 Processor -- start 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.253+0000 7fb219200640 1 -- start start 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21406e7a0 0x7fb214158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2140cf1d0 0x7fb21414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21415f9a0 0x7fb21414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb21416a730 con 0x7fb21415f9a0 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb21416a5b0 con 0x7fb21406e7a0 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb21416a8b0 con 0x7fb2140cf1d0 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21415f9a0 0x7fb21414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:28.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21415f9a0 0x7fb21414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60520/0 (socket says 172.21.15.114:60520) 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 -- 172.21.15.114:0/108755325 learned_addr learned my addr 172.21.15.114:0/108755325 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb211e00640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21406e7a0 0x7fb214158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb209400640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2140cf1d0 0x7fb21414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 -- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2140cf1d0 msgr2=0x7fb21414cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2140cf1d0 0x7fb21414cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 -- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21406e7a0 msgr2=0x7fb214158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21406e7a0 0x7fb214158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 -- 172.21.15.114:0/108755325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21414d780 con 0x7fb21415f9a0 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb209400640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2140cf1d0 0x7fb21414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb212800640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21415f9a0 0x7fb21414ff10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00cbc0 tx=0x7fb20c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb20aa00640 1 -- 172.21.15.114:0/108755325 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c016020 con 0x7fb21415f9a0 2024-09-16T07:34:28.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb20aa00640 1 -- 172.21.15.114:0/108755325 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb20c00ab00 con 0x7fb21415f9a0 2024-09-16T07:34:28.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb20aa00640 1 -- 172.21.15.114:0/108755325 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c012420 con 0x7fb21415f9a0 2024-09-16T07:34:28.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2141591b0 con 0x7fb21415f9a0 2024-09-16T07:34:28.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2141574b0 con 0x7fb21415f9a0 2024-09-16T07:34:28.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2140ce2e0 con 0x7fb21415f9a0 2024-09-16T07:34:28.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.257+0000 7fb20aa00640 1 -- 172.21.15.114:0/108755325 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fb20c019020 con 0x7fb21415f9a0 2024-09-16T07:34:28.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.261+0000 7fb20aa00640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1f0073340 0x7fb1f0075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:28.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.261+0000 7fb20aa00640 1 -- 172.21.15.114:0/108755325 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fb20c0949e0 con 0x7fb21415f9a0 2024-09-16T07:34:28.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.261+0000 7fb211e00640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1f0073340 0x7fb1f0075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:28.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.261+0000 7fb211e00640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1f0073340 0x7fb1f0075800 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb20400b810 tx=0x7fb204008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:28.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.265+0000 7fb20aa00640 1 -- 172.21.15.114:0/108755325 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb20c020020 con 0x7fb21415f9a0 2024-09-16T07:34:28.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.433+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb21415b040 con 0x7fb21415f9a0 2024-09-16T07:34:28.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.433+0000 7fb20aa00640 1 -- 172.21.15.114:0/108755325 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7fb21414d780 con 0x7fb21415f9a0 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1f0073340 msgr2=0x7fb1f0075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1f0073340 0x7fb1f0075800 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb20400b810 tx=0x7fb204008040 comp rx=0 tx=0).stop 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21415f9a0 msgr2=0x7fb21414ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21415f9a0 0x7fb21414ff10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00cbc0 tx=0x7fb20c00ccb0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 shutdown_connections 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb21415f9a0 0x7fb21414ff10 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb1f0073340 0x7fb1f0075800 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb2140cf1d0 0x7fb21414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 --2- 172.21.15.114:0/108755325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb21406e7a0 0x7fb214158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 >> 172.21.15.114:0/108755325 conn(0x7fb2140b18f0 msgr2=0x7fb214073b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:28.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 shutdown_connections 2024-09-16T07:34:28.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:28.437+0000 7fb219200640 1 -- 172.21.15.114:0/108755325 wait complete. 2024-09-16T07:34:28.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.455 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol33810/ebaf8ed6-52c6-4280-84bd-bb0bba132c0c) 2024-09-16T07:34:28.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.482 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol33810/ebaf8ed6-52c6-4280-84bd-bb0bba132c0c/.snap/fake) 2024-09-16T07:34:28.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.555 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:34:28.612 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:34:28.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.612 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol33810/ebaf8ed6-52c6-4280-84bd-bb0bba132c0c) 2024-09-16T07:34:28.678 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:28.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol33810/.meta 2024-09-16T07:34:28.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.741 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp52340/subvol79391/e24a97d4-1615-4fe5-a0b4-2ae73f362a5b) 2024-09-16T07:34:28.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.810 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp52340/subvol79391/e24a97d4-1615-4fe5-a0b4-2ae73f362a5b/.snap/fake) 2024-09-16T07:34:28.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.877 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:34:28.931 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:34:28.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:28.932 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp52340/subvol79391/e24a97d4-1615-4fe5-a0b4-2ae73f362a5b) 2024-09-16T07:34:28.998 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:28.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp52340/subvol79391/.meta 2024-09-16T07:34:29.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:29.066 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol27232/9dc871ee-4557-48cd-b9b5-9d683de518d5) 2024-09-16T07:34:29.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:29.128 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:34:29.179 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:34:29.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:29.179 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol27232/9dc871ee-4557-48cd-b9b5-9d683de518d5) 2024-09-16T07:34:29.251 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:29.252 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol27232/.meta 2024-09-16T07:34:29.317 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol33810 2024-09-16T07:34:29.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 -- 172.21.15.114:0/2433108468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 msgr2=0x7f39e40b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 --2- 172.21.15.114:0/2433108468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40b4a60 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f39e40af3d0 tx=0x7f39d001c800 comp rx=0 tx=0).stop 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 -- 172.21.15.114:0/2433108468 shutdown_connections 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 --2- 172.21.15.114:0/2433108468 >> v2:172.21.15.149:3300/0 conn(0x7f39e40b2bf0 0x7f39e40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 --2- 172.21.15.114:0/2433108468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40b4a60 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 -- 172.21.15.114:0/2433108468 >> 172.21.15.114:0/2433108468 conn(0x7f39e40b18f0 msgr2=0x7f39e40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 -- 172.21.15.114:0/2433108468 shutdown_connections 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.501+0000 7f39ea000640 1 -- 172.21.15.114:0/2433108468 wait complete. 2024-09-16T07:34:29.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 Processor -- start 2024-09-16T07:34:29.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 -- start start 2024-09-16T07:34:29.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39e40b2bf0 0x7f39e4145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39e4158a20 0x7f39e4156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f39e4167a00 con 0x7f39e406ecb0 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40cd790 con 0x7f39e4158a20 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f39e4167b80 con 0x7f39e40b2bf0 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60540/0 (socket says 172.21.15.114:60540) 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 -- 172.21.15.114:0/2931254535 learned_addr learned my addr 172.21.15.114:0/2931254535 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3e00640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39e4158a20 0x7f39e4156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e2a00640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39e40b2bf0 0x7f39e4145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 -- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39e40b2bf0 msgr2=0x7f39e4145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39e40b2bf0 0x7f39e4145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 -- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39e4158a20 msgr2=0x7f39e4156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39e4158a20 0x7f39e4156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 -- 172.21.15.114:0/2931254535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e40ad320 con 0x7f39e406ecb0 2024-09-16T07:34:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e2a00640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39e40b2bf0 0x7f39e4145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:29.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39e3400640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40acd40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f39d400c430 tx=0x7f39d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39db400640 1 -- 172.21.15.114:0/2931254535 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4011790 con 0x7f39e406ecb0 2024-09-16T07:34:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39db400640 1 -- 172.21.15.114:0/2931254535 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39d4017070 con 0x7f39e406ecb0 2024-09-16T07:34:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39db400640 1 -- 172.21.15.114:0/2931254535 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4011ce0 con 0x7f39e406ecb0 2024-09-16T07:34:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.505+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e40ad600 con 0x7f39e406ecb0 2024-09-16T07:34:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.509+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e40adea0 con 0x7f39e406ecb0 2024-09-16T07:34:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.509+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e40ad9f0 con 0x7f39e406ecb0 2024-09-16T07:34:29.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.509+0000 7f39db400640 1 -- 172.21.15.114:0/2931254535 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f39d401c460 con 0x7f39e406ecb0 2024-09-16T07:34:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.509+0000 7f39db400640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f39c4073340 0x7f39c4075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.509+0000 7f39db400640 1 -- 172.21.15.114:0/2931254535 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f39d40943b0 con 0x7f39e406ecb0 2024-09-16T07:34:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.509+0000 7f39e2a00640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f39c4073340 0x7f39c4075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.513+0000 7f39e2a00640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f39c4073340 0x7f39c4075800 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39d00af000 tx=0x7f39d001b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.513+0000 7f39db400640 1 -- 172.21.15.114:0/2931254535 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f39d405f030 con 0x7f39e406ecb0 2024-09-16T07:34:29.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.713+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol33810", "target": ["mon-mgr", ""]}) -- 0x7f39e4069410 con 0x7f39c4073340 2024-09-16T07:34:29.719 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:29.721+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:29.719 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:29.721+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:29.719 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:29.721+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:29.719 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:29.721+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:29.719 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:29.721+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:29.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.757+0000 7f39db400640 1 -- 172.21.15.114:0/2931254535 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f39e4069410 con 0x7f39c4073340 2024-09-16T07:34:29.758 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol33810/ebaf8ed6-52c6-4280-84bd-bb0bba132c0c 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f39c4073340 msgr2=0x7f39c4075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f39c4073340 0x7f39c4075800 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f39d00af000 tx=0x7f39d001b040 comp rx=0 tx=0).stop 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 msgr2=0x7f39e40acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40acd40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f39d400c430 tx=0x7f39d400c8f0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 shutdown_connections 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39e4158a20 0x7f39e4156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f39c4073340 0x7f39c4075800 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f39e40b2bf0 0x7f39e4145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 --2- 172.21.15.114:0/2931254535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f39e406ecb0 0x7f39e40acd40 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 >> 172.21.15.114:0/2931254535 conn(0x7f39e40b18f0 msgr2=0x7f39e4070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 shutdown_connections 2024-09-16T07:34:29.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.761+0000 7f39ea000640 1 -- 172.21.15.114:0/2931254535 wait complete. 2024-09-16T07:34:29.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol79391 subvol_grp52340 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 -- 172.21.15.114:0/4239043864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d06b0 msgr2=0x7fcffc0b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 --2- 172.21.15.114:0/4239043864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d06b0 0x7fcffc0b1350 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0739f0 tx=0x7fcff401cac0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 -- 172.21.15.114:0/4239043864 shutdown_connections 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 --2- 172.21.15.114:0/4239043864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d06b0 0x7fcffc0b1350 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 --2- 172.21.15.114:0/4239043864 >> v2:172.21.15.149:3300/0 conn(0x7fcffc0d28e0 0x7fcffc0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 --2- 172.21.15.114:0/4239043864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc15f390 0x7fcffc0cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 -- 172.21.15.114:0/4239043864 >> 172.21.15.114:0/4239043864 conn(0x7fcffc0d1dc0 msgr2=0x7fcffc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 -- 172.21.15.114:0/4239043864 shutdown_connections 2024-09-16T07:34:29.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.925+0000 7fd002c00640 1 -- 172.21.15.114:0/4239043864 wait complete. 2024-09-16T07:34:29.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 Processor -- start 2024-09-16T07:34:29.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 -- start start 2024-09-16T07:34:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0d06b0 0x7fcffc0b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d28e0 0x7fcffc0cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15f390 0x7fcffc15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0afe80 con 0x7fcffc0d28e0 2024-09-16T07:34:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0afd00 con 0x7fcffc15f390 2024-09-16T07:34:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc0b0000 con 0x7fcffc0d06b0 2024-09-16T07:34:29.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d28e0 0x7fcffc0cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d28e0 0x7fcffc0cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60584/0 (socket says 172.21.15.114:60584) 2024-09-16T07:34:29.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 -- 172.21.15.114:0/1361885447 learned_addr learned my addr 172.21.15.114:0/1361885447 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:29.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcffbe00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0d06b0 0x7fcffc0b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd000c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15f390 0x7fcffc15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 -- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0d06b0 msgr2=0x7fcffc0b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0d06b0 0x7fcffc0b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 -- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15f390 msgr2=0x7fcffc15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15f390 0x7fcffc15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 -- 172.21.15.114:0/1361885447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc0b6170 con 0x7fcffc0d28e0 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff3400640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d28e0 0x7fcffc0cefd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400d9b0 tx=0x7fcfe400de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff8c00640 1 -- 172.21.15.114:0/1361885447 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4017070 con 0x7fcffc0d28e0 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff8c00640 1 -- 172.21.15.114:0/1361885447 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe4009cc0 con 0x7fcffc0d28e0 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fcff8c00640 1 -- 172.21.15.114:0/1361885447 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40106c0 con 0x7fcffc0d28e0 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.929+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc0b63e0 con 0x7fcffc0d28e0 2024-09-16T07:34:29.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.933+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc0cf510 con 0x7fcffc0d28e0 2024-09-16T07:34:29.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.933+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc0b1350 con 0x7fcffc0d28e0 2024-09-16T07:34:29.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.933+0000 7fcff8c00640 1 -- 172.21.15.114:0/1361885447 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fcfe401a070 con 0x7fcffc0d28e0 2024-09-16T07:34:29.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.933+0000 7fcff8c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcfd8073340 0x7fcfd8075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:29.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.933+0000 7fcff8c00640 1 -- 172.21.15.114:0/1361885447 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fcfe4094980 con 0x7fcffc0d28e0 2024-09-16T07:34:29.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.933+0000 7fcffbe00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcfd8073340 0x7fcfd8075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:29.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.933+0000 7fcffbe00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcfd8073340 0x7fcfd8075800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0045b0 tx=0x7fcfec00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:29.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:29.937+0000 7fcff8c00640 1 -- 172.21.15.114:0/1361885447 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcfe405edc0 con 0x7fcffc0d28e0 2024-09-16T07:34:30.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.133+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol79391", "group_name": "subvol_grp52340", "target": ["mon-mgr", ""]}) -- 0x7fcffc151420 con 0x7fcfd8073340 2024-09-16T07:34:30.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.165+0000 7fcff8c00640 1 -- 172.21.15.114:0/1361885447 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7fcffc151420 con 0x7fcfd8073340 2024-09-16T07:34:30.166 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp52340/subvol79391/e24a97d4-1615-4fe5-a0b4-2ae73f362a5b 2024-09-16T07:34:30.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcfd8073340 msgr2=0x7fcfd8075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcfd8073340 0x7fcfd8075800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0045b0 tx=0x7fcfec00b2e0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d28e0 msgr2=0x7fcffc0cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d28e0 0x7fcffc0cefd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400d9b0 tx=0x7fcfe400de70 comp rx=0 tx=0).stop 2024-09-16T07:34:30.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 shutdown_connections 2024-09-16T07:34:30.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc15f390 0x7fcffc15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcffc0d28e0 0x7fcffc0cefd0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcfd8073340 0x7fcfd8075800 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 --2- 172.21.15.114:0/1361885447 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0d06b0 0x7fcffc0b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 >> 172.21.15.114:0/1361885447 conn(0x7fcffc0d1dc0 msgr2=0x7fcffc151920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 shutdown_connections 2024-09-16T07:34:30.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.169+0000 7fd002c00640 1 -- 172.21.15.114:0/1361885447 wait complete. 2024-09-16T07:34:30.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol27232 2024-09-16T07:34:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 -- 172.21.15.114:0/4212642216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98880cf300 msgr2=0x7f988806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 --2- 172.21.15.114:0/4212642216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98880cf300 0x7f988806ecb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f98880cc770 tx=0x7f987001c820 comp rx=0 tx=0).stop 2024-09-16T07:34:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 -- 172.21.15.114:0/4212642216 shutdown_connections 2024-09-16T07:34:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 --2- 172.21.15.114:0/4212642216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98880cf300 0x7f988806ecb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 -- 172.21.15.114:0/4212642216 >> 172.21.15.114:0/4212642216 conn(0x7f98880b18f0 msgr2=0x7f98880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:30.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 -- 172.21.15.114:0/4212642216 shutdown_connections 2024-09-16T07:34:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 -- 172.21.15.114:0/4212642216 wait complete. 2024-09-16T07:34:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 Processor -- start 2024-09-16T07:34:30.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.333+0000 7f988ce00640 1 -- start start 2024-09-16T07:34:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988806e810 0x7f98881f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98880cf300 0x7f988809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f988815ade0 0x7f988809af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9888169b20 con 0x7f988815ade0 2024-09-16T07:34:30.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f98881699a0 con 0x7f988806e810 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9888169ca0 con 0x7f98880cf300 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f988815ade0 0x7f988809af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f988815ade0 0x7f988809af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60588/0 (socket says 172.21.15.114:60588) 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 -- 172.21.15.114:0/1058987984 learned_addr learned my addr 172.21.15.114:0/1058987984 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9885e00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988806e810 0x7f98881f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f987d400640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98880cf300 0x7f988809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 -- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98880cf300 msgr2=0x7f988809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98880cf300 0x7f988809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 -- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988806e810 msgr2=0x7f98881f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988806e810 0x7f98881f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 -- 172.21.15.114:0/1058987984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98881f7ba0 con 0x7f988815ade0 2024-09-16T07:34:30.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f9886800640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f988815ade0 0x7f988809af50 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f988000cbf0 tx=0x7f988000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f987ea00640 1 -- 172.21.15.114:0/1058987984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880016020 con 0x7f988815ade0 2024-09-16T07:34:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f987ea00640 1 -- 172.21.15.114:0/1058987984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f988000ab00 con 0x7f988815ade0 2024-09-16T07:34:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988809b580 con 0x7f988815ade0 2024-09-16T07:34:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f987ea00640 1 -- 172.21.15.114:0/1058987984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9880012420 con 0x7f988815ade0 2024-09-16T07:34:30.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988809bb40 con 0x7f988815ade0 2024-09-16T07:34:30.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98880cf720 con 0x7f988815ade0 2024-09-16T07:34:30.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.337+0000 7f987ea00640 1 -- 172.21.15.114:0/1058987984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f9880019020 con 0x7f988815ade0 2024-09-16T07:34:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.341+0000 7f987ea00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9864073340 0x7f9864075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.341+0000 7f987ea00640 1 -- 172.21.15.114:0/1058987984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f98800949e0 con 0x7f988815ade0 2024-09-16T07:34:30.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.341+0000 7f9885e00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9864073340 0x7f9864075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.341+0000 7f9885e00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9864073340 0x7f9864075800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9878000c10 tx=0x7f9878009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:30.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.345+0000 7f987ea00640 1 -- 172.21.15.114:0/1058987984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9880020020 con 0x7f988815ade0 2024-09-16T07:34:30.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.545+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol27232", "target": ["mon-mgr", ""]}) -- 0x7f98881fb5b0 con 0x7f9864073340 2024-09-16T07:34:30.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f987ea00640 1 -- 172.21.15.114:0/1058987984 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+144 (secure 0 0 0) 0x7f98881fb5b0 con 0x7f9864073340 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "status": { 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "pending", 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "source": { 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "volume": "fake", 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "subvolume": "fake", 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: "snapshot": "fake" 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:30.572 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:34:30.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9864073340 msgr2=0x7f9864075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9864073340 0x7f9864075800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9878000c10 tx=0x7f9878009040 comp rx=0 tx=0).stop 2024-09-16T07:34:30.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f988815ade0 msgr2=0x7f988809af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f988815ade0 0x7f988809af50 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f988000cbf0 tx=0x7f988000cce0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 shutdown_connections 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f988815ade0 0x7f988809af50 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9864073340 0x7f9864075800 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98880cf300 0x7f988809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 --2- 172.21.15.114:0/1058987984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f988806e810 0x7f98881f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 >> 172.21.15.114:0/1058987984 conn(0x7f98880b18f0 msgr2=0x7f98880b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 shutdown_connections 2024-09-16T07:34:30.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.573+0000 7f988ce00640 1 -- 172.21.15.114:0/1058987984 wait complete. 2024-09-16T07:34:30.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol33810 fake 2024-09-16T07:34:30.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 -- 172.21.15.114:0/3410581812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2841550d0 msgr2=0x7ff2840cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 --2- 172.21.15.114:0/3410581812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2841550d0 0x7ff2840cb8c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff274009900 tx=0x7ff27401c8b0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 -- 172.21.15.114:0/3410581812 shutdown_connections 2024-09-16T07:34:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 --2- 172.21.15.114:0/3410581812 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff284073ef0 0x7ff2840ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 --2- 172.21.15.114:0/3410581812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2841550d0 0x7ff2840cb8c0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 -- 172.21.15.114:0/3410581812 >> 172.21.15.114:0/3410581812 conn(0x7ff2840d0c70 msgr2=0x7ff2840d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 -- 172.21.15.114:0/3410581812 shutdown_connections 2024-09-16T07:34:30.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 -- 172.21.15.114:0/3410581812 wait complete. 2024-09-16T07:34:30.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 Processor -- start 2024-09-16T07:34:30.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.741+0000 7ff283200640 1 -- start start 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff284073ef0 0x7ff284150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2841550d0 0x7ff284151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff28415bc40 0x7ff284152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff284167b50 con 0x7ff284073ef0 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff2840cfc00 con 0x7ff2841550d0 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff284167cd0 con 0x7ff28415bc40 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff284073ef0 0x7ff284150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff284073ef0 0x7ff284150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60602/0 (socket says 172.21.15.114:60602) 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 -- 172.21.15.114:0/3472742403 learned_addr learned my addr 172.21.15.114:0/3472742403 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:30.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff282800640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff28415bc40 0x7ff284152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff27be00640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2841550d0 0x7ff284151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 -- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff28415bc40 msgr2=0x7ff284152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff28415bc40 0x7ff284152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 -- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2841550d0 msgr2=0x7ff284151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2841550d0 0x7ff284151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 -- 172.21.15.114:0/3472742403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff284160750 con 0x7ff284073ef0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff27be00640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2841550d0 0x7ff284151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff281e00640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff284073ef0 0x7ff284150ed0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff274009850 tx=0x7ff2740a57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff27a000640 1 -- 172.21.15.114:0/3472742403 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740b2040 con 0x7ff284073ef0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff27a000640 1 -- 172.21.15.114:0/3472742403 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff274004400 con 0x7ff284073ef0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2840c7f90 con 0x7ff284073ef0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff27a000640 1 -- 172.21.15.114:0/3472742403 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274005290 con 0x7ff284073ef0 2024-09-16T07:34:30.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2840c8550 con 0x7ff284073ef0 2024-09-16T07:34:30.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2840c7d20 con 0x7ff284073ef0 2024-09-16T07:34:30.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.745+0000 7ff27a000640 1 -- 172.21.15.114:0/3472742403 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7ff274005430 con 0x7ff284073ef0 2024-09-16T07:34:30.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.749+0000 7ff27a000640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff260073340 0x7ff260075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:30.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.749+0000 7ff27a000640 1 -- 172.21.15.114:0/3472742403 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7ff27412e220 con 0x7ff284073ef0 2024-09-16T07:34:30.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.749+0000 7ff27be00640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff260073340 0x7ff260075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:30.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.749+0000 7ff27be00640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff260073340 0x7ff260075800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff2840702e0 tx=0x7ff26c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:30.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.753+0000 7ff27a000640 1 -- 172.21.15.114:0/3472742403 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff2740164d0 con 0x7ff284073ef0 2024-09-16T07:34:30.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.949+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol33810", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7ff28406ae20 con 0x7ff260073340 2024-09-16T07:34:30.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff27a000640 1 -- 172.21.15.114:0/3472742403 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff28406ae20 con 0x7ff260073340 2024-09-16T07:34:30.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff260073340 msgr2=0x7ff260075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff260073340 0x7ff260075800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff2840702e0 tx=0x7ff26c009040 comp rx=0 tx=0).stop 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff284073ef0 msgr2=0x7ff284150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff284073ef0 0x7ff284150ed0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7ff274009850 tx=0x7ff2740a57a0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 shutdown_connections 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff260073340 0x7ff260075800 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff28415bc40 0x7ff284152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2841550d0 0x7ff284151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 --2- 172.21.15.114:0/3472742403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff284073ef0 0x7ff284150ed0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 >> 172.21.15.114:0/3472742403 conn(0x7ff2840d0c70 msgr2=0x7ff28415de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 shutdown_connections 2024-09-16T07:34:30.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:30.997+0000 7ff283200640 1 -- 172.21.15.114:0/3472742403 wait complete. 2024-09-16T07:34:31.016 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol79391 fake subvol_grp52340 2024-09-16T07:34:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- 172.21.15.114:0/4109614617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 msgr2=0x7f58d40ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 --2- 172.21.15.114:0/4109614617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d40ce4e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f58d415f940 tx=0x7f58c401cb80 comp rx=0 tx=0).stop 2024-09-16T07:34:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- 172.21.15.114:0/4109614617 shutdown_connections 2024-09-16T07:34:31.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 --2- 172.21.15.114:0/4109614617 >> v2:172.21.15.149:3300/0 conn(0x7f58d40d28c0 0x7f58d40cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 --2- 172.21.15.114:0/4109614617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d40ce4e0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- 172.21.15.114:0/4109614617 >> 172.21.15.114:0/4109614617 conn(0x7f58d40d1da0 msgr2=0x7f58d40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- 172.21.15.114:0/4109614617 shutdown_connections 2024-09-16T07:34:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- 172.21.15.114:0/4109614617 wait complete. 2024-09-16T07:34:31.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 Processor -- start 2024-09-16T07:34:31.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- start start 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d40b53f0 0x7f58d40cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d40d28c0 0x7f58d406de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4169160 con 0x7f58d415be80 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4168fe0 con 0x7f58d40b53f0 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58db600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f58d41692e0 con 0x7f58d40d28c0 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58d9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58d9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d406e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60618/0 (socket says 172.21.15.114:60618) 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58d9600640 1 -- 172.21.15.114:0/3765143981 learned_addr learned my addr 172.21.15.114:0/3765143981 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:31.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58d8c00640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d40b53f0 0x7f58d40cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.165+0000 7f58d3e00640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d40d28c0 0x7f58d406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d9600640 1 -- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d40d28c0 msgr2=0x7f58d406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d9600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d40d28c0 0x7f58d406de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d9600640 1 -- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d40b53f0 msgr2=0x7f58d40cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d9600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d40b53f0 0x7f58d40cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d9600640 1 -- 172.21.15.114:0/3765143981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d4145be0 con 0x7f58d415be80 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d9600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d406e370 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00c440 tx=0x7f58cc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d0c00640 1 -- 172.21.15.114:0/3765143981 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc016020 con 0x7f58d415be80 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d0c00640 1 -- 172.21.15.114:0/3765143981 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58cc012920 con 0x7f58d415be80 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d0c00640 1 -- 172.21.15.114:0/3765143981 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc012d90 con 0x7f58d415be80 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d4145ec0 con 0x7f58d415be80 2024-09-16T07:34:31.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d40cb9d0 con 0x7f58d415be80 2024-09-16T07:34:31.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d40b57f0 con 0x7f58d415be80 2024-09-16T07:34:31.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.169+0000 7f58d0c00640 1 -- 172.21.15.114:0/3765143981 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7f58cc019020 con 0x7f58d415be80 2024-09-16T07:34:31.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.173+0000 7f58d0c00640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f58b4073340 0x7f58b4075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.173+0000 7f58d0c00640 1 -- 172.21.15.114:0/3765143981 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f58cc094bf0 con 0x7f58d415be80 2024-09-16T07:34:31.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.173+0000 7f58d8c00640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f58b4073340 0x7f58b4075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.173+0000 7f58d8c00640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f58b4073340 0x7f58b4075800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f58c40af000 tx=0x7f58c401b3c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:31.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.173+0000 7f58d0c00640 1 -- 172.21.15.114:0/3765143981 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f58cc020030 con 0x7f58d415be80 2024-09-16T07:34:31.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.369+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol79391", "snap_name": "fake", "group_name": "subvol_grp52340", "target": ["mon-mgr", ""]}) -- 0x7f58d40b6710 con 0x7f58b4073340 2024-09-16T07:34:31.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58d0c00640 1 -- 172.21.15.114:0/3765143981 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f58d40b6710 con 0x7f58b4073340 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f58b4073340 msgr2=0x7f58b4075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f58b4073340 0x7f58b4075800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f58c40af000 tx=0x7f58c401b3c0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 msgr2=0x7f58d406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d406e370 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00c440 tx=0x7f58cc00c900 comp rx=0 tx=0).stop 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 shutdown_connections 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58d415be80 0x7f58d406e370 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f58b4073340 0x7f58b4075800 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58d40d28c0 0x7f58d406de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 --2- 172.21.15.114:0/3765143981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58d40b53f0 0x7f58d40cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 >> 172.21.15.114:0/3765143981 conn(0x7f58d40d1da0 msgr2=0x7f58d4156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 shutdown_connections 2024-09-16T07:34:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.409+0000 7f58db600640 1 -- 172.21.15.114:0/3765143981 wait complete. 2024-09-16T07:34:31.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:31.428 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol33810/.meta) 2024-09-16T07:34:31.450 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:34:31.451 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:34:31.451 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:34:31.451 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol33810/ebaf8ed6-52c6-4280-84bd-bb0bba132c0c 2024-09-16T07:34:31.451 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:34:31.451 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:31.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:31.453 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp52340/subvol79391/.meta) 2024-09-16T07:34:31.518 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:34:31.519 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:34:31.519 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:34:31.519 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/subvol_grp52340/subvol79391/e24a97d4-1615-4fe5-a0b4-2ae73f362a5b 2024-09-16T07:34:31.519 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:34:31.519 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:31.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol33810 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- 172.21.15.114:0/3942459292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0406e7a0 msgr2=0x7fcd040ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 --2- 172.21.15.114:0/3942459292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0406e7a0 0x7fcd040ce2e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009c80 tx=0x7fccfc01cd70 comp rx=0 tx=0).stop 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- 172.21.15.114:0/3942459292 shutdown_connections 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 --2- 172.21.15.114:0/3942459292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd0406e7a0 0x7fcd040ce2e0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 --2- 172.21.15.114:0/3942459292 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd040cf1d0 0x7fcd04160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- 172.21.15.114:0/3942459292 >> 172.21.15.114:0/3942459292 conn(0x7fcd040b18f0 msgr2=0x7fcd040b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- 172.21.15.114:0/3942459292 shutdown_connections 2024-09-16T07:34:31.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- 172.21.15.114:0/3942459292 wait complete. 2024-09-16T07:34:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 Processor -- start 2024-09-16T07:34:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- start start 2024-09-16T07:34:31.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0406e7a0 0x7fcd0413e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd040cf1d0 0x7fcd041553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0415f9a0 0x7fcd04155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd04169200 con 0x7fcd040cf1d0 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd04169080 con 0x7fcd0415f9a0 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd04169380 con 0x7fcd0406e7a0 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd040cf1d0 0x7fcd041553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd040cf1d0 0x7fcd041553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60632/0 (socket says 172.21.15.114:60632) 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 -- 172.21.15.114:0/2707556066 learned_addr learned my addr 172.21.15.114:0/2707556066 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd09800640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0406e7a0 0x7fcd0413e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0a200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0415f9a0 0x7fcd04155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 -- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0406e7a0 msgr2=0x7fcd0413e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0406e7a0 0x7fcd0413e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 -- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0415f9a0 msgr2=0x7fcd04155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0415f9a0 0x7fcd04155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 -- 172.21.15.114:0/2707556066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd041f6dc0 con 0x7fcd040cf1d0 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0a200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0415f9a0 0x7fcd04155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd08e00640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd040cf1d0 0x7fcd041553d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fccf000d980 tx=0x7fccf000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0017070 con 0x7fcd040cf1d0 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccf0009d60 con 0x7fcd040cf1d0 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.709+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd041f6000 con 0x7fcd040cf1d0 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.713+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0005280 con 0x7fcd040cf1d0 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.713+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd041f65c0 con 0x7fcd040cf1d0 2024-09-16T07:34:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.713+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd04069410 con 0x7fcd040cf1d0 2024-09-16T07:34:31.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.713+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 22) ==== 97488+0+0 (secure 0 0 0) 0x7fccf0005420 con 0x7fcd040cf1d0 2024-09-16T07:34:31.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.713+0000 7fcd01600640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcce4073340 0x7fcce4075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:31.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.713+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fccf0094980 con 0x7fcd040cf1d0 2024-09-16T07:34:31.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.713+0000 7fcd09800640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcce4073340 0x7fcce4075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:31.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.717+0000 7fcd09800640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcce4073340 0x7fcce4075800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fccf8001650 tx=0x7fccf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:31.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.717+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fccf005f3c0 con 0x7fcd040cf1d0 2024-09-16T07:34:31.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.745+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 23) ==== 97539+0+0 (secure 0 0 0) 0x7fccf005af30 con 0x7fcd040cf1d0 2024-09-16T07:34:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.913+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol33810", "target": ["mon-mgr", ""]}) -- 0x7fcd040ce2e0 con 0x7fcce4073340 2024-09-16T07:34:31.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd01600640 1 -- 172.21.15.114:0/2707556066 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd040ce2e0 con 0x7fcce4073340 2024-09-16T07:34:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcce4073340 msgr2=0x7fcce4075800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcce4073340 0x7fcce4075800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fccf8001650 tx=0x7fccf8009040 comp rx=0 tx=0).stop 2024-09-16T07:34:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd040cf1d0 msgr2=0x7fcd041553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd040cf1d0 0x7fcd041553d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fccf000d980 tx=0x7fccf000de40 comp rx=0 tx=0).stop 2024-09-16T07:34:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 shutdown_connections 2024-09-16T07:34:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd0415f9a0 0x7fcd04155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd040cf1d0 0x7fcd041553d0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcce4073340 0x7fcce4075800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 --2- 172.21.15.114:0/2707556066 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd0406e7a0 0x7fcd0413e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 >> 172.21.15.114:0/2707556066 conn(0x7fcd040b18f0 msgr2=0x7fcd04166610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 shutdown_connections 2024-09-16T07:34:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:31.953+0000 7fcd0c200640 1 -- 172.21.15.114:0/2707556066 wait complete. 2024-09-16T07:34:31.958 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.957+0000 7f4e16a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.958 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.957+0000 7f4e16a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.958 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.957+0000 7f4e16a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.958 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.957+0000 7f4e16a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.958 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.957+0000 7f4e16a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.974 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.973+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.974 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.973+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.974 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.973+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.975 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.973+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.975 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:31.973+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:34:31.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol79391 subvol_grp52340 2024-09-16T07:34:32.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 -- 172.21.15.114:0/2391336454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ec003c20 msgr2=0x7fa5ec004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 --2- 172.21.15.114:0/2391336454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ec003c20 0x7fa5ec004040 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8006fa0 tx=0x7fa5f801cf00 comp rx=0 tx=0).stop 2024-09-16T07:34:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60d000640 1 -- 172.21.15.114:0/2391336454 reap_dead start 2024-09-16T07:34:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 -- 172.21.15.114:0/2391336454 shutdown_connections 2024-09-16T07:34:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 -- 172.21.15.114:0/2391336454 >> 172.21.15.114:0/2391336454 conn(0x7fa6080cfbc0 msgr2=0x7fa6080cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 -- 172.21.15.114:0/2391336454 shutdown_connections 2024-09-16T07:34:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 -- 172.21.15.114:0/2391336454 wait complete. 2024-09-16T07:34:32.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 Processor -- start 2024-09-16T07:34:32.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.129+0000 7fa60f000640 1 -- start start 2024-09-16T07:34:32.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5ec003c20 0x7fa6081556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa60809d3b0 0x7fa6081f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6081f8e70 0x7fa60806e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa608166f30 con 0x7fa6081f8e70 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa60815f8a0 con 0x7fa60809d3b0 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa6081670b0 con 0x7fa5ec003c20 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6081f8e70 0x7fa60806e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5ec003c20 0x7fa6081556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5ec003c20 0x7fa6081556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:53366/0 (socket says 172.21.15.114:53366) 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa60809d3b0 0x7fa6081f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6081f8e70 0x7fa60806e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60688/0 (socket says 172.21.15.114:60688) 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 -- 172.21.15.114:0/3417123696 learned_addr learned my addr 172.21.15.114:0/3417123696 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 -- 172.21.15.114:0/3417123696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa60809d3b0 msgr2=0x7fa6081f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa60809d3b0 0x7fa6081f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 -- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6081f8e70 msgr2=0x7fa60806e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6081f8e70 0x7fa60806e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 -- 172.21.15.114:0/3417123696 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa608163da0 con 0x7fa5ec003c20 2024-09-16T07:34:32.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa607e00640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5ec003c20 0x7fa6081556b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa5f801b600 tx=0x7fa5f8006c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:32.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa5ffe00640 1 -- 172.21.15.114:0/3417123696 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8006090 con 0x7fa5ec003c20 2024-09-16T07:34:32.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa5ffe00640 1 -- 172.21.15.114:0/3417123696 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5f8006230 con 0x7fa5ec003c20 2024-09-16T07:34:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa608164040 con 0x7fa5ec003c20 2024-09-16T07:34:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa5ffe00640 1 -- 172.21.15.114:0/3417123696 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8003600 con 0x7fa5ec003c20 2024-09-16T07:34:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6081f8410 con 0x7fa5ec003c20 2024-09-16T07:34:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.133+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa608069410 con 0x7fa5ec003c20 2024-09-16T07:34:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.137+0000 7fa5ffe00640 1 -- 172.21.15.114:0/3417123696 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 23) ==== 97539+0+0 (secure 0 0 0) 0x7fa5f80037a0 con 0x7fa5ec003c20 2024-09-16T07:34:32.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.137+0000 7fa5ffe00640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa5e80733d0 0x7fa5e8075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.137+0000 7fa5ffe00640 1 -- 172.21.15.114:0/3417123696 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fa5f812e6c0 con 0x7fa5ec003c20 2024-09-16T07:34:32.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.137+0000 7fa607400640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa5e80733d0 0x7fa5e8075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.137+0000 7fa607400640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa5e80733d0 0x7fa5e8075890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa6080b5eb0 tx=0x7fa5f40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.141+0000 7fa5ffe00640 1 -- 172.21.15.114:0/3417123696 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa5f8016cb0 con 0x7fa5ec003c20 2024-09-16T07:34:32.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.333+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol79391", "group_name": "subvol_grp52340", "target": ["mon-mgr", ""]}) -- 0x7fa6080adf50 con 0x7fa5e80733d0 2024-09-16T07:34:32.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa5ffe00640 1 -- 172.21.15.114:0/3417123696 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa6080adf50 con 0x7fa5e80733d0 2024-09-16T07:34:32.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa5e80733d0 msgr2=0x7fa5e8075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa5e80733d0 0x7fa5e8075890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa6080b5eb0 tx=0x7fa5f40091e0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5ec003c20 msgr2=0x7fa6081556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5ec003c20 0x7fa6081556b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa5f801b600 tx=0x7fa5f8006c50 comp rx=0 tx=0).stop 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 shutdown_connections 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6081f8e70 0x7fa60806e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa60809d3b0 0x7fa6081f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa5e80733d0 0x7fa5e8075890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.373+0000 7fa60f000640 1 --2- 172.21.15.114:0/3417123696 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa5ec003c20 0x7fa6081556b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.377+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 >> 172.21.15.114:0/3417123696 conn(0x7fa6080cfbc0 msgr2=0x7fa6080af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.377+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 shutdown_connections 2024-09-16T07:34:32.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.377+0000 7fa60f000640 1 -- 172.21.15.114:0/3417123696 wait complete. 2024-09-16T07:34:32.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol27232 2024-09-16T07:34:32.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 -- 172.21.15.114:0/2220825800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f615815bd40 msgr2=0x7f61580d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 --2- 172.21.15.114:0/2220825800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f615815bd40 0x7f61580d0240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6148009bf0 tx=0x7f614801cbe0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 -- 172.21.15.114:0/2220825800 shutdown_connections 2024-09-16T07:34:32.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 --2- 172.21.15.114:0/2220825800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f615815bd40 0x7f61580d0240 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 -- 172.21.15.114:0/2220825800 >> 172.21.15.114:0/2220825800 conn(0x7f615809aa10 msgr2=0x7f615809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:32.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 -- 172.21.15.114:0/2220825800 shutdown_connections 2024-09-16T07:34:32.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 -- 172.21.15.114:0/2220825800 wait complete. 2024-09-16T07:34:32.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 Processor -- start 2024-09-16T07:34:32.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.545+0000 7f6157200640 1 -- start start 2024-09-16T07:34:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61580b0d10 0x7f615814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61580d22c0 0x7f615806f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f615815bd40 0x7f6158153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6158169ee0 con 0x7f61580d22c0 2024-09-16T07:34:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6158169d60 con 0x7f615815bd40 2024-09-16T07:34:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f615816a060 con 0x7f61580b0d10 2024-09-16T07:34:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61580d22c0 0x7f615806f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61580d22c0 0x7f615806f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60700/0 (socket says 172.21.15.114:60700) 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 -- 172.21.15.114:0/3466920133 learned_addr learned my addr 172.21.15.114:0/3466920133 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6155e00640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61580b0d10 0x7f615814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6156800640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f615815bd40 0x7f6158153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 -- 172.21.15.114:0/3466920133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61580b0d10 msgr2=0x7f615814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f61580b0d10 0x7f615814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 -- 172.21.15.114:0/3466920133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f615815bd40 msgr2=0x7f6158153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f615815bd40 0x7f6158153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 -- 172.21.15.114:0/3466920133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615806e580 con 0x7f61580d22c0 2024-09-16T07:34:32.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614d400640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61580d22c0 0x7f615806f620 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f614000c4b0 tx=0x7f614000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:32.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614ea00640 1 -- 172.21.15.114:0/3466920133 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400052d0 con 0x7f61580d22c0 2024-09-16T07:34:32.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614ea00640 1 -- 172.21.15.114:0/3466920133 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6140005470 con 0x7f61580d22c0 2024-09-16T07:34:32.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 -- 172.21.15.114:0/3466920133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615806e860 con 0x7f61580d22c0 2024-09-16T07:34:32.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614ea00640 1 -- 172.21.15.114:0/3466920133 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6140012870 con 0x7f61580d22c0 2024-09-16T07:34:32.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 -- 172.21.15.114:0/3466920133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615806f100 con 0x7f61580d22c0 2024-09-16T07:34:32.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f6157200640 1 -- 172.21.15.114:0/3466920133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615806ec50 con 0x7f61580d22c0 2024-09-16T07:34:32.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.549+0000 7f614ea00640 1 -- 172.21.15.114:0/3466920133 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) ==== 97539+0+0 (secure 0 0 0) 0x7f6140003600 con 0x7f61580d22c0 2024-09-16T07:34:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.553+0000 7f614ea00640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6134073400 0x7f61340758c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.553+0000 7f614ea00640 1 -- 172.21.15.114:0/3466920133 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f6140094230 con 0x7f61580d22c0 2024-09-16T07:34:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.553+0000 7f6155e00640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6134073400 0x7f61340758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.553+0000 7f6155e00640 1 --2- 172.21.15.114:0/3466920133 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6134073400 0x7f61340758c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f61480af000 tx=0x7f614801b420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:32.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.557+0000 7f614ea00640 1 -- 172.21.15.114:0/3466920133 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f614005e550 con 0x7f61580d22c0 2024-09-16T07:34:32.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.749+0000 7f6157200640 1 -- 172.21.15.114:0/3466920133 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol27232", "target": ["mon-mgr", ""]}) -- 0x7f6158069e30 con 0x7f6134073400 2024-09-16T07:34:32.764 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:34:32.765+0000 7f4e12e00640 -1 mgr.server reply reply (11) Resource temporarily unavailable subvolume 'subvol27232' is not ready for operation rm (use --force to override) 2024-09-16T07:34:32.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.765+0000 7f614ea00640 1 -- 172.21.15.114:0/3466920133 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -11 subvolume 'subvol27232' is not ready for operation rm (use --force to override)) ==== 87+0+0 (secure 0 0 0) 0x7f61480a5930 con 0x7f6134073400 2024-09-16T07:34:32.764 INFO:teuthology.orchestra.run.smithi114.stderr:Error EAGAIN: subvolume 'subvol27232' is not ready for operation rm (use --force to override) 2024-09-16T07:34:32.773 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-09-16T07:34:32.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:32.774 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol27232/.meta) 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:type = clone 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol27232/9dc871ee-4557-48cd-b9b5-9d683de518d5 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:state = pending 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:[source] 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:volume = fake 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:subvolume = fake 2024-09-16T07:34:32.796 INFO:teuthology.orchestra.run.smithi114.stdout:snapshot = fake 2024-09-16T07:34:32.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol27232 --force 2024-09-16T07:34:32.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 -- 172.21.15.114:0/1085562305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b40b0b60 msgr2=0x7fc8b40ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/1085562305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b40b0b60 0x7fc8b40ccbd0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009c80 tx=0x7fc8ac01f5a0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 -- 172.21.15.114:0/1085562305 shutdown_connections 2024-09-16T07:34:32.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/1085562305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b40b0b60 0x7fc8b40ccbd0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/1085562305 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8b415c1f0 0x7fc8b40cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 -- 172.21.15.114:0/1085562305 >> 172.21.15.114:0/1085562305 conn(0x7fc8b40d1da0 msgr2=0x7fc8b40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:32.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 -- 172.21.15.114:0/1085562305 shutdown_connections 2024-09-16T07:34:32.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 -- 172.21.15.114:0/1085562305 wait complete. 2024-09-16T07:34:32.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 Processor -- start 2024-09-16T07:34:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.989+0000 7fc8b9c00640 1 -- start start 2024-09-16T07:34:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8b40b0b60 0x7fc8b40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8b415be10 0x7fc8b40c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b415c1f0 0x7fc8b40c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40cd4a0 con 0x7fc8b415c1f0 2024-09-16T07:34:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40cd320 con 0x7fc8b40b0b60 2024-09-16T07:34:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b40cd620 con 0x7fc8b415be10 2024-09-16T07:34:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b415c1f0 0x7fc8b40c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b415c1f0 0x7fc8b40c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60724/0 (socket says 172.21.15.114:60724) 2024-09-16T07:34:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 -- 172.21.15.114:0/2594379684 learned_addr learned my addr 172.21.15.114:0/2594379684 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8aa000640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8b415be10 0x7fc8b40c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b2a00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8b40b0b60 0x7fc8b40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 -- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8b415be10 msgr2=0x7fc8b40c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8b415be10 0x7fc8b40c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 -- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8b40b0b60 msgr2=0x7fc8b40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8b40b0b60 0x7fc8b40b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 -- 172.21.15.114:0/2594379684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b40b7040 con 0x7fc8b415c1f0 2024-09-16T07:34:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b2a00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8b40b0b60 0x7fc8b40b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b3400640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b415c1f0 0x7fc8b40c8160 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009bd0 tx=0x7fc8ac0af410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8ab400640 1 -- 172.21.15.114:0/2594379684 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac004e60 con 0x7fc8b415c1f0 2024-09-16T07:34:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8ab400640 1 -- 172.21.15.114:0/2594379684 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8ac0be030 con 0x7fc8b415c1f0 2024-09-16T07:34:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8ab400640 1 -- 172.21.15.114:0/2594379684 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0afae0 con 0x7fc8b415c1f0 2024-09-16T07:34:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b40b72e0 con 0x7fc8b415c1f0 2024-09-16T07:34:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b40ca240 con 0x7fc8b415c1f0 2024-09-16T07:34:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b40cdb10 con 0x7fc8b415c1f0 2024-09-16T07:34:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.993+0000 7fc8ab400640 1 -- 172.21.15.114:0/2594379684 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) ==== 97539+0+0 (secure 0 0 0) 0x7fc8ac0afc80 con 0x7fc8b415c1f0 2024-09-16T07:34:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.997+0000 7fc8ab400640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8900733d0 0x7fc890075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.997+0000 7fc8ab400640 1 -- 172.21.15.114:0/2594379684 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fc8ac1331f0 con 0x7fc8b415c1f0 2024-09-16T07:34:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.997+0000 7fc8b2a00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8900733d0 0x7fc890075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:32.997+0000 7fc8b2a00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8900733d0 0x7fc890075890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4001750 tx=0x7fc8a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.001+0000 7fc8ab400640 1 -- 172.21.15.114:0/2594379684 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc8ac0ac050 con 0x7fc8b415c1f0 2024-09-16T07:34:33.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.193+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol27232", "force": true, "target": ["mon-mgr", ""]}) -- 0x7fc8b40af690 con 0x7fc8900733d0 2024-09-16T07:34:33.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.213+0000 7fc8ab400640 1 -- 172.21.15.114:0/2594379684 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc8b40af690 con 0x7fc8900733d0 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8900733d0 msgr2=0x7fc890075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8900733d0 0x7fc890075890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4001750 tx=0x7fc8a4009040 comp rx=0 tx=0).stop 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b415c1f0 msgr2=0x7fc8b40c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b415c1f0 0x7fc8b40c8160 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009bd0 tx=0x7fc8ac0af410 comp rx=0 tx=0).stop 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 shutdown_connections 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8b415c1f0 0x7fc8b40c8160 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc8900733d0 0x7fc890075890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc8b415be10 0x7fc8b40c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 --2- 172.21.15.114:0/2594379684 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8b40b0b60 0x7fc8b40b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 >> 172.21.15.114:0/2594379684 conn(0x7fc8b40d1da0 msgr2=0x7fc8b415faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 shutdown_connections 2024-09-16T07:34:33.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.217+0000 7fc8b9c00640 1 -- 172.21.15.114:0/2594379684 wait complete. 2024-09-16T07:34:33.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-16T07:34:33.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 -- 172.21.15.114:0/330406972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 msgr2=0x7f6ef00b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:33.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 --2- 172.21.15.114:0/330406972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef00b15e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0074570 tx=0x7f6ee001f580 comp rx=0 tx=0).stop 2024-09-16T07:34:33.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 -- 172.21.15.114:0/330406972 shutdown_connections 2024-09-16T07:34:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 --2- 172.21.15.114:0/330406972 >> v2:172.21.15.149:3300/0 conn(0x7f6ef00d04d0 0x7f6ef00b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 --2- 172.21.15.114:0/330406972 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef00d29b0 0x7f6ef00b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 --2- 172.21.15.114:0/330406972 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef00b15e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 -- 172.21.15.114:0/330406972 >> 172.21.15.114:0/330406972 conn(0x7f6ef00d1e90 msgr2=0x7f6ef00d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 -- 172.21.15.114:0/330406972 shutdown_connections 2024-09-16T07:34:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.385+0000 7f6ef7200640 1 -- 172.21.15.114:0/330406972 wait complete. 2024-09-16T07:34:33.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 Processor -- start 2024-09-16T07:34:33.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 -- start start 2024-09-16T07:34:33.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef015d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:33.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef00d04d0 0x7f6ef01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:33.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef00d29b0 0x7f6ef00c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef015ff60 con 0x7f6ef00d00f0 2024-09-16T07:34:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef015fde0 con 0x7f6ef00d04d0 2024-09-16T07:34:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef01600e0 con 0x7f6ef00d29b0 2024-09-16T07:34:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef015d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60740/0 (socket says 172.21.15.114:60740) 2024-09-16T07:34:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 -- 172.21.15.114:0/2099148314 learned_addr learned my addr 172.21.15.114:0/2099148314 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef5200640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef00d29b0 0x7f6ef00c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ee7400640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef00d04d0 0x7f6ef01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 -- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef00d29b0 msgr2=0x7f6ef00c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef00d29b0 0x7f6ef00c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 -- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef00d04d0 msgr2=0x7f6ef01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef00d04d0 0x7f6ef01524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 -- 172.21.15.114:0/2099148314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef015efc0 con 0x7f6ef00d00f0 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eefe00640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef015d150 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000f90 tx=0x7f6ee00092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eecc00640 1 -- 172.21.15.114:0/2099148314 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00bf070 con 0x7f6ef00d00f0 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eecc00640 1 -- 172.21.15.114:0/2099148314 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ee0004c00 con 0x7f6ef00d00f0 2024-09-16T07:34:33.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef015f2a0 con 0x7f6ef00d00f0 2024-09-16T07:34:33.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6eecc00640 1 -- 172.21.15.114:0/2099148314 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00b5040 con 0x7f6ef00d00f0 2024-09-16T07:34:33.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef00cd5b0 con 0x7f6ef00d00f0 2024-09-16T07:34:33.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.389+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef01605e0 con 0x7f6ef00d00f0 2024-09-16T07:34:33.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.393+0000 7f6eecc00640 1 -- 172.21.15.114:0/2099148314 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) ==== 97539+0+0 (secure 0 0 0) 0x7f6ee00c2070 con 0x7f6ef00d00f0 2024-09-16T07:34:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.393+0000 7f6eecc00640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ecc0733d0 0x7f6ecc075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.393+0000 7f6eecc00640 1 -- 172.21.15.114:0/2099148314 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7f6ee01319f0 con 0x7f6ef00d00f0 2024-09-16T07:34:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.393+0000 7f6ee7400640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ecc0733d0 0x7f6ecc075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.393+0000 7f6ee7400640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ecc0733d0 0x7f6ecc075890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ef015c470 tx=0x7f6ed80091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:33.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.397+0000 7f6eecc00640 1 -- 172.21.15.114:0/2099148314 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6ee00190e0 con 0x7f6ef00d00f0 2024-09-16T07:34:33.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.589+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7f6ef015d860 con 0x7f6ecc0733d0 2024-09-16T07:34:33.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6eecc00640 1 -- 172.21.15.114:0/2099148314 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f6ef015d860 con 0x7f6ecc0733d0 2024-09-16T07:34:33.592 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-09-16T07:34:33.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ecc0733d0 msgr2=0x7f6ecc075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ecc0733d0 0x7f6ecc075890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ef015c470 tx=0x7f6ed80091e0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 msgr2=0x7f6ef015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef015d150 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0000f90 tx=0x7f6ee00092c0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 shutdown_connections 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ecc0733d0 0x7f6ecc075890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef00d29b0 0x7f6ef00c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef00d04d0 0x7f6ef01524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 --2- 172.21.15.114:0/2099148314 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef00d00f0 0x7f6ef015d150 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.593+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 >> 172.21.15.114:0/2099148314 conn(0x7f6ef00d1e90 msgr2=0x7f6ef00b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.597+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 shutdown_connections 2024-09-16T07:34:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33.597+0000 7f6ef7200640 1 -- 172.21.15.114:0/2099148314 wait complete. 2024-09-16T07:34:33.614 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T07:34:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:34:33.666 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-09-16T07:34:33.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:34:33.673 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:34:33.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:34:33.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:34:33.873 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:34:33.874 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:34:33.874 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:33.874 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:33.882 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:33.882 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:33.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:34:34.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- 172.21.15.114:0/12086270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 msgr2=0x7f70440cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 --2- 172.21.15.114:0/12086270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70440cebb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f70440745d0 tx=0x7f703001c830 comp rx=0 tx=0).stop 2024-09-16T07:34:34.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- 172.21.15.114:0/12086270 shutdown_connections 2024-09-16T07:34:34.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 --2- 172.21.15.114:0/12086270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70440cebb0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 --2- 172.21.15.114:0/12086270 >> v2:172.21.15.149:3300/0 conn(0x7f704415bea0 0x7f70440ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- 172.21.15.114:0/12086270 >> 172.21.15.114:0/12086270 conn(0x7f70440d1dc0 msgr2=0x7f70440d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:34.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- 172.21.15.114:0/12086270 shutdown_connections 2024-09-16T07:34:34.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- 172.21.15.114:0/12086270 wait complete. 2024-09-16T07:34:34.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 Processor -- start 2024-09-16T07:34:34.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- start start 2024-09-16T07:34:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70441566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70440d28e0 0x7f70440b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f704415bea0 0x7f70440b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7044168fc0 con 0x7f70440cdb30 2024-09-16T07:34:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7044168e40 con 0x7f704415bea0 2024-09-16T07:34:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7044169140 con 0x7f70440d28e0 2024-09-16T07:34:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70441566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70441566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60766/0 (socket says 172.21.15.114:60766) 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 -- 172.21.15.114:0/819121015 learned_addr learned my addr 172.21.15.114:0/819121015 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7048e00640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70440d28e0 0x7f70440b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f704a200640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f704415bea0 0x7f70440b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 -- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70440d28e0 msgr2=0x7f70440b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70440d28e0 0x7f70440b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 -- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f704415bea0 msgr2=0x7f70440b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f704415bea0 0x7f70440b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.129+0000 7f7049800640 1 -- 172.21.15.114:0/819121015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70440ccbe0 con 0x7f70440cdb30 2024-09-16T07:34:34.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7049800640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70441566b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f703800e7a0 tx=0x7f703800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:34.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7041600640 1 -- 172.21.15.114:0/819121015 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703800ccc0 con 0x7f70440cdb30 2024-09-16T07:34:34.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7041600640 1 -- 172.21.15.114:0/819121015 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7038010430 con 0x7f70440cdb30 2024-09-16T07:34:34.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704406dd70 con 0x7f70440cdb30 2024-09-16T07:34:34.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7041600640 1 -- 172.21.15.114:0/819121015 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038010860 con 0x7f70440cdb30 2024-09-16T07:34:34.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f704406e610 con 0x7f70440cdb30 2024-09-16T07:34:34.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70440cc9d0 con 0x7f70440cdb30 2024-09-16T07:34:34.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7041600640 1 -- 172.21.15.114:0/819121015 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f7038010a00 con 0x7f70440cdb30 2024-09-16T07:34:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7041600640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70240734f0 0x7f70240759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7041600640 1 -- 172.21.15.114:0/819121015 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7f7038095450 con 0x7f70440cdb30 2024-09-16T07:34:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.133+0000 7f7048e00640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70240734f0 0x7f70240759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.137+0000 7f7048e00640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70240734f0 0x7f70240759b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70300af000 tx=0x7f703001b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:34.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.137+0000 7f7041600640 1 -- 172.21.15.114:0/819121015 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f703805f590 con 0x7f70440cdb30 2024-09-16T07:34:34.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.317+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7044156bf0 con 0x7f70440cdb30 2024-09-16T07:34:34.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.317+0000 7f7041600640 1 -- 172.21.15.114:0/819121015 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7f7038063fc0 con 0x7f70440cdb30 2024-09-16T07:34:34.317 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:34:34.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70240734f0 msgr2=0x7f70240759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70240734f0 0x7f70240759b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f70300af000 tx=0x7f703001b070 comp rx=0 tx=0).stop 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 msgr2=0x7f70441566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70441566b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f703800e7a0 tx=0x7f703800ec60 comp rx=0 tx=0).stop 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 shutdown_connections 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f704415bea0 0x7f70440b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70240734f0 0x7f70240759b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70440d28e0 0x7f70440b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 --2- 172.21.15.114:0/819121015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70440cdb30 0x7f70441566b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 >> 172.21.15.114:0/819121015 conn(0x7f70440d1dc0 msgr2=0x7f70440b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 shutdown_connections 2024-09-16T07:34:34.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.321+0000 7f704c200640 1 -- 172.21.15.114:0/819121015 wait complete. 2024-09-16T07:34:34.340 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:34:34.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:34.340 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:34:34.393 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:34:34.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:34.394 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:34:34.412 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:34:34.413 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:34.413 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:34.423 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:34.423 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:34.475 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:34:34.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 -- 172.21.15.114:0/3288885014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 msgr2=0x7f4dc00cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 --2- 172.21.15.114:0/3288885014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00cb360 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0074f50 tx=0x7f4dac01c8a0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 -- 172.21.15.114:0/3288885014 shutdown_connections 2024-09-16T07:34:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 --2- 172.21.15.114:0/3288885014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00cb360 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 --2- 172.21.15.114:0/3288885014 >> v2:172.21.15.149:3300/0 conn(0x7f4dc0155080 0x7f4dc00cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 -- 172.21.15.114:0/3288885014 >> 172.21.15.114:0/3288885014 conn(0x7f4dc006dd30 msgr2=0x7f4dc006e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 -- 172.21.15.114:0/3288885014 shutdown_connections 2024-09-16T07:34:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.617+0000 7f4dbf200640 1 -- 172.21.15.114:0/3288885014 wait complete. 2024-09-16T07:34:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 Processor -- start 2024-09-16T07:34:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 -- start start 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc00cb8a0 0x7f4dc00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dc0155080 0x7f4dc0153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0167cf0 con 0x7f4dc00cda50 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0167b70 con 0x7f4dc00cb8a0 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc0167e70 con 0x7f4dc0155080 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00b65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58274/0 (socket says 172.21.15.114:58274) 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 -- 172.21.15.114:0/1381830741 learned_addr learned my addr 172.21.15.114:0/1381830741 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbde00640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc00cb8a0 0x7f4dc00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbe800640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dc0155080 0x7f4dc0153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 -- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dc0155080 msgr2=0x7f4dc0153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dc0155080 0x7f4dc0153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 -- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc00cb8a0 msgr2=0x7f4dc00b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc00cb8a0 0x7f4dc00b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 -- 172.21.15.114:0/1381830741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc00c46d0 con 0x7f4dc00cda50 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbde00640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc00cb8a0 0x7f4dc00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbd400640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00b65f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0194b0 tx=0x7f4dac005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4db6000640 1 -- 172.21.15.114:0/1381830741 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0bb070 con 0x7f4dc00cda50 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4db6000640 1 -- 172.21.15.114:0/1381830741 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dac0043f0 con 0x7f4dc00cda50 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4db6000640 1 -- 172.21.15.114:0/1381830741 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0b2040 con 0x7f4dc00cda50 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc0154460 con 0x7f4dc00cda50 2024-09-16T07:34:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc00c4940 con 0x7f4dc00cda50 2024-09-16T07:34:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.621+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc00c4b10 con 0x7f4dc00cda50 2024-09-16T07:34:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.625+0000 7f4db6000640 1 -- 172.21.15.114:0/1381830741 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f4dac0be070 con 0x7f4dc00cda50 2024-09-16T07:34:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.625+0000 7f4db6000640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4da00734f0 0x7f4da00759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.625+0000 7f4db6000640 1 -- 172.21.15.114:0/1381830741 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7f4dac12dff0 con 0x7f4dc00cda50 2024-09-16T07:34:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.625+0000 7f4dbde00640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4da00734f0 0x7f4da00759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.625+0000 7f4dbde00640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4da00734f0 0x7f4da00759b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4db0010420 tx=0x7f4db0009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.629+0000 7f4db6000640 1 -- 172.21.15.114:0/1381830741 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4dac016490 con 0x7f4dc00cda50 2024-09-16T07:34:34.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.809+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4dc00cb360 con 0x7f4dc00cda50 2024-09-16T07:34:34.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.809+0000 7f4db6000640 1 -- 172.21.15.114:0/1381830741 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7f4dac0f8780 con 0x7f4dc00cda50 2024-09-16T07:34:34.810 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:34:34.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4da00734f0 msgr2=0x7f4da00759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4da00734f0 0x7f4da00759b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4db0010420 tx=0x7f4db0009500 comp rx=0 tx=0).stop 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 msgr2=0x7f4dc00b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00b65f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0194b0 tx=0x7f4dac005e10 comp rx=0 tx=0).stop 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 shutdown_connections 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4da00734f0 0x7f4da00759b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4dc0155080 0x7f4dc0153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc00cda50 0x7f4dc00b65f0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 --2- 172.21.15.114:0/1381830741 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4dc00cb8a0 0x7f4dc00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 >> 172.21.15.114:0/1381830741 conn(0x7f4dc006dd30 msgr2=0x7f4dc0154770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 shutdown_connections 2024-09-16T07:34:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:34.813+0000 7f4dbf200640 1 -- 172.21.15.114:0/1381830741 wait complete. 2024-09-16T07:34:34.832 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:34:34.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:34.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:34:34.859 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:34:34.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:34:34.860 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:34:34.911 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:34:34.911 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:34.911 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:34.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:34:34.920 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:34:34.920 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:34.920 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:34.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:34:34.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:35.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- 172.21.15.114:0/910212404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00cd100 msgr2=0x7f9fe00b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/910212404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00cd100 0x7f9fe00b4340 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009900 tx=0x7f9fc801c7f0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- 172.21.15.114:0/910212404 shutdown_connections 2024-09-16T07:34:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/910212404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00cd100 0x7f9fe00b4340 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/910212404 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fe015db50 0x7f9fe00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- 172.21.15.114:0/910212404 >> 172.21.15.114:0/910212404 conn(0x7f9fe00b18f0 msgr2=0x7f9fe00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- 172.21.15.114:0/910212404 shutdown_connections 2024-09-16T07:34:35.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- 172.21.15.114:0/910212404 wait complete. 2024-09-16T07:34:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 Processor -- start 2024-09-16T07:34:35.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- start start 2024-09-16T07:34:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b4880 0x7f9fe014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fe00cd100 0x7f9fe0163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fe015db50 0x7f9fe015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0167120 con 0x7f9fe00b4880 2024-09-16T07:34:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00ccd20 con 0x7f9fe00cd100 2024-09-16T07:34:35.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe7c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe01672a0 con 0x7f9fe015db50 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b4880 0x7f9fe014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b4880 0x7f9fe014d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58304/0 (socket says 172.21.15.114:58304) 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe5200640 1 -- 172.21.15.114:0/587407856 learned_addr learned my addr 172.21.15.114:0/587407856 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fd7e00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fe00cd100 0x7f9fe0163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.109+0000 7f9fe5c00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fe015db50 0x7f9fe015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe5200640 1 -- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fe015db50 msgr2=0x7f9fe015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe5200640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fe015db50 0x7f9fe015b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe5200640 1 -- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fe00cd100 msgr2=0x7f9fe0163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe5200640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fe00cd100 0x7f9fe0163da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe5200640 1 -- 172.21.15.114:0/587407856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe01642e0 con 0x7f9fe00b4880 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe5200640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b4880 0x7f9fe014d7c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c9f0 tx=0x7f9fd000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:35.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fdd600640 1 -- 172.21.15.114:0/587407856 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007bb0 con 0x7f9fe00b4880 2024-09-16T07:34:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fdd600640 1 -- 172.21.15.114:0/587407856 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fd0007e40 con 0x7f9fe00b4880 2024-09-16T07:34:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fdd600640 1 -- 172.21.15.114:0/587407856 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000f690 con 0x7f9fe00b4880 2024-09-16T07:34:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe0163460 con 0x7f9fe00b4880 2024-09-16T07:34:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe0162980 con 0x7f9fe00b4880 2024-09-16T07:34:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe0069410 con 0x7f9fe00b4880 2024-09-16T07:34:35.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fdd600640 1 -- 172.21.15.114:0/587407856 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f9fd000f830 con 0x7f9fe00b4880 2024-09-16T07:34:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.113+0000 7f9fdd600640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fbc073520 0x7f9fbc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.117+0000 7f9fdd600640 1 -- 172.21.15.114:0/587407856 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7f9fd0095170 con 0x7f9fe00b4880 2024-09-16T07:34:35.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.117+0000 7f9fd7e00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fbc073520 0x7f9fbc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.117+0000 7f9fd7e00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fbc073520 0x7f9fbc0759e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ae000 tx=0x7f9fc801b090 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:35.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.121+0000 7f9fdd600640 1 -- 172.21.15.114:0/587407856 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9fe01642e0 con 0x7f9fe00b4880 2024-09-16T07:34:35.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fe00b4340 con 0x7f9fe00b4880 2024-09-16T07:34:35.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fdd600640 1 -- 172.21.15.114:0/587407856 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5231 (secure 0 0 0) 0x7f9fd0014030 con 0x7f9fe00b4880 2024-09-16T07:34:35.320 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:35.320 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":84,"btime":"2024-09-16T07:34:27:714829+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/229459534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":229459534},{"type":"v1","addr":"172.21.15.149:6801","nonce":229459534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2285177306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2285177306},{"type":"v1","addr":"172.21.15.149:6835","nonce":2285177306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/146376277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":146376277},{"type":"v1","addr":"172.21.15.114:6833","nonce":146376277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:13.032352+0000","modified":"2024-09-16T07:34:16.048792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7467":{"gid":7467,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1571071623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1571071623},{"type":"v1","addr":"172.21.15.114:6835","nonce":1571071623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7467,"qdb_cluster":[7467]},"id":9}]} 2024-09-16T07:34:35.320 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 84 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fbc073520 msgr2=0x7f9fbc0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fbc073520 0x7f9fbc0759e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ae000 tx=0x7f9fc801b090 comp rx=0 tx=0).stop 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b4880 msgr2=0x7f9fe014d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b4880 0x7f9fe014d7c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c9f0 tx=0x7f9fd000ceb0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 shutdown_connections 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9fbc073520 0x7f9fbc0759e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9fe015db50 0x7f9fe015b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9fe00cd100 0x7f9fe0163da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 --2- 172.21.15.114:0/587407856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fe00b4880 0x7f9fe014d7c0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 >> 172.21.15.114:0/587407856 conn(0x7f9fe00b18f0 msgr2=0x7f9fe015a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:35.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 shutdown_connections 2024-09-16T07:34:35.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.321+0000 7f9fe7c00640 1 -- 172.21.15.114:0/587407856 wait complete. 2024-09-16T07:34:35.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.481+0000 7fa552800640 1 -- 172.21.15.114:0/447615292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c15bea0 msgr2=0x7fa54c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.481+0000 7fa552800640 1 --2- 172.21.15.114:0/447615292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c15bea0 0x7fa54c0ce670 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009840 tx=0x7fa53c01c790 comp rx=0 tx=0).stop 2024-09-16T07:34:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.481+0000 7fa552800640 1 -- 172.21.15.114:0/447615292 shutdown_connections 2024-09-16T07:34:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.481+0000 7fa552800640 1 --2- 172.21.15.114:0/447615292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c15bea0 0x7fa54c0ce670 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.481+0000 7fa552800640 1 -- 172.21.15.114:0/447615292 >> 172.21.15.114:0/447615292 conn(0x7fa54c0d1dc0 msgr2=0x7fa54c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.481+0000 7fa552800640 1 -- 172.21.15.114:0/447615292 shutdown_connections 2024-09-16T07:34:35.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.481+0000 7fa552800640 1 -- 172.21.15.114:0/447615292 wait complete. 2024-09-16T07:34:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 Processor -- start 2024-09-16T07:34:35.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 -- start start 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa54c0cdb30 0x7fa54c151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c0d28e0 0x7fa54c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa54c15bea0 0x7fa54c06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c16a930 con 0x7fa54c0d28e0 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa54c16a7b0 con 0x7fa54c15bea0 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa54c16aab0 con 0x7fa54c0cdb30 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c0d28e0 0x7fa54c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c0d28e0 0x7fa54c15e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58326/0 (socket says 172.21.15.114:58326) 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 -- 172.21.15.114:0/1330205788 learned_addr learned my addr 172.21.15.114:0/1330205788 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa54b400640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa54c0cdb30 0x7fa54c151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa54be00640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa54c15bea0 0x7fa54c06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 -- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa54c0cdb30 msgr2=0x7fa54c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa54c0cdb30 0x7fa54c151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 -- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa54c15bea0 msgr2=0x7fa54c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa54c15bea0 0x7fa54c06ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 -- 172.21.15.114:0/1330205788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c0b5c00 con 0x7fa54c0d28e0 2024-09-16T07:34:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa542a00640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c0d28e0 0x7fa54c15e340 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c480 tx=0x7fa53400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa543e00640 1 -- 172.21.15.114:0/1330205788 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534012830 con 0x7fa54c0d28e0 2024-09-16T07:34:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa543e00640 1 -- 172.21.15.114:0/1330205788 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa534017070 con 0x7fa54c0d28e0 2024-09-16T07:34:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa543e00640 1 -- 172.21.15.114:0/1330205788 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534012d80 con 0x7fa54c0d28e0 2024-09-16T07:34:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54c06df10 con 0x7fa54c0d28e0 2024-09-16T07:34:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.485+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54c06e4d0 con 0x7fa54c0d28e0 2024-09-16T07:34:35.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.489+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa54c0ce670 con 0x7fa54c0d28e0 2024-09-16T07:34:35.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.489+0000 7fa543e00640 1 -- 172.21.15.114:0/1330205788 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fa53401c460 con 0x7fa54c0d28e0 2024-09-16T07:34:35.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.489+0000 7fa543e00640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa528073520 0x7fa5280759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.489+0000 7fa543e00640 1 -- 172.21.15.114:0/1330205788 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7fa534094670 con 0x7fa54c0d28e0 2024-09-16T07:34:35.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.489+0000 7fa54b400640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa528073520 0x7fa5280759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.489+0000 7fa54b400640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa528073520 0x7fa5280759e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0ae000 tx=0x7fa53c01afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:35.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.493+0000 7fa543e00640 1 -- 172.21.15.114:0/1330205788 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa53405e940 con 0x7fa54c0d28e0 2024-09-16T07:34:35.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.697+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa54c0b6df0 con 0x7fa54c0d28e0 2024-09-16T07:34:35.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.697+0000 7fa543e00640 1 -- 172.21.15.114:0/1330205788 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5231 (secure 0 0 0) 0x7fa534063370 con 0x7fa54c0d28e0 2024-09-16T07:34:35.697 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:35.698 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":84,"btime":"2024-09-16T07:34:27:714829+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/229459534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":229459534},{"type":"v1","addr":"172.21.15.149:6801","nonce":229459534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2285177306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2285177306},{"type":"v1","addr":"172.21.15.149:6835","nonce":2285177306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/146376277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":146376277},{"type":"v1","addr":"172.21.15.114:6833","nonce":146376277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:13.032352+0000","modified":"2024-09-16T07:34:16.048792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7467":{"gid":7467,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1571071623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1571071623},{"type":"v1","addr":"172.21.15.114:6835","nonce":1571071623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7467,"qdb_cluster":[7467]},"id":9}]} 2024-09-16T07:34:35.698 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 84 2024-09-16T07:34:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa528073520 msgr2=0x7fa5280759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa528073520 0x7fa5280759e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0ae000 tx=0x7fa53c01afd0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c0d28e0 msgr2=0x7fa54c15e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c0d28e0 0x7fa54c15e340 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c480 tx=0x7fa53400c940 comp rx=0 tx=0).stop 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 shutdown_connections 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa54c15bea0 0x7fa54c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa54c0d28e0 0x7fa54c15e340 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa528073520 0x7fa5280759e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 --2- 172.21.15.114:0/1330205788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa54c0cdb30 0x7fa54c151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 >> 172.21.15.114:0/1330205788 conn(0x7fa54c0d1dc0 msgr2=0x7fa54c0b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 shutdown_connections 2024-09-16T07:34:35.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.701+0000 7fa552800640 1 -- 172.21.15.114:0/1330205788 wait complete. 2024-09-16T07:34:35.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:35.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.861+0000 7f7ebae00640 1 -- 172.21.15.114:0/849696342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb40d17b0 msgr2=0x7f7eb40ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.861+0000 7f7ebae00640 1 --2- 172.21.15.114:0/849696342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb40d17b0 0x7f7eb40ccf90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40b3790 tx=0x7f7e9c01c830 comp rx=0 tx=0).stop 2024-09-16T07:34:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.861+0000 7f7ebae00640 1 -- 172.21.15.114:0/849696342 shutdown_connections 2024-09-16T07:34:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.861+0000 7f7ebae00640 1 --2- 172.21.15.114:0/849696342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb40d17b0 0x7f7eb40ccf90 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.861+0000 7f7ebae00640 1 --2- 172.21.15.114:0/849696342 >> v2:172.21.15.149:3300/0 conn(0x7f7eb415be80 0x7f7eb40cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.861+0000 7f7ebae00640 1 -- 172.21.15.114:0/849696342 >> 172.21.15.114:0/849696342 conn(0x7f7eb40d0c90 msgr2=0x7f7eb40d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 -- 172.21.15.114:0/849696342 shutdown_connections 2024-09-16T07:34:35.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 -- 172.21.15.114:0/849696342 wait complete. 2024-09-16T07:34:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 Processor -- start 2024-09-16T07:34:35.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 -- start start 2024-09-16T07:34:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7eb40b3ae0 0x7f7eb4150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7eb40d17b0 0x7f7eb415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb415be80 0x7f7eb415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb4169150 con 0x7f7eb415be80 2024-09-16T07:34:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb4168fd0 con 0x7f7eb40b3ae0 2024-09-16T07:34:35.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7ebae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb41692d0 con 0x7f7eb40d17b0 2024-09-16T07:34:35.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb415be80 0x7f7eb415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb415be80 0x7f7eb415ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58338/0 (socket says 172.21.15.114:58338) 2024-09-16T07:34:35.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 -- 172.21.15.114:0/3241080736 learned_addr learned my addr 172.21.15.114:0/3241080736 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 -- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7eb40d17b0 msgr2=0x7f7eb415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eab400640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7eb40d17b0 0x7f7eb415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb3e00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7eb40b3ae0 0x7f7eb4150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7eb40d17b0 0x7f7eb415a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 -- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7eb40b3ae0 msgr2=0x7f7eb4150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7eb40b3ae0 0x7f7eb4150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 -- 172.21.15.114:0/3241080736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb4152480 con 0x7f7eb415be80 2024-09-16T07:34:35.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eab400640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7eb40d17b0 0x7f7eb415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb3e00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7eb40b3ae0 0x7f7eb4150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb8e00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb415be80 0x7f7eb415ab30 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c7c0 tx=0x7f7eac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb0c00640 1 -- 172.21.15.114:0/3241080736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac003b80 con 0x7f7eb415be80 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb0c00640 1 -- 172.21.15.114:0/3241080736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eac003d20 con 0x7f7eb415be80 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.865+0000 7f7eb0c00640 1 -- 172.21.15.114:0/3241080736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00aab0 con 0x7f7eb415be80 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb4152760 con 0x7f7eb415be80 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb415e450 con 0x7f7eb415be80 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb406fa40 con 0x7f7eb415be80 2024-09-16T07:34:35.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7eb0c00640 1 -- 172.21.15.114:0/3241080736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f7eac00ac50 con 0x7f7eb415be80 2024-09-16T07:34:35.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7eb0c00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e90073520 0x7f7e900759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:35.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7eb0c00640 1 -- 172.21.15.114:0/3241080736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7f7eac094900 con 0x7f7eb415be80 2024-09-16T07:34:35.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7eb3e00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e90073520 0x7f7e900759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:35.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.869+0000 7f7eb3e00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e90073520 0x7f7e900759e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005fd0 tx=0x7f7ea4005d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:35.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:35.873+0000 7f7eb0c00640 1 -- 172.21.15.114:0/3241080736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7eac05f120 con 0x7f7eb415be80 2024-09-16T07:34:36.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.041+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7eb40c73d0 con 0x7f7eb415be80 2024-09-16T07:34:36.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7eb0c00640 1 -- 172.21.15.114:0/3241080736 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16996 (secure 0 0 0) 0x7f7eac05ea20 con 0x7f7eb415be80 2024-09-16T07:34:36.043 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:36.043 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":118,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:33.751277+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:10.716126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:12.002125+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":118,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.12","mappings":[{"from":2,"to":0}]},{"pgid":"19.30","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:36.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e90073520 msgr2=0x7f7e900759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e90073520 0x7f7e900759e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005fd0 tx=0x7f7ea4005d00 comp rx=0 tx=0).stop 2024-09-16T07:34:36.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb415be80 msgr2=0x7f7eb415ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb415be80 0x7f7eb415ab30 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c7c0 tx=0x7f7eac00cc80 comp rx=0 tx=0).stop 2024-09-16T07:34:36.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 shutdown_connections 2024-09-16T07:34:36.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7eb415be80 0x7f7eb415ab30 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7e90073520 0x7f7e900759e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7eb40d17b0 0x7f7eb415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 --2- 172.21.15.114:0/3241080736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7eb40b3ae0 0x7f7eb4150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 >> 172.21.15.114:0/3241080736 conn(0x7f7eb40d0c90 msgr2=0x7f7eb4158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:36.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 shutdown_connections 2024-09-16T07:34:36.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.045+0000 7f7ebae00640 1 -- 172.21.15.114:0/3241080736 wait complete. 2024-09-16T07:34:36.064 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:34:36.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:36.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.205+0000 7f2dc6e00640 1 -- 172.21.15.114:0/1896097468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 msgr2=0x7f2dc0168d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.205+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/1896097468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc0168d70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009c80 tx=0x7f2db801cd10 comp rx=0 tx=0).stop 2024-09-16T07:34:36.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.205+0000 7f2dc6e00640 1 -- 172.21.15.114:0/1896097468 shutdown_connections 2024-09-16T07:34:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.205+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/1896097468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc0168d70 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.205+0000 7f2dc6e00640 1 -- 172.21.15.114:0/1896097468 >> 172.21.15.114:0/1896097468 conn(0x7f2dc00d4060 msgr2=0x7f2dc00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.205+0000 7f2dc6e00640 1 -- 172.21.15.114:0/1896097468 shutdown_connections 2024-09-16T07:34:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.205+0000 7f2dc6e00640 1 -- 172.21.15.114:0/1896097468 wait complete. 2024-09-16T07:34:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 Processor -- start 2024-09-16T07:34:36.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 -- start start 2024-09-16T07:34:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dc00d2100 0x7f2dc0155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dc015e2d0 0x7f2dc014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc016c1e0 con 0x7f2dc00b8a40 2024-09-16T07:34:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc016c060 con 0x7f2dc00d2100 2024-09-16T07:34:36.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc016c360 con 0x7f2dc015e2d0 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc015f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58360/0 (socket says 172.21.15.114:58360) 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 -- 172.21.15.114:0/3637763228 learned_addr learned my addr 172.21.15.114:0/3637763228 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbf400640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dc00d2100 0x7f2dc0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc4e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dc015e2d0 0x7f2dc014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 -- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dc015e2d0 msgr2=0x7f2dc014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dc015e2d0 0x7f2dc014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 -- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dc00d2100 msgr2=0x7f2dc0155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dc00d2100 0x7f2dc0155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 -- 172.21.15.114:0/3637763228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc0161980 con 0x7f2dc00b8a40 2024-09-16T07:34:36.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dbfe00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc015f710 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2db000c420 tx=0x7f2db000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2db7e00640 1 -- 172.21.15.114:0/3637763228 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0017070 con 0x7f2dc00b8a40 2024-09-16T07:34:36.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2db7e00640 1 -- 172.21.15.114:0/3637763228 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db00053c0 con 0x7f2dc00b8a40 2024-09-16T07:34:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc015fe40 con 0x7f2dc00b8a40 2024-09-16T07:34:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2db7e00640 1 -- 172.21.15.114:0/3637763228 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0003860 con 0x7f2dc00b8a40 2024-09-16T07:34:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.209+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc00ccc00 con 0x7f2dc00b8a40 2024-09-16T07:34:36.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.213+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc00b9940 con 0x7f2dc00b8a40 2024-09-16T07:34:36.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.213+0000 7f2db7e00640 1 -- 172.21.15.114:0/3637763228 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f2db001a070 con 0x7f2dc00b8a40 2024-09-16T07:34:36.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.213+0000 7f2db7e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2da00734f0 0x7f2da00759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.213+0000 7f2db7e00640 1 -- 172.21.15.114:0/3637763228 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7f2db0093ec0 con 0x7f2dc00b8a40 2024-09-16T07:34:36.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.213+0000 7f2dbf400640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2da00734f0 0x7f2da00759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.213+0000 7f2dbf400640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2da00734f0 0x7f2da00759b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0159a70 tx=0x7f2dac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:36.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.217+0000 7f2db7e00640 1 -- 172.21.15.114:0/3637763228 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2dc015fe40 con 0x7f2dc00b8a40 2024-09-16T07:34:36.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dc00b9380 con 0x7f2dc00b8a40 2024-09-16T07:34:36.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2db7e00640 1 -- 172.21.15.114:0/3637763228 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5231 (secure 0 0 0) 0x7f2db005e6a0 con 0x7f2dc00b8a40 2024-09-16T07:34:36.423 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:36.423 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":84,"btime":"2024-09-16T07:34:27:714829+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/229459534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":229459534},{"type":"v1","addr":"172.21.15.149:6801","nonce":229459534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2285177306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2285177306},{"type":"v1","addr":"172.21.15.149:6835","nonce":2285177306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/146376277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":146376277},{"type":"v1","addr":"172.21.15.114:6833","nonce":146376277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:13.032352+0000","modified":"2024-09-16T07:34:16.048792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7467":{"gid":7467,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1571071623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1571071623},{"type":"v1","addr":"172.21.15.114:6835","nonce":1571071623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7467,"qdb_cluster":[7467]},"id":9}]} 2024-09-16T07:34:36.424 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 84 2024-09-16T07:34:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2da00734f0 msgr2=0x7f2da00759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2da00734f0 0x7f2da00759b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0159a70 tx=0x7f2dac009040 comp rx=0 tx=0).stop 2024-09-16T07:34:36.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 msgr2=0x7f2dc015f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc015f710 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f2db000c420 tx=0x7f2db000c8e0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 shutdown_connections 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2da00734f0 0x7f2da00759b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dc015e2d0 0x7f2dc014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dc00d2100 0x7f2dc0155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 --2- 172.21.15.114:0/3637763228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2dc00b8a40 0x7f2dc015f710 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 >> 172.21.15.114:0/3637763228 conn(0x7f2dc00d4060 msgr2=0x7f2dc006d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 shutdown_connections 2024-09-16T07:34:36.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.425+0000 7f2dc6e00640 1 -- 172.21.15.114:0/3637763228 wait complete. 2024-09-16T07:34:36.446 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 -- 172.21.15.114:0/2004061251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0015f9a0 msgr2=0x7fcf0006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 --2- 172.21.15.114:0/2004061251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0015f9a0 0x7fcf0006e7a0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fcf000b2c50 tx=0x7fcef001cd50 comp rx=0 tx=0).stop 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 -- 172.21.15.114:0/2004061251 shutdown_connections 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 --2- 172.21.15.114:0/2004061251 >> v2:172.21.15.149:3300/0 conn(0x7fcf000cf1d0 0x7fcf0015fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 --2- 172.21.15.114:0/2004061251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0015f9a0 0x7fcf0006e7a0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 -- 172.21.15.114:0/2004061251 >> 172.21.15.114:0/2004061251 conn(0x7fcf000b18f0 msgr2=0x7fcf000b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 -- 172.21.15.114:0/2004061251 shutdown_connections 2024-09-16T07:34:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 -- 172.21.15.114:0/2004061251 wait complete. 2024-09-16T07:34:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 Processor -- start 2024-09-16T07:34:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 -- start start 2024-09-16T07:34:36.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf000cf1d0 0x7fcf00141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0015f9a0 0x7fcf00144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.589+0000 7fcf05000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf001602c0 0x7fcf001fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcf05000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf001695a0 con 0x7fcf001602c0 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcf05000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf001608e0 con 0x7fcf0015f9a0 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcf05000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf00169720 con 0x7fcf000cf1d0 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf001602c0 0x7fcf001fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf001602c0 0x7fcf001fbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58378/0 (socket says 172.21.15.114:58378) 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 -- 172.21.15.114:0/4281267195 learned_addr learned my addr 172.21.15.114:0/4281267195 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefde00640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf000cf1d0 0x7fcf00141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcef5400640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0015f9a0 0x7fcf00144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 -- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf000cf1d0 msgr2=0x7fcf00141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf000cf1d0 0x7fcf00141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 -- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0015f9a0 msgr2=0x7fcf00144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0015f9a0 0x7fcf00144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 -- 172.21.15.114:0/4281267195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0009ac60 con 0x7fcf001602c0 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcef5400640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0015f9a0 0x7fcf00144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcefe800640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf001602c0 0x7fcf001fbcd0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c390 tx=0x7fcef800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcef6a00640 1 -- 172.21.15.114:0/4281267195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8017070 con 0x7fcf001602c0 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcef6a00640 1 -- 172.21.15.114:0/4281267195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcef80053c0 con 0x7fcf001602c0 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcef6a00640 1 -- 172.21.15.114:0/4281267195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8003860 con 0x7fcf001602c0 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0009af40 con 0x7fcf001602c0 2024-09-16T07:34:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf001fb7b0 con 0x7fcf001602c0 2024-09-16T07:34:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf00069410 con 0x7fcf001602c0 2024-09-16T07:34:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.593+0000 7fcef6a00640 1 -- 172.21.15.114:0/4281267195 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fcef801a070 con 0x7fcf001602c0 2024-09-16T07:34:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.597+0000 7fcef6a00640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcedc0734f0 0x7fcedc0759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.597+0000 7fcef6a00640 1 -- 172.21.15.114:0/4281267195 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7fcef8093d90 con 0x7fcf001602c0 2024-09-16T07:34:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.597+0000 7fcefde00640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcedc0734f0 0x7fcedc0759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.597+0000 7fcefde00640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcedc0734f0 0x7fcedc0759b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcef00af000 tx=0x7fcef001b590 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:36.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.601+0000 7fcef6a00640 1 -- 172.21.15.114:0/4281267195 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcef805de90 con 0x7fcf001602c0 2024-09-16T07:34:36.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.805+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf001fb9b0 con 0x7fcf001602c0 2024-09-16T07:34:36.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.805+0000 7fcef6a00640 1 -- 172.21.15.114:0/4281267195 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5231 (secure 0 0 0) 0x7fcf001fb9b0 con 0x7fcf001602c0 2024-09-16T07:34:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":84,"btime":"2024-09-16T07:34:27:714829+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/229459534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":229459534},{"type":"v1","addr":"172.21.15.149:6801","nonce":229459534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2285177306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2285177306},{"type":"v1","addr":"172.21.15.149:6835","nonce":2285177306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/146376277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":146376277},{"type":"v1","addr":"172.21.15.114:6833","nonce":146376277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:13.032352+0000","modified":"2024-09-16T07:34:16.048792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7467":{"gid":7467,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1571071623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1571071623},{"type":"v1","addr":"172.21.15.114:6835","nonce":1571071623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7467,"qdb_cluster":[7467]},"id":9}]} 2024-09-16T07:34:36.806 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 84 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcedc0734f0 msgr2=0x7fcedc0759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcedc0734f0 0x7fcedc0759b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcef00af000 tx=0x7fcef001b590 comp rx=0 tx=0).stop 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf001602c0 msgr2=0x7fcf001fbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf001602c0 0x7fcf001fbcd0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fcef800c390 tx=0x7fcef800c850 comp rx=0 tx=0).stop 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 shutdown_connections 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf001602c0 0x7fcf001fbcd0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf0015f9a0 0x7fcf00144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcedc0734f0 0x7fcedc0759b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 --2- 172.21.15.114:0/4281267195 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf000cf1d0 0x7fcf00141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 >> 172.21.15.114:0/4281267195 conn(0x7fcf000b18f0 msgr2=0x7fcf0015a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:36.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 shutdown_connections 2024-09-16T07:34:36.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.809+0000 7fcf05000640 1 -- 172.21.15.114:0/4281267195 wait complete. 2024-09-16T07:34:36.827 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:36.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 -- 172.21.15.114:0/1790482894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 msgr2=0x7fb9840cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 --2- 172.21.15.114:0/1790482894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb9840cebb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb9840745d0 tx=0x7fb97001c830 comp rx=0 tx=0).stop 2024-09-16T07:34:36.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 -- 172.21.15.114:0/1790482894 shutdown_connections 2024-09-16T07:34:36.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 --2- 172.21.15.114:0/1790482894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb9840cebb0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 --2- 172.21.15.114:0/1790482894 >> v2:172.21.15.149:3300/0 conn(0x7fb98415bea0 0x7fb9840ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 -- 172.21.15.114:0/1790482894 >> 172.21.15.114:0/1790482894 conn(0x7fb9840d1dc0 msgr2=0x7fb9840d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:36.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 -- 172.21.15.114:0/1790482894 shutdown_connections 2024-09-16T07:34:36.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.969+0000 7fb98c400640 1 -- 172.21.15.114:0/1790482894 wait complete. 2024-09-16T07:34:36.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 Processor -- start 2024-09-16T07:34:36.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 -- start start 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb98406ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9840d28e0 0x7fb984151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98415bea0 0x7fb98415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb984168fc0 con 0x7fb9840cdb30 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb984168e40 con 0x7fb9840d28e0 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb984169140 con 0x7fb98415bea0 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb98406ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb98406ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58388/0 (socket says 172.21.15.114:58388) 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 -- 172.21.15.114:0/917170975 learned_addr learned my addr 172.21.15.114:0/917170975 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989000640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9840d28e0 0x7fb984151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98a400640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98415bea0 0x7fb98415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 -- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98415bea0 msgr2=0x7fb98415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98415bea0 0x7fb98415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 -- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9840d28e0 msgr2=0x7fb984151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9840d28e0 0x7fb984151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 -- 172.21.15.114:0/917170975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb984166310 con 0x7fb9840cdb30 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb989a00640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb98406ed80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c9f0 tx=0x7fb97800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb981600640 1 -- 172.21.15.114:0/917170975 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978007bb0 con 0x7fb9840cdb30 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb981600640 1 -- 172.21.15.114:0/917170975 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb978007e40 con 0x7fb9840cdb30 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98406f360 con 0x7fb9840cdb30 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb981600640 1 -- 172.21.15.114:0/917170975 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97800f690 con 0x7fb9840cdb30 2024-09-16T07:34:36.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb984164530 con 0x7fb9840cdb30 2024-09-16T07:34:36.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.973+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9840cc9d0 con 0x7fb9840cdb30 2024-09-16T07:34:36.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.977+0000 7fb981600640 1 -- 172.21.15.114:0/917170975 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fb97800f830 con 0x7fb9840cdb30 2024-09-16T07:34:36.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.977+0000 7fb981600640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9640734f0 0x7fb9640759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:36.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.977+0000 7fb981600640 1 -- 172.21.15.114:0/917170975 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7fb978095280 con 0x7fb9840cdb30 2024-09-16T07:34:36.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.977+0000 7fb989000640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9640734f0 0x7fb9640759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:36.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.977+0000 7fb989000640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9640734f0 0x7fb9640759b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9700af000 tx=0x7fb97001b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:36.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:36.981+0000 7fb981600640 1 -- 172.21.15.114:0/917170975 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb984166310 con 0x7fb9840cdb30 2024-09-16T07:34:37.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.149+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb98406add0 con 0x7fb9840cdb30 2024-09-16T07:34:37.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.149+0000 7fb981600640 1 -- 172.21.15.114:0/917170975 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16996 (secure 0 0 0) 0x7fb978014030 con 0x7fb9840cdb30 2024-09-16T07:34:37.148 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:37.149 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":118,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:33.751277+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:10.716126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:12.002125+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":118,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.12","mappings":[{"from":2,"to":0}]},{"pgid":"19.30","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:37.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.149+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9640734f0 msgr2=0x7fb9640759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.149+0000 7fb98c400640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9640734f0 0x7fb9640759b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9700af000 tx=0x7fb97001b070 comp rx=0 tx=0).stop 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.149+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 msgr2=0x7fb98406ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.149+0000 7fb98c400640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb98406ed80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb97800c9f0 tx=0x7fb97800ceb0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 shutdown_connections 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9640734f0 0x7fb9640759b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb98415bea0 0x7fb98415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9840d28e0 0x7fb984151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 --2- 172.21.15.114:0/917170975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9840cdb30 0x7fb98406ed80 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 >> 172.21.15.114:0/917170975 conn(0x7fb9840d1dc0 msgr2=0x7fb9840d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 shutdown_connections 2024-09-16T07:34:37.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.153+0000 7fb98c400640 1 -- 172.21.15.114:0/917170975 wait complete. 2024-09-16T07:34:37.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:34:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 -- 172.21.15.114:0/1311429710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386415ade0 msgr2=0x7f38640cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 --2- 172.21.15.114:0/1311429710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386415ade0 0x7f38640cebf0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f3858009bc0 tx=0x7f385801cba0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 -- 172.21.15.114:0/1311429710 shutdown_connections 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 --2- 172.21.15.114:0/1311429710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386415ade0 0x7f38640cebf0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 -- 172.21.15.114:0/1311429710 >> 172.21.15.114:0/1311429710 conn(0x7f38640b18f0 msgr2=0x7f38640b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 -- 172.21.15.114:0/1311429710 shutdown_connections 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 -- 172.21.15.114:0/1311429710 wait complete. 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 Processor -- start 2024-09-16T07:34:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.313+0000 7f386c200640 1 -- start start 2024-09-16T07:34:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386406e810 0x7f3864159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38640b4bd0 0x7f3864073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f386415ade0 0x7f3864149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3864169850 con 0x7f386406e810 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38641696d0 con 0x7f38640b4bd0 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f38641699d0 con 0x7f386415ade0 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386406e810 0x7f3864159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386406e810 0x7f3864159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58414/0 (socket says 172.21.15.114:58414) 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 -- 172.21.15.114:0/9955246 learned_addr learned my addr 172.21.15.114:0/9955246 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 -- 172.21.15.114:0/9955246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f386415ade0 msgr2=0x7f3864149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f386415ade0 0x7f3864149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 -- 172.21.15.114:0/9955246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38640b4bd0 msgr2=0x7f3864073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38640b4bd0 0x7f3864073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 -- 172.21.15.114:0/9955246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38641589e0 con 0x7f386406e810 2024-09-16T07:34:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3869800640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386406e810 0x7f3864159a00 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3858009b10 tx=0x7f38580a5800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3861600640 1 -- 172.21.15.114:0/9955246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580bb070 con 0x7f386406e810 2024-09-16T07:34:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3861600640 1 -- 172.21.15.114:0/9955246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3858004d40 con 0x7f386406e810 2024-09-16T07:34:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3861600640 1 -- 172.21.15.114:0/9955246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580b2040 con 0x7f386406e810 2024-09-16T07:34:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3864158c80 con 0x7f386406e810 2024-09-16T07:34:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3864159200 con 0x7f386406e810 2024-09-16T07:34:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38640cebf0 con 0x7f386406e810 2024-09-16T07:34:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.317+0000 7f3861600640 1 -- 172.21.15.114:0/9955246 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f38580a58f0 con 0x7f386406e810 2024-09-16T07:34:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.321+0000 7f3861600640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f38440734f0 0x7f38440759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.321+0000 7f3861600640 1 -- 172.21.15.114:0/9955246 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5823+0+0 (secure 0 0 0) 0x7f385812eb20 con 0x7f386406e810 2024-09-16T07:34:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.321+0000 7f3868e00640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f38440734f0 0x7f38440759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.321+0000 7f3868e00640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f38440734f0 0x7f38440759b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3850007fd0 tx=0x7f38500079a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.325+0000 7f3861600640 1 -- 172.21.15.114:0/9955246 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3858016790 con 0x7f386406e810 2024-09-16T07:34:37.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.525+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3864151210 con 0x7f386406e810 2024-09-16T07:34:37.524 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:34:37.525+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:34:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f3861600640 1 -- 172.21.15.114:0/9955246 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) ==== 161+0+0 (secure 0 0 0) 0x7f38580f9300 con 0x7f386406e810 2024-09-16T07:34:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f38440734f0 msgr2=0x7f38440759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f38440734f0 0x7f38440759b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3850007fd0 tx=0x7f38500079a0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386406e810 msgr2=0x7f3864159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386406e810 0x7f3864159a00 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3858009b10 tx=0x7f38580a5800 comp rx=0 tx=0).stop 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 shutdown_connections 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f38440734f0 0x7f38440759b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f386415ade0 0x7f3864149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38640b4bd0 0x7f3864073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 --2- 172.21.15.114:0/9955246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f386406e810 0x7f3864159a00 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 >> 172.21.15.114:0/9955246 conn(0x7f38640b18f0 msgr2=0x7f3864156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 shutdown_connections 2024-09-16T07:34:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.529+0000 7f386c200640 1 -- 172.21.15.114:0/9955246 wait complete. 2024-09-16T07:34:37.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:34:37.595 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:34:37.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- 172.21.15.114:0/4006863939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0d22c0 msgr2=0x7fc00c166800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 --2- 172.21.15.114:0/4006863939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0d22c0 0x7fc00c166800 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc004009bc0 tx=0x7fc00401cba0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- 172.21.15.114:0/4006863939 shutdown_connections 2024-09-16T07:34:37.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 --2- 172.21.15.114:0/4006863939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0d22c0 0x7fc00c166800 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- 172.21.15.114:0/4006863939 >> 172.21.15.114:0/4006863939 conn(0x7fc00c09aa10 msgr2=0x7fc00c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:37.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- 172.21.15.114:0/4006863939 shutdown_connections 2024-09-16T07:34:37.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- 172.21.15.114:0/4006863939 wait complete. 2024-09-16T07:34:37.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 Processor -- start 2024-09-16T07:34:37.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- start start 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0b0d10 0x7fc00c0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00c0d22c0 0x7fc00c14b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc00c15bd40 0x7fc00c15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c169e10 con 0x7fc00c15bd40 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c169c90 con 0x7fc00c0b0d10 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc00c169f90 con 0x7fc00c0d22c0 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc00c15bd40 0x7fc00c15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc011a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0b0d10 0x7fc00c0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc011000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00c0d22c0 0x7fc00c14b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc00c15bd40 0x7fc00c15aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58442/0 (socket says 172.21.15.114:58442) 2024-09-16T07:34:37.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 -- 172.21.15.114:0/88649097 learned_addr learned my addr 172.21.15.114:0/88649097 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 -- 172.21.15.114:0/88649097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00c0d22c0 msgr2=0x7fc00c14b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00c0d22c0 0x7fc00c14b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 -- 172.21.15.114:0/88649097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0b0d10 msgr2=0x7fc00c0cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0b0d10 0x7fc00c0cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:37.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.709+0000 7fc012400640 1 -- 172.21.15.114:0/88649097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c0ca280 con 0x7fc00c15bd40 2024-09-16T07:34:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc012400640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc00c15bd40 0x7fc00c15aab0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fc0040b0040 tx=0x7fc004009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc009600640 1 -- 172.21.15.114:0/88649097 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0040bb070 con 0x7fc00c15bd40 2024-09-16T07:34:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc009600640 1 -- 172.21.15.114:0/88649097 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc004004d40 con 0x7fc00c15bd40 2024-09-16T07:34:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c14b6c0 con 0x7fc00c15bd40 2024-09-16T07:34:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc009600640 1 -- 172.21.15.114:0/88649097 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0040b2040 con 0x7fc00c15bd40 2024-09-16T07:34:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c0ca800 con 0x7fc00c15bd40 2024-09-16T07:34:37.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00c0b5d50 con 0x7fc00c15bd40 2024-09-16T07:34:37.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc009600640 1 -- 172.21.15.114:0/88649097 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fc0040be070 con 0x7fc00c15bd40 2024-09-16T07:34:37.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.713+0000 7fc009600640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfec0734f0 0x7fbfec0759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:37.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.717+0000 7fc009600640 1 -- 172.21.15.114:0/88649097 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5881+0+0 (secure 0 0 0) 0x7fc00412e690 con 0x7fc00c15bd40 2024-09-16T07:34:37.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.717+0000 7fc011a00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfec0734f0 0x7fbfec0759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:37.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.717+0000 7fc011a00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfec0734f0 0x7fbfec0759b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc000007fd0 tx=0x7fc000009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.721+0000 7fc009600640 1 -- 172.21.15.114:0/88649097 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc00c0b5d50 con 0x7fc00c15bd40 2024-09-16T07:34:37.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:37.925+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc00c0cc170 con 0x7fc00c15bd40 2024-09-16T07:34:38.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc009600640 1 -- 172.21.15.114:0/88649097 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) ==== 104+0+0 (secure 0 0 0) 0x7fc004016790 con 0x7fc00c15bd40 2024-09-16T07:34:38.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfec0734f0 msgr2=0x7fbfec0759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:38.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfec0734f0 0x7fbfec0759b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc000007fd0 tx=0x7fc000009040 comp rx=0 tx=0).stop 2024-09-16T07:34:38.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc00c15bd40 msgr2=0x7fc00c15aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:38.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc00c15bd40 0x7fc00c15aab0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fc0040b0040 tx=0x7fc004009200 comp rx=0 tx=0).stop 2024-09-16T07:34:38.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 shutdown_connections 2024-09-16T07:34:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc00c15bd40 0x7fc00c15aab0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfec0734f0 0x7fbfec0759b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc00c0d22c0 0x7fc00c14b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 --2- 172.21.15.114:0/88649097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc00c0b0d10 0x7fc00c0cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.541+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 >> 172.21.15.114:0/88649097 conn(0x7fc00c09aa10 msgr2=0x7fc00c0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.545+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 shutdown_connections 2024-09-16T07:34:38.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.545+0000 7fc012e00640 1 -- 172.21.15.114:0/88649097 wait complete. 2024-09-16T07:34:38.564 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:34:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 -- 172.21.15.114:0/2034977503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 msgr2=0x7fc76c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 --2- 172.21.15.114:0/2034977503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c0cec40 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fc76c073e00 tx=0x7fc75801c8c0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 -- 172.21.15.114:0/2034977503 shutdown_connections 2024-09-16T07:34:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 --2- 172.21.15.114:0/2034977503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c0cec40 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 --2- 172.21.15.114:0/2034977503 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc76c0b0b60 0x7fc76c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 --2- 172.21.15.114:0/2034977503 >> v2:172.21.15.149:3300/0 conn(0x7fc76c15be10 0x7fc76c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 -- 172.21.15.114:0/2034977503 >> 172.21.15.114:0/2034977503 conn(0x7fc76c0d1da0 msgr2=0x7fc76c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 -- 172.21.15.114:0/2034977503 shutdown_connections 2024-09-16T07:34:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.761+0000 7fc772200640 1 -- 172.21.15.114:0/2034977503 wait complete. 2024-09-16T07:34:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 Processor -- start 2024-09-16T07:34:38.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 -- start start 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc76c0b0b60 0x7fc76c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc76c15be10 0x7fc76c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c165930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c0ccf60 con 0x7fc76c15c1f0 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc76c0ccde0 con 0x7fc76c15be10 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc76c0cd0e0 con 0x7fc76c0b0b60 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c165930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c165930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58454/0 (socket says 172.21.15.114:58454) 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 -- 172.21.15.114:0/2749481865 learned_addr learned my addr 172.21.15.114:0/2749481865 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76b400640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc76c0b0b60 0x7fc76c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76aa00640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc76c15be10 0x7fc76c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 -- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc76c0b0b60 msgr2=0x7fc76c0b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc76c0b0b60 0x7fc76c0b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 -- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc76c15be10 msgr2=0x7fc76c1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc76c15be10 0x7fc76c1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 -- 172.21.15.114:0/2749481865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76c0cfcb0 con 0x7fc76c15c1f0 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76aa00640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc76c15be10 0x7fc76c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc76be00640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c165930 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fc76400cce0 tx=0x7fc76400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc763400640 1 -- 172.21.15.114:0/2749481865 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76400f450 con 0x7fc76c15c1f0 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc763400640 1 -- 172.21.15.114:0/2749481865 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc76400f6e0 con 0x7fc76c15c1f0 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc763400640 1 -- 172.21.15.114:0/2749481865 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76400fb30 con 0x7fc76c15c1f0 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76c154630 con 0x7fc76c15c1f0 2024-09-16T07:34:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.765+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76c1f7f50 con 0x7fc76c15c1f0 2024-09-16T07:34:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.769+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76c0cd590 con 0x7fc76c15c1f0 2024-09-16T07:34:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.769+0000 7fc763400640 1 -- 172.21.15.114:0/2749481865 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fc76400fcd0 con 0x7fc76c15c1f0 2024-09-16T07:34:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.769+0000 7fc763400640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc74c0734f0 0x7fc74c0759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.769+0000 7fc763400640 1 -- 172.21.15.114:0/2749481865 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5881+0+0 (secure 0 0 0) 0x7fc7640956f0 con 0x7fc76c15c1f0 2024-09-16T07:34:38.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.769+0000 7fc76b400640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc74c0734f0 0x7fc74c0759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:38.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.769+0000 7fc76b400640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc74c0734f0 0x7fc74c0759b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc75c005fd0 tx=0x7fc75c005db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:38.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.773+0000 7fc763400640 1 -- 172.21.15.114:0/2749481865 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc764014030 con 0x7fc76c15c1f0 2024-09-16T07:34:38.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:38.945+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc76c1651b0 con 0x7fc76c15c1f0 2024-09-16T07:34:39.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.789+0000 7fc763400640 1 -- 172.21.15.114:0/2749481865 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7fc76405f7b0 con 0x7fc76c15c1f0 2024-09-16T07:34:39.789 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:34:39.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc74c0734f0 msgr2=0x7fc74c0759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:39.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc74c0734f0 0x7fc74c0759b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc75c005fd0 tx=0x7fc75c005db0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 msgr2=0x7fc76c165930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:39.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c165930 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fc76400cce0 tx=0x7fc76400a620 comp rx=0 tx=0).stop 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 shutdown_connections 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc76c15c1f0 0x7fc76c165930 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc76c15be10 0x7fc76c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc74c0734f0 0x7fc74c0759b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 --2- 172.21.15.114:0/2749481865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc76c0b0b60 0x7fc76c0b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 >> 172.21.15.114:0/2749481865 conn(0x7fc76c0d1da0 msgr2=0x7fc76c0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 shutdown_connections 2024-09-16T07:34:39.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.793+0000 7fc772200640 1 -- 172.21.15.114:0/2749481865 wait complete. 2024-09-16T07:34:39.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:34:39.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.965+0000 7fe445a00640 1 -- 172.21.15.114:0/1949171109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 msgr2=0x7fe4400cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:39.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.965+0000 7fe445a00640 1 --2- 172.21.15.114:0/1949171109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400cb8c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe430009840 tx=0x7fe43001c7f0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.965+0000 7fe445a00640 1 -- 172.21.15.114:0/1949171109 shutdown_connections 2024-09-16T07:34:39.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.965+0000 7fe445a00640 1 --2- 172.21.15.114:0/1949171109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400cb8c0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.965+0000 7fe445a00640 1 -- 172.21.15.114:0/1949171109 >> 172.21.15.114:0/1949171109 conn(0x7fe4400d0c70 msgr2=0x7fe4400d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:39.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.965+0000 7fe445a00640 1 -- 172.21.15.114:0/1949171109 shutdown_connections 2024-09-16T07:34:39.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.965+0000 7fe445a00640 1 -- 172.21.15.114:0/1949171109 wait complete. 2024-09-16T07:34:39.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 Processor -- start 2024-09-16T07:34:39.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 -- start start 2024-09-16T07:34:39.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe440073ef0 0x7fe440158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:39.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:39.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe44015bc40 0x7fe440151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe440168ce0 con 0x7fe4401550d0 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe440168b60 con 0x7fe44015bc40 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe440168e60 con 0x7fe440073ef0 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58474/0 (socket says 172.21.15.114:58474) 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 -- 172.21.15.114:0/1412768929 learned_addr learned my addr 172.21.15.114:0/1412768929 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43fe00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe440073ef0 0x7fe440158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445000640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe44015bc40 0x7fe440151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 -- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe440073ef0 msgr2=0x7fe440158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe440073ef0 0x7fe440158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 -- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe44015bc40 msgr2=0x7fe440151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe44015bc40 0x7fe440151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:39.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 -- 172.21.15.114:0/1412768929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4400c6d70 con 0x7fe4401550d0 2024-09-16T07:34:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe43f400640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400c6830 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c3c0 tx=0x7fe42c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe437e00640 1 -- 172.21.15.114:0/1412768929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c017070 con 0x7fe4401550d0 2024-09-16T07:34:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe437e00640 1 -- 172.21.15.114:0/1412768929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe42c003600 con 0x7fe4401550d0 2024-09-16T07:34:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe437e00640 1 -- 172.21.15.114:0/1412768929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c003a50 con 0x7fe4401550d0 2024-09-16T07:34:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.969+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4401595b0 con 0x7fe4401550d0 2024-09-16T07:34:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.973+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4401567c0 con 0x7fe4401550d0 2024-09-16T07:34:39.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.973+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4400cb8c0 con 0x7fe4401550d0 2024-09-16T07:34:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.973+0000 7fe437e00640 1 -- 172.21.15.114:0/1412768929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fe42c01a070 con 0x7fe4401550d0 2024-09-16T07:34:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.973+0000 7fe437e00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe420073520 0x7fe4200759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.973+0000 7fe437e00640 1 -- 172.21.15.114:0/1412768929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5443+0+0 (secure 0 0 0) 0x7fe42c093af0 con 0x7fe4401550d0 2024-09-16T07:34:39.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.973+0000 7fe43fe00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe420073520 0x7fe4200759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:39.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.973+0000 7fe43fe00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe420073520 0x7fe4200759e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe4300af000 tx=0x7fe43001b030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:39.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:39.977+0000 7fe437e00640 1 -- 172.21.15.114:0/1412768929 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe42c05dd70 con 0x7fe4401550d0 2024-09-16T07:34:40.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.149+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe4400d1460 con 0x7fe4401550d0 2024-09-16T07:34:40.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.805+0000 7fe437e00640 1 -- 172.21.15.114:0/1412768929 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7fe42c0627a0 con 0x7fe4401550d0 2024-09-16T07:34:40.803 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:34:40.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe420073520 msgr2=0x7fe4200759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:40.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe420073520 0x7fe4200759e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe4300af000 tx=0x7fe43001b030 comp rx=0 tx=0).stop 2024-09-16T07:34:40.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 msgr2=0x7fe4400c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:40.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400c6830 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c3c0 tx=0x7fe42c00c880 comp rx=0 tx=0).stop 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 shutdown_connections 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe44015bc40 0x7fe440151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4401550d0 0x7fe4400c6830 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe420073520 0x7fe4200759e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 --2- 172.21.15.114:0/1412768929 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe440073ef0 0x7fe440158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 >> 172.21.15.114:0/1412768929 conn(0x7fe4400d0c70 msgr2=0x7fe4400cce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 shutdown_connections 2024-09-16T07:34:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.809+0000 7fe445a00640 1 -- 172.21.15.114:0/1412768929 wait complete. 2024-09-16T07:34:40.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:34:40.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 -- 172.21.15.114:0/2174174091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa33c004810 msgr2=0x7fa33c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:40.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 --2- 172.21.15.114:0/2174174091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa33c004810 0x7fa33c004c90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa34000c310 tx=0x7fa34001f6c0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 -- 172.21.15.114:0/2174174091 shutdown_connections 2024-09-16T07:34:40.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 --2- 172.21.15.114:0/2174174091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa33c004810 0x7fa33c004c90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 -- 172.21.15.114:0/2174174091 >> 172.21.15.114:0/2174174091 conn(0x7fa354073490 msgr2=0x7fa3540d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:40.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 -- 172.21.15.114:0/2174174091 shutdown_connections 2024-09-16T07:34:40.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 -- 172.21.15.114:0/2174174091 wait complete. 2024-09-16T07:34:40.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.977+0000 7fa359e00640 1 Processor -- start 2024-09-16T07:34:40.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 -- start start 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa33c004810 0x7fa354155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3541f4830 0x7fa354152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3541589a0 0x7fa354158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa354068ee0 con 0x7fa3541f4830 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3540af770 con 0x7fa3541589a0 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa35415c760 con 0x7fa33c004810 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3541f4830 0x7fa354152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa358a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa33c004810 0x7fa354155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3541f4830 0x7fa354152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58506/0 (socket says 172.21.15.114:58506) 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 -- 172.21.15.114:0/438234108 learned_addr learned my addr 172.21.15.114:0/438234108 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359400640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3541589a0 0x7fa354158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:40.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 -- 172.21.15.114:0/438234108 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa33c004810 msgr2=0x7fa354155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:40.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa33c004810 0x7fa354155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 -- 172.21.15.114:0/438234108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3541589a0 msgr2=0x7fa354158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:40.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3541589a0 0x7fa354158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:40.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 -- 172.21.15.114:0/438234108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa354156380 con 0x7fa3541f4830 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa353e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3541f4830 0x7fa354152070 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa34001df90 tx=0x7fa340001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa350c00640 1 -- 172.21.15.114:0/438234108 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400be070 con 0x7fa3541f4830 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa350c00640 1 -- 172.21.15.114:0/438234108 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3400b4040 con 0x7fa3541f4830 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa350c00640 1 -- 172.21.15.114:0/438234108 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400b3070 con 0x7fa3541f4830 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3541f4df0 con 0x7fa3541f4830 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3541f53b0 con 0x7fa3541f4830 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.981+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa354074340 con 0x7fa3541f4830 2024-09-16T07:34:40.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.985+0000 7fa350c00640 1 -- 172.21.15.114:0/438234108 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fa340003600 con 0x7fa3541f4830 2024-09-16T07:34:40.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.985+0000 7fa350c00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa3340734f0 0x7fa3340759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:40.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.985+0000 7fa350c00640 1 -- 172.21.15.114:0/438234108 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7fa3401316c0 con 0x7fa3541f4830 2024-09-16T07:34:40.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.985+0000 7fa358a00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa3340734f0 0x7fa3340759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:40.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.985+0000 7fa358a00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa3340734f0 0x7fa3340759b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa348009be0 tx=0x7fa3480091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:40.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:40.989+0000 7fa350c00640 1 -- 172.21.15.114:0/438234108 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa354156380 con 0x7fa3541f4830 2024-09-16T07:34:41.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.157+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fa354073b60 con 0x7fa3541f4830 2024-09-16T07:34:41.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa350c00640 1 -- 172.21.15.114:0/438234108 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7fa340019470 con 0x7fa3541f4830 2024-09-16T07:34:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa3340734f0 msgr2=0x7fa3340759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa3340734f0 0x7fa3340759b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa348009be0 tx=0x7fa3480091e0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3541f4830 msgr2=0x7fa354152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3541f4830 0x7fa354152070 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa34001df90 tx=0x7fa340001e10 comp rx=0 tx=0).stop 2024-09-16T07:34:41.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 shutdown_connections 2024-09-16T07:34:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3541589a0 0x7fa354158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3541f4830 0x7fa354152070 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa3340734f0 0x7fa3340759b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 --2- 172.21.15.114:0/438234108 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa33c004810 0x7fa354155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 >> 172.21.15.114:0/438234108 conn(0x7fa354073490 msgr2=0x7fa3540ae270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 shutdown_connections 2024-09-16T07:34:41.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.161+0000 7fa359e00640 1 -- 172.21.15.114:0/438234108 wait complete. 2024-09-16T07:34:41.182 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-16T07:34:41.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 -- 172.21.15.114:0/1752484013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780cf160 msgr2=0x7fc17815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 --2- 172.21.15.114:0/1752484013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780cf160 0x7fc17815a3e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fc1780ce180 tx=0x7fc16c01c830 comp rx=0 tx=0).stop 2024-09-16T07:34:41.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 -- 172.21.15.114:0/1752484013 shutdown_connections 2024-09-16T07:34:41.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 --2- 172.21.15.114:0/1752484013 >> v2:172.21.15.149:3300/0 conn(0x7fc1780ce200 0x7fc178068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 --2- 172.21.15.114:0/1752484013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780cf160 0x7fc17815a3e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 -- 172.21.15.114:0/1752484013 >> 172.21.15.114:0/1752484013 conn(0x7fc1780b2060 msgr2=0x7fc1780b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:41.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 -- 172.21.15.114:0/1752484013 shutdown_connections 2024-09-16T07:34:41.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.325+0000 7fc17fe00640 1 -- 172.21.15.114:0/1752484013 wait complete. 2024-09-16T07:34:41.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 Processor -- start 2024-09-16T07:34:41.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 -- start start 2024-09-16T07:34:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17806f090 0x7fc1780ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780ce200 0x7fc1781544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1780cf160 0x7fc1780af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc17806f470 con 0x7fc1780ce200 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1780ccbb0 con 0x7fc17806f090 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc17806f5f0 con 0x7fc1780cf160 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780ce200 0x7fc1781544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780ce200 0x7fc1781544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58520/0 (socket says 172.21.15.114:58520) 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 -- 172.21.15.114:0/2186994403 learned_addr learned my addr 172.21.15.114:0/2186994403 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17d400640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17806f090 0x7fc1780ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17de00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1780cf160 0x7fc1780af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 -- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1780cf160 msgr2=0x7fc1780af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1780cf160 0x7fc1780af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 -- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17806f090 msgr2=0x7fc1780ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17806f090 0x7fc1780ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 -- 172.21.15.114:0/2186994403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1781fb760 con 0x7fc1780ce200 2024-09-16T07:34:41.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17de00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1780cf160 0x7fc1780af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:41.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17ca00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780ce200 0x7fc1781544b0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc16400d950 tx=0x7fc16400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:41.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc175600640 1 -- 172.21.15.114:0/2186994403 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164017070 con 0x7fc1780ce200 2024-09-16T07:34:41.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc175600640 1 -- 172.21.15.114:0/2186994403 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc164009cc0 con 0x7fc1780ce200 2024-09-16T07:34:41.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc175600640 1 -- 172.21.15.114:0/2186994403 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640106c0 con 0x7fc1780ce200 2024-09-16T07:34:41.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1781fba40 con 0x7fc1780ce200 2024-09-16T07:34:41.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1781fc000 con 0x7fc1780ce200 2024-09-16T07:34:41.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.329+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc178068960 con 0x7fc1780ce200 2024-09-16T07:34:41.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.333+0000 7fc175600640 1 -- 172.21.15.114:0/2186994403 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fc164010860 con 0x7fc1780ce200 2024-09-16T07:34:41.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.333+0000 7fc175600640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc158073520 0x7fc1580759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.333+0000 7fc175600640 1 -- 172.21.15.114:0/2186994403 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7fc164094aa0 con 0x7fc1780ce200 2024-09-16T07:34:41.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.333+0000 7fc17d400640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc158073520 0x7fc1580759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.333+0000 7fc17d400640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc158073520 0x7fc1580759e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0af000 tx=0x7fc16c01b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:41.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.337+0000 7fc175600640 1 -- 172.21.15.114:0/2186994403 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc16405ef00 con 0x7fc1780ce200 2024-09-16T07:34:41.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.561+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7fc1780c5730 con 0x7fc1780ce200 2024-09-16T07:34:41.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc175600640 1 -- 172.21.15.114:0/2186994403 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v358) ==== 148+0+0 (secure 0 0 0) 0x7fc164063930 con 0x7fc1780ce200 2024-09-16T07:34:41.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc158073520 msgr2=0x7fc1580759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc158073520 0x7fc1580759e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0af000 tx=0x7fc16c01b070 comp rx=0 tx=0).stop 2024-09-16T07:34:41.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780ce200 msgr2=0x7fc1781544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780ce200 0x7fc1781544b0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fc16400d950 tx=0x7fc16400de10 comp rx=0 tx=0).stop 2024-09-16T07:34:41.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 shutdown_connections 2024-09-16T07:34:41.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc158073520 0x7fc1580759e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc1780cf160 0x7fc1780af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1780ce200 0x7fc1781544b0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 --2- 172.21.15.114:0/2186994403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc17806f090 0x7fc1780ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 >> 172.21.15.114:0/2186994403 conn(0x7fc1780b2060 msgr2=0x7fc1780b5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:41.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 shutdown_connections 2024-09-16T07:34:41.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.809+0000 7fc17fe00640 1 -- 172.21.15.114:0/2186994403 wait complete. 2024-09-16T07:34:41.829 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-16T07:34:41.830 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:34:41.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff660a00640 1 -- 172.21.15.114:0/614319148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640003a10 msgr2=0x7ff640003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff660a00640 1 --2- 172.21.15.114:0/614319148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff640003a10 0x7ff640003e30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009b60 tx=0x7ff64c01d240 comp rx=0 tx=0).stop 2024-09-16T07:34:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff65b200640 1 -- 172.21.15.114:0/614319148 reap_dead start 2024-09-16T07:34:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff660a00640 1 -- 172.21.15.114:0/614319148 shutdown_connections 2024-09-16T07:34:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff660a00640 1 -- 172.21.15.114:0/614319148 >> 172.21.15.114:0/614319148 conn(0x7ff65c06dd30 msgr2=0x7ff65c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff660a00640 1 -- 172.21.15.114:0/614319148 shutdown_connections 2024-09-16T07:34:41.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff660a00640 1 -- 172.21.15.114:0/614319148 wait complete. 2024-09-16T07:34:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.973+0000 7ff660a00640 1 Processor -- start 2024-09-16T07:34:41.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 -- start start 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff640003a10 0x7ff65c0c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c2ab0 0x7ff65c1e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c1e8920 0x7ff65c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0cf620 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0cf4a0 con 0x7ff640003a10 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c0cf7a0 con 0x7ff65c1e8920 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c2ab0 0x7ff65c1e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c2ab0 0x7ff65c1e83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58538/0 (socket says 172.21.15.114:58538) 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 -- 172.21.15.114:0/2146437790 learned_addr learned my addr 172.21.15.114:0/2146437790 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:41.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff65a800640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff640003a10 0x7ff65c0c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff65b200640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c1e8920 0x7ff65c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 -- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c1e8920 msgr2=0x7ff65c0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c1e8920 0x7ff65c0af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 -- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff640003a10 msgr2=0x7ff65c0c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff640003a10 0x7ff65c0c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 -- 172.21.15.114:0/2146437790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c0cb150 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff653e00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c2ab0 0x7ff65c1e83e0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff644011be0 tx=0x7ff64400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff652a00640 1 -- 172.21.15.114:0/2146437790 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64401e070 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff652a00640 1 -- 172.21.15.114:0/2146437790 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff64400e7c0 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff652a00640 1 -- 172.21.15.114:0/2146437790 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64400ebd0 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65c0c1a10 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65c0c1fd0 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.977+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65c15afb0 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.981+0000 7ff652a00640 1 -- 172.21.15.114:0/2146437790 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7ff644021070 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.981+0000 7ff652a00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6380734f0 0x7ff6380759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:41.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.981+0000 7ff652a00640 1 -- 172.21.15.114:0/2146437790 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7ff6440957a0 con 0x7ff65c0c2ab0 2024-09-16T07:34:41.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.981+0000 7ff65a800640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6380734f0 0x7ff6380759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:41.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.981+0000 7ff65a800640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6380734f0 0x7ff6380759b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0ae000 tx=0x7ff64c019fe0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:41.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:41.985+0000 7ff652a00640 1 -- 172.21.15.114:0/2146437790 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff64405fb60 con 0x7ff65c0c2ab0 2024-09-16T07:34:42.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff65c1e8d00 con 0x7ff65c0c2ab0 2024-09-16T07:34:42.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff652a00640 1 -- 172.21.15.114:0/2146437790 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13136 (secure 0 0 0) 0x7ff644064590 con 0x7ff65c0c2ab0 2024-09-16T07:34:42.151 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:42.151 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":121,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:40.804152+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/1571071623":"2024-09-17T07:34:37.530444+0000","172.21.15.114:6834/1571071623":"2024-09-17T07:34:37.530444+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:42.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6380734f0 msgr2=0x7ff6380759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6380734f0 0x7ff6380759b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0ae000 tx=0x7ff64c019fe0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c2ab0 msgr2=0x7ff65c1e83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c2ab0 0x7ff65c1e83e0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff644011be0 tx=0x7ff64400f790 comp rx=0 tx=0).stop 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 shutdown_connections 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6380734f0 0x7ff6380759b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff65c1e8920 0x7ff65c0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff65c0c2ab0 0x7ff65c1e83e0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 --2- 172.21.15.114:0/2146437790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff640003a10 0x7ff65c0c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 >> 172.21.15.114:0/2146437790 conn(0x7ff65c06dd30 msgr2=0x7ff65c06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 shutdown_connections 2024-09-16T07:34:42.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.153+0000 7ff660a00640 1 -- 172.21.15.114:0/2146437790 wait complete. 2024-09-16T07:34:42.173 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:34:42.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:34:42.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.317+0000 7efca5200640 1 -- 172.21.15.114:0/2605526616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc84004810 msgr2=0x7efc84004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.317+0000 7efca5200640 1 --2- 172.21.15.114:0/2605526616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc84004810 0x7efc84004c90 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c310 tx=0x7efc8c01f680 comp rx=0 tx=0).stop 2024-09-16T07:34:42.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.317+0000 7efca5200640 1 -- 172.21.15.114:0/2605526616 shutdown_connections 2024-09-16T07:34:42.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.317+0000 7efca5200640 1 --2- 172.21.15.114:0/2605526616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc84004810 0x7efc84004c90 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.317+0000 7efca5200640 1 -- 172.21.15.114:0/2605526616 >> 172.21.15.114:0/2605526616 conn(0x7efca00cfa00 msgr2=0x7efca00cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:42.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.317+0000 7efca5200640 1 -- 172.21.15.114:0/2605526616 shutdown_connections 2024-09-16T07:34:42.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.317+0000 7efca5200640 1 -- 172.21.15.114:0/2605526616 wait complete. 2024-09-16T07:34:42.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 Processor -- start 2024-09-16T07:34:42.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 -- start start 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc84004810 0x7efca00ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca01f7ea0 0x7efca00b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca0155b30 0x7efca0155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efca00aef70 con 0x7efca01f7ea0 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efca015e940 con 0x7efca0155b30 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efca00af0f0 con 0x7efc84004810 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca01f7ea0 0x7efca00b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca01f7ea0 0x7efca00b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58550/0 (socket says 172.21.15.114:58550) 2024-09-16T07:34:42.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 -- 172.21.15.114:0/4039797635 learned_addr learned my addr 172.21.15.114:0/4039797635 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9f400640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc84004810 0x7efca00ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9fe00640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca0155b30 0x7efca0155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 -- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc84004810 msgr2=0x7efca00ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc84004810 0x7efca00ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 -- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca0155b30 msgr2=0x7efca0155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca0155b30 0x7efca0155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 -- 172.21.15.114:0/4039797635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca01f8460 con 0x7efca01f7ea0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9fe00640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca0155b30 0x7efca0155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc9ea00640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca01f7ea0 0x7efca00b5090 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7efc8c026390 tx=0x7efc8c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc97400640 1 -- 172.21.15.114:0/4039797635 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0bf070 con 0x7efca01f7ea0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc97400640 1 -- 172.21.15.114:0/4039797635 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc8c0b4040 con 0x7efca01f7ea0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efc97400640 1 -- 172.21.15.114:0/4039797635 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0b3070 con 0x7efca01f7ea0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.321+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca01f8740 con 0x7efca01f7ea0 2024-09-16T07:34:42.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.325+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca00b55d0 con 0x7efca01f7ea0 2024-09-16T07:34:42.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.325+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca00ca340 con 0x7efca01f7ea0 2024-09-16T07:34:42.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.325+0000 7efc97400640 1 -- 172.21.15.114:0/4039797635 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7efc8c0c2070 con 0x7efca01f7ea0 2024-09-16T07:34:42.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.325+0000 7efc97400640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efc80073520 0x7efc800759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.325+0000 7efc97400640 1 -- 172.21.15.114:0/4039797635 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7efc8c131390 con 0x7efca01f7ea0 2024-09-16T07:34:42.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.325+0000 7efc9f400640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efc80073520 0x7efc800759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.325+0000 7efc9f400640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efc80073520 0x7efc800759e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc90000c10 tx=0x7efc90006d20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:42.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.329+0000 7efc97400640 1 -- 172.21.15.114:0/4039797635 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efc8c0ab070 con 0x7efca01f7ea0 2024-09-16T07:34:42.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.497+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efca00d0780 con 0x7efca01f7ea0 2024-09-16T07:34:42.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.497+0000 7efc97400640 1 -- 172.21.15.114:0/4039797635 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7efc8c019430 con 0x7efca01f7ea0 2024-09-16T07:34:42.497 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efc80073520 msgr2=0x7efc800759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efc80073520 0x7efc800759e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc90000c10 tx=0x7efc90006d20 comp rx=0 tx=0).stop 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca01f7ea0 msgr2=0x7efca00b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca01f7ea0 0x7efca00b5090 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7efc8c026390 tx=0x7efc8c001e10 comp rx=0 tx=0).stop 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 shutdown_connections 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efca0155b30 0x7efca0155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca01f7ea0 0x7efca00b5090 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efc80073520 0x7efc800759e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 --2- 172.21.15.114:0/4039797635 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efc84004810 0x7efca00ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 >> 172.21.15.114:0/4039797635 conn(0x7efca00cfa00 msgr2=0x7efca00ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 shutdown_connections 2024-09-16T07:34:42.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.501+0000 7efca5200640 1 -- 172.21.15.114:0/4039797635 wait complete. 2024-09-16T07:34:42.518 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-16T07:34:42.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- 172.21.15.114:0/3223409904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 msgr2=0x7fd6a40d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 --2- 172.21.15.114:0/3223409904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 0x7fd6a40d0c40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009840 tx=0x7fd68c01c820 comp rx=0 tx=0).stop 2024-09-16T07:34:42.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- 172.21.15.114:0/3223409904 shutdown_connections 2024-09-16T07:34:42.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 --2- 172.21.15.114:0/3223409904 >> v2:172.21.15.149:3300/0 conn(0x7fd6a40d1180 0x7fd6a40b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 --2- 172.21.15.114:0/3223409904 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 0x7fd6a40d0c40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- 172.21.15.114:0/3223409904 >> 172.21.15.114:0/3223409904 conn(0x7fd6a406dd30 msgr2=0x7fd6a406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- 172.21.15.114:0/3223409904 shutdown_connections 2024-09-16T07:34:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- 172.21.15.114:0/3223409904 wait complete. 2024-09-16T07:34:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 Processor -- start 2024-09-16T07:34:42.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- start start 2024-09-16T07:34:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a40d1180 0x7fd6a4164550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a415a7e0 0x7fd6a40c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 0x7fd6a415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4167ce0 con 0x7fd6a415a7e0 2024-09-16T07:34:42.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4167b60 con 0x7fd6a40d1180 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6ab400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a4167e60 con 0x7fd6a415abc0 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd69be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a415a7e0 0x7fd6a40c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd69be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a415a7e0 0x7fd6a40c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58552/0 (socket says 172.21.15.114:58552) 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd69be00640 1 -- 172.21.15.114:0/446459168 learned_addr learned my addr 172.21.15.114:0/446459168 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6a8a00640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a40d1180 0x7fd6a4164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd6a9400640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 0x7fd6a415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd69be00640 1 -- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 msgr2=0x7fd6a415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.661+0000 7fd69be00640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 0x7fd6a415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd69be00640 1 -- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a40d1180 msgr2=0x7fd6a4164550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd69be00640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a40d1180 0x7fd6a4164550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd69be00640 1 -- 172.21.15.114:0/446459168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a41fb1a0 con 0x7fd6a415a7e0 2024-09-16T07:34:42.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd69be00640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a415a7e0 0x7fd6a40c63f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009790 tx=0x7fd68c005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:42.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6a1600640 1 -- 172.21.15.114:0/446459168 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0b2040 con 0x7fd6a415a7e0 2024-09-16T07:34:42.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6a1600640 1 -- 172.21.15.114:0/446459168 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd68c004330 con 0x7fd6a415a7e0 2024-09-16T07:34:42.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a41fb440 con 0x7fd6a415a7e0 2024-09-16T07:34:42.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6a1600640 1 -- 172.21.15.114:0/446459168 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c003820 con 0x7fd6a415a7e0 2024-09-16T07:34:42.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41fbce0 con 0x7fd6a415a7e0 2024-09-16T07:34:42.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a40b48f0 con 0x7fd6a415a7e0 2024-09-16T07:34:42.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6a1600640 1 -- 172.21.15.114:0/446459168 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fd68c0bd060 con 0x7fd6a415a7e0 2024-09-16T07:34:42.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.665+0000 7fd6a1600640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd6800734f0 0x7fd6800759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:42.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.669+0000 7fd6a1600640 1 -- 172.21.15.114:0/446459168 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7fd68c12de10 con 0x7fd6a415a7e0 2024-09-16T07:34:42.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.669+0000 7fd6a8a00640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd6800734f0 0x7fd6800759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:42.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.669+0000 7fd6a8a00640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd6800734f0 0x7fd6800759b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd694001910 tx=0x7fd694001420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:42.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.669+0000 7fd6a1600640 1 -- 172.21.15.114:0/446459168 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd68c016410 con 0x7fd6a415a7e0 2024-09-16T07:34:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:42.901+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7fd6a4070fd0 con 0x7fd6a415a7e0 2024-09-16T07:34:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.813+0000 7fd6a1600640 1 -- 172.21.15.114:0/446459168 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v360) ==== 154+0+0 (secure 0 0 0) 0x7fd6a4070fd0 con 0x7fd6a415a7e0 2024-09-16T07:34:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd6800734f0 msgr2=0x7fd6800759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd6800734f0 0x7fd6800759b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd694001910 tx=0x7fd694001420 comp rx=0 tx=0).stop 2024-09-16T07:34:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a415a7e0 msgr2=0x7fd6a40c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a415a7e0 0x7fd6a40c63f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009790 tx=0x7fd68c005ca0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 shutdown_connections 2024-09-16T07:34:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd6800734f0 0x7fd6800759b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6a415abc0 0x7fd6a415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6a415a7e0 0x7fd6a40c63f0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 --2- 172.21.15.114:0/446459168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6a40d1180 0x7fd6a4164550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 >> 172.21.15.114:0/446459168 conn(0x7fd6a406dd30 msgr2=0x7fd6a40afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 shutdown_connections 2024-09-16T07:34:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.817+0000 7fd6ab400640 1 -- 172.21.15.114:0/446459168 wait complete. 2024-09-16T07:34:43.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:34:43.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 -- 172.21.15.114:0/3417868783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab040afac0 msgr2=0x7fab040d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:43.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 --2- 172.21.15.114:0/3417868783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab040afac0 0x7fab040d0960 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fab04072dd0 tx=0x7faaec01cc50 comp rx=0 tx=0).stop 2024-09-16T07:34:43.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 -- 172.21.15.114:0/3417868783 shutdown_connections 2024-09-16T07:34:43.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 --2- 172.21.15.114:0/3417868783 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab040afac0 0x7fab040d0960 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 --2- 172.21.15.114:0/3417868783 >> v2:172.21.15.149:3300/0 conn(0x7fab04159990 0x7fab040d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 -- 172.21.15.114:0/3417868783 >> 172.21.15.114:0/3417868783 conn(0x7fab040b2240 msgr2=0x7fab040b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:43.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 -- 172.21.15.114:0/3417868783 shutdown_connections 2024-09-16T07:34:43.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.985+0000 7fab08e00640 1 -- 172.21.15.114:0/3417868783 wait complete. 2024-09-16T07:34:43.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 Processor -- start 2024-09-16T07:34:43.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 -- start start 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0406f1d0 0x7fab040aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab040afac0 0x7fab0415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04159990 0x7fab041572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab041691e0 con 0x7fab04159990 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab04169060 con 0x7fab0406f1d0 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fab04169360 con 0x7fab040afac0 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04159990 0x7fab041572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:43.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04159990 0x7fab041572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58566/0 (socket says 172.21.15.114:58566) 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 -- 172.21.15.114:0/1927284029 learned_addr learned my addr 172.21.15.114:0/1927284029 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab01e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0406f1d0 0x7fab040aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7faaf9400640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab040afac0 0x7fab0415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 -- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab040afac0 msgr2=0x7fab0415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab040afac0 0x7fab0415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 -- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0406f1d0 msgr2=0x7fab040aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0406f1d0 0x7fab040aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 -- 172.21.15.114:0/1927284029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab041fb820 con 0x7fab04159990 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab02800640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04159990 0x7fab041572c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7faafc00b410 tx=0x7faafc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7faafaa00640 1 -- 172.21.15.114:0/1927284029 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc015020 con 0x7fab04159990 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7faafaa00640 1 -- 172.21.15.114:0/1927284029 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faafc011960 con 0x7fab04159990 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7faafaa00640 1 -- 172.21.15.114:0/1927284029 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc011db0 con 0x7fab04159990 2024-09-16T07:34:43.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab041fbb00 con 0x7fab04159990 2024-09-16T07:34:43.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.989+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab041fc0c0 con 0x7fab04159990 2024-09-16T07:34:43.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.993+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0406cc20 con 0x7fab04159990 2024-09-16T07:34:43.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.993+0000 7faafaa00640 1 -- 172.21.15.114:0/1927284029 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7faafc018020 con 0x7fab04159990 2024-09-16T07:34:43.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.993+0000 7faafaa00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae00734f0 0x7faae00759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:43.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.993+0000 7faafaa00640 1 -- 172.21.15.114:0/1927284029 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7faafc0941a0 con 0x7fab04159990 2024-09-16T07:34:43.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.993+0000 7fab01e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae00734f0 0x7faae00759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:43.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.993+0000 7fab01e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae00734f0 0x7faae00759b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab0414c970 tx=0x7faaf400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:43.997+0000 7faafaa00640 1 -- 172.21.15.114:0/1927284029 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7faafc01f030 con 0x7fab04159990 2024-09-16T07:34:44.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fab04068a80 con 0x7fab04159990 2024-09-16T07:34:44.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7faafaa00640 1 -- 172.21.15.114:0/1927284029 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+1998 (secure 0 0 0) 0x7faafc05e6c0 con 0x7fab04159990 2024-09-16T07:34:44.164 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:34:44.164 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:34:44.164 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:34:44.164 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:34:44.165 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:34:44.166 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:34:44.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae00734f0 msgr2=0x7faae00759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae00734f0 0x7faae00759b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fab0414c970 tx=0x7faaf400b390 comp rx=0 tx=0).stop 2024-09-16T07:34:44.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04159990 msgr2=0x7fab041572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04159990 0x7fab041572c0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7faafc00b410 tx=0x7faafc00b8d0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 shutdown_connections 2024-09-16T07:34:44.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab04159990 0x7fab041572c0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faae00734f0 0x7faae00759b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fab040afac0 0x7fab0415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 --2- 172.21.15.114:0/1927284029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab0406f1d0 0x7fab040aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 >> 172.21.15.114:0/1927284029 conn(0x7fab040b2240 msgr2=0x7fab0414d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:44.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 shutdown_connections 2024-09-16T07:34:44.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.165+0000 7fab08e00640 1 -- 172.21.15.114:0/1927284029 wait complete. 2024-09-16T07:34:44.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:34:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- 172.21.15.114:0/2187159441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 msgr2=0x7f8318004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 --2- 172.21.15.114:0/2187159441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 0x7f8318004c90 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f831c006fc0 tx=0x7f831c01f660 comp rx=0 tx=0).stop 2024-09-16T07:34:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8336000640 1 -- 172.21.15.114:0/2187159441 reap_dead start 2024-09-16T07:34:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- 172.21.15.114:0/2187159441 shutdown_connections 2024-09-16T07:34:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- 172.21.15.114:0/2187159441 >> 172.21.15.114:0/2187159441 conn(0x7f83300d1dd0 msgr2=0x7f83300d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- 172.21.15.114:0/2187159441 shutdown_connections 2024-09-16T07:34:44.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- 172.21.15.114:0/2187159441 wait complete. 2024-09-16T07:34:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 Processor -- start 2024-09-16T07:34:44.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- start start 2024-09-16T07:34:44.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 0x7f83301546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83300cdf40 0x7f83300ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83300c8150 0x7f83300c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83300b1220 con 0x7f8318004810 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f83300b0ee0 con 0x7f83300c8150 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8338000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f83300b13a0 con 0x7f83300cdf40 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 0x7f83301546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 0x7f83301546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41308/0 (socket says 172.21.15.114:41308) 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 -- 172.21.15.114:0/1138680135 learned_addr learned my addr 172.21.15.114:0/1138680135 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8336000640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83300c8150 0x7f83300c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8334c00640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83300cdf40 0x7f83300ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 -- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83300cdf40 msgr2=0x7f83300ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83300cdf40 0x7f83300ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 -- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83300c8150 msgr2=0x7f83300c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83300c8150 0x7f83300c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.333+0000 7f8335600640 1 -- 172.21.15.114:0/1138680135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83300c8b40 con 0x7f8318004810 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f8335600640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 0x7f83301546a0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8324003f20 tx=0x7f8324001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f832d600640 1 -- 172.21.15.114:0/1138680135 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324011640 con 0x7f8318004810 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f832d600640 1 -- 172.21.15.114:0/1138680135 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8324016020 con 0x7f8318004810 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83300b4dc0 con 0x7f8318004810 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f832d600640 1 -- 172.21.15.114:0/1138680135 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324011a80 con 0x7f8318004810 2024-09-16T07:34:44.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83300b5380 con 0x7f8318004810 2024-09-16T07:34:44.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83300b1a30 con 0x7f8318004810 2024-09-16T07:34:44.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f832d600640 1 -- 172.21.15.114:0/1138680135 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f8324011c20 con 0x7f8318004810 2024-09-16T07:34:44.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f832d600640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8310073520 0x7f83100759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f832d600640 1 -- 172.21.15.114:0/1138680135 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f8324095340 con 0x7f8318004810 2024-09-16T07:34:44.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.337+0000 7f8334c00640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8310073520 0x7f83100759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.341+0000 7f8334c00640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8310073520 0x7f83100759e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f831c0b0000 tx=0x7f831c01c4a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:44.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.341+0000 7f832d600640 1 -- 172.21.15.114:0/1138680135 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8324020020 con 0x7f8318004810 2024-09-16T07:34:44.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.509+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f83300d1080 con 0x7f8318004810 2024-09-16T07:34:44.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f832d600640 1 -- 172.21.15.114:0/1138680135 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f832405fe70 con 0x7f8318004810 2024-09-16T07:34:44.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8310073520 msgr2=0x7f83100759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8310073520 0x7f83100759e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f831c0b0000 tx=0x7f831c01c4a0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 msgr2=0x7f83301546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 0x7f83301546a0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f8324003f20 tx=0x7f8324001700 comp rx=0 tx=0).stop 2024-09-16T07:34:44.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 shutdown_connections 2024-09-16T07:34:44.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83300c8150 0x7f83300c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8310073520 0x7f83100759e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83300cdf40 0x7f83300ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 --2- 172.21.15.114:0/1138680135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8318004810 0x7f83301546a0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 >> 172.21.15.114:0/1138680135 conn(0x7f83300d1dd0 msgr2=0x7f833006f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:44.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 shutdown_connections 2024-09-16T07:34:44.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.513+0000 7f8338000640 1 -- 172.21.15.114:0/1138680135 wait complete. 2024-09-16T07:34:44.535 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:34:44.535 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:34:44.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:34:44.702 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:34:44.702 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:44.702 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:44.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:34:44.711 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:44.711 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:44.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:34:44.721 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:34:44.721 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:44.762 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:34:44.762 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:34:44.762 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:34:44.771 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:34:44.771 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:34:44.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:44.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 -- 172.21.15.114:0/2327102910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f44003fe0 msgr2=0x7f6f44004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 --2- 172.21.15.114:0/2327102910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f44003fe0 0x7f6f44004810 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800c4a0 tx=0x7f6f4801f6e0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f61400640 1 -- 172.21.15.114:0/2327102910 reap_dead start 2024-09-16T07:34:44.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 -- 172.21.15.114:0/2327102910 shutdown_connections 2024-09-16T07:34:44.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 -- 172.21.15.114:0/2327102910 >> 172.21.15.114:0/2327102910 conn(0x7f6f5c0d1da0 msgr2=0x7f6f5c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 -- 172.21.15.114:0/2327102910 shutdown_connections 2024-09-16T07:34:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 -- 172.21.15.114:0/2327102910 wait complete. 2024-09-16T07:34:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 Processor -- start 2024-09-16T07:34:44.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.949+0000 7f6f63400640 1 -- start start 2024-09-16T07:34:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44003fe0 0x7f6f5c09dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5c1f59d0 0x7f6f5c153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0c58d0 0x7f6f5c0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c0cedb0 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c0cec30 con 0x7f6f44003fe0 2024-09-16T07:34:44.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5c09f8e0 con 0x7f6f5c1f59d0 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0c58d0 0x7f6f5c0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0c58d0 0x7f6f5c0c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41324/0 (socket says 172.21.15.114:41324) 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 -- 172.21.15.114:0/3297452970 learned_addr learned my addr 172.21.15.114:0/3297452970 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f60a00640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44003fe0 0x7f6f5c09dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f5be00640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5c1f59d0 0x7f6f5c153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 -- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5c1f59d0 msgr2=0x7f6f5c153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5c1f59d0 0x7f6f5c153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 -- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44003fe0 msgr2=0x7f6f5c09dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:44.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44003fe0 0x7f6f5c09dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:44.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 -- 172.21.15.114:0/3297452970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c153780 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f5be00640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5c1f59d0 0x7f6f5c153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:44.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f61400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0c58d0 0x7f6f5c0c81a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f6f54011b20 tx=0x7f6f54011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f58c00640 1 -- 172.21.15.114:0/3297452970 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54004b30 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f58c00640 1 -- 172.21.15.114:0/3297452970 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f54004cd0 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f58c00640 1 -- 172.21.15.114:0/3297452970 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54005280 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5c1f5f40 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c1f6500 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5c0ce4e0 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.953+0000 7f6f58c00640 1 -- 172.21.15.114:0/3297452970 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f6f54005420 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.957+0000 7f6f58c00640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c073520 0x7f6f3c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.957+0000 7f6f58c00640 1 -- 172.21.15.114:0/3297452970 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f6f540951e0 con 0x7f6f5c0c58d0 2024-09-16T07:34:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.957+0000 7f6f60a00640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c073520 0x7f6f3c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:44.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.957+0000 7f6f60a00640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c073520 0x7f6f3c0759e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0c7b00 tx=0x7f6f500091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:44.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:44.961+0000 7f6f58c00640 1 -- 172.21.15.114:0/3297452970 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6f5405fc80 con 0x7f6f5c0c58d0 2024-09-16T07:34:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.157+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f5c15ac30 con 0x7f6f5c0c58d0 2024-09-16T07:34:45.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.157+0000 7f6f58c00640 1 -- 172.21.15.114:0/3297452970 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+3917 (secure 0 0 0) 0x7f6f5405f580 con 0x7f6f5c0c58d0 2024-09-16T07:34:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":86,"btime":"2024-09-16T07:34:38:543461+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6596,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/3249537959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":3249537959},{"type":"v1","addr":"172.21.15.114:6835","nonce":3249537959}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":86},{"gid":7120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/229459534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":229459534},{"type":"v1","addr":"172.21.15.149:6801","nonce":229459534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7123,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2285177306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2285177306},{"type":"v1","addr":"172.21.15.149:6835","nonce":2285177306}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/146376277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":146376277},{"type":"v1","addr":"172.21.15.114:6833","nonce":146376277}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-09-16T07:34:45.158 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 86 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c073520 msgr2=0x7f6f3c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c073520 0x7f6f3c0759e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0c7b00 tx=0x7f6f500091e0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0c58d0 msgr2=0x7f6f5c0c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0c58d0 0x7f6f5c0c81a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f6f54011b20 tx=0x7f6f54011f20 comp rx=0 tx=0).stop 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 shutdown_connections 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5c0c58d0 0x7f6f5c0c81a0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c073520 0x7f6f3c0759e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5c1f59d0 0x7f6f5c153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 --2- 172.21.15.114:0/3297452970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f44003fe0 0x7f6f5c09dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 >> 172.21.15.114:0/3297452970 conn(0x7f6f5c0d1da0 msgr2=0x7f6f5c070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 shutdown_connections 2024-09-16T07:34:45.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.161+0000 7f6f63400640 1 -- 172.21.15.114:0/3297452970 wait complete. 2024-09-16T07:34:45.179 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:34:45.179 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:34:45.179 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:34:45.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:45.180 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:34:45.180 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:34:45.180 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:34:45.180 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:45.180 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:34:45.180 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:34:45.181 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:34:45.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:45.181 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:34:45.181 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:34:45.181 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:34:45.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:34:45.192 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:34:45.192 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:34:45.193 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:34:45.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:34:45.196 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:34:45.197 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:34:45.197 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:34:45.198 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:34:45.240 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:34:45.241 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:45.241 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:34:45.242 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:45.242 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:34:45.242 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:45.243 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:34:45.243 DEBUG:teuthology.parallel:result is None 2024-09-16T07:34:45.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:34:45.327 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:34:45.329 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:34:45.329 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:34:45.330 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:34:45.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 -- 172.21.15.114:0/2805770194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 msgr2=0x7f28100cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:45.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 --2- 172.21.15.114:0/2805770194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f28100cc5b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009900 tx=0x7f27fc01c850 comp rx=0 tx=0).stop 2024-09-16T07:34:45.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 -- 172.21.15.114:0/2805770194 shutdown_connections 2024-09-16T07:34:45.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 --2- 172.21.15.114:0/2805770194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f28100cc5b0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 --2- 172.21.15.114:0/2805770194 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f281015f000 0x7f28100d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 -- 172.21.15.114:0/2805770194 >> 172.21.15.114:0/2805770194 conn(0x7f281009aa10 msgr2=0x7f281009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:45.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 -- 172.21.15.114:0/2805770194 shutdown_connections 2024-09-16T07:34:45.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.393+0000 7f2815400640 1 -- 172.21.15.114:0/2805770194 wait complete. 2024-09-16T07:34:45.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 Processor -- start 2024-09-16T07:34:45.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 -- start start 2024-09-16T07:34:45.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28100ccaf0 0x7f28100b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f2810142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f281015f000 0x7f2810155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2810169290 con 0x7f28100cefb0 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2810169110 con 0x7f281015f000 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2810169410 con 0x7f28100ccaf0 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f2810142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f2810142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41384/0 (socket says 172.21.15.114:41384) 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 -- 172.21.15.114:0/956239047 learned_addr learned my addr 172.21.15.114:0/956239047 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2814a00640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f281015f000 0x7f2810155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:45.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280fe00640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28100ccaf0 0x7f28100b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:45.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 -- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28100ccaf0 msgr2=0x7f28100b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:45.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28100ccaf0 0x7f28100b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 -- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f281015f000 msgr2=0x7f2810155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f281015f000 0x7f2810155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 -- 172.21.15.114:0/956239047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2810151570 con 0x7f28100cefb0 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f280f400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f2810142bf0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f27fc01d0f0 tx=0x7f27fc0a65b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2807e00640 1 -- 172.21.15.114:0/956239047 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0ac070 con 0x7f28100cefb0 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2807e00640 1 -- 172.21.15.114:0/956239047 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27fc004320 con 0x7f28100cefb0 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2810151810 con 0x7f28100cefb0 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2807e00640 1 -- 172.21.15.114:0/956239047 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0044f0 con 0x7f28100cefb0 2024-09-16T07:34:45.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2810151dd0 con 0x7f28100cefb0 2024-09-16T07:34:45.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.397+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28100cc5b0 con 0x7f28100cefb0 2024-09-16T07:34:45.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.401+0000 7f2807e00640 1 -- 172.21.15.114:0/956239047 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f27fc0af070 con 0x7f28100cefb0 2024-09-16T07:34:45.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.401+0000 7f2807e00640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27f00734f0 0x7f27f00759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:45.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.401+0000 7f2807e00640 1 -- 172.21.15.114:0/956239047 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f27fc12ec90 con 0x7f28100cefb0 2024-09-16T07:34:45.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.401+0000 7f280fe00640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27f00734f0 0x7f27f00759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:45.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.401+0000 7f280fe00640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27f00734f0 0x7f27f00759b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28101f93b0 tx=0x7f280000a590 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:45.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.405+0000 7f2807e00640 1 -- 172.21.15.114:0/956239047 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f27fc0164d0 con 0x7f28100cefb0 2024-09-16T07:34:45.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.589+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f28100cbcd0 con 0x7f28100cefb0 2024-09-16T07:34:45.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.837+0000 7f2807e00640 1 -- 172.21.15.114:0/956239047 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) ==== 97+0+0 (secure 0 0 0) 0x7f27fc0f9170 con 0x7f28100cefb0 2024-09-16T07:34:45.839 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27f00734f0 msgr2=0x7f27f00759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27f00734f0 0x7f27f00759b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f28101f93b0 tx=0x7f280000a590 comp rx=0 tx=0).stop 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 msgr2=0x7f2810142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f2810142bf0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f27fc01d0f0 tx=0x7f27fc0a65b0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 shutdown_connections 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f281015f000 0x7f2810155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28100cefb0 0x7f2810142bf0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f27f00734f0 0x7f27f00759b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 --2- 172.21.15.114:0/956239047 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f28100ccaf0 0x7f28100b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:45.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 >> 172.21.15.114:0/956239047 conn(0x7f281009aa10 msgr2=0x7f28100ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:45.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 shutdown_connections 2024-09-16T07:34:45.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:45.841+0000 7f2815400640 1 -- 172.21.15.114:0/956239047 wait complete. 2024-09-16T07:34:45.861 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:34:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- 172.21.15.114:0/1754428274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad815dae0 msgr2=0x7fcad80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 --2- 172.21.15.114:0/1754428274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad815dae0 0x7fcad80acd40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fcad80af800 tx=0x7fcac801c830 comp rx=0 tx=0).stop 2024-09-16T07:34:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- 172.21.15.114:0/1754428274 shutdown_connections 2024-09-16T07:34:46.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 --2- 172.21.15.114:0/1754428274 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcad80b4810 0x7fcad80ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 --2- 172.21.15.114:0/1754428274 >> v2:172.21.15.149:3300/0 conn(0x7fcad80cd100 0x7fcad80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 --2- 172.21.15.114:0/1754428274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad815dae0 0x7fcad80acd40 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- 172.21.15.114:0/1754428274 >> 172.21.15.114:0/1754428274 conn(0x7fcad80b18f0 msgr2=0x7fcad80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:46.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- 172.21.15.114:0/1754428274 shutdown_connections 2024-09-16T07:34:46.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- 172.21.15.114:0/1754428274 wait complete. 2024-09-16T07:34:46.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 Processor -- start 2024-09-16T07:34:46.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- start start 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcad80b4810 0x7fcad815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad80cd100 0x7fcad81fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad815dae0 0x7fcad80c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcad806ee90 con 0x7fcad80cd100 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcad806ed10 con 0x7fcad815dae0 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcad806f010 con 0x7fcad80b4810 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcacf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad80cd100 0x7fcad81fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcacf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad80cd100 0x7fcad81fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41400/0 (socket says 172.21.15.114:41400) 2024-09-16T07:34:46.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcacf400640 1 -- 172.21.15.114:0/4101191707 learned_addr learned my addr 172.21.15.114:0/4101191707 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcad7e00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcad80b4810 0x7fcad815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.005+0000 7fcadcc00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad815dae0 0x7fcad80c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad7e00640 1 -- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad815dae0 msgr2=0x7fcad80c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad7e00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad815dae0 0x7fcad80c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad7e00640 1 -- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad80cd100 msgr2=0x7fcad81fb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad7e00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad80cd100 0x7fcad81fb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad7e00640 1 -- 172.21.15.114:0/4101191707 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad81fbc00 con 0x7fcad80b4810 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcacf400640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad80cd100 0x7fcad81fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad7e00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcad80b4810 0x7fcad815ca20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcac80ac000 tx=0x7fcac80a56b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad4c00640 1 -- 172.21.15.114:0/4101191707 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac80b2040 con 0x7fcad80b4810 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad4c00640 1 -- 172.21.15.114:0/4101191707 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcac8004430 con 0x7fcad80b4810 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad4c00640 1 -- 172.21.15.114:0/4101191707 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8003860 con 0x7fcad80b4810 2024-09-16T07:34:46.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad81fbee0 con 0x7fcad80b4810 2024-09-16T07:34:46.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad815cf60 con 0x7fcad80b4810 2024-09-16T07:34:46.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad8069410 con 0x7fcad80b4810 2024-09-16T07:34:46.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad4c00640 1 -- 172.21.15.114:0/4101191707 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fcac8003a00 con 0x7fcad80b4810 2024-09-16T07:34:46.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad4c00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcab4073520 0x7fcab40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.009+0000 7fcad4c00640 1 -- 172.21.15.114:0/4101191707 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(125..125 src has 1..125) ==== 4885+0+0 (secure 0 0 0) 0x7fcac812df40 con 0x7fcad80b4810 2024-09-16T07:34:46.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.013+0000 7fcacf400640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcab4073520 0x7fcab40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.013+0000 7fcacf400640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcab4073520 0x7fcab40759e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcad809e190 tx=0x7fcac0005f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:46.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.017+0000 7fcad4c00640 1 -- 172.21.15.114:0/4101191707 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcac80164b0 con 0x7fcad80b4810 2024-09-16T07:34:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcad81fc0b0 con 0x7fcad80b4810 2024-09-16T07:34:46.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcad4c00640 1 -- 172.21.15.114:0/4101191707 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7fcac80f8470 con 0x7fcad80b4810 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.240 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.241 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:34:46.242 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.243 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:34:46.244 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.245 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:34:46.246 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.247 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.248 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:34:46.249 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:34:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:34:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.250 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:34:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:34:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:34:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.251 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:34:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:34:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:34:46.252 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:34:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:34:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:34:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:34:46.253 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.254 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.255 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.256 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:34:46.257 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:34:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.258 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:34:46.258 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:34:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcab4073520 msgr2=0x7fcab40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcab4073520 0x7fcab40759e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcad809e190 tx=0x7fcac0005f90 comp rx=0 tx=0).stop 2024-09-16T07:34:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcad80b4810 msgr2=0x7fcad815ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcad80b4810 0x7fcad815ca20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcac80ac000 tx=0x7fcac80a56b0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 shutdown_connections 2024-09-16T07:34:46.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcad815dae0 0x7fcad80c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcad80cd100 0x7fcad81fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcab4073520 0x7fcab40759e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 --2- 172.21.15.114:0/4101191707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcad80b4810 0x7fcad815ca20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 >> 172.21.15.114:0/4101191707 conn(0x7fcad80b18f0 msgr2=0x7fcad81677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:46.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 shutdown_connections 2024-09-16T07:34:46.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.241+0000 7fcadec00640 1 -- 172.21.15.114:0/4101191707 wait complete. 2024-09-16T07:34:46.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:34:46.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- 172.21.15.114:0/949692553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a80cdb30 msgr2=0x7ff3a80aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 --2- 172.21.15.114:0/949692553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a80cdb30 0x7ff3a80aeef0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009bc0 tx=0x7ff3a001cba0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- 172.21.15.114:0/949692553 shutdown_connections 2024-09-16T07:34:46.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 --2- 172.21.15.114:0/949692553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a80cdb30 0x7ff3a80aeef0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 --2- 172.21.15.114:0/949692553 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3a80ced80 0x7ff3a80ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- 172.21.15.114:0/949692553 >> 172.21.15.114:0/949692553 conn(0x7ff3a80d1dc0 msgr2=0x7ff3a80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:46.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- 172.21.15.114:0/949692553 shutdown_connections 2024-09-16T07:34:46.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- 172.21.15.114:0/949692553 wait complete. 2024-09-16T07:34:46.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 Processor -- start 2024-09-16T07:34:46.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- start start 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3a80cdb30 0x7ff3a8158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a815bea0 0x7ff3a80b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a8169340 con 0x7ff3a815bea0 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a81691c0 con 0x7ff3a80ced80 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3b0000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a81694c0 con 0x7ff3a80cdb30 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a815bea0 0x7ff3a80b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a815bea0 0x7ff3a80b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41422/0 (socket says 172.21.15.114:41422) 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 -- 172.21.15.114:0/4165550168 learned_addr learned my addr 172.21.15.114:0/4165550168 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3acc00640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ad600640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3a80cdb30 0x7ff3a8158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 -- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3a80cdb30 msgr2=0x7ff3a8158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3a80cdb30 0x7ff3a8158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 -- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3a80ced80 msgr2=0x7ff3a80c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ae000640 1 -- 172.21.15.114:0/4165550168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a806fd40 con 0x7ff3a815bea0 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.405+0000 7ff3ad600640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3a80cdb30 0x7ff3a8158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3ae000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a815bea0 0x7ff3a80b2b90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff3a001a7d0 tx=0x7ff3a0003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3a5600640 1 -- 172.21.15.114:0/4165550168 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00b2040 con 0x7ff3a815bea0 2024-09-16T07:34:46.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3a5600640 1 -- 172.21.15.114:0/4165550168 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3a0004d40 con 0x7ff3a815bea0 2024-09-16T07:34:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3a5600640 1 -- 172.21.15.114:0/4165550168 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0004210 con 0x7ff3a815bea0 2024-09-16T07:34:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a806fa60 con 0x7ff3a815bea0 2024-09-16T07:34:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a80b2390 con 0x7ff3a815bea0 2024-09-16T07:34:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a80ce670 con 0x7ff3a815bea0 2024-09-16T07:34:46.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.409+0000 7ff3a5600640 1 -- 172.21.15.114:0/4165550168 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7ff3a00be060 con 0x7ff3a815bea0 2024-09-16T07:34:46.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.413+0000 7ff3a5600640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3880734f0 0x7ff3880759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.413+0000 7ff3a5600640 1 -- 172.21.15.114:0/4165550168 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4885+0+0 (secure 0 0 0) 0x7ff3a012e300 con 0x7ff3a815bea0 2024-09-16T07:34:46.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.413+0000 7ff3ad600640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3880734f0 0x7ff3880759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.413+0000 7ff3ad600640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3880734f0 0x7ff3880759b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff39c007a60 tx=0x7ff39c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:46.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.417+0000 7ff3a5600640 1 -- 172.21.15.114:0/4165550168 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff3a0016790 con 0x7ff3a815bea0 2024-09-16T07:34:46.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff3a80aed50 con 0x7ff3a815bea0 2024-09-16T07:34:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3a5600640 1 -- 172.21.15.114:0/4165550168 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) ==== 84+0+65 (secure 0 0 0) 0x7ff3a00f8f40 con 0x7ff3a815bea0 2024-09-16T07:34:46.584 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:46.584 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:34:46.584 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:34:46.584 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:34:46.584 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:34:46.584 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:34:46.585 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:34:46.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3880734f0 msgr2=0x7ff3880759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3880734f0 0x7ff3880759b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff39c007a60 tx=0x7ff39c009040 comp rx=0 tx=0).stop 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a815bea0 msgr2=0x7ff3a80b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a815bea0 0x7ff3a80b2b90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff3a001a7d0 tx=0x7ff3a0003f60 comp rx=0 tx=0).stop 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 shutdown_connections 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3a815bea0 0x7ff3a80b2b90 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3880734f0 0x7ff3880759b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 --2- 172.21.15.114:0/4165550168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3a80cdb30 0x7ff3a8158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 >> 172.21.15.114:0/4165550168 conn(0x7ff3a80d1dc0 msgr2=0x7ff3a80b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 shutdown_connections 2024-09-16T07:34:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.585+0000 7ff3b0000640 1 -- 172.21.15.114:0/4165550168 wait complete. 2024-09-16T07:34:46.605 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:34:46.605 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:34:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- 172.21.15.114:0/2175822506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 msgr2=0x7fbfe80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 --2- 172.21.15.114:0/2175822506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 0x7fbfe80ccbd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009840 tx=0x7fbfe001f010 comp rx=0 tx=0).stop 2024-09-16T07:34:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- 172.21.15.114:0/2175822506 shutdown_connections 2024-09-16T07:34:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 --2- 172.21.15.114:0/2175822506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 0x7fbfe80ccbd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 --2- 172.21.15.114:0/2175822506 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfe815be10 0x7fbfe80ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- 172.21.15.114:0/2175822506 >> 172.21.15.114:0/2175822506 conn(0x7fbfe80d1da0 msgr2=0x7fbfe80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- 172.21.15.114:0/2175822506 shutdown_connections 2024-09-16T07:34:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- 172.21.15.114:0/2175822506 wait complete. 2024-09-16T07:34:46.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 Processor -- start 2024-09-16T07:34:46.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- start start 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 0x7fbfe81f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfe815be10 0x7fbfe80c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815c1f0 0x7fbfe8146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe80cd320 con 0x7fbfe815c1f0 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe80cf590 con 0x7fbfe80b0b60 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfeee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe80cd4a0 con 0x7fbfe815be10 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfece00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815c1f0 0x7fbfe8146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfece00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815c1f0 0x7fbfe8146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41428/0 (socket says 172.21.15.114:41428) 2024-09-16T07:34:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfece00640 1 -- 172.21.15.114:0/325779034 learned_addr learned my addr 172.21.15.114:0/325779034 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfe7e00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 0x7fbfe81f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.753+0000 7fbfdf400640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfe815be10 0x7fbfe80c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfece00640 1 -- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfe815be10 msgr2=0x7fbfe80c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfece00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfe815be10 0x7fbfe80c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfece00640 1 -- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 msgr2=0x7fbfe81f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfece00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 0x7fbfe81f3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfece00640 1 -- 172.21.15.114:0/325779034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe81552b0 con 0x7fbfe815c1f0 2024-09-16T07:34:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfece00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815c1f0 0x7fbfe8146df0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbfe001cc40 tx=0x7fbfe0004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfe4c00640 1 -- 172.21.15.114:0/325779034 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00b5040 con 0x7fbfe815c1f0 2024-09-16T07:34:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfe4c00640 1 -- 172.21.15.114:0/325779034 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfe0005220 con 0x7fbfe815c1f0 2024-09-16T07:34:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe8155590 con 0x7fbfe815c1f0 2024-09-16T07:34:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfe4c00640 1 -- 172.21.15.114:0/325779034 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00046d0 con 0x7fbfe815c1f0 2024-09-16T07:34:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe8155b50 con 0x7fbfe815c1f0 2024-09-16T07:34:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe80ccbd0 con 0x7fbfe815c1f0 2024-09-16T07:34:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfe4c00640 1 -- 172.21.15.114:0/325779034 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fbfe00c1060 con 0x7fbfe815c1f0 2024-09-16T07:34:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.757+0000 7fbfe4c00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfc4073520 0x7fbfc40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.761+0000 7fbfe4c00640 1 -- 172.21.15.114:0/325779034 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4885+0+0 (secure 0 0 0) 0x7fbfe0131250 con 0x7fbfe815c1f0 2024-09-16T07:34:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.761+0000 7fbfe7e00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfc4073520 0x7fbfc40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:46.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.761+0000 7fbfe7e00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfc4073520 0x7fbfc40759e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009f60 tx=0x7fbfd8009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:46.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.765+0000 7fbfe4c00640 1 -- 172.21.15.114:0/325779034 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbfe0018b70 con 0x7fbfe815c1f0 2024-09-16T07:34:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:46.937+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbfe8070350 con 0x7fbfe815c1f0 2024-09-16T07:34:47.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.857+0000 7fbfe4c00640 1 -- 172.21.15.114:0/325779034 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) ==== 138+0+0 (secure 0 0 0) 0x7fbfe00fb780 con 0x7fbfe815c1f0 2024-09-16T07:34:47.855 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfc4073520 msgr2=0x7fbfc40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfc4073520 0x7fbfc40759e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009f60 tx=0x7fbfd8009500 comp rx=0 tx=0).stop 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815c1f0 msgr2=0x7fbfe8146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815c1f0 0x7fbfe8146df0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbfe001cc40 tx=0x7fbfe0004620 comp rx=0 tx=0).stop 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 shutdown_connections 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815c1f0 0x7fbfe8146df0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbfc4073520 0x7fbfc40759e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbfe815be10 0x7fbfe80c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 --2- 172.21.15.114:0/325779034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbfe80b0b60 0x7fbfe81f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 >> 172.21.15.114:0/325779034 conn(0x7fbfe80d1da0 msgr2=0x7fbfe8070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 shutdown_connections 2024-09-16T07:34:47.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:47.861+0000 7fbfeee00640 1 -- 172.21.15.114:0/325779034 wait complete. 2024-09-16T07:34:47.886 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:34:48.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- 172.21.15.114:0/2992136510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 msgr2=0x7f70d006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:48.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 --2- 172.21.15.114:0/2992136510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 0x7f70d006f7b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f70c800a950 tx=0x7f70c801da00 comp rx=0 tx=0).stop 2024-09-16T07:34:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- 172.21.15.114:0/2992136510 shutdown_connections 2024-09-16T07:34:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 --2- 172.21.15.114:0/2992136510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 0x7f70d006f7b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 --2- 172.21.15.114:0/2992136510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70d015dae0 0x7f70d00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- 172.21.15.114:0/2992136510 >> 172.21.15.114:0/2992136510 conn(0x7f70d00b18f0 msgr2=0x7f70d00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- 172.21.15.114:0/2992136510 shutdown_connections 2024-09-16T07:34:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- 172.21.15.114:0/2992136510 wait complete. 2024-09-16T07:34:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 Processor -- start 2024-09-16T07:34:48.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- start start 2024-09-16T07:34:48.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 0x7f70d01496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70d00cd100 0x7f70d01fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d015dae0 0x7f70d01631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f70d00cf1f0 con 0x7f70d015dae0 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70d00cf070 con 0x7f70d00b49e0 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.041+0000 7f70d8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f70d00cf370 con 0x7f70d00cd100 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d015dae0 0x7f70d01631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70d00cd100 0x7f70d01fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d015dae0 0x7f70d01631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41436/0 (socket says 172.21.15.114:41436) 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 -- 172.21.15.114:0/287803703 learned_addr learned my addr 172.21.15.114:0/287803703 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d5800640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 0x7f70d01496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 -- 172.21.15.114:0/287803703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70d00cd100 msgr2=0x7f70d01fadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70d00cd100 0x7f70d01fadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 -- 172.21.15.114:0/287803703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 msgr2=0x7f70d01496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 0x7f70d01496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 -- 172.21.15.114:0/287803703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d01f79c0 con 0x7f70d015dae0 2024-09-16T07:34:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d6200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d015dae0 0x7f70d01631c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f70c801c0b0 tx=0x7f70c8004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70cd600640 1 -- 172.21.15.114:0/287803703 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80bc070 con 0x7f70d015dae0 2024-09-16T07:34:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70cd600640 1 -- 172.21.15.114:0/287803703 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70c80a6bd0 con 0x7f70d015dae0 2024-09-16T07:34:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d01fb530 con 0x7f70d015dae0 2024-09-16T07:34:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70cd600640 1 -- 172.21.15.114:0/287803703 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80b3040 con 0x7f70d015dae0 2024-09-16T07:34:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d01fbaf0 con 0x7f70d015dae0 2024-09-16T07:34:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.045+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d0069410 con 0x7f70d015dae0 2024-09-16T07:34:48.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.049+0000 7f70cd600640 1 -- 172.21.15.114:0/287803703 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f70c80bf070 con 0x7f70d015dae0 2024-09-16T07:34:48.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.049+0000 7f70cd600640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70b0073520 0x7f70b00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:48.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.049+0000 7f70cd600640 1 -- 172.21.15.114:0/287803703 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5255+0+0 (secure 0 0 0) 0x7f70c812e5a0 con 0x7f70d015dae0 2024-09-16T07:34:48.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.049+0000 7f70d5800640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70b0073520 0x7f70b00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:48.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.049+0000 7f70d5800640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70b0073520 0x7f70b00759e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70d0162c10 tx=0x7f70c4009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:48.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.053+0000 7f70cd600640 1 -- 172.21.15.114:0/287803703 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f70c80c6020 con 0x7f70d015dae0 2024-09-16T07:34:48.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.221+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f70d01f77d0 con 0x7f70d015dae0 2024-09-16T07:34:48.398 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:34:48.401 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:34:48.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70cd600640 1 -- 172.21.15.114:0/287803703 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) ==== 170+0+0 (secure 0 0 0) 0x7f70c8017680 con 0x7f70d015dae0 2024-09-16T07:34:48.863 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:34:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70b0073520 msgr2=0x7f70b00759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70b0073520 0x7f70b00759e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70d0162c10 tx=0x7f70c4009500 comp rx=0 tx=0).stop 2024-09-16T07:34:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d015dae0 msgr2=0x7f70d01631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d015dae0 0x7f70d01631c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f70c801c0b0 tx=0x7f70c8004620 comp rx=0 tx=0).stop 2024-09-16T07:34:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 shutdown_connections 2024-09-16T07:34:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70d015dae0 0x7f70d01631c0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70b0073520 0x7f70b00759e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70d00cd100 0x7f70d01fadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 --2- 172.21.15.114:0/287803703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70d00b49e0 0x7f70d01496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:48.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 >> 172.21.15.114:0/287803703 conn(0x7f70d00b18f0 msgr2=0x7f70d0072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:48.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.865+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 shutdown_connections 2024-09-16T07:34:48.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:48.869+0000 7f70d8200640 1 -- 172.21.15.114:0/287803703 wait complete. 2024-09-16T07:34:48.900 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:34:49.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.045+0000 7fed51a00640 1 -- 172.21.15.114:0/358308941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 msgr2=0x7fed4c15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.045+0000 7fed51a00640 1 --2- 172.21.15.114:0/358308941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c15f950 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009930 tx=0x7fed3c01c790 comp rx=0 tx=0).stop 2024-09-16T07:34:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.045+0000 7fed51a00640 1 -- 172.21.15.114:0/358308941 shutdown_connections 2024-09-16T07:34:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.045+0000 7fed51a00640 1 --2- 172.21.15.114:0/358308941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c15f950 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.045+0000 7fed51a00640 1 -- 172.21.15.114:0/358308941 >> 172.21.15.114:0/358308941 conn(0x7fed4c0b18f0 msgr2=0x7fed4c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.045+0000 7fed51a00640 1 -- 172.21.15.114:0/358308941 shutdown_connections 2024-09-16T07:34:49.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.045+0000 7fed51a00640 1 -- 172.21.15.114:0/358308941 wait complete. 2024-09-16T07:34:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 Processor -- start 2024-09-16T07:34:49.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 -- start start 2024-09-16T07:34:49.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed4c0745a0 0x7fed4c141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:49.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed4c0cd500 0x7fed4c164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:49.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c0cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:49.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c16a670 con 0x7fed4c15bdf0 2024-09-16T07:34:49.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c16a4f0 con 0x7fed4c0cd500 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed4c16a7f0 con 0x7fed4c0745a0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c0cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c0cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41446/0 (socket says 172.21.15.114:41446) 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 -- 172.21.15.114:0/3673648411 learned_addr learned my addr 172.21.15.114:0/3673648411 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4aa00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed4c0745a0 0x7fed4c141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed42000640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed4c0cd500 0x7fed4c164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 -- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed4c0745a0 msgr2=0x7fed4c141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed4c0745a0 0x7fed4c141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 -- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed4c0cd500 msgr2=0x7fed4c164d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed4c0cd500 0x7fed4c164d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 -- 172.21.15.114:0/3673648411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c0cdea0 con 0x7fed4c15bdf0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed4b400640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c0cffd0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c7c0 tx=0x7fed4400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed43400640 1 -- 172.21.15.114:0/3673648411 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44003b80 con 0x7fed4c15bdf0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed43400640 1 -- 172.21.15.114:0/3673648411 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed44003d20 con 0x7fed4c15bdf0 2024-09-16T07:34:49.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed43400640 1 -- 172.21.15.114:0/3673648411 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4400aab0 con 0x7fed4c15bdf0 2024-09-16T07:34:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4c09ae90 con 0x7fed4c15bdf0 2024-09-16T07:34:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4c09d320 con 0x7fed4c15bdf0 2024-09-16T07:34:49.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.049+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4c15f950 con 0x7fed4c15bdf0 2024-09-16T07:34:49.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.053+0000 7fed43400640 1 -- 172.21.15.114:0/3673648411 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fed4400ac50 con 0x7fed4c15bdf0 2024-09-16T07:34:49.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.053+0000 7fed43400640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed28073520 0x7fed280759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:49.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.053+0000 7fed43400640 1 -- 172.21.15.114:0/3673648411 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5637+0+0 (secure 0 0 0) 0x7fed44095260 con 0x7fed4c15bdf0 2024-09-16T07:34:49.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.053+0000 7fed4aa00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed28073520 0x7fed280759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:49.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.057+0000 7fed4aa00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed28073520 0x7fed280759e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0af000 tx=0x7fed3c01afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:49.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.057+0000 7fed43400640 1 -- 172.21.15.114:0/3673648411 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fed4405f490 con 0x7fed4c15bdf0 2024-09-16T07:34:49.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.257+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fed4c15c2e0 con 0x7fed4c15bdf0 2024-09-16T07:34:49.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.865+0000 7fed43400640 1 -- 172.21.15.114:0/3673648411 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v89) ==== 174+0+0 (secure 0 0 0) 0x7fed44068020 con 0x7fed4c15bdf0 2024-09-16T07:34:49.866 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 20 and data pool 21 2024-09-16T07:34:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed28073520 msgr2=0x7fed280759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed28073520 0x7fed280759e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0af000 tx=0x7fed3c01afd0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 msgr2=0x7fed4c0cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c0cffd0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c7c0 tx=0x7fed4400cc80 comp rx=0 tx=0).stop 2024-09-16T07:34:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 shutdown_connections 2024-09-16T07:34:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed4c15bdf0 0x7fed4c0cffd0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed4c0cd500 0x7fed4c164d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed28073520 0x7fed280759e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 --2- 172.21.15.114:0/3673648411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed4c0745a0 0x7fed4c141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:49.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.869+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 >> 172.21.15.114:0/3673648411 conn(0x7fed4c0b18f0 msgr2=0x7fed4c15eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:49.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.873+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 shutdown_connections 2024-09-16T07:34:49.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:49.873+0000 7fed51a00640 1 -- 172.21.15.114:0/3673648411 wait complete. 2024-09-16T07:34:49.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:50.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 -- 172.21.15.114:0/1733262188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 msgr2=0x7fa7f40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 --2- 172.21.15.114:0/1733262188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40ce670 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40cc3a0 tx=0x7fa7e801c770 comp rx=0 tx=0).stop 2024-09-16T07:34:50.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 -- 172.21.15.114:0/1733262188 shutdown_connections 2024-09-16T07:34:50.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 --2- 172.21.15.114:0/1733262188 >> v2:172.21.15.149:3300/0 conn(0x7fa7f40d28e0 0x7fa7f40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 --2- 172.21.15.114:0/1733262188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40ce670 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 -- 172.21.15.114:0/1733262188 >> 172.21.15.114:0/1733262188 conn(0x7fa7f40d1dc0 msgr2=0x7fa7f40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:50.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 -- 172.21.15.114:0/1733262188 shutdown_connections 2024-09-16T07:34:50.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 -- 172.21.15.114:0/1733262188 wait complete. 2024-09-16T07:34:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.065+0000 7fa7fb800640 1 Processor -- start 2024-09-16T07:34:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 -- start start 2024-09-16T07:34:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7f40cdb30 0x7fa7f4159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7f40d28e0 0x7fa7f40c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4168fc0 con 0x7fa7f415bea0 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f4168e40 con 0x7fa7f40cdb30 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f4169140 con 0x7fa7f40d28e0 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41452/0 (socket says 172.21.15.114:41452) 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 -- 172.21.15.114:0/3760871521 learned_addr learned my addr 172.21.15.114:0/3760871521 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f8e00640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7f40cdb30 0x7fa7f4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f3e00640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7f40d28e0 0x7fa7f40c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 -- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7f40d28e0 msgr2=0x7fa7f40c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7f40d28e0 0x7fa7f40c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 -- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7f40cdb30 msgr2=0x7fa7f4159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7f40cdb30 0x7fa7f4159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 -- 172.21.15.114:0/3760871521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40b0d80 con 0x7fa7f415bea0 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f3e00640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7f40d28e0 0x7fa7f40c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f9800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40c8490 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00eb50 tx=0x7fa7ec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f0c00640 1 -- 172.21.15.114:0/3760871521 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec004d30 con 0x7fa7f415bea0 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f0c00640 1 -- 172.21.15.114:0/3760871521 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7ec00ee50 con 0x7fa7f415bea0 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f40b1040 con 0x7fa7f415bea0 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7f0c00640 1 -- 172.21.15.114:0/3760871521 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec005280 con 0x7fa7f415bea0 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f40b1600 con 0x7fa7f415bea0 2024-09-16T07:34:50.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.069+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f40cc9d0 con 0x7fa7f415bea0 2024-09-16T07:34:50.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.073+0000 7fa7f0c00640 1 -- 172.21.15.114:0/3760871521 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fa7ec005420 con 0x7fa7f415bea0 2024-09-16T07:34:50.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.073+0000 7fa7f0c00640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa7d40734f0 0x7fa7d40759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.073+0000 7fa7f0c00640 1 -- 172.21.15.114:0/3760871521 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5737+0+0 (secure 0 0 0) 0x7fa7ec0955e0 con 0x7fa7f415bea0 2024-09-16T07:34:50.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.073+0000 7fa7f8e00640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa7d40734f0 0x7fa7d40759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.073+0000 7fa7f8e00640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa7d40734f0 0x7fa7d40759b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80af000 tx=0x7fa7e801afb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:50.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.077+0000 7fa7f0c00640 1 -- 172.21.15.114:0/3760871521 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa7ec05fec0 con 0x7fa7f415bea0 2024-09-16T07:34:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.245+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7f40b58f0 con 0x7fa7f415bea0 2024-09-16T07:34:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7f0c00640 1 -- 172.21.15.114:0/3760871521 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16844 (secure 0 0 0) 0x7fa7ec05f7c0 con 0x7fa7f415bea0 2024-09-16T07:34:50.247 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:50.248 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":128,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:49.262973+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:46.952845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:48.237188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa7d40734f0 msgr2=0x7fa7d40759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa7d40734f0 0x7fa7d40759b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80af000 tx=0x7fa7e801afb0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 msgr2=0x7fa7f40c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40c8490 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00eb50 tx=0x7fa7ec00c6a0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 shutdown_connections 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7f415bea0 0x7fa7f40c8490 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa7d40734f0 0x7fa7d40759b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa7f40d28e0 0x7fa7f40c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 --2- 172.21.15.114:0/3760871521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa7f40cdb30 0x7fa7f4159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 >> 172.21.15.114:0/3760871521 conn(0x7fa7f40d1dc0 msgr2=0x7fa7f406f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 shutdown_connections 2024-09-16T07:34:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.249+0000 7fa7fb800640 1 -- 172.21.15.114:0/3760871521 wait complete. 2024-09-16T07:34:50.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- 172.21.15.114:0/3293036419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887806e7a0 msgr2=0x7f88780ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 --2- 172.21.15.114:0/3293036419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887806e7a0 0x7f88780ce2e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8870009840 tx=0x7f887001c7f0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- 172.21.15.114:0/3293036419 shutdown_connections 2024-09-16T07:34:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 --2- 172.21.15.114:0/3293036419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887806e7a0 0x7f88780ce2e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 --2- 172.21.15.114:0/3293036419 >> v2:172.21.15.149:3300/0 conn(0x7f88780cf1d0 0x7f8878160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- 172.21.15.114:0/3293036419 >> 172.21.15.114:0/3293036419 conn(0x7f88780b18f0 msgr2=0x7f88780b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:50.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- 172.21.15.114:0/3293036419 shutdown_connections 2024-09-16T07:34:50.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- 172.21.15.114:0/3293036419 wait complete. 2024-09-16T07:34:50.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 Processor -- start 2024-09-16T07:34:50.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- start start 2024-09-16T07:34:50.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f887806e7a0 0x7f887814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88780cf1d0 0x7f88781f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887815f9a0 0x7f88781f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f88781691d0 con 0x7f88780cf1d0 2024-09-16T07:34:50.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8878169050 con 0x7f887806e7a0 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8878169350 con 0x7f887815f9a0 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f8877e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f887806e7a0 0x7f887814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f8877400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88780cf1d0 0x7f88781f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f8877e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f887806e7a0 0x7f887814e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:38852/0 (socket says 172.21.15.114:38852) 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f8877e00640 1 -- 172.21.15.114:0/95334546 learned_addr learned my addr 172.21.15.114:0/95334546 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.413+0000 7f887ca00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887815f9a0 0x7f88781f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f8877400640 1 -- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887815f9a0 msgr2=0x7f88781f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f8877400640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887815f9a0 0x7f88781f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f8877400640 1 -- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f887806e7a0 msgr2=0x7f887814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f8877400640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f887806e7a0 0x7f887814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f8877400640 1 -- 172.21.15.114:0/95334546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887814f180 con 0x7f88780cf1d0 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f8877e00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f887806e7a0 0x7f887814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f8877400640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88780cf1d0 0x7f88781f79e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f886400ea20 tx=0x7f886400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f886fe00640 1 -- 172.21.15.114:0/95334546 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886400ccc0 con 0x7f88780cf1d0 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f886fe00640 1 -- 172.21.15.114:0/95334546 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8864010430 con 0x7f88780cf1d0 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88780ad880 con 0x7f88780cf1d0 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f886fe00640 1 -- 172.21.15.114:0/95334546 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864010860 con 0x7f88780cf1d0 2024-09-16T07:34:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88780ade40 con 0x7f88780cf1d0 2024-09-16T07:34:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88780ce2e0 con 0x7f88780cf1d0 2024-09-16T07:34:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.417+0000 7f886fe00640 1 -- 172.21.15.114:0/95334546 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f8864010a00 con 0x7f88780cf1d0 2024-09-16T07:34:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.421+0000 7f886fe00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88580734f0 0x7f88580759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.421+0000 7f886fe00640 1 -- 172.21.15.114:0/95334546 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5737+0+0 (secure 0 0 0) 0x7f88640955b0 con 0x7f88780cf1d0 2024-09-16T07:34:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.421+0000 7f8877e00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88580734f0 0x7f88580759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.421+0000 7f8877e00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88580734f0 0x7f88580759b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f886800f290 tx=0x7f8868009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:50.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.425+0000 7f886fe00640 1 -- 172.21.15.114:0/95334546 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f886405f710 con 0x7f88780cf1d0 2024-09-16T07:34:50.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.593+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8878070a60 con 0x7f88780cf1d0 2024-09-16T07:34:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.593+0000 7f886fe00640 1 -- 172.21.15.114:0/95334546 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16844 (secure 0 0 0) 0x7f8864064140 con 0x7f88780cf1d0 2024-09-16T07:34:50.593 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:50.593 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":128,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:49.262973+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:46.952845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:48.237188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88580734f0 msgr2=0x7f88580759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88580734f0 0x7f88580759b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f886800f290 tx=0x7f8868009040 comp rx=0 tx=0).stop 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88780cf1d0 msgr2=0x7f88781f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88780cf1d0 0x7f88781f79e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f886400ea20 tx=0x7f886400eee0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 shutdown_connections 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88580734f0 0x7f88580759b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f887815f9a0 0x7f88781f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88780cf1d0 0x7f88781f79e0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 --2- 172.21.15.114:0/95334546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f887806e7a0 0x7f887814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 >> 172.21.15.114:0/95334546 conn(0x7f88780b18f0 msgr2=0x7f8878152080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 shutdown_connections 2024-09-16T07:34:50.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.597+0000 7f887ea00640 1 -- 172.21.15.114:0/95334546 wait complete. 2024-09-16T07:34:50.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:34:50.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 -- 172.21.15.114:0/2677895941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f415ade0 msgr2=0x7f81f40cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 --2- 172.21.15.114:0/2677895941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f415ade0 0x7f81f40cebf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009bf0 tx=0x7f81e801cbe0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 -- 172.21.15.114:0/2677895941 shutdown_connections 2024-09-16T07:34:50.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 --2- 172.21.15.114:0/2677895941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f415ade0 0x7f81f40cebf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 -- 172.21.15.114:0/2677895941 >> 172.21.15.114:0/2677895941 conn(0x7f81f40b18f0 msgr2=0x7f81f40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:50.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 -- 172.21.15.114:0/2677895941 shutdown_connections 2024-09-16T07:34:50.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 -- 172.21.15.114:0/2677895941 wait complete. 2024-09-16T07:34:50.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.761+0000 7f81fc600640 1 Processor -- start 2024-09-16T07:34:50.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 -- start start 2024-09-16T07:34:50.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f406e810 0x7f81f4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f40b4bd0 0x7f81f4166450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f415ade0 0x7f81f40ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4169850 con 0x7f81f415ade0 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f81f41696d0 con 0x7f81f406e810 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f81f41699d0 con 0x7f81f40b4bd0 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f415ade0 0x7f81f40ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f415ade0 0x7f81f40ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41476/0 (socket says 172.21.15.114:41476) 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 -- 172.21.15.114:0/2704184673 learned_addr learned my addr 172.21.15.114:0/2704184673 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81f9c00640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f406e810 0x7f81f4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81f9200640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f40b4bd0 0x7f81f4166450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 -- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f40b4bd0 msgr2=0x7f81f4166450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f40b4bd0 0x7f81f4166450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 -- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f406e810 msgr2=0x7f81f4151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f406e810 0x7f81f4151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:50.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 -- 172.21.15.114:0/2704184673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f41fb6c0 con 0x7f81f415ade0 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81f9200640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f40b4bd0 0x7f81f4166450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81f9c00640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f406e810 0x7f81f4151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fa600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f415ade0 0x7f81f40ad3b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c440 tx=0x7f81ec00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81f1600640 1 -- 172.21.15.114:0/2704184673 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec016020 con 0x7f81f415ade0 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81f1600640 1 -- 172.21.15.114:0/2704184673 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81ec012940 con 0x7f81f415ade0 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f41fb9a0 con 0x7f81f415ade0 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81f1600640 1 -- 172.21.15.114:0/2704184673 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec012d90 con 0x7f81f415ade0 2024-09-16T07:34:50.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f41fbf60 con 0x7f81f415ade0 2024-09-16T07:34:50.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.765+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f4069410 con 0x7f81f415ade0 2024-09-16T07:34:50.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.769+0000 7f81f1600640 1 -- 172.21.15.114:0/2704184673 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f81ec019020 con 0x7f81f415ade0 2024-09-16T07:34:50.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.769+0000 7f81f1600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f81d40734f0 0x7f81d40759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.769+0000 7f81f1600640 1 -- 172.21.15.114:0/2704184673 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5737+0+0 (secure 0 0 0) 0x7f81ec0949a0 con 0x7f81f415ade0 2024-09-16T07:34:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.769+0000 7f81f9c00640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f81d40734f0 0x7f81d40759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:50.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.769+0000 7f81f9c00640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f81d40734f0 0x7f81d40759b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81e80af000 tx=0x7f81e801b420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:50.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.773+0000 7f81f1600640 1 -- 172.21.15.114:0/2704184673 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f81ec020020 con 0x7f81f415ade0 2024-09-16T07:34:50.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:50.977+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f81f40cf720 con 0x7f81f415ade0 2024-09-16T07:34:51.839 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-16T07:34:51.841+0000 7fc3d6200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:34:51.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.893+0000 7f81f1600640 1 -- 172.21.15.114:0/2704184673 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) ==== 118+0+0 (secure 0 0 0) 0x7f81ec05f140 con 0x7f81f415ade0 2024-09-16T07:34:51.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f81d40734f0 msgr2=0x7f81d40759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f81d40734f0 0x7f81d40759b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81e80af000 tx=0x7f81e801b420 comp rx=0 tx=0).stop 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f415ade0 msgr2=0x7f81f40ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f415ade0 0x7f81f40ad3b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c440 tx=0x7f81ec00c900 comp rx=0 tx=0).stop 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 shutdown_connections 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81f415ade0 0x7f81f40ad3b0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f81d40734f0 0x7f81d40759b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f81f40b4bd0 0x7f81f4166450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 --2- 172.21.15.114:0/2704184673 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81f406e810 0x7f81f4151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 >> 172.21.15.114:0/2704184673 conn(0x7f81f40b18f0 msgr2=0x7f81f40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 shutdown_connections 2024-09-16T07:34:51.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:51.897+0000 7f81fc600640 1 -- 172.21.15.114:0/2704184673 wait complete. 2024-09-16T07:34:51.918 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:34:51.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:34:52.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 -- 172.21.15.114:0/2895367537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a4003a40 msgr2=0x7f52a4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:52.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 --2- 172.21.15.114:0/2895367537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52a4003a40 0x7f52a4003e60 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009ee0 tx=0x7f52b001d2d0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c2000640 1 -- 172.21.15.114:0/2895367537 reap_dead start 2024-09-16T07:34:52.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 -- 172.21.15.114:0/2895367537 shutdown_connections 2024-09-16T07:34:52.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 -- 172.21.15.114:0/2895367537 >> 172.21.15.114:0/2895367537 conn(0x7f52bc0d1ea0 msgr2=0x7f52bc0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:52.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 -- 172.21.15.114:0/2895367537 shutdown_connections 2024-09-16T07:34:52.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 -- 172.21.15.114:0/2895367537 wait complete. 2024-09-16T07:34:52.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 Processor -- start 2024-09-16T07:34:52.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.069+0000 7f52c4000640 1 -- start start 2024-09-16T07:34:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52a4003a40 0x7f52bc0b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52bc0b6510 0x7f52bc0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52bc1fc570 0x7f52bc1fca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc168c70 con 0x7f52bc0b6510 2024-09-16T07:34:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc168af0 con 0x7f52bc1fc570 2024-09-16T07:34:52.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc168df0 con 0x7f52a4003a40 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52bc0b6510 0x7f52bc0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52bc0b6510 0x7f52bc0b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41498/0 (socket says 172.21.15.114:41498) 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 -- 172.21.15.114:0/1289909515 learned_addr learned my addr 172.21.15.114:0/1289909515 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c1600640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52a4003a40 0x7f52bc0b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c2000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52bc1fc570 0x7f52bc1fca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 -- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52a4003a40 msgr2=0x7f52bc0b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52a4003a40 0x7f52bc0b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 -- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52bc1fc570 msgr2=0x7f52bc1fca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52bc1fc570 0x7f52bc1fca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 -- 172.21.15.114:0/1289909515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc0b4ee0 con 0x7f52bc0b6510 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c2000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52bc1fc570 0x7f52bc1fca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c0c00640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52bc0b6510 0x7f52bc0b6990 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f52a8003f20 tx=0x7f52a800f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:52.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52b9600640 1 -- 172.21.15.114:0/1289909515 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8015070 con 0x7f52bc0b6510 2024-09-16T07:34:52.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52b9600640 1 -- 172.21.15.114:0/1289909515 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52a8011840 con 0x7f52bc0b6510 2024-09-16T07:34:52.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52b9600640 1 -- 172.21.15.114:0/1289909515 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8011c70 con 0x7f52bc0b6510 2024-09-16T07:34:52.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc0b51c0 con 0x7f52bc0b6510 2024-09-16T07:34:52.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc0b5780 con 0x7f52bc0b6510 2024-09-16T07:34:52.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc0c5dd0 con 0x7f52bc0b6510 2024-09-16T07:34:52.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.073+0000 7f52b9600640 1 -- 172.21.15.114:0/1289909515 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f52a80103c0 con 0x7f52bc0b6510 2024-09-16T07:34:52.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.077+0000 7f52b9600640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f529c073520 0x7f529c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:52.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.077+0000 7f52b9600640 1 -- 172.21.15.114:0/1289909515 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f52a8095460 con 0x7f52bc0b6510 2024-09-16T07:34:52.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.077+0000 7f52c1600640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f529c073520 0x7f529c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:52.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.077+0000 7f52c1600640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f529c073520 0x7f529c0759e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f52b00af000 tx=0x7f52b001a390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:52.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.081+0000 7f52b9600640 1 -- 172.21.15.114:0/1289909515 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f52a805f680 con 0x7f52bc0b6510 2024-09-16T07:34:52.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.281+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f52bc0cc2d0 con 0x7f52bc0b6510 2024-09-16T07:34:52.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.901+0000 7f52b9600640 1 -- 172.21.15.114:0/1289909515 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) ==== 122+0+0 (secure 0 0 0) 0x7f52a80640b0 con 0x7f52bc0b6510 2024-09-16T07:34:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f529c073520 msgr2=0x7f529c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f529c073520 0x7f529c0759e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f52b00af000 tx=0x7f52b001a390 comp rx=0 tx=0).stop 2024-09-16T07:34:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52bc0b6510 msgr2=0x7f52bc0b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52bc0b6510 0x7f52bc0b6990 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f52a8003f20 tx=0x7f52a800f7e0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 shutdown_connections 2024-09-16T07:34:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52bc1fc570 0x7f52bc1fca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52bc0b6510 0x7f52bc0b6990 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f529c073520 0x7f529c0759e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 --2- 172.21.15.114:0/1289909515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f52a4003a40 0x7f52bc0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 >> 172.21.15.114:0/1289909515 conn(0x7f52bc0d1ea0 msgr2=0x7f52bc159560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 shutdown_connections 2024-09-16T07:34:52.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:52.905+0000 7f52c4000640 1 -- 172.21.15.114:0/1289909515 wait complete. 2024-09-16T07:34:52.925 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:34:52.925 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 -- 172.21.15.114:0/2281508508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a980cdb30 msgr2=0x7f3a980aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 --2- 172.21.15.114:0/2281508508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a980cdb30 0x7f3a980aeef0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009c80 tx=0x7f3a9001cda0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 -- 172.21.15.114:0/2281508508 shutdown_connections 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 --2- 172.21.15.114:0/2281508508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a980cdb30 0x7f3a980aeef0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 --2- 172.21.15.114:0/2281508508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a980ced80 0x7f3a980ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 -- 172.21.15.114:0/2281508508 >> 172.21.15.114:0/2281508508 conn(0x7f3a980d1dc0 msgr2=0x7f3a980d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 -- 172.21.15.114:0/2281508508 shutdown_connections 2024-09-16T07:34:53.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.069+0000 7f3a9f600640 1 -- 172.21.15.114:0/2281508508 wait complete. 2024-09-16T07:34:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 Processor -- start 2024-09-16T07:34:53.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 -- start start 2024-09-16T07:34:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980cdb30 0x7f3a9815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a980ced80 0x7f3a980c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a9815bea0 0x7f3a980c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98169340 con 0x7f3a980cdb30 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a981691c0 con 0x7f3a9815bea0 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3a981694c0 con 0x7f3a980ced80 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980cdb30 0x7f3a9815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980cdb30 0x7f3a9815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41510/0 (socket says 172.21.15.114:41510) 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 -- 172.21.15.114:0/1550475303 learned_addr learned my addr 172.21.15.114:0/1550475303 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9d600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a9815bea0 0x7f3a980c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a97e00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a980ced80 0x7f3a980c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 -- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a980ced80 msgr2=0x7f3a980c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a980ced80 0x7f3a980c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 -- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a9815bea0 msgr2=0x7f3a980c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a9815bea0 0x7f3a980c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 -- 172.21.15.114:0/1550475303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9815aee0 con 0x7f3a980cdb30 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9d600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a9815bea0 0x7f3a980c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a97e00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a980ced80 0x7f3a980c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9cc00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980cdb30 0x7f3a9815a5d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c3f0 tx=0x7f3a8800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a94c00640 1 -- 172.21.15.114:0/1550475303 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88017070 con 0x7f3a980cdb30 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a94c00640 1 -- 172.21.15.114:0/1550475303 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a880053c0 con 0x7f3a980cdb30 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9815ac00 con 0x7f3a980cdb30 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a94c00640 1 -- 172.21.15.114:0/1550475303 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88003860 con 0x7f3a980cdb30 2024-09-16T07:34:53.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.073+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a980c6300 con 0x7f3a980cdb30 2024-09-16T07:34:53.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.077+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a980cc1c0 con 0x7f3a980cdb30 2024-09-16T07:34:53.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.077+0000 7f3a94c00640 1 -- 172.21.15.114:0/1550475303 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f3a8801a070 con 0x7f3a980cdb30 2024-09-16T07:34:53.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.077+0000 7f3a94c00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a780734f0 0x7f3a780759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.077+0000 7f3a94c00640 1 -- 172.21.15.114:0/1550475303 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f3a88093d20 con 0x7f3a980cdb30 2024-09-16T07:34:53.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.077+0000 7f3a97e00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a780734f0 0x7f3a780759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.077+0000 7f3a97e00640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a780734f0 0x7f3a780759b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3a9806ac50 tx=0x7f3a840091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:53.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.081+0000 7f3a94c00640 1 -- 172.21.15.114:0/1550475303 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3a980cc1c0 con 0x7f3a980cdb30 2024-09-16T07:34:53.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.281+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a980ce670 con 0x7f3a980cdb30 2024-09-16T07:34:53.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a94c00640 1 -- 172.21.15.114:0/1550475303 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5227 (secure 0 0 0) 0x7f3a8805e590 con 0x7f3a980cdb30 2024-09-16T07:34:53.283 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:53.284 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":92,"btime":"2024-09-16T07:34:52:899280+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/480729207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":480729207},{"type":"v1","addr":"172.21.15.114:6833","nonce":480729207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/3104829839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3104829839},{"type":"v1","addr":"172.21.15.149:6834","nonce":3104829839}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/44383065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":44383065},{"type":"v1","addr":"172.21.15.149:6835","nonce":44383065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:49.262936+0000","modified":"2024-09-16T07:34:52.287252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7923":{"gid":7923,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/710167418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":710167418},{"type":"v1","addr":"172.21.15.114:6835","nonce":710167418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7923,"qdb_cluster":[7923]},"id":10}]} 2024-09-16T07:34:53.284 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 92 2024-09-16T07:34:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a780734f0 msgr2=0x7f3a780759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a780734f0 0x7f3a780759b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3a9806ac50 tx=0x7f3a840091e0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980cdb30 msgr2=0x7f3a9815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980cdb30 0x7f3a9815a5d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c3f0 tx=0x7f3a8800c8b0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 shutdown_connections 2024-09-16T07:34:53.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a9815bea0 0x7f3a980c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a780734f0 0x7f3a780759b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a980ced80 0x7f3a980c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 --2- 172.21.15.114:0/1550475303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a980cdb30 0x7f3a9815a5d0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 >> 172.21.15.114:0/1550475303 conn(0x7f3a980d1dc0 msgr2=0x7f3a980d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:53.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 shutdown_connections 2024-09-16T07:34:53.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.285+0000 7f3a9f600640 1 -- 172.21.15.114:0/1550475303 wait complete. 2024-09-16T07:34:53.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.449+0000 7fed9da00640 1 -- 172.21.15.114:0/1387463497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed980cc2a0 msgr2=0x7fed9806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.449+0000 7fed9da00640 1 --2- 172.21.15.114:0/1387463497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed980cc2a0 0x7fed9806eab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed80009900 tx=0x7fed8001c850 comp rx=0 tx=0).stop 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.449+0000 7fed9da00640 1 -- 172.21.15.114:0/1387463497 shutdown_connections 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.449+0000 7fed9da00640 1 --2- 172.21.15.114:0/1387463497 >> v2:172.21.15.149:3300/0 conn(0x7fed980b4cf0 0x7fed9806eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.449+0000 7fed9da00640 1 --2- 172.21.15.114:0/1387463497 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed980cc2a0 0x7fed9806eab0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.449+0000 7fed9da00640 1 -- 172.21.15.114:0/1387463497 >> 172.21.15.114:0/1387463497 conn(0x7fed980b18f0 msgr2=0x7fed980b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 -- 172.21.15.114:0/1387463497 shutdown_connections 2024-09-16T07:34:53.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 -- 172.21.15.114:0/1387463497 wait complete. 2024-09-16T07:34:53.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 Processor -- start 2024-09-16T07:34:53.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 -- start start 2024-09-16T07:34:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed980b4cf0 0x7fed9814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed9815e260 0x7fed9815e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9815eca0 0x7fed98151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fed98168210 con 0x7fed9815eca0 2024-09-16T07:34:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fed98168090 con 0x7fed980b4cf0 2024-09-16T07:34:53.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed9da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fed98168390 con 0x7fed9815e260 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9815eca0 0x7fed98151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9815eca0 0x7fed98151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41520/0 (socket says 172.21.15.114:41520) 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 -- 172.21.15.114:0/3044523116 learned_addr learned my addr 172.21.15.114:0/3044523116 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed8e000640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed9815e260 0x7fed9815e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed96a00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed980b4cf0 0x7fed9814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 -- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed9815e260 msgr2=0x7fed9815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed9815e260 0x7fed9815e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 -- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed980b4cf0 msgr2=0x7fed9814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed980b4cf0 0x7fed9814b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 -- 172.21.15.114:0/3044523116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9806a420 con 0x7fed9815eca0 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed97400640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9815eca0 0x7fed98151c00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fed9000efd0 tx=0x7fed9000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:53.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed8f400640 1 -- 172.21.15.114:0/3044523116 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90003b80 con 0x7fed9815eca0 2024-09-16T07:34:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.453+0000 7fed8f400640 1 -- 172.21.15.114:0/3044523116 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed90003d20 con 0x7fed9815eca0 2024-09-16T07:34:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9814f930 con 0x7fed9815eca0 2024-09-16T07:34:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed8f400640 1 -- 172.21.15.114:0/3044523116 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90004280 con 0x7fed9815eca0 2024-09-16T07:34:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed981f6540 con 0x7fed9815eca0 2024-09-16T07:34:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed98069410 con 0x7fed9815eca0 2024-09-16T07:34:53.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed8f400640 1 -- 172.21.15.114:0/3044523116 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fed90004420 con 0x7fed9815eca0 2024-09-16T07:34:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed8f400640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed740734f0 0x7fed740759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed8f400640 1 -- 172.21.15.114:0/3044523116 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fed90095870 con 0x7fed9815eca0 2024-09-16T07:34:53.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.457+0000 7fed96a00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed740734f0 0x7fed740759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.461+0000 7fed96a00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed740734f0 0x7fed740759b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fed98165920 tx=0x7fed88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:53.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.461+0000 7fed8f400640 1 -- 172.21.15.114:0/3044523116 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fed9005f940 con 0x7fed9815eca0 2024-09-16T07:34:53.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed9815f110 con 0x7fed9815eca0 2024-09-16T07:34:53.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed8f400640 1 -- 172.21.15.114:0/3044523116 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16831 (secure 0 0 0) 0x7fed9815f110 con 0x7fed9815eca0 2024-09-16T07:34:53.632 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:53.632 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":129,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:50.882652+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:46.952845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:48.237188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed740734f0 msgr2=0x7fed740759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed740734f0 0x7fed740759b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fed98165920 tx=0x7fed88009040 comp rx=0 tx=0).stop 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9815eca0 msgr2=0x7fed98151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9815eca0 0x7fed98151c00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fed9000efd0 tx=0x7fed9000c6a0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 shutdown_connections 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed9815eca0 0x7fed98151c00 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fed740734f0 0x7fed740759b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed9815e260 0x7fed9815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 --2- 172.21.15.114:0/3044523116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed980b4cf0 0x7fed9814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 >> 172.21.15.114:0/3044523116 conn(0x7fed980b18f0 msgr2=0x7fed981558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 shutdown_connections 2024-09-16T07:34:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.633+0000 7fed9da00640 1 -- 172.21.15.114:0/3044523116 wait complete. 2024-09-16T07:34:53.653 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:34:53.653 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- 172.21.15.114:0/1171677569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc004d50 msgr2=0x7ff3fc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 --2- 172.21.15.114:0/1171677569 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff3fc004d50 0x7ff3fc0051d0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff4180b7e50 tx=0x7ff41001d2e0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41d400640 1 -- 172.21.15.114:0/1171677569 reap_dead start 2024-09-16T07:34:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- 172.21.15.114:0/1171677569 shutdown_connections 2024-09-16T07:34:53.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- 172.21.15.114:0/1171677569 >> 172.21.15.114:0/1171677569 conn(0x7ff4180d1da0 msgr2=0x7ff4180d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:53.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- 172.21.15.114:0/1171677569 shutdown_connections 2024-09-16T07:34:53.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- 172.21.15.114:0/1171677569 wait complete. 2024-09-16T07:34:53.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 Processor -- start 2024-09-16T07:34:53.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- start start 2024-09-16T07:34:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3fc004d50 0x7ff418158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff41809e3d0 0x7ff4181f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff41809e830 0x7ff4181f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff4180cdc50 con 0x7ff41809e830 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff4180cdad0 con 0x7ff3fc004d50 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41f400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff4180cea20 con 0x7ff41809e3d0 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff41809e830 0x7ff4181f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff41809e830 0x7ff4181f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41532/0 (socket says 172.21.15.114:41532) 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41d400640 1 -- 172.21.15.114:0/3123437157 learned_addr learned my addr 172.21.15.114:0/3123437157 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff41ca00640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3fc004d50 0x7ff418158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.797+0000 7ff40fe00640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff41809e3d0 0x7ff4181f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41d400640 1 -- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff41809e3d0 msgr2=0x7ff4181f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41d400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff41809e3d0 0x7ff4181f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41d400640 1 -- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3fc004d50 msgr2=0x7ff418158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41d400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3fc004d50 0x7ff418158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41d400640 1 -- 172.21.15.114:0/3123437157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4181f6850 con 0x7ff41809e830 2024-09-16T07:34:53.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff40fe00640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff41809e3d0 0x7ff4181f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41d400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff41809e830 0x7ff4181f5f80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff41001db80 tx=0x7ff410001f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:53.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff415600640 1 -- 172.21.15.114:0/3123437157 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100039a0 con 0x7ff41809e830 2024-09-16T07:34:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff415600640 1 -- 172.21.15.114:0/3123437157 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff410003b40 con 0x7ff41809e830 2024-09-16T07:34:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41809ce00 con 0x7ff41809e830 2024-09-16T07:34:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff415600640 1 -- 172.21.15.114:0/3123437157 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100060a0 con 0x7ff41809e830 2024-09-16T07:34:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41809c040 con 0x7ff41809e830 2024-09-16T07:34:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4180d0010 con 0x7ff41809e830 2024-09-16T07:34:53.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff415600640 1 -- 172.21.15.114:0/3123437157 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7ff4100b8030 con 0x7ff41809e830 2024-09-16T07:34:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.801+0000 7ff415600640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3f4073520 0x7ff3f40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.805+0000 7ff415600640 1 -- 172.21.15.114:0/3123437157 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7ff41012e240 con 0x7ff41809e830 2024-09-16T07:34:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.805+0000 7ff41ca00640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3f4073520 0x7ff3f40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:53.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.805+0000 7ff41ca00640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3f4073520 0x7ff3f40759e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff408009e60 tx=0x7ff4080091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:53.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.805+0000 7ff415600640 1 -- 172.21.15.114:0/3123437157 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff4180d0350 con 0x7ff41809e830 2024-09-16T07:34:53.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.973+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff41809bb10 con 0x7ff3f4073520 2024-09-16T07:34:53.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.977+0000 7ff415600640 1 -- 172.21.15.114:0/3123437157 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240274 (secure 0 0 0) 0x7ff41809bb10 con 0x7ff3f4073520 2024-09-16T07:34:53.977 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:53.979 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:53.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3f4073520 msgr2=0x7ff3f40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3f4073520 0x7ff3f40759e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff408009e60 tx=0x7ff4080091e0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff41809e830 msgr2=0x7ff4181f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff41809e830 0x7ff4181f5f80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ff41001db80 tx=0x7ff410001f80 comp rx=0 tx=0).stop 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 shutdown_connections 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff41809e830 0x7ff4181f5f80 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff3f4073520 0x7ff3f40759e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff41809e3d0 0x7ff4181f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 --2- 172.21.15.114:0/3123437157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3fc004d50 0x7ff418158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 >> 172.21.15.114:0/3123437157 conn(0x7ff4180d1da0 msgr2=0x7ff4180b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 shutdown_connections 2024-09-16T07:34:53.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:53.981+0000 7ff41f400640 1 -- 172.21.15.114:0/3123437157 wait complete. 2024-09-16T07:34:53.998 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-16T07:34:52.401264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262916,"kb_used_data":13376,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711804,"statfs":{"total":773094113280,"available":772824887296,"internally_reserved":0,"allocated":13697024,"data_stored":6649210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.539072"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.866207+0000","last_change":"2024-09-16T07:34:47.866207+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.866207+0000","last_undegraded":"2024-09-16T07:34:47.866207+0000","last_fullsized":"2024-09-16T07:34:47.866207+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.872247+0000","last_change":"2024-09-16T07:34:47.872247+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.872247+0000","last_undegraded":"2024-09-16T07:34:47.872247+0000","last_fullsized":"2024-09-16T07:34:47.872247+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862222+0000","last_change":"2024-09-16T07:34:47.862222+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862222+0000","last_undegraded":"2024-09-16T07:34:47.862222+0000","last_fullsized":"2024-09-16T07:34:47.862222+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862059+0000","last_change":"2024-09-16T07:34:47.862059+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862059+0000","last_undegraded":"2024-09-16T07:34:47.862059+0000","last_fullsized":"2024-09-16T07:34:47.862059+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.866028+0000","last_change":"2024-09-16T07:34:47.866028+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.866028+0000","last_undegraded":"2024-09-16T07:34:47.866028+0000","last_fullsized":"2024-09-16T07:34:47.866028+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862207+0000","last_change":"2024-09-16T07:34:47.862207+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862207+0000","last_undegraded":"2024-09-16T07:34:47.862207+0000","last_fullsized":"2024-09-16T07:34:47.862207+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865827+0000","last_change":"2024-09-16T07:34:47.865827+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865827+0000","last_undegraded":"2024-09-16T07:34:47.865827+0000","last_fullsized":"2024-09-16T07:34:47.865827+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862659+0000","last_change":"2024-09-16T07:34:47.862659+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862659+0000","last_undegraded":"2024-09-16T07:34:47.862659+0000","last_fullsized":"2024-09-16T07:34:47.862659+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871976+0000","last_change":"2024-09-16T07:34:47.871976+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871976+0000","last_undegraded":"2024-09-16T07:34:47.871976+0000","last_fullsized":"2024-09-16T07:34:47.871976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865272+0000","last_change":"2024-09-16T07:34:47.865272+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865272+0000","last_undegraded":"2024-09-16T07:34:47.865272+0000","last_fullsized":"2024-09-16T07:34:47.865272+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.868860+0000","last_change":"2024-09-16T07:34:47.868860+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.868860+0000","last_undegraded":"2024-09-16T07:34:47.868860+0000","last_fullsized":"2024-09-16T07:34:47.868860+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865016+0000","last_change":"2024-09-16T07:34:47.865016+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865016+0000","last_undegraded":"2024-09-16T07:34:47.865016+0000","last_fullsized":"2024-09-16T07:34:47.865016+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864926+0000","last_change":"2024-09-16T07:34:47.864926+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864926+0000","last_undegraded":"2024-09-16T07:34:47.864926+0000","last_fullsized":"2024-09-16T07:34:47.864926+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867889+0000","last_change":"2024-09-16T07:34:47.867889+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867889+0000","last_undegraded":"2024-09-16T07:34:47.867889+0000","last_fullsized":"2024-09-16T07:34:47.867889+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.866424+0000","last_change":"2024-09-16T07:34:47.866424+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.866424+0000","last_undegraded":"2024-09-16T07:34:47.866424+0000","last_fullsized":"2024-09-16T07:34:47.866424+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.861961+0000","last_change":"2024-09-16T07:34:47.861961+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.861961+0000","last_undegraded":"2024-09-16T07:34:47.861961+0000","last_fullsized":"2024-09-16T07:34:47.861961+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871766+0000","last_change":"2024-09-16T07:34:47.871766+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871766+0000","last_undegraded":"2024-09-16T07:34:47.871766+0000","last_fullsized":"2024-09-16T07:34:47.871766+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865811+0000","last_change":"2024-09-16T07:34:47.865811+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865811+0000","last_undegraded":"2024-09-16T07:34:47.865811+0000","last_fullsized":"2024-09-16T07:34:47.865811+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871909+0000","last_change":"2024-09-16T07:34:47.871909+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871909+0000","last_undegraded":"2024-09-16T07:34:47.871909+0000","last_fullsized":"2024-09-16T07:34:47.871909+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.869339+0000","last_change":"2024-09-16T07:34:47.869339+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.869339+0000","last_undegraded":"2024-09-16T07:34:47.869339+0000","last_fullsized":"2024-09-16T07:34:47.869339+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865782+0000","last_change":"2024-09-16T07:34:47.865782+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865782+0000","last_undegraded":"2024-09-16T07:34:47.865782+0000","last_fullsized":"2024-09-16T07:34:47.865782+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865537+0000","last_change":"2024-09-16T07:34:47.865537+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865537+0000","last_undegraded":"2024-09-16T07:34:47.865537+0000","last_fullsized":"2024-09-16T07:34:47.865537+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864906+0000","last_change":"2024-09-16T07:34:47.864906+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864906+0000","last_undegraded":"2024-09-16T07:34:47.864906+0000","last_fullsized":"2024-09-16T07:34:47.864906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865758+0000","last_change":"2024-09-16T07:34:47.865758+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865758+0000","last_undegraded":"2024-09-16T07:34:47.865758+0000","last_fullsized":"2024-09-16T07:34:47.865758+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867847+0000","last_change":"2024-09-16T07:34:47.867847+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867847+0000","last_undegraded":"2024-09-16T07:34:47.867847+0000","last_fullsized":"2024-09-16T07:34:47.867847+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867877+0000","last_change":"2024-09-16T07:34:47.867877+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867877+0000","last_undegraded":"2024-09-16T07:34:47.867877+0000","last_fullsized":"2024-09-16T07:34:47.867877+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867843+0000","last_change":"2024-09-16T07:34:47.867843+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867843+0000","last_undegraded":"2024-09-16T07:34:47.867843+0000","last_fullsized":"2024-09-16T07:34:47.867843+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.868849+0000","last_change":"2024-09-16T07:34:47.868849+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.868849+0000","last_undegraded":"2024-09-16T07:34:47.868849+0000","last_fullsized":"2024-09-16T07:34:47.868849+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865281+0000","last_change":"2024-09-16T07:34:47.865281+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865281+0000","last_undegraded":"2024-09-16T07:34:47.865281+0000","last_fullsized":"2024-09-16T07:34:47.865281+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864933+0000","last_change":"2024-09-16T07:34:47.864933+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864933+0000","last_undegraded":"2024-09-16T07:34:47.864933+0000","last_fullsized":"2024-09-16T07:34:47.864933+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871759+0000","last_change":"2024-09-16T07:34:47.871759+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871759+0000","last_undegraded":"2024-09-16T07:34:47.871759+0000","last_fullsized":"2024-09-16T07:34:47.871759+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864924+0000","last_change":"2024-09-16T07:34:47.864924+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864924+0000","last_undegraded":"2024-09-16T07:34:47.864924+0000","last_fullsized":"2024-09-16T07:34:47.864924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":331,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:34:47.867204+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:47.867204+0000","last_peered":"2024-09-16T07:34:47.867204+0000","last_clean":"2024-09-16T07:34:47.867204+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:47.867204+0000","last_undegraded":"2024-09-16T07:34:47.867204+0000","last_fullsized":"2024-09-16T07:34:47.867204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":1278311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33312,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338528,"statfs":{"total":96636764160,"available":96602652672,"internally_reserved":0,"allocated":2166784,"data_stored":1278311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:54.002 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- 172.21.15.114:0/29820951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 msgr2=0x7f554c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 --2- 172.21.15.114:0/29820951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 0x7f554c004c90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f5550009ba0 tx=0x7f555001d250 comp rx=0 tx=0).stop 2024-09-16T07:34:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ca00640 1 -- 172.21.15.114:0/29820951 reap_dead start 2024-09-16T07:34:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- 172.21.15.114:0/29820951 shutdown_connections 2024-09-16T07:34:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- 172.21.15.114:0/29820951 >> 172.21.15.114:0/29820951 conn(0x7f55680d1da0 msgr2=0x7f55680d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- 172.21.15.114:0/29820951 shutdown_connections 2024-09-16T07:34:54.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- 172.21.15.114:0/29820951 wait complete. 2024-09-16T07:34:54.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 Processor -- start 2024-09-16T07:34:54.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- start start 2024-09-16T07:34:54.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 0x7f55681f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f556809e060 0x7f556809c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556809e4e0 0x7f5568159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f55680cdc50 con 0x7f554c004810 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f55680cdad0 con 0x7f556809e4e0 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.185+0000 7f556ea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f55680cea20 con 0x7f556809e060 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 0x7f55681f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 0x7f55681f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35836/0 (socket says 172.21.15.114:35836) 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 -- 172.21.15.114:0/2184930356 learned_addr learned my addr 172.21.15.114:0/2184930356 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f556ca00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556809e4e0 0x7f5568159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f555f400640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f556809e060 0x7f556809c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 -- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f556809e060 msgr2=0x7f556809c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f556809e060 0x7f556809c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 -- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556809e4e0 msgr2=0x7f5568159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556809e4e0 0x7f5568159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 -- 172.21.15.114:0/2184930356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556809fa30 con 0x7f554c004810 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f555f400640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f556809e060 0x7f556809c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5567e00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 0x7f55681f2510 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f5558011ae0 tx=0x7f5558009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5564c00640 1 -- 172.21.15.114:0/2184930356 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555801e070 con 0x7f554c004810 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5564c00640 1 -- 172.21.15.114:0/2184930356 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f555800fc70 con 0x7f554c004810 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5564c00640 1 -- 172.21.15.114:0/2184930356 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558019670 con 0x7f554c004810 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556809e990 con 0x7f554c004810 2024-09-16T07:34:54.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556809f230 con 0x7f554c004810 2024-09-16T07:34:54.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55680ce4e0 con 0x7f554c004810 2024-09-16T07:34:54.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.189+0000 7f5564c00640 1 -- 172.21.15.114:0/2184930356 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f5558021070 con 0x7f554c004810 2024-09-16T07:34:54.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.193+0000 7f5564c00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f55440734f0 0x7f55440759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.193+0000 7f5564c00640 1 -- 172.21.15.114:0/2184930356 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f55580952b0 con 0x7f554c004810 2024-09-16T07:34:54.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.193+0000 7f555f400640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f55440734f0 0x7f55440759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.193+0000 7f555f400640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f55440734f0 0x7f55440759b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f55500af000 tx=0x7f555001a050 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:54.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.197+0000 7f5564c00640 1 -- 172.21.15.114:0/2184930356 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f555800fe60 con 0x7f554c004810 2024-09-16T07:34:54.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.365+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55680cc1d0 con 0x7f55440734f0 2024-09-16T07:34:54.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.369+0000 7f5564c00640 1 -- 172.21.15.114:0/2184930356 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240274 (secure 0 0 0) 0x7f55680cc1d0 con 0x7f55440734f0 2024-09-16T07:34:54.369 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:54.370 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f55440734f0 msgr2=0x7f55440759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f55440734f0 0x7f55440759b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f55500af000 tx=0x7f555001a050 comp rx=0 tx=0).stop 2024-09-16T07:34:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 msgr2=0x7f55681f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 0x7f55681f2510 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f5558011ae0 tx=0x7f5558009ec0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 shutdown_connections 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f556809e4e0 0x7f5568159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f55440734f0 0x7f55440759b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f556809e060 0x7f556809c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 --2- 172.21.15.114:0/2184930356 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f554c004810 0x7f55681f2510 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 >> 172.21.15.114:0/2184930356 conn(0x7f55680d1da0 msgr2=0x7f55680b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 shutdown_connections 2024-09-16T07:34:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.373+0000 7f556ea00640 1 -- 172.21.15.114:0/2184930356 wait complete. 2024-09-16T07:34:54.389 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-16T07:34:52.401264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262916,"kb_used_data":13376,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711804,"statfs":{"total":773094113280,"available":772824887296,"internally_reserved":0,"allocated":13697024,"data_stored":6649210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.539072"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.866207+0000","last_change":"2024-09-16T07:34:47.866207+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.866207+0000","last_undegraded":"2024-09-16T07:34:47.866207+0000","last_fullsized":"2024-09-16T07:34:47.866207+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.872247+0000","last_change":"2024-09-16T07:34:47.872247+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.872247+0000","last_undegraded":"2024-09-16T07:34:47.872247+0000","last_fullsized":"2024-09-16T07:34:47.872247+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862222+0000","last_change":"2024-09-16T07:34:47.862222+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862222+0000","last_undegraded":"2024-09-16T07:34:47.862222+0000","last_fullsized":"2024-09-16T07:34:47.862222+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862059+0000","last_change":"2024-09-16T07:34:47.862059+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862059+0000","last_undegraded":"2024-09-16T07:34:47.862059+0000","last_fullsized":"2024-09-16T07:34:47.862059+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.866028+0000","last_change":"2024-09-16T07:34:47.866028+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.866028+0000","last_undegraded":"2024-09-16T07:34:47.866028+0000","last_fullsized":"2024-09-16T07:34:47.866028+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862207+0000","last_change":"2024-09-16T07:34:47.862207+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862207+0000","last_undegraded":"2024-09-16T07:34:47.862207+0000","last_fullsized":"2024-09-16T07:34:47.862207+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865827+0000","last_change":"2024-09-16T07:34:47.865827+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865827+0000","last_undegraded":"2024-09-16T07:34:47.865827+0000","last_fullsized":"2024-09-16T07:34:47.865827+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.862659+0000","last_change":"2024-09-16T07:34:47.862659+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.862659+0000","last_undegraded":"2024-09-16T07:34:47.862659+0000","last_fullsized":"2024-09-16T07:34:47.862659+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871976+0000","last_change":"2024-09-16T07:34:47.871976+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871976+0000","last_undegraded":"2024-09-16T07:34:47.871976+0000","last_fullsized":"2024-09-16T07:34:47.871976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865272+0000","last_change":"2024-09-16T07:34:47.865272+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865272+0000","last_undegraded":"2024-09-16T07:34:47.865272+0000","last_fullsized":"2024-09-16T07:34:47.865272+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.868860+0000","last_change":"2024-09-16T07:34:47.868860+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.868860+0000","last_undegraded":"2024-09-16T07:34:47.868860+0000","last_fullsized":"2024-09-16T07:34:47.868860+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865016+0000","last_change":"2024-09-16T07:34:47.865016+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865016+0000","last_undegraded":"2024-09-16T07:34:47.865016+0000","last_fullsized":"2024-09-16T07:34:47.865016+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864926+0000","last_change":"2024-09-16T07:34:47.864926+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864926+0000","last_undegraded":"2024-09-16T07:34:47.864926+0000","last_fullsized":"2024-09-16T07:34:47.864926+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867889+0000","last_change":"2024-09-16T07:34:47.867889+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867889+0000","last_undegraded":"2024-09-16T07:34:47.867889+0000","last_fullsized":"2024-09-16T07:34:47.867889+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.866424+0000","last_change":"2024-09-16T07:34:47.866424+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.866424+0000","last_undegraded":"2024-09-16T07:34:47.866424+0000","last_fullsized":"2024-09-16T07:34:47.866424+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.861961+0000","last_change":"2024-09-16T07:34:47.861961+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.861961+0000","last_undegraded":"2024-09-16T07:34:47.861961+0000","last_fullsized":"2024-09-16T07:34:47.861961+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871766+0000","last_change":"2024-09-16T07:34:47.871766+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871766+0000","last_undegraded":"2024-09-16T07:34:47.871766+0000","last_fullsized":"2024-09-16T07:34:47.871766+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865811+0000","last_change":"2024-09-16T07:34:47.865811+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865811+0000","last_undegraded":"2024-09-16T07:34:47.865811+0000","last_fullsized":"2024-09-16T07:34:47.865811+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871909+0000","last_change":"2024-09-16T07:34:47.871909+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871909+0000","last_undegraded":"2024-09-16T07:34:47.871909+0000","last_fullsized":"2024-09-16T07:34:47.871909+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.869339+0000","last_change":"2024-09-16T07:34:47.869339+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.869339+0000","last_undegraded":"2024-09-16T07:34:47.869339+0000","last_fullsized":"2024-09-16T07:34:47.869339+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865782+0000","last_change":"2024-09-16T07:34:47.865782+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865782+0000","last_undegraded":"2024-09-16T07:34:47.865782+0000","last_fullsized":"2024-09-16T07:34:47.865782+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865537+0000","last_change":"2024-09-16T07:34:47.865537+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865537+0000","last_undegraded":"2024-09-16T07:34:47.865537+0000","last_fullsized":"2024-09-16T07:34:47.865537+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864906+0000","last_change":"2024-09-16T07:34:47.864906+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864906+0000","last_undegraded":"2024-09-16T07:34:47.864906+0000","last_fullsized":"2024-09-16T07:34:47.864906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865758+0000","last_change":"2024-09-16T07:34:47.865758+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865758+0000","last_undegraded":"2024-09-16T07:34:47.865758+0000","last_fullsized":"2024-09-16T07:34:47.865758+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867847+0000","last_change":"2024-09-16T07:34:47.867847+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867847+0000","last_undegraded":"2024-09-16T07:34:47.867847+0000","last_fullsized":"2024-09-16T07:34:47.867847+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867877+0000","last_change":"2024-09-16T07:34:47.867877+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867877+0000","last_undegraded":"2024-09-16T07:34:47.867877+0000","last_fullsized":"2024-09-16T07:34:47.867877+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.867843+0000","last_change":"2024-09-16T07:34:47.867843+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.867843+0000","last_undegraded":"2024-09-16T07:34:47.867843+0000","last_fullsized":"2024-09-16T07:34:47.867843+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.868849+0000","last_change":"2024-09-16T07:34:47.868849+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.868849+0000","last_undegraded":"2024-09-16T07:34:47.868849+0000","last_fullsized":"2024-09-16T07:34:47.868849+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.865281+0000","last_change":"2024-09-16T07:34:47.865281+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.865281+0000","last_undegraded":"2024-09-16T07:34:47.865281+0000","last_fullsized":"2024-09-16T07:34:47.865281+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864933+0000","last_change":"2024-09-16T07:34:47.864933+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864933+0000","last_undegraded":"2024-09-16T07:34:47.864933+0000","last_fullsized":"2024-09-16T07:34:47.864933+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.871759+0000","last_change":"2024-09-16T07:34:47.871759+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.871759+0000","last_undegraded":"2024-09-16T07:34:47.871759+0000","last_fullsized":"2024-09-16T07:34:47.871759+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:34:48.862042+0000","last_change":"2024-09-16T07:34:48.862042+0000","last_active":"2024-09-16T07:34:48.862042+0000","last_peered":"2024-09-16T07:34:48.862042+0000","last_clean":"2024-09-16T07:34:48.862042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:48.862042+0000","last_undegraded":"2024-09-16T07:34:48.862042+0000","last_fullsized":"2024-09-16T07:34:48.862042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-16T07:34:47.864924+0000","last_change":"2024-09-16T07:34:47.864924+0000","last_active":"2024-09-16T07:34:47.858889+0000","last_peered":"2024-09-16T07:34:47.858889+0000","last_clean":"2024-09-16T07:34:47.858889+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:34:47.864924+0000","last_undegraded":"2024-09-16T07:34:47.864924+0000","last_fullsized":"2024-09-16T07:34:47.864924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":331,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:34:47.867204+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:47.867204+0000","last_peered":"2024-09-16T07:34:47.867204+0000","last_clean":"2024-09-16T07:34:47.867204+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:47.867204+0000","last_undegraded":"2024-09-16T07:34:47.867204+0000","last_fullsized":"2024-09-16T07:34:47.867204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":1278311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509522,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1560576,"data_stored":682098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33312,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338528,"statfs":{"total":96636764160,"available":96602652672,"internally_reserved":0,"allocated":2166784,"data_stored":1278311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:54.393 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:54.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 -- 172.21.15.114:0/3616251645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b5870 msgr2=0x7fd4a0165670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/3616251645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b5870 0x7fd4a0165670 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd498009c80 tx=0x7fd49801cda0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 -- 172.21.15.114:0/3616251645 shutdown_connections 2024-09-16T07:34:54.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/3616251645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b5870 0x7fd4a0165670 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/3616251645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4a00b4d80 0x7fd4a00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 -- 172.21.15.114:0/3616251645 >> 172.21.15.114:0/3616251645 conn(0x7fd4a009aa10 msgr2=0x7fd4a009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:54.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 -- 172.21.15.114:0/3616251645 shutdown_connections 2024-09-16T07:34:54.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 -- 172.21.15.114:0/3616251645 wait complete. 2024-09-16T07:34:54.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 Processor -- start 2024-09-16T07:34:54.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.573+0000 7fd4a5a00640 1 -- start start 2024-09-16T07:34:54.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b0ce0 0x7fd4a015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a00b4d80 0x7fd4a009bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4a00b5870 0x7fd4a01562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a0168ae0 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a0168960 con 0x7fd4a00b4d80 2024-09-16T07:34:54.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a0168c60 con 0x7fd4a00b5870 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b0ce0 0x7fd4a015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b0ce0 0x7fd4a015b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35864/0 (socket says 172.21.15.114:35864) 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 -- 172.21.15.114:0/100685589 learned_addr learned my addr 172.21.15.114:0/100685589 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5000640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4a00b5870 0x7fd4a01562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49f400640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a00b4d80 0x7fd4a009bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 -- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4a00b5870 msgr2=0x7fd4a01562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4a00b5870 0x7fd4a01562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 -- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a00b4d80 msgr2=0x7fd4a009bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a00b4d80 0x7fd4a009bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 -- 172.21.15.114:0/100685589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a01f7680 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49f400640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a00b4d80 0x7fd4a009bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd49fe00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b0ce0 0x7fd4a015b4c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c970 tx=0x7fd49000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd497e00640 1 -- 172.21.15.114:0/100685589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490007c70 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd497e00640 1 -- 172.21.15.114:0/100685589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd49000f450 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd497e00640 1 -- 172.21.15.114:0/100685589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49000f8a0 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a01f7960 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a01f7f20 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.577+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a00b11a0 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.581+0000 7fd497e00640 1 -- 172.21.15.114:0/100685589 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fd49000fa40 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.581+0000 7fd497e00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd4800734f0 0x7fd4800759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.581+0000 7fd497e00640 1 -- 172.21.15.114:0/100685589 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fd4900951d0 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.581+0000 7fd49f400640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd4800734f0 0x7fd4800759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.581+0000 7fd49f400640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd4800734f0 0x7fd4800759b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd4a01657f0 tx=0x7fd48c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.585+0000 7fd497e00640 1 -- 172.21.15.114:0/100685589 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd490014030 con 0x7fd4a00b0ce0 2024-09-16T07:34:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.749+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4a01f8440 con 0x7fd4800734f0 2024-09-16T07:34:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.753+0000 7fd497e00640 1 -- 172.21.15.114:0/100685589 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7fd48c056a60 con 0x7fd4800734f0 2024-09-16T07:34:54.755 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd4800734f0 msgr2=0x7fd4800759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd4800734f0 0x7fd4800759b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd4a01657f0 tx=0x7fd48c009040 comp rx=0 tx=0).stop 2024-09-16T07:34:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b0ce0 msgr2=0x7fd4a015b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b0ce0 0x7fd4a015b4c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c970 tx=0x7fd49000ce30 comp rx=0 tx=0).stop 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 shutdown_connections 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd4800734f0 0x7fd4800759b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd4a00b5870 0x7fd4a01562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4a00b4d80 0x7fd4a009bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 --2- 172.21.15.114:0/100685589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd4a00b0ce0 0x7fd4a015b4c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 >> 172.21.15.114:0/100685589 conn(0x7fd4a009aa10 msgr2=0x7fd4a009adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 shutdown_connections 2024-09-16T07:34:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.757+0000 7fd4a5a00640 1 -- 172.21.15.114:0/100685589 wait complete. 2024-09-16T07:34:54.775 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-16T07:34:54.401793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263328,"kb_used_data":13800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711392,"statfs":{"total":773094113280,"available":772824465408,"internally_reserved":0,"allocated":14131200,"data_stored":6844572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896431+0000","last_change":"2024-09-16T07:34:49.899183+0000","last_active":"2024-09-16T07:34:50.896431+0000","last_peered":"2024-09-16T07:34:50.896431+0000","last_clean":"2024-09-16T07:34:50.896431+0000","last_became_active":"2024-09-16T07:34:49.898893+0000","last_became_peered":"2024-09-16T07:34:49.898893+0000","last_unstale":"2024-09-16T07:34:50.896431+0000","last_undegraded":"2024-09-16T07:34:50.896431+0000","last_fullsized":"2024-09-16T07:34:50.896431+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:33:56.752796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608929+0000","last_change":"2024-09-16T07:34:49.900893+0000","last_active":"2024-09-16T07:34:51.608929+0000","last_peered":"2024-09-16T07:34:51.608929+0000","last_clean":"2024-09-16T07:34:51.608929+0000","last_became_active":"2024-09-16T07:34:49.900644+0000","last_became_peered":"2024-09-16T07:34:49.900644+0000","last_unstale":"2024-09-16T07:34:51.608929+0000","last_undegraded":"2024-09-16T07:34:51.608929+0000","last_fullsized":"2024-09-16T07:34:51.608929+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:33.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276630+0000","last_change":"2024-09-16T07:34:49.902252+0000","last_active":"2024-09-16T07:34:51.276630+0000","last_peered":"2024-09-16T07:34:51.276630+0000","last_clean":"2024-09-16T07:34:51.276630+0000","last_became_active":"2024-09-16T07:34:49.900140+0000","last_became_peered":"2024-09-16T07:34:49.900140+0000","last_unstale":"2024-09-16T07:34:51.276630+0000","last_undegraded":"2024-09-16T07:34:51.276630+0000","last_fullsized":"2024-09-16T07:34:51.276630+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:03.391435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894676+0000","last_change":"2024-09-16T07:34:49.890232+0000","last_active":"2024-09-16T07:34:50.894676+0000","last_peered":"2024-09-16T07:34:50.894676+0000","last_clean":"2024-09-16T07:34:50.894676+0000","last_became_active":"2024-09-16T07:34:49.889860+0000","last_became_peered":"2024-09-16T07:34:49.889860+0000","last_unstale":"2024-09-16T07:34:50.894676+0000","last_undegraded":"2024-09-16T07:34:50.894676+0000","last_fullsized":"2024-09-16T07:34:50.894676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:29.042874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894181+0000","last_change":"2024-09-16T07:34:49.899107+0000","last_active":"2024-09-16T07:34:50.894181+0000","last_peered":"2024-09-16T07:34:50.894181+0000","last_clean":"2024-09-16T07:34:50.894181+0000","last_became_active":"2024-09-16T07:34:49.898755+0000","last_became_peered":"2024-09-16T07:34:49.898755+0000","last_unstale":"2024-09-16T07:34:50.894181+0000","last_undegraded":"2024-09-16T07:34:50.894181+0000","last_fullsized":"2024-09-16T07:34:50.894181+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:55.193802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895777+0000","last_change":"2024-09-16T07:34:49.896559+0000","last_active":"2024-09-16T07:34:50.895777+0000","last_peered":"2024-09-16T07:34:50.895777+0000","last_clean":"2024-09-16T07:34:50.895777+0000","last_became_active":"2024-09-16T07:34:49.896039+0000","last_became_peered":"2024-09-16T07:34:49.896039+0000","last_unstale":"2024-09-16T07:34:50.895777+0000","last_undegraded":"2024-09-16T07:34:50.895777+0000","last_fullsized":"2024-09-16T07:34:50.895777+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:46.644889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609849+0000","last_change":"2024-09-16T07:34:49.905596+0000","last_active":"2024-09-16T07:34:51.609849+0000","last_peered":"2024-09-16T07:34:51.609849+0000","last_clean":"2024-09-16T07:34:51.609849+0000","last_became_active":"2024-09-16T07:34:49.905348+0000","last_became_peered":"2024-09-16T07:34:49.905348+0000","last_unstale":"2024-09-16T07:34:51.609849+0000","last_undegraded":"2024-09-16T07:34:51.609849+0000","last_fullsized":"2024-09-16T07:34:51.609849+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:52.411568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895652+0000","last_change":"2024-09-16T07:34:49.893481+0000","last_active":"2024-09-16T07:34:50.895652+0000","last_peered":"2024-09-16T07:34:50.895652+0000","last_clean":"2024-09-16T07:34:50.895652+0000","last_became_active":"2024-09-16T07:34:49.893173+0000","last_became_peered":"2024-09-16T07:34:49.893173+0000","last_unstale":"2024-09-16T07:34:50.895652+0000","last_undegraded":"2024-09-16T07:34:50.895652+0000","last_fullsized":"2024-09-16T07:34:50.895652+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:41.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608799+0000","last_change":"2024-09-16T07:34:49.905128+0000","last_active":"2024-09-16T07:34:51.608799+0000","last_peered":"2024-09-16T07:34:51.608799+0000","last_clean":"2024-09-16T07:34:51.608799+0000","last_became_active":"2024-09-16T07:34:49.904909+0000","last_became_peered":"2024-09-16T07:34:49.904909+0000","last_unstale":"2024-09-16T07:34:51.608799+0000","last_undegraded":"2024-09-16T07:34:51.608799+0000","last_fullsized":"2024-09-16T07:34:51.608799+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:25.593996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606040+0000","last_change":"2024-09-16T07:34:49.904121+0000","last_active":"2024-09-16T07:34:51.606040+0000","last_peered":"2024-09-16T07:34:51.606040+0000","last_clean":"2024-09-16T07:34:51.606040+0000","last_became_active":"2024-09-16T07:34:49.903902+0000","last_became_peered":"2024-09-16T07:34:49.903902+0000","last_unstale":"2024-09-16T07:34:51.606040+0000","last_undegraded":"2024-09-16T07:34:51.606040+0000","last_fullsized":"2024-09-16T07:34:51.606040+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:40.009722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895950+0000","last_change":"2024-09-16T07:34:49.893513+0000","last_active":"2024-09-16T07:34:50.895950+0000","last_peered":"2024-09-16T07:34:50.895950+0000","last_clean":"2024-09-16T07:34:50.895950+0000","last_became_active":"2024-09-16T07:34:49.893294+0000","last_became_peered":"2024-09-16T07:34:49.893294+0000","last_unstale":"2024-09-16T07:34:50.895950+0000","last_undegraded":"2024-09-16T07:34:50.895950+0000","last_fullsized":"2024-09-16T07:34:50.895950+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:56.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605660+0000","last_change":"2024-09-16T07:34:49.898104+0000","last_active":"2024-09-16T07:34:51.605660+0000","last_peered":"2024-09-16T07:34:51.605660+0000","last_clean":"2024-09-16T07:34:51.605660+0000","last_became_active":"2024-09-16T07:34:49.897111+0000","last_became_peered":"2024-09-16T07:34:49.897111+0000","last_unstale":"2024-09-16T07:34:51.605660+0000","last_undegraded":"2024-09-16T07:34:51.605660+0000","last_fullsized":"2024-09-16T07:34:51.605660+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:33.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894259+0000","last_change":"2024-09-16T07:34:49.898452+0000","last_active":"2024-09-16T07:34:50.894259+0000","last_peered":"2024-09-16T07:34:50.894259+0000","last_clean":"2024-09-16T07:34:50.894259+0000","last_became_active":"2024-09-16T07:34:49.898188+0000","last_became_peered":"2024-09-16T07:34:49.898188+0000","last_unstale":"2024-09-16T07:34:50.894259+0000","last_undegraded":"2024-09-16T07:34:50.894259+0000","last_fullsized":"2024-09-16T07:34:50.894259+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:16:41.058648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893841+0000","last_change":"2024-09-16T07:34:49.892557+0000","last_active":"2024-09-16T07:34:50.893841+0000","last_peered":"2024-09-16T07:34:50.893841+0000","last_clean":"2024-09-16T07:34:50.893841+0000","last_became_active":"2024-09-16T07:34:49.891634+0000","last_became_peered":"2024-09-16T07:34:49.891634+0000","last_unstale":"2024-09-16T07:34:50.893841+0000","last_undegraded":"2024-09-16T07:34:50.893841+0000","last_fullsized":"2024-09-16T07:34:50.893841+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:53.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605533+0000","last_change":"2024-09-16T07:34:49.893225+0000","last_active":"2024-09-16T07:34:51.605533+0000","last_peered":"2024-09-16T07:34:51.605533+0000","last_clean":"2024-09-16T07:34:51.605533+0000","last_became_active":"2024-09-16T07:34:49.892927+0000","last_became_peered":"2024-09-16T07:34:49.892927+0000","last_unstale":"2024-09-16T07:34:51.605533+0000","last_undegraded":"2024-09-16T07:34:51.605533+0000","last_fullsized":"2024-09-16T07:34:51.605533+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:03.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608865+0000","last_change":"2024-09-16T07:34:49.893120+0000","last_active":"2024-09-16T07:34:51.608865+0000","last_peered":"2024-09-16T07:34:51.608865+0000","last_clean":"2024-09-16T07:34:51.608865+0000","last_became_active":"2024-09-16T07:34:49.892811+0000","last_became_peered":"2024-09-16T07:34:49.892811+0000","last_unstale":"2024-09-16T07:34:51.608865+0000","last_undegraded":"2024-09-16T07:34:51.608865+0000","last_fullsized":"2024-09-16T07:34:51.608865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:07.380736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606359+0000","last_change":"2024-09-16T07:34:49.905443+0000","last_active":"2024-09-16T07:34:51.606359+0000","last_peered":"2024-09-16T07:34:51.606359+0000","last_clean":"2024-09-16T07:34:51.606359+0000","last_became_active":"2024-09-16T07:34:49.905192+0000","last_became_peered":"2024-09-16T07:34:49.905192+0000","last_unstale":"2024-09-16T07:34:51.606359+0000","last_undegraded":"2024-09-16T07:34:51.606359+0000","last_fullsized":"2024-09-16T07:34:51.606359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:18.385151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276642+0000","last_change":"2024-09-16T07:34:49.902936+0000","last_active":"2024-09-16T07:34:51.276642+0000","last_peered":"2024-09-16T07:34:51.276642+0000","last_clean":"2024-09-16T07:34:51.276642+0000","last_became_active":"2024-09-16T07:34:49.899974+0000","last_became_peered":"2024-09-16T07:34:49.899974+0000","last_unstale":"2024-09-16T07:34:51.276642+0000","last_undegraded":"2024-09-16T07:34:51.276642+0000","last_fullsized":"2024-09-16T07:34:51.276642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:08.628647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896212+0000","last_change":"2024-09-16T07:34:49.888985+0000","last_active":"2024-09-16T07:34:50.896212+0000","last_peered":"2024-09-16T07:34:50.896212+0000","last_clean":"2024-09-16T07:34:50.896212+0000","last_became_active":"2024-09-16T07:34:49.888293+0000","last_became_peered":"2024-09-16T07:34:49.888293+0000","last_unstale":"2024-09-16T07:34:50.896212+0000","last_undegraded":"2024-09-16T07:34:50.896212+0000","last_fullsized":"2024-09-16T07:34:50.896212+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:46.673683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609719+0000","last_change":"2024-09-16T07:34:49.904962+0000","last_active":"2024-09-16T07:34:51.609719+0000","last_peered":"2024-09-16T07:34:51.609719+0000","last_clean":"2024-09-16T07:34:51.609719+0000","last_became_active":"2024-09-16T07:34:49.904638+0000","last_became_peered":"2024-09-16T07:34:49.904638+0000","last_unstale":"2024-09-16T07:34:51.609719+0000","last_undegraded":"2024-09-16T07:34:51.609719+0000","last_fullsized":"2024-09-16T07:34:51.609719+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:42.367210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605930+0000","last_change":"2024-09-16T07:34:49.904665+0000","last_active":"2024-09-16T07:34:51.605930+0000","last_peered":"2024-09-16T07:34:51.605930+0000","last_clean":"2024-09-16T07:34:51.605930+0000","last_became_active":"2024-09-16T07:34:49.904436+0000","last_became_peered":"2024-09-16T07:34:49.904436+0000","last_unstale":"2024-09-16T07:34:51.605930+0000","last_undegraded":"2024-09-16T07:34:51.605930+0000","last_fullsized":"2024-09-16T07:34:51.605930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:21.486829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894174+0000","last_change":"2024-09-16T07:34:49.897868+0000","last_active":"2024-09-16T07:34:50.894174+0000","last_peered":"2024-09-16T07:34:50.894174+0000","last_clean":"2024-09-16T07:34:50.894174+0000","last_became_active":"2024-09-16T07:34:49.897223+0000","last_became_peered":"2024-09-16T07:34:49.897223+0000","last_unstale":"2024-09-16T07:34:50.894174+0000","last_undegraded":"2024-09-16T07:34:50.894174+0000","last_fullsized":"2024-09-16T07:34:50.894174+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:57.948900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893734+0000","last_change":"2024-09-16T07:34:49.893322+0000","last_active":"2024-09-16T07:34:50.893734+0000","last_peered":"2024-09-16T07:34:50.893734+0000","last_clean":"2024-09-16T07:34:50.893734+0000","last_became_active":"2024-09-16T07:34:49.893024+0000","last_became_peered":"2024-09-16T07:34:49.893024+0000","last_unstale":"2024-09-16T07:34:50.893734+0000","last_undegraded":"2024-09-16T07:34:50.893734+0000","last_fullsized":"2024-09-16T07:34:50.893734+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:10.977612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605653+0000","last_change":"2024-09-16T07:34:49.902914+0000","last_active":"2024-09-16T07:34:51.605653+0000","last_peered":"2024-09-16T07:34:51.605653+0000","last_clean":"2024-09-16T07:34:51.605653+0000","last_became_active":"2024-09-16T07:34:49.902537+0000","last_became_peered":"2024-09-16T07:34:49.902537+0000","last_unstale":"2024-09-16T07:34:51.605653+0000","last_undegraded":"2024-09-16T07:34:51.605653+0000","last_fullsized":"2024-09-16T07:34:51.605653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:18.808025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609847+0000","last_change":"2024-09-16T07:34:49.897597+0000","last_active":"2024-09-16T07:34:51.609847+0000","last_peered":"2024-09-16T07:34:51.609847+0000","last_clean":"2024-09-16T07:34:51.609847+0000","last_became_active":"2024-09-16T07:34:49.897339+0000","last_became_peered":"2024-09-16T07:34:49.897339+0000","last_unstale":"2024-09-16T07:34:51.609847+0000","last_undegraded":"2024-09-16T07:34:51.609847+0000","last_fullsized":"2024-09-16T07:34:51.609847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:39:20.393857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896168+0000","last_change":"2024-09-16T07:34:49.889825+0000","last_active":"2024-09-16T07:34:50.896168+0000","last_peered":"2024-09-16T07:34:50.896168+0000","last_clean":"2024-09-16T07:34:50.896168+0000","last_became_active":"2024-09-16T07:34:49.889595+0000","last_became_peered":"2024-09-16T07:34:49.889595+0000","last_unstale":"2024-09-16T07:34:50.896168+0000","last_undegraded":"2024-09-16T07:34:50.896168+0000","last_fullsized":"2024-09-16T07:34:50.896168+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:14.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610261+0000","last_change":"2024-09-16T07:34:49.899847+0000","last_active":"2024-09-16T07:34:51.610261+0000","last_peered":"2024-09-16T07:34:51.610261+0000","last_clean":"2024-09-16T07:34:51.610261+0000","last_became_active":"2024-09-16T07:34:49.899669+0000","last_became_peered":"2024-09-16T07:34:49.899669+0000","last_unstale":"2024-09-16T07:34:51.610261+0000","last_undegraded":"2024-09-16T07:34:51.610261+0000","last_fullsized":"2024-09-16T07:34:51.610261+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:21.057744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610300+0000","last_change":"2024-09-16T07:34:49.895116+0000","last_active":"2024-09-16T07:34:51.610300+0000","last_peered":"2024-09-16T07:34:51.610300+0000","last_clean":"2024-09-16T07:34:51.610300+0000","last_became_active":"2024-09-16T07:34:49.894843+0000","last_became_peered":"2024-09-16T07:34:49.894843+0000","last_unstale":"2024-09-16T07:34:51.610300+0000","last_undegraded":"2024-09-16T07:34:51.610300+0000","last_fullsized":"2024-09-16T07:34:51.610300+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:35.361017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895808+0000","last_change":"2024-09-16T07:34:49.894264+0000","last_active":"2024-09-16T07:34:50.895808+0000","last_peered":"2024-09-16T07:34:50.895808+0000","last_clean":"2024-09-16T07:34:50.895808+0000","last_became_active":"2024-09-16T07:34:49.894000+0000","last_became_peered":"2024-09-16T07:34:49.894000+0000","last_unstale":"2024-09-16T07:34:50.895808+0000","last_undegraded":"2024-09-16T07:34:50.895808+0000","last_fullsized":"2024-09-16T07:34:50.895808+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:45.059188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894447+0000","last_change":"2024-09-16T07:34:49.891915+0000","last_active":"2024-09-16T07:34:50.894447+0000","last_peered":"2024-09-16T07:34:50.894447+0000","last_clean":"2024-09-16T07:34:50.894447+0000","last_became_active":"2024-09-16T07:34:49.891124+0000","last_became_peered":"2024-09-16T07:34:49.891124+0000","last_unstale":"2024-09-16T07:34:50.894447+0000","last_undegraded":"2024-09-16T07:34:50.894447+0000","last_fullsized":"2024-09-16T07:34:50.894447+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:10.550878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608593+0000","last_change":"2024-09-16T07:34:49.899581+0000","last_active":"2024-09-16T07:34:51.608593+0000","last_peered":"2024-09-16T07:34:51.608593+0000","last_clean":"2024-09-16T07:34:51.608593+0000","last_became_active":"2024-09-16T07:34:49.899275+0000","last_became_peered":"2024-09-16T07:34:49.899275+0000","last_unstale":"2024-09-16T07:34:51.608593+0000","last_undegraded":"2024-09-16T07:34:51.608593+0000","last_fullsized":"2024-09-16T07:34:51.608593+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:51:12.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608964+0000","last_change":"2024-09-16T07:34:49.886312+0000","last_active":"2024-09-16T07:34:51.608964+0000","last_peered":"2024-09-16T07:34:51.608964+0000","last_clean":"2024-09-16T07:34:51.608964+0000","last_became_active":"2024-09-16T07:34:49.885586+0000","last_became_peered":"2024-09-16T07:34:49.885586+0000","last_unstale":"2024-09-16T07:34:51.608964+0000","last_undegraded":"2024-09-16T07:34:51.608964+0000","last_fullsized":"2024-09-16T07:34:51.608964+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:19:30.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606200+0000","last_change":"2024-09-16T07:34:49.900783+0000","last_active":"2024-09-16T07:34:51.606200+0000","last_peered":"2024-09-16T07:34:51.606200+0000","last_clean":"2024-09-16T07:34:51.606200+0000","last_became_active":"2024-09-16T07:34:49.900088+0000","last_became_peered":"2024-09-16T07:34:49.900088+0000","last_unstale":"2024-09-16T07:34:51.606200+0000","last_undegraded":"2024-09-16T07:34:51.606200+0000","last_fullsized":"2024-09-16T07:34:51.606200+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:54.929870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"128'4","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606037+0000","last_change":"2024-09-16T07:34:48.893084+0000","last_active":"2024-09-16T07:34:51.606037+0000","last_peered":"2024-09-16T07:34:51.606037+0000","last_clean":"2024-09-16T07:34:51.606037+0000","last_became_active":"2024-09-16T07:34:48.892752+0000","last_became_peered":"2024-09-16T07:34:48.892752+0000","last_unstale":"2024-09-16T07:34:51.606037+0000","last_undegraded":"2024-09-16T07:34:51.606037+0000","last_fullsized":"2024-09-16T07:34:51.606037+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:03.060258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609358+0000","last_change":"2024-09-16T07:34:49.905020+0000","last_active":"2024-09-16T07:34:51.609358+0000","last_peered":"2024-09-16T07:34:51.609358+0000","last_clean":"2024-09-16T07:34:51.609358+0000","last_became_active":"2024-09-16T07:34:49.904530+0000","last_became_peered":"2024-09-16T07:34:49.904530+0000","last_unstale":"2024-09-16T07:34:51.609358+0000","last_undegraded":"2024-09-16T07:34:51.609358+0000","last_fullsized":"2024-09-16T07:34:51.609358+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:40.585668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609152+0000","last_change":"2024-09-16T07:34:48.888909+0000","last_active":"2024-09-16T07:34:51.609152+0000","last_peered":"2024-09-16T07:34:51.609152+0000","last_clean":"2024-09-16T07:34:51.609152+0000","last_became_active":"2024-09-16T07:34:48.888597+0000","last_became_peered":"2024-09-16T07:34:48.888597+0000","last_unstale":"2024-09-16T07:34:51.609152+0000","last_undegraded":"2024-09-16T07:34:51.609152+0000","last_fullsized":"2024-09-16T07:34:51.609152+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:20.280007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895884+0000","last_change":"2024-09-16T07:34:49.898404+0000","last_active":"2024-09-16T07:34:50.895884+0000","last_peered":"2024-09-16T07:34:50.895884+0000","last_clean":"2024-09-16T07:34:50.895884+0000","last_became_active":"2024-09-16T07:34:49.898126+0000","last_became_peered":"2024-09-16T07:34:49.898126+0000","last_unstale":"2024-09-16T07:34:50.895884+0000","last_undegraded":"2024-09-16T07:34:50.895884+0000","last_fullsized":"2024-09-16T07:34:50.895884+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:58.497347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894293+0000","last_change":"2024-09-16T07:34:48.892523+0000","last_active":"2024-09-16T07:34:50.894293+0000","last_peered":"2024-09-16T07:34:50.894293+0000","last_clean":"2024-09-16T07:34:50.894293+0000","last_became_active":"2024-09-16T07:34:48.892217+0000","last_became_peered":"2024-09-16T07:34:48.892217+0000","last_unstale":"2024-09-16T07:34:50.894293+0000","last_undegraded":"2024-09-16T07:34:50.894293+0000","last_fullsized":"2024-09-16T07:34:50.894293+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:17.649185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605803+0000","last_change":"2024-09-16T07:34:49.897472+0000","last_active":"2024-09-16T07:34:51.605803+0000","last_peered":"2024-09-16T07:34:51.605803+0000","last_clean":"2024-09-16T07:34:51.605803+0000","last_became_active":"2024-09-16T07:34:49.896306+0000","last_became_peered":"2024-09-16T07:34:49.896306+0000","last_unstale":"2024-09-16T07:34:51.605803+0000","last_undegraded":"2024-09-16T07:34:51.605803+0000","last_fullsized":"2024-09-16T07:34:51.605803+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:40.585668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894734+0000","last_change":"2024-09-16T07:34:48.894534+0000","last_active":"2024-09-16T07:34:50.894734+0000","last_peered":"2024-09-16T07:34:50.894734+0000","last_clean":"2024-09-16T07:34:50.894734+0000","last_became_active":"2024-09-16T07:34:48.894219+0000","last_became_peered":"2024-09-16T07:34:48.894219+0000","last_unstale":"2024-09-16T07:34:50.894734+0000","last_undegraded":"2024-09-16T07:34:50.894734+0000","last_fullsized":"2024-09-16T07:34:50.894734+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:30.150520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608696+0000","last_change":"2024-09-16T07:34:49.900273+0000","last_active":"2024-09-16T07:34:51.608696+0000","last_peered":"2024-09-16T07:34:51.608696+0000","last_clean":"2024-09-16T07:34:51.608696+0000","last_became_active":"2024-09-16T07:34:49.900031+0000","last_became_peered":"2024-09-16T07:34:49.900031+0000","last_unstale":"2024-09-16T07:34:51.608696+0000","last_undegraded":"2024-09-16T07:34:51.608696+0000","last_fullsized":"2024-09-16T07:34:51.608696+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:46.304723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609300+0000","last_change":"2024-09-16T07:34:48.890124+0000","last_active":"2024-09-16T07:34:51.609300+0000","last_peered":"2024-09-16T07:34:51.609300+0000","last_clean":"2024-09-16T07:34:51.609300+0000","last_became_active":"2024-09-16T07:34:48.889825+0000","last_became_peered":"2024-09-16T07:34:48.889825+0000","last_unstale":"2024-09-16T07:34:51.609300+0000","last_undegraded":"2024-09-16T07:34:51.609300+0000","last_fullsized":"2024-09-16T07:34:51.609300+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:34.798167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893986+0000","last_change":"2024-09-16T07:34:49.892664+0000","last_active":"2024-09-16T07:34:50.893986+0000","last_peered":"2024-09-16T07:34:50.893986+0000","last_clean":"2024-09-16T07:34:50.893986+0000","last_became_active":"2024-09-16T07:34:49.890809+0000","last_became_peered":"2024-09-16T07:34:49.890809+0000","last_unstale":"2024-09-16T07:34:50.893986+0000","last_undegraded":"2024-09-16T07:34:50.893986+0000","last_fullsized":"2024-09-16T07:34:50.893986+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:21.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894029+0000","last_change":"2024-09-16T07:34:48.881340+0000","last_active":"2024-09-16T07:34:50.894029+0000","last_peered":"2024-09-16T07:34:50.894029+0000","last_clean":"2024-09-16T07:34:50.894029+0000","last_became_active":"2024-09-16T07:34:48.880998+0000","last_became_peered":"2024-09-16T07:34:48.880998+0000","last_unstale":"2024-09-16T07:34:50.894029+0000","last_undegraded":"2024-09-16T07:34:50.894029+0000","last_fullsized":"2024-09-16T07:34:50.894029+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:40:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608490+0000","last_change":"2024-09-16T07:34:49.900704+0000","last_active":"2024-09-16T07:34:51.608490+0000","last_peered":"2024-09-16T07:34:51.608490+0000","last_clean":"2024-09-16T07:34:51.608490+0000","last_became_active":"2024-09-16T07:34:49.899171+0000","last_became_peered":"2024-09-16T07:34:49.899171+0000","last_unstale":"2024-09-16T07:34:51.608490+0000","last_undegraded":"2024-09-16T07:34:51.608490+0000","last_fullsized":"2024-09-16T07:34:51.608490+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:48.669982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609086+0000","last_change":"2024-09-16T07:34:48.889784+0000","last_active":"2024-09-16T07:34:51.609086+0000","last_peered":"2024-09-16T07:34:51.609086+0000","last_clean":"2024-09-16T07:34:51.609086+0000","last_became_active":"2024-09-16T07:34:48.889255+0000","last_became_peered":"2024-09-16T07:34:48.889255+0000","last_unstale":"2024-09-16T07:34:51.609086+0000","last_undegraded":"2024-09-16T07:34:51.609086+0000","last_fullsized":"2024-09-16T07:34:51.609086+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:57.953541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893602+0000","last_change":"2024-09-16T07:34:49.890288+0000","last_active":"2024-09-16T07:34:50.893602+0000","last_peered":"2024-09-16T07:34:50.893602+0000","last_clean":"2024-09-16T07:34:50.893602+0000","last_became_active":"2024-09-16T07:34:49.889657+0000","last_became_peered":"2024-09-16T07:34:49.889657+0000","last_unstale":"2024-09-16T07:34:50.893602+0000","last_undegraded":"2024-09-16T07:34:50.893602+0000","last_fullsized":"2024-09-16T07:34:50.893602+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:28.815364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893378+0000","last_change":"2024-09-16T07:34:48.886612+0000","last_active":"2024-09-16T07:34:50.893378+0000","last_peered":"2024-09-16T07:34:50.893378+0000","last_clean":"2024-09-16T07:34:50.893378+0000","last_became_active":"2024-09-16T07:34:48.885615+0000","last_became_peered":"2024-09-16T07:34:48.885615+0000","last_unstale":"2024-09-16T07:34:50.893378+0000","last_undegraded":"2024-09-16T07:34:50.893378+0000","last_fullsized":"2024-09-16T07:34:50.893378+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:21.191674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894591+0000","last_change":"2024-09-16T07:34:49.887223+0000","last_active":"2024-09-16T07:34:50.894591+0000","last_peered":"2024-09-16T07:34:50.894591+0000","last_clean":"2024-09-16T07:34:50.894591+0000","last_became_active":"2024-09-16T07:34:49.886427+0000","last_became_peered":"2024-09-16T07:34:49.886427+0000","last_unstale":"2024-09-16T07:34:50.894591+0000","last_undegraded":"2024-09-16T07:34:50.894591+0000","last_fullsized":"2024-09-16T07:34:50.894591+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:47.368733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609270+0000","last_change":"2024-09-16T07:34:48.894539+0000","last_active":"2024-09-16T07:34:51.609270+0000","last_peered":"2024-09-16T07:34:51.609270+0000","last_clean":"2024-09-16T07:34:51.609270+0000","last_became_active":"2024-09-16T07:34:48.894261+0000","last_became_peered":"2024-09-16T07:34:48.894261+0000","last_unstale":"2024-09-16T07:34:51.609270+0000","last_undegraded":"2024-09-16T07:34:51.609270+0000","last_fullsized":"2024-09-16T07:34:51.609270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:28.039721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606087+0000","last_change":"2024-09-16T07:34:49.895864+0000","last_active":"2024-09-16T07:34:51.606087+0000","last_peered":"2024-09-16T07:34:51.606087+0000","last_clean":"2024-09-16T07:34:51.606087+0000","last_became_active":"2024-09-16T07:34:49.895498+0000","last_became_peered":"2024-09-16T07:34:49.895498+0000","last_unstale":"2024-09-16T07:34:51.606087+0000","last_undegraded":"2024-09-16T07:34:51.606087+0000","last_fullsized":"2024-09-16T07:34:51.606087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:17.431505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606279+0000","last_change":"2024-09-16T07:34:48.887587+0000","last_active":"2024-09-16T07:34:51.606279+0000","last_peered":"2024-09-16T07:34:51.606279+0000","last_clean":"2024-09-16T07:34:51.606279+0000","last_became_active":"2024-09-16T07:34:48.887245+0000","last_became_peered":"2024-09-16T07:34:48.887245+0000","last_unstale":"2024-09-16T07:34:51.606279+0000","last_undegraded":"2024-09-16T07:34:51.606279+0000","last_fullsized":"2024-09-16T07:34:51.606279+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:37.149662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609875+0000","last_change":"2024-09-16T07:34:49.896388+0000","last_active":"2024-09-16T07:34:51.609875+0000","last_peered":"2024-09-16T07:34:51.609875+0000","last_clean":"2024-09-16T07:34:51.609875+0000","last_became_active":"2024-09-16T07:34:49.896021+0000","last_became_peered":"2024-09-16T07:34:49.896021+0000","last_unstale":"2024-09-16T07:34:51.609875+0000","last_undegraded":"2024-09-16T07:34:51.609875+0000","last_fullsized":"2024-09-16T07:34:51.609875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:03.006749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610322+0000","last_change":"2024-09-16T07:34:48.888681+0000","last_active":"2024-09-16T07:34:51.610322+0000","last_peered":"2024-09-16T07:34:51.610322+0000","last_clean":"2024-09-16T07:34:51.610322+0000","last_became_active":"2024-09-16T07:34:48.888378+0000","last_became_peered":"2024-09-16T07:34:48.888378+0000","last_unstale":"2024-09-16T07:34:51.610322+0000","last_undegraded":"2024-09-16T07:34:51.610322+0000","last_fullsized":"2024-09-16T07:34:51.610322+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:37.758771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276334+0000","last_change":"2024-09-16T07:34:49.895542+0000","last_active":"2024-09-16T07:34:51.276334+0000","last_peered":"2024-09-16T07:34:51.276334+0000","last_clean":"2024-09-16T07:34:51.276334+0000","last_became_active":"2024-09-16T07:34:49.895125+0000","last_became_peered":"2024-09-16T07:34:49.895125+0000","last_unstale":"2024-09-16T07:34:51.276334+0000","last_undegraded":"2024-09-16T07:34:51.276334+0000","last_fullsized":"2024-09-16T07:34:51.276334+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:48.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276358+0000","last_change":"2024-09-16T07:34:48.892483+0000","last_active":"2024-09-16T07:34:51.276358+0000","last_peered":"2024-09-16T07:34:51.276358+0000","last_clean":"2024-09-16T07:34:51.276358+0000","last_became_active":"2024-09-16T07:34:48.892186+0000","last_became_peered":"2024-09-16T07:34:48.892186+0000","last_unstale":"2024-09-16T07:34:51.276358+0000","last_undegraded":"2024-09-16T07:34:51.276358+0000","last_fullsized":"2024-09-16T07:34:51.276358+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:52.424987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609067+0000","last_change":"2024-09-16T07:34:49.901728+0000","last_active":"2024-09-16T07:34:51.609067+0000","last_peered":"2024-09-16T07:34:51.609067+0000","last_clean":"2024-09-16T07:34:51.609067+0000","last_became_active":"2024-09-16T07:34:49.898973+0000","last_became_peered":"2024-09-16T07:34:49.898973+0000","last_unstale":"2024-09-16T07:34:51.609067+0000","last_undegraded":"2024-09-16T07:34:51.609067+0000","last_fullsized":"2024-09-16T07:34:51.609067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:38.761924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276269+0000","last_change":"2024-09-16T07:34:48.877638+0000","last_active":"2024-09-16T07:34:51.276269+0000","last_peered":"2024-09-16T07:34:51.276269+0000","last_clean":"2024-09-16T07:34:51.276269+0000","last_became_active":"2024-09-16T07:34:48.877313+0000","last_became_peered":"2024-09-16T07:34:48.877313+0000","last_unstale":"2024-09-16T07:34:51.276269+0000","last_undegraded":"2024-09-16T07:34:51.276269+0000","last_fullsized":"2024-09-16T07:34:51.276269+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:44.056036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893730+0000","last_change":"2024-09-16T07:34:49.890818+0000","last_active":"2024-09-16T07:34:50.893730+0000","last_peered":"2024-09-16T07:34:50.893730+0000","last_clean":"2024-09-16T07:34:50.893730+0000","last_became_active":"2024-09-16T07:34:49.890433+0000","last_became_peered":"2024-09-16T07:34:49.890433+0000","last_unstale":"2024-09-16T07:34:50.893730+0000","last_undegraded":"2024-09-16T07:34:50.893730+0000","last_fullsized":"2024-09-16T07:34:50.893730+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:27:22.656611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895494+0000","last_change":"2024-09-16T07:34:48.892873+0000","last_active":"2024-09-16T07:34:50.895494+0000","last_peered":"2024-09-16T07:34:50.895494+0000","last_clean":"2024-09-16T07:34:50.895494+0000","last_became_active":"2024-09-16T07:34:48.892618+0000","last_became_peered":"2024-09-16T07:34:48.892618+0000","last_unstale":"2024-09-16T07:34:50.895494+0000","last_undegraded":"2024-09-16T07:34:50.895494+0000","last_fullsized":"2024-09-16T07:34:50.895494+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:14:27.718923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276162+0000","last_change":"2024-09-16T07:34:49.884712+0000","last_active":"2024-09-16T07:34:51.276162+0000","last_peered":"2024-09-16T07:34:51.276162+0000","last_clean":"2024-09-16T07:34:51.276162+0000","last_became_active":"2024-09-16T07:34:49.884441+0000","last_became_peered":"2024-09-16T07:34:49.884441+0000","last_unstale":"2024-09-16T07:34:51.276162+0000","last_undegraded":"2024-09-16T07:34:51.276162+0000","last_fullsized":"2024-09-16T07:34:51.276162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:53.005442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"128'8","reported_seq":23,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608909+0000","last_change":"2024-09-16T07:34:48.890362+0000","last_active":"2024-09-16T07:34:51.608909+0000","last_peered":"2024-09-16T07:34:51.608909+0000","last_clean":"2024-09-16T07:34:51.608909+0000","last_became_active":"2024-09-16T07:34:48.890100+0000","last_became_peered":"2024-09-16T07:34:48.890100+0000","last_unstale":"2024-09-16T07:34:51.608909+0000","last_undegraded":"2024-09-16T07:34:51.608909+0000","last_fullsized":"2024-09-16T07:34:51.608909+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:28:25.076831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606219+0000","last_change":"2024-09-16T07:34:49.900365+0000","last_active":"2024-09-16T07:34:51.606219+0000","last_peered":"2024-09-16T07:34:51.606219+0000","last_clean":"2024-09-16T07:34:51.606219+0000","last_became_active":"2024-09-16T07:34:49.895213+0000","last_became_peered":"2024-09-16T07:34:49.895213+0000","last_unstale":"2024-09-16T07:34:51.606219+0000","last_undegraded":"2024-09-16T07:34:51.606219+0000","last_fullsized":"2024-09-16T07:34:51.606219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:52.411568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894405+0000","last_change":"2024-09-16T07:34:48.875951+0000","last_active":"2024-09-16T07:34:50.894405+0000","last_peered":"2024-09-16T07:34:50.894405+0000","last_clean":"2024-09-16T07:34:50.894405+0000","last_became_active":"2024-09-16T07:34:48.875659+0000","last_became_peered":"2024-09-16T07:34:48.875659+0000","last_unstale":"2024-09-16T07:34:50.894405+0000","last_undegraded":"2024-09-16T07:34:50.894405+0000","last_fullsized":"2024-09-16T07:34:50.894405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:52.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610061+0000","last_change":"2024-09-16T07:34:49.903151+0000","last_active":"2024-09-16T07:34:51.610061+0000","last_peered":"2024-09-16T07:34:51.610061+0000","last_clean":"2024-09-16T07:34:51.610061+0000","last_became_active":"2024-09-16T07:34:49.902861+0000","last_became_peered":"2024-09-16T07:34:49.902861+0000","last_unstale":"2024-09-16T07:34:51.610061+0000","last_undegraded":"2024-09-16T07:34:51.610061+0000","last_fullsized":"2024-09-16T07:34:51.610061+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:31:35.643169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609012+0000","last_change":"2024-09-16T07:34:48.898075+0000","last_active":"2024-09-16T07:34:51.609012+0000","last_peered":"2024-09-16T07:34:51.609012+0000","last_clean":"2024-09-16T07:34:51.609012+0000","last_became_active":"2024-09-16T07:34:48.896622+0000","last_became_peered":"2024-09-16T07:34:48.896622+0000","last_unstale":"2024-09-16T07:34:51.609012+0000","last_undegraded":"2024-09-16T07:34:51.609012+0000","last_fullsized":"2024-09-16T07:34:51.609012+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:09.547726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276367+0000","last_change":"2024-09-16T07:34:49.893352+0000","last_active":"2024-09-16T07:34:51.276367+0000","last_peered":"2024-09-16T07:34:51.276367+0000","last_clean":"2024-09-16T07:34:51.276367+0000","last_became_active":"2024-09-16T07:34:49.892959+0000","last_became_peered":"2024-09-16T07:34:49.892959+0000","last_unstale":"2024-09-16T07:34:51.276367+0000","last_undegraded":"2024-09-16T07:34:51.276367+0000","last_fullsized":"2024-09-16T07:34:51.276367+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:55.212243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609940+0000","last_change":"2024-09-16T07:34:48.892908+0000","last_active":"2024-09-16T07:34:51.609940+0000","last_peered":"2024-09-16T07:34:51.609940+0000","last_clean":"2024-09-16T07:34:51.609940+0000","last_became_active":"2024-09-16T07:34:48.892574+0000","last_became_peered":"2024-09-16T07:34:48.892574+0000","last_unstale":"2024-09-16T07:34:51.609940+0000","last_undegraded":"2024-09-16T07:34:51.609940+0000","last_fullsized":"2024-09-16T07:34:51.609940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:37.991710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896067+0000","last_change":"2024-09-16T07:34:49.896880+0000","last_active":"2024-09-16T07:34:50.896067+0000","last_peered":"2024-09-16T07:34:50.896067+0000","last_clean":"2024-09-16T07:34:50.896067+0000","last_became_active":"2024-09-16T07:34:49.896591+0000","last_became_peered":"2024-09-16T07:34:49.896591+0000","last_unstale":"2024-09-16T07:34:50.896067+0000","last_undegraded":"2024-09-16T07:34:50.896067+0000","last_fullsized":"2024-09-16T07:34:50.896067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:38.698994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608876+0000","last_change":"2024-09-16T07:34:48.888976+0000","last_active":"2024-09-16T07:34:51.608876+0000","last_peered":"2024-09-16T07:34:51.608876+0000","last_clean":"2024-09-16T07:34:51.608876+0000","last_became_active":"2024-09-16T07:34:48.888654+0000","last_became_peered":"2024-09-16T07:34:48.888654+0000","last_unstale":"2024-09-16T07:34:51.608876+0000","last_undegraded":"2024-09-16T07:34:51.608876+0000","last_fullsized":"2024-09-16T07:34:51.608876+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:03.060258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894565+0000","last_change":"2024-09-16T07:34:49.892277+0000","last_active":"2024-09-16T07:34:50.894565+0000","last_peered":"2024-09-16T07:34:50.894565+0000","last_clean":"2024-09-16T07:34:50.894565+0000","last_became_active":"2024-09-16T07:34:49.890615+0000","last_became_peered":"2024-09-16T07:34:49.890615+0000","last_unstale":"2024-09-16T07:34:50.894565+0000","last_undegraded":"2024-09-16T07:34:50.894565+0000","last_fullsized":"2024-09-16T07:34:50.894565+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:04.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610026+0000","last_change":"2024-09-16T07:34:48.895626+0000","last_active":"2024-09-16T07:34:51.610026+0000","last_peered":"2024-09-16T07:34:51.610026+0000","last_clean":"2024-09-16T07:34:51.610026+0000","last_became_active":"2024-09-16T07:34:48.895103+0000","last_became_peered":"2024-09-16T07:34:48.895103+0000","last_unstale":"2024-09-16T07:34:51.610026+0000","last_undegraded":"2024-09-16T07:34:51.610026+0000","last_fullsized":"2024-09-16T07:34:51.610026+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:02.603524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610046+0000","last_change":"2024-09-16T07:34:49.903192+0000","last_active":"2024-09-16T07:34:51.610046+0000","last_peered":"2024-09-16T07:34:51.610046+0000","last_clean":"2024-09-16T07:34:51.610046+0000","last_became_active":"2024-09-16T07:34:49.902924+0000","last_became_peered":"2024-09-16T07:34:49.902924+0000","last_unstale":"2024-09-16T07:34:51.610046+0000","last_undegraded":"2024-09-16T07:34:51.610046+0000","last_fullsized":"2024-09-16T07:34:51.610046+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:18.385151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605414+0000","last_change":"2024-09-16T07:34:48.893076+0000","last_active":"2024-09-16T07:34:51.605414+0000","last_peered":"2024-09-16T07:34:51.605414+0000","last_clean":"2024-09-16T07:34:51.605414+0000","last_became_active":"2024-09-16T07:34:48.892793+0000","last_became_peered":"2024-09-16T07:34:48.892793+0000","last_unstale":"2024-09-16T07:34:51.605414+0000","last_undegraded":"2024-09-16T07:34:51.605414+0000","last_fullsized":"2024-09-16T07:34:51.605414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:20.280007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893458+0000","last_change":"2024-09-16T07:34:49.892673+0000","last_active":"2024-09-16T07:34:50.893458+0000","last_peered":"2024-09-16T07:34:50.893458+0000","last_clean":"2024-09-16T07:34:50.893458+0000","last_became_active":"2024-09-16T07:34:49.892334+0000","last_became_peered":"2024-09-16T07:34:49.892334+0000","last_unstale":"2024-09-16T07:34:50.893458+0000","last_undegraded":"2024-09-16T07:34:50.893458+0000","last_fullsized":"2024-09-16T07:34:50.893458+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:15.326013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605263+0000","last_change":"2024-09-16T07:34:48.885044+0000","last_active":"2024-09-16T07:34:51.605263+0000","last_peered":"2024-09-16T07:34:51.605263+0000","last_clean":"2024-09-16T07:34:51.605263+0000","last_became_active":"2024-09-16T07:34:48.884521+0000","last_became_peered":"2024-09-16T07:34:48.884521+0000","last_unstale":"2024-09-16T07:34:51.605263+0000","last_undegraded":"2024-09-16T07:34:51.605263+0000","last_fullsized":"2024-09-16T07:34:51.605263+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:56.945747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609615+0000","last_change":"2024-09-16T07:34:49.905800+0000","last_active":"2024-09-16T07:34:51.609615+0000","last_peered":"2024-09-16T07:34:51.609615+0000","last_clean":"2024-09-16T07:34:51.609615+0000","last_became_active":"2024-09-16T07:34:49.905528+0000","last_became_peered":"2024-09-16T07:34:49.905528+0000","last_unstale":"2024-09-16T07:34:51.609615+0000","last_undegraded":"2024-09-16T07:34:51.609615+0000","last_fullsized":"2024-09-16T07:34:51.609615+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:54.929870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.275990+0000","last_change":"2024-09-16T07:34:48.884292+0000","last_active":"2024-09-16T07:34:51.275990+0000","last_peered":"2024-09-16T07:34:51.275990+0000","last_clean":"2024-09-16T07:34:51.275990+0000","last_became_active":"2024-09-16T07:34:48.883899+0000","last_became_peered":"2024-09-16T07:34:48.883899+0000","last_unstale":"2024-09-16T07:34:51.275990+0000","last_undegraded":"2024-09-16T07:34:51.275990+0000","last_fullsized":"2024-09-16T07:34:51.275990+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:30.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894781+0000","last_change":"2024-09-16T07:34:49.890004+0000","last_active":"2024-09-16T07:34:50.894781+0000","last_peered":"2024-09-16T07:34:50.894781+0000","last_clean":"2024-09-16T07:34:50.894781+0000","last_became_active":"2024-09-16T07:34:49.888807+0000","last_became_peered":"2024-09-16T07:34:49.888807+0000","last_unstale":"2024-09-16T07:34:50.894781+0000","last_undegraded":"2024-09-16T07:34:50.894781+0000","last_fullsized":"2024-09-16T07:34:50.894781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:12.066724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606188+0000","last_change":"2024-09-16T07:34:48.889789+0000","last_active":"2024-09-16T07:34:51.606188+0000","last_peered":"2024-09-16T07:34:51.606188+0000","last_clean":"2024-09-16T07:34:51.606188+0000","last_became_active":"2024-09-16T07:34:48.889531+0000","last_became_peered":"2024-09-16T07:34:48.889531+0000","last_unstale":"2024-09-16T07:34:51.606188+0000","last_undegraded":"2024-09-16T07:34:51.606188+0000","last_fullsized":"2024-09-16T07:34:51.606188+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:28.039721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276661+0000","last_change":"2024-09-16T07:34:49.893227+0000","last_active":"2024-09-16T07:34:51.276661+0000","last_peered":"2024-09-16T07:34:51.276661+0000","last_clean":"2024-09-16T07:34:51.276661+0000","last_became_active":"2024-09-16T07:34:49.892861+0000","last_became_peered":"2024-09-16T07:34:49.892861+0000","last_unstale":"2024-09-16T07:34:51.276661+0000","last_undegraded":"2024-09-16T07:34:51.276661+0000","last_fullsized":"2024-09-16T07:34:51.276661+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:29.774350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896192+0000","last_change":"2024-09-16T07:34:48.890219+0000","last_active":"2024-09-16T07:34:50.896192+0000","last_peered":"2024-09-16T07:34:50.896192+0000","last_clean":"2024-09-16T07:34:50.896192+0000","last_became_active":"2024-09-16T07:34:48.889961+0000","last_became_peered":"2024-09-16T07:34:48.889961+0000","last_unstale":"2024-09-16T07:34:50.896192+0000","last_undegraded":"2024-09-16T07:34:50.896192+0000","last_fullsized":"2024-09-16T07:34:50.896192+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:11.556349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608813+0000","last_change":"2024-09-16T07:34:49.904252+0000","last_active":"2024-09-16T07:34:51.608813+0000","last_peered":"2024-09-16T07:34:51.608813+0000","last_clean":"2024-09-16T07:34:51.608813+0000","last_became_active":"2024-09-16T07:34:49.903985+0000","last_became_peered":"2024-09-16T07:34:49.903985+0000","last_unstale":"2024-09-16T07:34:51.608813+0000","last_undegraded":"2024-09-16T07:34:51.608813+0000","last_fullsized":"2024-09-16T07:34:51.608813+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:03.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896120+0000","last_change":"2024-09-16T07:34:48.893646+0000","last_active":"2024-09-16T07:34:50.896120+0000","last_peered":"2024-09-16T07:34:50.896120+0000","last_clean":"2024-09-16T07:34:50.896120+0000","last_became_active":"2024-09-16T07:34:48.893380+0000","last_became_peered":"2024-09-16T07:34:48.893380+0000","last_unstale":"2024-09-16T07:34:50.896120+0000","last_undegraded":"2024-09-16T07:34:50.896120+0000","last_fullsized":"2024-09-16T07:34:50.896120+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:27.812212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896061+0000","last_change":"2024-09-16T07:34:49.898030+0000","last_active":"2024-09-16T07:34:50.896061+0000","last_peered":"2024-09-16T07:34:50.896061+0000","last_clean":"2024-09-16T07:34:50.896061+0000","last_became_active":"2024-09-16T07:34:49.897638+0000","last_became_peered":"2024-09-16T07:34:49.897638+0000","last_unstale":"2024-09-16T07:34:50.896061+0000","last_undegraded":"2024-09-16T07:34:50.896061+0000","last_fullsized":"2024-09-16T07:34:50.896061+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:31.153673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895758+0000","last_change":"2024-09-16T07:34:48.892742+0000","last_active":"2024-09-16T07:34:50.895758+0000","last_peered":"2024-09-16T07:34:50.895758+0000","last_clean":"2024-09-16T07:34:50.895758+0000","last_became_active":"2024-09-16T07:34:48.892494+0000","last_became_peered":"2024-09-16T07:34:48.892494+0000","last_unstale":"2024-09-16T07:34:50.895758+0000","last_undegraded":"2024-09-16T07:34:50.895758+0000","last_fullsized":"2024-09-16T07:34:50.895758+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:22.639564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609395+0000","last_change":"2024-09-16T07:34:49.898352+0000","last_active":"2024-09-16T07:34:51.609395+0000","last_peered":"2024-09-16T07:34:51.609395+0000","last_clean":"2024-09-16T07:34:51.609395+0000","last_became_active":"2024-09-16T07:34:49.898105+0000","last_became_peered":"2024-09-16T07:34:49.898105+0000","last_unstale":"2024-09-16T07:34:51.609395+0000","last_undegraded":"2024-09-16T07:34:51.609395+0000","last_fullsized":"2024-09-16T07:34:51.609395+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:11.043276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610110+0000","last_change":"2024-09-16T07:34:48.895875+0000","last_active":"2024-09-16T07:34:51.610110+0000","last_peered":"2024-09-16T07:34:51.610110+0000","last_clean":"2024-09-16T07:34:51.610110+0000","last_became_active":"2024-09-16T07:34:48.895406+0000","last_became_peered":"2024-09-16T07:34:48.895406+0000","last_unstale":"2024-09-16T07:34:51.610110+0000","last_undegraded":"2024-09-16T07:34:51.610110+0000","last_fullsized":"2024-09-16T07:34:51.610110+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:32.435416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894352+0000","last_change":"2024-09-16T07:34:49.881553+0000","last_active":"2024-09-16T07:34:50.894352+0000","last_peered":"2024-09-16T07:34:50.894352+0000","last_clean":"2024-09-16T07:34:50.894352+0000","last_became_active":"2024-09-16T07:34:49.881067+0000","last_became_peered":"2024-09-16T07:34:49.881067+0000","last_unstale":"2024-09-16T07:34:50.894352+0000","last_undegraded":"2024-09-16T07:34:50.894352+0000","last_fullsized":"2024-09-16T07:34:50.894352+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:35.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605559+0000","last_change":"2024-09-16T07:34:48.886764+0000","last_active":"2024-09-16T07:34:51.605559+0000","last_peered":"2024-09-16T07:34:51.605559+0000","last_clean":"2024-09-16T07:34:51.605559+0000","last_became_active":"2024-09-16T07:34:48.886504+0000","last_became_peered":"2024-09-16T07:34:48.886504+0000","last_unstale":"2024-09-16T07:34:51.605559+0000","last_undegraded":"2024-09-16T07:34:51.605559+0000","last_fullsized":"2024-09-16T07:34:51.605559+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:09.547726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605849+0000","last_change":"2024-09-16T07:34:49.894015+0000","last_active":"2024-09-16T07:34:51.605849+0000","last_peered":"2024-09-16T07:34:51.605849+0000","last_clean":"2024-09-16T07:34:51.605849+0000","last_became_active":"2024-09-16T07:34:49.892784+0000","last_became_peered":"2024-09-16T07:34:49.892784+0000","last_unstale":"2024-09-16T07:34:51.605849+0000","last_undegraded":"2024-09-16T07:34:51.605849+0000","last_fullsized":"2024-09-16T07:34:51.605849+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:00:59.644215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276138+0000","last_change":"2024-09-16T07:34:48.888373+0000","last_active":"2024-09-16T07:34:51.276138+0000","last_peered":"2024-09-16T07:34:51.276138+0000","last_clean":"2024-09-16T07:34:51.276138+0000","last_became_active":"2024-09-16T07:34:48.888068+0000","last_became_peered":"2024-09-16T07:34:48.888068+0000","last_unstale":"2024-09-16T07:34:51.276138+0000","last_undegraded":"2024-09-16T07:34:51.276138+0000","last_fullsized":"2024-09-16T07:34:51.276138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:45.641736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894043+0000","last_change":"2024-09-16T07:34:49.885644+0000","last_active":"2024-09-16T07:34:50.894043+0000","last_peered":"2024-09-16T07:34:50.894043+0000","last_clean":"2024-09-16T07:34:50.894043+0000","last_became_active":"2024-09-16T07:34:49.885361+0000","last_became_peered":"2024-09-16T07:34:49.885361+0000","last_unstale":"2024-09-16T07:34:50.894043+0000","last_undegraded":"2024-09-16T07:34:50.894043+0000","last_fullsized":"2024-09-16T07:34:50.894043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:45:29.237961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608408+0000","last_change":"2024-09-16T07:34:48.889929+0000","last_active":"2024-09-16T07:34:51.608408+0000","last_peered":"2024-09-16T07:34:51.608408+0000","last_clean":"2024-09-16T07:34:51.608408+0000","last_became_active":"2024-09-16T07:34:48.889599+0000","last_became_peered":"2024-09-16T07:34:48.889599+0000","last_unstale":"2024-09-16T07:34:51.608408+0000","last_undegraded":"2024-09-16T07:34:51.608408+0000","last_fullsized":"2024-09-16T07:34:51.608408+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:56.945747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610284+0000","last_change":"2024-09-16T07:34:49.904993+0000","last_active":"2024-09-16T07:34:51.610284+0000","last_peered":"2024-09-16T07:34:51.610284+0000","last_clean":"2024-09-16T07:34:51.610284+0000","last_became_active":"2024-09-16T07:34:49.904725+0000","last_became_peered":"2024-09-16T07:34:49.904725+0000","last_unstale":"2024-09-16T07:34:51.610284+0000","last_undegraded":"2024-09-16T07:34:51.610284+0000","last_fullsized":"2024-09-16T07:34:51.610284+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:16.039142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"128'3","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276630+0000","last_change":"2024-09-16T07:34:48.884237+0000","last_active":"2024-09-16T07:34:51.276630+0000","last_peered":"2024-09-16T07:34:51.276630+0000","last_clean":"2024-09-16T07:34:51.276630+0000","last_became_active":"2024-09-16T07:34:48.883916+0000","last_became_peered":"2024-09-16T07:34:48.883916+0000","last_unstale":"2024-09-16T07:34:51.276630+0000","last_undegraded":"2024-09-16T07:34:51.276630+0000","last_fullsized":"2024-09-16T07:34:51.276630+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:11.063572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":337,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605744+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:51.605744+0000","last_peered":"2024-09-16T07:34:51.605744+0000","last_clean":"2024-09-16T07:34:51.605744+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:51.605744+0000","last_undegraded":"2024-09-16T07:34:51.605744+0000","last_fullsized":"2024-09-16T07:34:51.605744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33348,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338492,"statfs":{"total":96636764160,"available":96602615808,"internally_reserved":0,"allocated":2211840,"data_stored":1298397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":707523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1613824,"data_stored":707399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509523,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1609728,"data_stored":707377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":707467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542228,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1626112,"data_stored":709059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1613824,"data_stored":707959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33356,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338484,"statfs":{"total":96636764160,"available":96602607616,"internally_reserved":0,"allocated":2220032,"data_stored":1299391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:54.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:34:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 -- 172.21.15.114:0/221705615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33e0003a10 msgr2=0x7f33e0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 --2- 172.21.15.114:0/221705615 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33e0003a10 0x7f33e0003e30 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00c2c0 tx=0x7f33ec01cf50 comp rx=0 tx=0).stop 2024-09-16T07:34:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33fd400640 1 -- 172.21.15.114:0/221705615 reap_dead start 2024-09-16T07:34:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 -- 172.21.15.114:0/221705615 shutdown_connections 2024-09-16T07:34:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 -- 172.21.15.114:0/221705615 >> 172.21.15.114:0/221705615 conn(0x7f33f806cdf0 msgr2=0x7f33f806d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 -- 172.21.15.114:0/221705615 shutdown_connections 2024-09-16T07:34:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 -- 172.21.15.114:0/221705615 wait complete. 2024-09-16T07:34:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 Processor -- start 2024-09-16T07:34:54.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.965+0000 7f33ff400640 1 -- start start 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33e0003a10 0x7f33f80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33f81f6a80 0x7f33f81f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33f81f3910 0x7f33f80b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f33f806ecb0 con 0x7f33f81f6a80 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f33f8074180 con 0x7f33e0003a10 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f33f806ee30 con 0x7f33f81f3910 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33f81f6a80 0x7f33f81f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33f81f6a80 0x7f33f81f33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35882/0 (socket says 172.21.15.114:35882) 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 -- 172.21.15.114:0/1785962953 learned_addr learned my addr 172.21.15.114:0/1785962953 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33fd400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33f81f3910 0x7f33f80b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33fca00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33e0003a10 0x7f33f80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 -- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33f81f3910 msgr2=0x7f33f80b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33f81f3910 0x7f33f80b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 -- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33e0003a10 msgr2=0x7f33f80b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33e0003a10 0x7f33f80b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 -- 172.21.15.114:0/1785962953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f81f3d90 con 0x7f33f81f6a80 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33fd400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33f81f3910 0x7f33f80b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33fca00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33e0003a10 0x7f33f80b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f7e00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33f81f6a80 0x7f33f81f33d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f33e4011ab0 tx=0x7f33e4011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f4c00640 1 -- 172.21.15.114:0/1785962953 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e401e070 con 0x7f33f81f6a80 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f4c00640 1 -- 172.21.15.114:0/1785962953 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33e400fc10 con 0x7f33f81f6a80 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f81f4070 con 0x7f33f81f6a80 2024-09-16T07:34:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f4c00640 1 -- 172.21.15.114:0/1785962953 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4019410 con 0x7f33f81f6a80 2024-09-16T07:34:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f81f4350 con 0x7f33f81f6a80 2024-09-16T07:34:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f80733b0 con 0x7f33f81f6a80 2024-09-16T07:34:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.969+0000 7f33f4c00640 1 -- 172.21.15.114:0/1785962953 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f33e4021070 con 0x7f33f81f6a80 2024-09-16T07:34:54.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.973+0000 7f33f4c00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f33d80734f0 0x7f33d80759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:54.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.973+0000 7f33f4c00640 1 -- 172.21.15.114:0/1785962953 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f33e4095210 con 0x7f33f81f6a80 2024-09-16T07:34:54.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.973+0000 7f33fca00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f33d80734f0 0x7f33d80759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:54.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.973+0000 7f33fca00640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f33d80734f0 0x7f33d80759b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ab000 tx=0x7f33ec019d90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:54.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:54.977+0000 7f33f4c00640 1 -- 172.21.15.114:0/1785962953 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f33e405f430 con 0x7f33f81f6a80 2024-09-16T07:34:55.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.205+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f33f80b4170 con 0x7f33f81f6a80 2024-09-16T07:34:55.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.205+0000 7f33f4c00640 1 -- 172.21.15.114:0/1785962953 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1478 (secure 0 0 0) 0x7f33e4063e60 con 0x7f33f81f6a80 2024-09-16T07:34:55.205 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:55.205 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":419,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":269647872,"bytes_avail":772824465408,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":92,"btime":"2024-09-16T07:34:52:899280+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":7923}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-16T07:34:38.398974+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T07:34:55.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f33d80734f0 msgr2=0x7f33d80759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:55.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f33d80734f0 0x7f33d80759b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ab000 tx=0x7f33ec019d90 comp rx=0 tx=0).stop 2024-09-16T07:34:55.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33f81f6a80 msgr2=0x7f33f81f33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:55.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33f81f6a80 0x7f33f81f33d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f33e4011ab0 tx=0x7f33e4011f70 comp rx=0 tx=0).stop 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 shutdown_connections 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f33d80734f0 0x7f33d80759b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33f81f3910 0x7f33f80b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33f81f6a80 0x7f33f81f33d0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 --2- 172.21.15.114:0/1785962953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33e0003a10 0x7f33f80b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 >> 172.21.15.114:0/1785962953 conn(0x7f33f806cdf0 msgr2=0x7f33f80cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 shutdown_connections 2024-09-16T07:34:55.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.209+0000 7f33ff400640 1 -- 172.21.15.114:0/1785962953 wait complete. 2024-09-16T07:34:55.226 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:34:55.227 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:55.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 -- 172.21.15.114:0/4104760392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 msgr2=0x7f88500b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:55.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 --2- 172.21.15.114:0/4104760392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f88500b2590 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f88500cf750 tx=0x7f884801ccf0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 -- 172.21.15.114:0/4104760392 shutdown_connections 2024-09-16T07:34:55.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 --2- 172.21.15.114:0/4104760392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f88500b2590 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 --2- 172.21.15.114:0/4104760392 >> v2:172.21.15.149:3300/0 conn(0x7f88500cefb0 0x7f88500cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 --2- 172.21.15.114:0/4104760392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f885015f000 0x7f88500d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 -- 172.21.15.114:0/4104760392 >> 172.21.15.114:0/4104760392 conn(0x7f885009aa10 msgr2=0x7f885009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:55.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 -- 172.21.15.114:0/4104760392 shutdown_connections 2024-09-16T07:34:55.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 -- 172.21.15.114:0/4104760392 wait complete. 2024-09-16T07:34:55.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 Processor -- start 2024-09-16T07:34:55.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.369+0000 7f8855c00640 1 -- start start 2024-09-16T07:34:55.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f8850158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:55.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88500cefb0 0x7f8850144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:55.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f885015f000 0x7f88500ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:55.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f885015ffd0 con 0x7f88500ccaf0 2024-09-16T07:34:55.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f885015fe50 con 0x7f885015f000 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8850160150 con 0x7f88500cefb0 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f8850158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f8850158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35904/0 (socket says 172.21.15.114:35904) 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 -- 172.21.15.114:0/470110685 learned_addr learned my addr 172.21.15.114:0/470110685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855200640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f885015f000 0x7f88500ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884f400640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88500cefb0 0x7f8850144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 -- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88500cefb0 msgr2=0x7f8850144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88500cefb0 0x7f8850144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 -- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f885015f000 msgr2=0x7f88500ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f885015f000 0x7f88500ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 -- 172.21.15.114:0/470110685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8850153160 con 0x7f88500ccaf0 2024-09-16T07:34:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f884fe00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f8850158220 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f88400058d0 tx=0x7f884000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8847e00640 1 -- 172.21.15.114:0/470110685 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840017070 con 0x7f88500ccaf0 2024-09-16T07:34:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8847e00640 1 -- 172.21.15.114:0/470110685 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8840009cc0 con 0x7f88500ccaf0 2024-09-16T07:34:55.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88500c5c00 con 0x7f88500ccaf0 2024-09-16T07:34:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8847e00640 1 -- 172.21.15.114:0/470110685 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88400106c0 con 0x7f88500ccaf0 2024-09-16T07:34:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88500c64a0 con 0x7f88500ccaf0 2024-09-16T07:34:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.373+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88500cc5b0 con 0x7f88500ccaf0 2024-09-16T07:34:55.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.377+0000 7f8847e00640 1 -- 172.21.15.114:0/470110685 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f884001a070 con 0x7f88500ccaf0 2024-09-16T07:34:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.377+0000 7f8847e00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88300734f0 0x7f88300759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.377+0000 7f8847e00640 1 -- 172.21.15.114:0/470110685 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f8840094b60 con 0x7f88500ccaf0 2024-09-16T07:34:55.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.377+0000 7f884f400640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88300734f0 0x7f88300759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:55.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.377+0000 7f884f400640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88300734f0 0x7f88300759b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f88501537e0 tx=0x7f883c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:55.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.381+0000 7f8847e00640 1 -- 172.21.15.114:0/470110685 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f884005ecb0 con 0x7f88500ccaf0 2024-09-16T07:34:55.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.545+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88500ce260 con 0x7f88300734f0 2024-09-16T07:34:55.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.549+0000 7f8847e00640 1 -- 172.21.15.114:0/470110685 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f88500ce260 con 0x7f88300734f0 2024-09-16T07:34:55.550 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88300734f0 msgr2=0x7f88300759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88300734f0 0x7f88300759b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f88501537e0 tx=0x7f883c00b2e0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 msgr2=0x7f8850158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f8850158220 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f88400058d0 tx=0x7f884000dde0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 shutdown_connections 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f885015f000 0x7f88500ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88300734f0 0x7f88300759b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f88500cefb0 0x7f8850144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 --2- 172.21.15.114:0/470110685 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88500ccaf0 0x7f8850158220 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:55.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 >> 172.21.15.114:0/470110685 conn(0x7f885009aa10 msgr2=0x7f88500aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:55.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 shutdown_connections 2024-09-16T07:34:55.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:55.553+0000 7f8855c00640 1 -- 172.21.15.114:0/470110685 wait complete. 2024-09-16T07:34:55.571 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-16T07:34:54.401793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263328,"kb_used_data":13800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711392,"statfs":{"total":773094113280,"available":772824465408,"internally_reserved":0,"allocated":14131200,"data_stored":6844572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001253"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896431+0000","last_change":"2024-09-16T07:34:49.899183+0000","last_active":"2024-09-16T07:34:50.896431+0000","last_peered":"2024-09-16T07:34:50.896431+0000","last_clean":"2024-09-16T07:34:50.896431+0000","last_became_active":"2024-09-16T07:34:49.898893+0000","last_became_peered":"2024-09-16T07:34:49.898893+0000","last_unstale":"2024-09-16T07:34:50.896431+0000","last_undegraded":"2024-09-16T07:34:50.896431+0000","last_fullsized":"2024-09-16T07:34:50.896431+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:33:56.752796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608929+0000","last_change":"2024-09-16T07:34:49.900893+0000","last_active":"2024-09-16T07:34:51.608929+0000","last_peered":"2024-09-16T07:34:51.608929+0000","last_clean":"2024-09-16T07:34:51.608929+0000","last_became_active":"2024-09-16T07:34:49.900644+0000","last_became_peered":"2024-09-16T07:34:49.900644+0000","last_unstale":"2024-09-16T07:34:51.608929+0000","last_undegraded":"2024-09-16T07:34:51.608929+0000","last_fullsized":"2024-09-16T07:34:51.608929+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:33.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276630+0000","last_change":"2024-09-16T07:34:49.902252+0000","last_active":"2024-09-16T07:34:51.276630+0000","last_peered":"2024-09-16T07:34:51.276630+0000","last_clean":"2024-09-16T07:34:51.276630+0000","last_became_active":"2024-09-16T07:34:49.900140+0000","last_became_peered":"2024-09-16T07:34:49.900140+0000","last_unstale":"2024-09-16T07:34:51.276630+0000","last_undegraded":"2024-09-16T07:34:51.276630+0000","last_fullsized":"2024-09-16T07:34:51.276630+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:03.391435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894676+0000","last_change":"2024-09-16T07:34:49.890232+0000","last_active":"2024-09-16T07:34:50.894676+0000","last_peered":"2024-09-16T07:34:50.894676+0000","last_clean":"2024-09-16T07:34:50.894676+0000","last_became_active":"2024-09-16T07:34:49.889860+0000","last_became_peered":"2024-09-16T07:34:49.889860+0000","last_unstale":"2024-09-16T07:34:50.894676+0000","last_undegraded":"2024-09-16T07:34:50.894676+0000","last_fullsized":"2024-09-16T07:34:50.894676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:29.042874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894181+0000","last_change":"2024-09-16T07:34:49.899107+0000","last_active":"2024-09-16T07:34:50.894181+0000","last_peered":"2024-09-16T07:34:50.894181+0000","last_clean":"2024-09-16T07:34:50.894181+0000","last_became_active":"2024-09-16T07:34:49.898755+0000","last_became_peered":"2024-09-16T07:34:49.898755+0000","last_unstale":"2024-09-16T07:34:50.894181+0000","last_undegraded":"2024-09-16T07:34:50.894181+0000","last_fullsized":"2024-09-16T07:34:50.894181+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:55.193802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895777+0000","last_change":"2024-09-16T07:34:49.896559+0000","last_active":"2024-09-16T07:34:50.895777+0000","last_peered":"2024-09-16T07:34:50.895777+0000","last_clean":"2024-09-16T07:34:50.895777+0000","last_became_active":"2024-09-16T07:34:49.896039+0000","last_became_peered":"2024-09-16T07:34:49.896039+0000","last_unstale":"2024-09-16T07:34:50.895777+0000","last_undegraded":"2024-09-16T07:34:50.895777+0000","last_fullsized":"2024-09-16T07:34:50.895777+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:46.644889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609849+0000","last_change":"2024-09-16T07:34:49.905596+0000","last_active":"2024-09-16T07:34:51.609849+0000","last_peered":"2024-09-16T07:34:51.609849+0000","last_clean":"2024-09-16T07:34:51.609849+0000","last_became_active":"2024-09-16T07:34:49.905348+0000","last_became_peered":"2024-09-16T07:34:49.905348+0000","last_unstale":"2024-09-16T07:34:51.609849+0000","last_undegraded":"2024-09-16T07:34:51.609849+0000","last_fullsized":"2024-09-16T07:34:51.609849+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:52.411568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895652+0000","last_change":"2024-09-16T07:34:49.893481+0000","last_active":"2024-09-16T07:34:50.895652+0000","last_peered":"2024-09-16T07:34:50.895652+0000","last_clean":"2024-09-16T07:34:50.895652+0000","last_became_active":"2024-09-16T07:34:49.893173+0000","last_became_peered":"2024-09-16T07:34:49.893173+0000","last_unstale":"2024-09-16T07:34:50.895652+0000","last_undegraded":"2024-09-16T07:34:50.895652+0000","last_fullsized":"2024-09-16T07:34:50.895652+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:41.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608799+0000","last_change":"2024-09-16T07:34:49.905128+0000","last_active":"2024-09-16T07:34:51.608799+0000","last_peered":"2024-09-16T07:34:51.608799+0000","last_clean":"2024-09-16T07:34:51.608799+0000","last_became_active":"2024-09-16T07:34:49.904909+0000","last_became_peered":"2024-09-16T07:34:49.904909+0000","last_unstale":"2024-09-16T07:34:51.608799+0000","last_undegraded":"2024-09-16T07:34:51.608799+0000","last_fullsized":"2024-09-16T07:34:51.608799+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:25.593996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606040+0000","last_change":"2024-09-16T07:34:49.904121+0000","last_active":"2024-09-16T07:34:51.606040+0000","last_peered":"2024-09-16T07:34:51.606040+0000","last_clean":"2024-09-16T07:34:51.606040+0000","last_became_active":"2024-09-16T07:34:49.903902+0000","last_became_peered":"2024-09-16T07:34:49.903902+0000","last_unstale":"2024-09-16T07:34:51.606040+0000","last_undegraded":"2024-09-16T07:34:51.606040+0000","last_fullsized":"2024-09-16T07:34:51.606040+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:40.009722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895950+0000","last_change":"2024-09-16T07:34:49.893513+0000","last_active":"2024-09-16T07:34:50.895950+0000","last_peered":"2024-09-16T07:34:50.895950+0000","last_clean":"2024-09-16T07:34:50.895950+0000","last_became_active":"2024-09-16T07:34:49.893294+0000","last_became_peered":"2024-09-16T07:34:49.893294+0000","last_unstale":"2024-09-16T07:34:50.895950+0000","last_undegraded":"2024-09-16T07:34:50.895950+0000","last_fullsized":"2024-09-16T07:34:50.895950+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:56.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605660+0000","last_change":"2024-09-16T07:34:49.898104+0000","last_active":"2024-09-16T07:34:51.605660+0000","last_peered":"2024-09-16T07:34:51.605660+0000","last_clean":"2024-09-16T07:34:51.605660+0000","last_became_active":"2024-09-16T07:34:49.897111+0000","last_became_peered":"2024-09-16T07:34:49.897111+0000","last_unstale":"2024-09-16T07:34:51.605660+0000","last_undegraded":"2024-09-16T07:34:51.605660+0000","last_fullsized":"2024-09-16T07:34:51.605660+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:33.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894259+0000","last_change":"2024-09-16T07:34:49.898452+0000","last_active":"2024-09-16T07:34:50.894259+0000","last_peered":"2024-09-16T07:34:50.894259+0000","last_clean":"2024-09-16T07:34:50.894259+0000","last_became_active":"2024-09-16T07:34:49.898188+0000","last_became_peered":"2024-09-16T07:34:49.898188+0000","last_unstale":"2024-09-16T07:34:50.894259+0000","last_undegraded":"2024-09-16T07:34:50.894259+0000","last_fullsized":"2024-09-16T07:34:50.894259+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:16:41.058648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893841+0000","last_change":"2024-09-16T07:34:49.892557+0000","last_active":"2024-09-16T07:34:50.893841+0000","last_peered":"2024-09-16T07:34:50.893841+0000","last_clean":"2024-09-16T07:34:50.893841+0000","last_became_active":"2024-09-16T07:34:49.891634+0000","last_became_peered":"2024-09-16T07:34:49.891634+0000","last_unstale":"2024-09-16T07:34:50.893841+0000","last_undegraded":"2024-09-16T07:34:50.893841+0000","last_fullsized":"2024-09-16T07:34:50.893841+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:53.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605533+0000","last_change":"2024-09-16T07:34:49.893225+0000","last_active":"2024-09-16T07:34:51.605533+0000","last_peered":"2024-09-16T07:34:51.605533+0000","last_clean":"2024-09-16T07:34:51.605533+0000","last_became_active":"2024-09-16T07:34:49.892927+0000","last_became_peered":"2024-09-16T07:34:49.892927+0000","last_unstale":"2024-09-16T07:34:51.605533+0000","last_undegraded":"2024-09-16T07:34:51.605533+0000","last_fullsized":"2024-09-16T07:34:51.605533+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:03.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608865+0000","last_change":"2024-09-16T07:34:49.893120+0000","last_active":"2024-09-16T07:34:51.608865+0000","last_peered":"2024-09-16T07:34:51.608865+0000","last_clean":"2024-09-16T07:34:51.608865+0000","last_became_active":"2024-09-16T07:34:49.892811+0000","last_became_peered":"2024-09-16T07:34:49.892811+0000","last_unstale":"2024-09-16T07:34:51.608865+0000","last_undegraded":"2024-09-16T07:34:51.608865+0000","last_fullsized":"2024-09-16T07:34:51.608865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:07.380736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606359+0000","last_change":"2024-09-16T07:34:49.905443+0000","last_active":"2024-09-16T07:34:51.606359+0000","last_peered":"2024-09-16T07:34:51.606359+0000","last_clean":"2024-09-16T07:34:51.606359+0000","last_became_active":"2024-09-16T07:34:49.905192+0000","last_became_peered":"2024-09-16T07:34:49.905192+0000","last_unstale":"2024-09-16T07:34:51.606359+0000","last_undegraded":"2024-09-16T07:34:51.606359+0000","last_fullsized":"2024-09-16T07:34:51.606359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:18.385151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276642+0000","last_change":"2024-09-16T07:34:49.902936+0000","last_active":"2024-09-16T07:34:51.276642+0000","last_peered":"2024-09-16T07:34:51.276642+0000","last_clean":"2024-09-16T07:34:51.276642+0000","last_became_active":"2024-09-16T07:34:49.899974+0000","last_became_peered":"2024-09-16T07:34:49.899974+0000","last_unstale":"2024-09-16T07:34:51.276642+0000","last_undegraded":"2024-09-16T07:34:51.276642+0000","last_fullsized":"2024-09-16T07:34:51.276642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:08.628647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896212+0000","last_change":"2024-09-16T07:34:49.888985+0000","last_active":"2024-09-16T07:34:50.896212+0000","last_peered":"2024-09-16T07:34:50.896212+0000","last_clean":"2024-09-16T07:34:50.896212+0000","last_became_active":"2024-09-16T07:34:49.888293+0000","last_became_peered":"2024-09-16T07:34:49.888293+0000","last_unstale":"2024-09-16T07:34:50.896212+0000","last_undegraded":"2024-09-16T07:34:50.896212+0000","last_fullsized":"2024-09-16T07:34:50.896212+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:46.673683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609719+0000","last_change":"2024-09-16T07:34:49.904962+0000","last_active":"2024-09-16T07:34:51.609719+0000","last_peered":"2024-09-16T07:34:51.609719+0000","last_clean":"2024-09-16T07:34:51.609719+0000","last_became_active":"2024-09-16T07:34:49.904638+0000","last_became_peered":"2024-09-16T07:34:49.904638+0000","last_unstale":"2024-09-16T07:34:51.609719+0000","last_undegraded":"2024-09-16T07:34:51.609719+0000","last_fullsized":"2024-09-16T07:34:51.609719+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:42.367210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605930+0000","last_change":"2024-09-16T07:34:49.904665+0000","last_active":"2024-09-16T07:34:51.605930+0000","last_peered":"2024-09-16T07:34:51.605930+0000","last_clean":"2024-09-16T07:34:51.605930+0000","last_became_active":"2024-09-16T07:34:49.904436+0000","last_became_peered":"2024-09-16T07:34:49.904436+0000","last_unstale":"2024-09-16T07:34:51.605930+0000","last_undegraded":"2024-09-16T07:34:51.605930+0000","last_fullsized":"2024-09-16T07:34:51.605930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:21.486829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894174+0000","last_change":"2024-09-16T07:34:49.897868+0000","last_active":"2024-09-16T07:34:50.894174+0000","last_peered":"2024-09-16T07:34:50.894174+0000","last_clean":"2024-09-16T07:34:50.894174+0000","last_became_active":"2024-09-16T07:34:49.897223+0000","last_became_peered":"2024-09-16T07:34:49.897223+0000","last_unstale":"2024-09-16T07:34:50.894174+0000","last_undegraded":"2024-09-16T07:34:50.894174+0000","last_fullsized":"2024-09-16T07:34:50.894174+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:57.948900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893734+0000","last_change":"2024-09-16T07:34:49.893322+0000","last_active":"2024-09-16T07:34:50.893734+0000","last_peered":"2024-09-16T07:34:50.893734+0000","last_clean":"2024-09-16T07:34:50.893734+0000","last_became_active":"2024-09-16T07:34:49.893024+0000","last_became_peered":"2024-09-16T07:34:49.893024+0000","last_unstale":"2024-09-16T07:34:50.893734+0000","last_undegraded":"2024-09-16T07:34:50.893734+0000","last_fullsized":"2024-09-16T07:34:50.893734+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:10.977612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605653+0000","last_change":"2024-09-16T07:34:49.902914+0000","last_active":"2024-09-16T07:34:51.605653+0000","last_peered":"2024-09-16T07:34:51.605653+0000","last_clean":"2024-09-16T07:34:51.605653+0000","last_became_active":"2024-09-16T07:34:49.902537+0000","last_became_peered":"2024-09-16T07:34:49.902537+0000","last_unstale":"2024-09-16T07:34:51.605653+0000","last_undegraded":"2024-09-16T07:34:51.605653+0000","last_fullsized":"2024-09-16T07:34:51.605653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:18.808025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609847+0000","last_change":"2024-09-16T07:34:49.897597+0000","last_active":"2024-09-16T07:34:51.609847+0000","last_peered":"2024-09-16T07:34:51.609847+0000","last_clean":"2024-09-16T07:34:51.609847+0000","last_became_active":"2024-09-16T07:34:49.897339+0000","last_became_peered":"2024-09-16T07:34:49.897339+0000","last_unstale":"2024-09-16T07:34:51.609847+0000","last_undegraded":"2024-09-16T07:34:51.609847+0000","last_fullsized":"2024-09-16T07:34:51.609847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:39:20.393857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896168+0000","last_change":"2024-09-16T07:34:49.889825+0000","last_active":"2024-09-16T07:34:50.896168+0000","last_peered":"2024-09-16T07:34:50.896168+0000","last_clean":"2024-09-16T07:34:50.896168+0000","last_became_active":"2024-09-16T07:34:49.889595+0000","last_became_peered":"2024-09-16T07:34:49.889595+0000","last_unstale":"2024-09-16T07:34:50.896168+0000","last_undegraded":"2024-09-16T07:34:50.896168+0000","last_fullsized":"2024-09-16T07:34:50.896168+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:14.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610261+0000","last_change":"2024-09-16T07:34:49.899847+0000","last_active":"2024-09-16T07:34:51.610261+0000","last_peered":"2024-09-16T07:34:51.610261+0000","last_clean":"2024-09-16T07:34:51.610261+0000","last_became_active":"2024-09-16T07:34:49.899669+0000","last_became_peered":"2024-09-16T07:34:49.899669+0000","last_unstale":"2024-09-16T07:34:51.610261+0000","last_undegraded":"2024-09-16T07:34:51.610261+0000","last_fullsized":"2024-09-16T07:34:51.610261+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:21.057744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610300+0000","last_change":"2024-09-16T07:34:49.895116+0000","last_active":"2024-09-16T07:34:51.610300+0000","last_peered":"2024-09-16T07:34:51.610300+0000","last_clean":"2024-09-16T07:34:51.610300+0000","last_became_active":"2024-09-16T07:34:49.894843+0000","last_became_peered":"2024-09-16T07:34:49.894843+0000","last_unstale":"2024-09-16T07:34:51.610300+0000","last_undegraded":"2024-09-16T07:34:51.610300+0000","last_fullsized":"2024-09-16T07:34:51.610300+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:35.361017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895808+0000","last_change":"2024-09-16T07:34:49.894264+0000","last_active":"2024-09-16T07:34:50.895808+0000","last_peered":"2024-09-16T07:34:50.895808+0000","last_clean":"2024-09-16T07:34:50.895808+0000","last_became_active":"2024-09-16T07:34:49.894000+0000","last_became_peered":"2024-09-16T07:34:49.894000+0000","last_unstale":"2024-09-16T07:34:50.895808+0000","last_undegraded":"2024-09-16T07:34:50.895808+0000","last_fullsized":"2024-09-16T07:34:50.895808+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:45.059188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894447+0000","last_change":"2024-09-16T07:34:49.891915+0000","last_active":"2024-09-16T07:34:50.894447+0000","last_peered":"2024-09-16T07:34:50.894447+0000","last_clean":"2024-09-16T07:34:50.894447+0000","last_became_active":"2024-09-16T07:34:49.891124+0000","last_became_peered":"2024-09-16T07:34:49.891124+0000","last_unstale":"2024-09-16T07:34:50.894447+0000","last_undegraded":"2024-09-16T07:34:50.894447+0000","last_fullsized":"2024-09-16T07:34:50.894447+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:10.550878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608593+0000","last_change":"2024-09-16T07:34:49.899581+0000","last_active":"2024-09-16T07:34:51.608593+0000","last_peered":"2024-09-16T07:34:51.608593+0000","last_clean":"2024-09-16T07:34:51.608593+0000","last_became_active":"2024-09-16T07:34:49.899275+0000","last_became_peered":"2024-09-16T07:34:49.899275+0000","last_unstale":"2024-09-16T07:34:51.608593+0000","last_undegraded":"2024-09-16T07:34:51.608593+0000","last_fullsized":"2024-09-16T07:34:51.608593+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:51:12.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608964+0000","last_change":"2024-09-16T07:34:49.886312+0000","last_active":"2024-09-16T07:34:51.608964+0000","last_peered":"2024-09-16T07:34:51.608964+0000","last_clean":"2024-09-16T07:34:51.608964+0000","last_became_active":"2024-09-16T07:34:49.885586+0000","last_became_peered":"2024-09-16T07:34:49.885586+0000","last_unstale":"2024-09-16T07:34:51.608964+0000","last_undegraded":"2024-09-16T07:34:51.608964+0000","last_fullsized":"2024-09-16T07:34:51.608964+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:19:30.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606200+0000","last_change":"2024-09-16T07:34:49.900783+0000","last_active":"2024-09-16T07:34:51.606200+0000","last_peered":"2024-09-16T07:34:51.606200+0000","last_clean":"2024-09-16T07:34:51.606200+0000","last_became_active":"2024-09-16T07:34:49.900088+0000","last_became_peered":"2024-09-16T07:34:49.900088+0000","last_unstale":"2024-09-16T07:34:51.606200+0000","last_undegraded":"2024-09-16T07:34:51.606200+0000","last_fullsized":"2024-09-16T07:34:51.606200+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:54.929870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"128'4","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606037+0000","last_change":"2024-09-16T07:34:48.893084+0000","last_active":"2024-09-16T07:34:51.606037+0000","last_peered":"2024-09-16T07:34:51.606037+0000","last_clean":"2024-09-16T07:34:51.606037+0000","last_became_active":"2024-09-16T07:34:48.892752+0000","last_became_peered":"2024-09-16T07:34:48.892752+0000","last_unstale":"2024-09-16T07:34:51.606037+0000","last_undegraded":"2024-09-16T07:34:51.606037+0000","last_fullsized":"2024-09-16T07:34:51.606037+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:03.060258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609358+0000","last_change":"2024-09-16T07:34:49.905020+0000","last_active":"2024-09-16T07:34:51.609358+0000","last_peered":"2024-09-16T07:34:51.609358+0000","last_clean":"2024-09-16T07:34:51.609358+0000","last_became_active":"2024-09-16T07:34:49.904530+0000","last_became_peered":"2024-09-16T07:34:49.904530+0000","last_unstale":"2024-09-16T07:34:51.609358+0000","last_undegraded":"2024-09-16T07:34:51.609358+0000","last_fullsized":"2024-09-16T07:34:51.609358+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:40.585668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609152+0000","last_change":"2024-09-16T07:34:48.888909+0000","last_active":"2024-09-16T07:34:51.609152+0000","last_peered":"2024-09-16T07:34:51.609152+0000","last_clean":"2024-09-16T07:34:51.609152+0000","last_became_active":"2024-09-16T07:34:48.888597+0000","last_became_peered":"2024-09-16T07:34:48.888597+0000","last_unstale":"2024-09-16T07:34:51.609152+0000","last_undegraded":"2024-09-16T07:34:51.609152+0000","last_fullsized":"2024-09-16T07:34:51.609152+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:20.280007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895884+0000","last_change":"2024-09-16T07:34:49.898404+0000","last_active":"2024-09-16T07:34:50.895884+0000","last_peered":"2024-09-16T07:34:50.895884+0000","last_clean":"2024-09-16T07:34:50.895884+0000","last_became_active":"2024-09-16T07:34:49.898126+0000","last_became_peered":"2024-09-16T07:34:49.898126+0000","last_unstale":"2024-09-16T07:34:50.895884+0000","last_undegraded":"2024-09-16T07:34:50.895884+0000","last_fullsized":"2024-09-16T07:34:50.895884+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:58.497347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894293+0000","last_change":"2024-09-16T07:34:48.892523+0000","last_active":"2024-09-16T07:34:50.894293+0000","last_peered":"2024-09-16T07:34:50.894293+0000","last_clean":"2024-09-16T07:34:50.894293+0000","last_became_active":"2024-09-16T07:34:48.892217+0000","last_became_peered":"2024-09-16T07:34:48.892217+0000","last_unstale":"2024-09-16T07:34:50.894293+0000","last_undegraded":"2024-09-16T07:34:50.894293+0000","last_fullsized":"2024-09-16T07:34:50.894293+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:17.649185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605803+0000","last_change":"2024-09-16T07:34:49.897472+0000","last_active":"2024-09-16T07:34:51.605803+0000","last_peered":"2024-09-16T07:34:51.605803+0000","last_clean":"2024-09-16T07:34:51.605803+0000","last_became_active":"2024-09-16T07:34:49.896306+0000","last_became_peered":"2024-09-16T07:34:49.896306+0000","last_unstale":"2024-09-16T07:34:51.605803+0000","last_undegraded":"2024-09-16T07:34:51.605803+0000","last_fullsized":"2024-09-16T07:34:51.605803+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:40.585668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894734+0000","last_change":"2024-09-16T07:34:48.894534+0000","last_active":"2024-09-16T07:34:50.894734+0000","last_peered":"2024-09-16T07:34:50.894734+0000","last_clean":"2024-09-16T07:34:50.894734+0000","last_became_active":"2024-09-16T07:34:48.894219+0000","last_became_peered":"2024-09-16T07:34:48.894219+0000","last_unstale":"2024-09-16T07:34:50.894734+0000","last_undegraded":"2024-09-16T07:34:50.894734+0000","last_fullsized":"2024-09-16T07:34:50.894734+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:30.150520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608696+0000","last_change":"2024-09-16T07:34:49.900273+0000","last_active":"2024-09-16T07:34:51.608696+0000","last_peered":"2024-09-16T07:34:51.608696+0000","last_clean":"2024-09-16T07:34:51.608696+0000","last_became_active":"2024-09-16T07:34:49.900031+0000","last_became_peered":"2024-09-16T07:34:49.900031+0000","last_unstale":"2024-09-16T07:34:51.608696+0000","last_undegraded":"2024-09-16T07:34:51.608696+0000","last_fullsized":"2024-09-16T07:34:51.608696+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:46.304723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609300+0000","last_change":"2024-09-16T07:34:48.890124+0000","last_active":"2024-09-16T07:34:51.609300+0000","last_peered":"2024-09-16T07:34:51.609300+0000","last_clean":"2024-09-16T07:34:51.609300+0000","last_became_active":"2024-09-16T07:34:48.889825+0000","last_became_peered":"2024-09-16T07:34:48.889825+0000","last_unstale":"2024-09-16T07:34:51.609300+0000","last_undegraded":"2024-09-16T07:34:51.609300+0000","last_fullsized":"2024-09-16T07:34:51.609300+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:34.798167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893986+0000","last_change":"2024-09-16T07:34:49.892664+0000","last_active":"2024-09-16T07:34:50.893986+0000","last_peered":"2024-09-16T07:34:50.893986+0000","last_clean":"2024-09-16T07:34:50.893986+0000","last_became_active":"2024-09-16T07:34:49.890809+0000","last_became_peered":"2024-09-16T07:34:49.890809+0000","last_unstale":"2024-09-16T07:34:50.893986+0000","last_undegraded":"2024-09-16T07:34:50.893986+0000","last_fullsized":"2024-09-16T07:34:50.893986+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:21.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894029+0000","last_change":"2024-09-16T07:34:48.881340+0000","last_active":"2024-09-16T07:34:50.894029+0000","last_peered":"2024-09-16T07:34:50.894029+0000","last_clean":"2024-09-16T07:34:50.894029+0000","last_became_active":"2024-09-16T07:34:48.880998+0000","last_became_peered":"2024-09-16T07:34:48.880998+0000","last_unstale":"2024-09-16T07:34:50.894029+0000","last_undegraded":"2024-09-16T07:34:50.894029+0000","last_fullsized":"2024-09-16T07:34:50.894029+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:40:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608490+0000","last_change":"2024-09-16T07:34:49.900704+0000","last_active":"2024-09-16T07:34:51.608490+0000","last_peered":"2024-09-16T07:34:51.608490+0000","last_clean":"2024-09-16T07:34:51.608490+0000","last_became_active":"2024-09-16T07:34:49.899171+0000","last_became_peered":"2024-09-16T07:34:49.899171+0000","last_unstale":"2024-09-16T07:34:51.608490+0000","last_undegraded":"2024-09-16T07:34:51.608490+0000","last_fullsized":"2024-09-16T07:34:51.608490+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:48.669982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609086+0000","last_change":"2024-09-16T07:34:48.889784+0000","last_active":"2024-09-16T07:34:51.609086+0000","last_peered":"2024-09-16T07:34:51.609086+0000","last_clean":"2024-09-16T07:34:51.609086+0000","last_became_active":"2024-09-16T07:34:48.889255+0000","last_became_peered":"2024-09-16T07:34:48.889255+0000","last_unstale":"2024-09-16T07:34:51.609086+0000","last_undegraded":"2024-09-16T07:34:51.609086+0000","last_fullsized":"2024-09-16T07:34:51.609086+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:57.953541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893602+0000","last_change":"2024-09-16T07:34:49.890288+0000","last_active":"2024-09-16T07:34:50.893602+0000","last_peered":"2024-09-16T07:34:50.893602+0000","last_clean":"2024-09-16T07:34:50.893602+0000","last_became_active":"2024-09-16T07:34:49.889657+0000","last_became_peered":"2024-09-16T07:34:49.889657+0000","last_unstale":"2024-09-16T07:34:50.893602+0000","last_undegraded":"2024-09-16T07:34:50.893602+0000","last_fullsized":"2024-09-16T07:34:50.893602+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:28.815364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893378+0000","last_change":"2024-09-16T07:34:48.886612+0000","last_active":"2024-09-16T07:34:50.893378+0000","last_peered":"2024-09-16T07:34:50.893378+0000","last_clean":"2024-09-16T07:34:50.893378+0000","last_became_active":"2024-09-16T07:34:48.885615+0000","last_became_peered":"2024-09-16T07:34:48.885615+0000","last_unstale":"2024-09-16T07:34:50.893378+0000","last_undegraded":"2024-09-16T07:34:50.893378+0000","last_fullsized":"2024-09-16T07:34:50.893378+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:21.191674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894591+0000","last_change":"2024-09-16T07:34:49.887223+0000","last_active":"2024-09-16T07:34:50.894591+0000","last_peered":"2024-09-16T07:34:50.894591+0000","last_clean":"2024-09-16T07:34:50.894591+0000","last_became_active":"2024-09-16T07:34:49.886427+0000","last_became_peered":"2024-09-16T07:34:49.886427+0000","last_unstale":"2024-09-16T07:34:50.894591+0000","last_undegraded":"2024-09-16T07:34:50.894591+0000","last_fullsized":"2024-09-16T07:34:50.894591+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:47.368733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609270+0000","last_change":"2024-09-16T07:34:48.894539+0000","last_active":"2024-09-16T07:34:51.609270+0000","last_peered":"2024-09-16T07:34:51.609270+0000","last_clean":"2024-09-16T07:34:51.609270+0000","last_became_active":"2024-09-16T07:34:48.894261+0000","last_became_peered":"2024-09-16T07:34:48.894261+0000","last_unstale":"2024-09-16T07:34:51.609270+0000","last_undegraded":"2024-09-16T07:34:51.609270+0000","last_fullsized":"2024-09-16T07:34:51.609270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:28.039721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606087+0000","last_change":"2024-09-16T07:34:49.895864+0000","last_active":"2024-09-16T07:34:51.606087+0000","last_peered":"2024-09-16T07:34:51.606087+0000","last_clean":"2024-09-16T07:34:51.606087+0000","last_became_active":"2024-09-16T07:34:49.895498+0000","last_became_peered":"2024-09-16T07:34:49.895498+0000","last_unstale":"2024-09-16T07:34:51.606087+0000","last_undegraded":"2024-09-16T07:34:51.606087+0000","last_fullsized":"2024-09-16T07:34:51.606087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:17.431505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606279+0000","last_change":"2024-09-16T07:34:48.887587+0000","last_active":"2024-09-16T07:34:51.606279+0000","last_peered":"2024-09-16T07:34:51.606279+0000","last_clean":"2024-09-16T07:34:51.606279+0000","last_became_active":"2024-09-16T07:34:48.887245+0000","last_became_peered":"2024-09-16T07:34:48.887245+0000","last_unstale":"2024-09-16T07:34:51.606279+0000","last_undegraded":"2024-09-16T07:34:51.606279+0000","last_fullsized":"2024-09-16T07:34:51.606279+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:37.149662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609875+0000","last_change":"2024-09-16T07:34:49.896388+0000","last_active":"2024-09-16T07:34:51.609875+0000","last_peered":"2024-09-16T07:34:51.609875+0000","last_clean":"2024-09-16T07:34:51.609875+0000","last_became_active":"2024-09-16T07:34:49.896021+0000","last_became_peered":"2024-09-16T07:34:49.896021+0000","last_unstale":"2024-09-16T07:34:51.609875+0000","last_undegraded":"2024-09-16T07:34:51.609875+0000","last_fullsized":"2024-09-16T07:34:51.609875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:03.006749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610322+0000","last_change":"2024-09-16T07:34:48.888681+0000","last_active":"2024-09-16T07:34:51.610322+0000","last_peered":"2024-09-16T07:34:51.610322+0000","last_clean":"2024-09-16T07:34:51.610322+0000","last_became_active":"2024-09-16T07:34:48.888378+0000","last_became_peered":"2024-09-16T07:34:48.888378+0000","last_unstale":"2024-09-16T07:34:51.610322+0000","last_undegraded":"2024-09-16T07:34:51.610322+0000","last_fullsized":"2024-09-16T07:34:51.610322+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:37.758771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276334+0000","last_change":"2024-09-16T07:34:49.895542+0000","last_active":"2024-09-16T07:34:51.276334+0000","last_peered":"2024-09-16T07:34:51.276334+0000","last_clean":"2024-09-16T07:34:51.276334+0000","last_became_active":"2024-09-16T07:34:49.895125+0000","last_became_peered":"2024-09-16T07:34:49.895125+0000","last_unstale":"2024-09-16T07:34:51.276334+0000","last_undegraded":"2024-09-16T07:34:51.276334+0000","last_fullsized":"2024-09-16T07:34:51.276334+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:48.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276358+0000","last_change":"2024-09-16T07:34:48.892483+0000","last_active":"2024-09-16T07:34:51.276358+0000","last_peered":"2024-09-16T07:34:51.276358+0000","last_clean":"2024-09-16T07:34:51.276358+0000","last_became_active":"2024-09-16T07:34:48.892186+0000","last_became_peered":"2024-09-16T07:34:48.892186+0000","last_unstale":"2024-09-16T07:34:51.276358+0000","last_undegraded":"2024-09-16T07:34:51.276358+0000","last_fullsized":"2024-09-16T07:34:51.276358+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:52.424987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609067+0000","last_change":"2024-09-16T07:34:49.901728+0000","last_active":"2024-09-16T07:34:51.609067+0000","last_peered":"2024-09-16T07:34:51.609067+0000","last_clean":"2024-09-16T07:34:51.609067+0000","last_became_active":"2024-09-16T07:34:49.898973+0000","last_became_peered":"2024-09-16T07:34:49.898973+0000","last_unstale":"2024-09-16T07:34:51.609067+0000","last_undegraded":"2024-09-16T07:34:51.609067+0000","last_fullsized":"2024-09-16T07:34:51.609067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:38.761924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276269+0000","last_change":"2024-09-16T07:34:48.877638+0000","last_active":"2024-09-16T07:34:51.276269+0000","last_peered":"2024-09-16T07:34:51.276269+0000","last_clean":"2024-09-16T07:34:51.276269+0000","last_became_active":"2024-09-16T07:34:48.877313+0000","last_became_peered":"2024-09-16T07:34:48.877313+0000","last_unstale":"2024-09-16T07:34:51.276269+0000","last_undegraded":"2024-09-16T07:34:51.276269+0000","last_fullsized":"2024-09-16T07:34:51.276269+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:44.056036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893730+0000","last_change":"2024-09-16T07:34:49.890818+0000","last_active":"2024-09-16T07:34:50.893730+0000","last_peered":"2024-09-16T07:34:50.893730+0000","last_clean":"2024-09-16T07:34:50.893730+0000","last_became_active":"2024-09-16T07:34:49.890433+0000","last_became_peered":"2024-09-16T07:34:49.890433+0000","last_unstale":"2024-09-16T07:34:50.893730+0000","last_undegraded":"2024-09-16T07:34:50.893730+0000","last_fullsized":"2024-09-16T07:34:50.893730+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:27:22.656611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895494+0000","last_change":"2024-09-16T07:34:48.892873+0000","last_active":"2024-09-16T07:34:50.895494+0000","last_peered":"2024-09-16T07:34:50.895494+0000","last_clean":"2024-09-16T07:34:50.895494+0000","last_became_active":"2024-09-16T07:34:48.892618+0000","last_became_peered":"2024-09-16T07:34:48.892618+0000","last_unstale":"2024-09-16T07:34:50.895494+0000","last_undegraded":"2024-09-16T07:34:50.895494+0000","last_fullsized":"2024-09-16T07:34:50.895494+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:14:27.718923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276162+0000","last_change":"2024-09-16T07:34:49.884712+0000","last_active":"2024-09-16T07:34:51.276162+0000","last_peered":"2024-09-16T07:34:51.276162+0000","last_clean":"2024-09-16T07:34:51.276162+0000","last_became_active":"2024-09-16T07:34:49.884441+0000","last_became_peered":"2024-09-16T07:34:49.884441+0000","last_unstale":"2024-09-16T07:34:51.276162+0000","last_undegraded":"2024-09-16T07:34:51.276162+0000","last_fullsized":"2024-09-16T07:34:51.276162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:53.005442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"128'8","reported_seq":23,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608909+0000","last_change":"2024-09-16T07:34:48.890362+0000","last_active":"2024-09-16T07:34:51.608909+0000","last_peered":"2024-09-16T07:34:51.608909+0000","last_clean":"2024-09-16T07:34:51.608909+0000","last_became_active":"2024-09-16T07:34:48.890100+0000","last_became_peered":"2024-09-16T07:34:48.890100+0000","last_unstale":"2024-09-16T07:34:51.608909+0000","last_undegraded":"2024-09-16T07:34:51.608909+0000","last_fullsized":"2024-09-16T07:34:51.608909+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:28:25.076831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606219+0000","last_change":"2024-09-16T07:34:49.900365+0000","last_active":"2024-09-16T07:34:51.606219+0000","last_peered":"2024-09-16T07:34:51.606219+0000","last_clean":"2024-09-16T07:34:51.606219+0000","last_became_active":"2024-09-16T07:34:49.895213+0000","last_became_peered":"2024-09-16T07:34:49.895213+0000","last_unstale":"2024-09-16T07:34:51.606219+0000","last_undegraded":"2024-09-16T07:34:51.606219+0000","last_fullsized":"2024-09-16T07:34:51.606219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:52.411568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894405+0000","last_change":"2024-09-16T07:34:48.875951+0000","last_active":"2024-09-16T07:34:50.894405+0000","last_peered":"2024-09-16T07:34:50.894405+0000","last_clean":"2024-09-16T07:34:50.894405+0000","last_became_active":"2024-09-16T07:34:48.875659+0000","last_became_peered":"2024-09-16T07:34:48.875659+0000","last_unstale":"2024-09-16T07:34:50.894405+0000","last_undegraded":"2024-09-16T07:34:50.894405+0000","last_fullsized":"2024-09-16T07:34:50.894405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:52.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610061+0000","last_change":"2024-09-16T07:34:49.903151+0000","last_active":"2024-09-16T07:34:51.610061+0000","last_peered":"2024-09-16T07:34:51.610061+0000","last_clean":"2024-09-16T07:34:51.610061+0000","last_became_active":"2024-09-16T07:34:49.902861+0000","last_became_peered":"2024-09-16T07:34:49.902861+0000","last_unstale":"2024-09-16T07:34:51.610061+0000","last_undegraded":"2024-09-16T07:34:51.610061+0000","last_fullsized":"2024-09-16T07:34:51.610061+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:31:35.643169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609012+0000","last_change":"2024-09-16T07:34:48.898075+0000","last_active":"2024-09-16T07:34:51.609012+0000","last_peered":"2024-09-16T07:34:51.609012+0000","last_clean":"2024-09-16T07:34:51.609012+0000","last_became_active":"2024-09-16T07:34:48.896622+0000","last_became_peered":"2024-09-16T07:34:48.896622+0000","last_unstale":"2024-09-16T07:34:51.609012+0000","last_undegraded":"2024-09-16T07:34:51.609012+0000","last_fullsized":"2024-09-16T07:34:51.609012+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:09.547726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276367+0000","last_change":"2024-09-16T07:34:49.893352+0000","last_active":"2024-09-16T07:34:51.276367+0000","last_peered":"2024-09-16T07:34:51.276367+0000","last_clean":"2024-09-16T07:34:51.276367+0000","last_became_active":"2024-09-16T07:34:49.892959+0000","last_became_peered":"2024-09-16T07:34:49.892959+0000","last_unstale":"2024-09-16T07:34:51.276367+0000","last_undegraded":"2024-09-16T07:34:51.276367+0000","last_fullsized":"2024-09-16T07:34:51.276367+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:55.212243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609940+0000","last_change":"2024-09-16T07:34:48.892908+0000","last_active":"2024-09-16T07:34:51.609940+0000","last_peered":"2024-09-16T07:34:51.609940+0000","last_clean":"2024-09-16T07:34:51.609940+0000","last_became_active":"2024-09-16T07:34:48.892574+0000","last_became_peered":"2024-09-16T07:34:48.892574+0000","last_unstale":"2024-09-16T07:34:51.609940+0000","last_undegraded":"2024-09-16T07:34:51.609940+0000","last_fullsized":"2024-09-16T07:34:51.609940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:37.991710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896067+0000","last_change":"2024-09-16T07:34:49.896880+0000","last_active":"2024-09-16T07:34:50.896067+0000","last_peered":"2024-09-16T07:34:50.896067+0000","last_clean":"2024-09-16T07:34:50.896067+0000","last_became_active":"2024-09-16T07:34:49.896591+0000","last_became_peered":"2024-09-16T07:34:49.896591+0000","last_unstale":"2024-09-16T07:34:50.896067+0000","last_undegraded":"2024-09-16T07:34:50.896067+0000","last_fullsized":"2024-09-16T07:34:50.896067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:38.698994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608876+0000","last_change":"2024-09-16T07:34:48.888976+0000","last_active":"2024-09-16T07:34:51.608876+0000","last_peered":"2024-09-16T07:34:51.608876+0000","last_clean":"2024-09-16T07:34:51.608876+0000","last_became_active":"2024-09-16T07:34:48.888654+0000","last_became_peered":"2024-09-16T07:34:48.888654+0000","last_unstale":"2024-09-16T07:34:51.608876+0000","last_undegraded":"2024-09-16T07:34:51.608876+0000","last_fullsized":"2024-09-16T07:34:51.608876+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:03.060258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894565+0000","last_change":"2024-09-16T07:34:49.892277+0000","last_active":"2024-09-16T07:34:50.894565+0000","last_peered":"2024-09-16T07:34:50.894565+0000","last_clean":"2024-09-16T07:34:50.894565+0000","last_became_active":"2024-09-16T07:34:49.890615+0000","last_became_peered":"2024-09-16T07:34:49.890615+0000","last_unstale":"2024-09-16T07:34:50.894565+0000","last_undegraded":"2024-09-16T07:34:50.894565+0000","last_fullsized":"2024-09-16T07:34:50.894565+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:04.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610026+0000","last_change":"2024-09-16T07:34:48.895626+0000","last_active":"2024-09-16T07:34:51.610026+0000","last_peered":"2024-09-16T07:34:51.610026+0000","last_clean":"2024-09-16T07:34:51.610026+0000","last_became_active":"2024-09-16T07:34:48.895103+0000","last_became_peered":"2024-09-16T07:34:48.895103+0000","last_unstale":"2024-09-16T07:34:51.610026+0000","last_undegraded":"2024-09-16T07:34:51.610026+0000","last_fullsized":"2024-09-16T07:34:51.610026+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:02.603524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610046+0000","last_change":"2024-09-16T07:34:49.903192+0000","last_active":"2024-09-16T07:34:51.610046+0000","last_peered":"2024-09-16T07:34:51.610046+0000","last_clean":"2024-09-16T07:34:51.610046+0000","last_became_active":"2024-09-16T07:34:49.902924+0000","last_became_peered":"2024-09-16T07:34:49.902924+0000","last_unstale":"2024-09-16T07:34:51.610046+0000","last_undegraded":"2024-09-16T07:34:51.610046+0000","last_fullsized":"2024-09-16T07:34:51.610046+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:18.385151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605414+0000","last_change":"2024-09-16T07:34:48.893076+0000","last_active":"2024-09-16T07:34:51.605414+0000","last_peered":"2024-09-16T07:34:51.605414+0000","last_clean":"2024-09-16T07:34:51.605414+0000","last_became_active":"2024-09-16T07:34:48.892793+0000","last_became_peered":"2024-09-16T07:34:48.892793+0000","last_unstale":"2024-09-16T07:34:51.605414+0000","last_undegraded":"2024-09-16T07:34:51.605414+0000","last_fullsized":"2024-09-16T07:34:51.605414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:20.280007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893458+0000","last_change":"2024-09-16T07:34:49.892673+0000","last_active":"2024-09-16T07:34:50.893458+0000","last_peered":"2024-09-16T07:34:50.893458+0000","last_clean":"2024-09-16T07:34:50.893458+0000","last_became_active":"2024-09-16T07:34:49.892334+0000","last_became_peered":"2024-09-16T07:34:49.892334+0000","last_unstale":"2024-09-16T07:34:50.893458+0000","last_undegraded":"2024-09-16T07:34:50.893458+0000","last_fullsized":"2024-09-16T07:34:50.893458+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:15.326013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605263+0000","last_change":"2024-09-16T07:34:48.885044+0000","last_active":"2024-09-16T07:34:51.605263+0000","last_peered":"2024-09-16T07:34:51.605263+0000","last_clean":"2024-09-16T07:34:51.605263+0000","last_became_active":"2024-09-16T07:34:48.884521+0000","last_became_peered":"2024-09-16T07:34:48.884521+0000","last_unstale":"2024-09-16T07:34:51.605263+0000","last_undegraded":"2024-09-16T07:34:51.605263+0000","last_fullsized":"2024-09-16T07:34:51.605263+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:56.945747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609615+0000","last_change":"2024-09-16T07:34:49.905800+0000","last_active":"2024-09-16T07:34:51.609615+0000","last_peered":"2024-09-16T07:34:51.609615+0000","last_clean":"2024-09-16T07:34:51.609615+0000","last_became_active":"2024-09-16T07:34:49.905528+0000","last_became_peered":"2024-09-16T07:34:49.905528+0000","last_unstale":"2024-09-16T07:34:51.609615+0000","last_undegraded":"2024-09-16T07:34:51.609615+0000","last_fullsized":"2024-09-16T07:34:51.609615+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:54.929870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.275990+0000","last_change":"2024-09-16T07:34:48.884292+0000","last_active":"2024-09-16T07:34:51.275990+0000","last_peered":"2024-09-16T07:34:51.275990+0000","last_clean":"2024-09-16T07:34:51.275990+0000","last_became_active":"2024-09-16T07:34:48.883899+0000","last_became_peered":"2024-09-16T07:34:48.883899+0000","last_unstale":"2024-09-16T07:34:51.275990+0000","last_undegraded":"2024-09-16T07:34:51.275990+0000","last_fullsized":"2024-09-16T07:34:51.275990+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:30.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894781+0000","last_change":"2024-09-16T07:34:49.890004+0000","last_active":"2024-09-16T07:34:50.894781+0000","last_peered":"2024-09-16T07:34:50.894781+0000","last_clean":"2024-09-16T07:34:50.894781+0000","last_became_active":"2024-09-16T07:34:49.888807+0000","last_became_peered":"2024-09-16T07:34:49.888807+0000","last_unstale":"2024-09-16T07:34:50.894781+0000","last_undegraded":"2024-09-16T07:34:50.894781+0000","last_fullsized":"2024-09-16T07:34:50.894781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:12.066724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606188+0000","last_change":"2024-09-16T07:34:48.889789+0000","last_active":"2024-09-16T07:34:51.606188+0000","last_peered":"2024-09-16T07:34:51.606188+0000","last_clean":"2024-09-16T07:34:51.606188+0000","last_became_active":"2024-09-16T07:34:48.889531+0000","last_became_peered":"2024-09-16T07:34:48.889531+0000","last_unstale":"2024-09-16T07:34:51.606188+0000","last_undegraded":"2024-09-16T07:34:51.606188+0000","last_fullsized":"2024-09-16T07:34:51.606188+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:28.039721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276661+0000","last_change":"2024-09-16T07:34:49.893227+0000","last_active":"2024-09-16T07:34:51.276661+0000","last_peered":"2024-09-16T07:34:51.276661+0000","last_clean":"2024-09-16T07:34:51.276661+0000","last_became_active":"2024-09-16T07:34:49.892861+0000","last_became_peered":"2024-09-16T07:34:49.892861+0000","last_unstale":"2024-09-16T07:34:51.276661+0000","last_undegraded":"2024-09-16T07:34:51.276661+0000","last_fullsized":"2024-09-16T07:34:51.276661+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:29.774350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896192+0000","last_change":"2024-09-16T07:34:48.890219+0000","last_active":"2024-09-16T07:34:50.896192+0000","last_peered":"2024-09-16T07:34:50.896192+0000","last_clean":"2024-09-16T07:34:50.896192+0000","last_became_active":"2024-09-16T07:34:48.889961+0000","last_became_peered":"2024-09-16T07:34:48.889961+0000","last_unstale":"2024-09-16T07:34:50.896192+0000","last_undegraded":"2024-09-16T07:34:50.896192+0000","last_fullsized":"2024-09-16T07:34:50.896192+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:11.556349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608813+0000","last_change":"2024-09-16T07:34:49.904252+0000","last_active":"2024-09-16T07:34:51.608813+0000","last_peered":"2024-09-16T07:34:51.608813+0000","last_clean":"2024-09-16T07:34:51.608813+0000","last_became_active":"2024-09-16T07:34:49.903985+0000","last_became_peered":"2024-09-16T07:34:49.903985+0000","last_unstale":"2024-09-16T07:34:51.608813+0000","last_undegraded":"2024-09-16T07:34:51.608813+0000","last_fullsized":"2024-09-16T07:34:51.608813+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:03.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896120+0000","last_change":"2024-09-16T07:34:48.893646+0000","last_active":"2024-09-16T07:34:50.896120+0000","last_peered":"2024-09-16T07:34:50.896120+0000","last_clean":"2024-09-16T07:34:50.896120+0000","last_became_active":"2024-09-16T07:34:48.893380+0000","last_became_peered":"2024-09-16T07:34:48.893380+0000","last_unstale":"2024-09-16T07:34:50.896120+0000","last_undegraded":"2024-09-16T07:34:50.896120+0000","last_fullsized":"2024-09-16T07:34:50.896120+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:27.812212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896061+0000","last_change":"2024-09-16T07:34:49.898030+0000","last_active":"2024-09-16T07:34:50.896061+0000","last_peered":"2024-09-16T07:34:50.896061+0000","last_clean":"2024-09-16T07:34:50.896061+0000","last_became_active":"2024-09-16T07:34:49.897638+0000","last_became_peered":"2024-09-16T07:34:49.897638+0000","last_unstale":"2024-09-16T07:34:50.896061+0000","last_undegraded":"2024-09-16T07:34:50.896061+0000","last_fullsized":"2024-09-16T07:34:50.896061+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:31.153673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895758+0000","last_change":"2024-09-16T07:34:48.892742+0000","last_active":"2024-09-16T07:34:50.895758+0000","last_peered":"2024-09-16T07:34:50.895758+0000","last_clean":"2024-09-16T07:34:50.895758+0000","last_became_active":"2024-09-16T07:34:48.892494+0000","last_became_peered":"2024-09-16T07:34:48.892494+0000","last_unstale":"2024-09-16T07:34:50.895758+0000","last_undegraded":"2024-09-16T07:34:50.895758+0000","last_fullsized":"2024-09-16T07:34:50.895758+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:22.639564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609395+0000","last_change":"2024-09-16T07:34:49.898352+0000","last_active":"2024-09-16T07:34:51.609395+0000","last_peered":"2024-09-16T07:34:51.609395+0000","last_clean":"2024-09-16T07:34:51.609395+0000","last_became_active":"2024-09-16T07:34:49.898105+0000","last_became_peered":"2024-09-16T07:34:49.898105+0000","last_unstale":"2024-09-16T07:34:51.609395+0000","last_undegraded":"2024-09-16T07:34:51.609395+0000","last_fullsized":"2024-09-16T07:34:51.609395+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:11.043276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610110+0000","last_change":"2024-09-16T07:34:48.895875+0000","last_active":"2024-09-16T07:34:51.610110+0000","last_peered":"2024-09-16T07:34:51.610110+0000","last_clean":"2024-09-16T07:34:51.610110+0000","last_became_active":"2024-09-16T07:34:48.895406+0000","last_became_peered":"2024-09-16T07:34:48.895406+0000","last_unstale":"2024-09-16T07:34:51.610110+0000","last_undegraded":"2024-09-16T07:34:51.610110+0000","last_fullsized":"2024-09-16T07:34:51.610110+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:32.435416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894352+0000","last_change":"2024-09-16T07:34:49.881553+0000","last_active":"2024-09-16T07:34:50.894352+0000","last_peered":"2024-09-16T07:34:50.894352+0000","last_clean":"2024-09-16T07:34:50.894352+0000","last_became_active":"2024-09-16T07:34:49.881067+0000","last_became_peered":"2024-09-16T07:34:49.881067+0000","last_unstale":"2024-09-16T07:34:50.894352+0000","last_undegraded":"2024-09-16T07:34:50.894352+0000","last_fullsized":"2024-09-16T07:34:50.894352+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:35.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605559+0000","last_change":"2024-09-16T07:34:48.886764+0000","last_active":"2024-09-16T07:34:51.605559+0000","last_peered":"2024-09-16T07:34:51.605559+0000","last_clean":"2024-09-16T07:34:51.605559+0000","last_became_active":"2024-09-16T07:34:48.886504+0000","last_became_peered":"2024-09-16T07:34:48.886504+0000","last_unstale":"2024-09-16T07:34:51.605559+0000","last_undegraded":"2024-09-16T07:34:51.605559+0000","last_fullsized":"2024-09-16T07:34:51.605559+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:09.547726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605849+0000","last_change":"2024-09-16T07:34:49.894015+0000","last_active":"2024-09-16T07:34:51.605849+0000","last_peered":"2024-09-16T07:34:51.605849+0000","last_clean":"2024-09-16T07:34:51.605849+0000","last_became_active":"2024-09-16T07:34:49.892784+0000","last_became_peered":"2024-09-16T07:34:49.892784+0000","last_unstale":"2024-09-16T07:34:51.605849+0000","last_undegraded":"2024-09-16T07:34:51.605849+0000","last_fullsized":"2024-09-16T07:34:51.605849+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:00:59.644215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276138+0000","last_change":"2024-09-16T07:34:48.888373+0000","last_active":"2024-09-16T07:34:51.276138+0000","last_peered":"2024-09-16T07:34:51.276138+0000","last_clean":"2024-09-16T07:34:51.276138+0000","last_became_active":"2024-09-16T07:34:48.888068+0000","last_became_peered":"2024-09-16T07:34:48.888068+0000","last_unstale":"2024-09-16T07:34:51.276138+0000","last_undegraded":"2024-09-16T07:34:51.276138+0000","last_fullsized":"2024-09-16T07:34:51.276138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:45.641736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894043+0000","last_change":"2024-09-16T07:34:49.885644+0000","last_active":"2024-09-16T07:34:50.894043+0000","last_peered":"2024-09-16T07:34:50.894043+0000","last_clean":"2024-09-16T07:34:50.894043+0000","last_became_active":"2024-09-16T07:34:49.885361+0000","last_became_peered":"2024-09-16T07:34:49.885361+0000","last_unstale":"2024-09-16T07:34:50.894043+0000","last_undegraded":"2024-09-16T07:34:50.894043+0000","last_fullsized":"2024-09-16T07:34:50.894043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:45:29.237961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608408+0000","last_change":"2024-09-16T07:34:48.889929+0000","last_active":"2024-09-16T07:34:51.608408+0000","last_peered":"2024-09-16T07:34:51.608408+0000","last_clean":"2024-09-16T07:34:51.608408+0000","last_became_active":"2024-09-16T07:34:48.889599+0000","last_became_peered":"2024-09-16T07:34:48.889599+0000","last_unstale":"2024-09-16T07:34:51.608408+0000","last_undegraded":"2024-09-16T07:34:51.608408+0000","last_fullsized":"2024-09-16T07:34:51.608408+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:56.945747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610284+0000","last_change":"2024-09-16T07:34:49.904993+0000","last_active":"2024-09-16T07:34:51.610284+0000","last_peered":"2024-09-16T07:34:51.610284+0000","last_clean":"2024-09-16T07:34:51.610284+0000","last_became_active":"2024-09-16T07:34:49.904725+0000","last_became_peered":"2024-09-16T07:34:49.904725+0000","last_unstale":"2024-09-16T07:34:51.610284+0000","last_undegraded":"2024-09-16T07:34:51.610284+0000","last_fullsized":"2024-09-16T07:34:51.610284+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:16.039142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"128'3","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276630+0000","last_change":"2024-09-16T07:34:48.884237+0000","last_active":"2024-09-16T07:34:51.276630+0000","last_peered":"2024-09-16T07:34:51.276630+0000","last_clean":"2024-09-16T07:34:51.276630+0000","last_became_active":"2024-09-16T07:34:48.883916+0000","last_became_peered":"2024-09-16T07:34:48.883916+0000","last_unstale":"2024-09-16T07:34:51.276630+0000","last_undegraded":"2024-09-16T07:34:51.276630+0000","last_fullsized":"2024-09-16T07:34:51.276630+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:11.063572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":337,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605744+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:51.605744+0000","last_peered":"2024-09-16T07:34:51.605744+0000","last_clean":"2024-09-16T07:34:51.605744+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:51.605744+0000","last_undegraded":"2024-09-16T07:34:51.605744+0000","last_fullsized":"2024-09-16T07:34:51.605744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33348,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338492,"statfs":{"total":96636764160,"available":96602615808,"internally_reserved":0,"allocated":2211840,"data_stored":1298397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":707523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1613824,"data_stored":707399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509523,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1609728,"data_stored":707377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":707467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542228,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1626112,"data_stored":709059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509525,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1613824,"data_stored":707959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33356,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338484,"statfs":{"total":96636764160,"available":96602607616,"internally_reserved":0,"allocated":2220032,"data_stored":1299391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:58.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:34:58.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- 172.21.15.114:0/2655713990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 msgr2=0x7f209c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 --2- 172.21.15.114:0/2655713990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 0x7f209c004c90 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f20a000e520 tx=0x7f20a001ef30 comp rx=0 tx=0).stop 2024-09-16T07:34:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9e00640 1 -- 172.21.15.114:0/2655713990 reap_dead start 2024-09-16T07:34:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- 172.21.15.114:0/2655713990 shutdown_connections 2024-09-16T07:34:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- 172.21.15.114:0/2655713990 >> 172.21.15.114:0/2655713990 conn(0x7f20b40b18f0 msgr2=0x7f20b40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- 172.21.15.114:0/2655713990 shutdown_connections 2024-09-16T07:34:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- 172.21.15.114:0/2655713990 wait complete. 2024-09-16T07:34:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 Processor -- start 2024-09-16T07:34:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- start start 2024-09-16T07:34:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 0x7f20b41f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4151270 0x7f20b40afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40aeef0 0x7f20b4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f20b40cf050 con 0x7f209c004810 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20b40ceed0 con 0x7f20b40aeef0 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20bbe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f20b40cf1d0 con 0x7f20b4151270 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 0x7f20b41f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 0x7f20b41f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35932/0 (socket says 172.21.15.114:35932) 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 -- 172.21.15.114:0/3828039924 learned_addr learned my addr 172.21.15.114:0/3828039924 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b8a00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4151270 0x7f20b40afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9e00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40aeef0 0x7f20b4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 -- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4151270 msgr2=0x7f20b40afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4151270 0x7f20b40afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 -- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40aeef0 msgr2=0x7f20b4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40aeef0 0x7f20b4154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:58.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.733+0000 7f20b9400640 1 -- 172.21.15.114:0/3828039924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b41f8570 con 0x7f209c004810 2024-09-16T07:34:58.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b9400640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 0x7f20b41f7f20 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f20a8004660 tx=0x7f20a8003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b1600640 1 -- 172.21.15.114:0/3828039924 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a800ee40 con 0x7f209c004810 2024-09-16T07:34:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b1600640 1 -- 172.21.15.114:0/3828039924 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20a801c070 con 0x7f209c004810 2024-09-16T07:34:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b41f8850 con 0x7f209c004810 2024-09-16T07:34:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b1600640 1 -- 172.21.15.114:0/3828039924 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8017680 con 0x7f209c004810 2024-09-16T07:34:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b41f8e10 con 0x7f209c004810 2024-09-16T07:34:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b4069410 con 0x7f209c004810 2024-09-16T07:34:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b1600640 1 -- 172.21.15.114:0/3828039924 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f20a8017820 con 0x7f209c004810 2024-09-16T07:34:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b1600640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20940734f0 0x7f20940759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b1600640 1 -- 172.21.15.114:0/3828039924 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f20a8095cf0 con 0x7f209c004810 2024-09-16T07:34:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.737+0000 7f20b8a00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20940734f0 0x7f20940759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.741+0000 7f20b8a00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20940734f0 0x7f20940759b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f20a00ae000 tx=0x7f20a001bd70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.741+0000 7f20b1600640 1 -- 172.21.15.114:0/3828039924 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f20a8060520 con 0x7f209c004810 2024-09-16T07:34:58.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.905+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20b4073a80 con 0x7f20940734f0 2024-09-16T07:34:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20b1600640 1 -- 172.21.15.114:0/3828039924 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252434 (secure 0 0 0) 0x7f20b4073a80 con 0x7f20940734f0 2024-09-16T07:34:58.913 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:58.914 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:34:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20940734f0 msgr2=0x7f20940759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20940734f0 0x7f20940759b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f20a00ae000 tx=0x7f20a001bd70 comp rx=0 tx=0).stop 2024-09-16T07:34:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 msgr2=0x7f20b41f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 0x7f20b41f7f20 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f20a8004660 tx=0x7f20a8003d90 comp rx=0 tx=0).stop 2024-09-16T07:34:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 shutdown_connections 2024-09-16T07:34:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20b40aeef0 0x7f20b4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20940734f0 0x7f20940759b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:58.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20b4151270 0x7f20b40afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:58.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 --2- 172.21.15.114:0/3828039924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f209c004810 0x7f20b41f7f20 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:58.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 >> 172.21.15.114:0/3828039924 conn(0x7f20b40b18f0 msgr2=0x7f20b4157550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:58.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 shutdown_connections 2024-09-16T07:34:58.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:58.913+0000 7f20bbe00640 1 -- 172.21.15.114:0/3828039924 wait complete. 2024-09-16T07:34:58.934 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-16T07:34:58.402837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263328,"kb_used_data":13800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711392,"statfs":{"total":773094113280,"available":772824465408,"internally_reserved":0,"allocated":14131200,"data_stored":6844572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.530155"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896431+0000","last_change":"2024-09-16T07:34:49.899183+0000","last_active":"2024-09-16T07:34:50.896431+0000","last_peered":"2024-09-16T07:34:50.896431+0000","last_clean":"2024-09-16T07:34:50.896431+0000","last_became_active":"2024-09-16T07:34:49.898893+0000","last_became_peered":"2024-09-16T07:34:49.898893+0000","last_unstale":"2024-09-16T07:34:50.896431+0000","last_undegraded":"2024-09-16T07:34:50.896431+0000","last_fullsized":"2024-09-16T07:34:50.896431+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:33:56.752796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608929+0000","last_change":"2024-09-16T07:34:49.900893+0000","last_active":"2024-09-16T07:34:51.608929+0000","last_peered":"2024-09-16T07:34:51.608929+0000","last_clean":"2024-09-16T07:34:51.608929+0000","last_became_active":"2024-09-16T07:34:49.900644+0000","last_became_peered":"2024-09-16T07:34:49.900644+0000","last_unstale":"2024-09-16T07:34:51.608929+0000","last_undegraded":"2024-09-16T07:34:51.608929+0000","last_fullsized":"2024-09-16T07:34:51.608929+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:33.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276630+0000","last_change":"2024-09-16T07:34:49.902252+0000","last_active":"2024-09-16T07:34:51.276630+0000","last_peered":"2024-09-16T07:34:51.276630+0000","last_clean":"2024-09-16T07:34:51.276630+0000","last_became_active":"2024-09-16T07:34:49.900140+0000","last_became_peered":"2024-09-16T07:34:49.900140+0000","last_unstale":"2024-09-16T07:34:51.276630+0000","last_undegraded":"2024-09-16T07:34:51.276630+0000","last_fullsized":"2024-09-16T07:34:51.276630+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:03.391435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894676+0000","last_change":"2024-09-16T07:34:49.890232+0000","last_active":"2024-09-16T07:34:50.894676+0000","last_peered":"2024-09-16T07:34:50.894676+0000","last_clean":"2024-09-16T07:34:50.894676+0000","last_became_active":"2024-09-16T07:34:49.889860+0000","last_became_peered":"2024-09-16T07:34:49.889860+0000","last_unstale":"2024-09-16T07:34:50.894676+0000","last_undegraded":"2024-09-16T07:34:50.894676+0000","last_fullsized":"2024-09-16T07:34:50.894676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:29.042874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894181+0000","last_change":"2024-09-16T07:34:49.899107+0000","last_active":"2024-09-16T07:34:50.894181+0000","last_peered":"2024-09-16T07:34:50.894181+0000","last_clean":"2024-09-16T07:34:50.894181+0000","last_became_active":"2024-09-16T07:34:49.898755+0000","last_became_peered":"2024-09-16T07:34:49.898755+0000","last_unstale":"2024-09-16T07:34:50.894181+0000","last_undegraded":"2024-09-16T07:34:50.894181+0000","last_fullsized":"2024-09-16T07:34:50.894181+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:55.193802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895777+0000","last_change":"2024-09-16T07:34:49.896559+0000","last_active":"2024-09-16T07:34:50.895777+0000","last_peered":"2024-09-16T07:34:50.895777+0000","last_clean":"2024-09-16T07:34:50.895777+0000","last_became_active":"2024-09-16T07:34:49.896039+0000","last_became_peered":"2024-09-16T07:34:49.896039+0000","last_unstale":"2024-09-16T07:34:50.895777+0000","last_undegraded":"2024-09-16T07:34:50.895777+0000","last_fullsized":"2024-09-16T07:34:50.895777+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:46.644889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609849+0000","last_change":"2024-09-16T07:34:49.905596+0000","last_active":"2024-09-16T07:34:51.609849+0000","last_peered":"2024-09-16T07:34:51.609849+0000","last_clean":"2024-09-16T07:34:51.609849+0000","last_became_active":"2024-09-16T07:34:49.905348+0000","last_became_peered":"2024-09-16T07:34:49.905348+0000","last_unstale":"2024-09-16T07:34:51.609849+0000","last_undegraded":"2024-09-16T07:34:51.609849+0000","last_fullsized":"2024-09-16T07:34:51.609849+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:52.411568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895652+0000","last_change":"2024-09-16T07:34:49.893481+0000","last_active":"2024-09-16T07:34:50.895652+0000","last_peered":"2024-09-16T07:34:50.895652+0000","last_clean":"2024-09-16T07:34:50.895652+0000","last_became_active":"2024-09-16T07:34:49.893173+0000","last_became_peered":"2024-09-16T07:34:49.893173+0000","last_unstale":"2024-09-16T07:34:50.895652+0000","last_undegraded":"2024-09-16T07:34:50.895652+0000","last_fullsized":"2024-09-16T07:34:50.895652+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:41.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608799+0000","last_change":"2024-09-16T07:34:49.905128+0000","last_active":"2024-09-16T07:34:51.608799+0000","last_peered":"2024-09-16T07:34:51.608799+0000","last_clean":"2024-09-16T07:34:51.608799+0000","last_became_active":"2024-09-16T07:34:49.904909+0000","last_became_peered":"2024-09-16T07:34:49.904909+0000","last_unstale":"2024-09-16T07:34:51.608799+0000","last_undegraded":"2024-09-16T07:34:51.608799+0000","last_fullsized":"2024-09-16T07:34:51.608799+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:25.593996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606040+0000","last_change":"2024-09-16T07:34:49.904121+0000","last_active":"2024-09-16T07:34:51.606040+0000","last_peered":"2024-09-16T07:34:51.606040+0000","last_clean":"2024-09-16T07:34:51.606040+0000","last_became_active":"2024-09-16T07:34:49.903902+0000","last_became_peered":"2024-09-16T07:34:49.903902+0000","last_unstale":"2024-09-16T07:34:51.606040+0000","last_undegraded":"2024-09-16T07:34:51.606040+0000","last_fullsized":"2024-09-16T07:34:51.606040+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:40.009722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895950+0000","last_change":"2024-09-16T07:34:49.893513+0000","last_active":"2024-09-16T07:34:50.895950+0000","last_peered":"2024-09-16T07:34:50.895950+0000","last_clean":"2024-09-16T07:34:50.895950+0000","last_became_active":"2024-09-16T07:34:49.893294+0000","last_became_peered":"2024-09-16T07:34:49.893294+0000","last_unstale":"2024-09-16T07:34:50.895950+0000","last_undegraded":"2024-09-16T07:34:50.895950+0000","last_fullsized":"2024-09-16T07:34:50.895950+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:56.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605660+0000","last_change":"2024-09-16T07:34:49.898104+0000","last_active":"2024-09-16T07:34:51.605660+0000","last_peered":"2024-09-16T07:34:51.605660+0000","last_clean":"2024-09-16T07:34:51.605660+0000","last_became_active":"2024-09-16T07:34:49.897111+0000","last_became_peered":"2024-09-16T07:34:49.897111+0000","last_unstale":"2024-09-16T07:34:51.605660+0000","last_undegraded":"2024-09-16T07:34:51.605660+0000","last_fullsized":"2024-09-16T07:34:51.605660+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:33.438569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894259+0000","last_change":"2024-09-16T07:34:49.898452+0000","last_active":"2024-09-16T07:34:50.894259+0000","last_peered":"2024-09-16T07:34:50.894259+0000","last_clean":"2024-09-16T07:34:50.894259+0000","last_became_active":"2024-09-16T07:34:49.898188+0000","last_became_peered":"2024-09-16T07:34:49.898188+0000","last_unstale":"2024-09-16T07:34:50.894259+0000","last_undegraded":"2024-09-16T07:34:50.894259+0000","last_fullsized":"2024-09-16T07:34:50.894259+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:16:41.058648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893841+0000","last_change":"2024-09-16T07:34:49.892557+0000","last_active":"2024-09-16T07:34:50.893841+0000","last_peered":"2024-09-16T07:34:50.893841+0000","last_clean":"2024-09-16T07:34:50.893841+0000","last_became_active":"2024-09-16T07:34:49.891634+0000","last_became_peered":"2024-09-16T07:34:49.891634+0000","last_unstale":"2024-09-16T07:34:50.893841+0000","last_undegraded":"2024-09-16T07:34:50.893841+0000","last_fullsized":"2024-09-16T07:34:50.893841+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:53.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605533+0000","last_change":"2024-09-16T07:34:49.893225+0000","last_active":"2024-09-16T07:34:51.605533+0000","last_peered":"2024-09-16T07:34:51.605533+0000","last_clean":"2024-09-16T07:34:51.605533+0000","last_became_active":"2024-09-16T07:34:49.892927+0000","last_became_peered":"2024-09-16T07:34:49.892927+0000","last_unstale":"2024-09-16T07:34:51.605533+0000","last_undegraded":"2024-09-16T07:34:51.605533+0000","last_fullsized":"2024-09-16T07:34:51.605533+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:03.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608865+0000","last_change":"2024-09-16T07:34:49.893120+0000","last_active":"2024-09-16T07:34:51.608865+0000","last_peered":"2024-09-16T07:34:51.608865+0000","last_clean":"2024-09-16T07:34:51.608865+0000","last_became_active":"2024-09-16T07:34:49.892811+0000","last_became_peered":"2024-09-16T07:34:49.892811+0000","last_unstale":"2024-09-16T07:34:51.608865+0000","last_undegraded":"2024-09-16T07:34:51.608865+0000","last_fullsized":"2024-09-16T07:34:51.608865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:48:07.380736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606359+0000","last_change":"2024-09-16T07:34:49.905443+0000","last_active":"2024-09-16T07:34:51.606359+0000","last_peered":"2024-09-16T07:34:51.606359+0000","last_clean":"2024-09-16T07:34:51.606359+0000","last_became_active":"2024-09-16T07:34:49.905192+0000","last_became_peered":"2024-09-16T07:34:49.905192+0000","last_unstale":"2024-09-16T07:34:51.606359+0000","last_undegraded":"2024-09-16T07:34:51.606359+0000","last_fullsized":"2024-09-16T07:34:51.606359+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:18.385151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276642+0000","last_change":"2024-09-16T07:34:49.902936+0000","last_active":"2024-09-16T07:34:51.276642+0000","last_peered":"2024-09-16T07:34:51.276642+0000","last_clean":"2024-09-16T07:34:51.276642+0000","last_became_active":"2024-09-16T07:34:49.899974+0000","last_became_peered":"2024-09-16T07:34:49.899974+0000","last_unstale":"2024-09-16T07:34:51.276642+0000","last_undegraded":"2024-09-16T07:34:51.276642+0000","last_fullsized":"2024-09-16T07:34:51.276642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:08.628647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896212+0000","last_change":"2024-09-16T07:34:49.888985+0000","last_active":"2024-09-16T07:34:50.896212+0000","last_peered":"2024-09-16T07:34:50.896212+0000","last_clean":"2024-09-16T07:34:50.896212+0000","last_became_active":"2024-09-16T07:34:49.888293+0000","last_became_peered":"2024-09-16T07:34:49.888293+0000","last_unstale":"2024-09-16T07:34:50.896212+0000","last_undegraded":"2024-09-16T07:34:50.896212+0000","last_fullsized":"2024-09-16T07:34:50.896212+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:46.673683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609719+0000","last_change":"2024-09-16T07:34:49.904962+0000","last_active":"2024-09-16T07:34:51.609719+0000","last_peered":"2024-09-16T07:34:51.609719+0000","last_clean":"2024-09-16T07:34:51.609719+0000","last_became_active":"2024-09-16T07:34:49.904638+0000","last_became_peered":"2024-09-16T07:34:49.904638+0000","last_unstale":"2024-09-16T07:34:51.609719+0000","last_undegraded":"2024-09-16T07:34:51.609719+0000","last_fullsized":"2024-09-16T07:34:51.609719+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:42.367210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605930+0000","last_change":"2024-09-16T07:34:49.904665+0000","last_active":"2024-09-16T07:34:51.605930+0000","last_peered":"2024-09-16T07:34:51.605930+0000","last_clean":"2024-09-16T07:34:51.605930+0000","last_became_active":"2024-09-16T07:34:49.904436+0000","last_became_peered":"2024-09-16T07:34:49.904436+0000","last_unstale":"2024-09-16T07:34:51.605930+0000","last_undegraded":"2024-09-16T07:34:51.605930+0000","last_fullsized":"2024-09-16T07:34:51.605930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:21.486829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894174+0000","last_change":"2024-09-16T07:34:49.897868+0000","last_active":"2024-09-16T07:34:50.894174+0000","last_peered":"2024-09-16T07:34:50.894174+0000","last_clean":"2024-09-16T07:34:50.894174+0000","last_became_active":"2024-09-16T07:34:49.897223+0000","last_became_peered":"2024-09-16T07:34:49.897223+0000","last_unstale":"2024-09-16T07:34:50.894174+0000","last_undegraded":"2024-09-16T07:34:50.894174+0000","last_fullsized":"2024-09-16T07:34:50.894174+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:57.948900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893734+0000","last_change":"2024-09-16T07:34:49.893322+0000","last_active":"2024-09-16T07:34:50.893734+0000","last_peered":"2024-09-16T07:34:50.893734+0000","last_clean":"2024-09-16T07:34:50.893734+0000","last_became_active":"2024-09-16T07:34:49.893024+0000","last_became_peered":"2024-09-16T07:34:49.893024+0000","last_unstale":"2024-09-16T07:34:50.893734+0000","last_undegraded":"2024-09-16T07:34:50.893734+0000","last_fullsized":"2024-09-16T07:34:50.893734+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:10.977612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605653+0000","last_change":"2024-09-16T07:34:49.902914+0000","last_active":"2024-09-16T07:34:51.605653+0000","last_peered":"2024-09-16T07:34:51.605653+0000","last_clean":"2024-09-16T07:34:51.605653+0000","last_became_active":"2024-09-16T07:34:49.902537+0000","last_became_peered":"2024-09-16T07:34:49.902537+0000","last_unstale":"2024-09-16T07:34:51.605653+0000","last_undegraded":"2024-09-16T07:34:51.605653+0000","last_fullsized":"2024-09-16T07:34:51.605653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:18.808025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609847+0000","last_change":"2024-09-16T07:34:49.897597+0000","last_active":"2024-09-16T07:34:51.609847+0000","last_peered":"2024-09-16T07:34:51.609847+0000","last_clean":"2024-09-16T07:34:51.609847+0000","last_became_active":"2024-09-16T07:34:49.897339+0000","last_became_peered":"2024-09-16T07:34:49.897339+0000","last_unstale":"2024-09-16T07:34:51.609847+0000","last_undegraded":"2024-09-16T07:34:51.609847+0000","last_fullsized":"2024-09-16T07:34:51.609847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:39:20.393857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896168+0000","last_change":"2024-09-16T07:34:49.889825+0000","last_active":"2024-09-16T07:34:50.896168+0000","last_peered":"2024-09-16T07:34:50.896168+0000","last_clean":"2024-09-16T07:34:50.896168+0000","last_became_active":"2024-09-16T07:34:49.889595+0000","last_became_peered":"2024-09-16T07:34:49.889595+0000","last_unstale":"2024-09-16T07:34:50.896168+0000","last_undegraded":"2024-09-16T07:34:50.896168+0000","last_fullsized":"2024-09-16T07:34:50.896168+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:14.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610261+0000","last_change":"2024-09-16T07:34:49.899847+0000","last_active":"2024-09-16T07:34:51.610261+0000","last_peered":"2024-09-16T07:34:51.610261+0000","last_clean":"2024-09-16T07:34:51.610261+0000","last_became_active":"2024-09-16T07:34:49.899669+0000","last_became_peered":"2024-09-16T07:34:49.899669+0000","last_unstale":"2024-09-16T07:34:51.610261+0000","last_undegraded":"2024-09-16T07:34:51.610261+0000","last_fullsized":"2024-09-16T07:34:51.610261+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:07:21.057744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610300+0000","last_change":"2024-09-16T07:34:49.895116+0000","last_active":"2024-09-16T07:34:51.610300+0000","last_peered":"2024-09-16T07:34:51.610300+0000","last_clean":"2024-09-16T07:34:51.610300+0000","last_became_active":"2024-09-16T07:34:49.894843+0000","last_became_peered":"2024-09-16T07:34:49.894843+0000","last_unstale":"2024-09-16T07:34:51.610300+0000","last_undegraded":"2024-09-16T07:34:51.610300+0000","last_fullsized":"2024-09-16T07:34:51.610300+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:35.361017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895808+0000","last_change":"2024-09-16T07:34:49.894264+0000","last_active":"2024-09-16T07:34:50.895808+0000","last_peered":"2024-09-16T07:34:50.895808+0000","last_clean":"2024-09-16T07:34:50.895808+0000","last_became_active":"2024-09-16T07:34:49.894000+0000","last_became_peered":"2024-09-16T07:34:49.894000+0000","last_unstale":"2024-09-16T07:34:50.895808+0000","last_undegraded":"2024-09-16T07:34:50.895808+0000","last_fullsized":"2024-09-16T07:34:50.895808+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:45.059188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894447+0000","last_change":"2024-09-16T07:34:49.891915+0000","last_active":"2024-09-16T07:34:50.894447+0000","last_peered":"2024-09-16T07:34:50.894447+0000","last_clean":"2024-09-16T07:34:50.894447+0000","last_became_active":"2024-09-16T07:34:49.891124+0000","last_became_peered":"2024-09-16T07:34:49.891124+0000","last_unstale":"2024-09-16T07:34:50.894447+0000","last_undegraded":"2024-09-16T07:34:50.894447+0000","last_fullsized":"2024-09-16T07:34:50.894447+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:10.550878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608593+0000","last_change":"2024-09-16T07:34:49.899581+0000","last_active":"2024-09-16T07:34:51.608593+0000","last_peered":"2024-09-16T07:34:51.608593+0000","last_clean":"2024-09-16T07:34:51.608593+0000","last_became_active":"2024-09-16T07:34:49.899275+0000","last_became_peered":"2024-09-16T07:34:49.899275+0000","last_unstale":"2024-09-16T07:34:51.608593+0000","last_undegraded":"2024-09-16T07:34:51.608593+0000","last_fullsized":"2024-09-16T07:34:51.608593+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:51:12.100216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608964+0000","last_change":"2024-09-16T07:34:49.886312+0000","last_active":"2024-09-16T07:34:51.608964+0000","last_peered":"2024-09-16T07:34:51.608964+0000","last_clean":"2024-09-16T07:34:51.608964+0000","last_became_active":"2024-09-16T07:34:49.885586+0000","last_became_peered":"2024-09-16T07:34:49.885586+0000","last_unstale":"2024-09-16T07:34:51.608964+0000","last_undegraded":"2024-09-16T07:34:51.608964+0000","last_fullsized":"2024-09-16T07:34:51.608964+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:19:30.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606200+0000","last_change":"2024-09-16T07:34:49.900783+0000","last_active":"2024-09-16T07:34:51.606200+0000","last_peered":"2024-09-16T07:34:51.606200+0000","last_clean":"2024-09-16T07:34:51.606200+0000","last_became_active":"2024-09-16T07:34:49.900088+0000","last_became_peered":"2024-09-16T07:34:49.900088+0000","last_unstale":"2024-09-16T07:34:51.606200+0000","last_undegraded":"2024-09-16T07:34:51.606200+0000","last_fullsized":"2024-09-16T07:34:51.606200+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:54.929870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"128'4","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606037+0000","last_change":"2024-09-16T07:34:48.893084+0000","last_active":"2024-09-16T07:34:51.606037+0000","last_peered":"2024-09-16T07:34:51.606037+0000","last_clean":"2024-09-16T07:34:51.606037+0000","last_became_active":"2024-09-16T07:34:48.892752+0000","last_became_peered":"2024-09-16T07:34:48.892752+0000","last_unstale":"2024-09-16T07:34:51.606037+0000","last_undegraded":"2024-09-16T07:34:51.606037+0000","last_fullsized":"2024-09-16T07:34:51.606037+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:03.060258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609358+0000","last_change":"2024-09-16T07:34:49.905020+0000","last_active":"2024-09-16T07:34:51.609358+0000","last_peered":"2024-09-16T07:34:51.609358+0000","last_clean":"2024-09-16T07:34:51.609358+0000","last_became_active":"2024-09-16T07:34:49.904530+0000","last_became_peered":"2024-09-16T07:34:49.904530+0000","last_unstale":"2024-09-16T07:34:51.609358+0000","last_undegraded":"2024-09-16T07:34:51.609358+0000","last_fullsized":"2024-09-16T07:34:51.609358+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:40.585668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609152+0000","last_change":"2024-09-16T07:34:48.888909+0000","last_active":"2024-09-16T07:34:51.609152+0000","last_peered":"2024-09-16T07:34:51.609152+0000","last_clean":"2024-09-16T07:34:51.609152+0000","last_became_active":"2024-09-16T07:34:48.888597+0000","last_became_peered":"2024-09-16T07:34:48.888597+0000","last_unstale":"2024-09-16T07:34:51.609152+0000","last_undegraded":"2024-09-16T07:34:51.609152+0000","last_fullsized":"2024-09-16T07:34:51.609152+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:20.280007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895884+0000","last_change":"2024-09-16T07:34:49.898404+0000","last_active":"2024-09-16T07:34:50.895884+0000","last_peered":"2024-09-16T07:34:50.895884+0000","last_clean":"2024-09-16T07:34:50.895884+0000","last_became_active":"2024-09-16T07:34:49.898126+0000","last_became_peered":"2024-09-16T07:34:49.898126+0000","last_unstale":"2024-09-16T07:34:50.895884+0000","last_undegraded":"2024-09-16T07:34:50.895884+0000","last_fullsized":"2024-09-16T07:34:50.895884+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:58.497347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894293+0000","last_change":"2024-09-16T07:34:48.892523+0000","last_active":"2024-09-16T07:34:50.894293+0000","last_peered":"2024-09-16T07:34:50.894293+0000","last_clean":"2024-09-16T07:34:50.894293+0000","last_became_active":"2024-09-16T07:34:48.892217+0000","last_became_peered":"2024-09-16T07:34:48.892217+0000","last_unstale":"2024-09-16T07:34:50.894293+0000","last_undegraded":"2024-09-16T07:34:50.894293+0000","last_fullsized":"2024-09-16T07:34:50.894293+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:17.649185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605803+0000","last_change":"2024-09-16T07:34:49.897472+0000","last_active":"2024-09-16T07:34:51.605803+0000","last_peered":"2024-09-16T07:34:51.605803+0000","last_clean":"2024-09-16T07:34:51.605803+0000","last_became_active":"2024-09-16T07:34:49.896306+0000","last_became_peered":"2024-09-16T07:34:49.896306+0000","last_unstale":"2024-09-16T07:34:51.605803+0000","last_undegraded":"2024-09-16T07:34:51.605803+0000","last_fullsized":"2024-09-16T07:34:51.605803+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:40.585668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894734+0000","last_change":"2024-09-16T07:34:48.894534+0000","last_active":"2024-09-16T07:34:50.894734+0000","last_peered":"2024-09-16T07:34:50.894734+0000","last_clean":"2024-09-16T07:34:50.894734+0000","last_became_active":"2024-09-16T07:34:48.894219+0000","last_became_peered":"2024-09-16T07:34:48.894219+0000","last_unstale":"2024-09-16T07:34:50.894734+0000","last_undegraded":"2024-09-16T07:34:50.894734+0000","last_fullsized":"2024-09-16T07:34:50.894734+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:30.150520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608696+0000","last_change":"2024-09-16T07:34:49.900273+0000","last_active":"2024-09-16T07:34:51.608696+0000","last_peered":"2024-09-16T07:34:51.608696+0000","last_clean":"2024-09-16T07:34:51.608696+0000","last_became_active":"2024-09-16T07:34:49.900031+0000","last_became_peered":"2024-09-16T07:34:49.900031+0000","last_unstale":"2024-09-16T07:34:51.608696+0000","last_undegraded":"2024-09-16T07:34:51.608696+0000","last_fullsized":"2024-09-16T07:34:51.608696+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:46.304723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609300+0000","last_change":"2024-09-16T07:34:48.890124+0000","last_active":"2024-09-16T07:34:51.609300+0000","last_peered":"2024-09-16T07:34:51.609300+0000","last_clean":"2024-09-16T07:34:51.609300+0000","last_became_active":"2024-09-16T07:34:48.889825+0000","last_became_peered":"2024-09-16T07:34:48.889825+0000","last_unstale":"2024-09-16T07:34:51.609300+0000","last_undegraded":"2024-09-16T07:34:51.609300+0000","last_fullsized":"2024-09-16T07:34:51.609300+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:34.798167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893986+0000","last_change":"2024-09-16T07:34:49.892664+0000","last_active":"2024-09-16T07:34:50.893986+0000","last_peered":"2024-09-16T07:34:50.893986+0000","last_clean":"2024-09-16T07:34:50.893986+0000","last_became_active":"2024-09-16T07:34:49.890809+0000","last_became_peered":"2024-09-16T07:34:49.890809+0000","last_unstale":"2024-09-16T07:34:50.893986+0000","last_undegraded":"2024-09-16T07:34:50.893986+0000","last_fullsized":"2024-09-16T07:34:50.893986+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:21.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894029+0000","last_change":"2024-09-16T07:34:48.881340+0000","last_active":"2024-09-16T07:34:50.894029+0000","last_peered":"2024-09-16T07:34:50.894029+0000","last_clean":"2024-09-16T07:34:50.894029+0000","last_became_active":"2024-09-16T07:34:48.880998+0000","last_became_peered":"2024-09-16T07:34:48.880998+0000","last_unstale":"2024-09-16T07:34:50.894029+0000","last_undegraded":"2024-09-16T07:34:50.894029+0000","last_fullsized":"2024-09-16T07:34:50.894029+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:40:52.804139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608490+0000","last_change":"2024-09-16T07:34:49.900704+0000","last_active":"2024-09-16T07:34:51.608490+0000","last_peered":"2024-09-16T07:34:51.608490+0000","last_clean":"2024-09-16T07:34:51.608490+0000","last_became_active":"2024-09-16T07:34:49.899171+0000","last_became_peered":"2024-09-16T07:34:49.899171+0000","last_unstale":"2024-09-16T07:34:51.608490+0000","last_undegraded":"2024-09-16T07:34:51.608490+0000","last_fullsized":"2024-09-16T07:34:51.608490+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:48.669982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609086+0000","last_change":"2024-09-16T07:34:48.889784+0000","last_active":"2024-09-16T07:34:51.609086+0000","last_peered":"2024-09-16T07:34:51.609086+0000","last_clean":"2024-09-16T07:34:51.609086+0000","last_became_active":"2024-09-16T07:34:48.889255+0000","last_became_peered":"2024-09-16T07:34:48.889255+0000","last_unstale":"2024-09-16T07:34:51.609086+0000","last_undegraded":"2024-09-16T07:34:51.609086+0000","last_fullsized":"2024-09-16T07:34:51.609086+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:57.953541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893602+0000","last_change":"2024-09-16T07:34:49.890288+0000","last_active":"2024-09-16T07:34:50.893602+0000","last_peered":"2024-09-16T07:34:50.893602+0000","last_clean":"2024-09-16T07:34:50.893602+0000","last_became_active":"2024-09-16T07:34:49.889657+0000","last_became_peered":"2024-09-16T07:34:49.889657+0000","last_unstale":"2024-09-16T07:34:50.893602+0000","last_undegraded":"2024-09-16T07:34:50.893602+0000","last_fullsized":"2024-09-16T07:34:50.893602+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:28.815364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893378+0000","last_change":"2024-09-16T07:34:48.886612+0000","last_active":"2024-09-16T07:34:50.893378+0000","last_peered":"2024-09-16T07:34:50.893378+0000","last_clean":"2024-09-16T07:34:50.893378+0000","last_became_active":"2024-09-16T07:34:48.885615+0000","last_became_peered":"2024-09-16T07:34:48.885615+0000","last_unstale":"2024-09-16T07:34:50.893378+0000","last_undegraded":"2024-09-16T07:34:50.893378+0000","last_fullsized":"2024-09-16T07:34:50.893378+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:21.191674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894591+0000","last_change":"2024-09-16T07:34:49.887223+0000","last_active":"2024-09-16T07:34:50.894591+0000","last_peered":"2024-09-16T07:34:50.894591+0000","last_clean":"2024-09-16T07:34:50.894591+0000","last_became_active":"2024-09-16T07:34:49.886427+0000","last_became_peered":"2024-09-16T07:34:49.886427+0000","last_unstale":"2024-09-16T07:34:50.894591+0000","last_undegraded":"2024-09-16T07:34:50.894591+0000","last_fullsized":"2024-09-16T07:34:50.894591+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:47.368733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609270+0000","last_change":"2024-09-16T07:34:48.894539+0000","last_active":"2024-09-16T07:34:51.609270+0000","last_peered":"2024-09-16T07:34:51.609270+0000","last_clean":"2024-09-16T07:34:51.609270+0000","last_became_active":"2024-09-16T07:34:48.894261+0000","last_became_peered":"2024-09-16T07:34:48.894261+0000","last_unstale":"2024-09-16T07:34:51.609270+0000","last_undegraded":"2024-09-16T07:34:51.609270+0000","last_fullsized":"2024-09-16T07:34:51.609270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:28.039721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606087+0000","last_change":"2024-09-16T07:34:49.895864+0000","last_active":"2024-09-16T07:34:51.606087+0000","last_peered":"2024-09-16T07:34:51.606087+0000","last_clean":"2024-09-16T07:34:51.606087+0000","last_became_active":"2024-09-16T07:34:49.895498+0000","last_became_peered":"2024-09-16T07:34:49.895498+0000","last_unstale":"2024-09-16T07:34:51.606087+0000","last_undegraded":"2024-09-16T07:34:51.606087+0000","last_fullsized":"2024-09-16T07:34:51.606087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:36:17.431505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606279+0000","last_change":"2024-09-16T07:34:48.887587+0000","last_active":"2024-09-16T07:34:51.606279+0000","last_peered":"2024-09-16T07:34:51.606279+0000","last_clean":"2024-09-16T07:34:51.606279+0000","last_became_active":"2024-09-16T07:34:48.887245+0000","last_became_peered":"2024-09-16T07:34:48.887245+0000","last_unstale":"2024-09-16T07:34:51.606279+0000","last_undegraded":"2024-09-16T07:34:51.606279+0000","last_fullsized":"2024-09-16T07:34:51.606279+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:37.149662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609875+0000","last_change":"2024-09-16T07:34:49.896388+0000","last_active":"2024-09-16T07:34:51.609875+0000","last_peered":"2024-09-16T07:34:51.609875+0000","last_clean":"2024-09-16T07:34:51.609875+0000","last_became_active":"2024-09-16T07:34:49.896021+0000","last_became_peered":"2024-09-16T07:34:49.896021+0000","last_unstale":"2024-09-16T07:34:51.609875+0000","last_undegraded":"2024-09-16T07:34:51.609875+0000","last_fullsized":"2024-09-16T07:34:51.609875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:03.006749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610322+0000","last_change":"2024-09-16T07:34:48.888681+0000","last_active":"2024-09-16T07:34:51.610322+0000","last_peered":"2024-09-16T07:34:51.610322+0000","last_clean":"2024-09-16T07:34:51.610322+0000","last_became_active":"2024-09-16T07:34:48.888378+0000","last_became_peered":"2024-09-16T07:34:48.888378+0000","last_unstale":"2024-09-16T07:34:51.610322+0000","last_undegraded":"2024-09-16T07:34:51.610322+0000","last_fullsized":"2024-09-16T07:34:51.610322+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:37.758771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276334+0000","last_change":"2024-09-16T07:34:49.895542+0000","last_active":"2024-09-16T07:34:51.276334+0000","last_peered":"2024-09-16T07:34:51.276334+0000","last_clean":"2024-09-16T07:34:51.276334+0000","last_became_active":"2024-09-16T07:34:49.895125+0000","last_became_peered":"2024-09-16T07:34:49.895125+0000","last_unstale":"2024-09-16T07:34:51.276334+0000","last_undegraded":"2024-09-16T07:34:51.276334+0000","last_fullsized":"2024-09-16T07:34:51.276334+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:48.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276358+0000","last_change":"2024-09-16T07:34:48.892483+0000","last_active":"2024-09-16T07:34:51.276358+0000","last_peered":"2024-09-16T07:34:51.276358+0000","last_clean":"2024-09-16T07:34:51.276358+0000","last_became_active":"2024-09-16T07:34:48.892186+0000","last_became_peered":"2024-09-16T07:34:48.892186+0000","last_unstale":"2024-09-16T07:34:51.276358+0000","last_undegraded":"2024-09-16T07:34:51.276358+0000","last_fullsized":"2024-09-16T07:34:51.276358+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:52.424987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609067+0000","last_change":"2024-09-16T07:34:49.901728+0000","last_active":"2024-09-16T07:34:51.609067+0000","last_peered":"2024-09-16T07:34:51.609067+0000","last_clean":"2024-09-16T07:34:51.609067+0000","last_became_active":"2024-09-16T07:34:49.898973+0000","last_became_peered":"2024-09-16T07:34:49.898973+0000","last_unstale":"2024-09-16T07:34:51.609067+0000","last_undegraded":"2024-09-16T07:34:51.609067+0000","last_fullsized":"2024-09-16T07:34:51.609067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:38.761924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276269+0000","last_change":"2024-09-16T07:34:48.877638+0000","last_active":"2024-09-16T07:34:51.276269+0000","last_peered":"2024-09-16T07:34:51.276269+0000","last_clean":"2024-09-16T07:34:51.276269+0000","last_became_active":"2024-09-16T07:34:48.877313+0000","last_became_peered":"2024-09-16T07:34:48.877313+0000","last_unstale":"2024-09-16T07:34:51.276269+0000","last_undegraded":"2024-09-16T07:34:51.276269+0000","last_fullsized":"2024-09-16T07:34:51.276269+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:44.056036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893730+0000","last_change":"2024-09-16T07:34:49.890818+0000","last_active":"2024-09-16T07:34:50.893730+0000","last_peered":"2024-09-16T07:34:50.893730+0000","last_clean":"2024-09-16T07:34:50.893730+0000","last_became_active":"2024-09-16T07:34:49.890433+0000","last_became_peered":"2024-09-16T07:34:49.890433+0000","last_unstale":"2024-09-16T07:34:50.893730+0000","last_undegraded":"2024-09-16T07:34:50.893730+0000","last_fullsized":"2024-09-16T07:34:50.893730+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:27:22.656611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895494+0000","last_change":"2024-09-16T07:34:48.892873+0000","last_active":"2024-09-16T07:34:50.895494+0000","last_peered":"2024-09-16T07:34:50.895494+0000","last_clean":"2024-09-16T07:34:50.895494+0000","last_became_active":"2024-09-16T07:34:48.892618+0000","last_became_peered":"2024-09-16T07:34:48.892618+0000","last_unstale":"2024-09-16T07:34:50.895494+0000","last_undegraded":"2024-09-16T07:34:50.895494+0000","last_fullsized":"2024-09-16T07:34:50.895494+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:14:27.718923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276162+0000","last_change":"2024-09-16T07:34:49.884712+0000","last_active":"2024-09-16T07:34:51.276162+0000","last_peered":"2024-09-16T07:34:51.276162+0000","last_clean":"2024-09-16T07:34:51.276162+0000","last_became_active":"2024-09-16T07:34:49.884441+0000","last_became_peered":"2024-09-16T07:34:49.884441+0000","last_unstale":"2024-09-16T07:34:51.276162+0000","last_undegraded":"2024-09-16T07:34:51.276162+0000","last_fullsized":"2024-09-16T07:34:51.276162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:53.005442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"128'8","reported_seq":23,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608909+0000","last_change":"2024-09-16T07:34:48.890362+0000","last_active":"2024-09-16T07:34:51.608909+0000","last_peered":"2024-09-16T07:34:51.608909+0000","last_clean":"2024-09-16T07:34:51.608909+0000","last_became_active":"2024-09-16T07:34:48.890100+0000","last_became_peered":"2024-09-16T07:34:48.890100+0000","last_unstale":"2024-09-16T07:34:51.608909+0000","last_undegraded":"2024-09-16T07:34:51.608909+0000","last_fullsized":"2024-09-16T07:34:51.608909+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:28:25.076831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606219+0000","last_change":"2024-09-16T07:34:49.900365+0000","last_active":"2024-09-16T07:34:51.606219+0000","last_peered":"2024-09-16T07:34:51.606219+0000","last_clean":"2024-09-16T07:34:51.606219+0000","last_became_active":"2024-09-16T07:34:49.895213+0000","last_became_peered":"2024-09-16T07:34:49.895213+0000","last_unstale":"2024-09-16T07:34:51.606219+0000","last_undegraded":"2024-09-16T07:34:51.606219+0000","last_fullsized":"2024-09-16T07:34:51.606219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:52.411568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894405+0000","last_change":"2024-09-16T07:34:48.875951+0000","last_active":"2024-09-16T07:34:50.894405+0000","last_peered":"2024-09-16T07:34:50.894405+0000","last_clean":"2024-09-16T07:34:50.894405+0000","last_became_active":"2024-09-16T07:34:48.875659+0000","last_became_peered":"2024-09-16T07:34:48.875659+0000","last_unstale":"2024-09-16T07:34:50.894405+0000","last_undegraded":"2024-09-16T07:34:50.894405+0000","last_fullsized":"2024-09-16T07:34:50.894405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:52.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610061+0000","last_change":"2024-09-16T07:34:49.903151+0000","last_active":"2024-09-16T07:34:51.610061+0000","last_peered":"2024-09-16T07:34:51.610061+0000","last_clean":"2024-09-16T07:34:51.610061+0000","last_became_active":"2024-09-16T07:34:49.902861+0000","last_became_peered":"2024-09-16T07:34:49.902861+0000","last_unstale":"2024-09-16T07:34:51.610061+0000","last_undegraded":"2024-09-16T07:34:51.610061+0000","last_fullsized":"2024-09-16T07:34:51.610061+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:31:35.643169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609012+0000","last_change":"2024-09-16T07:34:48.898075+0000","last_active":"2024-09-16T07:34:51.609012+0000","last_peered":"2024-09-16T07:34:51.609012+0000","last_clean":"2024-09-16T07:34:51.609012+0000","last_became_active":"2024-09-16T07:34:48.896622+0000","last_became_peered":"2024-09-16T07:34:48.896622+0000","last_unstale":"2024-09-16T07:34:51.609012+0000","last_undegraded":"2024-09-16T07:34:51.609012+0000","last_fullsized":"2024-09-16T07:34:51.609012+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:09.547726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276367+0000","last_change":"2024-09-16T07:34:49.893352+0000","last_active":"2024-09-16T07:34:51.276367+0000","last_peered":"2024-09-16T07:34:51.276367+0000","last_clean":"2024-09-16T07:34:51.276367+0000","last_became_active":"2024-09-16T07:34:49.892959+0000","last_became_peered":"2024-09-16T07:34:49.892959+0000","last_unstale":"2024-09-16T07:34:51.276367+0000","last_undegraded":"2024-09-16T07:34:51.276367+0000","last_fullsized":"2024-09-16T07:34:51.276367+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:01:55.212243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609940+0000","last_change":"2024-09-16T07:34:48.892908+0000","last_active":"2024-09-16T07:34:51.609940+0000","last_peered":"2024-09-16T07:34:51.609940+0000","last_clean":"2024-09-16T07:34:51.609940+0000","last_became_active":"2024-09-16T07:34:48.892574+0000","last_became_peered":"2024-09-16T07:34:48.892574+0000","last_unstale":"2024-09-16T07:34:51.609940+0000","last_undegraded":"2024-09-16T07:34:51.609940+0000","last_fullsized":"2024-09-16T07:34:51.609940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:37.991710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896067+0000","last_change":"2024-09-16T07:34:49.896880+0000","last_active":"2024-09-16T07:34:50.896067+0000","last_peered":"2024-09-16T07:34:50.896067+0000","last_clean":"2024-09-16T07:34:50.896067+0000","last_became_active":"2024-09-16T07:34:49.896591+0000","last_became_peered":"2024-09-16T07:34:49.896591+0000","last_unstale":"2024-09-16T07:34:50.896067+0000","last_undegraded":"2024-09-16T07:34:50.896067+0000","last_fullsized":"2024-09-16T07:34:50.896067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:38.698994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608876+0000","last_change":"2024-09-16T07:34:48.888976+0000","last_active":"2024-09-16T07:34:51.608876+0000","last_peered":"2024-09-16T07:34:51.608876+0000","last_clean":"2024-09-16T07:34:51.608876+0000","last_became_active":"2024-09-16T07:34:48.888654+0000","last_became_peered":"2024-09-16T07:34:48.888654+0000","last_unstale":"2024-09-16T07:34:51.608876+0000","last_undegraded":"2024-09-16T07:34:51.608876+0000","last_fullsized":"2024-09-16T07:34:51.608876+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:03.060258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894565+0000","last_change":"2024-09-16T07:34:49.892277+0000","last_active":"2024-09-16T07:34:50.894565+0000","last_peered":"2024-09-16T07:34:50.894565+0000","last_clean":"2024-09-16T07:34:50.894565+0000","last_became_active":"2024-09-16T07:34:49.890615+0000","last_became_peered":"2024-09-16T07:34:49.890615+0000","last_unstale":"2024-09-16T07:34:50.894565+0000","last_undegraded":"2024-09-16T07:34:50.894565+0000","last_fullsized":"2024-09-16T07:34:50.894565+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:04.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610026+0000","last_change":"2024-09-16T07:34:48.895626+0000","last_active":"2024-09-16T07:34:51.610026+0000","last_peered":"2024-09-16T07:34:51.610026+0000","last_clean":"2024-09-16T07:34:51.610026+0000","last_became_active":"2024-09-16T07:34:48.895103+0000","last_became_peered":"2024-09-16T07:34:48.895103+0000","last_unstale":"2024-09-16T07:34:51.610026+0000","last_undegraded":"2024-09-16T07:34:51.610026+0000","last_fullsized":"2024-09-16T07:34:51.610026+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:02.603524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610046+0000","last_change":"2024-09-16T07:34:49.903192+0000","last_active":"2024-09-16T07:34:51.610046+0000","last_peered":"2024-09-16T07:34:51.610046+0000","last_clean":"2024-09-16T07:34:51.610046+0000","last_became_active":"2024-09-16T07:34:49.902924+0000","last_became_peered":"2024-09-16T07:34:49.902924+0000","last_unstale":"2024-09-16T07:34:51.610046+0000","last_undegraded":"2024-09-16T07:34:51.610046+0000","last_fullsized":"2024-09-16T07:34:51.610046+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:18.385151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605414+0000","last_change":"2024-09-16T07:34:48.893076+0000","last_active":"2024-09-16T07:34:51.605414+0000","last_peered":"2024-09-16T07:34:51.605414+0000","last_clean":"2024-09-16T07:34:51.605414+0000","last_became_active":"2024-09-16T07:34:48.892793+0000","last_became_peered":"2024-09-16T07:34:48.892793+0000","last_unstale":"2024-09-16T07:34:51.605414+0000","last_undegraded":"2024-09-16T07:34:51.605414+0000","last_fullsized":"2024-09-16T07:34:51.605414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:10:20.280007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.893458+0000","last_change":"2024-09-16T07:34:49.892673+0000","last_active":"2024-09-16T07:34:50.893458+0000","last_peered":"2024-09-16T07:34:50.893458+0000","last_clean":"2024-09-16T07:34:50.893458+0000","last_became_active":"2024-09-16T07:34:49.892334+0000","last_became_peered":"2024-09-16T07:34:49.892334+0000","last_unstale":"2024-09-16T07:34:50.893458+0000","last_undegraded":"2024-09-16T07:34:50.893458+0000","last_fullsized":"2024-09-16T07:34:50.893458+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:15.326013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605263+0000","last_change":"2024-09-16T07:34:48.885044+0000","last_active":"2024-09-16T07:34:51.605263+0000","last_peered":"2024-09-16T07:34:51.605263+0000","last_clean":"2024-09-16T07:34:51.605263+0000","last_became_active":"2024-09-16T07:34:48.884521+0000","last_became_peered":"2024-09-16T07:34:48.884521+0000","last_unstale":"2024-09-16T07:34:51.605263+0000","last_undegraded":"2024-09-16T07:34:51.605263+0000","last_fullsized":"2024-09-16T07:34:51.605263+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:56.945747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609615+0000","last_change":"2024-09-16T07:34:49.905800+0000","last_active":"2024-09-16T07:34:51.609615+0000","last_peered":"2024-09-16T07:34:51.609615+0000","last_clean":"2024-09-16T07:34:51.609615+0000","last_became_active":"2024-09-16T07:34:49.905528+0000","last_became_peered":"2024-09-16T07:34:49.905528+0000","last_unstale":"2024-09-16T07:34:51.609615+0000","last_undegraded":"2024-09-16T07:34:51.609615+0000","last_fullsized":"2024-09-16T07:34:51.609615+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:54.929870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.275990+0000","last_change":"2024-09-16T07:34:48.884292+0000","last_active":"2024-09-16T07:34:51.275990+0000","last_peered":"2024-09-16T07:34:51.275990+0000","last_clean":"2024-09-16T07:34:51.275990+0000","last_became_active":"2024-09-16T07:34:48.883899+0000","last_became_peered":"2024-09-16T07:34:48.883899+0000","last_unstale":"2024-09-16T07:34:51.275990+0000","last_undegraded":"2024-09-16T07:34:51.275990+0000","last_fullsized":"2024-09-16T07:34:51.275990+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:30.819275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894781+0000","last_change":"2024-09-16T07:34:49.890004+0000","last_active":"2024-09-16T07:34:50.894781+0000","last_peered":"2024-09-16T07:34:50.894781+0000","last_clean":"2024-09-16T07:34:50.894781+0000","last_became_active":"2024-09-16T07:34:49.888807+0000","last_became_peered":"2024-09-16T07:34:49.888807+0000","last_unstale":"2024-09-16T07:34:50.894781+0000","last_undegraded":"2024-09-16T07:34:50.894781+0000","last_fullsized":"2024-09-16T07:34:50.894781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:12.066724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.606188+0000","last_change":"2024-09-16T07:34:48.889789+0000","last_active":"2024-09-16T07:34:51.606188+0000","last_peered":"2024-09-16T07:34:51.606188+0000","last_clean":"2024-09-16T07:34:51.606188+0000","last_became_active":"2024-09-16T07:34:48.889531+0000","last_became_peered":"2024-09-16T07:34:48.889531+0000","last_unstale":"2024-09-16T07:34:51.606188+0000","last_undegraded":"2024-09-16T07:34:51.606188+0000","last_fullsized":"2024-09-16T07:34:51.606188+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:53:28.039721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276661+0000","last_change":"2024-09-16T07:34:49.893227+0000","last_active":"2024-09-16T07:34:51.276661+0000","last_peered":"2024-09-16T07:34:51.276661+0000","last_clean":"2024-09-16T07:34:51.276661+0000","last_became_active":"2024-09-16T07:34:49.892861+0000","last_became_peered":"2024-09-16T07:34:49.892861+0000","last_unstale":"2024-09-16T07:34:51.276661+0000","last_undegraded":"2024-09-16T07:34:51.276661+0000","last_fullsized":"2024-09-16T07:34:51.276661+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:29.774350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896192+0000","last_change":"2024-09-16T07:34:48.890219+0000","last_active":"2024-09-16T07:34:50.896192+0000","last_peered":"2024-09-16T07:34:50.896192+0000","last_clean":"2024-09-16T07:34:50.896192+0000","last_became_active":"2024-09-16T07:34:48.889961+0000","last_became_peered":"2024-09-16T07:34:48.889961+0000","last_unstale":"2024-09-16T07:34:50.896192+0000","last_undegraded":"2024-09-16T07:34:50.896192+0000","last_fullsized":"2024-09-16T07:34:50.896192+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:11.556349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608813+0000","last_change":"2024-09-16T07:34:49.904252+0000","last_active":"2024-09-16T07:34:51.608813+0000","last_peered":"2024-09-16T07:34:51.608813+0000","last_clean":"2024-09-16T07:34:51.608813+0000","last_became_active":"2024-09-16T07:34:49.903985+0000","last_became_peered":"2024-09-16T07:34:49.903985+0000","last_unstale":"2024-09-16T07:34:51.608813+0000","last_undegraded":"2024-09-16T07:34:51.608813+0000","last_fullsized":"2024-09-16T07:34:51.608813+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:03.606677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896120+0000","last_change":"2024-09-16T07:34:48.893646+0000","last_active":"2024-09-16T07:34:50.896120+0000","last_peered":"2024-09-16T07:34:50.896120+0000","last_clean":"2024-09-16T07:34:50.896120+0000","last_became_active":"2024-09-16T07:34:48.893380+0000","last_became_peered":"2024-09-16T07:34:48.893380+0000","last_unstale":"2024-09-16T07:34:50.896120+0000","last_undegraded":"2024-09-16T07:34:50.896120+0000","last_fullsized":"2024-09-16T07:34:50.896120+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:27.812212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.896061+0000","last_change":"2024-09-16T07:34:49.898030+0000","last_active":"2024-09-16T07:34:50.896061+0000","last_peered":"2024-09-16T07:34:50.896061+0000","last_clean":"2024-09-16T07:34:50.896061+0000","last_became_active":"2024-09-16T07:34:49.897638+0000","last_became_peered":"2024-09-16T07:34:49.897638+0000","last_unstale":"2024-09-16T07:34:50.896061+0000","last_undegraded":"2024-09-16T07:34:50.896061+0000","last_fullsized":"2024-09-16T07:34:50.896061+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:47:31.153673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.895758+0000","last_change":"2024-09-16T07:34:48.892742+0000","last_active":"2024-09-16T07:34:50.895758+0000","last_peered":"2024-09-16T07:34:50.895758+0000","last_clean":"2024-09-16T07:34:50.895758+0000","last_became_active":"2024-09-16T07:34:48.892494+0000","last_became_peered":"2024-09-16T07:34:48.892494+0000","last_unstale":"2024-09-16T07:34:50.895758+0000","last_undegraded":"2024-09-16T07:34:50.895758+0000","last_fullsized":"2024-09-16T07:34:50.895758+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:22.639564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.609395+0000","last_change":"2024-09-16T07:34:49.898352+0000","last_active":"2024-09-16T07:34:51.609395+0000","last_peered":"2024-09-16T07:34:51.609395+0000","last_clean":"2024-09-16T07:34:51.609395+0000","last_became_active":"2024-09-16T07:34:49.898105+0000","last_became_peered":"2024-09-16T07:34:49.898105+0000","last_unstale":"2024-09-16T07:34:51.609395+0000","last_undegraded":"2024-09-16T07:34:51.609395+0000","last_fullsized":"2024-09-16T07:34:51.609395+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:11.043276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610110+0000","last_change":"2024-09-16T07:34:48.895875+0000","last_active":"2024-09-16T07:34:51.610110+0000","last_peered":"2024-09-16T07:34:51.610110+0000","last_clean":"2024-09-16T07:34:51.610110+0000","last_became_active":"2024-09-16T07:34:48.895406+0000","last_became_peered":"2024-09-16T07:34:48.895406+0000","last_unstale":"2024-09-16T07:34:51.610110+0000","last_undegraded":"2024-09-16T07:34:51.610110+0000","last_fullsized":"2024-09-16T07:34:51.610110+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:32.435416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894352+0000","last_change":"2024-09-16T07:34:49.881553+0000","last_active":"2024-09-16T07:34:50.894352+0000","last_peered":"2024-09-16T07:34:50.894352+0000","last_clean":"2024-09-16T07:34:50.894352+0000","last_became_active":"2024-09-16T07:34:49.881067+0000","last_became_peered":"2024-09-16T07:34:49.881067+0000","last_unstale":"2024-09-16T07:34:50.894352+0000","last_undegraded":"2024-09-16T07:34:50.894352+0000","last_fullsized":"2024-09-16T07:34:50.894352+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:35.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605559+0000","last_change":"2024-09-16T07:34:48.886764+0000","last_active":"2024-09-16T07:34:51.605559+0000","last_peered":"2024-09-16T07:34:51.605559+0000","last_clean":"2024-09-16T07:34:51.605559+0000","last_became_active":"2024-09-16T07:34:48.886504+0000","last_became_peered":"2024-09-16T07:34:48.886504+0000","last_unstale":"2024-09-16T07:34:51.605559+0000","last_undegraded":"2024-09-16T07:34:51.605559+0000","last_fullsized":"2024-09-16T07:34:51.605559+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:09.547726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605849+0000","last_change":"2024-09-16T07:34:49.894015+0000","last_active":"2024-09-16T07:34:51.605849+0000","last_peered":"2024-09-16T07:34:51.605849+0000","last_clean":"2024-09-16T07:34:51.605849+0000","last_became_active":"2024-09-16T07:34:49.892784+0000","last_became_peered":"2024-09-16T07:34:49.892784+0000","last_unstale":"2024-09-16T07:34:51.605849+0000","last_undegraded":"2024-09-16T07:34:51.605849+0000","last_fullsized":"2024-09-16T07:34:51.605849+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:00:59.644215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276138+0000","last_change":"2024-09-16T07:34:48.888373+0000","last_active":"2024-09-16T07:34:51.276138+0000","last_peered":"2024-09-16T07:34:51.276138+0000","last_clean":"2024-09-16T07:34:51.276138+0000","last_became_active":"2024-09-16T07:34:48.888068+0000","last_became_peered":"2024-09-16T07:34:48.888068+0000","last_unstale":"2024-09-16T07:34:51.276138+0000","last_undegraded":"2024-09-16T07:34:51.276138+0000","last_fullsized":"2024-09-16T07:34:51.276138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:45.641736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:50.894043+0000","last_change":"2024-09-16T07:34:49.885644+0000","last_active":"2024-09-16T07:34:50.894043+0000","last_peered":"2024-09-16T07:34:50.894043+0000","last_clean":"2024-09-16T07:34:50.894043+0000","last_became_active":"2024-09-16T07:34:49.885361+0000","last_became_peered":"2024-09-16T07:34:49.885361+0000","last_unstale":"2024-09-16T07:34:50.894043+0000","last_undegraded":"2024-09-16T07:34:50.894043+0000","last_fullsized":"2024-09-16T07:34:50.894043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:45:29.237961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.608408+0000","last_change":"2024-09-16T07:34:48.889929+0000","last_active":"2024-09-16T07:34:51.608408+0000","last_peered":"2024-09-16T07:34:51.608408+0000","last_clean":"2024-09-16T07:34:51.608408+0000","last_became_active":"2024-09-16T07:34:48.889599+0000","last_became_peered":"2024-09-16T07:34:48.889599+0000","last_unstale":"2024-09-16T07:34:51.608408+0000","last_undegraded":"2024-09-16T07:34:51.608408+0000","last_fullsized":"2024-09-16T07:34:51.608408+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:01:56.945747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.610284+0000","last_change":"2024-09-16T07:34:49.904993+0000","last_active":"2024-09-16T07:34:51.610284+0000","last_peered":"2024-09-16T07:34:51.610284+0000","last_clean":"2024-09-16T07:34:51.610284+0000","last_became_active":"2024-09-16T07:34:49.904725+0000","last_became_peered":"2024-09-16T07:34:49.904725+0000","last_unstale":"2024-09-16T07:34:51.610284+0000","last_undegraded":"2024-09-16T07:34:51.610284+0000","last_fullsized":"2024-09-16T07:34:51.610284+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:48.862042+0000","last_clean_scrub_stamp":"2024-09-16T07:34:48.862042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:16.039142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"128'3","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.276630+0000","last_change":"2024-09-16T07:34:48.884237+0000","last_active":"2024-09-16T07:34:51.276630+0000","last_peered":"2024-09-16T07:34:51.276630+0000","last_clean":"2024-09-16T07:34:51.276630+0000","last_became_active":"2024-09-16T07:34:48.883916+0000","last_became_peered":"2024-09-16T07:34:48.883916+0000","last_unstale":"2024-09-16T07:34:51.276630+0000","last_undegraded":"2024-09-16T07:34:51.276630+0000","last_fullsized":"2024-09-16T07:34:51.276630+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:34:47.858889+0000","last_clean_scrub_stamp":"2024-09-16T07:34:47.858889+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:11.063572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":337,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:34:51.605744+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:34:51.605744+0000","last_peered":"2024-09-16T07:34:51.605744+0000","last_clean":"2024-09-16T07:34:51.605744+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:34:51.605744+0000","last_undegraded":"2024-09-16T07:34:51.605744+0000","last_fullsized":"2024-09-16T07:34:51.605744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33348,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338492,"statfs":{"total":96636764160,"available":96602615808,"internally_reserved":0,"allocated":2211840,"data_stored":1298397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":707523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1613824,"data_stored":707399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509523,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1609728,"data_stored":707377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":707467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542229,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1626112,"data_stored":709059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1613824,"data_stored":707959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33356,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338484,"statfs":{"total":96636764160,"available":96602607616,"internally_reserved":0,"allocated":2220032,"data_stored":1299391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:34:58.938 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:34:58.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:34:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 -- 172.21.15.114:0/4204658267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c0cd100 msgr2=0x7f535c0ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 --2- 172.21.15.114:0/4204658267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c0cd100 0x7f535c0ce810 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f535c070900 tx=0x7f535401de20 comp rx=0 tx=0).stop 2024-09-16T07:34:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 -- 172.21.15.114:0/4204658267 shutdown_connections 2024-09-16T07:34:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 --2- 172.21.15.114:0/4204658267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c0cd100 0x7f535c0ce810 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 --2- 172.21.15.114:0/4204658267 >> v2:172.21.15.149:3300/0 conn(0x7f535c0b4a50 0x7f535c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 -- 172.21.15.114:0/4204658267 >> 172.21.15.114:0/4204658267 conn(0x7f535c0b18f0 msgr2=0x7f535c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:59.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 -- 172.21.15.114:0/4204658267 shutdown_connections 2024-09-16T07:34:59.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 -- 172.21.15.114:0/4204658267 wait complete. 2024-09-16T07:34:59.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 Processor -- start 2024-09-16T07:34:59.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.129+0000 7f5361400640 1 -- start start 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535c0b4a50 0x7f535c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f535c0cd100 0x7f535c0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c15db50 0x7f535c14a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f535c167120 con 0x7f535c15db50 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f535c0cf5a0 con 0x7f535c0b4a50 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f535c1672a0 con 0x7f535c0cd100 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c15db50 0x7f535c14a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c15db50 0x7f535c14a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35948/0 (socket says 172.21.15.114:35948) 2024-09-16T07:34:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 -- 172.21.15.114:0/2721522770 learned_addr learned my addr 172.21.15.114:0/2721522770 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5359e00640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f535c0cd100 0x7f535c0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535a800640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535c0b4a50 0x7f535c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 -- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f535c0cd100 msgr2=0x7f535c0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f535c0cd100 0x7f535c0700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 -- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535c0b4a50 msgr2=0x7f535c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535c0b4a50 0x7f535c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 -- 172.21.15.114:0/2721522770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c1fb630 con 0x7f535c15db50 2024-09-16T07:34:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f535b200640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c15db50 0x7f535c14a270 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f535400ac20 tx=0x7f5354003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:59.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5352a00640 1 -- 172.21.15.114:0/2721522770 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53540b3040 con 0x7f535c15db50 2024-09-16T07:34:59.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5352a00640 1 -- 172.21.15.114:0/2721522770 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5354004c50 con 0x7f535c15db50 2024-09-16T07:34:59.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c1fb910 con 0x7f535c15db50 2024-09-16T07:34:59.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5352a00640 1 -- 172.21.15.114:0/2721522770 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53540ae5f0 con 0x7f535c15db50 2024-09-16T07:34:59.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c1fbed0 con 0x7f535c15db50 2024-09-16T07:34:59.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535c069410 con 0x7f535c15db50 2024-09-16T07:34:59.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.133+0000 7f5352a00640 1 -- 172.21.15.114:0/2721522770 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f53540ae790 con 0x7f535c15db50 2024-09-16T07:34:59.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.137+0000 7f5352a00640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f533c073520 0x7f533c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.137+0000 7f5352a00640 1 -- 172.21.15.114:0/2721522770 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f535412f180 con 0x7f535c15db50 2024-09-16T07:34:59.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.137+0000 7f535a800640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f533c073520 0x7f533c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.137+0000 7f535a800640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f533c073520 0x7f533c0759e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f534c001640 tx=0x7f534c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:59.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.141+0000 7f5352a00640 1 -- 172.21.15.114:0/2721522770 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f53540c5060 con 0x7f535c15db50 2024-09-16T07:34:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.369+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f535c0adec0 con 0x7f535c15db50 2024-09-16T07:34:59.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.369+0000 7f5352a00640 1 -- 172.21.15.114:0/2721522770 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7f5354017aa0 con 0x7f535c15db50 2024-09-16T07:34:59.370 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:34:59.370 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:34:59.370 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:34:59.370 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:34:59.370 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:34:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:34:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f533c073520 msgr2=0x7f533c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f533c073520 0x7f533c0759e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f534c001640 tx=0x7f534c009040 comp rx=0 tx=0).stop 2024-09-16T07:34:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c15db50 msgr2=0x7f535c14a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c15db50 0x7f535c14a270 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f535400ac20 tx=0x7f5354003f40 comp rx=0 tx=0).stop 2024-09-16T07:34:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 shutdown_connections 2024-09-16T07:34:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f535c15db50 0x7f535c14a270 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f533c073520 0x7f533c0759e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f535c0cd100 0x7f535c0700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 --2- 172.21.15.114:0/2721522770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f535c0b4a50 0x7f535c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 >> 172.21.15.114:0/2721522770 conn(0x7f535c0b18f0 msgr2=0x7f535c073e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 shutdown_connections 2024-09-16T07:34:59.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.373+0000 7f5361400640 1 -- 172.21.15.114:0/2721522770 wait complete. 2024-09-16T07:34:59.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:34:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.533+0000 7f8280800640 1 -- 172.21.15.114:0/2056158760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278164c60 msgr2=0x7f8278167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.533+0000 7f8280800640 1 --2- 172.21.15.114:0/2056158760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278164c60 0x7f8278167050 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f8274009bc0 tx=0x7f827401cae0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- 172.21.15.114:0/2056158760 shutdown_connections 2024-09-16T07:34:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 --2- 172.21.15.114:0/2056158760 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8278164c60 0x7f8278167050 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- 172.21.15.114:0/2056158760 >> 172.21.15.114:0/2056158760 conn(0x7f82780d1e30 msgr2=0x7f82780d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- 172.21.15.114:0/2056158760 shutdown_connections 2024-09-16T07:34:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- 172.21.15.114:0/2056158760 wait complete. 2024-09-16T07:34:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 Processor -- start 2024-09-16T07:34:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- start start 2024-09-16T07:34:59.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82780b2e80 0x7f82780cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f827815f490 0x7f8278158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8278164c60 0x7f82780ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8278169f30 con 0x7f82780b2e80 2024-09-16T07:34:59.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8278169db0 con 0x7f827815f490 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f8280800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f827816a0b0 con 0x7f8278164c60 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82780b2e80 0x7f82780cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82780b2e80 0x7f82780cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35964/0 (socket says 172.21.15.114:35964) 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 -- 172.21.15.114:0/4294667010 learned_addr learned my addr 172.21.15.114:0/4294667010 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827e800640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8278164c60 0x7f82780ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827d400640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f827815f490 0x7f8278158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 -- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8278164c60 msgr2=0x7f82780ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8278164c60 0x7f82780ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 -- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f827815f490 msgr2=0x7f8278158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f827815f490 0x7f8278158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 -- 172.21.15.114:0/4294667010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82780ce750 con 0x7f82780b2e80 2024-09-16T07:34:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.537+0000 7f827de00640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82780b2e80 0x7f82780cf250 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c480 tx=0x7f826c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8272000640 1 -- 172.21.15.114:0/4294667010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c016020 con 0x7f82780b2e80 2024-09-16T07:34:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8272000640 1 -- 172.21.15.114:0/4294667010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f826c012920 con 0x7f82780b2e80 2024-09-16T07:34:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8272000640 1 -- 172.21.15.114:0/4294667010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c012d70 con 0x7f82780b2e80 2024-09-16T07:34:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827815a150 con 0x7f82780b2e80 2024-09-16T07:34:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827815a710 con 0x7f82780b2e80 2024-09-16T07:34:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82781fb120 con 0x7f82780b2e80 2024-09-16T07:34:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8272000640 1 -- 172.21.15.114:0/4294667010 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f826c019020 con 0x7f82780b2e80 2024-09-16T07:34:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8272000640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f825c0734f0 0x7f825c0759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:34:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f8272000640 1 -- 172.21.15.114:0/4294667010 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f826c0948e0 con 0x7f82780b2e80 2024-09-16T07:34:59.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.541+0000 7f827d400640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f825c0734f0 0x7f825c0759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:34:59.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.545+0000 7f827d400640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f825c0734f0 0x7f825c0759b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f827815bb40 tx=0x7f8268007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:34:59.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.545+0000 7f8272000640 1 -- 172.21.15.114:0/4294667010 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f82781fb120 con 0x7f82780b2e80 2024-09-16T07:34:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82780b14c0 con 0x7f82780b2e80 2024-09-16T07:34:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8272000640 1 -- 172.21.15.114:0/4294667010 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5227 (secure 0 0 0) 0x7f826c020020 con 0x7f82780b2e80 2024-09-16T07:34:59.747 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:34:59.747 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":92,"btime":"2024-09-16T07:34:52:899280+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/480729207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":480729207},{"type":"v1","addr":"172.21.15.114:6833","nonce":480729207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/3104829839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3104829839},{"type":"v1","addr":"172.21.15.149:6834","nonce":3104829839}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/44383065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":44383065},{"type":"v1","addr":"172.21.15.149:6835","nonce":44383065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:49.262936+0000","modified":"2024-09-16T07:34:52.287252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7923":{"gid":7923,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/710167418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":710167418},{"type":"v1","addr":"172.21.15.114:6835","nonce":710167418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7923,"qdb_cluster":[7923]},"id":10}]} 2024-09-16T07:34:59.748 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 92 2024-09-16T07:34:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f825c0734f0 msgr2=0x7f825c0759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f825c0734f0 0x7f825c0759b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f827815bb40 tx=0x7f8268007e40 comp rx=0 tx=0).stop 2024-09-16T07:34:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82780b2e80 msgr2=0x7f82780cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:34:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82780b2e80 0x7f82780cf250 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c480 tx=0x7f826c00c940 comp rx=0 tx=0).stop 2024-09-16T07:34:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 shutdown_connections 2024-09-16T07:34:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f825c0734f0 0x7f825c0759b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8278164c60 0x7f82780ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f827815f490 0x7f8278158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 --2- 172.21.15.114:0/4294667010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82780b2e80 0x7f82780cf250 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:34:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 >> 172.21.15.114:0/4294667010 conn(0x7f82780d1e30 msgr2=0x7f82780b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:34:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 shutdown_connections 2024-09-16T07:34:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:34:59.749+0000 7f8280800640 1 -- 172.21.15.114:0/4294667010 wait complete. 2024-09-16T07:35:00.172 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:34:49.262936+0000', 'modified': '2024-09-16T07:34:52.287252+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7923}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7923': {'gid': 7923, 'name': 'a', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/710167418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 710167418}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 710167418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7923, 'qdb_cluster': [7923]} 2024-09-16T07:35:00.172 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:35:00.172 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T07:35:00.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 -- 172.21.15.114:0/2891134830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 msgr2=0x7fb6d006ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 --2- 172.21.15.114:0/2891134830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d006ec30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009bc0 tx=0x7fb6c801f370 comp rx=0 tx=0).stop 2024-09-16T07:35:00.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 -- 172.21.15.114:0/2891134830 shutdown_connections 2024-09-16T07:35:00.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 --2- 172.21.15.114:0/2891134830 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d006ec30 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 --2- 172.21.15.114:0/2891134830 >> v2:172.21.15.149:3300/0 conn(0x7fb6d015c3e0 0x7fb6d015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 -- 172.21.15.114:0/2891134830 >> 172.21.15.114:0/2891134830 conn(0x7fb6d00b18f0 msgr2=0x7fb6d00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 -- 172.21.15.114:0/2891134830 shutdown_connections 2024-09-16T07:35:00.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 -- 172.21.15.114:0/2891134830 wait complete. 2024-09-16T07:35:00.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 Processor -- start 2024-09-16T07:35:00.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.317+0000 7fb6d6800640 1 -- start start 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d01503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6d015bfa0 0x7fb6d00cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6d015c3e0 0x7fb6d01f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d006f170 con 0x7fb6d006e7a0 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d0074960 con 0x7fb6d015c3e0 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d006f2f0 con 0x7fb6d015bfa0 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d01503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d01503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35986/0 (socket says 172.21.15.114:35986) 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 -- 172.21.15.114:0/3145240310 learned_addr learned my addr 172.21.15.114:0/3145240310 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6d015c3e0 0x7fb6d01f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6d015bfa0 0x7fb6d00cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 -- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6d015bfa0 msgr2=0x7fb6d00cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6d015bfa0 0x7fb6d00cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 -- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6d015c3e0 msgr2=0x7fb6d01f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6d015c3e0 0x7fb6d01f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 -- 172.21.15.114:0/3145240310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d0159c40 con 0x7fb6d006e7a0 2024-09-16T07:35:00.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6cf400640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d01503a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00058d0 tx=0x7fb6c000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6c7e00640 1 -- 172.21.15.114:0/3145240310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0017070 con 0x7fb6d006e7a0 2024-09-16T07:35:00.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6c7e00640 1 -- 172.21.15.114:0/3145240310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c0009d20 con 0x7fb6d006e7a0 2024-09-16T07:35:00.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d0159f20 con 0x7fb6d006e7a0 2024-09-16T07:35:00.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6c7e00640 1 -- 172.21.15.114:0/3145240310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00106c0 con 0x7fb6d006e7a0 2024-09-16T07:35:00.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d01f4ff0 con 0x7fb6d006e7a0 2024-09-16T07:35:00.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.321+0000 7fb6c7e00640 1 -- 172.21.15.114:0/3145240310 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fb6c001a070 con 0x7fb6d006e7a0 2024-09-16T07:35:00.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6c7e00640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6ac0734f0 0x7fb6ac0759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6c7e00640 1 -- 172.21.15.114:0/3145240310 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fb6c0094aa0 con 0x7fb6d006e7a0 2024-09-16T07:35:00.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6ac0734f0 0x7fb6ac0759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 Processor -- start 2024-09-16T07:35:00.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- start start 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6ac0734f0 0x7fb6ac0759b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb6d015c3b0 tx=0x7fb6b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76449d0 0x55b6e7644db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76452f0 0x55b6e75f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b6e75193f0 con 0x55b6e76449d0 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b6e7456b20 con 0x55b6e76452f0 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55b6e7445f50 con 0x55b6e75f8e10 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76449d0 0x55b6e7644db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76449d0 0x55b6e7644db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35998/0 (socket says 172.21.15.114:35998) 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 -- 172.21.15.114:0/1232499674 learned_addr learned my addr 172.21.15.114:0/1232499674 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76452f0 0x55b6e75f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 -- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 msgr2=0x55b6e75f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 -- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76452f0 msgr2=0x55b6e75f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76452f0 0x55b6e75f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 -- 172.21.15.114:0/1232499674 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6e740d590 con 0x55b6e76449d0 2024-09-16T07:35:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6cf400640 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76449d0 0x55b6e7644db0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fb6c005e980 tx=0x7fb6c005e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77681235456866b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6bfe00640 1 -- 172.21.15.114:0/1232499674 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0021040 con 0x55b6e76449d0 2024-09-16T07:35:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6bfe00640 1 -- 172.21.15.114:0/1232499674 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c005e0e0 con 0x55b6e76449d0 2024-09-16T07:35:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6bfe00640 1 -- 172.21.15.114:0/1232499674 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c005a810 con 0x55b6e76449d0 2024-09-16T07:35:00.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- 172.21.15.114:0/1232499674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76449d0 msgr2=0x55b6e7644db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76449d0 0x55b6e7644db0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fb6c005e980 tx=0x7fb6c005e3f0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- 172.21.15.114:0/1232499674 shutdown_connections 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76452f0 0x55b6e75f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/1232499674 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76449d0 0x55b6e7644db0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- 172.21.15.114:0/1232499674 >> 172.21.15.114:0/1232499674 conn(0x55b6e74e2130 msgr2=0x55b6e7627e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- 172.21.15.114:0/1232499674 shutdown_connections 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.325+0000 7fb6d9b57000 1 -- 172.21.15.114:0/1232499674 wait complete. 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 -- start start 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 Processor -- start 2024-09-16T07:35:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75fa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e75fa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e75facc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b6e73e05d0 con 0x55b6e76452f0 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b6e7449d60 con 0x55b6e76449d0 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55b6e73ec500 con 0x55b6e75f8e10 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 10 client.0 _ll_register_callbacks cb 0x55b6e73f0810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e75facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e75facc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36000/0 (socket says 172.21.15.114:36000) 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 -- 172.21.15.114:0/4270928712 learned_addr learned my addr 172.21.15.114:0/4270928712 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e75fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cf400640 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 -- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 msgr2=0x55b6e75fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75fa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 -- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 msgr2=0x55b6e75fa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e75fa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 -- 172.21.15.114:0/4270928712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6e73e4170 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e75facc0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80b2040 tx=0x7fb6c8004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466148f1a073f919 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6bcc00640 1 -- 172.21.15.114:0/4270928712 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80b4040 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6bcc00640 1 -- 172.21.15.114:0/4270928712 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fb6c8003b80 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6e73de0f0 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6bcc00640 1 -- 172.21.15.114:0/4270928712 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fb6c8003d80 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 10 client.8064 fetch_fsmap learned FSMap version 92 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) -- 0x55b6e74caef0 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6bcc00640 1 -- 172.21.15.114:0/4270928712 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b6e73de0f0 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6bcc00640 1 -- 172.21.15.114:0/4270928712 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 92) ==== 3502+0+0 (secure 0 0 0) 0x7fb6c8005040 con 0x55b6e76452f0 2024-09-16T07:35:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 10 client.8064 fetch_fsmap finished waiting for FSMap version 92 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 10 client.8064 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 20 client.8064 populate_metadata read hostname 'smithi114' 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e7653c70 0x55b6e7656060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 4 client.8064 mds_command: new command op to 7923 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 --> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6e7458a70 con 0x55b6e7653c70 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.329+0000 7fb6cf400640 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e7653c70 0x55b6e7656060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6bcc00640 10 client.8064 ms_handle_connect on v2:172.21.15.114:6834/710167418 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6cf400640 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e7653c70 0x55b6e7656060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=904714b09424ac0e server_cookie=719a57ec519d2ca3 in_seq=0 out_seq=0 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6bcc00640 1 -- 172.21.15.114:0/4270928712 <== mds.0 v2:172.21.15.114:6834/710167418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6e7458a70 con 0x55b6e7653c70 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6bcc00640 10 client.8064 handle_command_reply: tid=0 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 client.8064 shutdown 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 msgr2=0x55b6e75facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e75facc0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80b2040 tx=0x7fb6c8004ca0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 shutdown_connections 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e7653c70 0x55b6e7656060 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e75facc0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e75fa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/4270928712 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e75f8e10 0x55b6e75fa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6bcc00640 0 client.8064 ms_handle_reset on v2:172.21.15.114:6834/710167418 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 >> 172.21.15.114:0/4270928712 conn(0x55b6e74e2130 msgr2=0x55b6e75f7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 shutdown_connections 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 1 -- 172.21.15.114:0/4270928712 wait complete. 2024-09-16T07:35:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.333+0000 7fb6d9b57000 20 client.8064 trim_cache size 0 max 16384 2024-09-16T07:35:00.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.349+0000 7fb6d9b57000 1 Processor -- start 2024-09-16T07:35:00.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.349+0000 7fb6d9b57000 1 -- start start 2024-09-16T07:35:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e75f8e10 0x55b6e76bebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76449d0 0x55b6e76bf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e76bf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d00c9db0 con 0x55b6e76452f0 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d00c9110 con 0x55b6e75f8e10 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d00c9760 con 0x55b6e76449d0 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e76bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e76bf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36012/0 (socket says 172.21.15.114:36012) 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 -- 172.21.15.114:0/2654208857 learned_addr learned my addr 172.21.15.114:0/2654208857 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 -- 172.21.15.114:0/2654208857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76449d0 msgr2=0x55b6e76bf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/2654208857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76449d0 0x55b6e76bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 -- 172.21.15.114:0/2654208857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e75f8e10 msgr2=0x55b6e76bebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/2654208857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e75f8e10 0x55b6e76bebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 -- 172.21.15.114:0/2654208857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6e74a1d90 con 0x55b6e76452f0 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/2654208857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e76bf650 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb6c801cfa0 tx=0x7fb6c80097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3e66090e41e043 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6bf400640 1 -- 172.21.15.114:0/2654208857 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80b4040 con 0x55b6e76452f0 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6bf400640 1 -- 172.21.15.114:0/2654208857 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c80059a0 con 0x55b6e76452f0 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6bf400640 1 -- 172.21.15.114:0/2654208857 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8003980 con 0x55b6e76452f0 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2654208857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 msgr2=0x55b6e76bf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2654208857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e76bf650 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb6c801cfa0 tx=0x7fb6c80097e0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2654208857 shutdown_connections 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2654208857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e76452f0 0x55b6e76bf650 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2654208857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76449d0 0x55b6e76bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2654208857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e75f8e10 0x55b6e76bebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2654208857 >> 172.21.15.114:0/2654208857 conn(0x55b6e74e2130 msgr2=0x55b6e75f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2654208857 shutdown_connections 2024-09-16T07:35:00.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2654208857 wait complete. 2024-09-16T07:35:00.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 -- start start 2024-09-16T07:35:00.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.353+0000 7fb6d9b57000 1 Processor -- start 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e75f8e10 0x55b6e765ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e767ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76452f0 0x55b6e767f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55b6e74558f0 con 0x55b6e75f8e10 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b6e7411ec0 con 0x55b6e76449d0 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55b6e744e390 con 0x55b6e76452f0 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 10 client.0 _ll_register_callbacks cb 0x7fb6c8009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e75f8e10 0x55b6e765ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e75f8e10 0x55b6e765ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36020/0 (socket says 172.21.15.114:36020) 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 -- 172.21.15.114:0/2121544976 learned_addr learned my addr 172.21.15.114:0/2121544976 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e767ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cfe00640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76452f0 0x55b6e767f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 -- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76452f0 msgr2=0x55b6e767f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76452f0 0x55b6e767f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 -- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 msgr2=0x55b6e767ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e767ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 -- 172.21.15.114:0/2121544976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6e740ca90 con 0x55b6e75f8e10 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e767ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6cf400640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e75f8e10 0x55b6e765ac50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fb6c005bef0 tx=0x7fb6c000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf8bb1073a2e4f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:35:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 1 -- 172.21.15.114:0/2121544976 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0021040 con 0x55b6e75f8e10 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 1 -- 172.21.15.114:0/2121544976 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fb6c0074d50 con 0x55b6e75f8e10 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6c80059a0 con 0x55b6e75f8e10 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 1 -- 172.21.15.114:0/2121544976 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fb6c005b2d0 con 0x55b6e75f8e10 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 10 client.8070 fetch_fsmap learned FSMap version 92 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) -- 0x55b6e73eb050 con 0x55b6e75f8e10 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 1 -- 172.21.15.114:0/2121544976 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c80059a0 con 0x55b6e75f8e10 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 1 -- 172.21.15.114:0/2121544976 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 92) ==== 3502+0+0 (secure 0 0 0) 0x7fb6c005dee0 con 0x55b6e75f8e10 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 10 client.8070 fetch_fsmap finished waiting for FSMap version 92 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 10 client.8070 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 20 client.8070 populate_metadata read hostname 'smithi114' 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e767f810 0x55b6e76c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 4 client.8070 mds_command: new command op to 7923 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 --> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] -- command(tid 0: {"prefix": "status"}) -- 0x55b6e7454520 con 0x55b6e767f810 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e767f810 0x55b6e76c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6c6a00640 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e767f810 0x55b6e76c2e20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85f5e1ad8bc733d server_cookie=d098e39608aaf1d1 in_seq=0 out_seq=0 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 10 client.8070 ms_handle_connect on v2:172.21.15.114:6834/710167418 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 1 -- 172.21.15.114:0/2121544976 <== mds.0 v2:172.21.15.114:6834/710167418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55b6e7454520 con 0x55b6e767f810 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 10 client.8070 handle_command_reply: tid=0 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 client.8070 shutdown 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e75f8e10 msgr2=0x55b6e765ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e75f8e10 0x55b6e765ac50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fb6c005bef0 tx=0x7fb6c000bef0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 shutdown_connections 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:6834/710167418,v1:172.21.15.114:6835/710167418] conn(0x55b6e767f810 0x55b6e76c2e20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55b6e76452f0 0x55b6e767f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b6e76449d0 0x55b6e767ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6bcc00640 0 client.8070 ms_handle_reset on v2:172.21.15.114:6834/710167418 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 --2- 172.21.15.114:0/2121544976 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b6e75f8e10 0x55b6e765ac50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 >> 172.21.15.114:0/2121544976 conn(0x55b6e74e2130 msgr2=0x55b6e7656060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 shutdown_connections 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 1 -- 172.21.15.114:0/2121544976 wait complete. 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.357+0000 7fb6d9b57000 20 client.8070 trim_cache size 0 max 16384 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:35:00.362 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 7923, 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.491032746, 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 92, 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 129, 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 129, 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 15.02198295 2024-09-16T07:35:00.363 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:35:00.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6ac0734f0 msgr2=0x7fb6ac0759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6ac0734f0 0x7fb6ac0759b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb6d015c3b0 tx=0x7fb6b8009040 comp rx=0 tx=0).stop 2024-09-16T07:35:00.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 msgr2=0x7fb6d01503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d01503a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00058d0 tx=0x7fb6c000dde0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 shutdown_connections 2024-09-16T07:35:00.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6d015c3e0 0x7fb6d01f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6ac0734f0 0x7fb6ac0759b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6d015bfa0 0x7fb6d00cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 --2- 172.21.15.114:0/3145240310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6d006e7a0 0x7fb6d01503a0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 >> 172.21.15.114:0/3145240310 conn(0x7fb6d00b18f0 msgr2=0x7fb6d00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 shutdown_connections 2024-09-16T07:35:00.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.361+0000 7fb6d6800640 1 -- 172.21.15.114:0/3145240310 wait complete. 2024-09-16T07:35:00.377 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 -- 172.21.15.114:0/401133568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd608003c20 msgr2=0x7fd608004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 --2- 172.21.15.114:0/401133568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd608003c20 0x7fd608004020 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd614001f80 tx=0x7fd61401cc40 comp rx=0 tx=0).stop 2024-09-16T07:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd628c00640 1 -- 172.21.15.114:0/401133568 reap_dead start 2024-09-16T07:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 -- 172.21.15.114:0/401133568 shutdown_connections 2024-09-16T07:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 -- 172.21.15.114:0/401133568 >> 172.21.15.114:0/401133568 conn(0x7fd6240d1dc0 msgr2=0x7fd6240d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 -- 172.21.15.114:0/401133568 shutdown_connections 2024-09-16T07:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 -- 172.21.15.114:0/401133568 wait complete. 2024-09-16T07:35:00.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 Processor -- start 2024-09-16T07:35:00.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.525+0000 7fd62ac00640 1 -- start start 2024-09-16T07:35:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd608003c20 0x7fd62406e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd62415c630 0x7fd62406f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd62406f940 0x7fd624164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd624167f10 con 0x7fd62415c630 2024-09-16T07:35:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd624167d90 con 0x7fd608003c20 2024-09-16T07:35:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd624168090 con 0x7fd62406f940 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd62415c630 0x7fd62406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd62415c630 0x7fd62406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36042/0 (socket says 172.21.15.114:36042) 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 -- 172.21.15.114:0/1135963351 learned_addr learned my addr 172.21.15.114:0/1135963351 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd623e00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd608003c20 0x7fd62406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd628c00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd62406f940 0x7fd624164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 -- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd62406f940 msgr2=0x7fd624164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd62406f940 0x7fd624164b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 -- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd608003c20 msgr2=0x7fd62406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd608003c20 0x7fd62406e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 -- 172.21.15.114:0/1135963351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62415cab0 con 0x7fd62415c630 2024-09-16T07:35:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd61b400640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd62415c630 0x7fd62406f400 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00e600 tx=0x7fd60c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd620c00640 1 -- 172.21.15.114:0/1135963351 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c015070 con 0x7fd62415c630 2024-09-16T07:35:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd620c00640 1 -- 172.21.15.114:0/1135963351 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd60c010980 con 0x7fd62415c630 2024-09-16T07:35:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd620c00640 1 -- 172.21.15.114:0/1135963351 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c010dd0 con 0x7fd62415c630 2024-09-16T07:35:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62406ed70 con 0x7fd62415c630 2024-09-16T07:35:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd624164350 con 0x7fd62415c630 2024-09-16T07:35:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6240ae9b0 con 0x7fd62415c630 2024-09-16T07:35:00.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.529+0000 7fd620c00640 1 -- 172.21.15.114:0/1135963351 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fd60c018070 con 0x7fd62415c630 2024-09-16T07:35:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.533+0000 7fd620c00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd600073520 0x7fd6000759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.533+0000 7fd620c00640 1 -- 172.21.15.114:0/1135963351 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fd60c094d90 con 0x7fd62415c630 2024-09-16T07:35:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.533+0000 7fd623e00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd600073520 0x7fd6000759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.533+0000 7fd623e00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd600073520 0x7fd6000759e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6140a9000 tx=0x7fd614019a80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.537+0000 7fd620c00640 1 -- 172.21.15.114:0/1135963351 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd62415cab0 con 0x7fd62415c630 2024-09-16T07:35:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd6240cc1b0 con 0x7fd62415c630 2024-09-16T07:35:00.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd620c00640 1 -- 172.21.15.114:0/1135963351 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) ==== 53+0+73 (secure 0 0 0) 0x7fd60c05eee0 con 0x7fd62415c630 2024-09-16T07:35:00.739 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd600073520 msgr2=0x7fd6000759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd600073520 0x7fd6000759e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd6140a9000 tx=0x7fd614019a80 comp rx=0 tx=0).stop 2024-09-16T07:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd62415c630 msgr2=0x7fd62406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd62415c630 0x7fd62406f400 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00e600 tx=0x7fd60c00ea00 comp rx=0 tx=0).stop 2024-09-16T07:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 shutdown_connections 2024-09-16T07:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd600073520 0x7fd6000759e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd62406f940 0x7fd624164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd62415c630 0x7fd62406f400 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 --2- 172.21.15.114:0/1135963351 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd608003c20 0x7fd62406e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 >> 172.21.15.114:0/1135963351 conn(0x7fd6240d1dc0 msgr2=0x7fd6240b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 shutdown_connections 2024-09-16T07:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00.741+0000 7fd62ac00640 1 -- 172.21.15.114:0/1135963351 wait complete. 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:35:00.761 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:35:00.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:00.762 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:00.771 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42040sec preferred_lft 42040sec 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.772 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:35:00.773 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:00.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:00.774 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:35:00.831 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:35:00.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:00.833 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:35:00.886 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:00.887 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:35:00.887 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:35:00.887 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:35:00.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:35:00.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:35:00.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:35:00.887 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:35:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:35:01.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:01.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:01.022 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:35:01.077 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:35:01.078 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:35:01.078 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:35:01.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:01.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:35:01.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:01.141 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:01.189 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:35:01.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:01.190 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:01.241 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:35:01.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:01.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:35:01.329 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:35:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:35:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:35:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:01.345 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:01.352 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:35:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:35:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:35:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:35:01.353 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:35:01.356 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:35:01.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:01.357 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:01.376 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:35:01.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:35:01.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:01.479 INFO:teuthology.orchestra.run.smithi114.stdout:client8079 2024-09-16T07:35:01.480 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:01.480 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:01.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:35:01.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 -- 172.21.15.114:0/712563549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740cfe80 msgr2=0x7f0a740d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:01.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 --2- 172.21.15.114:0/712563549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740cfe80 0x7f0a740d0260 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b33d0 tx=0x7f0a6401c810 comp rx=0 tx=0).stop 2024-09-16T07:35:01.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 -- 172.21.15.114:0/712563549 shutdown_connections 2024-09-16T07:35:01.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 --2- 172.21.15.114:0/712563549 >> v2:172.21.15.149:3300/0 conn(0x7f0a740b2760 0x7f0a741605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 --2- 172.21.15.114:0/712563549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740cfe80 0x7f0a740d0260 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 -- 172.21.15.114:0/712563549 >> 172.21.15.114:0/712563549 conn(0x7f0a740d1e40 msgr2=0x7f0a740d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:01.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 -- 172.21.15.114:0/712563549 shutdown_connections 2024-09-16T07:35:01.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.721+0000 7f0a7b200640 1 -- 172.21.15.114:0/712563549 wait complete. 2024-09-16T07:35:01.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 Processor -- start 2024-09-16T07:35:01.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 -- start start 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740b2760 0x7f0a74152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a740b2d00 0x7f0a74158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a740cfe80 0x7f0a7415efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0a740b08f0 con 0x7f0a740b2760 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0a740b0770 con 0x7f0a740cfe80 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0a740b0a70 con 0x7f0a740b2d00 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740b2760 0x7f0a74152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740b2760 0x7f0a74152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36050/0 (socket says 172.21.15.114:36050) 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 -- 172.21.15.114:0/3206084457 learned_addr learned my addr 172.21.15.114:0/3206084457 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a79200640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a740cfe80 0x7f0a7415efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:01.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a6b400640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a740b2d00 0x7f0a74158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 -- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a740b2d00 msgr2=0x7f0a74158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a740b2d00 0x7f0a74158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 -- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a740cfe80 msgr2=0x7f0a7415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a740cfe80 0x7f0a7415efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 -- 172.21.15.114:0/3206084457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a741520c0 con 0x7f0a740b2760 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a73e00640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740b2760 0x7f0a74152e40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0a640b0040 tx=0x7f0a64004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a70c00640 1 -- 172.21.15.114:0/3206084457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64004230 con 0x7f0a740b2760 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a70c00640 1 -- 172.21.15.114:0/3206084457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a640044c0 con 0x7f0a740b2760 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a70c00640 1 -- 172.21.15.114:0/3206084457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64005250 con 0x7f0a740b2760 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a740c7370 con 0x7f0a740b2760 2024-09-16T07:35:01.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.725+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a74152640 con 0x7f0a740b2760 2024-09-16T07:35:01.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.729+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a740d0260 con 0x7f0a740b2760 2024-09-16T07:35:01.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.729+0000 7f0a70c00640 1 -- 172.21.15.114:0/3206084457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f0a640bf030 con 0x7f0a740b2760 2024-09-16T07:35:01.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.729+0000 7f0a70c00640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a500734f0 0x7f0a500759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:01.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.729+0000 7f0a70c00640 1 -- 172.21.15.114:0/3206084457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f0a6412ee90 con 0x7f0a740b2760 2024-09-16T07:35:01.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.729+0000 7f0a6b400640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a500734f0 0x7f0a500759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:01.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.729+0000 7f0a6b400640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a500734f0 0x7f0a500759b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0a7409fff0 tx=0x7f0a5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:01.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.733+0000 7f0a70c00640 1 -- 172.21.15.114:0/3206084457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0a64016490 con 0x7f0a740b2760 2024-09-16T07:35:01.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.937+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a740cf0d0 con 0x7f0a740b2760 2024-09-16T07:35:01.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.937+0000 7f0a70c00640 1 -- 172.21.15.114:0/3206084457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) ==== 53+0+73 (secure 0 0 0) 0x7f0a640f9630 con 0x7f0a740b2760 2024-09-16T07:35:01.938 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:35:01.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a500734f0 msgr2=0x7f0a500759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a500734f0 0x7f0a500759b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0a7409fff0 tx=0x7f0a5c009040 comp rx=0 tx=0).stop 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740b2760 msgr2=0x7f0a74152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740b2760 0x7f0a74152e40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0a640b0040 tx=0x7f0a64004040 comp rx=0 tx=0).stop 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 shutdown_connections 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a740cfe80 0x7f0a7415efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a500734f0 0x7f0a500759b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a740b2d00 0x7f0a74158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 --2- 172.21.15.114:0/3206084457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a740b2760 0x7f0a74152e40 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:01.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 >> 172.21.15.114:0/3206084457 conn(0x7f0a740d1e40 msgr2=0x7f0a74159970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:01.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 shutdown_connections 2024-09-16T07:35:01.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:01.941+0000 7f0a7b200640 1 -- 172.21.15.114:0/3206084457 wait complete. 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:35:01.960 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:35:01.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:01.961 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:01.971 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42048sec preferred_lft 42048sec 2024-09-16T07:35:01.972 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:35:01.973 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:35:01.974 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:01.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:01.975 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:35:02.037 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:35:02.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:02.041 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:35:02.099 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:35:02.099 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:35:02.099 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:35:02.099 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:35:02.099 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:35:02.099 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:35:02.099 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:35:02.100 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:02.100 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:02.100 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:02.100 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:35:02.100 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:35:02.100 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:35:02.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:35:02.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:35:02.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:35:02.101 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:35:02.191 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:35:02.233 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:02.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:02.241 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:35:02.250 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:35:02.250 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:35:02.251 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:35:02.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:02.251 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:35:02.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:02.314 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:02.366 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:35:02.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:02.367 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:02.422 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:35:02.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:02.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:02.517 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:02.517 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:35:02.517 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:35:02.532 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:02.532 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:35:02.532 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:35:02.532 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:02.532 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:35:02.542 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:35:02.547 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:35:02.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:02.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:02.566 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:35:02.656 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:35:02.660 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:02.666 INFO:teuthology.orchestra.run.smithi149.stdout:client7603 2024-09-16T07:35:02.666 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:02.666 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:02.715 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:35:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- 172.21.15.114:0/3188545831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a40b0b60 msgr2=0x7f24a4166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 --2- 172.21.15.114:0/3188545831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a40b0b60 0x7f24a4166eb0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f249c009840 tx=0x7f249c01c740 comp rx=0 tx=0).stop 2024-09-16T07:35:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- 172.21.15.114:0/3188545831 shutdown_connections 2024-09-16T07:35:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 --2- 172.21.15.114:0/3188545831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a40b0b60 0x7f24a4166eb0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- 172.21.15.114:0/3188545831 >> 172.21.15.114:0/3188545831 conn(0x7f24a40d1da0 msgr2=0x7f24a40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- 172.21.15.114:0/3188545831 shutdown_connections 2024-09-16T07:35:02.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- 172.21.15.114:0/3188545831 wait complete. 2024-09-16T07:35:02.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 Processor -- start 2024-09-16T07:35:02.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- start start 2024-09-16T07:35:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a40b0b60 0x7f24a40c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:02.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a415be10 0x7f24a40c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a415c1f0 0x7f24a40b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4167570 con 0x7f24a415c1f0 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24a41673f0 con 0x7f24a415be10 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24abe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24a41676f0 con 0x7f24a40b0b60 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a415c1f0 0x7f24a40b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a415c1f0 0x7f24a40b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36054/0 (socket says 172.21.15.114:36054) 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a8a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a415be10 0x7f24a40c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 -- 172.21.15.114:0/1882698520 learned_addr learned my addr 172.21.15.114:0/1882698520 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9400640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a40b0b60 0x7f24a40c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 -- 172.21.15.114:0/1882698520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a40b0b60 msgr2=0x7f24a40c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a40b0b60 0x7f24a40c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 -- 172.21.15.114:0/1882698520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a415be10 msgr2=0x7f24a40c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:02.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a415be10 0x7f24a40c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.869+0000 7f24a9e00640 1 -- 172.21.15.114:0/1882698520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a40c98f0 con 0x7f24a415c1f0 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a9e00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a415c1f0 0x7f24a40b0060 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f249c009790 tx=0x7f249c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a1600640 1 -- 172.21.15.114:0/1882698520 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0bb070 con 0x7f24a415c1f0 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a1600640 1 -- 172.21.15.114:0/1882698520 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f249c005120 con 0x7f24a415c1f0 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a1600640 1 -- 172.21.15.114:0/1882698520 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0b2040 con 0x7f24a415c1f0 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a4154200 con 0x7f24a415c1f0 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a40c8e70 con 0x7f24a415c1f0 2024-09-16T07:35:02.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a40ce700 con 0x7f24a415c1f0 2024-09-16T07:35:02.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a1600640 1 -- 172.21.15.114:0/1882698520 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f249c0be070 con 0x7f24a415c1f0 2024-09-16T07:35:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a1600640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24840734f0 0x7f24840759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a1600640 1 -- 172.21.15.114:0/1882698520 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f249c12e3c0 con 0x7f24a415c1f0 2024-09-16T07:35:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.873+0000 7f24a9400640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24840734f0 0x7f24840759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:02.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.877+0000 7f24a9400640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24840734f0 0x7f24840759b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2498005680 tx=0x7f2498003dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:02.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:02.877+0000 7f24a1600640 1 -- 172.21.15.114:0/1882698520 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f249c016330 con 0x7f24a415c1f0 2024-09-16T07:35:03.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.081+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f24a4070350 con 0x7f24a415c1f0 2024-09-16T07:35:03.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.469+0000 7f24a1600640 1 -- 172.21.15.114:0/1882698520 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v93) ==== 136+0+0 (secure 0 0 0) 0x7f249c0f85e0 con 0x7f24a415c1f0 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24840734f0 msgr2=0x7f24840759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24840734f0 0x7f24840759b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2498005680 tx=0x7f2498003dd0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a415c1f0 msgr2=0x7f24a40b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a415c1f0 0x7f24a40b0060 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f249c009790 tx=0x7f249c004270 comp rx=0 tx=0).stop 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 shutdown_connections 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24a415c1f0 0x7f24a40b0060 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a415be10 0x7f24a40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24840734f0 0x7f24840759b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 --2- 172.21.15.114:0/1882698520 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24a40b0b60 0x7f24a40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 >> 172.21.15.114:0/1882698520 conn(0x7f24a40d1da0 msgr2=0x7f24a40ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 shutdown_connections 2024-09-16T07:35:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.473+0000 7f24abe00640 1 -- 172.21.15.114:0/1882698520 wait complete. 2024-09-16T07:35:03.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:35:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 -- 172.21.15.114:0/2223911311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b815dae0 msgr2=0x7f24b80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 --2- 172.21.15.114:0/2223911311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b815dae0 0x7f24b80acd40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009900 tx=0x7f24ac01c850 comp rx=0 tx=0).stop 2024-09-16T07:35:03.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 -- 172.21.15.114:0/2223911311 shutdown_connections 2024-09-16T07:35:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 --2- 172.21.15.114:0/2223911311 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24b80cd100 0x7f24b80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 --2- 172.21.15.114:0/2223911311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b815dae0 0x7f24b80acd40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 -- 172.21.15.114:0/2223911311 >> 172.21.15.114:0/2223911311 conn(0x7f24b80b18f0 msgr2=0x7f24b80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 -- 172.21.15.114:0/2223911311 shutdown_connections 2024-09-16T07:35:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 -- 172.21.15.114:0/2223911311 wait complete. 2024-09-16T07:35:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 Processor -- start 2024-09-16T07:35:03.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.637+0000 7f24c0200640 1 -- start start 2024-09-16T07:35:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b80b4810 0x7f24b8148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24b80cd100 0x7f24b81f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:03.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24b815dae0 0x7f24b815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f24b81674b0 con 0x7f24b80cd100 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24b8167330 con 0x7f24b80b4810 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f24b8167630 con 0x7f24b815dae0 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24b80cd100 0x7f24b81f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24b80cd100 0x7f24b81f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36056/0 (socket says 172.21.15.114:36056) 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 -- 172.21.15.114:0/2893205752 learned_addr learned my addr 172.21.15.114:0/2893205752 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24be200640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24b815dae0 0x7f24b815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bd800640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b80b4810 0x7f24b8148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 -- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24b815dae0 msgr2=0x7f24b815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24b815dae0 0x7f24b815a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 -- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b80b4810 msgr2=0x7f24b8148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b80b4810 0x7f24b8148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 -- 172.21.15.114:0/2893205752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b81f9030 con 0x7f24b80cd100 2024-09-16T07:35:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24bce00640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24b80cd100 0x7f24b81f8650 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f24a400ead0 tx=0x7f24a400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24b5600640 1 -- 172.21.15.114:0/2893205752 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a401b070 con 0x7f24b80cd100 2024-09-16T07:35:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24b5600640 1 -- 172.21.15.114:0/2893205752 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24a4016410 con 0x7f24b80cd100 2024-09-16T07:35:03.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b81f9310 con 0x7f24b80cd100 2024-09-16T07:35:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24b5600640 1 -- 172.21.15.114:0/2893205752 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4016860 con 0x7f24b80cd100 2024-09-16T07:35:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b81f9c20 con 0x7f24b80cd100 2024-09-16T07:35:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.641+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8069410 con 0x7f24b80cd100 2024-09-16T07:35:03.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.645+0000 7f24b5600640 1 -- 172.21.15.114:0/2893205752 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f24a401e070 con 0x7f24b80cd100 2024-09-16T07:35:03.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.645+0000 7f24b5600640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24980734f0 0x7f24980759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:03.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.645+0000 7f24b5600640 1 -- 172.21.15.114:0/2893205752 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f24a4094c50 con 0x7f24b80cd100 2024-09-16T07:35:03.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.645+0000 7f24bd800640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24980734f0 0x7f24980759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:03.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.645+0000 7f24bd800640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24980734f0 0x7f24980759b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0af000 tx=0x7f24ac01b090 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:03.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.649+0000 7f24b5600640 1 -- 172.21.15.114:0/2893205752 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f24a405ee30 con 0x7f24b80cd100 2024-09-16T07:35:03.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.837+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f24b80cc440 con 0x7f24980734f0 2024-09-16T07:35:03.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.837+0000 7f24b5600640 1 -- 172.21.15.114:0/2893205752 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f24b80cc440 con 0x7f24980734f0 2024-09-16T07:35:03.837 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:35:03.838 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:03.838 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:35:03.838 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:03.838 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:35:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24980734f0 msgr2=0x7f24980759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24980734f0 0x7f24980759b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0af000 tx=0x7f24ac01b090 comp rx=0 tx=0).stop 2024-09-16T07:35:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24b80cd100 msgr2=0x7f24b81f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24b80cd100 0x7f24b81f8650 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f24a400ead0 tx=0x7f24a400ef90 comp rx=0 tx=0).stop 2024-09-16T07:35:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 shutdown_connections 2024-09-16T07:35:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f24980734f0 0x7f24980759b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24b815dae0 0x7f24b815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f24b80cd100 0x7f24b81f8650 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 --2- 172.21.15.114:0/2893205752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24b80b4810 0x7f24b8148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 >> 172.21.15.114:0/2893205752 conn(0x7f24b80b18f0 msgr2=0x7f24b80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 shutdown_connections 2024-09-16T07:35:03.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:03.841+0000 7f24c0200640 1 -- 172.21.15.114:0/2893205752 wait complete. 2024-09-16T07:35:03.859 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:35:04.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 -- 172.21.15.114:0/3163676246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 msgr2=0x7f3a800ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 --2- 172.21.15.114:0/3163676246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 0x7f3a800ce4e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009900 tx=0x7f3a7401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 -- 172.21.15.114:0/3163676246 shutdown_connections 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 --2- 172.21.15.114:0/3163676246 >> v2:172.21.15.149:3300/0 conn(0x7f3a800cd8c0 0x7f3a800cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 --2- 172.21.15.114:0/3163676246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 0x7f3a800ce4e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 -- 172.21.15.114:0/3163676246 >> 172.21.15.114:0/3163676246 conn(0x7f3a800d1da0 msgr2=0x7f3a800d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 -- 172.21.15.114:0/3163676246 shutdown_connections 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 -- 172.21.15.114:0/3163676246 wait complete. 2024-09-16T07:35:04.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 Processor -- start 2024-09-16T07:35:04.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.005+0000 7f3a88200640 1 -- start start 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a800cd8c0 0x7f3a800c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a800d28c0 0x7f3a801571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 0x7f3a8015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a80168de0 con 0x7f3a800d28c0 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a80168c60 con 0x7f3a800cd8c0 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3a80168f60 con 0x7f3a8015be80 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a800d28c0 0x7f3a801571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a800d28c0 0x7f3a801571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36064/0 (socket says 172.21.15.114:36064) 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 -- 172.21.15.114:0/193097544 learned_addr learned my addr 172.21.15.114:0/193097544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a85800640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a800cd8c0 0x7f3a800c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a86200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 0x7f3a8015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 -- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 msgr2=0x7f3a8015ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 0x7f3a8015ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 -- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a800cd8c0 msgr2=0x7f3a800c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a800cd8c0 0x7f3a800c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 -- 172.21.15.114:0/193097544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a800c58d0 con 0x7f3a800d28c0 2024-09-16T07:35:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a86200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 0x7f3a8015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:04.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a84e00640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a800d28c0 0x7f3a801571f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c007fd0 tx=0x7f3a6c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:04.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a7d600640 1 -- 172.21.15.114:0/193097544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c017070 con 0x7f3a800d28c0 2024-09-16T07:35:04.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a7d600640 1 -- 172.21.15.114:0/193097544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a6c0053c0 con 0x7f3a800d28c0 2024-09-16T07:35:04.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a801f7b10 con 0x7f3a800d28c0 2024-09-16T07:35:04.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a7d600640 1 -- 172.21.15.114:0/193097544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c003860 con 0x7f3a800d28c0 2024-09-16T07:35:04.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a801f80d0 con 0x7f3a800d28c0 2024-09-16T07:35:04.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.009+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a801f88b0 con 0x7f3a800d28c0 2024-09-16T07:35:04.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.013+0000 7f3a7d600640 1 -- 172.21.15.114:0/193097544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f3a6c01a070 con 0x7f3a800d28c0 2024-09-16T07:35:04.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.013+0000 7f3a7d600640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a600734f0 0x7f3a600759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.013+0000 7f3a7d600640 1 -- 172.21.15.114:0/193097544 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f3a6c093db0 con 0x7f3a800d28c0 2024-09-16T07:35:04.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.013+0000 7f3a85800640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a600734f0 0x7f3a600759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.013+0000 7f3a85800640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a600734f0 0x7f3a600759b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a740af000 tx=0x7f3a7401b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:04.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.017+0000 7f3a7d600640 1 -- 172.21.15.114:0/193097544 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3a800d0350 con 0x7f3a800d28c0 2024-09-16T07:35:04.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.185+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3a800b53f0 con 0x7f3a800d28c0 2024-09-16T07:35:04.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.185+0000 7f3a7d600640 1 -- 172.21.15.114:0/193097544 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f3a6c05df10 con 0x7f3a800d28c0 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a600734f0 msgr2=0x7f3a600759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a600734f0 0x7f3a600759b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a740af000 tx=0x7f3a7401b120 comp rx=0 tx=0).stop 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a800d28c0 msgr2=0x7f3a801571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a800d28c0 0x7f3a801571f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c007fd0 tx=0x7f3a6c00c890 comp rx=0 tx=0).stop 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 shutdown_connections 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a600734f0 0x7f3a600759b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a8015be80 0x7f3a8015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a800d28c0 0x7f3a801571f0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 --2- 172.21.15.114:0/193097544 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a800cd8c0 0x7f3a800c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 >> 172.21.15.114:0/193097544 conn(0x7f3a800d1da0 msgr2=0x7f3a800b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:04.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 shutdown_connections 2024-09-16T07:35:04.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.189+0000 7f3a88200640 1 -- 172.21.15.114:0/193097544 wait complete. 2024-09-16T07:35:04.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create non_existent_subvolume subvolume_1 2024-09-16T07:35:04.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 -- 172.21.15.114:0/1679761158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c15f340 msgr2=0x7f316c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 --2- 172.21.15.114:0/1679761158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c15f340 0x7f316c0b34a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f316c073ef0 tx=0x7f315c01cd50 comp rx=0 tx=0).stop 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 -- 172.21.15.114:0/1679761158 shutdown_connections 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 --2- 172.21.15.114:0/1679761158 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f316c0ccf10 0x7f316c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 --2- 172.21.15.114:0/1679761158 >> v2:172.21.15.149:3300/0 conn(0x7f316c0b2a00 0x7f316c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 --2- 172.21.15.114:0/1679761158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c15f340 0x7f316c0b34a0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 -- 172.21.15.114:0/1679761158 >> 172.21.15.114:0/1679761158 conn(0x7f316c0d1e00 msgr2=0x7f316c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 -- 172.21.15.114:0/1679761158 shutdown_connections 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 -- 172.21.15.114:0/1679761158 wait complete. 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 Processor -- start 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.353+0000 7f3172c00640 1 -- start start 2024-09-16T07:35:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c0b2a00 0x7f316c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0ccf10 0x7f316c164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f316c15f340 0x7f316c164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f316c0b1a20 con 0x7f316c0ccf10 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f316c0b18a0 con 0x7f316c0b2a00 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f316c0b1ba0 con 0x7f316c15f340 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0ccf10 0x7f316c164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0ccf10 0x7f316c164680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47984/0 (socket says 172.21.15.114:47984) 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 -- 172.21.15.114:0/3580311121 learned_addr learned my addr 172.21.15.114:0/3580311121 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3170c00640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f316c15f340 0x7f316c164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f316be00640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c0b2a00 0x7f316c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 -- 172.21.15.114:0/3580311121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f316c15f340 msgr2=0x7f316c164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f316c15f340 0x7f316c164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 -- 172.21.15.114:0/3580311121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c0b2a00 msgr2=0x7f316c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f316c0b2a00 0x7f316c158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 -- 172.21.15.114:0/3580311121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c165fb0 con 0x7f316c0ccf10 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3163400640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f316c0ccf10 0x7f316c164680 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f315400d720 tx=0x7f315400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3168c00640 1 -- 172.21.15.114:0/3580311121 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154017070 con 0x7f316c0ccf10 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3168c00640 1 -- 172.21.15.114:0/3580311121 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3154004310 con 0x7f316c0ccf10 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3168c00640 1 -- 172.21.15.114:0/3580311121 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154005280 con 0x7f316c0ccf10 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 -- 172.21.15.114:0/3580311121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c165cd0 con 0x7f316c0ccf10 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 -- 172.21.15.114:0/3580311121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c0aed10 con 0x7f316c0ccf10 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3172c00640 1 -- 172.21.15.114:0/3580311121 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c0cd380 con 0x7f316c0ccf10 2024-09-16T07:35:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.357+0000 7f3168c00640 1 -- 172.21.15.114:0/3580311121 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f3154005420 con 0x7f316c0ccf10 2024-09-16T07:35:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.361+0000 7f3168c00640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3148073520 0x7f31480759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.361+0000 7f3168c00640 1 -- 172.21.15.114:0/3580311121 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f3154094d50 con 0x7f316c0ccf10 2024-09-16T07:35:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.361+0000 7f316be00640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3148073520 0x7f31480759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.361+0000 7f316be00640 1 --2- 172.21.15.114:0/3580311121 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3148073520 0x7f31480759e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f315c0af000 tx=0x7f315c01b590 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:04.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.365+0000 7f3168c00640 1 -- 172.21.15.114:0/3580311121 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3154020020 con 0x7f316c0ccf10 2024-09-16T07:35:04.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.557+0000 7f3172c00640 1 -- 172.21.15.114:0/3580311121 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f316c0d0050 con 0x7f3148073520 2024-09-16T07:35:04.559 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:04.561+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.561+0000 7f3168c00640 1 -- 172.21.15.114:0/3580311121 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f316c0d0050 con 0x7f3148073520 2024-09-16T07:35:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:04.568 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:04.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm non_existent_subvolume subvolume_1 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 -- 172.21.15.114:0/1669853213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f782015dae0 msgr2=0x7f78200acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 --2- 172.21.15.114:0/1669853213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f782015dae0 0x7f78200acd40 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f7820070d30 tx=0x7f781401c830 comp rx=0 tx=0).stop 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 -- 172.21.15.114:0/1669853213 shutdown_connections 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 --2- 172.21.15.114:0/1669853213 >> v2:172.21.15.149:3300/0 conn(0x7f78200b4810 0x7f78200ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 --2- 172.21.15.114:0/1669853213 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78200cd100 0x7f78200b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 --2- 172.21.15.114:0/1669853213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f782015dae0 0x7f78200acd40 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 -- 172.21.15.114:0/1669853213 >> 172.21.15.114:0/1669853213 conn(0x7f78200b18f0 msgr2=0x7f78200b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:04.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 -- 172.21.15.114:0/1669853213 shutdown_connections 2024-09-16T07:35:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 -- 172.21.15.114:0/1669853213 wait complete. 2024-09-16T07:35:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 Processor -- start 2024-09-16T07:35:04.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.713+0000 7f7828000640 1 -- start start 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78200b4810 0x7f782014b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78200cd100 0x7f78201634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f782015dae0 0x7f7820163a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f78200cf400 con 0x7f78200b4810 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f78200cf280 con 0x7f782015dae0 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f782006e7a0 con 0x7f78200cd100 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78200b4810 0x7f782014b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78200b4810 0x7f782014b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47996/0 (socket says 172.21.15.114:47996) 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 -- 172.21.15.114:0/1060093523 learned_addr learned my addr 172.21.15.114:0/1060093523 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7824c00640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78200cd100 0x7f78201634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7826000640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f782015dae0 0x7f7820163a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 -- 172.21.15.114:0/1060093523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78200cd100 msgr2=0x7f78201634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f78200cd100 0x7f78201634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 -- 172.21.15.114:0/1060093523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f782015dae0 msgr2=0x7f7820163a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f782015dae0 0x7f7820163a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 -- 172.21.15.114:0/1060093523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78201f8da0 con 0x7f78200b4810 2024-09-16T07:35:04.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7825600640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78200b4810 0x7f782014b6a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f78140b0040 tx=0x7f7814005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:04.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f781d600640 1 -- 172.21.15.114:0/1060093523 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78140b2040 con 0x7f78200b4810 2024-09-16T07:35:04.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f781d600640 1 -- 172.21.15.114:0/1060093523 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7814004240 con 0x7f78200b4810 2024-09-16T07:35:04.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f781d600640 1 -- 172.21.15.114:0/1060093523 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814005030 con 0x7f78200b4810 2024-09-16T07:35:04.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 -- 172.21.15.114:0/1060093523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78201f9080 con 0x7f78200b4810 2024-09-16T07:35:04.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 -- 172.21.15.114:0/1060093523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78201f9640 con 0x7f78200b4810 2024-09-16T07:35:04.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.717+0000 7f7828000640 1 -- 172.21.15.114:0/1060093523 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7820069410 con 0x7f78200b4810 2024-09-16T07:35:04.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.721+0000 7f781d600640 1 -- 172.21.15.114:0/1060093523 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f78140051d0 con 0x7f78200b4810 2024-09-16T07:35:04.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.721+0000 7f781d600640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f78000734f0 0x7f78000759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:04.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.721+0000 7f781d600640 1 -- 172.21.15.114:0/1060093523 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f781412e350 con 0x7f78200b4810 2024-09-16T07:35:04.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.721+0000 7f7824c00640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f78000734f0 0x7f78000759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:04.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.721+0000 7f7824c00640 1 --2- 172.21.15.114:0/1060093523 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f78000734f0 0x7f78000759b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7820073a20 tx=0x7f780c00b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:04.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.725+0000 7f781d600640 1 -- 172.21.15.114:0/1060093523 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f78140164b0 con 0x7f78200b4810 2024-09-16T07:35:04.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.921+0000 7f7828000640 1 -- 172.21.15.114:0/1060093523 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f78200cc440 con 0x7f78000734f0 2024-09-16T07:35:04.919 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:04.921+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:04.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:04.921+0000 7f781d600640 1 -- 172.21.15.114:0/1060093523 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f78200cc440 con 0x7f78000734f0 2024-09-16T07:35:04.920 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:04.928 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:04.929 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath non_existent_subvolume subvolume_1 2024-09-16T07:35:05.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 -- 172.21.15.114:0/2240651056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895815bd50 msgr2=0x7f89580ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 --2- 172.21.15.114:0/2240651056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895815bd50 0x7f89580ce5e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f895806d870 tx=0x7f894c01c7a0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 -- 172.21.15.114:0/2240651056 shutdown_connections 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 --2- 172.21.15.114:0/2240651056 >> v2:172.21.15.149:3300/0 conn(0x7f895815c130 0x7f89580ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 --2- 172.21.15.114:0/2240651056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895815bd50 0x7f89580ce5e0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 -- 172.21.15.114:0/2240651056 >> 172.21.15.114:0/2240651056 conn(0x7f89580d1ea0 msgr2=0x7f89580d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 -- 172.21.15.114:0/2240651056 shutdown_connections 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.073+0000 7f895fe00640 1 -- 172.21.15.114:0/2240651056 wait complete. 2024-09-16T07:35:05.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 Processor -- start 2024-09-16T07:35:05.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 -- start start 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89580cf4e0 0x7f895806e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895815bd50 0x7f89580c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f895815c130 0x7f89580caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8958168e50 con 0x7f895815bd50 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8958168cd0 con 0x7f895815c130 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8958168fd0 con 0x7f89580cf4e0 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895815bd50 0x7f89580c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895815bd50 0x7f89580c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48008/0 (socket says 172.21.15.114:48008) 2024-09-16T07:35:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 -- 172.21.15.114:0/632291809 learned_addr learned my addr 172.21.15.114:0/632291809 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 -- 172.21.15.114:0/632291809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89580cf4e0 msgr2=0x7f895806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89580cf4e0 0x7f895806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 -- 172.21.15.114:0/632291809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f895815c130 msgr2=0x7f89580caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895de00640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f895815c130 0x7f89580caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f895815c130 0x7f89580caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 -- 172.21.15.114:0/632291809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895806f040 con 0x7f895815bd50 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895de00640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f895815c130 0x7f89580caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895ca00640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f895815bd50 0x7f89580c91d0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f894400b3f0 tx=0x7f894400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f8955600640 1 -- 172.21.15.114:0/632291809 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944015020 con 0x7f895815bd50 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f8955600640 1 -- 172.21.15.114:0/632291809 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8944011920 con 0x7f895815bd50 2024-09-16T07:35:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f8955600640 1 -- 172.21.15.114:0/632291809 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944011d70 con 0x7f895815bd50 2024-09-16T07:35:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 -- 172.21.15.114:0/632291809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895806f320 con 0x7f895815bd50 2024-09-16T07:35:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.077+0000 7f895fe00640 1 -- 172.21.15.114:0/632291809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8958156500 con 0x7f895815bd50 2024-09-16T07:35:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.081+0000 7f895fe00640 1 -- 172.21.15.114:0/632291809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89580c5dd0 con 0x7f895815bd50 2024-09-16T07:35:05.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.081+0000 7f8955600640 1 -- 172.21.15.114:0/632291809 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f8944018020 con 0x7f895815bd50 2024-09-16T07:35:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.081+0000 7f8955600640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8938073520 0x7f89380759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.081+0000 7f8955600640 1 -- 172.21.15.114:0/632291809 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f8944094a70 con 0x7f895815bd50 2024-09-16T07:35:05.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.081+0000 7f895d400640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8938073520 0x7f89380759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.081+0000 7f895d400640 1 --2- 172.21.15.114:0/632291809 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8938073520 0x7f89380759e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f894c0af000 tx=0x7f894c019540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.085+0000 7f8955600640 1 -- 172.21.15.114:0/632291809 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f894401f020 con 0x7f895815bd50 2024-09-16T07:35:05.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.277+0000 7f895fe00640 1 -- 172.21.15.114:0/632291809 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f89580cfcf0 con 0x7f8938073520 2024-09-16T07:35:05.277 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:05.277+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:05.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.277+0000 7f8955600640 1 -- 172.21.15.114:0/632291809 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f89580cfcf0 con 0x7f8938073520 2024-09-16T07:35:05.277 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:05.287 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:05.287 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info non_existent_subvolume subvolume_1 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 -- 172.21.15.114:0/4063315722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc0afb10 msgr2=0x7fd0dc0affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 --2- 172.21.15.114:0/4063315722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc0afb10 0x7fd0dc0affc0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc073810 tx=0x7fd0d401cb80 comp rx=0 tx=0).stop 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 -- 172.21.15.114:0/4063315722 shutdown_connections 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 --2- 172.21.15.114:0/4063315722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc0afb10 0x7fd0dc0affc0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 --2- 172.21.15.114:0/4063315722 >> v2:172.21.15.149:3300/0 conn(0x7fd0dc1605d0 0x7fd0dc0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 -- 172.21.15.114:0/4063315722 >> 172.21.15.114:0/4063315722 conn(0x7fd0dc0d1dd0 msgr2=0x7fd0dc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 -- 172.21.15.114:0/4063315722 shutdown_connections 2024-09-16T07:35:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 -- 172.21.15.114:0/4063315722 wait complete. 2024-09-16T07:35:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 Processor -- start 2024-09-16T07:35:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.433+0000 7fd0e3000640 1 -- start start 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc0afb10 0x7fd0dc0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc0b1650 0x7fd0dc1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0dc1605d0 0x7fd0dc166160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc169540 con 0x7fd0dc0afb10 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc0b1430 con 0x7fd0dc0b1650 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd0dc1696c0 con 0x7fd0dc1605d0 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc0afb10 0x7fd0dc0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc0afb10 0x7fd0dc0c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48014/0 (socket says 172.21.15.114:48014) 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 -- 172.21.15.114:0/4225977739 learned_addr learned my addr 172.21.15.114:0/4225977739 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0d3400640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc0b1650 0x7fd0dc1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e1000640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0dc1605d0 0x7fd0dc166160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 -- 172.21.15.114:0/4225977739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0dc1605d0 msgr2=0x7fd0dc166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0dc1605d0 0x7fd0dc166160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 -- 172.21.15.114:0/4225977739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc0b1650 msgr2=0x7fd0dc1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0dc0b1650 0x7fd0dc1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 -- 172.21.15.114:0/4225977739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc1fb700 con 0x7fd0dc0afb10 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0dbe00640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0dc0afb10 0x7fd0dc0c4c40 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00e7a0 tx=0x7fd0cc00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0d8c00640 1 -- 172.21.15.114:0/4225977739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc00ccc0 con 0x7fd0dc0afb10 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0d8c00640 1 -- 172.21.15.114:0/4225977739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0cc010430 con 0x7fd0dc0afb10 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0d8c00640 1 -- 172.21.15.114:0/4225977739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc010860 con 0x7fd0dc0afb10 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 -- 172.21.15.114:0/4225977739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc1fb9e0 con 0x7fd0dc0afb10 2024-09-16T07:35:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 -- 172.21.15.114:0/4225977739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc1fbfa0 con 0x7fd0dc0afb10 2024-09-16T07:35:05.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0e3000640 1 -- 172.21.15.114:0/4225977739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc0affc0 con 0x7fd0dc0afb10 2024-09-16T07:35:05.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.437+0000 7fd0d8c00640 1 -- 172.21.15.114:0/4225977739 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fd0cc010a00 con 0x7fd0dc0afb10 2024-09-16T07:35:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.441+0000 7fd0d8c00640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd0b80734f0 0x7fd0b80759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.441+0000 7fd0d8c00640 1 -- 172.21.15.114:0/4225977739 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fd0cc095490 con 0x7fd0dc0afb10 2024-09-16T07:35:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.441+0000 7fd0d3400640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd0b80734f0 0x7fd0b80759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.441+0000 7fd0d3400640 1 --2- 172.21.15.114:0/4225977739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd0b80734f0 0x7fd0b80759b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0d28c0 tx=0x7fd0c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:05.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.445+0000 7fd0d8c00640 1 -- 172.21.15.114:0/4225977739 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd0cc05fcc0 con 0x7fd0dc0afb10 2024-09-16T07:35:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.637+0000 7fd0e3000640 1 -- 172.21.15.114:0/4225977739 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7fd0dc0b45f0 con 0x7fd0b80734f0 2024-09-16T07:35:05.639 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:05.641+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.641+0000 7fd0d8c00640 1 -- 172.21.15.114:0/4225977739 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fd0dc0b45f0 con 0x7fd0b80734f0 2024-09-16T07:35:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:05.648 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:05.649 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize non_existent_subvolume subvolname_1 inf 2024-09-16T07:35:05.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.793+0000 7fc5d0e00640 1 -- 172.21.15.114:0/1868246548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5cc0cf440 msgr2=0x7fc5cc0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.793+0000 7fc5d0e00640 1 --2- 172.21.15.114:0/1868246548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5cc0cf440 0x7fc5cc0ce350 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc051480 tx=0x7fc5b401c890 comp rx=0 tx=0).stop 2024-09-16T07:35:05.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.793+0000 7fc5d0e00640 1 -- 172.21.15.114:0/1868246548 shutdown_connections 2024-09-16T07:35:05.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.793+0000 7fc5d0e00640 1 --2- 172.21.15.114:0/1868246548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5cc0cf440 0x7fc5cc0ce350 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.793+0000 7fc5d0e00640 1 --2- 172.21.15.114:0/1868246548 >> v2:172.21.15.149:3300/0 conn(0x7fc5cc0734f0 0x7fc5cc15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.793+0000 7fc5d0e00640 1 -- 172.21.15.114:0/1868246548 >> 172.21.15.114:0/1868246548 conn(0x7fc5cc0cfbc0 msgr2=0x7fc5cc0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:05.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 -- 172.21.15.114:0/1868246548 shutdown_connections 2024-09-16T07:35:05.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 -- 172.21.15.114:0/1868246548 wait complete. 2024-09-16T07:35:05.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 Processor -- start 2024-09-16T07:35:05.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 -- start start 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5cc0734f0 0x7fc5cc0acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5cc0ce890 0x7fc5cc0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5cc0cf440 0x7fc5cc1447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc167a30 con 0x7fc5cc0ce890 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5cc1678b0 con 0x7fc5cc0cf440 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5cc167bb0 con 0x7fc5cc0734f0 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5cc0ce890 0x7fc5cc0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5cc0ce890 0x7fc5cc0b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48032/0 (socket says 172.21.15.114:48032) 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 -- 172.21.15.114:0/2558239383 learned_addr learned my addr 172.21.15.114:0/2558239383 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c9e00640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5cc0734f0 0x7fc5cc0acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5ca800640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5cc0cf440 0x7fc5cc1447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 -- 172.21.15.114:0/2558239383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5cc0734f0 msgr2=0x7fc5cc0acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5cc0734f0 0x7fc5cc0acfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 -- 172.21.15.114:0/2558239383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5cc0cf440 msgr2=0x7fc5cc1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc5cc0cf440 0x7fc5cc1447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 -- 172.21.15.114:0/2558239383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc144ce0 con 0x7fc5cc0ce890 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c1400640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5cc0ce890 0x7fc5cc0b40c0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40b0040 tx=0x7fc5b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c2a00640 1 -- 172.21.15.114:0/2558239383 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b40b2040 con 0x7fc5cc0ce890 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c2a00640 1 -- 172.21.15.114:0/2558239383 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5b4003600 con 0x7fc5cc0ce890 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5c2a00640 1 -- 172.21.15.114:0/2558239383 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4003a30 con 0x7fc5cc0ce890 2024-09-16T07:35:05.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.797+0000 7fc5d0e00640 1 -- 172.21.15.114:0/2558239383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5cc0b4810 con 0x7fc5cc0ce890 2024-09-16T07:35:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.801+0000 7fc5d0e00640 1 -- 172.21.15.114:0/2558239383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5cc0b4dd0 con 0x7fc5cc0ce890 2024-09-16T07:35:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.801+0000 7fc5d0e00640 1 -- 172.21.15.114:0/2558239383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5cc069410 con 0x7fc5cc0ce890 2024-09-16T07:35:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.801+0000 7fc5c2a00640 1 -- 172.21.15.114:0/2558239383 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7fc5b4003bd0 con 0x7fc5cc0ce890 2024-09-16T07:35:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.801+0000 7fc5c2a00640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5a80734f0 0x7fc5a80759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.801+0000 7fc5c2a00640 1 -- 172.21.15.114:0/2558239383 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fc5b412e690 con 0x7fc5cc0ce890 2024-09-16T07:35:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.801+0000 7fc5c9e00640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5a80734f0 0x7fc5a80759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.805+0000 7fc5c9e00640 1 --2- 172.21.15.114:0/2558239383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc5a80734f0 0x7fc5a80759b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc005fd0 tx=0x7fc5bc005db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:05.805+0000 7fc5c2a00640 1 -- 172.21.15.114:0/2558239383 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc5b40164b0 con 0x7fc5cc0ce890 2024-09-16T07:35:06.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.009+0000 7fc5d0e00640 1 -- 172.21.15.114:0/2558239383 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "new_size": "inf", "target": ["mon-mgr", ""]}) -- 0x7fc5cc15a9d0 con 0x7fc5a80734f0 2024-09-16T07:35:06.007 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:06.009+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:06.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.009+0000 7fc5c2a00640 1 -- 172.21.15.114:0/2558239383 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fc5cc15a9d0 con 0x7fc5a80734f0 2024-09-16T07:35:06.008 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:06.017 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:06.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume pin non_existent_subvolume subvolname_1 export 1 2024-09-16T07:35:06.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.165+0000 7f9a50e00640 1 -- 172.21.15.114:0/4277653191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a30004810 msgr2=0x7f9a30004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.165+0000 7f9a50e00640 1 --2- 172.21.15.114:0/4277653191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a30004810 0x7f9a30004c90 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009b60 tx=0x7f9a3401d240 comp rx=0 tx=0).stop 2024-09-16T07:35:06.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.165+0000 7f9a50e00640 1 -- 172.21.15.114:0/4277653191 shutdown_connections 2024-09-16T07:35:06.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.165+0000 7f9a50e00640 1 --2- 172.21.15.114:0/4277653191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a30004810 0x7f9a30004c90 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.165+0000 7f9a50e00640 1 -- 172.21.15.114:0/4277653191 >> 172.21.15.114:0/4277653191 conn(0x7f9a4c06dd30 msgr2=0x7f9a4c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:06.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.165+0000 7f9a50e00640 1 -- 172.21.15.114:0/4277653191 shutdown_connections 2024-09-16T07:35:06.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.165+0000 7f9a50e00640 1 -- 172.21.15.114:0/4277653191 wait complete. 2024-09-16T07:35:06.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 Processor -- start 2024-09-16T07:35:06.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 -- start start 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a30004810 0x7f9a4c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c0708c0 0x7f9a4c150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4c150ff0 0x7f9a4c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c0afff0 con 0x7f9a4c0708c0 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c0afe70 con 0x7f9a30004810 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4c0b0170 con 0x7f9a4c150ff0 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c0708c0 0x7f9a4c150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c0708c0 0x7f9a4c150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48056/0 (socket says 172.21.15.114:48056) 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 -- 172.21.15.114:0/622957467 learned_addr learned my addr 172.21.15.114:0/622957467 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:06.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a49e00640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a30004810 0x7f9a4c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a4a800640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4c150ff0 0x7f9a4c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 -- 172.21.15.114:0/622957467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4c150ff0 msgr2=0x7f9a4c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9a4c150ff0 0x7f9a4c154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 -- 172.21.15.114:0/622957467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a30004810 msgr2=0x7f9a4c071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a30004810 0x7f9a4c071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 -- 172.21.15.114:0/622957467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c071560 con 0x7f9a4c0708c0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a49e00640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a30004810 0x7f9a4c071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a41400640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a4c0708c0 0x7f9a4c150ab0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f9a3401d070 tx=0x7f9a34005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a42a00640 1 -- 172.21.15.114:0/622957467 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a340b1040 con 0x7f9a4c0708c0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a42a00640 1 -- 172.21.15.114:0/622957467 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a34004120 con 0x7f9a4c0708c0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a42a00640 1 -- 172.21.15.114:0/622957467 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a340ac7b0 con 0x7f9a4c0708c0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 -- 172.21.15.114:0/622957467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c14f210 con 0x7f9a4c0708c0 2024-09-16T07:35:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.169+0000 7f9a50e00640 1 -- 172.21.15.114:0/622957467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c1f87a0 con 0x7f9a4c0708c0 2024-09-16T07:35:06.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.173+0000 7f9a50e00640 1 -- 172.21.15.114:0/622957467 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4c0b0690 con 0x7f9a4c0708c0 2024-09-16T07:35:06.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.173+0000 7f9a42a00640 1 -- 172.21.15.114:0/622957467 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f9a340ac950 con 0x7f9a4c0708c0 2024-09-16T07:35:06.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.173+0000 7f9a42a00640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a280734f0 0x7f9a280759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.173+0000 7f9a42a00640 1 -- 172.21.15.114:0/622957467 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f9a3412f910 con 0x7f9a4c0708c0 2024-09-16T07:35:06.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.173+0000 7f9a49e00640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a280734f0 0x7f9a280759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.173+0000 7f9a49e00640 1 --2- 172.21.15.114:0/622957467 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a280734f0 0x7f9a280759b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c001a40 tx=0x7f9a3c001030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:06.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.177+0000 7f9a42a00640 1 -- 172.21.15.114:0/622957467 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9a340a5e20 con 0x7f9a4c0708c0 2024-09-16T07:35:06.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.377+0000 7f9a50e00640 1 -- 172.21.15.114:0/622957467 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume pin", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "pin_type": "export", "pin_setting": "1", "target": ["mon-mgr", ""]}) -- 0x7f9a4c157060 con 0x7f9a280734f0 2024-09-16T07:35:06.377 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:06.377+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:06.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.377+0000 7f9a42a00640 1 -- 172.21.15.114:0/622957467 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f9a4c157060 con 0x7f9a280734f0 2024-09-16T07:35:06.377 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:06.387 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:06.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls non_existent_subvolume 2024-09-16T07:35:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 -- 172.21.15.114:0/2220458472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20c00708c0 msgr2=0x7f20c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 --2- 172.21.15.114:0/2220458472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20c00708c0 0x7f20c0068960 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f20c00c7650 tx=0x7f20b401c8c0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 -- 172.21.15.114:0/2220458472 shutdown_connections 2024-09-16T07:35:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 --2- 172.21.15.114:0/2220458472 >> v2:172.21.15.149:3300/0 conn(0x7f20c0070ca0 0x7f20c00c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 --2- 172.21.15.114:0/2220458472 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20c015c290 0x7f20c00c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 --2- 172.21.15.114:0/2220458472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20c00708c0 0x7f20c0068960 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 -- 172.21.15.114:0/2220458472 >> 172.21.15.114:0/2220458472 conn(0x7f20c0071420 msgr2=0x7f20c006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 -- 172.21.15.114:0/2220458472 shutdown_connections 2024-09-16T07:35:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.533+0000 7f20c7c00640 1 -- 172.21.15.114:0/2220458472 wait complete. 2024-09-16T07:35:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 Processor -- start 2024-09-16T07:35:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 -- start start 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20c00708c0 0x7f20c0148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20c0070ca0 0x7f20c014e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20c015c290 0x7f20c014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f20c015fd80 con 0x7f20c00708c0 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20c015fc00 con 0x7f20c0070ca0 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f20c015ff00 con 0x7f20c015c290 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20c00708c0 0x7f20c0148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20c00708c0 0x7f20c0148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48064/0 (socket says 172.21.15.114:48064) 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 -- 172.21.15.114:0/1861898196 learned_addr learned my addr 172.21.15.114:0/1861898196 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5c00640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20c015c290 0x7f20c014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20bfe00640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20c0070ca0 0x7f20c014e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 -- 172.21.15.114:0/1861898196 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20c015c290 msgr2=0x7f20c014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f20c015c290 0x7f20c014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 -- 172.21.15.114:0/1861898196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20c0070ca0 msgr2=0x7f20c014e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20c0070ca0 0x7f20c014e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 -- 172.21.15.114:0/1861898196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c01597f0 con 0x7f20c00708c0 2024-09-16T07:35:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c5200640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20c00708c0 0x7f20c0148bf0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f20b40b0040 tx=0x7f20b40a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:06.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20bcc00640 1 -- 172.21.15.114:0/1861898196 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b40b2040 con 0x7f20c00708c0 2024-09-16T07:35:06.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20bcc00640 1 -- 172.21.15.114:0/1861898196 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20b4004380 con 0x7f20c00708c0 2024-09-16T07:35:06.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 -- 172.21.15.114:0/1861898196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c0159ad0 con 0x7f20c00708c0 2024-09-16T07:35:06.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20bcc00640 1 -- 172.21.15.114:0/1861898196 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b40052d0 con 0x7f20c00708c0 2024-09-16T07:35:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 -- 172.21.15.114:0/1861898196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c014f450 con 0x7f20c00708c0 2024-09-16T07:35:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.537+0000 7f20c7c00640 1 -- 172.21.15.114:0/1861898196 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c01603f0 con 0x7f20c00708c0 2024-09-16T07:35:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.541+0000 7f20bcc00640 1 -- 172.21.15.114:0/1861898196 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f20b4005470 con 0x7f20c00708c0 2024-09-16T07:35:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.541+0000 7f20bcc00640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20a00734f0 0x7f20a00759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.541+0000 7f20bcc00640 1 -- 172.21.15.114:0/1861898196 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f20b412e540 con 0x7f20c00708c0 2024-09-16T07:35:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.541+0000 7f20bfe00640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20a00734f0 0x7f20a00759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.541+0000 7f20bfe00640 1 --2- 172.21.15.114:0/1861898196 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f20a00734f0 0x7f20a00759b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0058d0 tx=0x7f20ac005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:06.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.545+0000 7f20bcc00640 1 -- 172.21.15.114:0/1861898196 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f20b40164b0 con 0x7f20c00708c0 2024-09-16T07:35:06.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.733+0000 7f20c7c00640 1 -- 172.21.15.114:0/1861898196 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7f20c015bee0 con 0x7f20a00734f0 2024-09-16T07:35:06.734 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:06.737+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:06.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.737+0000 7f20bcc00640 1 -- 172.21.15.114:0/1861898196 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f20c015bee0 con 0x7f20a00734f0 2024-09-16T07:35:06.734 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:06.743 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:06.744 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create non_existent_subvolume subvolume_1 snapshot_1 2024-09-16T07:35:06.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 -- 172.21.15.114:0/1876801149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6940003a10 msgr2=0x7f6940003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 --2- 172.21.15.114:0/1876801149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6940003a10 0x7f6940003e30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f694c009b60 tx=0x7f694c01d270 comp rx=0 tx=0).stop 2024-09-16T07:35:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f695be00640 1 -- 172.21.15.114:0/1876801149 reap_dead start 2024-09-16T07:35:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 -- 172.21.15.114:0/1876801149 shutdown_connections 2024-09-16T07:35:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 -- 172.21.15.114:0/1876801149 >> 172.21.15.114:0/1876801149 conn(0x7f695c0cfbc0 msgr2=0x7f695c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 -- 172.21.15.114:0/1876801149 shutdown_connections 2024-09-16T07:35:06.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 -- 172.21.15.114:0/1876801149 wait complete. 2024-09-16T07:35:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 Processor -- start 2024-09-16T07:35:06.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.893+0000 7f6962400640 1 -- start start 2024-09-16T07:35:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6940003a10 0x7f695c1f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c154150 0x7f695c1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f695c15bd50 0x7f695c15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f695c0ce4d0 con 0x7f6940003a10 2024-09-16T07:35:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f695c0ce350 con 0x7f695c154150 2024-09-16T07:35:06.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f695c0ce650 con 0x7f695c15bd50 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6940003a10 0x7f695c1f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6940003a10 0x7f695c1f6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48072/0 (socket says 172.21.15.114:48072) 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 -- 172.21.15.114:0/556585899 learned_addr learned my addr 172.21.15.114:0/556585899 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695be00640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f695c15bd50 0x7f695c15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6952a00640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c154150 0x7f695c1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 -- 172.21.15.114:0/556585899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f695c15bd50 msgr2=0x7f695c15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f695c15bd50 0x7f695c15c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 -- 172.21.15.114:0/556585899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c154150 msgr2=0x7f695c1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f695c154150 0x7f695c1537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:06.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 -- 172.21.15.114:0/556585899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c159880 con 0x7f6940003a10 2024-09-16T07:35:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f695b400640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6940003a10 0x7f695c1f6db0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f694c01d0a0 tx=0x7f694c005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6953e00640 1 -- 172.21.15.114:0/556585899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c0b1040 con 0x7f6940003a10 2024-09-16T07:35:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6953e00640 1 -- 172.21.15.114:0/556585899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f694c0ac400 con 0x7f6940003a10 2024-09-16T07:35:06.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6953e00640 1 -- 172.21.15.114:0/556585899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c004290 con 0x7f6940003a10 2024-09-16T07:35:06.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 -- 172.21.15.114:0/556585899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f695c153d20 con 0x7f6940003a10 2024-09-16T07:35:06.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 -- 172.21.15.114:0/556585899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695c1f7390 con 0x7f6940003a10 2024-09-16T07:35:06.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.897+0000 7f6962400640 1 -- 172.21.15.114:0/556585899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695c0cebe0 con 0x7f6940003a10 2024-09-16T07:35:06.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.901+0000 7f6953e00640 1 -- 172.21.15.114:0/556585899 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f694c0bd020 con 0x7f6940003a10 2024-09-16T07:35:06.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.901+0000 7f6953e00640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6938073520 0x7f69380759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:06.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.901+0000 7f6953e00640 1 -- 172.21.15.114:0/556585899 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f694c12efb0 con 0x7f6940003a10 2024-09-16T07:35:06.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.901+0000 7f6952a00640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6938073520 0x7f69380759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:06.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.901+0000 7f6952a00640 1 --2- 172.21.15.114:0/556585899 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6938073520 0x7f69380759e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f695c0ccdb0 tx=0x7f6944001ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:06.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:06.905+0000 7f6953e00640 1 -- 172.21.15.114:0/556585899 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f694c0c4020 con 0x7f6940003a10 2024-09-16T07:35:07.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.101+0000 7f6962400640 1 -- 172.21.15.114:0/556585899 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f695c0d0850 con 0x7f6938073520 2024-09-16T07:35:07.099 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:07.101+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.101+0000 7f6953e00640 1 -- 172.21.15.114:0/556585899 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f695c0d0850 con 0x7f6938073520 2024-09-16T07:35:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:07.107 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:07.108 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm non_existent_subvolume subvolume_1 snapshot_1 2024-09-16T07:35:07.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- 172.21.15.114:0/223021695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c015aca0 msgr2=0x7f73c0073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 --2- 172.21.15.114:0/223021695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c015aca0 0x7f73c0073120 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f73c00cf760 tx=0x7f73ac01c600 comp rx=0 tx=0).stop 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- 172.21.15.114:0/223021695 shutdown_connections 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 --2- 172.21.15.114:0/223021695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c015aca0 0x7f73c0073120 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 --2- 172.21.15.114:0/223021695 >> v2:172.21.15.149:3300/0 conn(0x7f73c0073660 0x7f73c00ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 --2- 172.21.15.114:0/223021695 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73c015a8c0 0x7f73c015f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- 172.21.15.114:0/223021695 >> 172.21.15.114:0/223021695 conn(0x7f73c00b2140 msgr2=0x7f73c00b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- 172.21.15.114:0/223021695 shutdown_connections 2024-09-16T07:35:07.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- 172.21.15.114:0/223021695 wait complete. 2024-09-16T07:35:07.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 Processor -- start 2024-09-16T07:35:07.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- start start 2024-09-16T07:35:07.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c0073660 0x7f73c00d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73c015a8c0 0x7f73c0147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c015aca0 0x7f73c015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f73c00700f0 con 0x7f73c015aca0 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f73c006ff70 con 0x7f73c0073660 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73c5400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f73c0070270 con 0x7f73c015a8c0 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c015aca0 0x7f73c015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c015aca0 0x7f73c015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48082/0 (socket says 172.21.15.114:48082) 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 -- 172.21.15.114:0/2486340971 learned_addr learned my addr 172.21.15.114:0/2486340971 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bde00640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73c015a8c0 0x7f73c0147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73be800640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c0073660 0x7f73c00d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 -- 172.21.15.114:0/2486340971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73c015a8c0 msgr2=0x7f73c0147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73c015a8c0 0x7f73c0147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 -- 172.21.15.114:0/2486340971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c0073660 msgr2=0x7f73c00d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73c0073660 0x7f73c00d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.257+0000 7f73bf200640 1 -- 172.21.15.114:0/2486340971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c014ce40 con 0x7f73c015aca0 2024-09-16T07:35:07.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73bf200640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f73c015aca0 0x7f73c015d730 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f73b800cce0 tx=0x7f73b800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:07.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73b6a00640 1 -- 172.21.15.114:0/2486340971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800f450 con 0x7f73c015aca0 2024-09-16T07:35:07.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73b6a00640 1 -- 172.21.15.114:0/2486340971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73b800f700 con 0x7f73c015aca0 2024-09-16T07:35:07.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73b6a00640 1 -- 172.21.15.114:0/2486340971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800fb50 con 0x7f73c015aca0 2024-09-16T07:35:07.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73c5400640 1 -- 172.21.15.114:0/2486340971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c014d120 con 0x7f73c015aca0 2024-09-16T07:35:07.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73c5400640 1 -- 172.21.15.114:0/2486340971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c014d6e0 con 0x7f73c015aca0 2024-09-16T07:35:07.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73c5400640 1 -- 172.21.15.114:0/2486340971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c0154250 con 0x7f73c015aca0 2024-09-16T07:35:07.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73b6a00640 1 -- 172.21.15.114:0/2486340971 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f73b800fcf0 con 0x7f73c015aca0 2024-09-16T07:35:07.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73b6a00640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f73a00734f0 0x7f73a00759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73b6a00640 1 -- 172.21.15.114:0/2486340971 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f73b8095620 con 0x7f73c015aca0 2024-09-16T07:35:07.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.261+0000 7f73be800640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f73a00734f0 0x7f73a00759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.265+0000 7f73be800640 1 --2- 172.21.15.114:0/2486340971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f73a00734f0 0x7f73a00759b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f73b0006fd0 tx=0x7f73b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:07.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.265+0000 7f73b6a00640 1 -- 172.21.15.114:0/2486340971 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f73b8014030 con 0x7f73c015aca0 2024-09-16T07:35:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.465+0000 7f73c5400640 1 -- 172.21.15.114:0/2486340971 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f73c014cbf0 con 0x7f73a00734f0 2024-09-16T07:35:07.466 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:07.469+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.469+0000 7f73b6a00640 1 -- 172.21.15.114:0/2486340971 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f73c014cbf0 con 0x7f73a00734f0 2024-09-16T07:35:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:07.474 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:07.475 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info non_existent_subvolume subvolume_1 snapshot_1 2024-09-16T07:35:07.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 -- 172.21.15.114:0/2100060977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b7c003a10 msgr2=0x7f5b7c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 --2- 172.21.15.114:0/2100060977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b7c003a10 0x7f5b7c003e30 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009ee0 tx=0x7f5b8801d5f0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b96800640 1 -- 172.21.15.114:0/2100060977 reap_dead start 2024-09-16T07:35:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 -- 172.21.15.114:0/2100060977 shutdown_connections 2024-09-16T07:35:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 -- 172.21.15.114:0/2100060977 >> 172.21.15.114:0/2100060977 conn(0x7f5b980cfbc0 msgr2=0x7f5b980cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 -- 172.21.15.114:0/2100060977 shutdown_connections 2024-09-16T07:35:07.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 -- 172.21.15.114:0/2100060977 wait complete. 2024-09-16T07:35:07.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 Processor -- start 2024-09-16T07:35:07.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 -- start start 2024-09-16T07:35:07.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b7c003a10 0x7f5b9809d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b98154390 0x7f5b980adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b98153750 0x7f5b98153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.625+0000 7f5b9d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9815edc0 con 0x7f5b98153750 2024-09-16T07:35:07.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b9d200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9815ec40 con 0x7f5b7c003a10 2024-09-16T07:35:07.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b9d200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b98165350 con 0x7f5b98154390 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b98153750 0x7f5b98153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b98153750 0x7f5b98153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48098/0 (socket says 172.21.15.114:48098) 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 -- 172.21.15.114:0/4055491309 learned_addr learned my addr 172.21.15.114:0/4055491309 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b95e00640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b7c003a10 0x7f5b9809d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b8d400640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b98154390 0x7f5b980adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 -- 172.21.15.114:0/4055491309 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b98154390 msgr2=0x7f5b980adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b98154390 0x7f5b980adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 -- 172.21.15.114:0/4055491309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b7c003a10 msgr2=0x7f5b9809d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b7c003a10 0x7f5b9809d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 -- 172.21.15.114:0/4055491309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b98154be0 con 0x7f5b98153750 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b96800640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b98153750 0x7f5b98153b90 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f5b980d0c70 tx=0x7f5b900039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b8ea00640 1 -- 172.21.15.114:0/4055491309 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90011840 con 0x7f5b98153750 2024-09-16T07:35:07.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b8ea00640 1 -- 172.21.15.114:0/4055491309 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b90018070 con 0x7f5b98153750 2024-09-16T07:35:07.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b8ea00640 1 -- 172.21.15.114:0/4055491309 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90011ca0 con 0x7f5b98153750 2024-09-16T07:35:07.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b9d200640 1 -- 172.21.15.114:0/4055491309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9809dd40 con 0x7f5b98153750 2024-09-16T07:35:07.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b9d200640 1 -- 172.21.15.114:0/4055491309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b981f8fe0 con 0x7f5b98153750 2024-09-16T07:35:07.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b9d200640 1 -- 172.21.15.114:0/4055491309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b98069410 con 0x7f5b98153750 2024-09-16T07:35:07.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.629+0000 7f5b8ea00640 1 -- 172.21.15.114:0/4055491309 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f5b9001d460 con 0x7f5b98153750 2024-09-16T07:35:07.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.633+0000 7f5b8ea00640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b74073520 0x7f5b740759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.633+0000 7f5b8ea00640 1 -- 172.21.15.114:0/4055491309 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f5b900951c0 con 0x7f5b98153750 2024-09-16T07:35:07.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.633+0000 7f5b95e00640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b74073520 0x7f5b740759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.633+0000 7f5b95e00640 1 --2- 172.21.15.114:0/4055491309 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b74073520 0x7f5b740759e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5b880af000 tx=0x7f5b880b4040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:07.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.637+0000 7f5b8ea00640 1 -- 172.21.15.114:0/4055491309 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5b9005f8d0 con 0x7f5b98153750 2024-09-16T07:35:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.829+0000 7f5b9d200640 1 -- 172.21.15.114:0/4055491309 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f5b980b16d0 con 0x7f5b74073520 2024-09-16T07:35:07.831 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:07.833+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:07.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.833+0000 7f5b8ea00640 1 -- 172.21.15.114:0/4055491309 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f5b980b16d0 con 0x7f5b74073520 2024-09-16T07:35:07.831 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:07.840 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:07.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot protect non_existent_subvolume subvolume_1 snapshot_1 2024-09-16T07:35:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 -- 172.21.15.114:0/581329178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815be10 msgr2=0x7f87080ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 --2- 172.21.15.114:0/581329178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815be10 0x7f87080ce700 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009900 tx=0x7f86fc01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 -- 172.21.15.114:0/581329178 shutdown_connections 2024-09-16T07:35:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 --2- 172.21.15.114:0/581329178 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87080b0b60 0x7f87080ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 --2- 172.21.15.114:0/581329178 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f870815be10 0x7f87080ce700 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 -- 172.21.15.114:0/581329178 >> 172.21.15.114:0/581329178 conn(0x7f87080d1da0 msgr2=0x7f87080d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 -- 172.21.15.114:0/581329178 shutdown_connections 2024-09-16T07:35:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 -- 172.21.15.114:0/581329178 wait complete. 2024-09-16T07:35:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 Processor -- start 2024-09-16T07:35:07.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.989+0000 7f870fe00640 1 -- start start 2024-09-16T07:35:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080b0b60 0x7f87081556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f870815be10 0x7f87080c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f870815c1f0 0x7f87080c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8708169040 con 0x7f87080b0b60 2024-09-16T07:35:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8708168ec0 con 0x7f870815be10 2024-09-16T07:35:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f87081691c0 con 0x7f870815c1f0 2024-09-16T07:35:07.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080b0b60 0x7f87081556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080b0b60 0x7f87081556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48120/0 (socket says 172.21.15.114:48120) 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 -- 172.21.15.114:0/2192998781 learned_addr learned my addr 172.21.15.114:0/2192998781 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870de00640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f870815c1f0 0x7f87080c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870ca00640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f870815be10 0x7f87080c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 -- 172.21.15.114:0/2192998781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f870815c1f0 msgr2=0x7f87080c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f870815c1f0 0x7f87080c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 -- 172.21.15.114:0/2192998781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f870815be10 msgr2=0x7f87080c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f870815be10 0x7f87080c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 -- 172.21.15.114:0/2192998781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87080c6a10 con 0x7f87080b0b60 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870d400640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87080b0b60 0x7f87081556a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009850 tx=0x7f86fc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f8705600640 1 -- 172.21.15.114:0/2192998781 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0b2040 con 0x7f87080b0b60 2024-09-16T07:35:07.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f8705600640 1 -- 172.21.15.114:0/2192998781 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86fc005070 con 0x7f87080b0b60 2024-09-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f8705600640 1 -- 172.21.15.114:0/2192998781 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0044f0 con 0x7f87080b0b60 2024-09-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 -- 172.21.15.114:0/2192998781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87080c6cf0 con 0x7f87080b0b60 2024-09-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 -- 172.21.15.114:0/2192998781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87080c6fd0 con 0x7f87080b0b60 2024-09-16T07:35:07.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f870fe00640 1 -- 172.21.15.114:0/2192998781 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87080ccbd0 con 0x7f87080b0b60 2024-09-16T07:35:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.993+0000 7f8705600640 1 -- 172.21.15.114:0/2192998781 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f86fc005480 con 0x7f87080b0b60 2024-09-16T07:35:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.997+0000 7f8705600640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86e80734f0 0x7f86e80759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.997+0000 7f8705600640 1 -- 172.21.15.114:0/2192998781 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f86fc12e5d0 con 0x7f87080b0b60 2024-09-16T07:35:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.997+0000 7f870ca00640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86e80734f0 0x7f86e80759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:07.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:07.997+0000 7f870ca00640 1 --2- 172.21.15.114:0/2192998781 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86e80734f0 0x7f86e80759b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f87081f8e90 tx=0x7f86f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:07.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.001+0000 7f8705600640 1 -- 172.21.15.114:0/2192998781 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f86fc0164d0 con 0x7f87080b0b60 2024-09-16T07:35:08.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.197+0000 7f870fe00640 1 -- 172.21.15.114:0/2192998781 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot protect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f8708070350 con 0x7f86e80734f0 2024-09-16T07:35:08.197 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:08.197+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:08.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.197+0000 7f8705600640 1 -- 172.21.15.114:0/2192998781 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f8708070350 con 0x7f86e80734f0 2024-09-16T07:35:08.197 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:08.206 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:08.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot unprotect non_existent_subvolume subvolume_1 snapshot_1 2024-09-16T07:35:08.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- 172.21.15.114:0/2767003567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d0004b00 msgr2=0x7f87d0004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 --2- 172.21.15.114:0/2767003567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87d0004b00 0x7f87d0004ee0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00c610 tx=0x7f87dc01d240 comp rx=0 tx=0).stop 2024-09-16T07:35:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87ebe00640 1 -- 172.21.15.114:0/2767003567 reap_dead start 2024-09-16T07:35:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- 172.21.15.114:0/2767003567 shutdown_connections 2024-09-16T07:35:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- 172.21.15.114:0/2767003567 >> 172.21.15.114:0/2767003567 conn(0x7f87ec0cfbc0 msgr2=0x7f87ec0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- 172.21.15.114:0/2767003567 shutdown_connections 2024-09-16T07:35:08.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- 172.21.15.114:0/2767003567 wait complete. 2024-09-16T07:35:08.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 Processor -- start 2024-09-16T07:35:08.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- start start 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d0004b00 0x7f87ec1fb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87ec151700 0x7f87ec14a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ec0b0220 0x7f87ec0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec0cde50 con 0x7f87ec0b0220 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec0cdcd0 con 0x7f87d0004b00 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.357+0000 7f87f2800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f87ec0cdfd0 con 0x7f87ec151700 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ec0b0220 0x7f87ec0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ec0b0220 0x7f87ec0b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48132/0 (socket says 172.21.15.114:48132) 2024-09-16T07:35:08.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 -- 172.21.15.114:0/481485761 learned_addr learned my addr 172.21.15.114:0/481485761 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87e2a00640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87ec151700 0x7f87ec14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87eb400640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d0004b00 0x7f87ec1fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 -- 172.21.15.114:0/481485761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87ec151700 msgr2=0x7f87ec14a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87ec151700 0x7f87ec14a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 -- 172.21.15.114:0/481485761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d0004b00 msgr2=0x7f87ec1fb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d0004b00 0x7f87ec1fb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 -- 172.21.15.114:0/481485761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec0ae270 con 0x7f87ec0b0220 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87eb400640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87d0004b00 0x7f87ec1fb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87ebe00640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87ec0b0220 0x7f87ec0b06a0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0d0820 tx=0x7f87e4006f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87e3e00640 1 -- 172.21.15.114:0/481485761 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4015020 con 0x7f87ec0b0220 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87e3e00640 1 -- 172.21.15.114:0/481485761 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87e4011570 con 0x7f87ec0b0220 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87e3e00640 1 -- 172.21.15.114:0/481485761 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e40119c0 con 0x7f87ec0b0220 2024-09-16T07:35:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87f2800640 1 -- 172.21.15.114:0/481485761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ec09ab40 con 0x7f87ec0b0220 2024-09-16T07:35:08.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87f2800640 1 -- 172.21.15.114:0/481485761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ec159480 con 0x7f87ec0b0220 2024-09-16T07:35:08.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87f2800640 1 -- 172.21.15.114:0/481485761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ec069410 con 0x7f87ec0b0220 2024-09-16T07:35:08.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.361+0000 7f87e3e00640 1 -- 172.21.15.114:0/481485761 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f87e4018020 con 0x7f87ec0b0220 2024-09-16T07:35:08.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.365+0000 7f87e3e00640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f87c80734f0 0x7f87c80759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.365+0000 7f87e3e00640 1 -- 172.21.15.114:0/481485761 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f87e40951c0 con 0x7f87ec0b0220 2024-09-16T07:35:08.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.365+0000 7f87eb400640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f87c80734f0 0x7f87c80759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.365+0000 7f87eb400640 1 --2- 172.21.15.114:0/481485761 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f87c80734f0 0x7f87c80759b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00c610 tx=0x7f87dc01a080 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:08.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.365+0000 7f87e3e00640 1 -- 172.21.15.114:0/481485761 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f87e401f020 con 0x7f87ec0b0220 2024-09-16T07:35:08.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.569+0000 7f87f2800640 1 -- 172.21.15.114:0/481485761 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot unprotect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f87ec151f20 con 0x7f87c80734f0 2024-09-16T07:35:08.569 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:08.569+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.569+0000 7f87e3e00640 1 -- 172.21.15.114:0/481485761 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f87dc001880 con 0x7f87c80734f0 2024-09-16T07:35:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:08.579 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:08.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls non_existent_subvolume subvolume_1 2024-09-16T07:35:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 -- 172.21.15.114:0/1335254261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feffc15c1f0 msgr2=0x7feffc0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 --2- 172.21.15.114:0/1335254261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feffc15c1f0 0x7feffc0cec40 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7feffc074e00 tx=0x7fefe801f0b0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 -- 172.21.15.114:0/1335254261 shutdown_connections 2024-09-16T07:35:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 --2- 172.21.15.114:0/1335254261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feffc15c1f0 0x7feffc0cec40 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 --2- 172.21.15.114:0/1335254261 >> v2:172.21.15.149:3300/0 conn(0x7feffc0b0b60 0x7feffc0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 --2- 172.21.15.114:0/1335254261 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feffc15be10 0x7feffc0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 -- 172.21.15.114:0/1335254261 >> 172.21.15.114:0/1335254261 conn(0x7feffc0d1da0 msgr2=0x7feffc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:08.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 -- 172.21.15.114:0/1335254261 shutdown_connections 2024-09-16T07:35:08.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.725+0000 7ff004200640 1 -- 172.21.15.114:0/1335254261 wait complete. 2024-09-16T07:35:08.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 Processor -- start 2024-09-16T07:35:08.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 -- start start 2024-09-16T07:35:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feffc0b0b60 0x7feffc071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feffc15be10 0x7feffc0722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feffc15c1f0 0x7feffc1f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feffc1600a0 con 0x7feffc15c1f0 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feffc15ff20 con 0x7feffc15be10 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feffc160220 con 0x7feffc0b0b60 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feffc15c1f0 0x7feffc1f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feffc15c1f0 0x7feffc1f80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48150/0 (socket says 172.21.15.114:48150) 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 -- 172.21.15.114:0/3401582640 learned_addr learned my addr 172.21.15.114:0/3401582640 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff000e00640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feffc15be10 0x7feffc0722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff001800640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feffc0b0b60 0x7feffc071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 -- 172.21.15.114:0/3401582640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feffc0b0b60 msgr2=0x7feffc071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feffc0b0b60 0x7feffc071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 -- 172.21.15.114:0/3401582640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feffc15be10 msgr2=0x7feffc0722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feffc15be10 0x7feffc0722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 -- 172.21.15.114:0/3401582640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc0b5dc0 con 0x7feffc15c1f0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff002200640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feffc15c1f0 0x7feffc1f80d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7feff400b970 tx=0x7feff400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7feff9600640 1 -- 172.21.15.114:0/3401582640 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4019070 con 0x7feffc15c1f0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7feff9600640 1 -- 172.21.15.114:0/3401582640 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feff400cc50 con 0x7feffc15c1f0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7feff9600640 1 -- 172.21.15.114:0/3401582640 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff40146a0 con 0x7feffc15c1f0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 -- 172.21.15.114:0/3401582640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feffc0b6080 con 0x7feffc15c1f0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 -- 172.21.15.114:0/3401582640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feffc0c6da0 con 0x7feffc15c1f0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.729+0000 7ff004200640 1 -- 172.21.15.114:0/3401582640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feffc1606f0 con 0x7feffc15c1f0 2024-09-16T07:35:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.733+0000 7feff9600640 1 -- 172.21.15.114:0/3401582640 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7feff401c070 con 0x7feffc15c1f0 2024-09-16T07:35:08.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.733+0000 7feff9600640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fefdc0734f0 0x7fefdc0759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:08.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.733+0000 7feff9600640 1 -- 172.21.15.114:0/3401582640 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7feff4094660 con 0x7feffc15c1f0 2024-09-16T07:35:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.733+0000 7ff001800640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fefdc0734f0 0x7fefdc0759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.733+0000 7ff001800640 1 --2- 172.21.15.114:0/3401582640 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fefdc0734f0 0x7fefdc0759b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feff0006fd0 tx=0x7feff0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.737+0000 7feff9600640 1 -- 172.21.15.114:0/3401582640 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7feff405e900 con 0x7feffc15c1f0 2024-09-16T07:35:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.933+0000 7ff004200640 1 -- 172.21.15.114:0/3401582640 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7feffc070350 con 0x7fefdc0734f0 2024-09-16T07:35:08.933 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:08.933+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:08.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:08.933+0000 7feff9600640 1 -- 172.21.15.114:0/3401582640 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7feffc070350 con 0x7fefdc0734f0 2024-09-16T07:35:08.934 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:08.943 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:08.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone non_existent_subvolume subvolume_1 snapshot_1 clone_1 2024-09-16T07:35:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- 172.21.15.114:0/1206723689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06900b3190 msgr2=0x7f06900b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 --2- 172.21.15.114:0/1206723689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06900b3190 0x7f06900b1450 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f0688009bc0 tx=0x7f068801ca50 comp rx=0 tx=0).stop 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- 172.21.15.114:0/1206723689 shutdown_connections 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 --2- 172.21.15.114:0/1206723689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06900b3190 0x7f06900b1450 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 --2- 172.21.15.114:0/1206723689 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06901617a0 0x7f0690162300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- 172.21.15.114:0/1206723689 >> 172.21.15.114:0/1206723689 conn(0x7f06900d1dd0 msgr2=0x7f06900d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- 172.21.15.114:0/1206723689 shutdown_connections 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- 172.21.15.114:0/1206723689 wait complete. 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 Processor -- start 2024-09-16T07:35:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- start start 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06900b3190 0x7f0690150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06901613c0 0x7f06901fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06901617a0 0x7f069015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f069016b0b0 con 0x7f06900b3190 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f069016af30 con 0x7f06901613c0 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0698000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f069016b230 con 0x7f06901617a0 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0695600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06900b3190 0x7f0690150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0695600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06900b3190 0x7f0690150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48170/0 (socket says 172.21.15.114:48170) 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.093+0000 7f0695600640 1 -- 172.21.15.114:0/582334971 learned_addr learned my addr 172.21.15.114:0/582334971 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0696000640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06901617a0 0x7f069015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0694c00640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06901613c0 0x7f06901fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0695600640 1 -- 172.21.15.114:0/582334971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06901617a0 msgr2=0x7f069015b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0695600640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f06901617a0 0x7f069015b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0695600640 1 -- 172.21.15.114:0/582334971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06901613c0 msgr2=0x7f06901fb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0695600640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06901613c0 0x7f06901fb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0695600640 1 -- 172.21.15.114:0/582334971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069015c090 con 0x7f06900b3190 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0695600640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06900b3190 0x7f0690150e00 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f068400c450 tx=0x7f068400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f068d600640 1 -- 172.21.15.114:0/582334971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684011790 con 0x7f06900b3190 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f068d600640 1 -- 172.21.15.114:0/582334971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0684017070 con 0x7f06900b3190 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0698000640 1 -- 172.21.15.114:0/582334971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069015c370 con 0x7f06900b3190 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f068d600640 1 -- 172.21.15.114:0/582334971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684011cc0 con 0x7f06900b3190 2024-09-16T07:35:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0698000640 1 -- 172.21.15.114:0/582334971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06901fb1a0 con 0x7f06900b3190 2024-09-16T07:35:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f0698000640 1 -- 172.21.15.114:0/582334971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06900b1450 con 0x7f06900b3190 2024-09-16T07:35:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f068d600640 1 -- 172.21.15.114:0/582334971 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f068401c460 con 0x7f06900b3190 2024-09-16T07:35:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.097+0000 7f068d600640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0670073520 0x7f06700759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.101+0000 7f068d600640 1 -- 172.21.15.114:0/582334971 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f0684094660 con 0x7f06900b3190 2024-09-16T07:35:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.101+0000 7f0694c00640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0670073520 0x7f06700759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.101+0000 7f0694c00640 1 --2- 172.21.15.114:0/582334971 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0670073520 0x7f06700759e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f06900c95f0 tx=0x7f067c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:09.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.101+0000 7f068d600640 1 -- 172.21.15.114:0/582334971 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f068405e880 con 0x7f06900b3190 2024-09-16T07:35:09.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.301+0000 7f0698000640 1 -- 172.21.15.114:0/582334971 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7f06900b00a0 con 0x7f0670073520 2024-09-16T07:35:09.305 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:09.305+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:09.305 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:09.305+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:09.305 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:09.305+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:09.305 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:09.305+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:09.305 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:09.305+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:09.311 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:09.313+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.313+0000 7f068d600640 1 -- 172.21.15.114:0/582334971 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f06900b00a0 con 0x7f0670073520 2024-09-16T07:35:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:09.320 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:09.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status non_existent_subvolume clone_1 2024-09-16T07:35:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.465+0000 7f6f19000640 1 -- 172.21.15.114:0/2360054208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef8004810 msgr2=0x7f6ef8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.465+0000 7f6f19000640 1 --2- 172.21.15.114:0/2360054208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef8004810 0x7f6ef8004c90 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00c2e0 tx=0x7f6efc01f6e0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.465+0000 7f6f19000640 1 -- 172.21.15.114:0/2360054208 shutdown_connections 2024-09-16T07:35:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.465+0000 7f6f19000640 1 --2- 172.21.15.114:0/2360054208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef8004810 0x7f6ef8004c90 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.465+0000 7f6f19000640 1 -- 172.21.15.114:0/2360054208 >> 172.21.15.114:0/2360054208 conn(0x7f6f140d1dd0 msgr2=0x7f6f140d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.465+0000 7f6f19000640 1 -- 172.21.15.114:0/2360054208 shutdown_connections 2024-09-16T07:35:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.465+0000 7f6f19000640 1 -- 172.21.15.114:0/2360054208 wait complete. 2024-09-16T07:35:09.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 Processor -- start 2024-09-16T07:35:09.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 -- start start 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef8004810 0x7f6f141efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f141560a0 0x7f6f141f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f140c84c0 0x7f6f140b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140b0e50 con 0x7f6ef8004810 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140b0cd0 con 0x7f6f140c84c0 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140b1220 con 0x7f6f141560a0 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef8004810 0x7f6f141efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef8004810 0x7f6f141efce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48220/0 (socket says 172.21.15.114:48220) 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 -- 172.21.15.114:0/2456504002 learned_addr learned my addr 172.21.15.114:0/2456504002 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f09400640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f141560a0 0x7f6f141f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f12800640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f140c84c0 0x7f6f140b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 -- 172.21.15.114:0/2456504002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f141560a0 msgr2=0x7f6f141f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f141560a0 0x7f6f141f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 -- 172.21.15.114:0/2456504002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f140c84c0 msgr2=0x7f6f140b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f140c84c0 0x7f6f140b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 -- 172.21.15.114:0/2456504002 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f141f36e0 con 0x7f6ef8004810 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f12800640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f140c84c0 0x7f6f140b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f11e00640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef8004810 0x7f6f141efce0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f6f04010ba0 tx=0x7f6f0400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f0aa00640 1 -- 172.21.15.114:0/2456504002 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04010ea0 con 0x7f6ef8004810 2024-09-16T07:35:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f0aa00640 1 -- 172.21.15.114:0/2456504002 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f0401c790 con 0x7f6ef8004810 2024-09-16T07:35:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f0aa00640 1 -- 172.21.15.114:0/2456504002 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0401cbe0 con 0x7f6ef8004810 2024-09-16T07:35:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 -- 172.21.15.114:0/2456504002 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f14153b10 con 0x7f6ef8004810 2024-09-16T07:35:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.469+0000 7f6f19000640 1 -- 172.21.15.114:0/2456504002 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f141540d0 con 0x7f6ef8004810 2024-09-16T07:35:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.473+0000 7f6f19000640 1 -- 172.21.15.114:0/2456504002 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f140d01c0 con 0x7f6ef8004810 2024-09-16T07:35:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.473+0000 7f6f0aa00640 1 -- 172.21.15.114:0/2456504002 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f6f04011440 con 0x7f6ef8004810 2024-09-16T07:35:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.473+0000 7f6f0aa00640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ef0073520 0x7f6ef00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.473+0000 7f6f0aa00640 1 -- 172.21.15.114:0/2456504002 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f6f04095b70 con 0x7f6ef8004810 2024-09-16T07:35:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.473+0000 7f6f09400640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ef0073520 0x7f6ef00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.473+0000 7f6f09400640 1 --2- 172.21.15.114:0/2456504002 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ef0073520 0x7f6ef00759e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0b0000 tx=0x7f6efc01c520 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.477+0000 7f6f0aa00640 1 -- 172.21.15.114:0/2456504002 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6f04060480 con 0x7f6ef8004810 2024-09-16T07:35:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.681+0000 7f6f19000640 1 -- 172.21.15.114:0/2456504002 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "non_existent_subvolume", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7f6f140d06e0 con 0x7f6ef0073520 2024-09-16T07:35:09.679 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:09.681+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.681+0000 7f6f0aa00640 1 -- 172.21.15.114:0/2456504002 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f6f140d06e0 con 0x7f6ef0073520 2024-09-16T07:35:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:09.689 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:09.690 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create non_existent_subvolume group_1 2024-09-16T07:35:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 -- 172.21.15.114:0/3875636832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60d415a720 msgr2=0x7f60d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 --2- 172.21.15.114:0/3875636832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60d415a720 0x7f60d406e7a0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f60d409e090 tx=0x7f60c401cd80 comp rx=0 tx=0).stop 2024-09-16T07:35:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 -- 172.21.15.114:0/3875636832 shutdown_connections 2024-09-16T07:35:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 --2- 172.21.15.114:0/3875636832 >> v2:172.21.15.149:3300/0 conn(0x7f60d40cd3c0 0x7f60d40b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 --2- 172.21.15.114:0/3875636832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60d415a720 0x7f60d406e7a0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 -- 172.21.15.114:0/3875636832 >> 172.21.15.114:0/3875636832 conn(0x7f60d40b18f0 msgr2=0x7f60d40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 -- 172.21.15.114:0/3875636832 shutdown_connections 2024-09-16T07:35:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 -- 172.21.15.114:0/3875636832 wait complete. 2024-09-16T07:35:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.837+0000 7f60d9a00640 1 Processor -- start 2024-09-16T07:35:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 -- start start 2024-09-16T07:35:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d40b4810 0x7f60d4158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60d40cd3c0 0x7f60d4159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60d415a720 0x7f60d4159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f60d4167220 con 0x7f60d415a720 2024-09-16T07:35:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f60d415ee00 con 0x7f60d40cd3c0 2024-09-16T07:35:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f60d41673a0 con 0x7f60d40b4810 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60d415a720 0x7f60d4159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60d415a720 0x7f60d4159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48240/0 (socket says 172.21.15.114:48240) 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 -- 172.21.15.114:0/1381019287 learned_addr learned my addr 172.21.15.114:0/1381019287 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d2000640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60d40cd3c0 0x7f60d4159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d2a00640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d40b4810 0x7f60d4158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 -- 172.21.15.114:0/1381019287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d40b4810 msgr2=0x7f60d4158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f60d40b4810 0x7f60d4158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 -- 172.21.15.114:0/1381019287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60d40cd3c0 msgr2=0x7f60d4159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f60d40cd3c0 0x7f60d4159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 -- 172.21.15.114:0/1381019287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d41f8ae0 con 0x7f60d415a720 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d3400640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60d415a720 0x7f60d4159990 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f60cc00c3c0 tx=0x7f60cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60caa00640 1 -- 172.21.15.114:0/1381019287 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc011790 con 0x7f60d415a720 2024-09-16T07:35:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60caa00640 1 -- 172.21.15.114:0/1381019287 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60cc017070 con 0x7f60d415a720 2024-09-16T07:35:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60caa00640 1 -- 172.21.15.114:0/1381019287 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc011cc0 con 0x7f60d415a720 2024-09-16T07:35:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 -- 172.21.15.114:0/1381019287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d41f7f60 con 0x7f60d415a720 2024-09-16T07:35:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 -- 172.21.15.114:0/1381019287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d41f8520 con 0x7f60d415a720 2024-09-16T07:35:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.841+0000 7f60d9a00640 1 -- 172.21.15.114:0/1381019287 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d4069410 con 0x7f60d415a720 2024-09-16T07:35:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.845+0000 7f60caa00640 1 -- 172.21.15.114:0/1381019287 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7f60cc01c460 con 0x7f60d415a720 2024-09-16T07:35:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.845+0000 7f60caa00640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f60b40734f0 0x7f60b40759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.845+0000 7f60caa00640 1 -- 172.21.15.114:0/1381019287 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f60cc094680 con 0x7f60d415a720 2024-09-16T07:35:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.845+0000 7f60d2a00640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f60b40734f0 0x7f60b40759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.845+0000 7f60d2a00640 1 --2- 172.21.15.114:0/1381019287 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f60b40734f0 0x7f60b40759b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f60c40af000 tx=0x7f60c401b5c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:09.849+0000 7f60caa00640 1 -- 172.21.15.114:0/1381019287 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f60cc05e890 con 0x7f60d415a720 2024-09-16T07:35:10.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.041+0000 7f60d9a00640 1 -- 172.21.15.114:0/1381019287 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f60d40b42d0 con 0x7f60b40734f0 2024-09-16T07:35:10.040 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:10.041+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:10.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.041+0000 7f60caa00640 1 -- 172.21.15.114:0/1381019287 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f60d40b42d0 con 0x7f60b40734f0 2024-09-16T07:35:10.040 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:10.049 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:10.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm non_existent_subvolume group_1 2024-09-16T07:35:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- 172.21.15.114:0/3175912724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d80b49e0 msgr2=0x7ff5d806f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 --2- 172.21.15.114:0/3175912724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d80b49e0 0x7ff5d806f7b0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009c80 tx=0x7ff5d001cd10 comp rx=0 tx=0).stop 2024-09-16T07:35:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- 172.21.15.114:0/3175912724 shutdown_connections 2024-09-16T07:35:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 --2- 172.21.15.114:0/3175912724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d80b49e0 0x7ff5d806f7b0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 --2- 172.21.15.114:0/3175912724 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d815dae0 0x7ff5d80acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- 172.21.15.114:0/3175912724 >> 172.21.15.114:0/3175912724 conn(0x7ff5d80b18f0 msgr2=0x7ff5d80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- 172.21.15.114:0/3175912724 shutdown_connections 2024-09-16T07:35:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- 172.21.15.114:0/3175912724 wait complete. 2024-09-16T07:35:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 Processor -- start 2024-09-16T07:35:10.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- start start 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d80b49e0 0x7ff5d8144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d80cd100 0x7ff5d81456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d815dae0 0x7ff5d81f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d80cc9f0 con 0x7ff5d80cd100 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d80cc870 con 0x7ff5d80b49e0 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5de200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d80ccb70 con 0x7ff5d815dae0 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.197+0000 7ff5cea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d80cd100 0x7ff5d81456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5d7400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d80b49e0 0x7ff5d8144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5d7e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d815dae0 0x7ff5d81f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d80cd100 0x7ff5d81456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48258/0 (socket says 172.21.15.114:48258) 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 -- 172.21.15.114:0/30197421 learned_addr learned my addr 172.21.15.114:0/30197421 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 -- 172.21.15.114:0/30197421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d815dae0 msgr2=0x7ff5d81f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 --2- 172.21.15.114:0/30197421 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d815dae0 0x7ff5d81f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 -- 172.21.15.114:0/30197421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d80b49e0 msgr2=0x7ff5d8144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 --2- 172.21.15.114:0/30197421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d80b49e0 0x7ff5d8144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 -- 172.21.15.114:0/30197421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d81f9470 con 0x7ff5d80cd100 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cea00640 1 --2- 172.21.15.114:0/30197421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d80cd100 0x7ff5d81456e0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c4b0 tx=0x7ff5c000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cfe00640 1 -- 172.21.15.114:0/30197421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00052d0 con 0x7ff5d80cd100 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cfe00640 1 -- 172.21.15.114:0/30197421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5c0005470 con 0x7ff5d80cd100 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5de200640 1 -- 172.21.15.114:0/30197421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d81f9750 con 0x7ff5d80cd100 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cfe00640 1 -- 172.21.15.114:0/30197421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0012890 con 0x7ff5d80cd100 2024-09-16T07:35:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5de200640 1 -- 172.21.15.114:0/30197421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d8163940 con 0x7ff5d80cd100 2024-09-16T07:35:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5de200640 1 -- 172.21.15.114:0/30197421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d80acd40 con 0x7ff5d80cd100 2024-09-16T07:35:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.201+0000 7ff5cfe00640 1 -- 172.21.15.114:0/30197421 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 24) ==== 97641+0+0 (secure 0 0 0) 0x7ff5c0003600 con 0x7ff5d80cd100 2024-09-16T07:35:10.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.205+0000 7ff5cfe00640 1 --2- 172.21.15.114:0/30197421 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b40734f0 0x7ff5b40759b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.205+0000 7ff5cfe00640 1 -- 172.21.15.114:0/30197421 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7ff5c0094440 con 0x7ff5d80cd100 2024-09-16T07:35:10.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.205+0000 7ff5d7400640 1 --2- 172.21.15.114:0/30197421 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b40734f0 0x7ff5b40759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.205+0000 7ff5d7400640 1 --2- 172.21.15.114:0/30197421 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b40734f0 0x7ff5b40759b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800ff60 tx=0x7ff5c800f6f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.209+0000 7ff5cfe00640 1 -- 172.21.15.114:0/30197421 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff5c005e620 con 0x7ff5d80cd100 2024-09-16T07:35:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.397+0000 7ff5de200640 1 -- 172.21.15.114:0/30197421 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7ff5d815c340 con 0x7ff5b40734f0 2024-09-16T07:35:10.397 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:10.397+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.397+0000 7ff5cfe00640 1 -- 172.21.15.114:0/30197421 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7ff5d815c340 con 0x7ff5b40734f0 2024-09-16T07:35:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:10.406 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:10.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup getpath non_existent_subvolume group_1 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 -- 172.21.15.114:0/2191754883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f323806fff0 msgr2=0x7f3238074060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 --2- 172.21.15.114:0/2191754883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f323806fff0 0x7f3238074060 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f3220009840 tx=0x7f322001c7f0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 -- 172.21.15.114:0/2191754883 shutdown_connections 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 --2- 172.21.15.114:0/2191754883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f32380745a0 0x7f323806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 --2- 172.21.15.114:0/2191754883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f323806fff0 0x7f3238074060 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 -- 172.21.15.114:0/2191754883 >> 172.21.15.114:0/2191754883 conn(0x7f32380d0cd0 msgr2=0x7f32380d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 -- 172.21.15.114:0/2191754883 shutdown_connections 2024-09-16T07:35:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.557+0000 7f323e600640 1 -- 172.21.15.114:0/2191754883 wait complete. 2024-09-16T07:35:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 Processor -- start 2024-09-16T07:35:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 -- start start 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f323806fff0 0x7f32380adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32380b6350 0x7f3238153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f323815a4b0 0x7f32380cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f32381694d0 con 0x7f32380b6350 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3238169350 con 0x7f323815a4b0 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3238169650 con 0x7f323806fff0 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f3237400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f323806fff0 0x7f32380adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32380b6350 0x7f3238153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32380b6350 0x7f3238153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48282/0 (socket says 172.21.15.114:48282) 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 -- 172.21.15.114:0/590421397 learned_addr learned my addr 172.21.15.114:0/590421397 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f3237400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f323806fff0 0x7f32380adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:58690/0 (socket says 172.21.15.114:58690) 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f3237e00640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f323815a4b0 0x7f32380cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 -- 172.21.15.114:0/590421397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f323806fff0 msgr2=0x7f32380adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f323806fff0 0x7f32380adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 -- 172.21.15.114:0/590421397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f323815a4b0 msgr2=0x7f32380cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f323815a4b0 0x7f32380cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 -- 172.21.15.114:0/590421397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32381548e0 con 0x7f32380b6350 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f3237400640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f323806fff0 0x7f32380adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:35:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322ea00640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32380b6350 0x7f3238153f60 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3220009790 tx=0x7f32200a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:10.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322fe00640 1 -- 172.21.15.114:0/590421397 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32200b2040 con 0x7f32380b6350 2024-09-16T07:35:10.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322fe00640 1 -- 172.21.15.114:0/590421397 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32200044b0 con 0x7f32380b6350 2024-09-16T07:35:10.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 -- 172.21.15.114:0/590421397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32381596f0 con 0x7f32380b6350 2024-09-16T07:35:10.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f322fe00640 1 -- 172.21.15.114:0/590421397 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3220005280 con 0x7f32380b6350 2024-09-16T07:35:10.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 -- 172.21.15.114:0/590421397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3238159cb0 con 0x7f32380b6350 2024-09-16T07:35:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.561+0000 7f323e600640 1 -- 172.21.15.114:0/590421397 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3238074060 con 0x7f32380b6350 2024-09-16T07:35:10.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.565+0000 7f322fe00640 1 -- 172.21.15.114:0/590421397 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f32200be060 con 0x7f32380b6350 2024-09-16T07:35:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.565+0000 7f322fe00640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3214073580 0x7f3214075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.565+0000 7f322fe00640 1 -- 172.21.15.114:0/590421397 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f322012e150 con 0x7f32380b6350 2024-09-16T07:35:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.565+0000 7f3237400640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3214073580 0x7f3214075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.565+0000 7f3237400640 1 --2- 172.21.15.114:0/590421397 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3214073580 0x7f3214075a40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3228007fd0 tx=0x7f3228007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:10.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.569+0000 7f322fe00640 1 -- 172.21.15.114:0/590421397 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3220016410 con 0x7f32380b6350 2024-09-16T07:35:10.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.757+0000 7f323e600640 1 -- 172.21.15.114:0/590421397 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup getpath", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f32380ae080 con 0x7f3214073580 2024-09-16T07:35:10.758 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:10.761+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.761+0000 7f322fe00640 1 -- 172.21.15.114:0/590421397 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f32380ae080 con 0x7f3214073580 2024-09-16T07:35:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:10.767 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:10.767 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup pin non_existent_subvolume group_1 export 0 2024-09-16T07:35:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- 172.21.15.114:0/1997452176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74700b5170 msgr2=0x7f74700aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 --2- 172.21.15.114:0/1997452176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74700b5170 0x7f74700aedf0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f7458009840 tx=0x7f745801c750 comp rx=0 tx=0).stop 2024-09-16T07:35:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- 172.21.15.114:0/1997452176 shutdown_connections 2024-09-16T07:35:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 --2- 172.21.15.114:0/1997452176 >> v2:172.21.15.149:3300/0 conn(0x7f74700af330 0x7f74700cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 --2- 172.21.15.114:0/1997452176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74700b5170 0x7f74700aedf0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- 172.21.15.114:0/1997452176 >> 172.21.15.114:0/1997452176 conn(0x7f74700cfbc0 msgr2=0x7f74700cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- 172.21.15.114:0/1997452176 shutdown_connections 2024-09-16T07:35:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- 172.21.15.114:0/1997452176 wait complete. 2024-09-16T07:35:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 Processor -- start 2024-09-16T07:35:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- start start 2024-09-16T07:35:10.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74700af330 0x7f7470151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74700b5170 0x7f747015aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f747015bf60 0x7f7470151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7470169240 con 0x7f747015bf60 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74701690c0 con 0x7f74700b5170 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7475400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f74701693c0 con 0x7f74700af330 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f747015bf60 0x7f7470151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f747015bf60 0x7f7470151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48294/0 (socket says 172.21.15.114:48294) 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 -- 172.21.15.114:0/3611144907 learned_addr learned my addr 172.21.15.114:0/3611144907 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746e800640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74700af330 0x7f7470151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7465e00640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74700b5170 0x7f747015aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 -- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74700af330 msgr2=0x7f7470151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74700af330 0x7f7470151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 -- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74700b5170 msgr2=0x7f747015aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74700b5170 0x7f747015aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746f200640 1 -- 172.21.15.114:0/3611144907 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7470157830 con 0x7f747015bf60 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f7465e00640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74700b5170 0x7f747015aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.917+0000 7f746e800640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74700af330 0x7f7470151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f746f200640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f747015bf60 0x7f7470151060 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f746800eb50 tx=0x7f746800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7467400640 1 -- 172.21.15.114:0/3611144907 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004d30 con 0x7f747015bf60 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7467400640 1 -- 172.21.15.114:0/3611144907 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f746800ee50 con 0x7f747015bf60 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7467400640 1 -- 172.21.15.114:0/3611144907 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468005280 con 0x7f747015bf60 2024-09-16T07:35:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7475400640 1 -- 172.21.15.114:0/3611144907 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747015b160 con 0x7f747015bf60 2024-09-16T07:35:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7475400640 1 -- 172.21.15.114:0/3611144907 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747015b720 con 0x7f747015bf60 2024-09-16T07:35:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7475400640 1 -- 172.21.15.114:0/3611144907 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7470069410 con 0x7f747015bf60 2024-09-16T07:35:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7467400640 1 -- 172.21.15.114:0/3611144907 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f7468005420 con 0x7f747015bf60 2024-09-16T07:35:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7467400640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f744c0735b0 0x7f744c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f7467400640 1 -- 172.21.15.114:0/3611144907 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f7468095670 con 0x7f747015bf60 2024-09-16T07:35:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.921+0000 7f746e800640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f744c0735b0 0x7f744c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.925+0000 7f746e800640 1 --2- 172.21.15.114:0/3611144907 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f744c0735b0 0x7f744c075a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7460001630 tx=0x7f7460009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:10.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:10.925+0000 7f7467400640 1 -- 172.21.15.114:0/3611144907 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f746805ff90 con 0x7f747015bf60 2024-09-16T07:35:11.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.117+0000 7f7475400640 1 -- 172.21.15.114:0/3611144907 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "non_existent_subvolume", "group_name": "group_1", "pin_type": "export", "pin_setting": "0", "target": ["mon-mgr", ""]}) -- 0x7f74700cdac0 con 0x7f744c0735b0 2024-09-16T07:35:11.119 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:11.121+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.121+0000 7f7467400640 1 -- 172.21.15.114:0/3611144907 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f74700cdac0 con 0x7f744c0735b0 2024-09-16T07:35:11.119 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:11.127 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:11.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup ls non_existent_subvolume 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 -- 172.21.15.114:0/3951286788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc15bf70 msgr2=0x7fc9fc0d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 --2- 172.21.15.114:0/3951286788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc15bf70 0x7fc9fc0d28f0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009900 tx=0x7fc9ec01c850 comp rx=0 tx=0).stop 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 -- 172.21.15.114:0/3951286788 shutdown_connections 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 --2- 172.21.15.114:0/3951286788 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9fc0d0950 0x7fc9fc0aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 --2- 172.21.15.114:0/3951286788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc15bf70 0x7fc9fc0d28f0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 -- 172.21.15.114:0/3951286788 >> 172.21.15.114:0/3951286788 conn(0x7fc9fc0d1e00 msgr2=0x7fc9fc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 -- 172.21.15.114:0/3951286788 shutdown_connections 2024-09-16T07:35:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.273+0000 7fca03400640 1 -- 172.21.15.114:0/3951286788 wait complete. 2024-09-16T07:35:11.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 Processor -- start 2024-09-16T07:35:11.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 -- start start 2024-09-16T07:35:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc0b0f50 0x7fc9fc1f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9fc0d0950 0x7fc9fc1fae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9fc15bf70 0x7fc9fc1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc168d40 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc168bc0 con 0x7fc9fc15bf70 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc9fc168ec0 con 0x7fc9fc0d0950 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc0b0f50 0x7fc9fc1f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc0b0f50 0x7fc9fc1f82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48316/0 (socket says 172.21.15.114:48316) 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 -- 172.21.15.114:0/2716356331 learned_addr learned my addr 172.21.15.114:0/2716356331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fc9f3e00640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9fc0d0950 0x7fc9fc1fae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca01400640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9fc15bf70 0x7fc9fc1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 -- 172.21.15.114:0/2716356331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9fc0d0950 msgr2=0x7fc9fc1fae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc9fc0d0950 0x7fc9fc1fae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 -- 172.21.15.114:0/2716356331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9fc15bf70 msgr2=0x7fc9fc1509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc9fc15bf70 0x7fc9fc1509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 -- 172.21.15.114:0/2716356331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc1fb5b0 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca00a00640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9fc0b0f50 0x7fc9fc1f82c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009850 tx=0x7fc9ec004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fc9f9600640 1 -- 172.21.15.114:0/2716356331 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0bb020 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fc9f9600640 1 -- 172.21.15.114:0/2716356331 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9ec003600 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fc9f9600640 1 -- 172.21.15.114:0/2716356331 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec003a50 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 -- 172.21.15.114:0/2716356331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc1fb890 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 -- 172.21.15.114:0/2716356331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc164140 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.277+0000 7fca03400640 1 -- 172.21.15.114:0/2716356331 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9fc0aeb50 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.281+0000 7fc9f9600640 1 -- 172.21.15.114:0/2716356331 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fc9ec0be020 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.281+0000 7fc9f9600640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc9d8073580 0x7fc9d8075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.281+0000 7fc9f9600640 1 -- 172.21.15.114:0/2716356331 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fc9ec12f5f0 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.281+0000 7fc9f3e00640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc9d8073580 0x7fc9d8075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.281+0000 7fc9f3e00640 1 --2- 172.21.15.114:0/2716356331 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc9d8073580 0x7fc9d8075a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0cb820 tx=0x7fc9e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:11.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.285+0000 7fc9f9600640 1 -- 172.21.15.114:0/2716356331 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc9ec0c5030 con 0x7fc9fc0b0f50 2024-09-16T07:35:11.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.473+0000 7fca03400640 1 -- 172.21.15.114:0/2716356331 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7fc9fc0c8c30 con 0x7fc9d8073580 2024-09-16T07:35:11.474 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:11.477+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:11.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.477+0000 7fc9f9600640 1 -- 172.21.15.114:0/2716356331 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fc9fc0c8c30 con 0x7fc9d8073580 2024-09-16T07:35:11.475 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:11.482 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:11.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create non_existent_subvolume group_1 snapshot_1 2024-09-16T07:35:11.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- 172.21.15.114:0/2598622861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0734f0 msgr2=0x7fdfbc15a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 --2- 172.21.15.114:0/2598622861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0734f0 0x7fdfbc15a9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009870 tx=0x7fdfac01c6c0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- 172.21.15.114:0/2598622861 shutdown_connections 2024-09-16T07:35:11.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 --2- 172.21.15.114:0/2598622861 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0734f0 0x7fdfbc15a9d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- 172.21.15.114:0/2598622861 >> 172.21.15.114:0/2598622861 conn(0x7fdfbc0cfbc0 msgr2=0x7fdfbc0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:11.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- 172.21.15.114:0/2598622861 shutdown_connections 2024-09-16T07:35:11.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- 172.21.15.114:0/2598622861 wait complete. 2024-09-16T07:35:11.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 Processor -- start 2024-09-16T07:35:11.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- start start 2024-09-16T07:35:11.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0734f0 0x7fdfbc15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0cea60 0x7fdfbc14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc0cf440 0x7fdfbc0ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc06fdc0 con 0x7fdfbc0cea60 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc06fc40 con 0x7fdfbc0cf440 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfc1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc168370 con 0x7fdfbc0734f0 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfb2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0cea60 0x7fdfbc14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfbaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0734f0 0x7fdfbc15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfbaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0734f0 0x7fdfbc15cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:58726/0 (socket says 172.21.15.114:58726) 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3994420074 learned_addr learned my addr 172.21.15.114:0/3994420074 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.633+0000 7fdfbb400640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc0cf440 0x7fdfbc0ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3994420074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc0cf440 msgr2=0x7fdfbc0ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfbaa00640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfbc0cf440 0x7fdfbc0ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3994420074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0cea60 msgr2=0x7fdfbc14e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfbaa00640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0cea60 0x7fdfbc14e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3994420074 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc0b4e00 con 0x7fdfbc0734f0 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfb2000640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfbc0cea60 0x7fdfbc14e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfbaa00640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdfbc0734f0 0x7fdfbc15cd20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfac01cf60 tx=0x7fdfac004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfb3400640 1 -- 172.21.15.114:0/3994420074 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac004420 con 0x7fdfbc0734f0 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfb3400640 1 -- 172.21.15.114:0/3994420074 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfac005120 con 0x7fdfbc0734f0 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfb3400640 1 -- 172.21.15.114:0/3994420074 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac005570 con 0x7fdfbc0734f0 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfc1600640 1 -- 172.21.15.114:0/3994420074 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc0b50e0 con 0x7fdfbc0734f0 2024-09-16T07:35:11.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfc1600640 1 -- 172.21.15.114:0/3994420074 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc0b56a0 con 0x7fdfbc0734f0 2024-09-16T07:35:11.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfc1600640 1 -- 172.21.15.114:0/3994420074 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc069410 con 0x7fdfbc0734f0 2024-09-16T07:35:11.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfb3400640 1 -- 172.21.15.114:0/3994420074 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fdfac0bf020 con 0x7fdfbc0734f0 2024-09-16T07:35:11.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfb3400640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdf98073580 0x7fdf98075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.637+0000 7fdfb3400640 1 -- 172.21.15.114:0/3994420074 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fdfac12ef40 con 0x7fdfbc0734f0 2024-09-16T07:35:11.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.641+0000 7fdfb2000640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdf98073580 0x7fdf98075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.641+0000 7fdfb2000640 1 --2- 172.21.15.114:0/3994420074 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdf98073580 0x7fdf98075a40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc152870 tx=0x7fdfa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:11.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.641+0000 7fdfb3400640 1 -- 172.21.15.114:0/3994420074 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdfac016370 con 0x7fdfbc0734f0 2024-09-16T07:35:11.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.833+0000 7fdfc1600640 1 -- 172.21.15.114:0/3994420074 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fdfbc0acfd0 con 0x7fdf98073580 2024-09-16T07:35:11.835 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:11.837+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:11.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.837+0000 7fdfb3400640 1 -- 172.21.15.114:0/3994420074 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fdfa4001810 con 0x7fdf98073580 2024-09-16T07:35:11.835 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:11.844 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:11.845 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot rm non_existent_subvolume group_1 snapshot_1 2024-09-16T07:35:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 -- 172.21.15.114:0/2700479786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92a80d1350 msgr2=0x7f92a80b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 --2- 172.21.15.114:0/2700479786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92a80d1350 0x7f92a80b48f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f92a8072fa0 tx=0x7f92a001cd80 comp rx=0 tx=0).stop 2024-09-16T07:35:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 -- 172.21.15.114:0/2700479786 shutdown_connections 2024-09-16T07:35:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 --2- 172.21.15.114:0/2700479786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92a80d1350 0x7f92a80b48f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 --2- 172.21.15.114:0/2700479786 >> v2:172.21.15.149:3300/0 conn(0x7f92a815a7e0 0x7f92a80ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 -- 172.21.15.114:0/2700479786 >> 172.21.15.114:0/2700479786 conn(0x7f92a806dd30 msgr2=0x7f92a806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:11.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 -- 172.21.15.114:0/2700479786 shutdown_connections 2024-09-16T07:35:11.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 -- 172.21.15.114:0/2700479786 wait complete. 2024-09-16T07:35:11.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 Processor -- start 2024-09-16T07:35:11.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.993+0000 7f92aea00640 1 -- start start 2024-09-16T07:35:11.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92a80aea10 0x7f92a81f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92a80d1350 0x7f92a815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92a815a7e0 0x7f92a81f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92a81680a0 con 0x7f92a815a7e0 2024-09-16T07:35:11.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8167f20 con 0x7f92a80d1350 2024-09-16T07:35:11.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92a8168220 con 0x7f92a80aea10 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92a815a7e0 0x7f92a81f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92a815a7e0 0x7f92a81f6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48364/0 (socket says 172.21.15.114:48364) 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 -- 172.21.15.114:0/3253198105 learned_addr learned my addr 172.21.15.114:0/3253198105 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92a7400640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92a80d1350 0x7f92a815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92a7e00640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92a80aea10 0x7f92a81f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 -- 172.21.15.114:0/3253198105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92a80aea10 msgr2=0x7f92a81f9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f92a80aea10 0x7f92a81f9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 -- 172.21.15.114:0/3253198105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92a80d1350 msgr2=0x7f92a815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92a80d1350 0x7f92a815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 -- 172.21.15.114:0/3253198105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a81f8bd0 con 0x7f92a815a7e0 2024-09-16T07:35:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aca00640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92a815a7e0 0x7f92a81f6700 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f92a0019990 tx=0x7f92a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f929fe00640 1 -- 172.21.15.114:0/3253198105 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a00bb070 con 0x7f92a815a7e0 2024-09-16T07:35:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f929fe00640 1 -- 172.21.15.114:0/3253198105 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92a00047d0 con 0x7f92a815a7e0 2024-09-16T07:35:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 -- 172.21.15.114:0/3253198105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a809e700 con 0x7f92a815a7e0 2024-09-16T07:35:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f929fe00640 1 -- 172.21.15.114:0/3253198105 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a00b2040 con 0x7f92a815a7e0 2024-09-16T07:35:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 -- 172.21.15.114:0/3253198105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a8158e00 con 0x7f92a815a7e0 2024-09-16T07:35:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:11.997+0000 7f92aea00640 1 -- 172.21.15.114:0/3253198105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a80b48f0 con 0x7f92a815a7e0 2024-09-16T07:35:11.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.001+0000 7f929fe00640 1 -- 172.21.15.114:0/3253198105 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f92a00be070 con 0x7f92a815a7e0 2024-09-16T07:35:11.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.001+0000 7f929fe00640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9288073580 0x7f9288075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:11.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.001+0000 7f929fe00640 1 -- 172.21.15.114:0/3253198105 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f92a012eba0 con 0x7f92a815a7e0 2024-09-16T07:35:11.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.001+0000 7f92a7e00640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9288073580 0x7f9288075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.001+0000 7f92a7e00640 1 --2- 172.21.15.114:0/3253198105 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9288073580 0x7f9288075a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f929800ab40 tx=0x7f929800a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:12.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.005+0000 7f929fe00640 1 -- 172.21.15.114:0/3253198105 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f92a0130e20 con 0x7f92a815a7e0 2024-09-16T07:35:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.197+0000 7f92aea00640 1 -- 172.21.15.114:0/3253198105 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f92a8069b00 con 0x7f9288073580 2024-09-16T07:35:12.197 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:12.197+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.197+0000 7f929fe00640 1 -- 172.21.15.114:0/3253198105 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f92a8069b00 con 0x7f9288073580 2024-09-16T07:35:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:12.207 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:12.208 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot ls non_existent_subvolume group_1 2024-09-16T07:35:12.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 -- 172.21.15.114:0/493260513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0a015be10 msgr2=0x7fc0a00ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:12.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 --2- 172.21.15.114:0/493260513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0a015be10 0x7fc0a00ce700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc090009bc0 tx=0x7fc09001cac0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 -- 172.21.15.114:0/493260513 shutdown_connections 2024-09-16T07:35:12.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 --2- 172.21.15.114:0/493260513 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0a00b0b60 0x7fc0a00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 --2- 172.21.15.114:0/493260513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0a015be10 0x7fc0a00ce700 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 -- 172.21.15.114:0/493260513 >> 172.21.15.114:0/493260513 conn(0x7fc0a00d1da0 msgr2=0x7fc0a00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 -- 172.21.15.114:0/493260513 shutdown_connections 2024-09-16T07:35:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.353+0000 7fc0a5c00640 1 -- 172.21.15.114:0/493260513 wait complete. 2024-09-16T07:35:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 Processor -- start 2024-09-16T07:35:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 -- start start 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0a00b0b60 0x7fc0a0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a015be10 0x7fc0a00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0a015c1f0 0x7fc0a0154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a0169040 con 0x7fc0a015be10 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a0168ec0 con 0x7fc0a015c1f0 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a01691c0 con 0x7fc0a00b0b60 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a015be10 0x7fc0a00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a015be10 0x7fc0a00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48376/0 (socket says 172.21.15.114:48376) 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 -- 172.21.15.114:0/2797638938 learned_addr learned my addr 172.21.15.114:0/2797638938 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:12.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09ea00640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0a00b0b60 0x7fc0a0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09f400640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0a015c1f0 0x7fc0a0154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 -- 172.21.15.114:0/2797638938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0a00b0b60 msgr2=0x7fc0a0155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0a00b0b60 0x7fc0a0155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 -- 172.21.15.114:0/2797638938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0a015c1f0 msgr2=0x7fc0a0154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0a015c1f0 0x7fc0a0154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 -- 172.21.15.114:0/2797638938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a01514d0 con 0x7fc0a015be10 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc09e000640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0a015be10 0x7fc0a00b4bf0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c530 tx=0x7fc08c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc096a00640 1 -- 172.21.15.114:0/2797638938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c016020 con 0x7fc0a015be10 2024-09-16T07:35:12.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc096a00640 1 -- 172.21.15.114:0/2797638938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc08c012940 con 0x7fc0a015be10 2024-09-16T07:35:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc096a00640 1 -- 172.21.15.114:0/2797638938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c012d90 con 0x7fc0a015be10 2024-09-16T07:35:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 -- 172.21.15.114:0/2797638938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a01517b0 con 0x7fc0a015be10 2024-09-16T07:35:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.357+0000 7fc0a5c00640 1 -- 172.21.15.114:0/2797638938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a00c7060 con 0x7fc0a015be10 2024-09-16T07:35:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.361+0000 7fc0a5c00640 1 -- 172.21.15.114:0/2797638938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a00ccbd0 con 0x7fc0a015be10 2024-09-16T07:35:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.361+0000 7fc096a00640 1 -- 172.21.15.114:0/2797638938 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fc08c019020 con 0x7fc0a015be10 2024-09-16T07:35:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.361+0000 7fc096a00640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc080073580 0x7fc080075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.361+0000 7fc096a00640 1 -- 172.21.15.114:0/2797638938 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fc08c094b20 con 0x7fc0a015be10 2024-09-16T07:35:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.361+0000 7fc09ea00640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc080073580 0x7fc080075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.361+0000 7fc09ea00640 1 --2- 172.21.15.114:0/2797638938 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc080073580 0x7fc080075a40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0900af000 tx=0x7fc09001b300 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.365+0000 7fc096a00640 1 -- 172.21.15.114:0/2797638938 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc08c020020 con 0x7fc0a015be10 2024-09-16T07:35:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.561+0000 7fc0a5c00640 1 -- 172.21.15.114:0/2797638938 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot ls", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7fc0a0151280 con 0x7fc080073580 2024-09-16T07:35:12.559 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:12.561+0000 7f4e12e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-16T07:35:12.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.561+0000 7fc096a00640 1 -- 172.21.15.114:0/2797638938 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fc0a0151280 con 0x7fc080073580 2024-09-16T07:35:12.560 INFO:teuthology.orchestra.run.smithi114.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-16T07:35:12.567 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-16T07:35:12.568 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:35:12.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:35:12.640 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:35:12.713 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:35:12.713 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:12.714 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:12.714 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:12.722 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:12.722 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:12.774 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 -- 172.21.15.114:0/495087971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 msgr2=0x7f33901602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 --2- 172.21.15.114:0/495087971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f33901602b0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3380009900 tx=0x7f338001c870 comp rx=0 tx=0).stop 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 -- 172.21.15.114:0/495087971 shutdown_connections 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 --2- 172.21.15.114:0/495087971 >> v2:172.21.15.149:3300/0 conn(0x7f3390074880 0x7f33900cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 --2- 172.21.15.114:0/495087971 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f33900cd0b0 0x7f3390074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 --2- 172.21.15.114:0/495087971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f33901602b0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 -- 172.21.15.114:0/495087971 >> 172.21.15.114:0/495087971 conn(0x7f3390073490 msgr2=0x7f33900d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 -- 172.21.15.114:0/495087971 shutdown_connections 2024-09-16T07:35:12.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.961+0000 7f3395600640 1 -- 172.21.15.114:0/495087971 wait complete. 2024-09-16T07:35:12.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 Processor -- start 2024-09-16T07:35:12.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 -- start start 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3390074880 0x7f33900c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f339015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33900cd0b0 0x7f339015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f339015c4d0 con 0x7f33900cccd0 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f339015c350 con 0x7f33900cd0b0 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f339015c650 con 0x7f3390074880 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f339015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f339015acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48388/0 (socket says 172.21.15.114:48388) 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 -- 172.21.15.114:0/2810429759 learned_addr learned my addr 172.21.15.114:0/2810429759 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f338fe00640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3390074880 0x7f33900c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3394c00640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33900cd0b0 0x7f339015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 -- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3390074880 msgr2=0x7f33900c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3390074880 0x7f33900c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 -- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33900cd0b0 msgr2=0x7f339015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33900cd0b0 0x7f339015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 -- 172.21.15.114:0/2810429759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33900b2710 con 0x7f33900cccd0 2024-09-16T07:35:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3394c00640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33900cd0b0 0x7f339015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3387400640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f339015acf0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f337800d720 tx=0x7f337800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:12.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f338cc00640 1 -- 172.21.15.114:0/2810429759 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378017070 con 0x7f33900cccd0 2024-09-16T07:35:12.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f338cc00640 1 -- 172.21.15.114:0/2810429759 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3378009d20 con 0x7f33900cccd0 2024-09-16T07:35:12.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f338cc00640 1 -- 172.21.15.114:0/2810429759 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3378005280 con 0x7f33900cccd0 2024-09-16T07:35:12.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33900b29f0 con 0x7f33900cccd0 2024-09-16T07:35:12.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33900c6010 con 0x7f33900cccd0 2024-09-16T07:35:12.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.965+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339015cc40 con 0x7f33900cccd0 2024-09-16T07:35:12.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.969+0000 7f338cc00640 1 -- 172.21.15.114:0/2810429759 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f3378005420 con 0x7f33900cccd0 2024-09-16T07:35:12.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.969+0000 7f338cc00640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f336c073580 0x7f336c075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:12.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.969+0000 7f338cc00640 1 -- 172.21.15.114:0/2810429759 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f3378094bd0 con 0x7f33900cccd0 2024-09-16T07:35:12.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.969+0000 7f338fe00640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f336c073580 0x7f336c075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:12.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.969+0000 7f338fe00640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f336c073580 0x7f336c075a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f33800af000 tx=0x7f338001b0b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:12.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:12.973+0000 7f338cc00640 1 -- 172.21.15.114:0/2810429759 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f337805ecd0 con 0x7f33900cccd0 2024-09-16T07:35:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.149+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f33900cdc50 con 0x7f33900cccd0 2024-09-16T07:35:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.149+0000 7f338cc00640 1 -- 172.21.15.114:0/2810429759 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7f3378094e20 con 0x7f33900cccd0 2024-09-16T07:35:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:35:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f336c073580 msgr2=0x7f336c075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f336c073580 0x7f336c075a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f33800af000 tx=0x7f338001b0b0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 msgr2=0x7f339015acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f339015acf0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f337800d720 tx=0x7f337800dbe0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 shutdown_connections 2024-09-16T07:35:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33900cd0b0 0x7f339015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f33900cccd0 0x7f339015acf0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f336c073580 0x7f336c075a40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 --2- 172.21.15.114:0/2810429759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3390074880 0x7f33900c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 >> 172.21.15.114:0/2810429759 conn(0x7f3390073490 msgr2=0x7f3390164ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:13.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 shutdown_connections 2024-09-16T07:35:13.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.153+0000 7f3395600640 1 -- 172.21.15.114:0/2810429759 wait complete. 2024-09-16T07:35:13.171 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:35:13.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:13.172 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:13.197 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:35:13.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:13.197 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:35:13.249 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:13.250 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:13.250 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:13.259 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:13.260 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:13.311 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:35:13.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- 172.21.15.114:0/3078630253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 msgr2=0x7fd9e00ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 --2- 172.21.15.114:0/3078630253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e00ce5e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00d0f60 tx=0x7fd9d401c6e0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- 172.21.15.114:0/3078630253 shutdown_connections 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 --2- 172.21.15.114:0/3078630253 >> v2:172.21.15.149:3300/0 conn(0x7fd9e00cf4e0 0x7fd9e00cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 --2- 172.21.15.114:0/3078630253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e00ce5e0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- 172.21.15.114:0/3078630253 >> 172.21.15.114:0/3078630253 conn(0x7fd9e00d1ea0 msgr2=0x7fd9e00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- 172.21.15.114:0/3078630253 shutdown_connections 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- 172.21.15.114:0/3078630253 wait complete. 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 Processor -- start 2024-09-16T07:35:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- start start 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9e00cf4e0 0x7fd9e015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9e015c130 0x7fd9e014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0168e50 con 0x7fd9e015bd50 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0168cd0 con 0x7fd9e00cf4e0 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e8400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e0168fd0 con 0x7fd9e015c130 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e01593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48416/0 (socket says 172.21.15.114:48416) 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 -- 172.21.15.114:0/1511419884 learned_addr learned my addr 172.21.15.114:0/1511419884 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5a00640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9e00cf4e0 0x7fd9e015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e6400640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9e015c130 0x7fd9e014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 -- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9e015c130 msgr2=0x7fd9e014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9e015c130 0x7fd9e014e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 -- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9e00cf4e0 msgr2=0x7fd9e015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9e00cf4e0 0x7fd9e015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 -- 172.21.15.114:0/1511419884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e0071c60 con 0x7fd9e015bd50 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.457+0000 7fd9e5000640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e01593d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c400 tx=0x7fd9cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9dd600640 1 -- 172.21.15.114:0/1511419884 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc011790 con 0x7fd9e015bd50 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9dd600640 1 -- 172.21.15.114:0/1511419884 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9cc017070 con 0x7fd9e015bd50 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e00c9390 con 0x7fd9e015bd50 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9dd600640 1 -- 172.21.15.114:0/1511419884 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc011cc0 con 0x7fd9e015bd50 2024-09-16T07:35:13.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e0158bd0 con 0x7fd9e015bd50 2024-09-16T07:35:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e01586e0 con 0x7fd9e015bd50 2024-09-16T07:35:13.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9dd600640 1 -- 172.21.15.114:0/1511419884 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fd9cc01c460 con 0x7fd9e015bd50 2024-09-16T07:35:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9dd600640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9c0073580 0x7fd9c0075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9dd600640 1 -- 172.21.15.114:0/1511419884 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fd9cc0948b0 con 0x7fd9e015bd50 2024-09-16T07:35:13.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.461+0000 7fd9e5a00640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9c0073580 0x7fd9c0075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.465+0000 7fd9e5a00640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9c0073580 0x7fd9c0075a40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40af000 tx=0x7fd9d401af20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:13.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.465+0000 7fd9dd600640 1 -- 172.21.15.114:0/1511419884 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd9cc05f080 con 0x7fd9e015bd50 2024-09-16T07:35:13.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.645+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd9e00ce5e0 con 0x7fd9e015bd50 2024-09-16T07:35:13.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9dd600640 1 -- 172.21.15.114:0/1511419884 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7fd9cc05e980 con 0x7fd9e015bd50 2024-09-16T07:35:13.646 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9c0073580 msgr2=0x7fd9c0075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9c0073580 0x7fd9c0075a40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40af000 tx=0x7fd9d401af20 comp rx=0 tx=0).stop 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 msgr2=0x7fd9e01593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e01593d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c400 tx=0x7fd9cc00c8c0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 shutdown_connections 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9c0073580 0x7fd9c0075a40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9e015c130 0x7fd9e014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9e015bd50 0x7fd9e01593d0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 --2- 172.21.15.114:0/1511419884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9e00cf4e0 0x7fd9e015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 >> 172.21.15.114:0/1511419884 conn(0x7fd9e00d1ea0 msgr2=0x7fd9e00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 shutdown_connections 2024-09-16T07:35:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.649+0000 7fd9e8400640 1 -- 172.21.15.114:0/1511419884 wait complete. 2024-09-16T07:35:13.668 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:35:13.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:13.668 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:13.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:35:13.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:13.694 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:35:13.743 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:13.766 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:13.766 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:13.778 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:35:13.778 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:13.778 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:13.778 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:13.797 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:35:13.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:13.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- 172.21.15.114:0/724705925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f415db50 msgr2=0x7f91f40acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 --2- 172.21.15.114:0/724705925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f415db50 0x7f91f40acd40 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009900 tx=0x7f91e401c850 comp rx=0 tx=0).stop 2024-09-16T07:35:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- 172.21.15.114:0/724705925 shutdown_connections 2024-09-16T07:35:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 --2- 172.21.15.114:0/724705925 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f40b4a50 0x7f91f40ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 --2- 172.21.15.114:0/724705925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f415db50 0x7f91f40acd40 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- 172.21.15.114:0/724705925 >> 172.21.15.114:0/724705925 conn(0x7f91f40b18f0 msgr2=0x7f91f40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- 172.21.15.114:0/724705925 shutdown_connections 2024-09-16T07:35:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- 172.21.15.114:0/724705925 wait complete. 2024-09-16T07:35:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 Processor -- start 2024-09-16T07:35:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- start start 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f40b4a50 0x7f91f41f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f40cd100 0x7f91f415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f415db50 0x7f91f4164900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f91f4167120 con 0x7f91f40b4a50 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91f40cf550 con 0x7f91f415db50 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91fa400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f91f41672a0 con 0x7f91f40cd100 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f40b4a50 0x7f91f41f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f40b4a50 0x7f91f41f8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48442/0 (socket says 172.21.15.114:48442) 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 -- 172.21.15.114:0/955767549 learned_addr learned my addr 172.21.15.114:0/955767549 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3e00640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f415db50 0x7f91f4164900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f2a00640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f40cd100 0x7f91f415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 -- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f40cd100 msgr2=0x7f91f415caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f40cd100 0x7f91f415caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 -- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f415db50 msgr2=0x7f91f4164900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:13.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f415db50 0x7f91f4164900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:13.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 -- 172.21.15.114:0/955767549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f41f9070 con 0x7f91f40b4a50 2024-09-16T07:35:13.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f2a00640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f40cd100 0x7f91f415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:13.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.981+0000 7f91f3400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f40b4a50 0x7f91f41f8b30 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009850 tx=0x7f91e4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91eb400640 1 -- 172.21.15.114:0/955767549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e40b2040 con 0x7f91f40b4a50 2024-09-16T07:35:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91eb400640 1 -- 172.21.15.114:0/955767549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91e4004240 con 0x7f91f40b4a50 2024-09-16T07:35:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91eb400640 1 -- 172.21.15.114:0/955767549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e4005030 con 0x7f91f40b4a50 2024-09-16T07:35:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f40addc0 con 0x7f91f40b4a50 2024-09-16T07:35:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f41f8330 con 0x7f91f40b4a50 2024-09-16T07:35:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91f4069410 con 0x7f91f40b4a50 2024-09-16T07:35:13.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91eb400640 1 -- 172.21.15.114:0/955767549 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f91e40051d0 con 0x7f91f40b4a50 2024-09-16T07:35:13.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91eb400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91d40735b0 0x7f91d4075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:13.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91eb400640 1 -- 172.21.15.114:0/955767549 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f91e412e370 con 0x7f91f40b4a50 2024-09-16T07:35:13.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.985+0000 7f91f2a00640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91d40735b0 0x7f91d4075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.989+0000 7f91f2a00640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91d40735b0 0x7f91d4075a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91f40ace40 tx=0x7f91e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:13.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:13.989+0000 7f91eb400640 1 -- 172.21.15.114:0/955767549 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f91f41f9070 con 0x7f91f40b4a50 2024-09-16T07:35:14.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.193+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91f40ce810 con 0x7f91f40b4a50 2024-09-16T07:35:14.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.193+0000 7f91eb400640 1 -- 172.21.15.114:0/955767549 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5227 (secure 0 0 0) 0x7f91e40164d0 con 0x7f91f40b4a50 2024-09-16T07:35:14.193 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:14.194 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"btime":"2024-09-16T07:35:03:473504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/480729207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":480729207},{"type":"v1","addr":"172.21.15.114:6833","nonce":480729207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/3104829839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3104829839},{"type":"v1","addr":"172.21.15.149:6834","nonce":3104829839}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/44383065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":44383065},{"type":"v1","addr":"172.21.15.149:6835","nonce":44383065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:49.262936+0000","modified":"2024-09-16T07:34:52.287252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7923":{"gid":7923,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/710167418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":710167418},{"type":"v1","addr":"172.21.15.114:6835","nonce":710167418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7923,"qdb_cluster":[7923]},"id":10}]} 2024-09-16T07:35:14.194 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2024-09-16T07:35:14.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91d40735b0 msgr2=0x7f91d4075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91d40735b0 0x7f91d4075a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f91f40ace40 tx=0x7f91e0009040 comp rx=0 tx=0).stop 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f40b4a50 msgr2=0x7f91f41f8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f40b4a50 0x7f91f41f8b30 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009850 tx=0x7f91e4005760 comp rx=0 tx=0).stop 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 shutdown_connections 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f415db50 0x7f91f4164900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f91d40735b0 0x7f91d4075a70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f40cd100 0x7f91f415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 --2- 172.21.15.114:0/955767549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91f40b4a50 0x7f91f41f8b30 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 >> 172.21.15.114:0/955767549 conn(0x7f91f40b18f0 msgr2=0x7f91f4150820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 shutdown_connections 2024-09-16T07:35:14.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.197+0000 7f91fa400640 1 -- 172.21.15.114:0/955767549 wait complete. 2024-09-16T07:35:14.214 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 -- 172.21.15.114:0/3180398684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 msgr2=0x7f3a240d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 --2- 172.21.15.114:0/3180398684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a240d0540 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f3a240c7510 tx=0x7f3a1401c890 comp rx=0 tx=0).stop 2024-09-16T07:35:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 -- 172.21.15.114:0/3180398684 shutdown_connections 2024-09-16T07:35:14.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 --2- 172.21.15.114:0/3180398684 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a240d0fc0 0x7f3a240d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 --2- 172.21.15.114:0/3180398684 >> v2:172.21.15.149:3300/0 conn(0x7f3a241617b0 0x7f3a240d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 --2- 172.21.15.114:0/3180398684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a240d0540 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 -- 172.21.15.114:0/3180398684 >> 172.21.15.114:0/3180398684 conn(0x7f3a240d3e00 msgr2=0x7f3a240d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 -- 172.21.15.114:0/3180398684 shutdown_connections 2024-09-16T07:35:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 -- 172.21.15.114:0/3180398684 wait complete. 2024-09-16T07:35:14.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 Processor -- start 2024-09-16T07:35:14.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.357+0000 7f3a23e00640 1 -- start start 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a240d0fc0 0x7f3a24150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a24159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a241617b0 0x7f3a241507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240b7100 con 0x7f3a241613d0 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240b6f80 con 0x7f3a241617b0 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3a240b7280 con 0x7f3a240d0fc0 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a24159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a24159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36314/0 (socket says 172.21.15.114:36314) 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 -- 172.21.15.114:0/2240346030 learned_addr learned my addr 172.21.15.114:0/2240346030 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22a00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a240d0fc0 0x7f3a24150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23400640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a241617b0 0x7f3a241507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 -- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a240d0fc0 msgr2=0x7f3a24150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a240d0fc0 0x7f3a24150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 -- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a241617b0 msgr2=0x7f3a241507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a241617b0 0x7f3a241507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 -- 172.21.15.114:0/2240346030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a240c8020 con 0x7f3a241613d0 2024-09-16T07:35:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23400640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a241617b0 0x7f3a241507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a22000640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a24159740 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000d780 tx=0x7f3a1000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a1aa00640 1 -- 172.21.15.114:0/2240346030 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10017070 con 0x7f3a241613d0 2024-09-16T07:35:14.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a1aa00640 1 -- 172.21.15.114:0/2240346030 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a1000de90 con 0x7f3a241613d0 2024-09-16T07:35:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a240c8300 con 0x7f3a241613d0 2024-09-16T07:35:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a1aa00640 1 -- 172.21.15.114:0/2240346030 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a100099d0 con 0x7f3a241613d0 2024-09-16T07:35:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a240c88c0 con 0x7f3a241613d0 2024-09-16T07:35:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a240d19d0 con 0x7f3a241613d0 2024-09-16T07:35:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.361+0000 7f3a1aa00640 1 -- 172.21.15.114:0/2240346030 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f3a10009b70 con 0x7f3a241613d0 2024-09-16T07:35:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.365+0000 7f3a1aa00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a04073580 0x7f3a04075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.365+0000 7f3a1aa00640 1 -- 172.21.15.114:0/2240346030 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f3a10094b50 con 0x7f3a241613d0 2024-09-16T07:35:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.365+0000 7f3a22a00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a04073580 0x7f3a04075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.365+0000 7f3a22a00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a04073580 0x7f3a04075a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a140af000 tx=0x7f3a1401b0d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:14.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.369+0000 7f3a1aa00640 1 -- 172.21.15.114:0/2240346030 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3a1005ec50 con 0x7f3a241613d0 2024-09-16T07:35:14.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.569+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a241517e0 con 0x7f3a241613d0 2024-09-16T07:35:14.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.569+0000 7f3a1aa00640 1 -- 172.21.15.114:0/2240346030 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5227 (secure 0 0 0) 0x7f3a10063680 con 0x7f3a241613d0 2024-09-16T07:35:14.570 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:14.570 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"btime":"2024-09-16T07:35:03:473504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/480729207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":480729207},{"type":"v1","addr":"172.21.15.114:6833","nonce":480729207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/3104829839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3104829839},{"type":"v1","addr":"172.21.15.149:6834","nonce":3104829839}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/44383065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":44383065},{"type":"v1","addr":"172.21.15.149:6835","nonce":44383065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:49.262936+0000","modified":"2024-09-16T07:34:52.287252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7923":{"gid":7923,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/710167418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":710167418},{"type":"v1","addr":"172.21.15.114:6835","nonce":710167418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7923,"qdb_cluster":[7923]},"id":10}]} 2024-09-16T07:35:14.570 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2024-09-16T07:35:14.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a04073580 msgr2=0x7f3a04075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a04073580 0x7f3a04075a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a140af000 tx=0x7f3a1401b0d0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 msgr2=0x7f3a24159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a24159740 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000d780 tx=0x7f3a1000dc40 comp rx=0 tx=0).stop 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 shutdown_connections 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3a241617b0 0x7f3a241507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a241613d0 0x7f3a24159740 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3a04073580 0x7f3a04075a40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 --2- 172.21.15.114:0/2240346030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3a240d0fc0 0x7f3a24150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 >> 172.21.15.114:0/2240346030 conn(0x7f3a240d3e00 msgr2=0x7f3a2415a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 shutdown_connections 2024-09-16T07:35:14.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.573+0000 7f3a23e00640 1 -- 172.21.15.114:0/2240346030 wait complete. 2024-09-16T07:35:14.591 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 -- 172.21.15.114:0/4283796519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 msgr2=0x7fce680cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 --2- 172.21.15.114:0/4283796519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680cebb0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fce60009840 tx=0x7fce6001c820 comp rx=0 tx=0).stop 2024-09-16T07:35:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 -- 172.21.15.114:0/4283796519 shutdown_connections 2024-09-16T07:35:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 --2- 172.21.15.114:0/4283796519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680cebb0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 --2- 172.21.15.114:0/4283796519 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce6815bea0 0x7fce680ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 -- 172.21.15.114:0/4283796519 >> 172.21.15.114:0/4283796519 conn(0x7fce680d1dc0 msgr2=0x7fce680d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:14.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 -- 172.21.15.114:0/4283796519 shutdown_connections 2024-09-16T07:35:14.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.733+0000 7fce70600640 1 -- 172.21.15.114:0/4283796519 wait complete. 2024-09-16T07:35:14.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 Processor -- start 2024-09-16T07:35:14.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 -- start start 2024-09-16T07:35:14.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce680cdb30 0x7fce68151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce6815bea0 0x7fce680c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce68169020 con 0x7fce680d28e0 2024-09-16T07:35:14.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce68168ea0 con 0x7fce6815bea0 2024-09-16T07:35:14.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fce681691a0 con 0x7fce680cdb30 2024-09-16T07:35:14.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36328/0 (socket says 172.21.15.114:36328) 2024-09-16T07:35:14.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 -- 172.21.15.114:0/4106233979 learned_addr learned my addr 172.21.15.114:0/4106233979 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:14.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6dc00640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce680cdb30 0x7fce68151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6e600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce6815bea0 0x7fce680c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 -- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce680cdb30 msgr2=0x7fce68151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce680cdb30 0x7fce68151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 -- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce6815bea0 msgr2=0x7fce680c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce6815bea0 0x7fce680c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 -- 172.21.15.114:0/4106233979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce680c9600 con 0x7fce680d28e0 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6e600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce6815bea0 0x7fce680c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce6d200640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680b3f20 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fce5400c4c0 tx=0x7fce5400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce65600640 1 -- 172.21.15.114:0/4106233979 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54016020 con 0x7fce680d28e0 2024-09-16T07:35:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce65600640 1 -- 172.21.15.114:0/4106233979 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce54012940 con 0x7fce680d28e0 2024-09-16T07:35:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce65600640 1 -- 172.21.15.114:0/4106233979 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54012d90 con 0x7fce680d28e0 2024-09-16T07:35:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce680c98e0 con 0x7fce680d28e0 2024-09-16T07:35:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.737+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce680c9ea0 con 0x7fce680d28e0 2024-09-16T07:35:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.741+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce680cc9d0 con 0x7fce680d28e0 2024-09-16T07:35:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.741+0000 7fce65600640 1 -- 172.21.15.114:0/4106233979 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fce54019020 con 0x7fce680d28e0 2024-09-16T07:35:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.741+0000 7fce65600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce48073580 0x7fce48075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.741+0000 7fce65600640 1 -- 172.21.15.114:0/4106233979 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fce54094b00 con 0x7fce680d28e0 2024-09-16T07:35:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.741+0000 7fce6dc00640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce48073580 0x7fce48075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.741+0000 7fce6dc00640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce48073580 0x7fce48075a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fce680b2aa0 tx=0x7fce5c009630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.745+0000 7fce65600640 1 -- 172.21.15.114:0/4106233979 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fce54020020 con 0x7fce680d28e0 2024-09-16T07:35:14.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.913+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce681f8480 con 0x7fce680d28e0 2024-09-16T07:35:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.913+0000 7fce65600640 1 -- 172.21.15.114:0/4106233979 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16831 (secure 0 0 0) 0x7fce5405f280 con 0x7fce680d28e0 2024-09-16T07:35:14.914 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:14.914 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":129,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:50.882652+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:46.952845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:48.237188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:14.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce48073580 msgr2=0x7fce48075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce48073580 0x7fce48075a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fce680b2aa0 tx=0x7fce5c009630 comp rx=0 tx=0).stop 2024-09-16T07:35:14.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 msgr2=0x7fce680b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:14.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680b3f20 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fce5400c4c0 tx=0x7fce5400c980 comp rx=0 tx=0).stop 2024-09-16T07:35:14.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 shutdown_connections 2024-09-16T07:35:14.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce6815bea0 0x7fce680c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce680d28e0 0x7fce680b3f20 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fce48073580 0x7fce48075a40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 --2- 172.21.15.114:0/4106233979 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fce680cdb30 0x7fce68151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:14.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 >> 172.21.15.114:0/4106233979 conn(0x7fce680d1dc0 msgr2=0x7fce68158530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:14.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 shutdown_connections 2024-09-16T07:35:14.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:14.917+0000 7fce70600640 1 -- 172.21.15.114:0/4106233979 wait complete. 2024-09-16T07:35:14.936 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:35:14.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- 172.21.15.114:0/1886564007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e40cebf0 msgr2=0x7fe7e40cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/1886564007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e40cebf0 0x7fe7e40cc8b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009c80 tx=0x7fe7cc01cda0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- 172.21.15.114:0/1886564007 shutdown_connections 2024-09-16T07:35:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/1886564007 >> v2:172.21.15.149:3300/0 conn(0x7fe7e40b6400 0x7fe7e40ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/1886564007 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e40cebf0 0x7fe7e40cc8b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- 172.21.15.114:0/1886564007 >> 172.21.15.114:0/1886564007 conn(0x7fe7e40d1da0 msgr2=0x7fe7e40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- 172.21.15.114:0/1886564007 shutdown_connections 2024-09-16T07:35:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- 172.21.15.114:0/1886564007 wait complete. 2024-09-16T07:35:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 Processor -- start 2024-09-16T07:35:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- start start 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7e40b6400 0x7fe7e40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e40cebf0 0x7fe7e414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e415be80 0x7fe7e4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e41692b0 con 0x7fe7e40b6400 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e4169130 con 0x7fe7e40cebf0 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e9a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e4169430 con 0x7fe7e415be80 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7e40b6400 0x7fe7e40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7e40b6400 0x7fe7e40c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36344/0 (socket says 172.21.15.114:36344) 2024-09-16T07:35:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7da000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e40cebf0 0x7fe7e414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 -- 172.21.15.114:0/3950462134 learned_addr learned my addr 172.21.15.114:0/3950462134 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:15.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e3400640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e415be80 0x7fe7e4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 -- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e415be80 msgr2=0x7fe7e4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e415be80 0x7fe7e4155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 -- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e40cebf0 msgr2=0x7fe7e414f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e40cebf0 0x7fe7e414f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 -- 172.21.15.114:0/3950462134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e40b2bc0 con 0x7fe7e40b6400 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7da000640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e40cebf0 0x7fe7e414f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.081+0000 7fe7e2a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7e40b6400 0x7fe7e40c6c20 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c3c0 tx=0x7fe7d400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7db400640 1 -- 172.21.15.114:0/3950462134 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4017070 con 0x7fe7e40b6400 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7db400640 1 -- 172.21.15.114:0/3950462134 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7d40053c0 con 0x7fe7e40b6400 2024-09-16T07:35:15.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7db400640 1 -- 172.21.15.114:0/3950462134 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4003860 con 0x7fe7e40b6400 2024-09-16T07:35:15.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e40c7160 con 0x7fe7e40b6400 2024-09-16T07:35:15.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e41f8ee0 con 0x7fe7e40b6400 2024-09-16T07:35:15.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e40ce4e0 con 0x7fe7e40b6400 2024-09-16T07:35:15.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7db400640 1 -- 172.21.15.114:0/3950462134 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fe7d401a070 con 0x7fe7e40b6400 2024-09-16T07:35:15.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7db400640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7c00735b0 0x7fe7c0075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7db400640 1 -- 172.21.15.114:0/3950462134 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fe7d4093ee0 con 0x7fe7e40b6400 2024-09-16T07:35:15.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.085+0000 7fe7da000640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7c00735b0 0x7fe7c0075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.089+0000 7fe7da000640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7c00735b0 0x7fe7c0075a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0af000 tx=0x7fe7cc01b5e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:15.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.089+0000 7fe7db400640 1 -- 172.21.15.114:0/3950462134 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe7e40d0350 con 0x7fe7e40b6400 2024-09-16T07:35:15.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.293+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7e41559b0 con 0x7fe7e40b6400 2024-09-16T07:35:15.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.293+0000 7fe7db400640 1 -- 172.21.15.114:0/3950462134 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5227 (secure 0 0 0) 0x7fe7d405df50 con 0x7fe7e40b6400 2024-09-16T07:35:15.292 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:15.292 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"btime":"2024-09-16T07:35:03:473504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/480729207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":480729207},{"type":"v1","addr":"172.21.15.114:6833","nonce":480729207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/3104829839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3104829839},{"type":"v1","addr":"172.21.15.149:6834","nonce":3104829839}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/44383065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":44383065},{"type":"v1","addr":"172.21.15.149:6835","nonce":44383065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:49.262936+0000","modified":"2024-09-16T07:34:52.287252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7923":{"gid":7923,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/710167418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":710167418},{"type":"v1","addr":"172.21.15.114:6835","nonce":710167418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7923,"qdb_cluster":[7923]},"id":10}]} 2024-09-16T07:35:15.292 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2024-09-16T07:35:15.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.293+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7c00735b0 msgr2=0x7fe7c0075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.293+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7c00735b0 0x7fe7c0075a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0af000 tx=0x7fe7cc01b5e0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7e40b6400 msgr2=0x7fe7e40c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7e40b6400 0x7fe7e40c6c20 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c3c0 tx=0x7fe7d400c7c0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 shutdown_connections 2024-09-16T07:35:15.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7c00735b0 0x7fe7c0075a70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7e415be80 0x7fe7e4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7e40cebf0 0x7fe7e414f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 --2- 172.21.15.114:0/3950462134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7e40b6400 0x7fe7e40c6c20 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 >> 172.21.15.114:0/3950462134 conn(0x7fe7e40d1da0 msgr2=0x7fe7e4071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:15.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 shutdown_connections 2024-09-16T07:35:15.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.297+0000 7fe7e9a00640 1 -- 172.21.15.114:0/3950462134 wait complete. 2024-09-16T07:35:15.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 -- 172.21.15.114:0/1647161154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c071030 msgr2=0x7f863c0714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 --2- 172.21.15.114:0/1647161154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c071030 0x7f863c0714c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8634009840 tx=0x7f863401c7f0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 -- 172.21.15.114:0/1647161154 shutdown_connections 2024-09-16T07:35:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 --2- 172.21.15.114:0/1647161154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c071030 0x7f863c0714c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 --2- 172.21.15.114:0/1647161154 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c06cc20 0x7f863c0737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 -- 172.21.15.114:0/1647161154 >> 172.21.15.114:0/1647161154 conn(0x7f863c0d0c90 msgr2=0x7f863c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 -- 172.21.15.114:0/1647161154 shutdown_connections 2024-09-16T07:35:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.457+0000 7f8642a00640 1 -- 172.21.15.114:0/1647161154 wait complete. 2024-09-16T07:35:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 Processor -- start 2024-09-16T07:35:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 -- start start 2024-09-16T07:35:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c06cc20 0x7f863c15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c071030 0x7f863c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15c1c0 0x7f863c158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f863c169020 con 0x7f863c071030 2024-09-16T07:35:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f863c168ea0 con 0x7f863c06cc20 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f863c1691a0 con 0x7f863c15c1c0 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c071030 0x7f863c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c071030 0x7f863c154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36346/0 (socket says 172.21.15.114:36346) 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 -- 172.21.15.114:0/2547077729 learned_addr learned my addr 172.21.15.114:0/2547077729 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f863be00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c06cc20 0x7f863c15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8640a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15c1c0 0x7f863c158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 -- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15c1c0 msgr2=0x7f863c158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15c1c0 0x7f863c158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 -- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c06cc20 msgr2=0x7f863c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c06cc20 0x7f863c15d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 -- 172.21.15.114:0/2547077729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c15fba0 con 0x7f863c071030 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8640a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15c1c0 0x7f863c158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f863be00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c06cc20 0x7f863c15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8633400640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c071030 0x7f863c154650 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f862400c400 tx=0x7f862400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8638c00640 1 -- 172.21.15.114:0/2547077729 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624011790 con 0x7f863c071030 2024-09-16T07:35:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8638c00640 1 -- 172.21.15.114:0/2547077729 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8624017070 con 0x7f863c071030 2024-09-16T07:35:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8638c00640 1 -- 172.21.15.114:0/2547077729 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624011cc0 con 0x7f863c071030 2024-09-16T07:35:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863c15fe80 con 0x7f863c071030 2024-09-16T07:35:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.461+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863c158670 con 0x7f863c071030 2024-09-16T07:35:15.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.465+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863c0737c0 con 0x7f863c071030 2024-09-16T07:35:15.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.465+0000 7f8638c00640 1 -- 172.21.15.114:0/2547077729 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f862401c460 con 0x7f863c071030 2024-09-16T07:35:15.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.465+0000 7f8638c00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8618073580 0x7f8618075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.465+0000 7f8638c00640 1 -- 172.21.15.114:0/2547077729 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f86240946b0 con 0x7f863c071030 2024-09-16T07:35:15.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.465+0000 7f863be00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8618073580 0x7f8618075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.465+0000 7f863be00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8618073580 0x7f8618075a40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f862c009f40 tx=0x7f862c009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:15.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.469+0000 7f8638c00640 1 -- 172.21.15.114:0/2547077729 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f862405f040 con 0x7f863c071030 2024-09-16T07:35:15.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.673+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f863c0b0020 con 0x7f863c071030 2024-09-16T07:35:15.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.673+0000 7f8638c00640 1 -- 172.21.15.114:0/2547077729 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5227 (secure 0 0 0) 0x7f862405e940 con 0x7f863c071030 2024-09-16T07:35:15.672 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:15.672 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":93,"btime":"2024-09-16T07:35:03:473504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/480729207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":480729207},{"type":"v1","addr":"172.21.15.114:6833","nonce":480729207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/3104829839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3104829839},{"type":"v1","addr":"172.21.15.149:6834","nonce":3104829839}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/44383065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":44383065},{"type":"v1","addr":"172.21.15.149:6835","nonce":44383065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:34:49.262936+0000","modified":"2024-09-16T07:34:52.287252+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7923":{"gid":7923,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/710167418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":710167418},{"type":"v1","addr":"172.21.15.114:6835","nonce":710167418}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7923,"qdb_cluster":[7923]},"id":10}]} 2024-09-16T07:35:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 93 2024-09-16T07:35:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8618073580 msgr2=0x7f8618075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8618073580 0x7f8618075a40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f862c009f40 tx=0x7f862c009500 comp rx=0 tx=0).stop 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c071030 msgr2=0x7f863c154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c071030 0x7f863c154650 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f862400c400 tx=0x7f862400c8c0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 shutdown_connections 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8618073580 0x7f8618075a40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f863c15c1c0 0x7f863c158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f863c071030 0x7f863c154650 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 --2- 172.21.15.114:0/2547077729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f863c06cc20 0x7f863c15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 >> 172.21.15.114:0/2547077729 conn(0x7f863c0d0c90 msgr2=0x7f863c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 shutdown_connections 2024-09-16T07:35:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.677+0000 7f8642a00640 1 -- 172.21.15.114:0/2547077729 wait complete. 2024-09-16T07:35:15.694 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:15.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.837+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3633637930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 msgr2=0x7f6cec00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.837+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3633637930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6cec00b9d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009ee0 tx=0x7f6cfc01d630 comp rx=0 tx=0).stop 2024-09-16T07:35:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.837+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3633637930 shutdown_connections 2024-09-16T07:35:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.837+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3633637930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6cec00b9d0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.837+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3633637930 >> 172.21.15.114:0/3633637930 conn(0x7f6d0406dd30 msgr2=0x7f6d0406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.837+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3633637930 shutdown_connections 2024-09-16T07:35:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.837+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3633637930 wait complete. 2024-09-16T07:35:15.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 Processor -- start 2024-09-16T07:35:15.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 -- start start 2024-09-16T07:35:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6d041f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040afdc0 0x7f6d040c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d040af7e0 0x7f6d041f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6d040ce3a0 con 0x7f6cec0051d0 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6d040ce220 con 0x7f6d040afdc0 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6d041605a0 con 0x7f6d040af7e0 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6d041f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6d041f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36368/0 (socket says 172.21.15.114:36368) 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 -- 172.21.15.114:0/3802076269 learned_addr learned my addr 172.21.15.114:0/3802076269 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0a200640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d040af7e0 0x7f6d041f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d08e00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040afdc0 0x7f6d040c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 -- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d040af7e0 msgr2=0x7f6d041f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d040af7e0 0x7f6d041f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 -- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040afdc0 msgr2=0x7f6d040c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040afdc0 0x7f6d040c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 -- 172.21.15.114:0/3802076269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d040c6360 con 0x7f6cec0051d0 2024-09-16T07:35:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d09800640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6d041f3cc0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800e570 tx=0x7f6cf800ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d01600640 1 -- 172.21.15.114:0/3802076269 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8015020 con 0x7f6cec0051d0 2024-09-16T07:35:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d01600640 1 -- 172.21.15.114:0/3802076269 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf800ca00 con 0x7f6cec0051d0 2024-09-16T07:35:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d01600640 1 -- 172.21.15.114:0/3802076269 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800ce50 con 0x7f6cec0051d0 2024-09-16T07:35:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d041f84c0 con 0x7f6cec0051d0 2024-09-16T07:35:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d040c7060 con 0x7f6cec0051d0 2024-09-16T07:35:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.841+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d040cc930 con 0x7f6cec0051d0 2024-09-16T07:35:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.845+0000 7f6d01600640 1 -- 172.21.15.114:0/3802076269 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f6cf8018020 con 0x7f6cec0051d0 2024-09-16T07:35:15.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.845+0000 7f6d01600640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ce40735b0 0x7f6ce4075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.845+0000 7f6d01600640 1 -- 172.21.15.114:0/3802076269 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f6cf80950d0 con 0x7f6cec0051d0 2024-09-16T07:35:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.845+0000 7f6d08e00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ce40735b0 0x7f6ce4075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.845+0000 7f6d08e00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ce40735b0 0x7f6ce4075a70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0000c10 tx=0x7f6cf0006b00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:15.849+0000 7f6d01600640 1 -- 172.21.15.114:0/3802076269 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6cf801f020 con 0x7f6cec0051d0 2024-09-16T07:35:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d04071a30 con 0x7f6cec0051d0 2024-09-16T07:35:16.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d01600640 1 -- 172.21.15.114:0/3802076269 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16831 (secure 0 0 0) 0x7f6cf805f790 con 0x7f6cec0051d0 2024-09-16T07:35:16.019 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:16.020 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":129,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:34:50.882652+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:34:46.952845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-16T07:34:48.237188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:16.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ce40735b0 msgr2=0x7f6ce4075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ce40735b0 0x7f6ce4075a70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0000c10 tx=0x7f6cf0006b00 comp rx=0 tx=0).stop 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 msgr2=0x7f6d041f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6d041f3cc0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800e570 tx=0x7f6cf800ea30 comp rx=0 tx=0).stop 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 shutdown_connections 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ce40735b0 0x7f6ce4075a70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6d040af7e0 0x7f6d041f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6d040afdc0 0x7f6d040c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 --2- 172.21.15.114:0/3802076269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6cec0051d0 0x7f6d041f3cc0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 >> 172.21.15.114:0/3802076269 conn(0x7f6d0406dd30 msgr2=0x7f6d040d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 shutdown_connections 2024-09-16T07:35:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.021+0000 7f6d0ac00640 1 -- 172.21.15.114:0/3802076269 wait complete. 2024-09-16T07:35:16.041 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 -- 172.21.15.114:0/3759206477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015df50 msgr2=0x7f169006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 --2- 172.21.15.114:0/3759206477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015df50 0x7f169006e740 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f1690161c00 tx=0x7f168001c830 comp rx=0 tx=0).stop 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 -- 172.21.15.114:0/3759206477 shutdown_connections 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 --2- 172.21.15.114:0/3759206477 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f16900b11d0 0x7f16900afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 --2- 172.21.15.114:0/3759206477 >> v2:172.21.15.149:3300/0 conn(0x7f169015e330 0x7f169006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 --2- 172.21.15.114:0/3759206477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015df50 0x7f169006e740 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 -- 172.21.15.114:0/3759206477 >> 172.21.15.114:0/3759206477 conn(0x7f16900d1dc0 msgr2=0x7f16900d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 -- 172.21.15.114:0/3759206477 shutdown_connections 2024-09-16T07:35:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.185+0000 7f1697800640 1 -- 172.21.15.114:0/3759206477 wait complete. 2024-09-16T07:35:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 Processor -- start 2024-09-16T07:35:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 -- start start 2024-09-16T07:35:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16900b11d0 0x7f16900c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f169015df50 0x7f1690155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015e330 0x7f16901562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f16900b2f30 con 0x7f169015e330 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16900b2db0 con 0x7f16900b11d0 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f16900b30b0 con 0x7f169015df50 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015e330 0x7f16901562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015e330 0x7f16901562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36390/0 (socket says 172.21.15.114:36390) 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 -- 172.21.15.114:0/346938036 learned_addr learned my addr 172.21.15.114:0/346938036 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1687e00640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f169015df50 0x7f1690155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 -- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f169015df50 msgr2=0x7f1690155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1694e00640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16900b11d0 0x7f16900c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f169015df50 0x7f1690155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 -- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16900b11d0 msgr2=0x7f16900c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16900b11d0 0x7f16900c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 -- 172.21.15.114:0/346938036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16900c8c90 con 0x7f169015e330 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1694e00640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16900b11d0 0x7f16900c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1687e00640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f169015df50 0x7f1690155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1695800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015e330 0x7f16901562b0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f168800ea20 tx=0x7f168800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f168d600640 1 -- 172.21.15.114:0/346938036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168800cde0 con 0x7f169015e330 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f168d600640 1 -- 172.21.15.114:0/346938036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1688004c40 con 0x7f169015e330 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f168d600640 1 -- 172.21.15.114:0/346938036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688005280 con 0x7f169015e330 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16900c76f0 con 0x7f169015e330 2024-09-16T07:35:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16900c7c70 con 0x7f169015e330 2024-09-16T07:35:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.189+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16900b35d0 con 0x7f169015e330 2024-09-16T07:35:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.193+0000 7f168d600640 1 -- 172.21.15.114:0/346938036 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f1688005420 con 0x7f169015e330 2024-09-16T07:35:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.193+0000 7f168d600640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f166c073580 0x7f166c075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.193+0000 7f168d600640 1 -- 172.21.15.114:0/346938036 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f16880955e0 con 0x7f169015e330 2024-09-16T07:35:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.193+0000 7f1694e00640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f166c073580 0x7f166c075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.193+0000 7f1694e00640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f166c073580 0x7f166c075a40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f16800af000 tx=0x7f168001b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.197+0000 7f168d600640 1 -- 172.21.15.114:0/346938036 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f16900c8c90 con 0x7f169015e330 2024-09-16T07:35:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.405+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f16900b1c20 con 0x7f169015e330 2024-09-16T07:35:16.404 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:35:16.405+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:35:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f168d600640 1 -- 172.21.15.114:0/346938036 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) ==== 161+0+0 (secure 0 0 0) 0x7f1688016030 con 0x7f169015e330 2024-09-16T07:35:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f166c073580 msgr2=0x7f166c075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f166c073580 0x7f166c075a40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f16800af000 tx=0x7f168001b070 comp rx=0 tx=0).stop 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015e330 msgr2=0x7f16901562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015e330 0x7f16901562b0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f168800ea20 tx=0x7f168800eee0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 shutdown_connections 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f169015e330 0x7f16901562b0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f166c073580 0x7f166c075a40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f169015df50 0x7f1690155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 --2- 172.21.15.114:0/346938036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16900b11d0 0x7f16900c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 >> 172.21.15.114:0/346938036 conn(0x7f16900d1dc0 msgr2=0x7f1690071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.409+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 shutdown_connections 2024-09-16T07:35:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.413+0000 7f1697800640 1 -- 172.21.15.114:0/346938036 wait complete. 2024-09-16T07:35:16.417 INFO:tasks.ceph.mds.a.smithi114.stderr: -3070> 2024-09-16T07:34:51.841+0000 7fc3d6200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:35:16.432 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:35:16.467 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 -- 172.21.15.114:0/2949490020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef40d1f80 msgr2=0x7f6ef415c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/2949490020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef40d1f80 0x7f6ef415c800 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009bc0 tx=0x7f6eec01cae0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 -- 172.21.15.114:0/2949490020 shutdown_connections 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/2949490020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef40d1f80 0x7f6ef415c800 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/2949490020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef415c060 0x7f6ef40d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 -- 172.21.15.114:0/2949490020 >> 172.21.15.114:0/2949490020 conn(0x7f6ef409aa10 msgr2=0x7f6ef409adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 -- 172.21.15.114:0/2949490020 shutdown_connections 2024-09-16T07:35:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.581+0000 7f6ef8c00640 1 -- 172.21.15.114:0/2949490020 wait complete. 2024-09-16T07:35:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 Processor -- start 2024-09-16T07:35:16.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 -- start start 2024-09-16T07:35:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef40d1f80 0x7f6ef41676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef415bc80 0x7f6ef4154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef415c060 0x7f6ef41fac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef40ccff0 con 0x7f6ef40d1f80 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef40cce70 con 0x7f6ef415c060 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef40cd170 con 0x7f6ef415bc80 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef40d1f80 0x7f6ef41676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef40d1f80 0x7f6ef41676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36420/0 (socket says 172.21.15.114:36420) 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 -- 172.21.15.114:0/3305095801 learned_addr learned my addr 172.21.15.114:0/3305095801 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef2800640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef415c060 0x7f6ef41fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1400640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef415bc80 0x7f6ef4154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 -- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef415bc80 msgr2=0x7f6ef4154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef415bc80 0x7f6ef4154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 -- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef415c060 msgr2=0x7f6ef41fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef415c060 0x7f6ef41fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 -- 172.21.15.114:0/3305095801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef4167c10 con 0x7f6ef40d1f80 2024-09-16T07:35:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef1e00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef40d1f80 0x7f6ef41676d0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c490 tx=0x7f6ee400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6eea000640 1 -- 172.21.15.114:0/3305095801 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4016020 con 0x7f6ef40d1f80 2024-09-16T07:35:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6eea000640 1 -- 172.21.15.114:0/3305095801 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ee4012940 con 0x7f6ef40d1f80 2024-09-16T07:35:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef41f8b00 con 0x7f6ef40d1f80 2024-09-16T07:35:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6eea000640 1 -- 172.21.15.114:0/3305095801 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4012d90 con 0x7f6ef40d1f80 2024-09-16T07:35:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.585+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef4165410 con 0x7f6ef40d1f80 2024-09-16T07:35:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.589+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef415c800 con 0x7f6ef40d1f80 2024-09-16T07:35:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.589+0000 7f6eea000640 1 -- 172.21.15.114:0/3305095801 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f6ee4019020 con 0x7f6ef40d1f80 2024-09-16T07:35:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.589+0000 7f6eea000640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ed4073580 0x7f6ed4075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.589+0000 7f6eea000640 1 -- 172.21.15.114:0/3305095801 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5823+0+0 (secure 0 0 0) 0x7f6ee4094870 con 0x7f6ef40d1f80 2024-09-16T07:35:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.589+0000 7f6ef1400640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ed4073580 0x7f6ed4075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.589+0000 7f6ef1400640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ed4073580 0x7f6ed4075a40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6ef41669d0 tx=0x7f6ee00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:16.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.593+0000 7f6eea000640 1 -- 172.21.15.114:0/3305095801 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6ee4020030 con 0x7f6ef40d1f80 2024-09-16T07:35:16.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:16.809+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6ef4070cb0 con 0x7f6ef40d1f80 2024-09-16T07:35:17.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.409+0000 7f6eea000640 1 -- 172.21.15.114:0/3305095801 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) ==== 104+0+0 (secure 0 0 0) 0x7f6ef4167c10 con 0x7f6ef40d1f80 2024-09-16T07:35:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ed4073580 msgr2=0x7f6ed4075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ed4073580 0x7f6ed4075a40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6ef41669d0 tx=0x7f6ee00091e0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef40d1f80 msgr2=0x7f6ef41676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef40d1f80 0x7f6ef41676d0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c490 tx=0x7f6ee400c950 comp rx=0 tx=0).stop 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 shutdown_connections 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ef415c060 0x7f6ef41fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6ed4073580 0x7f6ed4075a40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6ef415bc80 0x7f6ef4154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 --2- 172.21.15.114:0/3305095801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ef40d1f80 0x7f6ef41676d0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 >> 172.21.15.114:0/3305095801 conn(0x7f6ef409aa10 msgr2=0x7f6ef40b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 shutdown_connections 2024-09-16T07:35:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.413+0000 7f6ef8c00640 1 -- 172.21.15.114:0/3305095801 wait complete. 2024-09-16T07:35:17.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:35:17.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 -- 172.21.15.114:0/238857771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015be10 msgr2=0x7fcd700ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:17.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 --2- 172.21.15.114:0/238857771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015be10 0x7fcd700ce700 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fcd700b0fb0 tx=0x7fcd6001f0b0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 -- 172.21.15.114:0/238857771 shutdown_connections 2024-09-16T07:35:17.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 --2- 172.21.15.114:0/238857771 >> v2:172.21.15.149:3300/0 conn(0x7fcd700b0b60 0x7fcd700ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 --2- 172.21.15.114:0/238857771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015be10 0x7fcd700ce700 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 -- 172.21.15.114:0/238857771 >> 172.21.15.114:0/238857771 conn(0x7fcd700d1da0 msgr2=0x7fcd700d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:17.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 -- 172.21.15.114:0/238857771 shutdown_connections 2024-09-16T07:35:17.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.621+0000 7fcd77200640 1 -- 172.21.15.114:0/238857771 wait complete. 2024-09-16T07:35:17.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 Processor -- start 2024-09-16T07:35:17.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 -- start start 2024-09-16T07:35:17.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd700b0b60 0x7fcd701515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:17.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd7015be10 0x7fcd700c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:17.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015c1f0 0x7fcd70156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:17.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcd700cd4a0 con 0x7fcd7015c1f0 2024-09-16T07:35:17.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcd700cd320 con 0x7fcd700b0b60 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcd700cd620 con 0x7fcd7015be10 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015c1f0 0x7fcd70156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015c1f0 0x7fcd70156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36434/0 (socket says 172.21.15.114:36434) 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 -- 172.21.15.114:0/2137161579 learned_addr learned my addr 172.21.15.114:0/2137161579 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd6fe00640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd700b0b60 0x7fcd701515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd67400640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd7015be10 0x7fcd700c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 -- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd7015be10 msgr2=0x7fcd700c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd7015be10 0x7fcd700c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 -- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd700b0b60 msgr2=0x7fcd701515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd700b0b60 0x7fcd701515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 -- 172.21.15.114:0/2137161579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd701e5bd0 con 0x7fcd7015c1f0 2024-09-16T07:35:17.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd75200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015c1f0 0x7fcd70156620 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800ea20 tx=0x7fcd6800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:17.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd6cc00640 1 -- 172.21.15.114:0/2137161579 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800cde0 con 0x7fcd7015c1f0 2024-09-16T07:35:17.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd6cc00640 1 -- 172.21.15.114:0/2137161579 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd68004c40 con 0x7fcd7015c1f0 2024-09-16T07:35:17.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd701e5eb0 con 0x7fcd7015c1f0 2024-09-16T07:35:17.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd6cc00640 1 -- 172.21.15.114:0/2137161579 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68005280 con 0x7fcd7015c1f0 2024-09-16T07:35:17.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd701e6470 con 0x7fcd7015c1f0 2024-09-16T07:35:17.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.625+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd700cdb40 con 0x7fcd7015c1f0 2024-09-16T07:35:17.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.629+0000 7fcd6cc00640 1 -- 172.21.15.114:0/2137161579 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fcd68005420 con 0x7fcd7015c1f0 2024-09-16T07:35:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.629+0000 7fcd6cc00640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd4c0735b0 0x7fcd4c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.629+0000 7fcd6cc00640 1 -- 172.21.15.114:0/2137161579 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5823+0+0 (secure 0 0 0) 0x7fcd680954b0 con 0x7fcd7015c1f0 2024-09-16T07:35:17.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.629+0000 7fcd6fe00640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd4c0735b0 0x7fcd4c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:17.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.629+0000 7fcd6fe00640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd4c0735b0 0x7fcd4c075a70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcd600b2000 tx=0x7fcd6001d8f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:17.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.633+0000 7fcd6cc00640 1 -- 172.21.15.114:0/2137161579 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcd68016030 con 0x7fcd7015c1f0 2024-09-16T07:35:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:17.801+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd700d26a0 con 0x7fcd7015c1f0 2024-09-16T07:35:18.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd6cc00640 1 -- 172.21.15.114:0/2137161579 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) ==== 181+0+0 (secure 0 0 0) 0x7fcd6805f560 con 0x7fcd7015c1f0 2024-09-16T07:35:18.543 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:35:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd4c0735b0 msgr2=0x7fcd4c075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd4c0735b0 0x7fcd4c075a70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcd600b2000 tx=0x7fcd6001d8f0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015c1f0 msgr2=0x7fcd70156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015c1f0 0x7fcd70156620 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800ea20 tx=0x7fcd6800eee0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 shutdown_connections 2024-09-16T07:35:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd7015c1f0 0x7fcd70156620 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcd4c0735b0 0x7fcd4c075a70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcd7015be10 0x7fcd700c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 --2- 172.21.15.114:0/2137161579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd700b0b60 0x7fcd701515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 >> 172.21.15.114:0/2137161579 conn(0x7fcd700d1da0 msgr2=0x7fcd700cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 shutdown_connections 2024-09-16T07:35:18.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.545+0000 7fcd77200640 1 -- 172.21.15.114:0/2137161579 wait complete. 2024-09-16T07:35:18.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:35:18.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:35:18.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:35:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- 172.21.15.114:0/3376947739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac0af850 msgr2=0x7f9aac0afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/3376947739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac0af850 0x7f9aac0afc30 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0cc4a0 tx=0x7f9aa401c890 comp rx=0 tx=0).stop 2024-09-16T07:35:18.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- 172.21.15.114:0/3376947739 shutdown_connections 2024-09-16T07:35:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/3376947739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac0af850 0x7f9aac0afc30 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/3376947739 >> v2:172.21.15.149:3300/0 conn(0x7f9aac0d28e0 0x7f9aac0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- 172.21.15.114:0/3376947739 >> 172.21.15.114:0/3376947739 conn(0x7f9aac0d1dc0 msgr2=0x7f9aac0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- 172.21.15.114:0/3376947739 shutdown_connections 2024-09-16T07:35:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- 172.21.15.114:0/3376947739 wait complete. 2024-09-16T07:35:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 Processor -- start 2024-09-16T07:35:18.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- start start 2024-09-16T07:35:18.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aac0af850 0x7f9aac1f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:18.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aac0d28e0 0x7f9aac0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:18.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac15f390 0x7f9aac0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:18.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac168ea0 con 0x7f9aac15f390 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac168d20 con 0x7f9aac0d28e0 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.721+0000 7f9ab1c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9aac169020 con 0x7f9aac0af850 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aaa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aac0d28e0 0x7f9aac0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aaaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aac0af850 0x7f9aac1f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aaa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aac0d28e0 0x7f9aac0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:54846/0 (socket says 172.21.15.114:54846) 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aaa000640 1 -- 172.21.15.114:0/682988703 learned_addr learned my addr 172.21.15.114:0/682988703 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aab400640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac15f390 0x7f9aac0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aab400640 1 -- 172.21.15.114:0/682988703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aac0af850 msgr2=0x7f9aac1f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aab400640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aac0af850 0x7f9aac1f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aab400640 1 -- 172.21.15.114:0/682988703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aac0d28e0 msgr2=0x7f9aac0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:18.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aab400640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aac0d28e0 0x7f9aac0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:18.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aab400640 1 -- 172.21.15.114:0/682988703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aac0c9370 con 0x7f9aac15f390 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aab400640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac15f390 0x7f9aac0ced30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40ac000 tx=0x7f9aa4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aa2a00640 1 -- 172.21.15.114:0/682988703 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40b2040 con 0x7f9aac15f390 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aa2a00640 1 -- 172.21.15.114:0/682988703 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aa4005030 con 0x7f9aac15f390 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aa2a00640 1 -- 172.21.15.114:0/682988703 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4005480 con 0x7f9aac15f390 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac0c9670 con 0x7f9aac15f390 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac0c9f10 con 0x7f9aac15f390 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac0afc30 con 0x7f9aac15f390 2024-09-16T07:35:18.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.725+0000 7f9aa2a00640 1 -- 172.21.15.114:0/682988703 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f9aa40be060 con 0x7f9aac15f390 2024-09-16T07:35:18.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.729+0000 7f9aa2a00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a8c073580 0x7f9a8c075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:18.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.729+0000 7f9aa2a00640 1 -- 172.21.15.114:0/682988703 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5385+0+0 (secure 0 0 0) 0x7f9aa412dd00 con 0x7f9aac15f390 2024-09-16T07:35:18.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.729+0000 7f9aaaa00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a8c073580 0x7f9a8c075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:18.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.729+0000 7f9aaaa00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a8c073580 0x7f9a8c075a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9aac15bd20 tx=0x7f9a9c00d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:18.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.733+0000 7f9aa2a00640 1 -- 172.21.15.114:0/682988703 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9aa40164b0 con 0x7f9aac15f390 2024-09-16T07:35:18.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:18.897+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9aac0c9840 con 0x7f9aac15f390 2024-09-16T07:35:19.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.545+0000 7f9aa2a00640 1 -- 172.21.15.114:0/682988703 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) ==== 169+0+0 (secure 0 0 0) 0x7f9aa40f8060 con 0x7f9aac15f390 2024-09-16T07:35:19.545 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:35:19.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.549+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a8c073580 msgr2=0x7f9a8c075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:19.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.549+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a8c073580 0x7f9a8c075a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9aac15bd20 tx=0x7f9a9c00d040 comp rx=0 tx=0).stop 2024-09-16T07:35:19.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.549+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac15f390 msgr2=0x7f9aac0ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:19.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.549+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac15f390 0x7f9aac0ced30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40ac000 tx=0x7f9aa4004040 comp rx=0 tx=0).stop 2024-09-16T07:35:19.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 shutdown_connections 2024-09-16T07:35:19.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9aac15f390 0x7f9aac0ced30 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9aac0d28e0 0x7f9aac0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9a8c073580 0x7f9a8c075a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 --2- 172.21.15.114:0/682988703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9aac0af850 0x7f9aac1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 >> 172.21.15.114:0/682988703 conn(0x7f9aac0d1dc0 msgr2=0x7f9aac156490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:19.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 shutdown_connections 2024-09-16T07:35:19.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.553+0000 7f9ab1c00640 1 -- 172.21.15.114:0/682988703 wait complete. 2024-09-16T07:35:19.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:35:19.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 -- 172.21.15.114:0/93208745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb79415f000 msgr2=0x7fb7940d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:19.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 --2- 172.21.15.114:0/93208745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb79415f000 0x7fb7940d01b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb784009bf0 tx=0x7fb78401cb50 comp rx=0 tx=0).stop 2024-09-16T07:35:19.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 -- 172.21.15.114:0/93208745 shutdown_connections 2024-09-16T07:35:19.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 --2- 172.21.15.114:0/93208745 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb79415f000 0x7fb7940d01b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 -- 172.21.15.114:0/93208745 >> 172.21.15.114:0/93208745 conn(0x7fb79409aa10 msgr2=0x7fb79409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:19.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 -- 172.21.15.114:0/93208745 shutdown_connections 2024-09-16T07:35:19.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 -- 172.21.15.114:0/93208745 wait complete. 2024-09-16T07:35:19.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 Processor -- start 2024-09-16T07:35:19.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.773+0000 7fb793200640 1 -- start start 2024-09-16T07:35:19.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7940b2590 0x7fb79415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:19.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7940cefb0 0x7fb7941f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:19.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb79415f000 0x7fb7941fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:19.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb79416a0d0 con 0x7fb7940cefb0 2024-09-16T07:35:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb794169f50 con 0x7fb79415f000 2024-09-16T07:35:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb79416a250 con 0x7fb7940b2590 2024-09-16T07:35:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7940cefb0 0x7fb7941f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7940cefb0 0x7fb7941f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36464/0 (socket says 172.21.15.114:36464) 2024-09-16T07:35:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 -- 172.21.15.114:0/565835659 learned_addr learned my addr 172.21.15.114:0/565835659 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb791e00640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7940b2590 0x7fb79415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb792800640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb79415f000 0x7fb7941fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 -- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7940b2590 msgr2=0x7fb79415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7940b2590 0x7fb79415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 -- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb79415f000 msgr2=0x7fb7941fbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb79415f000 0x7fb7941fbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 -- 172.21.15.114:0/565835659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7940b6700 con 0x7fb7940cefb0 2024-09-16T07:35:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb792800640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb79415f000 0x7fb7941fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb789400640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7940cefb0 0x7fb7941f86c0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c490 tx=0x7fb77c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb78aa00640 1 -- 172.21.15.114:0/565835659 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0052d0 con 0x7fb7940cefb0 2024-09-16T07:35:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb78aa00640 1 -- 172.21.15.114:0/565835659 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb77c005490 con 0x7fb7940cefb0 2024-09-16T07:35:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7940b69e0 con 0x7fb7940cefb0 2024-09-16T07:35:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7940b74c0 con 0x7fb7940cefb0 2024-09-16T07:35:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.777+0000 7fb78aa00640 1 -- 172.21.15.114:0/565835659 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c012870 con 0x7fb7940cefb0 2024-09-16T07:35:19.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.781+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c0052a0 con 0x7fb7940cefb0 2024-09-16T07:35:19.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.781+0000 7fb78aa00640 1 -- 172.21.15.114:0/565835659 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fb77c003600 con 0x7fb7940cefb0 2024-09-16T07:35:19.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.781+0000 7fb78aa00640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7700735b0 0x7fb770075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:19.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.781+0000 7fb78aa00640 1 -- 172.21.15.114:0/565835659 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7fb77c094100 con 0x7fb7940cefb0 2024-09-16T07:35:19.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.785+0000 7fb791e00640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7700735b0 0x7fb770075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:19.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.785+0000 7fb791e00640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7700735b0 0x7fb770075a70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb7840af000 tx=0x7fb78401b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:19.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.789+0000 7fb78aa00640 1 -- 172.21.15.114:0/565835659 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb77c05ec50 con 0x7fb7940cefb0 2024-09-16T07:35:19.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.965+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fb76c005860 con 0x7fb7940cefb0 2024-09-16T07:35:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb78aa00640 1 -- 172.21.15.114:0/565835659 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v43) ==== 71+0+0 (secure 0 0 0) 0x7fb77c05e550 con 0x7fb7940cefb0 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7700735b0 msgr2=0x7fb770075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7700735b0 0x7fb770075a70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb7840af000 tx=0x7fb78401b390 comp rx=0 tx=0).stop 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7940cefb0 msgr2=0x7fb7941f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7940cefb0 0x7fb7941f86c0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c490 tx=0x7fb77c00c950 comp rx=0 tx=0).stop 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 shutdown_connections 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb79415f000 0x7fb7941fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7940cefb0 0x7fb7941f86c0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb7700735b0 0x7fb770075a70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 --2- 172.21.15.114:0/565835659 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7940b2590 0x7fb79415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 >> 172.21.15.114:0/565835659 conn(0x7fb79409aa10 msgr2=0x7fb79409b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 shutdown_connections 2024-09-16T07:35:19.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:19.969+0000 7fb793200640 1 -- 172.21.15.114:0/565835659 wait complete. 2024-09-16T07:35:19.989 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-16T07:35:20.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- 172.21.15.114:0/717131233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e38004810 msgr2=0x7f1e38004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 --2- 172.21.15.114:0/717131233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e38004810 0x7f1e38004c90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009b60 tx=0x7f1e4001d270 comp rx=0 tx=0).stop 2024-09-16T07:35:20.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- 172.21.15.114:0/717131233 shutdown_connections 2024-09-16T07:35:20.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 --2- 172.21.15.114:0/717131233 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e38004810 0x7f1e38004c90 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- 172.21.15.114:0/717131233 >> 172.21.15.114:0/717131233 conn(0x7f1e500b18f0 msgr2=0x7f1e500b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:20.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- 172.21.15.114:0/717131233 shutdown_connections 2024-09-16T07:35:20.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- 172.21.15.114:0/717131233 wait complete. 2024-09-16T07:35:20.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 Processor -- start 2024-09-16T07:35:20.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- start start 2024-09-16T07:35:20.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e38004810 0x7f1e501f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e50146390 0x7f1e501526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e50152c00 0x7f1e50148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1e500b4d50 con 0x7f1e50146390 2024-09-16T07:35:20.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1e500b4bd0 con 0x7f1e38004810 2024-09-16T07:35:20.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.133+0000 7f1e58800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1e500b4ed0 con 0x7f1e50152c00 2024-09-16T07:35:20.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e50146390 0x7f1e501526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e38004810 0x7f1e501f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e56800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e50152c00 0x7f1e50148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e50146390 0x7f1e501526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36480/0 (socket says 172.21.15.114:36480) 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 -- 172.21.15.114:0/1741680589 learned_addr learned my addr 172.21.15.114:0/1741680589 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 -- 172.21.15.114:0/1741680589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e50152c00 msgr2=0x7f1e50148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e50152c00 0x7f1e50148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 -- 172.21.15.114:0/1741680589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e38004810 msgr2=0x7f1e501f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e38004810 0x7f1e501f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 -- 172.21.15.114:0/1741680589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e50149940 con 0x7f1e50146390 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e55400640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e50146390 0x7f1e501526c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f1e400af040 tx=0x7f1e400056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e4a000640 1 -- 172.21.15.114:0/1741680589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e400ba070 con 0x7f1e50146390 2024-09-16T07:35:20.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e4a000640 1 -- 172.21.15.114:0/1741680589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e400049c0 con 0x7f1e50146390 2024-09-16T07:35:20.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e4a000640 1 -- 172.21.15.114:0/1741680589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e400b1040 con 0x7f1e50146390 2024-09-16T07:35:20.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e50149c20 con 0x7f1e50146390 2024-09-16T07:35:20.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e501f3210 con 0x7f1e50146390 2024-09-16T07:35:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e50069410 con 0x7f1e50146390 2024-09-16T07:35:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.137+0000 7f1e4a000640 1 -- 172.21.15.114:0/1741680589 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f1e400bf450 con 0x7f1e50146390 2024-09-16T07:35:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.141+0000 7f1e4a000640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e340735b0 0x7f1e34075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.141+0000 7f1e4a000640 1 -- 172.21.15.114:0/1741680589 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7f1e4012f1d0 con 0x7f1e50146390 2024-09-16T07:35:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.141+0000 7f1e55e00640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e340735b0 0x7f1e34075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.141+0000 7f1e55e00640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e340735b0 0x7f1e34075a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1e44006c50 tx=0x7f1e440067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:20.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.145+0000 7f1e4a000640 1 -- 172.21.15.114:0/1741680589 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1e400c4020 con 0x7f1e50146390 2024-09-16T07:35:20.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.369+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7f1e500ceee0 con 0x7f1e50146390 2024-09-16T07:35:20.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e4a000640 1 -- 172.21.15.114:0/1741680589 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v395) ==== 151+0+0 (secure 0 0 0) 0x7f1e40016f80 con 0x7f1e50146390 2024-09-16T07:35:20.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e340735b0 msgr2=0x7f1e34075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e340735b0 0x7f1e34075a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1e44006c50 tx=0x7f1e440067b0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e50146390 msgr2=0x7f1e501526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e50146390 0x7f1e501526c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f1e400af040 tx=0x7f1e400056a0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 shutdown_connections 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1e340735b0 0x7f1e34075a70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e50152c00 0x7f1e50148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e50146390 0x7f1e501526c0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 --2- 172.21.15.114:0/1741680589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e38004810 0x7f1e501f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 >> 172.21.15.114:0/1741680589 conn(0x7f1e500b18f0 msgr2=0x7f1e500d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 shutdown_connections 2024-09-16T07:35:20.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.557+0000 7f1e58800640 1 -- 172.21.15.114:0/1741680589 wait complete. 2024-09-16T07:35:20.576 INFO:tasks.cephfs_test_runner:test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-16T07:35:20.576 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- rather than going through a full upgrade cycle, 2024-09-16T07:35:20.576 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:35:20.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- 172.21.15.114:0/1662034216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3815c3e0 msgr2=0x7fea3815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1662034216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3815c3e0 0x7fea3815c7c0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fea28009900 tx=0x7fea2801f090 comp rx=0 tx=0).stop 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- 172.21.15.114:0/1662034216 shutdown_connections 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1662034216 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea380cd540 0x7fea3815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1662034216 >> v2:172.21.15.149:3300/0 conn(0x7fea3815bfa0 0x7fea380cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1662034216 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea3815c3e0 0x7fea3815c7c0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- 172.21.15.114:0/1662034216 >> 172.21.15.114:0/1662034216 conn(0x7fea380b18f0 msgr2=0x7fea380b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:20.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- 172.21.15.114:0/1662034216 shutdown_connections 2024-09-16T07:35:20.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- 172.21.15.114:0/1662034216 wait complete. 2024-09-16T07:35:20.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 Processor -- start 2024-09-16T07:35:20.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- start start 2024-09-16T07:35:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea380cd540 0x7fea381f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3815bfa0 0x7fea380b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea3815c3e0 0x7fea380acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fea3815ffd0 con 0x7fea380cd540 2024-09-16T07:35:20.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea3815fe50 con 0x7fea3815bfa0 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea3cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea38160150 con 0x7fea3815c3e0 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea380cd540 0x7fea381f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea35e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea380cd540 0x7fea381f4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36498/0 (socket says 172.21.15.114:36498) 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea35e00640 1 -- 172.21.15.114:0/1554340575 learned_addr learned my addr 172.21.15.114:0/1554340575 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea2d400640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3815bfa0 0x7fea380b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.721+0000 7fea36800640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea3815c3e0 0x7fea380acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea35e00640 1 -- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea3815c3e0 msgr2=0x7fea380acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea35e00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea3815c3e0 0x7fea380acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea35e00640 1 -- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3815bfa0 msgr2=0x7fea380b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea35e00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3815bfa0 0x7fea380b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea35e00640 1 -- 172.21.15.114:0/1554340575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea381f5d20 con 0x7fea380cd540 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea35e00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea380cd540 0x7fea381f4d80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fea28009850 tx=0x7fea28005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea2ea00640 1 -- 172.21.15.114:0/1554340575 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea280b5040 con 0x7fea380cd540 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea2ea00640 1 -- 172.21.15.114:0/1554340575 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea28005320 con 0x7fea380cd540 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea381f5480 con 0x7fea380cd540 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea2ea00640 1 -- 172.21.15.114:0/1554340575 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea280046d0 con 0x7fea380cd540 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea381f5a40 con 0x7fea380cd540 2024-09-16T07:35:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea38069410 con 0x7fea380cd540 2024-09-16T07:35:20.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea2ea00640 1 -- 172.21.15.114:0/1554340575 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fea28004870 con 0x7fea380cd540 2024-09-16T07:35:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.725+0000 7fea2ea00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea14073580 0x7fea14075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.729+0000 7fea2ea00640 1 -- 172.21.15.114:0/1554340575 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7fea281316e0 con 0x7fea380cd540 2024-09-16T07:35:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.729+0000 7fea2d400640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea14073580 0x7fea14075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:20.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.729+0000 7fea2d400640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea14073580 0x7fea14075a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fea380aed80 tx=0x7fea2000b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.733+0000 7fea2ea00640 1 -- 172.21.15.114:0/1554340575 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fea280bf060 con 0x7fea380cd540 2024-09-16T07:35:20.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.901+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea38160620 con 0x7fea380cd540 2024-09-16T07:35:20.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.901+0000 7fea2ea00640 1 -- 172.21.15.114:0/1554340575 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+13134 (secure 0 0 0) 0x7fea28018bf0 con 0x7fea380cd540 2024-09-16T07:35:20.900 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:20.900 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":132,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:35:19.548601+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/710167418":"2024-09-17T07:35:16.410597+0000","172.21.15.114:6834/710167418":"2024-09-17T07:35:16.410597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:20.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea14073580 msgr2=0x7fea14075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea14073580 0x7fea14075a40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fea380aed80 tx=0x7fea2000b390 comp rx=0 tx=0).stop 2024-09-16T07:35:20.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea380cd540 msgr2=0x7fea381f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:20.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea380cd540 0x7fea381f4d80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fea28009850 tx=0x7fea28005760 comp rx=0 tx=0).stop 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 shutdown_connections 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea14073580 0x7fea14075a40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea3815c3e0 0x7fea380acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea3815bfa0 0x7fea380b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 --2- 172.21.15.114:0/1554340575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea380cd540 0x7fea381f4d80 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 >> 172.21.15.114:0/1554340575 conn(0x7fea380b18f0 msgr2=0x7fea380b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 shutdown_connections 2024-09-16T07:35:20.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:20.905+0000 7fea3cc00640 1 -- 172.21.15.114:0/1554340575 wait complete. 2024-09-16T07:35:20.921 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:35:20.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:35:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- 172.21.15.114:0/2134742305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c00b3300 msgr2=0x7f47c00cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 --2- 172.21.15.114:0/2134742305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c00b3300 0x7f47c00cc550 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f47c0069820 tx=0x7f47b801cd80 comp rx=0 tx=0).stop 2024-09-16T07:35:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- 172.21.15.114:0/2134742305 shutdown_connections 2024-09-16T07:35:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 --2- 172.21.15.114:0/2134742305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c00b3300 0x7f47c00cc550 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 --2- 172.21.15.114:0/2134742305 >> v2:172.21.15.149:3300/0 conn(0x7f47c015b580 0x7f47c015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- 172.21.15.114:0/2134742305 >> 172.21.15.114:0/2134742305 conn(0x7f47c00b18f0 msgr2=0x7f47c00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- 172.21.15.114:0/2134742305 shutdown_connections 2024-09-16T07:35:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- 172.21.15.114:0/2134742305 wait complete. 2024-09-16T07:35:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 Processor -- start 2024-09-16T07:35:21.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- start start 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00b3300 0x7f47c009d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c00b4bd0 0x7f47c01f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c015b580 0x7f47c01f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0167eb0 con 0x7f47c015b580 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0167d30 con 0x7f47c00b3300 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c8000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f47c0168030 con 0x7f47c00b4bd0 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c015b580 0x7f47c01f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c015b580 0x7f47c01f9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36510/0 (socket says 172.21.15.114:36510) 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c6000640 1 -- 172.21.15.114:0/1324653103 learned_addr learned my addr 172.21.15.114:0/1324653103 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c5600640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00b3300 0x7f47c009d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.069+0000 7f47c4c00640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c00b4bd0 0x7f47c01f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c6000640 1 -- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c00b4bd0 msgr2=0x7f47c01f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c6000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c00b4bd0 0x7f47c01f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c6000640 1 -- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00b3300 msgr2=0x7f47c009d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c6000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00b3300 0x7f47c009d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c6000640 1 -- 172.21.15.114:0/1324653103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c01f5fc0 con 0x7f47c015b580 2024-09-16T07:35:21.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c6000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c015b580 0x7f47c01f9e70 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f47b801b430 tx=0x7f47b8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:21.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47bd600640 1 -- 172.21.15.114:0/1324653103 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b80bb070 con 0x7f47c015b580 2024-09-16T07:35:21.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47bd600640 1 -- 172.21.15.114:0/1324653103 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47b8004e00 con 0x7f47c015b580 2024-09-16T07:35:21.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47bd600640 1 -- 172.21.15.114:0/1324653103 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b80b2040 con 0x7f47c015b580 2024-09-16T07:35:21.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c01f62a0 con 0x7f47c015b580 2024-09-16T07:35:21.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01f6860 con 0x7f47c015b580 2024-09-16T07:35:21.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c0069410 con 0x7f47c015b580 2024-09-16T07:35:21.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.073+0000 7f47bd600640 1 -- 172.21.15.114:0/1324653103 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f47b80be070 con 0x7f47c015b580 2024-09-16T07:35:21.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.077+0000 7f47bd600640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f47a0073580 0x7f47a0075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.077+0000 7f47bd600640 1 -- 172.21.15.114:0/1324653103 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7f47b812e140 con 0x7f47c015b580 2024-09-16T07:35:21.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.077+0000 7f47c5600640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f47a0073580 0x7f47a0075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.077+0000 7f47c5600640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f47a0073580 0x7f47a0075a40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47b4004630 tx=0x7f47b400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:21.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.081+0000 7f47bd600640 1 -- 172.21.15.114:0/1324653103 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f47b8016970 con 0x7f47c015b580 2024-09-16T07:35:21.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.245+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f47c00cc550 con 0x7f47c015b580 2024-09-16T07:35:21.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.245+0000 7f47bd600640 1 -- 172.21.15.114:0/1324653103 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) ==== 93+0+10 (secure 0 0 0) 0x7f47b80f8640 con 0x7f47c015b580 2024-09-16T07:35:21.245 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f47a0073580 msgr2=0x7f47a0075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f47a0073580 0x7f47a0075a40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f47b4004630 tx=0x7f47b400b2e0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c015b580 msgr2=0x7f47c01f9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c015b580 0x7f47c01f9e70 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f47b801b430 tx=0x7f47b8003f60 comp rx=0 tx=0).stop 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 shutdown_connections 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47c015b580 0x7f47c01f9e70 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f47a0073580 0x7f47a0075a40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47c00b4bd0 0x7f47c01f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 --2- 172.21.15.114:0/1324653103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47c00b3300 0x7f47c009d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 >> 172.21.15.114:0/1324653103 conn(0x7f47c00b18f0 msgr2=0x7f47c00aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:21.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 shutdown_connections 2024-09-16T07:35:21.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.249+0000 7f47c8000640 1 -- 172.21.15.114:0/1324653103 wait complete. 2024-09-16T07:35:21.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-16T07:35:21.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 -- 172.21.15.114:0/1974454311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14040cefb0 msgr2=0x7f14040cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 --2- 172.21.15.114:0/1974454311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14040cefb0 0x7f14040cc5b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f14040b1640 tx=0x7f13ec01c830 comp rx=0 tx=0).stop 2024-09-16T07:35:21.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 -- 172.21.15.114:0/1974454311 shutdown_connections 2024-09-16T07:35:21.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 --2- 172.21.15.114:0/1974454311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14040cefb0 0x7f14040cc5b0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 --2- 172.21.15.114:0/1974454311 >> v2:172.21.15.149:3300/0 conn(0x7f14040ccaf0 0x7f14040b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 --2- 172.21.15.114:0/1974454311 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f140415f000 0x7f14040d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 -- 172.21.15.114:0/1974454311 >> 172.21.15.114:0/1974454311 conn(0x7f140409aa10 msgr2=0x7f140409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:21.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 -- 172.21.15.114:0/1974454311 shutdown_connections 2024-09-16T07:35:21.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.409+0000 7f1408c00640 1 -- 172.21.15.114:0/1974454311 wait complete. 2024-09-16T07:35:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 Processor -- start 2024-09-16T07:35:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 -- start start 2024-09-16T07:35:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14040ccaf0 0x7f14041fb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14040cefb0 0x7f14041fbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f140415f000 0x7f1404071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f140415ff80 con 0x7f140415f000 2024-09-16T07:35:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f140415fe00 con 0x7f14040ccaf0 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1404160100 con 0x7f14040cefb0 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f140415f000 0x7f1404071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f140415f000 0x7f1404071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36524/0 (socket says 172.21.15.114:36524) 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 -- 172.21.15.114:0/1145231735 learned_addr learned my addr 172.21.15.114:0/1145231735 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403400640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14040ccaf0 0x7f14041fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f13faa00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14040cefb0 0x7f14041fbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 -- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14040cefb0 msgr2=0x7f14041fbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14040cefb0 0x7f14041fbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 -- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14040ccaf0 msgr2=0x7f14041fb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14040ccaf0 0x7f14041fb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 -- 172.21.15.114:0/1145231735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140414b210 con 0x7f140415f000 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1403e00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f140415f000 0x7f1404071bc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00daf0 tx=0x7f13fc009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f13fbe00640 1 -- 172.21.15.114:0/1145231735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00be00 con 0x7f140415f000 2024-09-16T07:35:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f13fbe00640 1 -- 172.21.15.114:0/1145231735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13fc003980 con 0x7f140415f000 2024-09-16T07:35:21.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f13fbe00640 1 -- 172.21.15.114:0/1145231735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc003dd0 con 0x7f140415f000 2024-09-16T07:35:21.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140414b4f0 con 0x7f140415f000 2024-09-16T07:35:21.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140414bab0 con 0x7f140415f000 2024-09-16T07:35:21.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.413+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14040c7660 con 0x7f140415f000 2024-09-16T07:35:21.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.417+0000 7f13fbe00640 1 -- 172.21.15.114:0/1145231735 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f13fc003f70 con 0x7f140415f000 2024-09-16T07:35:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.417+0000 7f13fbe00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13e0073580 0x7f13e0075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.417+0000 7f13fbe00640 1 -- 172.21.15.114:0/1145231735 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7f13fc094f80 con 0x7f140415f000 2024-09-16T07:35:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.417+0000 7f1403400640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13e0073580 0x7f13e0075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.417+0000 7f1403400640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13e0073580 0x7f13e0075a40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f13f4004630 tx=0x7f13f400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:21.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.421+0000 7f13fbe00640 1 -- 172.21.15.114:0/1145231735 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f13fc020030 con 0x7f140415f000 2024-09-16T07:35:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:21.649+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7f14040cc5b0 con 0x7f140415f000 2024-09-16T07:35:22.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f13fbe00640 1 -- 172.21.15.114:0/1145231735 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v397) ==== 152+0+0 (secure 0 0 0) 0x7f13fc017030 con 0x7f140415f000 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13e0073580 msgr2=0x7f13e0075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13e0073580 0x7f13e0075a40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f13f4004630 tx=0x7f13f400b2e0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f140415f000 msgr2=0x7f1404071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f140415f000 0x7f1404071bc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00daf0 tx=0x7f13fc009f60 comp rx=0 tx=0).stop 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 shutdown_connections 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f140415f000 0x7f1404071bc0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13e0073580 0x7f13e0075a40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14040cefb0 0x7f14041fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 --2- 172.21.15.114:0/1145231735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14040ccaf0 0x7f14041fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 >> 172.21.15.114:0/1145231735 conn(0x7f140409aa10 msgr2=0x7f14040708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 shutdown_connections 2024-09-16T07:35:22.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.565+0000 7f1408c00640 1 -- 172.21.15.114:0/1145231735 wait complete. 2024-09-16T07:35:22.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:35:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- 172.21.15.114:0/2213543612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 msgr2=0x7f51f8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 --2- 172.21.15.114:0/2213543612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 0x7f51f8003e40 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f520400c5c0 tx=0x7f520401d2c0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213e00640 1 -- 172.21.15.114:0/2213543612 reap_dead start 2024-09-16T07:35:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- 172.21.15.114:0/2213543612 shutdown_connections 2024-09-16T07:35:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- 172.21.15.114:0/2213543612 >> 172.21.15.114:0/2213543612 conn(0x7f52140d1dc0 msgr2=0x7f52140d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- 172.21.15.114:0/2213543612 shutdown_connections 2024-09-16T07:35:22.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- 172.21.15.114:0/2213543612 wait complete. 2024-09-16T07:35:22.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 Processor -- start 2024-09-16T07:35:22.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- start start 2024-09-16T07:35:22.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 0x7f52141558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:22.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52140b1550 0x7f52140b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:22.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5214156480 0x7f52140b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:22.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5214167f10 con 0x7f51f8003a40 2024-09-16T07:35:22.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5214167d90 con 0x7f52140b1550 2024-09-16T07:35:22.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f521a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5214168090 con 0x7f5214156480 2024-09-16T07:35:22.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 0x7f52141558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:22.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 0x7f52141558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36548/0 (socket says 172.21.15.114:36548) 2024-09-16T07:35:22.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 -- 172.21.15.114:0/4284011146 learned_addr learned my addr 172.21.15.114:0/4284011146 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5212a00640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52140b1550 0x7f52140b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213e00640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5214156480 0x7f52140b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 -- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5214156480 msgr2=0x7f52140b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5214156480 0x7f52140b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 -- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52140b1550 msgr2=0x7f52140b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52140b1550 0x7f52140b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 -- 172.21.15.114:0/4284011146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52140b19e0 con 0x7f51f8003a40 2024-09-16T07:35:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213e00640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5214156480 0x7f52140b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f5213400640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 0x7f52141558d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f520401cd80 tx=0x7f5204002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.733+0000 7f520b400640 1 -- 172.21.15.114:0/4284011146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204003b80 con 0x7f51f8003a40 2024-09-16T07:35:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f520b400640 1 -- 172.21.15.114:0/4284011146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5204003d20 con 0x7f51f8003a40 2024-09-16T07:35:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52140b1cc0 con 0x7f51f8003a40 2024-09-16T07:35:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f520b400640 1 -- 172.21.15.114:0/4284011146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204006330 con 0x7f51f8003a40 2024-09-16T07:35:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52140b2280 con 0x7f51f8003a40 2024-09-16T07:35:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52140b4770 con 0x7f51f8003a40 2024-09-16T07:35:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f520b400640 1 -- 172.21.15.114:0/4284011146 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f52040064d0 con 0x7f51f8003a40 2024-09-16T07:35:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f520b400640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f51f4073580 0x7f51f4075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f520b400640 1 -- 172.21.15.114:0/4284011146 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7f520412ef50 con 0x7f51f8003a40 2024-09-16T07:35:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.737+0000 7f5212a00640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f51f4073580 0x7f51f4075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.741+0000 7f5212a00640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f51f4073580 0x7f51f4075a40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f52140d2210 tx=0x7f5200006e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.741+0000 7f520b400640 1 -- 172.21.15.114:0/4284011146 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5204017070 con 0x7f51f8003a40 2024-09-16T07:35:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f521415a6a0 con 0x7f51f8003a40 2024-09-16T07:35:22.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f520b400640 1 -- 172.21.15.114:0/4284011146 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v43) ==== 59+0+1998 (secure 0 0 0) 0x7f52040f9a20 con 0x7f51f8003a40 2024-09-16T07:35:22.912 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:35:22.912 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:35:22.912 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:35:22.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:35:22.912 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:35:22.913 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:35:22.913 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:35:22.913 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:35:22.913 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:35:22.913 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:35:22.913 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:35:22.914 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:35:22.914 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:35:22.914 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:35:22.914 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:35:22.914 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:35:22.914 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:35:22.915 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:35:22.915 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:35:22.915 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:35:22.915 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:35:22.915 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:35:22.915 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:35:22.916 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:35:22.916 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:35:22.916 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:35:22.916 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:35:22.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f51f4073580 msgr2=0x7f51f4075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:22.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f51f4073580 0x7f51f4075a40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f52140d2210 tx=0x7f5200006e10 comp rx=0 tx=0).stop 2024-09-16T07:35:22.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 msgr2=0x7f52141558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 0x7f52141558d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f520401cd80 tx=0x7f5204002100 comp rx=0 tx=0).stop 2024-09-16T07:35:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 shutdown_connections 2024-09-16T07:35:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f51f4073580 0x7f51f4075a40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5214156480 0x7f52140b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52140b1550 0x7f52140b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 --2- 172.21.15.114:0/4284011146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f51f8003a40 0x7f52141558d0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:22.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 >> 172.21.15.114:0/4284011146 conn(0x7f52140d1dc0 msgr2=0x7f52140b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:22.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 shutdown_connections 2024-09-16T07:35:22.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:22.913+0000 7f521a800640 1 -- 172.21.15.114:0/4284011146 wait complete. 2024-09-16T07:35:22.933 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:35:23.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- 172.21.15.114:0/215226268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69e0004810 msgr2=0x7f69e0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 --2- 172.21.15.114:0/215226268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69e0004810 0x7f69e0004c90 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f69f80b2770 tx=0x7f69e401d1b0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69fd800640 1 -- 172.21.15.114:0/215226268 reap_dead start 2024-09-16T07:35:23.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- 172.21.15.114:0/215226268 shutdown_connections 2024-09-16T07:35:23.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- 172.21.15.114:0/215226268 >> 172.21.15.114:0/215226268 conn(0x7f69f80b18f0 msgr2=0x7f69f80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:23.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- 172.21.15.114:0/215226268 shutdown_connections 2024-09-16T07:35:23.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- 172.21.15.114:0/215226268 wait complete. 2024-09-16T07:35:23.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 Processor -- start 2024-09-16T07:35:23.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- start start 2024-09-16T07:35:23.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69e0004810 0x7f69f80ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69f80ae800 0x7f69f80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f80aec80 0x7f69f81f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f69f80cc740 con 0x7f69f80aec80 2024-09-16T07:35:23.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f69f80cdae0 con 0x7f69e0004810 2024-09-16T07:35:23.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69ff800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f69f80cc8c0 con 0x7f69f80ae800 2024-09-16T07:35:23.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69fd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f80aec80 0x7f69f81f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69fd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f80aec80 0x7f69f81f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36552/0 (socket says 172.21.15.114:36552) 2024-09-16T07:35:23.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.081+0000 7f69fd800640 1 -- 172.21.15.114:0/4069628486 learned_addr learned my addr 172.21.15.114:0/4069628486 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:23.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69f7e00640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69f80ae800 0x7f69f80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fce00640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69e0004810 0x7f69f80ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fd800640 1 -- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69f80ae800 msgr2=0x7f69f80ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fd800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69f80ae800 0x7f69f80ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fd800640 1 -- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69e0004810 msgr2=0x7f69f80ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fd800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69e0004810 0x7f69f80ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fd800640 1 -- 172.21.15.114:0/4069628486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f8155550 con 0x7f69f80aec80 2024-09-16T07:35:23.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fce00640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69e0004810 0x7f69f80ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69f7e00640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69f80ae800 0x7f69f80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69fd800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f80aec80 0x7f69f81f5290 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f69f80cd060 tx=0x7f69f0006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69f4c00640 1 -- 172.21.15.114:0/4069628486 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f000fa80 con 0x7f69f80aec80 2024-09-16T07:35:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69f4c00640 1 -- 172.21.15.114:0/4069628486 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69f0018070 con 0x7f69f80aec80 2024-09-16T07:35:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f8154f90 con 0x7f69f80aec80 2024-09-16T07:35:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69f4c00640 1 -- 172.21.15.114:0/4069628486 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0011430 con 0x7f69f80aec80 2024-09-16T07:35:23.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f80acee0 con 0x7f69f80aec80 2024-09-16T07:35:23.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f8069410 con 0x7f69f80aec80 2024-09-16T07:35:23.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.085+0000 7f69f4c00640 1 -- 172.21.15.114:0/4069628486 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f69f00115d0 con 0x7f69f80aec80 2024-09-16T07:35:23.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.089+0000 7f69f4c00640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69d8073580 0x7f69d8075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.089+0000 7f69f4c00640 1 -- 172.21.15.114:0/4069628486 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7f69f0094f40 con 0x7f69f80aec80 2024-09-16T07:35:23.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.089+0000 7f69fce00640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69d8073580 0x7f69d8075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.089+0000 7f69fce00640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69d8073580 0x7f69d8075a40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006fd0 tx=0x7f69ec006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:23.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.093+0000 7f69f4c00640 1 -- 172.21.15.114:0/4069628486 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f69f8155550 con 0x7f69f80aec80 2024-09-16T07:35:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.257+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f69f80b4490 con 0x7f69f80aec80 2024-09-16T07:35:23.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.261+0000 7f69f4c00640 1 -- 172.21.15.114:0/4069628486 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7f69f005fa90 con 0x7f69f80aec80 2024-09-16T07:35:23.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69d8073580 msgr2=0x7f69d8075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69d8073580 0x7f69d8075a40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006fd0 tx=0x7f69ec006b20 comp rx=0 tx=0).stop 2024-09-16T07:35:23.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f80aec80 msgr2=0x7f69f81f5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f80aec80 0x7f69f81f5290 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f69f80cd060 tx=0x7f69f0006720 comp rx=0 tx=0).stop 2024-09-16T07:35:23.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 shutdown_connections 2024-09-16T07:35:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69f80aec80 0x7f69f81f5290 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69d8073580 0x7f69d8075a40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f69f80ae800 0x7f69f80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 --2- 172.21.15.114:0/4069628486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69e0004810 0x7f69f80ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 >> 172.21.15.114:0/4069628486 conn(0x7f69f80b18f0 msgr2=0x7f69f80ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 shutdown_connections 2024-09-16T07:35:23.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.265+0000 7f69ff800640 1 -- 172.21.15.114:0/4069628486 wait complete. 2024-09-16T07:35:23.283 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:35:23.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:35:23.365 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:35:23.469 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:35:23.470 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:23.470 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:23.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:35:23.478 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:23.478 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:23.487 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:23.487 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:23.529 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:35:23.529 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:23.529 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:23.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:35:23.542 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:35:23.542 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- 172.21.15.114:0/3597475506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 msgr2=0x7f342815b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 --2- 172.21.15.114:0/3597475506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342815b960 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f342806db60 tx=0x7f341801c8c0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- 172.21.15.114:0/3597475506 shutdown_connections 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 --2- 172.21.15.114:0/3597475506 >> v2:172.21.15.149:3300/0 conn(0x7f34280b3300 0x7f34280cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 --2- 172.21.15.114:0/3597475506 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342815b960 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- 172.21.15.114:0/3597475506 >> 172.21.15.114:0/3597475506 conn(0x7f34280b18f0 msgr2=0x7f34280b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- 172.21.15.114:0/3597475506 shutdown_connections 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- 172.21.15.114:0/3597475506 wait complete. 2024-09-16T07:35:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 Processor -- start 2024-09-16T07:35:23.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- start start 2024-09-16T07:35:23.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280b3300 0x7f34280ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34280b4bd0 0x7f34281f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3428167e80 con 0x7f342815b580 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3428167d00 con 0x7f34280b3300 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f342e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3428168000 con 0x7f34280b4bd0 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342814d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36558/0 (socket says 172.21.15.114:36558) 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 -- 172.21.15.114:0/1096575890 learned_addr learned my addr 172.21.15.114:0/1096575890 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427400640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280b3300 0x7f34280ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3426a00640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34280b4bd0 0x7f34281f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 -- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34280b4bd0 msgr2=0x7f34281f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34280b4bd0 0x7f34281f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 -- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280b3300 msgr2=0x7f34280ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280b3300 0x7f34280ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.721+0000 7f3427e00640 1 -- 172.21.15.114:0/1096575890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3428074b80 con 0x7f342815b580 2024-09-16T07:35:23.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f3427e00640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342814d0d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f342000b970 tx=0x7f342000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:23.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f341f400640 1 -- 172.21.15.114:0/1096575890 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420019070 con 0x7f342815b580 2024-09-16T07:35:23.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f341f400640 1 -- 172.21.15.114:0/1096575890 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f342000cc50 con 0x7f342815b580 2024-09-16T07:35:23.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f341f400640 1 -- 172.21.15.114:0/1096575890 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34200146a0 con 0x7f342815b580 2024-09-16T07:35:23.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34281f8ba0 con 0x7f342815b580 2024-09-16T07:35:23.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34281f9490 con 0x7f342815b580 2024-09-16T07:35:23.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34281f90c0 con 0x7f342815b580 2024-09-16T07:35:23.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f341f400640 1 -- 172.21.15.114:0/1096575890 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f342001c070 con 0x7f342815b580 2024-09-16T07:35:23.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.725+0000 7f341f400640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3408073580 0x7f3408075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:23.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.729+0000 7f341f400640 1 -- 172.21.15.114:0/1096575890 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4971+0+0 (secure 0 0 0) 0x7f3420094370 con 0x7f342815b580 2024-09-16T07:35:23.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.729+0000 7f3427400640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3408073580 0x7f3408075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:23.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.729+0000 7f3427400640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3408073580 0x7f3408075a40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f34180af000 tx=0x7f341801b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:23.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.729+0000 7f341f400640 1 -- 172.21.15.114:0/1096575890 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f34281f90c0 con 0x7f342815b580 2024-09-16T07:35:23.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.933+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34280cc550 con 0x7f342815b580 2024-09-16T07:35:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.933+0000 7f341f400640 1 -- 172.21.15.114:0/1096575890 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+3914 (secure 0 0 0) 0x7f342005e930 con 0x7f342815b580 2024-09-16T07:35:23.934 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:23.934 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":95,"btime":"2024-09-16T07:35:17:412922+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7914,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/480729207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":480729207},{"type":"v1","addr":"172.21.15.114:6833","nonce":480729207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/3104829839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3104829839},{"type":"v1","addr":"172.21.15.149:6834","nonce":3104829839}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":7920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/44383065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":44383065},{"type":"v1","addr":"172.21.15.149:6835","nonce":44383065}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8325,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2895331064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2895331064},{"type":"v1","addr":"172.21.15.114:6835","nonce":2895331064}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[]} 2024-09-16T07:35:23.935 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 95 2024-09-16T07:35:23.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3408073580 msgr2=0x7f3408075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3408073580 0x7f3408075a40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f34180af000 tx=0x7f341801b100 comp rx=0 tx=0).stop 2024-09-16T07:35:23.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 msgr2=0x7f342814d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:23.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342814d0d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f342000b970 tx=0x7f342000be30 comp rx=0 tx=0).stop 2024-09-16T07:35:23.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 shutdown_connections 2024-09-16T07:35:23.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f342815b580 0x7f342814d0d0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3408073580 0x7f3408075a40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34280b4bd0 0x7f34281f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 --2- 172.21.15.114:0/1096575890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34280b3300 0x7f34280ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:23.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 >> 172.21.15.114:0/1096575890 conn(0x7f34280b18f0 msgr2=0x7f34280cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:23.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 shutdown_connections 2024-09-16T07:35:23.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:23.937+0000 7f342e200640 1 -- 172.21.15.114:0/1096575890 wait complete. 2024-09-16T07:35:23.955 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:35:23.955 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:35:23.955 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:35:23.955 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:35:23.956 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:35:23.956 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:35:23.956 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:35:23.956 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:35:23.956 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:35:23.956 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:35:23.956 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:35:23.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:35:23.957 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:35:23.957 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:35:23.957 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:35:23.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:35:23.971 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:35:23.971 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:35:23.972 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:35:23.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:35:23.974 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:35:23.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:35:24.017 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:35:24.017 DEBUG:teuthology.parallel:result is None 2024-09-16T07:35:24.019 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:35:24.019 DEBUG:teuthology.parallel:result is None 2024-09-16T07:35:24.024 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:35:24.024 DEBUG:teuthology.parallel:result is None 2024-09-16T07:35:24.105 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:35:24.107 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:35:24.108 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:35:27.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-16T07:35:29.974 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:35:29.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:35:29.978 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:35:29.978 DEBUG:teuthology.parallel:result is None 2024-09-16T07:35:29.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:35:30.071 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:35:30.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 -- 172.21.15.114:0/444593373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 msgr2=0x7f70cc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 --2- 172.21.15.114:0/444593373 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 0x7f70cc003e60 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f70d80016f0 tx=0x7f70d801c7b0 comp rx=0 tx=0).stop 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ea000640 1 -- 172.21.15.114:0/444593373 reap_dead start 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 -- 172.21.15.114:0/444593373 shutdown_connections 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 -- 172.21.15.114:0/444593373 >> 172.21.15.114:0/444593373 conn(0x7f70e406dd30 msgr2=0x7f70e406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 -- 172.21.15.114:0/444593373 shutdown_connections 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 -- 172.21.15.114:0/444593373 wait complete. 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 Processor -- start 2024-09-16T07:35:30.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.137+0000 7f70ec000640 1 -- start start 2024-09-16T07:35:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 0x7f70e41f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70e40cfa40 0x7f70e40b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70e40b3180 0x7f70e4162e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f70e415ee30 con 0x7f70cc003a40 2024-09-16T07:35:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70e415ecb0 con 0x7f70e40cfa40 2024-09-16T07:35:30.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f70e415efb0 con 0x7f70e40b3180 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 0x7f70e41f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 0x7f70e41f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55014/0 (socket says 172.21.15.114:55014) 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 -- 172.21.15.114:0/2208842411 learned_addr learned my addr 172.21.15.114:0/2208842411 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e8c00640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70e40cfa40 0x7f70e40b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ea000640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70e40b3180 0x7f70e4162e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 -- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70e40b3180 msgr2=0x7f70e4162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70e40b3180 0x7f70e4162e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 -- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70e40cfa40 msgr2=0x7f70e40b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70e40cfa40 0x7f70e40b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 -- 172.21.15.114:0/2208842411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e41455c0 con 0x7f70cc003a40 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e9600640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 0x7f70e41f8a50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c10 tx=0x7f70d8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e1600640 1 -- 172.21.15.114:0/2208842411 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80bd070 con 0x7f70cc003a40 2024-09-16T07:35:30.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e1600640 1 -- 172.21.15.114:0/2208842411 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70d8006500 con 0x7f70cc003a40 2024-09-16T07:35:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70e1600640 1 -- 172.21.15.114:0/2208842411 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8001310 con 0x7f70cc003a40 2024-09-16T07:35:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e41458a0 con 0x7f70cc003a40 2024-09-16T07:35:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e4145e60 con 0x7f70cc003a40 2024-09-16T07:35:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.141+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e40b3590 con 0x7f70cc003a40 2024-09-16T07:35:30.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.145+0000 7f70e1600640 1 -- 172.21.15.114:0/2208842411 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f70d80a6510 con 0x7f70cc003a40 2024-09-16T07:35:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.145+0000 7f70e1600640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70c4073580 0x7f70c4075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.145+0000 7f70e1600640 1 -- 172.21.15.114:0/2208842411 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4971+0+0 (secure 0 0 0) 0x7f70d812e360 con 0x7f70cc003a40 2024-09-16T07:35:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.145+0000 7f70e8c00640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70c4073580 0x7f70c4075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:30.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.145+0000 7f70e8c00640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70c4073580 0x7f70c4075a40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70d0001250 tx=0x7f70d0006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:30.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.149+0000 7f70e1600640 1 -- 172.21.15.114:0/2208842411 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f70e40b3590 con 0x7f70cc003a40 2024-09-16T07:35:30.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:30.325+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f70e40ae4d0 con 0x7f70cc003a40 2024-09-16T07:35:31.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.597+0000 7f70e1600640 1 -- 172.21.15.114:0/2208842411 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) ==== 97+0+0 (secure 0 0 0) 0x7f70d80aa050 con 0x7f70cc003a40 2024-09-16T07:35:31.597 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:35:31.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70c4073580 msgr2=0x7f70c4075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:31.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70c4073580 0x7f70c4075a40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70d0001250 tx=0x7f70d0006040 comp rx=0 tx=0).stop 2024-09-16T07:35:31.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 msgr2=0x7f70e41f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:31.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 0x7f70e41f8a50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c10 tx=0x7f70d8003b90 comp rx=0 tx=0).stop 2024-09-16T07:35:31.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 shutdown_connections 2024-09-16T07:35:31.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70c4073580 0x7f70c4075a40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70e40b3180 0x7f70e4162e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70e40cfa40 0x7f70e40b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 --2- 172.21.15.114:0/2208842411 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70cc003a40 0x7f70e41f8a50 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 >> 172.21.15.114:0/2208842411 conn(0x7f70e406dd30 msgr2=0x7f70e40b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:31.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 shutdown_connections 2024-09-16T07:35:31.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.601+0000 7f70ec000640 1 -- 172.21.15.114:0/2208842411 wait complete. 2024-09-16T07:35:31.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:35:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.769+0000 7fb75b800640 1 -- 172.21.15.114:0/2266181228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb75415f490 msgr2=0x7fb7540b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.769+0000 7fb75b800640 1 --2- 172.21.15.114:0/2266181228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb75415f490 0x7fb7540b14c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb748009840 tx=0x7fb74801c6d0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.769+0000 7fb75b800640 1 -- 172.21.15.114:0/2266181228 shutdown_connections 2024-09-16T07:35:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.769+0000 7fb75b800640 1 --2- 172.21.15.114:0/2266181228 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7540b2e80 0x7fb7540b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 --2- 172.21.15.114:0/2266181228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb75415f490 0x7fb7540b14c0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- 172.21.15.114:0/2266181228 >> 172.21.15.114:0/2266181228 conn(0x7fb7540d1e30 msgr2=0x7fb7540d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- 172.21.15.114:0/2266181228 shutdown_connections 2024-09-16T07:35:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- 172.21.15.114:0/2266181228 wait complete. 2024-09-16T07:35:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 Processor -- start 2024-09-16T07:35:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- start start 2024-09-16T07:35:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7540b1f40 0x7fb75414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7540b2e80 0x7fb7540cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb75415f490 0x7fb7540ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb754168e00 con 0x7fb7540b2e80 2024-09-16T07:35:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb754168c80 con 0x7fb75415f490 2024-09-16T07:35:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb754168f80 con 0x7fb7540b1f40 2024-09-16T07:35:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7540b2e80 0x7fb7540cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7540b2e80 0x7fb7540cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55030/0 (socket says 172.21.15.114:55030) 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 -- 172.21.15.114:0/2961858485 learned_addr learned my addr 172.21.15.114:0/2961858485 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb758e00640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7540b1f40 0x7fb75414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb759800640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb75415f490 0x7fb7540ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 -- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7540b1f40 msgr2=0x7fb75414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7540b1f40 0x7fb75414fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 -- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb75415f490 msgr2=0x7fb7540ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb75415f490 0x7fb7540ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 -- 172.21.15.114:0/2961858485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7540c6270 con 0x7fb7540b2e80 2024-09-16T07:35:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb753e00640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7540b2e80 0x7fb7540cdb10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb74000d980 tx=0x7fb74000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb750c00640 1 -- 172.21.15.114:0/2961858485 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740017070 con 0x7fb7540b2e80 2024-09-16T07:35:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb750c00640 1 -- 172.21.15.114:0/2961858485 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb740009d20 con 0x7fb7540b2e80 2024-09-16T07:35:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7540c6550 con 0x7fb7540b2e80 2024-09-16T07:35:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.773+0000 7fb750c00640 1 -- 172.21.15.114:0/2961858485 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740004280 con 0x7fb7540b2e80 2024-09-16T07:35:31.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.777+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7540c6b10 con 0x7fb7540b2e80 2024-09-16T07:35:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.777+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7540cfda0 con 0x7fb7540b2e80 2024-09-16T07:35:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.777+0000 7fb750c00640 1 -- 172.21.15.114:0/2961858485 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fb740003600 con 0x7fb7540b2e80 2024-09-16T07:35:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.777+0000 7fb750c00640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb734073580 0x7fb734075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.777+0000 7fb750c00640 1 -- 172.21.15.114:0/2961858485 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4885+0+0 (secure 0 0 0) 0x7fb740094970 con 0x7fb7540b2e80 2024-09-16T07:35:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.777+0000 7fb758e00640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb734073580 0x7fb734075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.777+0000 7fb758e00640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb734073580 0x7fb734075a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb7480af000 tx=0x7fb74801af10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:31.781+0000 7fb750c00640 1 -- 172.21.15.114:0/2961858485 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb74005f410 con 0x7fb7540b2e80 2024-09-16T07:35:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.005+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb75415abe0 con 0x7fb7540b2e80 2024-09-16T07:35:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.005+0000 7fb750c00640 1 -- 172.21.15.114:0/2961858485 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7fb74005ed10 con 0x7fb7540b2e80 2024-09-16T07:35:32.005 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:32.005 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:35:32.005 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:35:32.005 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.005 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.006 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.007 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:35:32.008 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.009 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:35:32.010 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.011 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:35:32.012 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.013 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:35:32.014 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.015 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:35:32.016 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.017 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:35:32.018 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:35:32.019 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.019 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.019 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:35:32.019 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb734073580 msgr2=0x7fb734075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb734073580 0x7fb734075a40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb7480af000 tx=0x7fb74801af10 comp rx=0 tx=0).stop 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7540b2e80 msgr2=0x7fb7540cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7540b2e80 0x7fb7540cdb10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb74000d980 tx=0x7fb74000de40 comp rx=0 tx=0).stop 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 shutdown_connections 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb75415f490 0x7fb7540ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7540b2e80 0x7fb7540cdb10 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb734073580 0x7fb734075a40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 --2- 172.21.15.114:0/2961858485 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb7540b1f40 0x7fb75414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 >> 172.21.15.114:0/2961858485 conn(0x7fb7540d1e30 msgr2=0x7fb7540ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 shutdown_connections 2024-09-16T07:35:32.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.009+0000 7fb75b800640 1 -- 172.21.15.114:0/2961858485 wait complete. 2024-09-16T07:35:32.026 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:35:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.169+0000 7f50bfe00640 1 -- 172.21.15.114:0/2790014933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a4003a90 msgr2=0x7f50a4003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.169+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2790014933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a4003a90 0x7f50a4003eb0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f50b00016f0 tx=0x7f50b001c750 comp rx=0 tx=0).stop 2024-09-16T07:35:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.169+0000 7f50bfe00640 1 -- 172.21.15.114:0/2790014933 shutdown_connections 2024-09-16T07:35:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.169+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2790014933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50a4003a90 0x7f50a4003eb0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.169+0000 7f50bfe00640 1 -- 172.21.15.114:0/2790014933 >> 172.21.15.114:0/2790014933 conn(0x7f50c006cc20 msgr2=0x7f50c006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.169+0000 7f50bfe00640 1 -- 172.21.15.114:0/2790014933 shutdown_connections 2024-09-16T07:35:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.169+0000 7f50bfe00640 1 -- 172.21.15.114:0/2790014933 wait complete. 2024-09-16T07:35:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 Processor -- start 2024-09-16T07:35:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 -- start start 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50a4003a90 0x7f50c015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c014eaa0 0x7f50c01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c0158400 0x7f50c014de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00ce680 con 0x7f50c014eaa0 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00ce500 con 0x7f50c0158400 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00ce800 con 0x7f50a4003a90 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c014eaa0 0x7f50c01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c014eaa0 0x7f50c01550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55060/0 (socket says 172.21.15.114:55060) 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 -- 172.21.15.114:0/2339000091 learned_addr learned my addr 172.21.15.114:0/2339000091 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bea00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50a4003a90 0x7f50c015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bf400640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c0158400 0x7f50c014de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 -- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50a4003a90 msgr2=0x7f50c015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50a4003a90 0x7f50c015e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 -- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c0158400 msgr2=0x7f50c014de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c0158400 0x7f50c014de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 -- 172.21.15.114:0/2339000091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c0157640 con 0x7f50c014eaa0 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50be000640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c014eaa0 0x7f50c01550d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0066b0 tx=0x7f50ac0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50b6a00640 1 -- 172.21.15.114:0/2339000091 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac011700 con 0x7f50c014eaa0 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50b6a00640 1 -- 172.21.15.114:0/2339000091 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50ac016020 con 0x7f50c014eaa0 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c0157920 con 0x7f50c014eaa0 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50b6a00640 1 -- 172.21.15.114:0/2339000091 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac011b60 con 0x7f50c014eaa0 2024-09-16T07:35:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c0157350 con 0x7f50c014eaa0 2024-09-16T07:35:32.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.173+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c0072a50 con 0x7f50c014eaa0 2024-09-16T07:35:32.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.177+0000 7f50b6a00640 1 -- 172.21.15.114:0/2339000091 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f50ac011d00 con 0x7f50c014eaa0 2024-09-16T07:35:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.177+0000 7f50b6a00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a0073580 0x7f50a0075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.177+0000 7f50b6a00640 1 -- 172.21.15.114:0/2339000091 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4885+0+0 (secure 0 0 0) 0x7f50ac095320 con 0x7f50c014eaa0 2024-09-16T07:35:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.177+0000 7f50bea00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a0073580 0x7f50a0075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.177+0000 7f50bea00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a0073580 0x7f50a0075a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50b00016c0 tx=0x7f50b00a8040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.181+0000 7f50b6a00640 1 -- 172.21.15.114:0/2339000091 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f50ac020020 con 0x7f50c014eaa0 2024-09-16T07:35:32.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.353+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f50c015a580 con 0x7f50c014eaa0 2024-09-16T07:35:32.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.353+0000 7f50b6a00640 1 -- 172.21.15.114:0/2339000091 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) ==== 84+0+65 (secure 0 0 0) 0x7f50ac05fdc0 con 0x7f50c014eaa0 2024-09-16T07:35:32.354 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:32.354 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:35:32.354 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:32.354 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:35:32.354 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:35:32.354 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:32.354 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a0073580 msgr2=0x7f50a0075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a0073580 0x7f50a0075a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f50b00016c0 tx=0x7f50b00a8040 comp rx=0 tx=0).stop 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c014eaa0 msgr2=0x7f50c01550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c014eaa0 0x7f50c01550d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0066b0 tx=0x7f50ac0039d0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 shutdown_connections 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50c0158400 0x7f50c014de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50c014eaa0 0x7f50c01550d0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a0073580 0x7f50a0075a40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 --2- 172.21.15.114:0/2339000091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50a4003a90 0x7f50c015e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 >> 172.21.15.114:0/2339000091 conn(0x7f50c006cc20 msgr2=0x7f50c00b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 shutdown_connections 2024-09-16T07:35:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.357+0000 7f50bfe00640 1 -- 172.21.15.114:0/2339000091 wait complete. 2024-09-16T07:35:32.375 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:35:32.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:35:32.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- 172.21.15.114:0/3259574742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0040051d0 msgr2=0x7fd00400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 --2- 172.21.15.114:0/3259574742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0040051d0 0x7fd00400b9d0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd01800c640 tx=0x7fd01801d1e0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd024c00640 1 -- 172.21.15.114:0/3259574742 reap_dead start 2024-09-16T07:35:32.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- 172.21.15.114:0/3259574742 shutdown_connections 2024-09-16T07:35:32.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- 172.21.15.114:0/3259574742 >> 172.21.15.114:0/3259574742 conn(0x7fd0200d1da0 msgr2=0x7fd0200d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:32.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- 172.21.15.114:0/3259574742 shutdown_connections 2024-09-16T07:35:32.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- 172.21.15.114:0/3259574742 wait complete. 2024-09-16T07:35:32.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 Processor -- start 2024-09-16T07:35:32.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- start start 2024-09-16T07:35:32.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0040051d0 0x7fd0201f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0200c9880 0x7fd0200cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201f80f0 0x7fd0201f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd0200cea90 con 0x7fd0200c9880 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0200ce910 con 0x7fd0201f80f0 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd026c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd0200cd2e0 con 0x7fd0040051d0 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0200c9880 0x7fd0200cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0200c9880 0x7fd0200cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55080/0 (socket says 172.21.15.114:55080) 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 -- 172.21.15.114:0/1747240968 learned_addr learned my addr 172.21.15.114:0/1747240968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd024c00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201f80f0 0x7fd0201f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd01fe00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0040051d0 0x7fd0201f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 -- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0040051d0 msgr2=0x7fd0201f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0040051d0 0x7fd0201f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 -- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201f80f0 msgr2=0x7fd0201f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201f80f0 0x7fd0201f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.525+0000 7fd017400640 1 -- 172.21.15.114:0/1747240968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0200c9d00 con 0x7fd0200c9880 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd017400640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0200c9880 0x7fd0200cb530 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd008003f30 tx=0x7fd0080018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd01cc00640 1 -- 172.21.15.114:0/1747240968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008015070 con 0x7fd0200c9880 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd01cc00640 1 -- 172.21.15.114:0/1747240968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd008011900 con 0x7fd0200c9880 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd01cc00640 1 -- 172.21.15.114:0/1747240968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008011d50 con 0x7fd0200c9880 2024-09-16T07:35:32.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0201f5a80 con 0x7fd0200c9880 2024-09-16T07:35:32.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0201f57a0 con 0x7fd0200c9880 2024-09-16T07:35:32.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0200ccbd0 con 0x7fd0200c9880 2024-09-16T07:35:32.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd01cc00640 1 -- 172.21.15.114:0/1747240968 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fd00800f430 con 0x7fd0200c9880 2024-09-16T07:35:32.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd01cc00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcffc073580 0x7fcffc075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:32.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.529+0000 7fd01cc00640 1 -- 172.21.15.114:0/1747240968 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4885+0+0 (secure 0 0 0) 0x7fd008095750 con 0x7fd0200c9880 2024-09-16T07:35:32.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.533+0000 7fd01fe00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcffc073580 0x7fcffc075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:32.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.533+0000 7fd01fe00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcffc073580 0x7fcffc075a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd020073e00 tx=0x7fd0100091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:32.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.533+0000 7fd01cc00640 1 -- 172.21.15.114:0/1747240968 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd0080600e0 con 0x7fd0200c9880 2024-09-16T07:35:32.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:32.705+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd020070350 con 0x7fd0200c9880 2024-09-16T07:35:33.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.617+0000 7fd01cc00640 1 -- 172.21.15.114:0/1747240968 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v138) ==== 138+0+0 (secure 0 0 0) 0x7fd00805f9e0 con 0x7fd0200c9880 2024-09-16T07:35:33.616 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:35:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcffc073580 msgr2=0x7fcffc075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcffc073580 0x7fcffc075a40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd020073e00 tx=0x7fd0100091e0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0200c9880 msgr2=0x7fd0200cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0200c9880 0x7fd0200cb530 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd008003f30 tx=0x7fd0080018d0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 shutdown_connections 2024-09-16T07:35:33.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0201f80f0 0x7fd0201f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0200c9880 0x7fd0200cb530 secure :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd008003f30 tx=0x7fd0080018d0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcffc073580 0x7fcffc075a40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 --2- 172.21.15.114:0/1747240968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0040051d0 0x7fd0201f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 >> 172.21.15.114:0/1747240968 conn(0x7fd0200d1da0 msgr2=0x7fd020071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:33.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 shutdown_connections 2024-09-16T07:35:33.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.621+0000 7fd026c00640 1 -- 172.21.15.114:0/1747240968 wait complete. 2024-09-16T07:35:33.648 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:35:33.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 -- 172.21.15.114:0/1800813657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 msgr2=0x7f2e1c0ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:33.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 --2- 172.21.15.114:0/1800813657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 0x7f2e1c0ce5e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009840 tx=0x7f2e0c01c700 comp rx=0 tx=0).stop 2024-09-16T07:35:33.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 -- 172.21.15.114:0/1800813657 shutdown_connections 2024-09-16T07:35:33.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 --2- 172.21.15.114:0/1800813657 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e1c15c130 0x7f2e1c0ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 --2- 172.21.15.114:0/1800813657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 0x7f2e1c0ce5e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 -- 172.21.15.114:0/1800813657 >> 172.21.15.114:0/1800813657 conn(0x7f2e1c0d1ea0 msgr2=0x7f2e1c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 -- 172.21.15.114:0/1800813657 shutdown_connections 2024-09-16T07:35:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.801+0000 7f2e21e00640 1 -- 172.21.15.114:0/1800813657 wait complete. 2024-09-16T07:35:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 Processor -- start 2024-09-16T07:35:33.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 -- start start 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e1c0cf4e0 0x7f2e1c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 0x7f2e1c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e1c15c130 0x7f2e1c0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c168e50 con 0x7f2e1c15c130 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1c168cd0 con 0x7f2e1c15bd50 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1c168fd0 con 0x7f2e1c0cf4e0 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e1c15c130 0x7f2e1c0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e1c15c130 0x7f2e1c0c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55084/0 (socket says 172.21.15.114:55084) 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 -- 172.21.15.114:0/2526774839 learned_addr learned my addr 172.21.15.114:0/2526774839 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1aa00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e1c0cf4e0 0x7f2e1c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e12000640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 0x7f2e1c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 -- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e1c0cf4e0 msgr2=0x7f2e1c0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e1c0cf4e0 0x7f2e1c0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 -- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 msgr2=0x7f2e1c0c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 0x7f2e1c0c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 -- 172.21.15.114:0/2526774839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c153b00 con 0x7f2e1c15c130 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e12000640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 0x7f2e1c0c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e1b400640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e1c15c130 0x7f2e1c0c94b0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400cbc0 tx=0x7f2e1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e13e00640 1 -- 172.21.15.114:0/2526774839 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14016020 con 0x7f2e1c15c130 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e13e00640 1 -- 172.21.15.114:0/2526774839 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e1400ab00 con 0x7f2e1c15c130 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c1526a0 con 0x7f2e1c15c130 2024-09-16T07:35:33.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e13e00640 1 -- 172.21.15.114:0/2526774839 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14012420 con 0x7f2e1c15c130 2024-09-16T07:35:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.805+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1c152c60 con 0x7f2e1c15c130 2024-09-16T07:35:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.809+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1c0c5dd0 con 0x7f2e1c15c130 2024-09-16T07:35:33.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.809+0000 7f2e13e00640 1 -- 172.21.15.114:0/2526774839 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f2e14019020 con 0x7f2e1c15c130 2024-09-16T07:35:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.809+0000 7f2e13e00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2df8073580 0x7f2df8075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:33.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.809+0000 7f2e13e00640 1 -- 172.21.15.114:0/2526774839 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5255+0+0 (secure 0 0 0) 0x7f2e140950b0 con 0x7f2e1c15c130 2024-09-16T07:35:33.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.809+0000 7f2e1aa00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2df8073580 0x7f2df8075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:33.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.809+0000 7f2e1aa00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2df8073580 0x7f2df8075a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0af000 tx=0x7f2e0c01af40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.813+0000 7f2e13e00640 1 -- 172.21.15.114:0/2526774839 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2e14020020 con 0x7f2e1c15c130 2024-09-16T07:35:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:33.981+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2e1c1572b0 con 0x7f2e1c15c130 2024-09-16T07:35:34.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-16T07:35:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.625+0000 7f2e13e00640 1 -- 172.21.15.114:0/2526774839 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v139) ==== 170+0+0 (secure 0 0 0) 0x7f2e1405f9d0 con 0x7f2e1c15c130 2024-09-16T07:35:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:35:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2df8073580 msgr2=0x7f2df8075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2df8073580 0x7f2df8075a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0af000 tx=0x7f2e0c01af40 comp rx=0 tx=0).stop 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e1c15c130 msgr2=0x7f2e1c0c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e1c15c130 0x7f2e1c0c94b0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400cbc0 tx=0x7f2e1400ccb0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 shutdown_connections 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e1c15c130 0x7f2e1c0c94b0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c15bd50 0x7f2e1c0c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2df8073580 0x7f2df8075a40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 --2- 172.21.15.114:0/2526774839 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2e1c0cf4e0 0x7f2e1c0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 >> 172.21.15.114:0/2526774839 conn(0x7f2e1c0d1ea0 msgr2=0x7f2e1c0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 shutdown_connections 2024-09-16T07:35:34.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.629+0000 7f2e21e00640 1 -- 172.21.15.114:0/2526774839 wait complete. 2024-09-16T07:35:34.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:35:34.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 -- 172.21.15.114:0/1198941928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 msgr2=0x7f4cc406f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:34.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1198941928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 0x7f4cc406f090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009930 tx=0x7f4cb401c8e0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 -- 172.21.15.114:0/1198941928 shutdown_connections 2024-09-16T07:35:34.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1198941928 >> v2:172.21.15.149:3300/0 conn(0x7f4cc415ff50 0x7f4cc406d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1198941928 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 0x7f4cc406f090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 -- 172.21.15.114:0/1198941928 >> 172.21.15.114:0/1198941928 conn(0x7f4cc40cce90 msgr2=0x7f4cc40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:34.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 -- 172.21.15.114:0/1198941928 shutdown_connections 2024-09-16T07:35:34.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.809+0000 7f4ccb000640 1 -- 172.21.15.114:0/1198941928 wait complete. 2024-09-16T07:35:34.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 Processor -- start 2024-09-16T07:35:34.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 -- start start 2024-09-16T07:35:34.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc40c6b00 0x7f4cc4150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 0x7f4cc40b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc415ff50 0x7f4cc40b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4168bc0 con 0x7f4cc415ff50 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4074040 con 0x7f4cc40c6b00 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc4168d40 con 0x7f4cc4152b90 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc415ff50 0x7f4cc40b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc415ff50 0x7f4cc40b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57294/0 (socket says 172.21.15.114:57294) 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 -- 172.21.15.114:0/1732313514 learned_addr learned my addr 172.21.15.114:0/1732313514 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc3400640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 0x7f4cc40b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc3e00640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc40c6b00 0x7f4cc4150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 -- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 msgr2=0x7f4cc40b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 0x7f4cc40b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 -- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc40c6b00 msgr2=0x7f4cc4150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc40c6b00 0x7f4cc4150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 -- 172.21.15.114:0/1732313514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc40b0d60 con 0x7f4cc415ff50 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cc9000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc415ff50 0x7f4cc40b2310 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00ec00 tx=0x7f4cbc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cbbe00640 1 -- 172.21.15.114:0/1732313514 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc003b80 con 0x7f4cc415ff50 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cbbe00640 1 -- 172.21.15.114:0/1732313514 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cbc003e10 con 0x7f4cc415ff50 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc415d910 con 0x7f4cc415ff50 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4cbbe00640 1 -- 172.21.15.114:0/1732313514 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc004280 con 0x7f4cc415ff50 2024-09-16T07:35:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc415ded0 con 0x7f4cc415ff50 2024-09-16T07:35:34.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.813+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc406f090 con 0x7f4cc415ff50 2024-09-16T07:35:34.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.817+0000 7f4cbbe00640 1 -- 172.21.15.114:0/1732313514 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f4cbc004420 con 0x7f4cc415ff50 2024-09-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.817+0000 7f4cbbe00640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ca4073580 0x7f4ca4075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.817+0000 7f4cbbe00640 1 -- 172.21.15.114:0/1732313514 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5637+0+0 (secure 0 0 0) 0x7f4cbc095ab0 con 0x7f4cc415ff50 2024-09-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.817+0000 7f4cc3e00640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ca4073580 0x7f4ca4075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:34.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.817+0000 7f4cc3e00640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ca4073580 0x7f4ca4075a40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009930 tx=0x7f4cb401b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:34.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:34.821+0000 7f4cbbe00640 1 -- 172.21.15.114:0/1732313514 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4cbc05fbc0 con 0x7f4cc415ff50 2024-09-16T07:35:35.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.021+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4cc414ea70 con 0x7f4cc415ff50 2024-09-16T07:35:35.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.625+0000 7f4cbbe00640 1 -- 172.21.15.114:0/1732313514 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v99) ==== 174+0+0 (secure 0 0 0) 0x7f4cbc0645f0 con 0x7f4cc415ff50 2024-09-16T07:35:35.626 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 22 and data pool 23 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ca4073580 msgr2=0x7f4ca4075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ca4073580 0x7f4ca4075a40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009930 tx=0x7f4cb401b120 comp rx=0 tx=0).stop 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc415ff50 msgr2=0x7f4cc40b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc415ff50 0x7f4cc40b2310 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00ec00 tx=0x7f4cbc00c6a0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 shutdown_connections 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc415ff50 0x7f4cc40b2310 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ca4073580 0x7f4ca4075a40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc4152b90 0x7f4cc40b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 --2- 172.21.15.114:0/1732313514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc40c6b00 0x7f4cc4150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 >> 172.21.15.114:0/1732313514 conn(0x7f4cc40cce90 msgr2=0x7f4cc4151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:35.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 shutdown_connections 2024-09-16T07:35:35.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.629+0000 7f4ccb000640 1 -- 172.21.15.114:0/1732313514 wait complete. 2024-09-16T07:35:35.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 -- 172.21.15.114:0/3689268802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5980b4cf0 msgr2=0x7fc5980b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 --2- 172.21.15.114:0/3689268802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5980b4cf0 0x7fc5980b3130 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fc590009c80 tx=0x7fc59001cd10 comp rx=0 tx=0).stop 2024-09-16T07:35:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 -- 172.21.15.114:0/3689268802 shutdown_connections 2024-09-16T07:35:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 --2- 172.21.15.114:0/3689268802 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5980b4cf0 0x7fc5980b3130 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 --2- 172.21.15.114:0/3689268802 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc59815e260 0x7fc5980b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 -- 172.21.15.114:0/3689268802 >> 172.21.15.114:0/3689268802 conn(0x7fc5980b18f0 msgr2=0x7fc5980b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:35.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 -- 172.21.15.114:0/3689268802 shutdown_connections 2024-09-16T07:35:35.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 -- 172.21.15.114:0/3689268802 wait complete. 2024-09-16T07:35:35.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 Processor -- start 2024-09-16T07:35:35.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.817+0000 7fc59e000640 1 -- start start 2024-09-16T07:35:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5980b4cf0 0x7fc598164050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc59815e260 0x7fc59814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc59814eb40 0x7fc59814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc598168350 con 0x7fc59814eb40 2024-09-16T07:35:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc5981681d0 con 0x7fc59815e260 2024-09-16T07:35:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc5981684d0 con 0x7fc5980b4cf0 2024-09-16T07:35:35.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc597400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5980b4cf0 0x7fc598164050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc596a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc59815e260 0x7fc59814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc597e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc59814eb40 0x7fc59814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc597400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5980b4cf0 0x7fc598164050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:36366/0 (socket says 172.21.15.114:36366) 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc597400640 1 -- 172.21.15.114:0/999040355 learned_addr learned my addr 172.21.15.114:0/999040355 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc596a00640 1 -- 172.21.15.114:0/999040355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5980b4cf0 msgr2=0x7fc598164050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc596a00640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5980b4cf0 0x7fc598164050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc596a00640 1 -- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc59814eb40 msgr2=0x7fc59814eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc596a00640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc59814eb40 0x7fc59814eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc596a00640 1 -- 172.21.15.114:0/999040355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc598154960 con 0x7fc59815e260 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc597e00640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc59814eb40 0x7fc59814eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:35:35.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc596a00640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc59815e260 0x7fc59814e310 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc5980b42f0 tx=0x7fc58400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:35.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc58f400640 1 -- 172.21.15.114:0/999040355 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584017070 con 0x7fc59815e260 2024-09-16T07:35:35.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc58f400640 1 -- 172.21.15.114:0/999040355 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5840053c0 con 0x7fc59815e260 2024-09-16T07:35:35.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc598154c40 con 0x7fc59815e260 2024-09-16T07:35:35.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc58f400640 1 -- 172.21.15.114:0/999040355 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584003860 con 0x7fc59815e260 2024-09-16T07:35:35.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc598072fe0 con 0x7fc59815e260 2024-09-16T07:35:35.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.821+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc598069410 con 0x7fc59815e260 2024-09-16T07:35:35.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.825+0000 7fc58f400640 1 -- 172.21.15.114:0/999040355 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fc58401a070 con 0x7fc59815e260 2024-09-16T07:35:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.825+0000 7fc58f400640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc578073580 0x7fc578075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.825+0000 7fc58f400640 1 -- 172.21.15.114:0/999040355 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5737+0+0 (secure 0 0 0) 0x7fc584093e40 con 0x7fc59815e260 2024-09-16T07:35:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.825+0000 7fc597400640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc578073580 0x7fc578075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:35.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.825+0000 7fc597400640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc578073580 0x7fc578075a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc588009c00 tx=0x7fc5880091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:35.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.829+0000 7fc58f400640 1 -- 172.21.15.114:0/999040355 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc58405df70 con 0x7fc59815e260 2024-09-16T07:35:35.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.997+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc598072dd0 con 0x7fc59815e260 2024-09-16T07:35:35.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:35.997+0000 7fc58f400640 1 -- 172.21.15.114:0/999040355 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16836 (secure 0 0 0) 0x7fc5840629a0 con 0x7fc59815e260 2024-09-16T07:35:35.997 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:35.997 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":140,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:35:35.026423+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:35:32.721475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-16T07:35:33.996800+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc578073580 msgr2=0x7fc578075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc578073580 0x7fc578075a40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc588009c00 tx=0x7fc5880091e0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc59815e260 msgr2=0x7fc59814e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc59815e260 0x7fc59814e310 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc5980b42f0 tx=0x7fc58400c890 comp rx=0 tx=0).stop 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 shutdown_connections 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc59814eb40 0x7fc59814eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc59815e260 0x7fc59814e310 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc578073580 0x7fc578075a40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:35.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 --2- 172.21.15.114:0/999040355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc5980b4cf0 0x7fc598164050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 >> 172.21.15.114:0/999040355 conn(0x7fc5980b18f0 msgr2=0x7fc5980b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:36.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 shutdown_connections 2024-09-16T07:35:36.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.001+0000 7fc59e000640 1 -- 172.21.15.114:0/999040355 wait complete. 2024-09-16T07:35:36.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:36.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.161+0000 7f9f52200640 1 -- 172.21.15.114:0/3788057921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f30003a10 msgr2=0x7f9f30003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.161+0000 7f9f52200640 1 --2- 172.21.15.114:0/3788057921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f30003a10 0x7f9f30003e30 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009b60 tx=0x7f9f3c01d270 comp rx=0 tx=0).stop 2024-09-16T07:35:36.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.161+0000 7f9f4be00640 1 -- 172.21.15.114:0/3788057921 reap_dead start 2024-09-16T07:35:36.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.161+0000 7f9f52200640 1 -- 172.21.15.114:0/3788057921 shutdown_connections 2024-09-16T07:35:36.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.161+0000 7f9f52200640 1 -- 172.21.15.114:0/3788057921 >> 172.21.15.114:0/3788057921 conn(0x7f9f4c0d1dc0 msgr2=0x7f9f4c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:36.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.161+0000 7f9f52200640 1 -- 172.21.15.114:0/3788057921 shutdown_connections 2024-09-16T07:35:36.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.161+0000 7f9f52200640 1 -- 172.21.15.114:0/3788057921 wait complete. 2024-09-16T07:35:36.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 Processor -- start 2024-09-16T07:35:36.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 -- start start 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f30003a10 0x7f9f4c15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f4c0c8e90 0x7f9f4c14fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f4c1f7a90 0x7f9f4c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c166f00 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c166d80 con 0x7f9f30003a10 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c167080 con 0x7f9f4c1f7a90 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f4c0c8e90 0x7f9f4c14fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f4c0c8e90 0x7f9f4c14fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57332/0 (socket says 172.21.15.114:57332) 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 -- 172.21.15.114:0/4011996468 learned_addr learned my addr 172.21.15.114:0/4011996468 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:36.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f4b400640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f30003a10 0x7f9f4c15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f4be00640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f4c1f7a90 0x7f9f4c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 -- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f4c1f7a90 msgr2=0x7f9f4c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f4c1f7a90 0x7f9f4c0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 -- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f30003a10 msgr2=0x7f9f4c15b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f30003a10 0x7f9f4c15b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 -- 172.21.15.114:0/4011996468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c1f7f10 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43e00640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f4c0c8e90 0x7f9f4c14fe40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9f34006600 tx=0x7f9f340039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43400640 1 -- 172.21.15.114:0/4011996468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34011700 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43400640 1 -- 172.21.15.114:0/4011996468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f34016020 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c0c9320 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f43400640 1 -- 172.21.15.114:0/4011996468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34011b60 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.165+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c163fb0 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.169+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4c0ceb90 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.169+0000 7f9f43400640 1 -- 172.21.15.114:0/4011996468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f9f34011d00 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.169+0000 7f9f43400640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f28073580 0x7f9f28075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.169+0000 7f9f43400640 1 -- 172.21.15.114:0/4011996468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5737+0+0 (secure 0 0 0) 0x7f9f340955b0 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.169+0000 7f9f4b400640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f28073580 0x7f9f28075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.169+0000 7f9f4b400640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f28073580 0x7f9f28075a40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0ae000 tx=0x7f9f3c01a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:36.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.173+0000 7f9f43400640 1 -- 172.21.15.114:0/4011996468 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9f34020020 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.341+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f4c0d2370 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f43400640 1 -- 172.21.15.114:0/4011996468 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16836 (secure 0 0 0) 0x7f9f3405fd00 con 0x7f9f4c0c8e90 2024-09-16T07:35:36.343 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:36.343 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":140,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:35:35.026423+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:35:32.721475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-16T07:35:33.996800+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:36.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f28073580 msgr2=0x7f9f28075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f28073580 0x7f9f28075a40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0ae000 tx=0x7f9f3c01a010 comp rx=0 tx=0).stop 2024-09-16T07:35:36.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f4c0c8e90 msgr2=0x7f9f4c14fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f4c0c8e90 0x7f9f4c14fe40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9f34006600 tx=0x7f9f340039d0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 shutdown_connections 2024-09-16T07:35:36.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f28073580 0x7f9f28075a40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f4c1f7a90 0x7f9f4c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f4c0c8e90 0x7f9f4c14fe40 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 --2- 172.21.15.114:0/4011996468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f30003a10 0x7f9f4c15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 >> 172.21.15.114:0/4011996468 conn(0x7f9f4c0d1dc0 msgr2=0x7f9f4c0b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:36.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 shutdown_connections 2024-09-16T07:35:36.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.345+0000 7f9f52200640 1 -- 172.21.15.114:0/4011996468 wait complete. 2024-09-16T07:35:36.365 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:35:36.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 -- 172.21.15.114:0/2805555228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 msgr2=0x7f9268005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 --2- 172.21.15.114:0/2805555228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f9268005da0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f926c006fa0 tx=0x7f926c01ce80 comp rx=0 tx=0).stop 2024-09-16T07:35:36.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 -- 172.21.15.114:0/2805555228 shutdown_connections 2024-09-16T07:35:36.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 --2- 172.21.15.114:0/2805555228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f9268005da0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 -- 172.21.15.114:0/2805555228 >> 172.21.15.114:0/2805555228 conn(0x7f92840b18f0 msgr2=0x7f92840b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:36.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 -- 172.21.15.114:0/2805555228 shutdown_connections 2024-09-16T07:35:36.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 -- 172.21.15.114:0/2805555228 wait complete. 2024-09-16T07:35:36.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 Processor -- start 2024-09-16T07:35:36.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.513+0000 7f928bc00640 1 -- start start 2024-09-16T07:35:36.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f928414a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92840c6ee0 0x7f92840c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f928409c440 0x7f928409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f92840ceba0 con 0x7f9268005920 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f92840cea20 con 0x7f92840c6ee0 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f92840ced20 con 0x7f928409c440 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f928414a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f928414a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57358/0 (socket says 172.21.15.114:57358) 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 -- 172.21.15.114:0/977680542 learned_addr learned my addr 172.21.15.114:0/977680542 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289c00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f928409c440 0x7f928409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f927be00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92840c6ee0 0x7f92840c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 -- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f928409c440 msgr2=0x7f928409c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f928409c440 0x7f928409c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 -- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92840c6ee0 msgr2=0x7f92840c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:36.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92840c6ee0 0x7f92840c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:36.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 -- 172.21.15.114:0/977680542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928409d1e0 con 0x7f9268005920 2024-09-16T07:35:36.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9289200640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f928414a620 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f9274003ef0 tx=0x7f9274001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:36.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9281600640 1 -- 172.21.15.114:0/977680542 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274011640 con 0x7f9268005920 2024-09-16T07:35:36.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9281600640 1 -- 172.21.15.114:0/977680542 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9274016020 con 0x7f9268005920 2024-09-16T07:35:36.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9281600640 1 -- 172.21.15.114:0/977680542 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274011a80 con 0x7f9268005920 2024-09-16T07:35:36.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928409d4c0 con 0x7f9268005920 2024-09-16T07:35:36.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92840c4ee0 con 0x7f9268005920 2024-09-16T07:35:36.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92840cf280 con 0x7f9268005920 2024-09-16T07:35:36.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.517+0000 7f9281600640 1 -- 172.21.15.114:0/977680542 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f9274011c20 con 0x7f9268005920 2024-09-16T07:35:36.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.521+0000 7f9281600640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9260073580 0x7f9260075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:36.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.521+0000 7f9281600640 1 -- 172.21.15.114:0/977680542 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5737+0+0 (secure 0 0 0) 0x7f9274095820 con 0x7f9268005920 2024-09-16T07:35:36.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.521+0000 7f927be00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9260073580 0x7f9260075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:36.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.521+0000 7f927be00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9260073580 0x7f9260075a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f926c0ab000 tx=0x7f926c019cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:36.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.525+0000 7f9281600640 1 -- 172.21.15.114:0/977680542 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9274020020 con 0x7f9268005920 2024-09-16T07:35:36.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:36.729+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f92840b1e70 con 0x7f9268005920 2024-09-16T07:35:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.653+0000 7f9281600640 1 -- 172.21.15.114:0/977680542 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v102) ==== 118+0+0 (secure 0 0 0) 0x7f927405ff70 con 0x7f9268005920 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9260073580 msgr2=0x7f9260075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9260073580 0x7f9260075a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f926c0ab000 tx=0x7f926c019cc0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 msgr2=0x7f928414a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f928414a620 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f9274003ef0 tx=0x7f9274001640 comp rx=0 tx=0).stop 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 shutdown_connections 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9260073580 0x7f9260075a40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f928409c440 0x7f928409c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f92840c6ee0 0x7f92840c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 --2- 172.21.15.114:0/977680542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9268005920 0x7f928414a620 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 >> 172.21.15.114:0/977680542 conn(0x7f92840b18f0 msgr2=0x7f9284073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 shutdown_connections 2024-09-16T07:35:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.657+0000 7f928bc00640 1 -- 172.21.15.114:0/977680542 wait complete. 2024-09-16T07:35:37.678 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:35:37.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 -- 172.21.15.114:0/2258682744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80b4810 msgr2=0x7f71f80ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2258682744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80b4810 0x7f71f80ce810 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f71f806aab0 tx=0x7f71f001c830 comp rx=0 tx=0).stop 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 -- 172.21.15.114:0/2258682744 shutdown_connections 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2258682744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80b4810 0x7f71f80ce810 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2258682744 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71f80cd100 0x7f71f80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2258682744 >> v2:172.21.15.149:3300/0 conn(0x7f71f815dae0 0x7f71f80acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 -- 172.21.15.114:0/2258682744 >> 172.21.15.114:0/2258682744 conn(0x7f71f80b18f0 msgr2=0x7f71f80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 -- 172.21.15.114:0/2258682744 shutdown_connections 2024-09-16T07:35:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 -- 172.21.15.114:0/2258682744 wait complete. 2024-09-16T07:35:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 Processor -- start 2024-09-16T07:35:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.829+0000 7f71fdc00640 1 -- start start 2024-09-16T07:35:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71f80b4810 0x7f71f80cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80cd100 0x7f71f8148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f815dae0 0x7f71f8148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f71f80cf4b0 con 0x7f71f80cd100 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f71f80cf330 con 0x7f71f815dae0 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f71f8167120 con 0x7f71f80b4810 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80cd100 0x7f71f8148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71f6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71f80b4810 0x7f71f80cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80cd100 0x7f71f8148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57378/0 (socket says 172.21.15.114:57378) 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 -- 172.21.15.114:0/2539188790 learned_addr learned my addr 172.21.15.114:0/2539188790 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:37.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71f7400640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f815dae0 0x7f71f8148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 -- 172.21.15.114:0/2539188790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71f80b4810 msgr2=0x7f71f80cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71f80b4810 0x7f71f80cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 -- 172.21.15.114:0/2539188790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f815dae0 msgr2=0x7f71f8148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f815dae0 0x7f71f8148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 -- 172.21.15.114:0/2539188790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f80c5060 con 0x7f71f80cd100 2024-09-16T07:35:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ee000640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80cd100 0x7f71f8148530 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b480 tx=0x7f71e000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ef400640 1 -- 172.21.15.114:0/2539188790 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0014070 con 0x7f71f80cd100 2024-09-16T07:35:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ef400640 1 -- 172.21.15.114:0/2539188790 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71e0010980 con 0x7f71f80cd100 2024-09-16T07:35:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71ef400640 1 -- 172.21.15.114:0/2539188790 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0010dd0 con 0x7f71f80cd100 2024-09-16T07:35:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f8162e80 con 0x7f71f80cd100 2024-09-16T07:35:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f8163440 con 0x7f71f80cd100 2024-09-16T07:35:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.833+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f8069410 con 0x7f71f80cd100 2024-09-16T07:35:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.837+0000 7f71ef400640 1 -- 172.21.15.114:0/2539188790 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f71e0017070 con 0x7f71f80cd100 2024-09-16T07:35:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.837+0000 7f71ef400640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71d4073580 0x7f71d4075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.837+0000 7f71ef400640 1 -- 172.21.15.114:0/2539188790 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f71e0094970 con 0x7f71f80cd100 2024-09-16T07:35:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.837+0000 7f71f6a00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71d4073580 0x7f71d4075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:37.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.837+0000 7f71f6a00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71d4073580 0x7f71d4075a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71e800a400 tx=0x7f71e800d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:37.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:37.841+0000 7f71ef400640 1 -- 172.21.15.114:0/2539188790 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f71e005ea70 con 0x7f71f80cd100 2024-09-16T07:35:38.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.041+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f71f80b42d0 con 0x7f71f80cd100 2024-09-16T07:35:38.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71ef400640 1 -- 172.21.15.114:0/2539188790 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v103) ==== 122+0+0 (secure 0 0 0) 0x7f71e00634a0 con 0x7f71f80cd100 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71d4073580 msgr2=0x7f71d4075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71d4073580 0x7f71d4075a40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f71e800a400 tx=0x7f71e800d040 comp rx=0 tx=0).stop 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80cd100 msgr2=0x7f71f8148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80cd100 0x7f71f8148530 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b480 tx=0x7f71e000b940 comp rx=0 tx=0).stop 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 shutdown_connections 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f815dae0 0x7f71f8148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71f80cd100 0x7f71f8148530 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f71d4073580 0x7f71d4075a40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 --2- 172.21.15.114:0/2539188790 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71f80b4810 0x7f71f80cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 >> 172.21.15.114:0/2539188790 conn(0x7f71f80b18f0 msgr2=0x7f71f806fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 shutdown_connections 2024-09-16T07:35:38.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.661+0000 7f71fdc00640 1 -- 172.21.15.114:0/2539188790 wait complete. 2024-09-16T07:35:38.682 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:35:38.683 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- 172.21.15.114:0/2437060693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f78160490 msgr2=0x7f7f780ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 --2- 172.21.15.114:0/2437060693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f78160490 0x7f7f780ce2e0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009840 tx=0x7f7f7001c820 comp rx=0 tx=0).stop 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- 172.21.15.114:0/2437060693 shutdown_connections 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 --2- 172.21.15.114:0/2437060693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f78160490 0x7f7f780ce2e0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 --2- 172.21.15.114:0/2437060693 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f7815f9a0 0x7f7f7806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- 172.21.15.114:0/2437060693 >> 172.21.15.114:0/2437060693 conn(0x7f7f780b18f0 msgr2=0x7f7f780b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- 172.21.15.114:0/2437060693 shutdown_connections 2024-09-16T07:35:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- 172.21.15.114:0/2437060693 wait complete. 2024-09-16T07:35:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 Processor -- start 2024-09-16T07:35:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- start start 2024-09-16T07:35:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f780cf1d0 0x7f7f78166640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f7815f9a0 0x7f7f78165160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f78160490 0x7f7f781656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7f781693c0 con 0x7f7f780cf1d0 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78169240 con 0x7f7f7815f9a0 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f7e200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7f78169540 con 0x7f7f78160490 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f77400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f780cf1d0 0x7f7f78166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.829+0000 7f7f77400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f780cf1d0 0x7f7f78166640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57390/0 (socket says 172.21.15.114:57390) 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77400640 1 -- 172.21.15.114:0/3981174212 learned_addr learned my addr 172.21.15.114:0/3981174212 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77e00640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f78160490 0x7f7f781656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f6ea00640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f7815f9a0 0x7f7f78165160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77400640 1 -- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f78160490 msgr2=0x7f7f781656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77400640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f78160490 0x7f7f781656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77400640 1 -- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f7815f9a0 msgr2=0x7f7f78165160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77400640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f7815f9a0 0x7f7f78165160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77400640 1 -- 172.21.15.114:0/3981174212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f78166b80 con 0x7f7f780cf1d0 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f6ea00640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f7815f9a0 0x7f7f78165160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:38.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f77400640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f780cf1d0 0x7f7f78166640 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009fd0 tx=0x7f7f6800c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f6fe00640 1 -- 172.21.15.114:0/3981174212 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011470 con 0x7f7f780cf1d0 2024-09-16T07:35:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f6fe00640 1 -- 172.21.15.114:0/3981174212 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f68011700 con 0x7f7f780cf1d0 2024-09-16T07:35:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f780b3ae0 con 0x7f7f780cf1d0 2024-09-16T07:35:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f6fe00640 1 -- 172.21.15.114:0/3981174212 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68011b30 con 0x7f7f780cf1d0 2024-09-16T07:35:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f78166120 con 0x7f7f780cf1d0 2024-09-16T07:35:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f78069410 con 0x7f7f780cf1d0 2024-09-16T07:35:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f6fe00640 1 -- 172.21.15.114:0/3981174212 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f7f68011cd0 con 0x7f7f780cf1d0 2024-09-16T07:35:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.833+0000 7f7f6fe00640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7f54073580 0x7f7f54075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:38.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.837+0000 7f7f6fe00640 1 -- 172.21.15.114:0/3981174212 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f7f68095810 con 0x7f7f780cf1d0 2024-09-16T07:35:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.837+0000 7f7f6ea00640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7f54073580 0x7f7f54075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:38.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.837+0000 7f7f6ea00640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7f54073580 0x7f7f54075a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7f60007a60 tx=0x7f7f60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:38.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:38.837+0000 7f7f6fe00640 1 -- 172.21.15.114:0/3981174212 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7f68016030 con 0x7f7f780cf1d0 2024-09-16T07:35:39.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.041+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f78074890 con 0x7f7f780cf1d0 2024-09-16T07:35:39.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.041+0000 7f7f6fe00640 1 -- 172.21.15.114:0/3981174212 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5241 (secure 0 0 0) 0x7f7f6805ff10 con 0x7f7f780cf1d0 2024-09-16T07:35:39.040 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:39.040 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":103,"btime":"2024-09-16T07:35:38:658904+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4246164040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4246164040},{"type":"v1","addr":"172.21.15.114:6833","nonce":4246164040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2023547758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":2023547758},{"type":"v1","addr":"172.21.15.149:6835","nonce":2023547758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8409,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/4110489344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":4110489344},{"type":"v1","addr":"172.21.15.149:6834","nonce":4110489344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:35:35.026388+0000","modified":"2024-09-16T07:35:38.048575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8415":{"gid":8415,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1141336969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1141336969},{"type":"v1","addr":"172.21.15.114:6835","nonce":1141336969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8415,"qdb_cluster":[8415]},"id":11}]} 2024-09-16T07:35:39.040 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 103 2024-09-16T07:35:39.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7f54073580 msgr2=0x7f7f54075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7f54073580 0x7f7f54075a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7f60007a60 tx=0x7f7f60009040 comp rx=0 tx=0).stop 2024-09-16T07:35:39.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f780cf1d0 msgr2=0x7f7f78166640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f780cf1d0 0x7f7f78166640 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009fd0 tx=0x7f7f6800c270 comp rx=0 tx=0).stop 2024-09-16T07:35:39.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 shutdown_connections 2024-09-16T07:35:39.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7f54073580 0x7f7f54075a40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7f78160490 0x7f7f781656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f7815f9a0 0x7f7f78165160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 --2- 172.21.15.114:0/3981174212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f780cf1d0 0x7f7f78166640 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 >> 172.21.15.114:0/3981174212 conn(0x7f7f780b18f0 msgr2=0x7f7f7815fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:39.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 shutdown_connections 2024-09-16T07:35:39.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.045+0000 7f7f7e200640 1 -- 172.21.15.114:0/3981174212 wait complete. 2024-09-16T07:35:39.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 -- 172.21.15.114:0/4293952683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7144003a90 msgr2=0x7f7144003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 --2- 172.21.15.114:0/4293952683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7144003a90 0x7f7144003eb0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f7150006f90 tx=0x7f715001ceb0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715f400640 1 -- 172.21.15.114:0/4293952683 reap_dead start 2024-09-16T07:35:39.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 -- 172.21.15.114:0/4293952683 shutdown_connections 2024-09-16T07:35:39.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 -- 172.21.15.114:0/4293952683 >> 172.21.15.114:0/4293952683 conn(0x7f71600b1b90 msgr2=0x7f71600b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:39.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 -- 172.21.15.114:0/4293952683 shutdown_connections 2024-09-16T07:35:39.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 -- 172.21.15.114:0/4293952683 wait complete. 2024-09-16T07:35:39.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 Processor -- start 2024-09-16T07:35:39.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.205+0000 7f715fe00640 1 -- start start 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7144003a90 0x7f71600a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71601f84c0 0x7f71600aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7160163ad0 0x7f7160163f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f716015f320 con 0x7f7160163ad0 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f716015f1a0 con 0x7f71601f84c0 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f716015f4a0 con 0x7f7144003a90 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7160163ad0 0x7f7160163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7160163ad0 0x7f7160163f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57404/0 (socket says 172.21.15.114:57404) 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 -- 172.21.15.114:0/417390390 learned_addr learned my addr 172.21.15.114:0/417390390 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:39.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715ea00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7144003a90 0x7f71600a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715e000640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71601f84c0 0x7f71600aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 -- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7144003a90 msgr2=0x7f71600a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7144003a90 0x7f71600a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 -- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71601f84c0 msgr2=0x7f71600aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71601f84c0 0x7f71600aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 -- 172.21.15.114:0/417390390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71600d0110 con 0x7f7160163ad0 2024-09-16T07:35:39.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715f400640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7160163ad0 0x7f7160163f30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f71600afaa0 tx=0x7f715800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:39.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f7156a00640 1 -- 172.21.15.114:0/417390390 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158004b30 con 0x7f7160163ad0 2024-09-16T07:35:39.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f7156a00640 1 -- 172.21.15.114:0/417390390 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7158004cd0 con 0x7f7160163ad0 2024-09-16T07:35:39.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f7156a00640 1 -- 172.21.15.114:0/417390390 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158003be0 con 0x7f7160163ad0 2024-09-16T07:35:39.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71600aa060 con 0x7f7160163ad0 2024-09-16T07:35:39.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71600aa340 con 0x7f7160163ad0 2024-09-16T07:35:39.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.209+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7160164470 con 0x7f7160163ad0 2024-09-16T07:35:39.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.213+0000 7f7156a00640 1 -- 172.21.15.114:0/417390390 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f7158004030 con 0x7f7160163ad0 2024-09-16T07:35:39.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.213+0000 7f7156a00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7140073580 0x7f7140075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.213+0000 7f7156a00640 1 -- 172.21.15.114:0/417390390 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f7158095230 con 0x7f7160163ad0 2024-09-16T07:35:39.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.213+0000 7f715ea00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7140073580 0x7f7140075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.213+0000 7f715ea00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7140073580 0x7f7140075a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f71500ac000 tx=0x7f7150019cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:39.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.217+0000 7f7156a00640 1 -- 172.21.15.114:0/417390390 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f715805f370 con 0x7f7160163ad0 2024-09-16T07:35:39.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.385+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7160074410 con 0x7f7160163ad0 2024-09-16T07:35:39.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.385+0000 7f7156a00640 1 -- 172.21.15.114:0/417390390 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16823 (secure 0 0 0) 0x7f7158063da0 con 0x7f7160163ad0 2024-09-16T07:35:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:39.385 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":141,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:35:36.642863+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:35:32.721475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-16T07:35:33.996800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:39.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7140073580 msgr2=0x7f7140075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7140073580 0x7f7140075a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f71500ac000 tx=0x7f7150019cf0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7160163ad0 msgr2=0x7f7160163f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7160163ad0 0x7f7160163f30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f71600afaa0 tx=0x7f715800f3c0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 shutdown_connections 2024-09-16T07:35:39.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7160163ad0 0x7f7160163f30 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71601f84c0 0x7f71600aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7140073580 0x7f7140075a40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 --2- 172.21.15.114:0/417390390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7144003a90 0x7f71600a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 >> 172.21.15.114:0/417390390 conn(0x7f71600b1b90 msgr2=0x7f7160073300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:39.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 shutdown_connections 2024-09-16T07:35:39.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.389+0000 7f715fe00640 1 -- 172.21.15.114:0/417390390 wait complete. 2024-09-16T07:35:39.406 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:35:39.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:35:39.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.549+0000 7f4c01800640 1 -- 172.21.15.114:0/1985390785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0ce800 msgr2=0x7f4bfc06cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.549+0000 7f4c01800640 1 --2- 172.21.15.114:0/1985390785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0ce800 0x7f4bfc06cc20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009840 tx=0x7f4bec01c820 comp rx=0 tx=0).stop 2024-09-16T07:35:39.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.549+0000 7f4c01800640 1 -- 172.21.15.114:0/1985390785 shutdown_connections 2024-09-16T07:35:39.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.549+0000 7f4c01800640 1 --2- 172.21.15.114:0/1985390785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0ce800 0x7f4bfc06cc20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.549+0000 7f4c01800640 1 -- 172.21.15.114:0/1985390785 >> 172.21.15.114:0/1985390785 conn(0x7f4bfc0b2240 msgr2=0x7f4bfc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:39.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.549+0000 7f4c01800640 1 -- 172.21.15.114:0/1985390785 shutdown_connections 2024-09-16T07:35:39.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.549+0000 7f4c01800640 1 -- 172.21.15.114:0/1985390785 wait complete. 2024-09-16T07:35:39.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 Processor -- start 2024-09-16T07:35:39.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 -- start start 2024-09-16T07:35:39.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc070530 0x7f4bfc15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc073170 0x7f4bfc0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0ce800 0x7f4bfc0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc1695f0 con 0x7f4bfc070530 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc169470 con 0x7f4bfc073170 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc169770 con 0x7f4bfc0ce800 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc070530 0x7f4bfc15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc070530 0x7f4bfc15a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57412/0 (socket says 172.21.15.114:57412) 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 -- 172.21.15.114:0/2586644995 learned_addr learned my addr 172.21.15.114:0/2586644995 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfb400640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0ce800 0x7f4bfc0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bf2000640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc073170 0x7f4bfc0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 -- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0ce800 msgr2=0x7f4bfc0b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0ce800 0x7f4bfc0b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 -- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc073170 msgr2=0x7f4bfc0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc073170 0x7f4bfc0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 -- 172.21.15.114:0/2586644995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc15d480 con 0x7f4bfc070530 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bf2000640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc073170 0x7f4bfc0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bfaa00640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc070530 0x7f4bfc15a3d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009790 tx=0x7f4bec0a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bf3400640 1 -- 172.21.15.114:0/2586644995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0bb070 con 0x7f4bfc070530 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bf3400640 1 -- 172.21.15.114:0/2586644995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bec004470 con 0x7f4bfc070530 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4bf3400640 1 -- 172.21.15.114:0/2586644995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0b2040 con 0x7f4bfc070530 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc15d760 con 0x7f4bfc070530 2024-09-16T07:35:39.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc15dd20 con 0x7f4bfc070530 2024-09-16T07:35:39.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.553+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc06cc20 con 0x7f4bfc070530 2024-09-16T07:35:39.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.557+0000 7f4bf3400640 1 -- 172.21.15.114:0/2586644995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f4bec005290 con 0x7f4bfc070530 2024-09-16T07:35:39.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.557+0000 7f4bf3400640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073580 0x7f4bd8075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.557+0000 7f4bf3400640 1 -- 172.21.15.114:0/2586644995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f4bec12e670 con 0x7f4bfc070530 2024-09-16T07:35:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.557+0000 7f4bf2000640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073580 0x7f4bd8075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.557+0000 7f4bf2000640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073580 0x7f4bd8075a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc139e30 tx=0x7f4be4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:39.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.561+0000 7f4bf3400640 1 -- 172.21.15.114:0/2586644995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4bec0c4020 con 0x7f4bfc070530 2024-09-16T07:35:39.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.725+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4bfc13a640 con 0x7f4bd8073580 2024-09-16T07:35:39.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.729+0000 7f4bf3400640 1 -- 172.21.15.114:0/2586644995 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7f4bfc13a640 con 0x7f4bd8073580 2024-09-16T07:35:39.731 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:39.733 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:35:39.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073580 msgr2=0x7f4bd8075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073580 0x7f4bd8075a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc139e30 tx=0x7f4be4009040 comp rx=0 tx=0).stop 2024-09-16T07:35:39.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc070530 msgr2=0x7f4bfc15a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc070530 0x7f4bfc15a3d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009790 tx=0x7f4bec0a5650 comp rx=0 tx=0).stop 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 shutdown_connections 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073580 0x7f4bd8075a40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0ce800 0x7f4bfc0b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc073170 0x7f4bfc0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 --2- 172.21.15.114:0/2586644995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc070530 0x7f4bfc15a3d0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 >> 172.21.15.114:0/2586644995 conn(0x7f4bfc0b2240 msgr2=0x7f4bfc06f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 shutdown_connections 2024-09-16T07:35:39.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.733+0000 7f4c01800640 1 -- 172.21.15.114:0/2586644995 wait complete. 2024-09-16T07:35:39.751 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-16T07:35:38.411208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264516,"kb_used_data":14968,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710204,"statfs":{"total":773094113280,"available":772823248896,"internally_reserved":0,"allocated":15327232,"data_stored":7370068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.788180"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649377+0000","last_change":"2024-09-16T07:35:35.654190+0000","last_active":"2024-09-16T07:35:36.649377+0000","last_peered":"2024-09-16T07:35:36.649377+0000","last_clean":"2024-09-16T07:35:36.649377+0000","last_became_active":"2024-09-16T07:35:35.653917+0000","last_became_peered":"2024-09-16T07:35:35.653917+0000","last_unstale":"2024-09-16T07:35:36.649377+0000","last_undegraded":"2024-09-16T07:35:36.649377+0000","last_fullsized":"2024-09-16T07:35:36.649377+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:02.490226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884114+0000","last_change":"2024-09-16T07:35:35.652487+0000","last_active":"2024-09-16T07:35:37.884114+0000","last_peered":"2024-09-16T07:35:37.884114+0000","last_clean":"2024-09-16T07:35:37.884114+0000","last_became_active":"2024-09-16T07:35:35.652218+0000","last_became_peered":"2024-09-16T07:35:35.652218+0000","last_unstale":"2024-09-16T07:35:37.884114+0000","last_undegraded":"2024-09-16T07:35:37.884114+0000","last_fullsized":"2024-09-16T07:35:37.884114+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:40.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649516+0000","last_change":"2024-09-16T07:35:35.647404+0000","last_active":"2024-09-16T07:35:36.649516+0000","last_peered":"2024-09-16T07:35:36.649516+0000","last_clean":"2024-09-16T07:35:36.649516+0000","last_became_active":"2024-09-16T07:35:35.646350+0000","last_became_peered":"2024-09-16T07:35:35.646350+0000","last_unstale":"2024-09-16T07:35:36.649516+0000","last_undegraded":"2024-09-16T07:35:36.649516+0000","last_fullsized":"2024-09-16T07:35:36.649516+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:07.155317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651052+0000","last_change":"2024-09-16T07:35:35.657119+0000","last_active":"2024-09-16T07:35:36.651052+0000","last_peered":"2024-09-16T07:35:36.651052+0000","last_clean":"2024-09-16T07:35:36.651052+0000","last_became_active":"2024-09-16T07:35:35.656900+0000","last_became_peered":"2024-09-16T07:35:35.656900+0000","last_unstale":"2024-09-16T07:35:36.651052+0000","last_undegraded":"2024-09-16T07:35:36.651052+0000","last_fullsized":"2024-09-16T07:35:36.651052+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:51.123515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883829+0000","last_change":"2024-09-16T07:35:35.641683+0000","last_active":"2024-09-16T07:35:37.883829+0000","last_peered":"2024-09-16T07:35:37.883829+0000","last_clean":"2024-09-16T07:35:37.883829+0000","last_became_active":"2024-09-16T07:35:35.641385+0000","last_became_peered":"2024-09-16T07:35:35.641385+0000","last_unstale":"2024-09-16T07:35:37.883829+0000","last_undegraded":"2024-09-16T07:35:37.883829+0000","last_fullsized":"2024-09-16T07:35:37.883829+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:24.522699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164400+0000","last_change":"2024-09-16T07:35:35.654593+0000","last_active":"2024-09-16T07:35:38.164400+0000","last_peered":"2024-09-16T07:35:38.164400+0000","last_clean":"2024-09-16T07:35:38.164400+0000","last_became_active":"2024-09-16T07:35:35.654202+0000","last_became_peered":"2024-09-16T07:35:35.654202+0000","last_unstale":"2024-09-16T07:35:38.164400+0000","last_undegraded":"2024-09-16T07:35:38.164400+0000","last_fullsized":"2024-09-16T07:35:38.164400+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:37:19.183966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671604+0000","last_change":"2024-09-16T07:35:35.665628+0000","last_active":"2024-09-16T07:35:35.671604+0000","last_peered":"2024-09-16T07:35:35.671604+0000","last_clean":"2024-09-16T07:35:35.671604+0000","last_became_active":"2024-09-16T07:35:35.665368+0000","last_became_peered":"2024-09-16T07:35:35.665368+0000","last_unstale":"2024-09-16T07:35:35.671604+0000","last_undegraded":"2024-09-16T07:35:35.671604+0000","last_fullsized":"2024-09-16T07:35:35.671604+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:05.269865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883954+0000","last_change":"2024-09-16T07:35:35.639537+0000","last_active":"2024-09-16T07:35:37.883954+0000","last_peered":"2024-09-16T07:35:37.883954+0000","last_clean":"2024-09-16T07:35:37.883954+0000","last_became_active":"2024-09-16T07:35:35.639215+0000","last_became_peered":"2024-09-16T07:35:35.639215+0000","last_unstale":"2024-09-16T07:35:37.883954+0000","last_undegraded":"2024-09-16T07:35:37.883954+0000","last_fullsized":"2024-09-16T07:35:37.883954+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:25.770497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884323+0000","last_change":"2024-09-16T07:35:35.656531+0000","last_active":"2024-09-16T07:35:37.884323+0000","last_peered":"2024-09-16T07:35:37.884323+0000","last_clean":"2024-09-16T07:35:37.884323+0000","last_became_active":"2024-09-16T07:35:35.655207+0000","last_became_peered":"2024-09-16T07:35:35.655207+0000","last_unstale":"2024-09-16T07:35:37.884323+0000","last_undegraded":"2024-09-16T07:35:37.884323+0000","last_fullsized":"2024-09-16T07:35:37.884323+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:11:04.145927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884139+0000","last_change":"2024-09-16T07:35:35.660831+0000","last_active":"2024-09-16T07:35:37.884139+0000","last_peered":"2024-09-16T07:35:37.884139+0000","last_clean":"2024-09-16T07:35:37.884139+0000","last_became_active":"2024-09-16T07:35:35.660586+0000","last_became_peered":"2024-09-16T07:35:35.660586+0000","last_unstale":"2024-09-16T07:35:37.884139+0000","last_undegraded":"2024-09-16T07:35:37.884139+0000","last_fullsized":"2024-09-16T07:35:37.884139+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:38.172343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883923+0000","last_change":"2024-09-16T07:35:35.641686+0000","last_active":"2024-09-16T07:35:37.883923+0000","last_peered":"2024-09-16T07:35:37.883923+0000","last_clean":"2024-09-16T07:35:37.883923+0000","last_became_active":"2024-09-16T07:35:35.641414+0000","last_became_peered":"2024-09-16T07:35:35.641414+0000","last_unstale":"2024-09-16T07:35:37.883923+0000","last_undegraded":"2024-09-16T07:35:37.883923+0000","last_fullsized":"2024-09-16T07:35:37.883923+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:13.813451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884050+0000","last_change":"2024-09-16T07:35:35.659670+0000","last_active":"2024-09-16T07:35:37.884050+0000","last_peered":"2024-09-16T07:35:37.884050+0000","last_clean":"2024-09-16T07:35:37.884050+0000","last_became_active":"2024-09-16T07:35:35.658570+0000","last_became_peered":"2024-09-16T07:35:35.658570+0000","last_unstale":"2024-09-16T07:35:37.884050+0000","last_undegraded":"2024-09-16T07:35:37.884050+0000","last_fullsized":"2024-09-16T07:35:37.884050+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:54:26.346443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649221+0000","last_change":"2024-09-16T07:35:35.647063+0000","last_active":"2024-09-16T07:35:36.649221+0000","last_peered":"2024-09-16T07:35:36.649221+0000","last_clean":"2024-09-16T07:35:36.649221+0000","last_became_active":"2024-09-16T07:35:35.646817+0000","last_became_peered":"2024-09-16T07:35:35.646817+0000","last_unstale":"2024-09-16T07:35:36.649221+0000","last_undegraded":"2024-09-16T07:35:36.649221+0000","last_fullsized":"2024-09-16T07:35:36.649221+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:20.707063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648991+0000","last_change":"2024-09-16T07:35:35.656926+0000","last_active":"2024-09-16T07:35:36.648991+0000","last_peered":"2024-09-16T07:35:36.648991+0000","last_clean":"2024-09-16T07:35:36.648991+0000","last_became_active":"2024-09-16T07:35:35.656666+0000","last_became_peered":"2024-09-16T07:35:35.656666+0000","last_unstale":"2024-09-16T07:35:36.648991+0000","last_undegraded":"2024-09-16T07:35:36.648991+0000","last_fullsized":"2024-09-16T07:35:36.648991+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:06:46.691583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648165+0000","last_change":"2024-09-16T07:35:35.660589+0000","last_active":"2024-09-16T07:35:36.648165+0000","last_peered":"2024-09-16T07:35:36.648165+0000","last_clean":"2024-09-16T07:35:36.648165+0000","last_became_active":"2024-09-16T07:35:35.659173+0000","last_became_peered":"2024-09-16T07:35:35.659173+0000","last_unstale":"2024-09-16T07:35:36.648165+0000","last_undegraded":"2024-09-16T07:35:36.648165+0000","last_fullsized":"2024-09-16T07:35:36.648165+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:05.544298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671568+0000","last_change":"2024-09-16T07:35:35.664670+0000","last_active":"2024-09-16T07:35:35.671568+0000","last_peered":"2024-09-16T07:35:35.671568+0000","last_clean":"2024-09-16T07:35:35.671568+0000","last_became_active":"2024-09-16T07:35:35.664409+0000","last_became_peered":"2024-09-16T07:35:35.664409+0000","last_unstale":"2024-09-16T07:35:35.671568+0000","last_undegraded":"2024-09-16T07:35:35.671568+0000","last_fullsized":"2024-09-16T07:35:35.671568+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:04.418935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164542+0000","last_change":"2024-09-16T07:35:35.664902+0000","last_active":"2024-09-16T07:35:38.164542+0000","last_peered":"2024-09-16T07:35:38.164542+0000","last_clean":"2024-09-16T07:35:38.164542+0000","last_became_active":"2024-09-16T07:35:35.664600+0000","last_became_peered":"2024-09-16T07:35:35.664600+0000","last_unstale":"2024-09-16T07:35:38.164542+0000","last_undegraded":"2024-09-16T07:35:38.164542+0000","last_fullsized":"2024-09-16T07:35:38.164542+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:30:43.254572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.668332+0000","last_change":"2024-09-16T07:35:35.659469+0000","last_active":"2024-09-16T07:35:35.668332+0000","last_peered":"2024-09-16T07:35:35.668332+0000","last_clean":"2024-09-16T07:35:35.668332+0000","last_became_active":"2024-09-16T07:35:35.659226+0000","last_became_peered":"2024-09-16T07:35:35.659226+0000","last_unstale":"2024-09-16T07:35:35.668332+0000","last_undegraded":"2024-09-16T07:35:35.668332+0000","last_fullsized":"2024-09-16T07:35:35.668332+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:25.044989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164386+0000","last_change":"2024-09-16T07:35:35.662509+0000","last_active":"2024-09-16T07:35:38.164386+0000","last_peered":"2024-09-16T07:35:38.164386+0000","last_clean":"2024-09-16T07:35:38.164386+0000","last_became_active":"2024-09-16T07:35:35.662297+0000","last_became_peered":"2024-09-16T07:35:35.662297+0000","last_unstale":"2024-09-16T07:35:38.164386+0000","last_undegraded":"2024-09-16T07:35:38.164386+0000","last_fullsized":"2024-09-16T07:35:38.164386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:45:24.346320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649640+0000","last_change":"2024-09-16T07:35:35.660062+0000","last_active":"2024-09-16T07:35:36.649640+0000","last_peered":"2024-09-16T07:35:36.649640+0000","last_clean":"2024-09-16T07:35:36.649640+0000","last_became_active":"2024-09-16T07:35:35.659810+0000","last_became_peered":"2024-09-16T07:35:35.659810+0000","last_unstale":"2024-09-16T07:35:36.649640+0000","last_undegraded":"2024-09-16T07:35:36.649640+0000","last_fullsized":"2024-09-16T07:35:36.649640+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:32:39.502887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164329+0000","last_change":"2024-09-16T07:35:35.664634+0000","last_active":"2024-09-16T07:35:38.164329+0000","last_peered":"2024-09-16T07:35:38.164329+0000","last_clean":"2024-09-16T07:35:38.164329+0000","last_became_active":"2024-09-16T07:35:35.664359+0000","last_became_peered":"2024-09-16T07:35:35.664359+0000","last_unstale":"2024-09-16T07:35:38.164329+0000","last_undegraded":"2024-09-16T07:35:38.164329+0000","last_fullsized":"2024-09-16T07:35:38.164329+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:02.780139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883951+0000","last_change":"2024-09-16T07:35:35.650567+0000","last_active":"2024-09-16T07:35:37.883951+0000","last_peered":"2024-09-16T07:35:37.883951+0000","last_clean":"2024-09-16T07:35:37.883951+0000","last_became_active":"2024-09-16T07:35:35.650262+0000","last_became_peered":"2024-09-16T07:35:35.650262+0000","last_unstale":"2024-09-16T07:35:37.883951+0000","last_undegraded":"2024-09-16T07:35:37.883951+0000","last_fullsized":"2024-09-16T07:35:37.883951+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:51.123515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164205+0000","last_change":"2024-09-16T07:35:35.655046+0000","last_active":"2024-09-16T07:35:38.164205+0000","last_peered":"2024-09-16T07:35:38.164205+0000","last_clean":"2024-09-16T07:35:38.164205+0000","last_became_active":"2024-09-16T07:35:35.654790+0000","last_became_peered":"2024-09-16T07:35:35.654790+0000","last_unstale":"2024-09-16T07:35:38.164205+0000","last_undegraded":"2024-09-16T07:35:38.164205+0000","last_fullsized":"2024-09-16T07:35:38.164205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:36.960224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884000+0000","last_change":"2024-09-16T07:35:35.643994+0000","last_active":"2024-09-16T07:35:37.884000+0000","last_peered":"2024-09-16T07:35:37.884000+0000","last_clean":"2024-09-16T07:35:37.884000+0000","last_became_active":"2024-09-16T07:35:35.643734+0000","last_became_peered":"2024-09-16T07:35:35.643734+0000","last_unstale":"2024-09-16T07:35:37.884000+0000","last_undegraded":"2024-09-16T07:35:37.884000+0000","last_fullsized":"2024-09-16T07:35:37.884000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:01:45.404990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650143+0000","last_change":"2024-09-16T07:35:35.651408+0000","last_active":"2024-09-16T07:35:36.650143+0000","last_peered":"2024-09-16T07:35:36.650143+0000","last_clean":"2024-09-16T07:35:36.650143+0000","last_became_active":"2024-09-16T07:35:35.651150+0000","last_became_peered":"2024-09-16T07:35:35.651150+0000","last_unstale":"2024-09-16T07:35:36.650143+0000","last_undegraded":"2024-09-16T07:35:36.650143+0000","last_fullsized":"2024-09-16T07:35:36.650143+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:33.043588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.673813+0000","last_change":"2024-09-16T07:35:35.672949+0000","last_active":"2024-09-16T07:35:35.673813+0000","last_peered":"2024-09-16T07:35:35.673813+0000","last_clean":"2024-09-16T07:35:35.673813+0000","last_became_active":"2024-09-16T07:35:35.672622+0000","last_became_peered":"2024-09-16T07:35:35.672622+0000","last_unstale":"2024-09-16T07:35:35.673813+0000","last_undegraded":"2024-09-16T07:35:35.673813+0000","last_fullsized":"2024-09-16T07:35:35.673813+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:05.544298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649783+0000","last_change":"2024-09-16T07:35:35.666942+0000","last_active":"2024-09-16T07:35:36.649783+0000","last_peered":"2024-09-16T07:35:36.649783+0000","last_clean":"2024-09-16T07:35:36.649783+0000","last_became_active":"2024-09-16T07:35:35.666716+0000","last_became_peered":"2024-09-16T07:35:35.666716+0000","last_unstale":"2024-09-16T07:35:36.649783+0000","last_undegraded":"2024-09-16T07:35:36.649783+0000","last_fullsized":"2024-09-16T07:35:36.649783+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:06.947829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651109+0000","last_change":"2024-09-16T07:35:35.659004+0000","last_active":"2024-09-16T07:35:36.651109+0000","last_peered":"2024-09-16T07:35:36.651109+0000","last_clean":"2024-09-16T07:35:36.651109+0000","last_became_active":"2024-09-16T07:35:35.658761+0000","last_became_peered":"2024-09-16T07:35:35.658761+0000","last_unstale":"2024-09-16T07:35:36.651109+0000","last_undegraded":"2024-09-16T07:35:36.651109+0000","last_fullsized":"2024-09-16T07:35:36.651109+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:16.704439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649476+0000","last_change":"2024-09-16T07:35:35.659734+0000","last_active":"2024-09-16T07:35:36.649476+0000","last_peered":"2024-09-16T07:35:36.649476+0000","last_clean":"2024-09-16T07:35:36.649476+0000","last_became_active":"2024-09-16T07:35:35.659160+0000","last_became_peered":"2024-09-16T07:35:35.659160+0000","last_unstale":"2024-09-16T07:35:36.649476+0000","last_undegraded":"2024-09-16T07:35:36.649476+0000","last_fullsized":"2024-09-16T07:35:36.649476+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:58.409439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636846+0000","last_change":"2024-09-16T07:35:35.657982+0000","last_active":"2024-09-16T07:35:37.636846+0000","last_peered":"2024-09-16T07:35:37.636846+0000","last_clean":"2024-09-16T07:35:37.636846+0000","last_became_active":"2024-09-16T07:35:35.657696+0000","last_became_peered":"2024-09-16T07:35:35.657696+0000","last_unstale":"2024-09-16T07:35:37.636846+0000","last_undegraded":"2024-09-16T07:35:37.636846+0000","last_fullsized":"2024-09-16T07:35:37.636846+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:08.833937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636793+0000","last_change":"2024-09-16T07:35:35.648577+0000","last_active":"2024-09-16T07:35:37.636793+0000","last_peered":"2024-09-16T07:35:37.636793+0000","last_clean":"2024-09-16T07:35:37.636793+0000","last_became_active":"2024-09-16T07:35:35.648297+0000","last_became_peered":"2024-09-16T07:35:35.648297+0000","last_unstale":"2024-09-16T07:35:37.636793+0000","last_undegraded":"2024-09-16T07:35:37.636793+0000","last_fullsized":"2024-09-16T07:35:37.636793+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:21.121792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.667749+0000","last_change":"2024-09-16T07:35:35.658853+0000","last_active":"2024-09-16T07:35:35.667749+0000","last_peered":"2024-09-16T07:35:35.667749+0000","last_clean":"2024-09-16T07:35:35.667749+0000","last_became_active":"2024-09-16T07:35:35.658595+0000","last_became_peered":"2024-09-16T07:35:35.658595+0000","last_unstale":"2024-09-16T07:35:35.667749+0000","last_undegraded":"2024-09-16T07:35:35.667749+0000","last_fullsized":"2024-09-16T07:35:35.667749+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:55.169292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.673526+0000","last_change":"2024-09-16T07:35:35.672807+0000","last_active":"2024-09-16T07:35:35.673526+0000","last_peered":"2024-09-16T07:35:35.673526+0000","last_clean":"2024-09-16T07:35:35.673526+0000","last_became_active":"2024-09-16T07:35:35.672424+0000","last_became_peered":"2024-09-16T07:35:35.672424+0000","last_unstale":"2024-09-16T07:35:35.673526+0000","last_undegraded":"2024-09-16T07:35:35.673526+0000","last_fullsized":"2024-09-16T07:35:35.673526+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:17.574458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649077+0000","last_change":"2024-09-16T07:35:34.654598+0000","last_active":"2024-09-16T07:35:36.649077+0000","last_peered":"2024-09-16T07:35:36.649077+0000","last_clean":"2024-09-16T07:35:36.649077+0000","last_became_active":"2024-09-16T07:35:34.654327+0000","last_became_peered":"2024-09-16T07:35:34.654327+0000","last_unstale":"2024-09-16T07:35:36.649077+0000","last_undegraded":"2024-09-16T07:35:36.649077+0000","last_fullsized":"2024-09-16T07:35:36.649077+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:20.289599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637178+0000","last_change":"2024-09-16T07:35:35.649200+0000","last_active":"2024-09-16T07:35:37.637178+0000","last_peered":"2024-09-16T07:35:37.637178+0000","last_clean":"2024-09-16T07:35:37.637178+0000","last_became_active":"2024-09-16T07:35:35.648927+0000","last_became_peered":"2024-09-16T07:35:35.648927+0000","last_unstale":"2024-09-16T07:35:37.637178+0000","last_undegraded":"2024-09-16T07:35:37.637178+0000","last_fullsized":"2024-09-16T07:35:37.637178+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:48.428252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636924+0000","last_change":"2024-09-16T07:35:34.646468+0000","last_active":"2024-09-16T07:35:37.636924+0000","last_peered":"2024-09-16T07:35:37.636924+0000","last_clean":"2024-09-16T07:35:37.636924+0000","last_became_active":"2024-09-16T07:35:34.646173+0000","last_became_peered":"2024-09-16T07:35:34.646173+0000","last_unstale":"2024-09-16T07:35:37.636924+0000","last_undegraded":"2024-09-16T07:35:37.636924+0000","last_fullsized":"2024-09-16T07:35:37.636924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:55.006126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164305+0000","last_change":"2024-09-16T07:35:35.666823+0000","last_active":"2024-09-16T07:35:38.164305+0000","last_peered":"2024-09-16T07:35:38.164305+0000","last_clean":"2024-09-16T07:35:38.164305+0000","last_became_active":"2024-09-16T07:35:35.664724+0000","last_became_peered":"2024-09-16T07:35:35.664724+0000","last_unstale":"2024-09-16T07:35:38.164305+0000","last_undegraded":"2024-09-16T07:35:38.164305+0000","last_fullsized":"2024-09-16T07:35:38.164305+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:07.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650768+0000","last_change":"2024-09-16T07:35:34.649863+0000","last_active":"2024-09-16T07:35:36.650768+0000","last_peered":"2024-09-16T07:35:36.650768+0000","last_clean":"2024-09-16T07:35:36.650768+0000","last_became_active":"2024-09-16T07:35:34.648504+0000","last_became_peered":"2024-09-16T07:35:34.648504+0000","last_unstale":"2024-09-16T07:35:36.650768+0000","last_undegraded":"2024-09-16T07:35:36.650768+0000","last_fullsized":"2024-09-16T07:35:36.650768+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:02:43.634832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649892+0000","last_change":"2024-09-16T07:35:35.658084+0000","last_active":"2024-09-16T07:35:36.649892+0000","last_peered":"2024-09-16T07:35:36.649892+0000","last_clean":"2024-09-16T07:35:36.649892+0000","last_became_active":"2024-09-16T07:35:35.654663+0000","last_became_peered":"2024-09-16T07:35:35.654663+0000","last_unstale":"2024-09-16T07:35:36.649892+0000","last_undegraded":"2024-09-16T07:35:36.649892+0000","last_fullsized":"2024-09-16T07:35:36.649892+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:04.486596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651205+0000","last_change":"2024-09-16T07:35:34.655235+0000","last_active":"2024-09-16T07:35:36.651205+0000","last_peered":"2024-09-16T07:35:36.651205+0000","last_clean":"2024-09-16T07:35:36.651205+0000","last_became_active":"2024-09-16T07:35:34.654998+0000","last_became_peered":"2024-09-16T07:35:34.654998+0000","last_unstale":"2024-09-16T07:35:36.651205+0000","last_undegraded":"2024-09-16T07:35:36.651205+0000","last_fullsized":"2024-09-16T07:35:36.651205+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:44.031072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670123+0000","last_change":"2024-09-16T07:35:35.653753+0000","last_active":"2024-09-16T07:35:35.670123+0000","last_peered":"2024-09-16T07:35:35.670123+0000","last_clean":"2024-09-16T07:35:35.670123+0000","last_became_active":"2024-09-16T07:35:35.653478+0000","last_became_peered":"2024-09-16T07:35:35.653478+0000","last_unstale":"2024-09-16T07:35:35.670123+0000","last_undegraded":"2024-09-16T07:35:35.670123+0000","last_fullsized":"2024-09-16T07:35:35.670123+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:46.316952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649507+0000","last_change":"2024-09-16T07:35:34.649245+0000","last_active":"2024-09-16T07:35:36.649507+0000","last_peered":"2024-09-16T07:35:36.649507+0000","last_clean":"2024-09-16T07:35:36.649507+0000","last_became_active":"2024-09-16T07:35:34.648905+0000","last_became_peered":"2024-09-16T07:35:34.648905+0000","last_unstale":"2024-09-16T07:35:36.649507+0000","last_undegraded":"2024-09-16T07:35:36.649507+0000","last_fullsized":"2024-09-16T07:35:36.649507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:48.143536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651308+0000","last_change":"2024-09-16T07:35:35.661804+0000","last_active":"2024-09-16T07:35:36.651308+0000","last_peered":"2024-09-16T07:35:36.651308+0000","last_clean":"2024-09-16T07:35:36.651308+0000","last_became_active":"2024-09-16T07:35:35.661478+0000","last_became_peered":"2024-09-16T07:35:35.661478+0000","last_unstale":"2024-09-16T07:35:36.651308+0000","last_undegraded":"2024-09-16T07:35:36.651308+0000","last_fullsized":"2024-09-16T07:35:36.651308+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:13.212950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650592+0000","last_change":"2024-09-16T07:35:34.657142+0000","last_active":"2024-09-16T07:35:36.650592+0000","last_peered":"2024-09-16T07:35:36.650592+0000","last_clean":"2024-09-16T07:35:36.650592+0000","last_became_active":"2024-09-16T07:35:34.656873+0000","last_became_peered":"2024-09-16T07:35:34.656873+0000","last_unstale":"2024-09-16T07:35:36.650592+0000","last_undegraded":"2024-09-16T07:35:36.650592+0000","last_fullsized":"2024-09-16T07:35:36.650592+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:22.904915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650683+0000","last_change":"2024-09-16T07:35:35.657439+0000","last_active":"2024-09-16T07:35:36.650683+0000","last_peered":"2024-09-16T07:35:36.650683+0000","last_clean":"2024-09-16T07:35:36.650683+0000","last_became_active":"2024-09-16T07:35:35.657189+0000","last_became_peered":"2024-09-16T07:35:35.657189+0000","last_unstale":"2024-09-16T07:35:36.650683+0000","last_undegraded":"2024-09-16T07:35:36.650683+0000","last_fullsized":"2024-09-16T07:35:36.650683+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:13.813451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883567+0000","last_change":"2024-09-16T07:35:34.649672+0000","last_active":"2024-09-16T07:35:37.883567+0000","last_peered":"2024-09-16T07:35:37.883567+0000","last_clean":"2024-09-16T07:35:37.883567+0000","last_became_active":"2024-09-16T07:35:34.645434+0000","last_became_peered":"2024-09-16T07:35:34.645434+0000","last_unstale":"2024-09-16T07:35:37.883567+0000","last_undegraded":"2024-09-16T07:35:37.883567+0000","last_fullsized":"2024-09-16T07:35:37.883567+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:27.048296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164527+0000","last_change":"2024-09-16T07:35:35.654901+0000","last_active":"2024-09-16T07:35:38.164527+0000","last_peered":"2024-09-16T07:35:38.164527+0000","last_clean":"2024-09-16T07:35:38.164527+0000","last_became_active":"2024-09-16T07:35:35.654364+0000","last_became_peered":"2024-09-16T07:35:35.654364+0000","last_unstale":"2024-09-16T07:35:38.164527+0000","last_undegraded":"2024-09-16T07:35:38.164527+0000","last_fullsized":"2024-09-16T07:35:38.164527+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:39.117930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.646931+0000","last_change":"2024-09-16T07:35:34.656147+0000","last_active":"2024-09-16T07:35:35.646931+0000","last_peered":"2024-09-16T07:35:35.646931+0000","last_clean":"2024-09-16T07:35:35.646931+0000","last_became_active":"2024-09-16T07:35:34.655776+0000","last_became_peered":"2024-09-16T07:35:34.655776+0000","last_unstale":"2024-09-16T07:35:35.646931+0000","last_undegraded":"2024-09-16T07:35:35.646931+0000","last_fullsized":"2024-09-16T07:35:35.646931+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:44.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669996+0000","last_change":"2024-09-16T07:35:35.666272+0000","last_active":"2024-09-16T07:35:35.669996+0000","last_peered":"2024-09-16T07:35:35.669996+0000","last_clean":"2024-09-16T07:35:35.669996+0000","last_became_active":"2024-09-16T07:35:35.665985+0000","last_became_peered":"2024-09-16T07:35:35.665985+0000","last_unstale":"2024-09-16T07:35:35.669996+0000","last_undegraded":"2024-09-16T07:35:35.669996+0000","last_fullsized":"2024-09-16T07:35:35.669996+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:31.058725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164467+0000","last_change":"2024-09-16T07:35:34.657522+0000","last_active":"2024-09-16T07:35:38.164467+0000","last_peered":"2024-09-16T07:35:38.164467+0000","last_clean":"2024-09-16T07:35:38.164467+0000","last_became_active":"2024-09-16T07:35:34.657251+0000","last_became_peered":"2024-09-16T07:35:34.657251+0000","last_unstale":"2024-09-16T07:35:38.164467+0000","last_undegraded":"2024-09-16T07:35:38.164467+0000","last_fullsized":"2024-09-16T07:35:38.164467+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:44:15.943305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670009+0000","last_change":"2024-09-16T07:35:35.663978+0000","last_active":"2024-09-16T07:35:35.670009+0000","last_peered":"2024-09-16T07:35:35.670009+0000","last_clean":"2024-09-16T07:35:35.670009+0000","last_became_active":"2024-09-16T07:35:35.663700+0000","last_became_peered":"2024-09-16T07:35:35.663700+0000","last_unstale":"2024-09-16T07:35:35.670009+0000","last_undegraded":"2024-09-16T07:35:35.670009+0000","last_fullsized":"2024-09-16T07:35:35.670009+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:54.834191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"140'3","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164447+0000","last_change":"2024-09-16T07:35:34.651520+0000","last_active":"2024-09-16T07:35:38.164447+0000","last_peered":"2024-09-16T07:35:38.164447+0000","last_clean":"2024-09-16T07:35:38.164447+0000","last_became_active":"2024-09-16T07:35:34.651252+0000","last_became_peered":"2024-09-16T07:35:34.651252+0000","last_unstale":"2024-09-16T07:35:38.164447+0000","last_undegraded":"2024-09-16T07:35:38.164447+0000","last_fullsized":"2024-09-16T07:35:38.164447+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:43.986432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637252+0000","last_change":"2024-09-16T07:35:35.651019+0000","last_active":"2024-09-16T07:35:37.637252+0000","last_peered":"2024-09-16T07:35:37.637252+0000","last_clean":"2024-09-16T07:35:37.637252+0000","last_became_active":"2024-09-16T07:35:35.647730+0000","last_became_peered":"2024-09-16T07:35:35.647730+0000","last_unstale":"2024-09-16T07:35:37.637252+0000","last_undegraded":"2024-09-16T07:35:37.637252+0000","last_fullsized":"2024-09-16T07:35:37.637252+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:43.986642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"140'6","reported_seq":21,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637039+0000","last_change":"2024-09-16T07:35:34.650720+0000","last_active":"2024-09-16T07:35:37.637039+0000","last_peered":"2024-09-16T07:35:37.637039+0000","last_clean":"2024-09-16T07:35:37.637039+0000","last_became_active":"2024-09-16T07:35:34.650068+0000","last_became_peered":"2024-09-16T07:35:34.650068+0000","last_unstale":"2024-09-16T07:35:37.637039+0000","last_undegraded":"2024-09-16T07:35:37.637039+0000","last_fullsized":"2024-09-16T07:35:37.637039+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:32.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.667912+0000","last_change":"2024-09-16T07:35:35.654004+0000","last_active":"2024-09-16T07:35:35.667912+0000","last_peered":"2024-09-16T07:35:35.667912+0000","last_clean":"2024-09-16T07:35:35.667912+0000","last_became_active":"2024-09-16T07:35:35.653748+0000","last_became_peered":"2024-09-16T07:35:35.653748+0000","last_unstale":"2024-09-16T07:35:35.667912+0000","last_undegraded":"2024-09-16T07:35:35.667912+0000","last_fullsized":"2024-09-16T07:35:35.667912+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:26:13.077159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650967+0000","last_change":"2024-09-16T07:35:34.655156+0000","last_active":"2024-09-16T07:35:36.650967+0000","last_peered":"2024-09-16T07:35:36.650967+0000","last_clean":"2024-09-16T07:35:36.650967+0000","last_became_active":"2024-09-16T07:35:34.654911+0000","last_became_peered":"2024-09-16T07:35:34.654911+0000","last_unstale":"2024-09-16T07:35:36.650967+0000","last_undegraded":"2024-09-16T07:35:36.650967+0000","last_fullsized":"2024-09-16T07:35:36.650967+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:59.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670086+0000","last_change":"2024-09-16T07:35:35.656145+0000","last_active":"2024-09-16T07:35:35.670086+0000","last_peered":"2024-09-16T07:35:35.670086+0000","last_clean":"2024-09-16T07:35:35.670086+0000","last_became_active":"2024-09-16T07:35:35.655915+0000","last_became_peered":"2024-09-16T07:35:35.655915+0000","last_unstale":"2024-09-16T07:35:35.670086+0000","last_undegraded":"2024-09-16T07:35:35.670086+0000","last_fullsized":"2024-09-16T07:35:35.670086+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:53.614432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.642047+0000","last_change":"2024-09-16T07:35:34.650131+0000","last_active":"2024-09-16T07:35:35.642047+0000","last_peered":"2024-09-16T07:35:35.642047+0000","last_clean":"2024-09-16T07:35:35.642047+0000","last_became_active":"2024-09-16T07:35:34.649842+0000","last_became_peered":"2024-09-16T07:35:34.649842+0000","last_unstale":"2024-09-16T07:35:35.642047+0000","last_undegraded":"2024-09-16T07:35:35.642047+0000","last_fullsized":"2024-09-16T07:35:35.642047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:42.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650753+0000","last_change":"2024-09-16T07:35:35.656773+0000","last_active":"2024-09-16T07:35:36.650753+0000","last_peered":"2024-09-16T07:35:36.650753+0000","last_clean":"2024-09-16T07:35:36.650753+0000","last_became_active":"2024-09-16T07:35:35.655263+0000","last_became_peered":"2024-09-16T07:35:35.655263+0000","last_unstale":"2024-09-16T07:35:36.650753+0000","last_undegraded":"2024-09-16T07:35:36.650753+0000","last_fullsized":"2024-09-16T07:35:36.650753+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:56.014800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650833+0000","last_change":"2024-09-16T07:35:34.648747+0000","last_active":"2024-09-16T07:35:36.650833+0000","last_peered":"2024-09-16T07:35:36.650833+0000","last_clean":"2024-09-16T07:35:36.650833+0000","last_became_active":"2024-09-16T07:35:34.648385+0000","last_became_peered":"2024-09-16T07:35:34.648385+0000","last_unstale":"2024-09-16T07:35:36.650833+0000","last_undegraded":"2024-09-16T07:35:36.650833+0000","last_fullsized":"2024-09-16T07:35:36.650833+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:03.282520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648725+0000","last_change":"2024-09-16T07:35:35.653133+0000","last_active":"2024-09-16T07:35:36.648725+0000","last_peered":"2024-09-16T07:35:36.648725+0000","last_clean":"2024-09-16T07:35:36.648725+0000","last_became_active":"2024-09-16T07:35:35.652656+0000","last_became_peered":"2024-09-16T07:35:35.652656+0000","last_unstale":"2024-09-16T07:35:36.648725+0000","last_undegraded":"2024-09-16T07:35:36.648725+0000","last_fullsized":"2024-09-16T07:35:36.648725+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:04.378514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"140'8","reported_seq":23,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636880+0000","last_change":"2024-09-16T07:35:34.648703+0000","last_active":"2024-09-16T07:35:37.636880+0000","last_peered":"2024-09-16T07:35:37.636880+0000","last_clean":"2024-09-16T07:35:37.636880+0000","last_became_active":"2024-09-16T07:35:34.648357+0000","last_became_peered":"2024-09-16T07:35:34.648357+0000","last_unstale":"2024-09-16T07:35:37.636880+0000","last_undegraded":"2024-09-16T07:35:37.636880+0000","last_fullsized":"2024-09-16T07:35:37.636880+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:03.560126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651298+0000","last_change":"2024-09-16T07:35:35.661984+0000","last_active":"2024-09-16T07:35:36.651298+0000","last_peered":"2024-09-16T07:35:36.651298+0000","last_clean":"2024-09-16T07:35:36.651298+0000","last_became_active":"2024-09-16T07:35:35.661040+0000","last_became_peered":"2024-09-16T07:35:35.661040+0000","last_unstale":"2024-09-16T07:35:36.651298+0000","last_undegraded":"2024-09-16T07:35:36.651298+0000","last_fullsized":"2024-09-16T07:35:36.651298+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:38.172343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650070+0000","last_change":"2024-09-16T07:35:34.644336+0000","last_active":"2024-09-16T07:35:36.650070+0000","last_peered":"2024-09-16T07:35:36.650070+0000","last_clean":"2024-09-16T07:35:36.650070+0000","last_became_active":"2024-09-16T07:35:34.644061+0000","last_became_peered":"2024-09-16T07:35:34.644061+0000","last_unstale":"2024-09-16T07:35:36.650070+0000","last_undegraded":"2024-09-16T07:35:36.650070+0000","last_fullsized":"2024-09-16T07:35:36.650070+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:53.380748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669595+0000","last_change":"2024-09-16T07:35:35.661381+0000","last_active":"2024-09-16T07:35:35.669595+0000","last_peered":"2024-09-16T07:35:35.669595+0000","last_clean":"2024-09-16T07:35:35.669595+0000","last_became_active":"2024-09-16T07:35:35.660933+0000","last_became_peered":"2024-09-16T07:35:35.660933+0000","last_unstale":"2024-09-16T07:35:35.669595+0000","last_undegraded":"2024-09-16T07:35:35.669595+0000","last_fullsized":"2024-09-16T07:35:35.669595+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:55:27.783547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649130+0000","last_change":"2024-09-16T07:35:34.651885+0000","last_active":"2024-09-16T07:35:36.649130+0000","last_peered":"2024-09-16T07:35:36.649130+0000","last_clean":"2024-09-16T07:35:36.649130+0000","last_became_active":"2024-09-16T07:35:34.651624+0000","last_became_peered":"2024-09-16T07:35:34.651624+0000","last_unstale":"2024-09-16T07:35:36.649130+0000","last_undegraded":"2024-09-16T07:35:36.649130+0000","last_fullsized":"2024-09-16T07:35:36.649130+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:16:33.701483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651236+0000","last_change":"2024-09-16T07:35:35.663415+0000","last_active":"2024-09-16T07:35:36.651236+0000","last_peered":"2024-09-16T07:35:36.651236+0000","last_clean":"2024-09-16T07:35:36.651236+0000","last_became_active":"2024-09-16T07:35:35.663031+0000","last_became_peered":"2024-09-16T07:35:35.663031+0000","last_unstale":"2024-09-16T07:35:36.651236+0000","last_undegraded":"2024-09-16T07:35:36.651236+0000","last_fullsized":"2024-09-16T07:35:36.651236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:52.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648862+0000","last_change":"2024-09-16T07:35:34.653143+0000","last_active":"2024-09-16T07:35:36.648862+0000","last_peered":"2024-09-16T07:35:36.648862+0000","last_clean":"2024-09-16T07:35:36.648862+0000","last_became_active":"2024-09-16T07:35:34.652777+0000","last_became_peered":"2024-09-16T07:35:34.652777+0000","last_unstale":"2024-09-16T07:35:36.648862+0000","last_undegraded":"2024-09-16T07:35:36.648862+0000","last_fullsized":"2024-09-16T07:35:36.648862+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:36.233160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671384+0000","last_change":"2024-09-16T07:35:35.663347+0000","last_active":"2024-09-16T07:35:35.671384+0000","last_peered":"2024-09-16T07:35:35.671384+0000","last_clean":"2024-09-16T07:35:35.671384+0000","last_became_active":"2024-09-16T07:35:35.663104+0000","last_became_peered":"2024-09-16T07:35:35.663104+0000","last_unstale":"2024-09-16T07:35:35.671384+0000","last_undegraded":"2024-09-16T07:35:35.671384+0000","last_fullsized":"2024-09-16T07:35:35.671384+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:07.331798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648714+0000","last_change":"2024-09-16T07:35:34.656103+0000","last_active":"2024-09-16T07:35:36.648714+0000","last_peered":"2024-09-16T07:35:36.648714+0000","last_clean":"2024-09-16T07:35:36.648714+0000","last_became_active":"2024-09-16T07:35:34.655883+0000","last_became_peered":"2024-09-16T07:35:34.655883+0000","last_unstale":"2024-09-16T07:35:36.648714+0000","last_undegraded":"2024-09-16T07:35:36.648714+0000","last_fullsized":"2024-09-16T07:35:36.648714+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:02.773598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649201+0000","last_change":"2024-09-16T07:35:35.650519+0000","last_active":"2024-09-16T07:35:36.649201+0000","last_peered":"2024-09-16T07:35:36.649201+0000","last_clean":"2024-09-16T07:35:36.649201+0000","last_became_active":"2024-09-16T07:35:35.650255+0000","last_became_peered":"2024-09-16T07:35:35.650255+0000","last_unstale":"2024-09-16T07:35:36.649201+0000","last_undegraded":"2024-09-16T07:35:36.649201+0000","last_fullsized":"2024-09-16T07:35:36.649201+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:58.609044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651073+0000","last_change":"2024-09-16T07:35:34.652596+0000","last_active":"2024-09-16T07:35:36.651073+0000","last_peered":"2024-09-16T07:35:36.651073+0000","last_clean":"2024-09-16T07:35:36.651073+0000","last_became_active":"2024-09-16T07:35:34.650025+0000","last_became_peered":"2024-09-16T07:35:34.650025+0000","last_unstale":"2024-09-16T07:35:36.651073+0000","last_undegraded":"2024-09-16T07:35:36.651073+0000","last_fullsized":"2024-09-16T07:35:36.651073+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:54:30.936813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671505+0000","last_change":"2024-09-16T07:35:35.664299+0000","last_active":"2024-09-16T07:35:35.671505+0000","last_peered":"2024-09-16T07:35:35.671505+0000","last_clean":"2024-09-16T07:35:35.671505+0000","last_became_active":"2024-09-16T07:35:35.663976+0000","last_became_peered":"2024-09-16T07:35:35.663976+0000","last_unstale":"2024-09-16T07:35:35.671505+0000","last_undegraded":"2024-09-16T07:35:35.671505+0000","last_fullsized":"2024-09-16T07:35:35.671505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.727675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648431+0000","last_change":"2024-09-16T07:35:34.656729+0000","last_active":"2024-09-16T07:35:36.648431+0000","last_peered":"2024-09-16T07:35:36.648431+0000","last_clean":"2024-09-16T07:35:36.648431+0000","last_became_active":"2024-09-16T07:35:34.656517+0000","last_became_peered":"2024-09-16T07:35:34.656517+0000","last_unstale":"2024-09-16T07:35:36.648431+0000","last_undegraded":"2024-09-16T07:35:36.648431+0000","last_fullsized":"2024-09-16T07:35:36.648431+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:32:31.195911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648174+0000","last_change":"2024-09-16T07:35:35.656731+0000","last_active":"2024-09-16T07:35:36.648174+0000","last_peered":"2024-09-16T07:35:36.648174+0000","last_clean":"2024-09-16T07:35:36.648174+0000","last_became_active":"2024-09-16T07:35:35.656491+0000","last_became_peered":"2024-09-16T07:35:35.656491+0000","last_unstale":"2024-09-16T07:35:36.648174+0000","last_undegraded":"2024-09-16T07:35:36.648174+0000","last_fullsized":"2024-09-16T07:35:36.648174+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:25.576745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650646+0000","last_change":"2024-09-16T07:35:34.654623+0000","last_active":"2024-09-16T07:35:36.650646+0000","last_peered":"2024-09-16T07:35:36.650646+0000","last_clean":"2024-09-16T07:35:36.650646+0000","last_became_active":"2024-09-16T07:35:34.654323+0000","last_became_peered":"2024-09-16T07:35:34.654323+0000","last_unstale":"2024-09-16T07:35:36.650646+0000","last_undegraded":"2024-09-16T07:35:36.650646+0000","last_fullsized":"2024-09-16T07:35:36.650646+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:43.070977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164661+0000","last_change":"2024-09-16T07:35:35.654623+0000","last_active":"2024-09-16T07:35:38.164661+0000","last_peered":"2024-09-16T07:35:38.164661+0000","last_clean":"2024-09-16T07:35:38.164661+0000","last_became_active":"2024-09-16T07:35:35.654197+0000","last_became_peered":"2024-09-16T07:35:35.654197+0000","last_unstale":"2024-09-16T07:35:38.164661+0000","last_undegraded":"2024-09-16T07:35:38.164661+0000","last_fullsized":"2024-09-16T07:35:38.164661+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:43.624173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648148+0000","last_change":"2024-09-16T07:35:34.654487+0000","last_active":"2024-09-16T07:35:36.648148+0000","last_peered":"2024-09-16T07:35:36.648148+0000","last_clean":"2024-09-16T07:35:36.648148+0000","last_became_active":"2024-09-16T07:35:34.654176+0000","last_became_peered":"2024-09-16T07:35:34.654176+0000","last_unstale":"2024-09-16T07:35:36.648148+0000","last_undegraded":"2024-09-16T07:35:36.648148+0000","last_fullsized":"2024-09-16T07:35:36.648148+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:55:26.774873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670064+0000","last_change":"2024-09-16T07:35:35.666265+0000","last_active":"2024-09-16T07:35:35.670064+0000","last_peered":"2024-09-16T07:35:35.670064+0000","last_clean":"2024-09-16T07:35:35.670064+0000","last_became_active":"2024-09-16T07:35:35.665762+0000","last_became_peered":"2024-09-16T07:35:35.665762+0000","last_unstale":"2024-09-16T07:35:35.670064+0000","last_undegraded":"2024-09-16T07:35:35.670064+0000","last_fullsized":"2024-09-16T07:35:35.670064+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:21.298273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"140'2","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.661036+0000","last_change":"2024-09-16T07:35:34.647795+0000","last_active":"2024-09-16T07:35:35.661036+0000","last_peered":"2024-09-16T07:35:35.661036+0000","last_clean":"2024-09-16T07:35:35.661036+0000","last_became_active":"2024-09-16T07:35:34.647534+0000","last_became_peered":"2024-09-16T07:35:34.647534+0000","last_unstale":"2024-09-16T07:35:35.661036+0000","last_undegraded":"2024-09-16T07:35:35.661036+0000","last_fullsized":"2024-09-16T07:35:35.661036+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:05:56.753443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671571+0000","last_change":"2024-09-16T07:35:35.664933+0000","last_active":"2024-09-16T07:35:35.671571+0000","last_peered":"2024-09-16T07:35:35.671571+0000","last_clean":"2024-09-16T07:35:35.671571+0000","last_became_active":"2024-09-16T07:35:35.664196+0000","last_became_peered":"2024-09-16T07:35:35.664196+0000","last_unstale":"2024-09-16T07:35:35.671571+0000","last_undegraded":"2024-09-16T07:35:35.671571+0000","last_fullsized":"2024-09-16T07:35:35.671571+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:45:07.797248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"141'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.635926+0000","last_change":"2024-09-16T07:35:34.649452+0000","last_active":"2024-09-16T07:35:37.635926+0000","last_peered":"2024-09-16T07:35:37.635926+0000","last_clean":"2024-09-16T07:35:37.635926+0000","last_became_active":"2024-09-16T07:35:34.649195+0000","last_became_peered":"2024-09-16T07:35:34.649195+0000","last_unstale":"2024-09-16T07:35:37.635926+0000","last_undegraded":"2024-09-16T07:35:37.635926+0000","last_fullsized":"2024-09-16T07:35:37.635926+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:39.964344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164575+0000","last_change":"2024-09-16T07:35:35.662711+0000","last_active":"2024-09-16T07:35:38.164575+0000","last_peered":"2024-09-16T07:35:38.164575+0000","last_clean":"2024-09-16T07:35:38.164575+0000","last_became_active":"2024-09-16T07:35:35.661974+0000","last_became_peered":"2024-09-16T07:35:35.661974+0000","last_unstale":"2024-09-16T07:35:38.164575+0000","last_undegraded":"2024-09-16T07:35:38.164575+0000","last_fullsized":"2024-09-16T07:35:38.164575+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:37:36.005879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883954+0000","last_change":"2024-09-16T07:35:34.648925+0000","last_active":"2024-09-16T07:35:37.883954+0000","last_peered":"2024-09-16T07:35:37.883954+0000","last_clean":"2024-09-16T07:35:37.883954+0000","last_became_active":"2024-09-16T07:35:34.648585+0000","last_became_peered":"2024-09-16T07:35:34.648585+0000","last_unstale":"2024-09-16T07:35:37.883954+0000","last_undegraded":"2024-09-16T07:35:37.883954+0000","last_fullsized":"2024-09-16T07:35:37.883954+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:06:45.682909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669910+0000","last_change":"2024-09-16T07:35:35.663020+0000","last_active":"2024-09-16T07:35:35.669910+0000","last_peered":"2024-09-16T07:35:35.669910+0000","last_clean":"2024-09-16T07:35:35.669910+0000","last_became_active":"2024-09-16T07:35:35.662764+0000","last_became_peered":"2024-09-16T07:35:35.662764+0000","last_unstale":"2024-09-16T07:35:35.669910+0000","last_undegraded":"2024-09-16T07:35:35.669910+0000","last_fullsized":"2024-09-16T07:35:35.669910+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:32:32.204585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.642278+0000","last_change":"2024-09-16T07:35:34.654458+0000","last_active":"2024-09-16T07:35:35.642278+0000","last_peered":"2024-09-16T07:35:35.642278+0000","last_clean":"2024-09-16T07:35:35.642278+0000","last_became_active":"2024-09-16T07:35:34.654195+0000","last_became_peered":"2024-09-16T07:35:34.654195+0000","last_unstale":"2024-09-16T07:35:35.642278+0000","last_undegraded":"2024-09-16T07:35:35.642278+0000","last_fullsized":"2024-09-16T07:35:35.642278+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:44:41.045028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669714+0000","last_change":"2024-09-16T07:35:35.661701+0000","last_active":"2024-09-16T07:35:35.669714+0000","last_peered":"2024-09-16T07:35:35.669714+0000","last_clean":"2024-09-16T07:35:35.669714+0000","last_became_active":"2024-09-16T07:35:35.661338+0000","last_became_peered":"2024-09-16T07:35:35.661338+0000","last_unstale":"2024-09-16T07:35:35.669714+0000","last_undegraded":"2024-09-16T07:35:35.669714+0000","last_fullsized":"2024-09-16T07:35:35.669714+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:03.782272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636768+0000","last_change":"2024-09-16T07:35:34.642024+0000","last_active":"2024-09-16T07:35:37.636768+0000","last_peered":"2024-09-16T07:35:37.636768+0000","last_clean":"2024-09-16T07:35:37.636768+0000","last_became_active":"2024-09-16T07:35:34.641762+0000","last_became_peered":"2024-09-16T07:35:34.641762+0000","last_unstale":"2024-09-16T07:35:37.636768+0000","last_undegraded":"2024-09-16T07:35:37.636768+0000","last_fullsized":"2024-09-16T07:35:37.636768+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:58.371502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636966+0000","last_change":"2024-09-16T07:35:35.658670+0000","last_active":"2024-09-16T07:35:37.636966+0000","last_peered":"2024-09-16T07:35:37.636966+0000","last_clean":"2024-09-16T07:35:37.636966+0000","last_became_active":"2024-09-16T07:35:35.658412+0000","last_became_peered":"2024-09-16T07:35:35.658412+0000","last_unstale":"2024-09-16T07:35:37.636966+0000","last_undegraded":"2024-09-16T07:35:37.636966+0000","last_fullsized":"2024-09-16T07:35:37.636966+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:57.363085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650761+0000","last_change":"2024-09-16T07:35:34.652876+0000","last_active":"2024-09-16T07:35:36.650761+0000","last_peered":"2024-09-16T07:35:36.650761+0000","last_clean":"2024-09-16T07:35:36.650761+0000","last_became_active":"2024-09-16T07:35:34.652613+0000","last_became_peered":"2024-09-16T07:35:34.652613+0000","last_unstale":"2024-09-16T07:35:36.650761+0000","last_undegraded":"2024-09-16T07:35:36.650761+0000","last_fullsized":"2024-09-16T07:35:36.650761+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:39.332687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671376+0000","last_change":"2024-09-16T07:35:35.662649+0000","last_active":"2024-09-16T07:35:35.671376+0000","last_peered":"2024-09-16T07:35:35.671376+0000","last_clean":"2024-09-16T07:35:35.671376+0000","last_became_active":"2024-09-16T07:35:35.662362+0000","last_became_peered":"2024-09-16T07:35:35.662362+0000","last_unstale":"2024-09-16T07:35:35.671376+0000","last_undegraded":"2024-09-16T07:35:35.671376+0000","last_fullsized":"2024-09-16T07:35:35.671376+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:23:33.851376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883714+0000","last_change":"2024-09-16T07:35:34.650260+0000","last_active":"2024-09-16T07:35:37.883714+0000","last_peered":"2024-09-16T07:35:37.883714+0000","last_clean":"2024-09-16T07:35:37.883714+0000","last_became_active":"2024-09-16T07:35:34.648114+0000","last_became_peered":"2024-09-16T07:35:34.648114+0000","last_unstale":"2024-09-16T07:35:37.883714+0000","last_undegraded":"2024-09-16T07:35:37.883714+0000","last_fullsized":"2024-09-16T07:35:37.883714+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:03.369840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649277+0000","last_change":"2024-09-16T07:35:35.653757+0000","last_active":"2024-09-16T07:35:36.649277+0000","last_peered":"2024-09-16T07:35:36.649277+0000","last_clean":"2024-09-16T07:35:36.649277+0000","last_became_active":"2024-09-16T07:35:35.653488+0000","last_became_peered":"2024-09-16T07:35:35.653488+0000","last_unstale":"2024-09-16T07:35:36.649277+0000","last_undegraded":"2024-09-16T07:35:36.649277+0000","last_fullsized":"2024-09-16T07:35:36.649277+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:25.555794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636749+0000","last_change":"2024-09-16T07:35:34.652585+0000","last_active":"2024-09-16T07:35:37.636749+0000","last_peered":"2024-09-16T07:35:37.636749+0000","last_clean":"2024-09-16T07:35:37.636749+0000","last_became_active":"2024-09-16T07:35:34.652034+0000","last_became_peered":"2024-09-16T07:35:34.652034+0000","last_unstale":"2024-09-16T07:35:37.636749+0000","last_undegraded":"2024-09-16T07:35:37.636749+0000","last_fullsized":"2024-09-16T07:35:37.636749+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:12.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670043+0000","last_change":"2024-09-16T07:35:35.666006+0000","last_active":"2024-09-16T07:35:35.670043+0000","last_peered":"2024-09-16T07:35:35.670043+0000","last_clean":"2024-09-16T07:35:35.670043+0000","last_became_active":"2024-09-16T07:35:35.665421+0000","last_became_peered":"2024-09-16T07:35:35.665421+0000","last_unstale":"2024-09-16T07:35:35.670043+0000","last_undegraded":"2024-09-16T07:35:35.670043+0000","last_fullsized":"2024-09-16T07:35:35.670043+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:37.241835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637128+0000","last_change":"2024-09-16T07:35:34.644753+0000","last_active":"2024-09-16T07:35:37.637128+0000","last_peered":"2024-09-16T07:35:37.637128+0000","last_clean":"2024-09-16T07:35:37.637128+0000","last_became_active":"2024-09-16T07:35:34.643106+0000","last_became_peered":"2024-09-16T07:35:34.643106+0000","last_unstale":"2024-09-16T07:35:37.637128+0000","last_undegraded":"2024-09-16T07:35:37.637128+0000","last_fullsized":"2024-09-16T07:35:37.637128+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:50.114840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":359,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648207+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:35:36.648207+0000","last_peered":"2024-09-16T07:35:36.648207+0000","last_clean":"2024-09-16T07:35:36.648207+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:35:36.648207+0000","last_undegraded":"2024-09-16T07:35:36.648207+0000","last_fullsized":"2024-09-16T07:35:36.648207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1368950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":769922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1773568,"data_stored":776832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":777910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":769934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":769990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1769472,"data_stored":776262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2347008,"data_stored":1360268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:35:39.756 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:35:39.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 -- 172.21.15.114:0/2198321582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17840afca0 msgr2=0x7f17840b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 --2- 172.21.15.114:0/2198321582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17840afca0 0x7f17840b00d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f1784073dd0 tx=0x7f177c01ccc0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 -- 172.21.15.114:0/2198321582 shutdown_connections 2024-09-16T07:35:39.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 --2- 172.21.15.114:0/2198321582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17840afca0 0x7f17840b00d0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 --2- 172.21.15.114:0/2198321582 >> v2:172.21.15.149:3300/0 conn(0x7f17840b2e80 0x7f17840b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 -- 172.21.15.114:0/2198321582 >> 172.21.15.114:0/2198321582 conn(0x7f17840d1e30 msgr2=0x7f17840d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 -- 172.21.15.114:0/2198321582 shutdown_connections 2024-09-16T07:35:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 -- 172.21.15.114:0/2198321582 wait complete. 2024-09-16T07:35:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 Processor -- start 2024-09-16T07:35:39.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.941+0000 7f178c000640 1 -- start start 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17840afca0 0x7f1784156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17840b2e80 0x7f17840b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178415f490 0x7f17840b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1784168e00 con 0x7f178415f490 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1784168c80 con 0x7f17840b2e80 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1784168f80 con 0x7f17840afca0 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178415f490 0x7f17840b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f1788c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17840b2e80 0x7f17840b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f1789600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17840afca0 0x7f1784156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178415f490 0x7f17840b4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57422/0 (socket says 172.21.15.114:57422) 2024-09-16T07:35:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 -- 172.21.15.114:0/3745629207 learned_addr learned my addr 172.21.15.114:0/3745629207 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:39.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 -- 172.21.15.114:0/3745629207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17840afca0 msgr2=0x7f1784156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17840afca0 0x7f1784156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 -- 172.21.15.114:0/3745629207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17840b2e80 msgr2=0x7f17840b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17840b2e80 0x7f17840b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 -- 172.21.15.114:0/3745629207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17841570f0 con 0x7f178415f490 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178a000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178415f490 0x7f17840b4c60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f177c0198d0 tx=0x7f177c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f1781600640 1 -- 172.21.15.114:0/3745629207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0bb070 con 0x7f178415f490 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f1781600640 1 -- 172.21.15.114:0/3745629207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f177c004e00 con 0x7f178415f490 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f1781600640 1 -- 172.21.15.114:0/3745629207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0b2040 con 0x7f178415f490 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1784157370 con 0x7f178415f490 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1784157930 con 0x7f178415f490 2024-09-16T07:35:39.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17840b00d0 con 0x7f178415f490 2024-09-16T07:35:39.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.945+0000 7f1781600640 1 -- 172.21.15.114:0/3745629207 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f177c0ad810 con 0x7f178415f490 2024-09-16T07:35:39.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.949+0000 7f1781600640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1764073580 0x7f1764075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:39.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.949+0000 7f1781600640 1 -- 172.21.15.114:0/3745629207 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f177c12e8f0 con 0x7f178415f490 2024-09-16T07:35:39.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.949+0000 7f1789600640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1764073580 0x7f1764075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:39.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.949+0000 7f1789600640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1764073580 0x7f1764075a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1778007fd0 tx=0x7f1778009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:39.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:39.953+0000 7f1781600640 1 -- 172.21.15.114:0/3745629207 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f17841570f0 con 0x7f178415f490 2024-09-16T07:35:40.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.117+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17840ce110 con 0x7f1764073580 2024-09-16T07:35:40.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.121+0000 7f1781600640 1 -- 172.21.15.114:0/3745629207 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7f17840ce110 con 0x7f1764073580 2024-09-16T07:35:40.121 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:40.123 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1764073580 msgr2=0x7f1764075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1764073580 0x7f1764075a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1778007fd0 tx=0x7f1778009040 comp rx=0 tx=0).stop 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178415f490 msgr2=0x7f17840b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178415f490 0x7f17840b4c60 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f177c0198d0 tx=0x7f177c003f60 comp rx=0 tx=0).stop 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 shutdown_connections 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f178415f490 0x7f17840b4c60 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17840b2e80 0x7f17840b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1764073580 0x7f1764075a40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 --2- 172.21.15.114:0/3745629207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f17840afca0 0x7f1784156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 >> 172.21.15.114:0/3745629207 conn(0x7f17840d1e30 msgr2=0x7f1784158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 shutdown_connections 2024-09-16T07:35:40.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.125+0000 7f178c000640 1 -- 172.21.15.114:0/3745629207 wait complete. 2024-09-16T07:35:40.141 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-16T07:35:38.411208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264516,"kb_used_data":14968,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710204,"statfs":{"total":773094113280,"available":772823248896,"internally_reserved":0,"allocated":15327232,"data_stored":7370068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.788180"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649377+0000","last_change":"2024-09-16T07:35:35.654190+0000","last_active":"2024-09-16T07:35:36.649377+0000","last_peered":"2024-09-16T07:35:36.649377+0000","last_clean":"2024-09-16T07:35:36.649377+0000","last_became_active":"2024-09-16T07:35:35.653917+0000","last_became_peered":"2024-09-16T07:35:35.653917+0000","last_unstale":"2024-09-16T07:35:36.649377+0000","last_undegraded":"2024-09-16T07:35:36.649377+0000","last_fullsized":"2024-09-16T07:35:36.649377+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:02.490226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884114+0000","last_change":"2024-09-16T07:35:35.652487+0000","last_active":"2024-09-16T07:35:37.884114+0000","last_peered":"2024-09-16T07:35:37.884114+0000","last_clean":"2024-09-16T07:35:37.884114+0000","last_became_active":"2024-09-16T07:35:35.652218+0000","last_became_peered":"2024-09-16T07:35:35.652218+0000","last_unstale":"2024-09-16T07:35:37.884114+0000","last_undegraded":"2024-09-16T07:35:37.884114+0000","last_fullsized":"2024-09-16T07:35:37.884114+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:40.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649516+0000","last_change":"2024-09-16T07:35:35.647404+0000","last_active":"2024-09-16T07:35:36.649516+0000","last_peered":"2024-09-16T07:35:36.649516+0000","last_clean":"2024-09-16T07:35:36.649516+0000","last_became_active":"2024-09-16T07:35:35.646350+0000","last_became_peered":"2024-09-16T07:35:35.646350+0000","last_unstale":"2024-09-16T07:35:36.649516+0000","last_undegraded":"2024-09-16T07:35:36.649516+0000","last_fullsized":"2024-09-16T07:35:36.649516+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:07.155317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651052+0000","last_change":"2024-09-16T07:35:35.657119+0000","last_active":"2024-09-16T07:35:36.651052+0000","last_peered":"2024-09-16T07:35:36.651052+0000","last_clean":"2024-09-16T07:35:36.651052+0000","last_became_active":"2024-09-16T07:35:35.656900+0000","last_became_peered":"2024-09-16T07:35:35.656900+0000","last_unstale":"2024-09-16T07:35:36.651052+0000","last_undegraded":"2024-09-16T07:35:36.651052+0000","last_fullsized":"2024-09-16T07:35:36.651052+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:51.123515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883829+0000","last_change":"2024-09-16T07:35:35.641683+0000","last_active":"2024-09-16T07:35:37.883829+0000","last_peered":"2024-09-16T07:35:37.883829+0000","last_clean":"2024-09-16T07:35:37.883829+0000","last_became_active":"2024-09-16T07:35:35.641385+0000","last_became_peered":"2024-09-16T07:35:35.641385+0000","last_unstale":"2024-09-16T07:35:37.883829+0000","last_undegraded":"2024-09-16T07:35:37.883829+0000","last_fullsized":"2024-09-16T07:35:37.883829+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:24.522699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164400+0000","last_change":"2024-09-16T07:35:35.654593+0000","last_active":"2024-09-16T07:35:38.164400+0000","last_peered":"2024-09-16T07:35:38.164400+0000","last_clean":"2024-09-16T07:35:38.164400+0000","last_became_active":"2024-09-16T07:35:35.654202+0000","last_became_peered":"2024-09-16T07:35:35.654202+0000","last_unstale":"2024-09-16T07:35:38.164400+0000","last_undegraded":"2024-09-16T07:35:38.164400+0000","last_fullsized":"2024-09-16T07:35:38.164400+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:37:19.183966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671604+0000","last_change":"2024-09-16T07:35:35.665628+0000","last_active":"2024-09-16T07:35:35.671604+0000","last_peered":"2024-09-16T07:35:35.671604+0000","last_clean":"2024-09-16T07:35:35.671604+0000","last_became_active":"2024-09-16T07:35:35.665368+0000","last_became_peered":"2024-09-16T07:35:35.665368+0000","last_unstale":"2024-09-16T07:35:35.671604+0000","last_undegraded":"2024-09-16T07:35:35.671604+0000","last_fullsized":"2024-09-16T07:35:35.671604+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:08:05.269865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883954+0000","last_change":"2024-09-16T07:35:35.639537+0000","last_active":"2024-09-16T07:35:37.883954+0000","last_peered":"2024-09-16T07:35:37.883954+0000","last_clean":"2024-09-16T07:35:37.883954+0000","last_became_active":"2024-09-16T07:35:35.639215+0000","last_became_peered":"2024-09-16T07:35:35.639215+0000","last_unstale":"2024-09-16T07:35:37.883954+0000","last_undegraded":"2024-09-16T07:35:37.883954+0000","last_fullsized":"2024-09-16T07:35:37.883954+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:25.770497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884323+0000","last_change":"2024-09-16T07:35:35.656531+0000","last_active":"2024-09-16T07:35:37.884323+0000","last_peered":"2024-09-16T07:35:37.884323+0000","last_clean":"2024-09-16T07:35:37.884323+0000","last_became_active":"2024-09-16T07:35:35.655207+0000","last_became_peered":"2024-09-16T07:35:35.655207+0000","last_unstale":"2024-09-16T07:35:37.884323+0000","last_undegraded":"2024-09-16T07:35:37.884323+0000","last_fullsized":"2024-09-16T07:35:37.884323+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:11:04.145927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884139+0000","last_change":"2024-09-16T07:35:35.660831+0000","last_active":"2024-09-16T07:35:37.884139+0000","last_peered":"2024-09-16T07:35:37.884139+0000","last_clean":"2024-09-16T07:35:37.884139+0000","last_became_active":"2024-09-16T07:35:35.660586+0000","last_became_peered":"2024-09-16T07:35:35.660586+0000","last_unstale":"2024-09-16T07:35:37.884139+0000","last_undegraded":"2024-09-16T07:35:37.884139+0000","last_fullsized":"2024-09-16T07:35:37.884139+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:38.172343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883923+0000","last_change":"2024-09-16T07:35:35.641686+0000","last_active":"2024-09-16T07:35:37.883923+0000","last_peered":"2024-09-16T07:35:37.883923+0000","last_clean":"2024-09-16T07:35:37.883923+0000","last_became_active":"2024-09-16T07:35:35.641414+0000","last_became_peered":"2024-09-16T07:35:35.641414+0000","last_unstale":"2024-09-16T07:35:37.883923+0000","last_undegraded":"2024-09-16T07:35:37.883923+0000","last_fullsized":"2024-09-16T07:35:37.883923+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:13.813451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884050+0000","last_change":"2024-09-16T07:35:35.659670+0000","last_active":"2024-09-16T07:35:37.884050+0000","last_peered":"2024-09-16T07:35:37.884050+0000","last_clean":"2024-09-16T07:35:37.884050+0000","last_became_active":"2024-09-16T07:35:35.658570+0000","last_became_peered":"2024-09-16T07:35:35.658570+0000","last_unstale":"2024-09-16T07:35:37.884050+0000","last_undegraded":"2024-09-16T07:35:37.884050+0000","last_fullsized":"2024-09-16T07:35:37.884050+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:54:26.346443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649221+0000","last_change":"2024-09-16T07:35:35.647063+0000","last_active":"2024-09-16T07:35:36.649221+0000","last_peered":"2024-09-16T07:35:36.649221+0000","last_clean":"2024-09-16T07:35:36.649221+0000","last_became_active":"2024-09-16T07:35:35.646817+0000","last_became_peered":"2024-09-16T07:35:35.646817+0000","last_unstale":"2024-09-16T07:35:36.649221+0000","last_undegraded":"2024-09-16T07:35:36.649221+0000","last_fullsized":"2024-09-16T07:35:36.649221+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:24:20.707063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648991+0000","last_change":"2024-09-16T07:35:35.656926+0000","last_active":"2024-09-16T07:35:36.648991+0000","last_peered":"2024-09-16T07:35:36.648991+0000","last_clean":"2024-09-16T07:35:36.648991+0000","last_became_active":"2024-09-16T07:35:35.656666+0000","last_became_peered":"2024-09-16T07:35:35.656666+0000","last_unstale":"2024-09-16T07:35:36.648991+0000","last_undegraded":"2024-09-16T07:35:36.648991+0000","last_fullsized":"2024-09-16T07:35:36.648991+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:06:46.691583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648165+0000","last_change":"2024-09-16T07:35:35.660589+0000","last_active":"2024-09-16T07:35:36.648165+0000","last_peered":"2024-09-16T07:35:36.648165+0000","last_clean":"2024-09-16T07:35:36.648165+0000","last_became_active":"2024-09-16T07:35:35.659173+0000","last_became_peered":"2024-09-16T07:35:35.659173+0000","last_unstale":"2024-09-16T07:35:36.648165+0000","last_undegraded":"2024-09-16T07:35:36.648165+0000","last_fullsized":"2024-09-16T07:35:36.648165+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:05.544298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671568+0000","last_change":"2024-09-16T07:35:35.664670+0000","last_active":"2024-09-16T07:35:35.671568+0000","last_peered":"2024-09-16T07:35:35.671568+0000","last_clean":"2024-09-16T07:35:35.671568+0000","last_became_active":"2024-09-16T07:35:35.664409+0000","last_became_peered":"2024-09-16T07:35:35.664409+0000","last_unstale":"2024-09-16T07:35:35.671568+0000","last_undegraded":"2024-09-16T07:35:35.671568+0000","last_fullsized":"2024-09-16T07:35:35.671568+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:04.418935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164542+0000","last_change":"2024-09-16T07:35:35.664902+0000","last_active":"2024-09-16T07:35:38.164542+0000","last_peered":"2024-09-16T07:35:38.164542+0000","last_clean":"2024-09-16T07:35:38.164542+0000","last_became_active":"2024-09-16T07:35:35.664600+0000","last_became_peered":"2024-09-16T07:35:35.664600+0000","last_unstale":"2024-09-16T07:35:38.164542+0000","last_undegraded":"2024-09-16T07:35:38.164542+0000","last_fullsized":"2024-09-16T07:35:38.164542+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:30:43.254572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.668332+0000","last_change":"2024-09-16T07:35:35.659469+0000","last_active":"2024-09-16T07:35:35.668332+0000","last_peered":"2024-09-16T07:35:35.668332+0000","last_clean":"2024-09-16T07:35:35.668332+0000","last_became_active":"2024-09-16T07:35:35.659226+0000","last_became_peered":"2024-09-16T07:35:35.659226+0000","last_unstale":"2024-09-16T07:35:35.668332+0000","last_undegraded":"2024-09-16T07:35:35.668332+0000","last_fullsized":"2024-09-16T07:35:35.668332+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:02:25.044989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164386+0000","last_change":"2024-09-16T07:35:35.662509+0000","last_active":"2024-09-16T07:35:38.164386+0000","last_peered":"2024-09-16T07:35:38.164386+0000","last_clean":"2024-09-16T07:35:38.164386+0000","last_became_active":"2024-09-16T07:35:35.662297+0000","last_became_peered":"2024-09-16T07:35:35.662297+0000","last_unstale":"2024-09-16T07:35:38.164386+0000","last_undegraded":"2024-09-16T07:35:38.164386+0000","last_fullsized":"2024-09-16T07:35:38.164386+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:45:24.346320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649640+0000","last_change":"2024-09-16T07:35:35.660062+0000","last_active":"2024-09-16T07:35:36.649640+0000","last_peered":"2024-09-16T07:35:36.649640+0000","last_clean":"2024-09-16T07:35:36.649640+0000","last_became_active":"2024-09-16T07:35:35.659810+0000","last_became_peered":"2024-09-16T07:35:35.659810+0000","last_unstale":"2024-09-16T07:35:36.649640+0000","last_undegraded":"2024-09-16T07:35:36.649640+0000","last_fullsized":"2024-09-16T07:35:36.649640+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:32:39.502887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164329+0000","last_change":"2024-09-16T07:35:35.664634+0000","last_active":"2024-09-16T07:35:38.164329+0000","last_peered":"2024-09-16T07:35:38.164329+0000","last_clean":"2024-09-16T07:35:38.164329+0000","last_became_active":"2024-09-16T07:35:35.664359+0000","last_became_peered":"2024-09-16T07:35:35.664359+0000","last_unstale":"2024-09-16T07:35:38.164329+0000","last_undegraded":"2024-09-16T07:35:38.164329+0000","last_fullsized":"2024-09-16T07:35:38.164329+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:02.780139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883951+0000","last_change":"2024-09-16T07:35:35.650567+0000","last_active":"2024-09-16T07:35:37.883951+0000","last_peered":"2024-09-16T07:35:37.883951+0000","last_clean":"2024-09-16T07:35:37.883951+0000","last_became_active":"2024-09-16T07:35:35.650262+0000","last_became_peered":"2024-09-16T07:35:35.650262+0000","last_unstale":"2024-09-16T07:35:37.883951+0000","last_undegraded":"2024-09-16T07:35:37.883951+0000","last_fullsized":"2024-09-16T07:35:37.883951+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:51.123515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164205+0000","last_change":"2024-09-16T07:35:35.655046+0000","last_active":"2024-09-16T07:35:38.164205+0000","last_peered":"2024-09-16T07:35:38.164205+0000","last_clean":"2024-09-16T07:35:38.164205+0000","last_became_active":"2024-09-16T07:35:35.654790+0000","last_became_peered":"2024-09-16T07:35:35.654790+0000","last_unstale":"2024-09-16T07:35:38.164205+0000","last_undegraded":"2024-09-16T07:35:38.164205+0000","last_fullsized":"2024-09-16T07:35:38.164205+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:36.960224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.884000+0000","last_change":"2024-09-16T07:35:35.643994+0000","last_active":"2024-09-16T07:35:37.884000+0000","last_peered":"2024-09-16T07:35:37.884000+0000","last_clean":"2024-09-16T07:35:37.884000+0000","last_became_active":"2024-09-16T07:35:35.643734+0000","last_became_peered":"2024-09-16T07:35:35.643734+0000","last_unstale":"2024-09-16T07:35:37.884000+0000","last_undegraded":"2024-09-16T07:35:37.884000+0000","last_fullsized":"2024-09-16T07:35:37.884000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:01:45.404990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650143+0000","last_change":"2024-09-16T07:35:35.651408+0000","last_active":"2024-09-16T07:35:36.650143+0000","last_peered":"2024-09-16T07:35:36.650143+0000","last_clean":"2024-09-16T07:35:36.650143+0000","last_became_active":"2024-09-16T07:35:35.651150+0000","last_became_peered":"2024-09-16T07:35:35.651150+0000","last_unstale":"2024-09-16T07:35:36.650143+0000","last_undegraded":"2024-09-16T07:35:36.650143+0000","last_fullsized":"2024-09-16T07:35:36.650143+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:33.043588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.673813+0000","last_change":"2024-09-16T07:35:35.672949+0000","last_active":"2024-09-16T07:35:35.673813+0000","last_peered":"2024-09-16T07:35:35.673813+0000","last_clean":"2024-09-16T07:35:35.673813+0000","last_became_active":"2024-09-16T07:35:35.672622+0000","last_became_peered":"2024-09-16T07:35:35.672622+0000","last_unstale":"2024-09-16T07:35:35.673813+0000","last_undegraded":"2024-09-16T07:35:35.673813+0000","last_fullsized":"2024-09-16T07:35:35.673813+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:05.544298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649783+0000","last_change":"2024-09-16T07:35:35.666942+0000","last_active":"2024-09-16T07:35:36.649783+0000","last_peered":"2024-09-16T07:35:36.649783+0000","last_clean":"2024-09-16T07:35:36.649783+0000","last_became_active":"2024-09-16T07:35:35.666716+0000","last_became_peered":"2024-09-16T07:35:35.666716+0000","last_unstale":"2024-09-16T07:35:36.649783+0000","last_undegraded":"2024-09-16T07:35:36.649783+0000","last_fullsized":"2024-09-16T07:35:36.649783+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:06.947829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651109+0000","last_change":"2024-09-16T07:35:35.659004+0000","last_active":"2024-09-16T07:35:36.651109+0000","last_peered":"2024-09-16T07:35:36.651109+0000","last_clean":"2024-09-16T07:35:36.651109+0000","last_became_active":"2024-09-16T07:35:35.658761+0000","last_became_peered":"2024-09-16T07:35:35.658761+0000","last_unstale":"2024-09-16T07:35:36.651109+0000","last_undegraded":"2024-09-16T07:35:36.651109+0000","last_fullsized":"2024-09-16T07:35:36.651109+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:10:16.704439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649476+0000","last_change":"2024-09-16T07:35:35.659734+0000","last_active":"2024-09-16T07:35:36.649476+0000","last_peered":"2024-09-16T07:35:36.649476+0000","last_clean":"2024-09-16T07:35:36.649476+0000","last_became_active":"2024-09-16T07:35:35.659160+0000","last_became_peered":"2024-09-16T07:35:35.659160+0000","last_unstale":"2024-09-16T07:35:36.649476+0000","last_undegraded":"2024-09-16T07:35:36.649476+0000","last_fullsized":"2024-09-16T07:35:36.649476+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:48:58.409439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636846+0000","last_change":"2024-09-16T07:35:35.657982+0000","last_active":"2024-09-16T07:35:37.636846+0000","last_peered":"2024-09-16T07:35:37.636846+0000","last_clean":"2024-09-16T07:35:37.636846+0000","last_became_active":"2024-09-16T07:35:35.657696+0000","last_became_peered":"2024-09-16T07:35:35.657696+0000","last_unstale":"2024-09-16T07:35:37.636846+0000","last_undegraded":"2024-09-16T07:35:37.636846+0000","last_fullsized":"2024-09-16T07:35:37.636846+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:08.833937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636793+0000","last_change":"2024-09-16T07:35:35.648577+0000","last_active":"2024-09-16T07:35:37.636793+0000","last_peered":"2024-09-16T07:35:37.636793+0000","last_clean":"2024-09-16T07:35:37.636793+0000","last_became_active":"2024-09-16T07:35:35.648297+0000","last_became_peered":"2024-09-16T07:35:35.648297+0000","last_unstale":"2024-09-16T07:35:37.636793+0000","last_undegraded":"2024-09-16T07:35:37.636793+0000","last_fullsized":"2024-09-16T07:35:37.636793+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:28:21.121792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.667749+0000","last_change":"2024-09-16T07:35:35.658853+0000","last_active":"2024-09-16T07:35:35.667749+0000","last_peered":"2024-09-16T07:35:35.667749+0000","last_clean":"2024-09-16T07:35:35.667749+0000","last_became_active":"2024-09-16T07:35:35.658595+0000","last_became_peered":"2024-09-16T07:35:35.658595+0000","last_unstale":"2024-09-16T07:35:35.667749+0000","last_undegraded":"2024-09-16T07:35:35.667749+0000","last_fullsized":"2024-09-16T07:35:35.667749+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:55.169292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.673526+0000","last_change":"2024-09-16T07:35:35.672807+0000","last_active":"2024-09-16T07:35:35.673526+0000","last_peered":"2024-09-16T07:35:35.673526+0000","last_clean":"2024-09-16T07:35:35.673526+0000","last_became_active":"2024-09-16T07:35:35.672424+0000","last_became_peered":"2024-09-16T07:35:35.672424+0000","last_unstale":"2024-09-16T07:35:35.673526+0000","last_undegraded":"2024-09-16T07:35:35.673526+0000","last_fullsized":"2024-09-16T07:35:35.673526+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:17.574458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649077+0000","last_change":"2024-09-16T07:35:34.654598+0000","last_active":"2024-09-16T07:35:36.649077+0000","last_peered":"2024-09-16T07:35:36.649077+0000","last_clean":"2024-09-16T07:35:36.649077+0000","last_became_active":"2024-09-16T07:35:34.654327+0000","last_became_peered":"2024-09-16T07:35:34.654327+0000","last_unstale":"2024-09-16T07:35:36.649077+0000","last_undegraded":"2024-09-16T07:35:36.649077+0000","last_fullsized":"2024-09-16T07:35:36.649077+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:20.289599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637178+0000","last_change":"2024-09-16T07:35:35.649200+0000","last_active":"2024-09-16T07:35:37.637178+0000","last_peered":"2024-09-16T07:35:37.637178+0000","last_clean":"2024-09-16T07:35:37.637178+0000","last_became_active":"2024-09-16T07:35:35.648927+0000","last_became_peered":"2024-09-16T07:35:35.648927+0000","last_unstale":"2024-09-16T07:35:37.637178+0000","last_undegraded":"2024-09-16T07:35:37.637178+0000","last_fullsized":"2024-09-16T07:35:37.637178+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:48.428252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636924+0000","last_change":"2024-09-16T07:35:34.646468+0000","last_active":"2024-09-16T07:35:37.636924+0000","last_peered":"2024-09-16T07:35:37.636924+0000","last_clean":"2024-09-16T07:35:37.636924+0000","last_became_active":"2024-09-16T07:35:34.646173+0000","last_became_peered":"2024-09-16T07:35:34.646173+0000","last_unstale":"2024-09-16T07:35:37.636924+0000","last_undegraded":"2024-09-16T07:35:37.636924+0000","last_fullsized":"2024-09-16T07:35:37.636924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:55.006126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164305+0000","last_change":"2024-09-16T07:35:35.666823+0000","last_active":"2024-09-16T07:35:38.164305+0000","last_peered":"2024-09-16T07:35:38.164305+0000","last_clean":"2024-09-16T07:35:38.164305+0000","last_became_active":"2024-09-16T07:35:35.664724+0000","last_became_peered":"2024-09-16T07:35:35.664724+0000","last_unstale":"2024-09-16T07:35:38.164305+0000","last_undegraded":"2024-09-16T07:35:38.164305+0000","last_fullsized":"2024-09-16T07:35:38.164305+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:07.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650768+0000","last_change":"2024-09-16T07:35:34.649863+0000","last_active":"2024-09-16T07:35:36.650768+0000","last_peered":"2024-09-16T07:35:36.650768+0000","last_clean":"2024-09-16T07:35:36.650768+0000","last_became_active":"2024-09-16T07:35:34.648504+0000","last_became_peered":"2024-09-16T07:35:34.648504+0000","last_unstale":"2024-09-16T07:35:36.650768+0000","last_undegraded":"2024-09-16T07:35:36.650768+0000","last_fullsized":"2024-09-16T07:35:36.650768+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:02:43.634832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649892+0000","last_change":"2024-09-16T07:35:35.658084+0000","last_active":"2024-09-16T07:35:36.649892+0000","last_peered":"2024-09-16T07:35:36.649892+0000","last_clean":"2024-09-16T07:35:36.649892+0000","last_became_active":"2024-09-16T07:35:35.654663+0000","last_became_peered":"2024-09-16T07:35:35.654663+0000","last_unstale":"2024-09-16T07:35:36.649892+0000","last_undegraded":"2024-09-16T07:35:36.649892+0000","last_fullsized":"2024-09-16T07:35:36.649892+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:04.486596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651205+0000","last_change":"2024-09-16T07:35:34.655235+0000","last_active":"2024-09-16T07:35:36.651205+0000","last_peered":"2024-09-16T07:35:36.651205+0000","last_clean":"2024-09-16T07:35:36.651205+0000","last_became_active":"2024-09-16T07:35:34.654998+0000","last_became_peered":"2024-09-16T07:35:34.654998+0000","last_unstale":"2024-09-16T07:35:36.651205+0000","last_undegraded":"2024-09-16T07:35:36.651205+0000","last_fullsized":"2024-09-16T07:35:36.651205+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:44.031072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670123+0000","last_change":"2024-09-16T07:35:35.653753+0000","last_active":"2024-09-16T07:35:35.670123+0000","last_peered":"2024-09-16T07:35:35.670123+0000","last_clean":"2024-09-16T07:35:35.670123+0000","last_became_active":"2024-09-16T07:35:35.653478+0000","last_became_peered":"2024-09-16T07:35:35.653478+0000","last_unstale":"2024-09-16T07:35:35.670123+0000","last_undegraded":"2024-09-16T07:35:35.670123+0000","last_fullsized":"2024-09-16T07:35:35.670123+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:46.316952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649507+0000","last_change":"2024-09-16T07:35:34.649245+0000","last_active":"2024-09-16T07:35:36.649507+0000","last_peered":"2024-09-16T07:35:36.649507+0000","last_clean":"2024-09-16T07:35:36.649507+0000","last_became_active":"2024-09-16T07:35:34.648905+0000","last_became_peered":"2024-09-16T07:35:34.648905+0000","last_unstale":"2024-09-16T07:35:36.649507+0000","last_undegraded":"2024-09-16T07:35:36.649507+0000","last_fullsized":"2024-09-16T07:35:36.649507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:48.143536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651308+0000","last_change":"2024-09-16T07:35:35.661804+0000","last_active":"2024-09-16T07:35:36.651308+0000","last_peered":"2024-09-16T07:35:36.651308+0000","last_clean":"2024-09-16T07:35:36.651308+0000","last_became_active":"2024-09-16T07:35:35.661478+0000","last_became_peered":"2024-09-16T07:35:35.661478+0000","last_unstale":"2024-09-16T07:35:36.651308+0000","last_undegraded":"2024-09-16T07:35:36.651308+0000","last_fullsized":"2024-09-16T07:35:36.651308+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:13.212950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650592+0000","last_change":"2024-09-16T07:35:34.657142+0000","last_active":"2024-09-16T07:35:36.650592+0000","last_peered":"2024-09-16T07:35:36.650592+0000","last_clean":"2024-09-16T07:35:36.650592+0000","last_became_active":"2024-09-16T07:35:34.656873+0000","last_became_peered":"2024-09-16T07:35:34.656873+0000","last_unstale":"2024-09-16T07:35:36.650592+0000","last_undegraded":"2024-09-16T07:35:36.650592+0000","last_fullsized":"2024-09-16T07:35:36.650592+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:22.904915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650683+0000","last_change":"2024-09-16T07:35:35.657439+0000","last_active":"2024-09-16T07:35:36.650683+0000","last_peered":"2024-09-16T07:35:36.650683+0000","last_clean":"2024-09-16T07:35:36.650683+0000","last_became_active":"2024-09-16T07:35:35.657189+0000","last_became_peered":"2024-09-16T07:35:35.657189+0000","last_unstale":"2024-09-16T07:35:36.650683+0000","last_undegraded":"2024-09-16T07:35:36.650683+0000","last_fullsized":"2024-09-16T07:35:36.650683+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:13.813451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883567+0000","last_change":"2024-09-16T07:35:34.649672+0000","last_active":"2024-09-16T07:35:37.883567+0000","last_peered":"2024-09-16T07:35:37.883567+0000","last_clean":"2024-09-16T07:35:37.883567+0000","last_became_active":"2024-09-16T07:35:34.645434+0000","last_became_peered":"2024-09-16T07:35:34.645434+0000","last_unstale":"2024-09-16T07:35:37.883567+0000","last_undegraded":"2024-09-16T07:35:37.883567+0000","last_fullsized":"2024-09-16T07:35:37.883567+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:29:27.048296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164527+0000","last_change":"2024-09-16T07:35:35.654901+0000","last_active":"2024-09-16T07:35:38.164527+0000","last_peered":"2024-09-16T07:35:38.164527+0000","last_clean":"2024-09-16T07:35:38.164527+0000","last_became_active":"2024-09-16T07:35:35.654364+0000","last_became_peered":"2024-09-16T07:35:35.654364+0000","last_unstale":"2024-09-16T07:35:38.164527+0000","last_undegraded":"2024-09-16T07:35:38.164527+0000","last_fullsized":"2024-09-16T07:35:38.164527+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:39.117930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.646931+0000","last_change":"2024-09-16T07:35:34.656147+0000","last_active":"2024-09-16T07:35:35.646931+0000","last_peered":"2024-09-16T07:35:35.646931+0000","last_clean":"2024-09-16T07:35:35.646931+0000","last_became_active":"2024-09-16T07:35:34.655776+0000","last_became_peered":"2024-09-16T07:35:34.655776+0000","last_unstale":"2024-09-16T07:35:35.646931+0000","last_undegraded":"2024-09-16T07:35:35.646931+0000","last_fullsized":"2024-09-16T07:35:35.646931+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:44.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669996+0000","last_change":"2024-09-16T07:35:35.666272+0000","last_active":"2024-09-16T07:35:35.669996+0000","last_peered":"2024-09-16T07:35:35.669996+0000","last_clean":"2024-09-16T07:35:35.669996+0000","last_became_active":"2024-09-16T07:35:35.665985+0000","last_became_peered":"2024-09-16T07:35:35.665985+0000","last_unstale":"2024-09-16T07:35:35.669996+0000","last_undegraded":"2024-09-16T07:35:35.669996+0000","last_fullsized":"2024-09-16T07:35:35.669996+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:31.058725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164467+0000","last_change":"2024-09-16T07:35:34.657522+0000","last_active":"2024-09-16T07:35:38.164467+0000","last_peered":"2024-09-16T07:35:38.164467+0000","last_clean":"2024-09-16T07:35:38.164467+0000","last_became_active":"2024-09-16T07:35:34.657251+0000","last_became_peered":"2024-09-16T07:35:34.657251+0000","last_unstale":"2024-09-16T07:35:38.164467+0000","last_undegraded":"2024-09-16T07:35:38.164467+0000","last_fullsized":"2024-09-16T07:35:38.164467+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:44:15.943305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670009+0000","last_change":"2024-09-16T07:35:35.663978+0000","last_active":"2024-09-16T07:35:35.670009+0000","last_peered":"2024-09-16T07:35:35.670009+0000","last_clean":"2024-09-16T07:35:35.670009+0000","last_became_active":"2024-09-16T07:35:35.663700+0000","last_became_peered":"2024-09-16T07:35:35.663700+0000","last_unstale":"2024-09-16T07:35:35.670009+0000","last_undegraded":"2024-09-16T07:35:35.670009+0000","last_fullsized":"2024-09-16T07:35:35.670009+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:54.834191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"140'3","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164447+0000","last_change":"2024-09-16T07:35:34.651520+0000","last_active":"2024-09-16T07:35:38.164447+0000","last_peered":"2024-09-16T07:35:38.164447+0000","last_clean":"2024-09-16T07:35:38.164447+0000","last_became_active":"2024-09-16T07:35:34.651252+0000","last_became_peered":"2024-09-16T07:35:34.651252+0000","last_unstale":"2024-09-16T07:35:38.164447+0000","last_undegraded":"2024-09-16T07:35:38.164447+0000","last_fullsized":"2024-09-16T07:35:38.164447+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:43.986432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637252+0000","last_change":"2024-09-16T07:35:35.651019+0000","last_active":"2024-09-16T07:35:37.637252+0000","last_peered":"2024-09-16T07:35:37.637252+0000","last_clean":"2024-09-16T07:35:37.637252+0000","last_became_active":"2024-09-16T07:35:35.647730+0000","last_became_peered":"2024-09-16T07:35:35.647730+0000","last_unstale":"2024-09-16T07:35:37.637252+0000","last_undegraded":"2024-09-16T07:35:37.637252+0000","last_fullsized":"2024-09-16T07:35:37.637252+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:43.986642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"140'6","reported_seq":21,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637039+0000","last_change":"2024-09-16T07:35:34.650720+0000","last_active":"2024-09-16T07:35:37.637039+0000","last_peered":"2024-09-16T07:35:37.637039+0000","last_clean":"2024-09-16T07:35:37.637039+0000","last_became_active":"2024-09-16T07:35:34.650068+0000","last_became_peered":"2024-09-16T07:35:34.650068+0000","last_unstale":"2024-09-16T07:35:37.637039+0000","last_undegraded":"2024-09-16T07:35:37.637039+0000","last_fullsized":"2024-09-16T07:35:37.637039+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:32.034913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.667912+0000","last_change":"2024-09-16T07:35:35.654004+0000","last_active":"2024-09-16T07:35:35.667912+0000","last_peered":"2024-09-16T07:35:35.667912+0000","last_clean":"2024-09-16T07:35:35.667912+0000","last_became_active":"2024-09-16T07:35:35.653748+0000","last_became_peered":"2024-09-16T07:35:35.653748+0000","last_unstale":"2024-09-16T07:35:35.667912+0000","last_undegraded":"2024-09-16T07:35:35.667912+0000","last_fullsized":"2024-09-16T07:35:35.667912+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:26:13.077159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650967+0000","last_change":"2024-09-16T07:35:34.655156+0000","last_active":"2024-09-16T07:35:36.650967+0000","last_peered":"2024-09-16T07:35:36.650967+0000","last_clean":"2024-09-16T07:35:36.650967+0000","last_became_active":"2024-09-16T07:35:34.654911+0000","last_became_peered":"2024-09-16T07:35:34.654911+0000","last_unstale":"2024-09-16T07:35:36.650967+0000","last_undegraded":"2024-09-16T07:35:36.650967+0000","last_fullsized":"2024-09-16T07:35:36.650967+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:59.931783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670086+0000","last_change":"2024-09-16T07:35:35.656145+0000","last_active":"2024-09-16T07:35:35.670086+0000","last_peered":"2024-09-16T07:35:35.670086+0000","last_clean":"2024-09-16T07:35:35.670086+0000","last_became_active":"2024-09-16T07:35:35.655915+0000","last_became_peered":"2024-09-16T07:35:35.655915+0000","last_unstale":"2024-09-16T07:35:35.670086+0000","last_undegraded":"2024-09-16T07:35:35.670086+0000","last_fullsized":"2024-09-16T07:35:35.670086+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:53.614432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.642047+0000","last_change":"2024-09-16T07:35:34.650131+0000","last_active":"2024-09-16T07:35:35.642047+0000","last_peered":"2024-09-16T07:35:35.642047+0000","last_clean":"2024-09-16T07:35:35.642047+0000","last_became_active":"2024-09-16T07:35:34.649842+0000","last_became_peered":"2024-09-16T07:35:34.649842+0000","last_unstale":"2024-09-16T07:35:35.642047+0000","last_undegraded":"2024-09-16T07:35:35.642047+0000","last_fullsized":"2024-09-16T07:35:35.642047+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:42:42.977968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650753+0000","last_change":"2024-09-16T07:35:35.656773+0000","last_active":"2024-09-16T07:35:36.650753+0000","last_peered":"2024-09-16T07:35:36.650753+0000","last_clean":"2024-09-16T07:35:36.650753+0000","last_became_active":"2024-09-16T07:35:35.655263+0000","last_became_peered":"2024-09-16T07:35:35.655263+0000","last_unstale":"2024-09-16T07:35:36.650753+0000","last_undegraded":"2024-09-16T07:35:36.650753+0000","last_fullsized":"2024-09-16T07:35:36.650753+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:00:56.014800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650833+0000","last_change":"2024-09-16T07:35:34.648747+0000","last_active":"2024-09-16T07:35:36.650833+0000","last_peered":"2024-09-16T07:35:36.650833+0000","last_clean":"2024-09-16T07:35:36.650833+0000","last_became_active":"2024-09-16T07:35:34.648385+0000","last_became_peered":"2024-09-16T07:35:34.648385+0000","last_unstale":"2024-09-16T07:35:36.650833+0000","last_undegraded":"2024-09-16T07:35:36.650833+0000","last_fullsized":"2024-09-16T07:35:36.650833+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:03.282520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648725+0000","last_change":"2024-09-16T07:35:35.653133+0000","last_active":"2024-09-16T07:35:36.648725+0000","last_peered":"2024-09-16T07:35:36.648725+0000","last_clean":"2024-09-16T07:35:36.648725+0000","last_became_active":"2024-09-16T07:35:35.652656+0000","last_became_peered":"2024-09-16T07:35:35.652656+0000","last_unstale":"2024-09-16T07:35:36.648725+0000","last_undegraded":"2024-09-16T07:35:36.648725+0000","last_fullsized":"2024-09-16T07:35:36.648725+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:04.378514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"140'8","reported_seq":23,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636880+0000","last_change":"2024-09-16T07:35:34.648703+0000","last_active":"2024-09-16T07:35:37.636880+0000","last_peered":"2024-09-16T07:35:37.636880+0000","last_clean":"2024-09-16T07:35:37.636880+0000","last_became_active":"2024-09-16T07:35:34.648357+0000","last_became_peered":"2024-09-16T07:35:34.648357+0000","last_unstale":"2024-09-16T07:35:37.636880+0000","last_undegraded":"2024-09-16T07:35:37.636880+0000","last_fullsized":"2024-09-16T07:35:37.636880+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:03.560126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651298+0000","last_change":"2024-09-16T07:35:35.661984+0000","last_active":"2024-09-16T07:35:36.651298+0000","last_peered":"2024-09-16T07:35:36.651298+0000","last_clean":"2024-09-16T07:35:36.651298+0000","last_became_active":"2024-09-16T07:35:35.661040+0000","last_became_peered":"2024-09-16T07:35:35.661040+0000","last_unstale":"2024-09-16T07:35:36.651298+0000","last_undegraded":"2024-09-16T07:35:36.651298+0000","last_fullsized":"2024-09-16T07:35:36.651298+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:38.172343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650070+0000","last_change":"2024-09-16T07:35:34.644336+0000","last_active":"2024-09-16T07:35:36.650070+0000","last_peered":"2024-09-16T07:35:36.650070+0000","last_clean":"2024-09-16T07:35:36.650070+0000","last_became_active":"2024-09-16T07:35:34.644061+0000","last_became_peered":"2024-09-16T07:35:34.644061+0000","last_unstale":"2024-09-16T07:35:36.650070+0000","last_undegraded":"2024-09-16T07:35:36.650070+0000","last_fullsized":"2024-09-16T07:35:36.650070+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:53.380748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669595+0000","last_change":"2024-09-16T07:35:35.661381+0000","last_active":"2024-09-16T07:35:35.669595+0000","last_peered":"2024-09-16T07:35:35.669595+0000","last_clean":"2024-09-16T07:35:35.669595+0000","last_became_active":"2024-09-16T07:35:35.660933+0000","last_became_peered":"2024-09-16T07:35:35.660933+0000","last_unstale":"2024-09-16T07:35:35.669595+0000","last_undegraded":"2024-09-16T07:35:35.669595+0000","last_fullsized":"2024-09-16T07:35:35.669595+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:55:27.783547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649130+0000","last_change":"2024-09-16T07:35:34.651885+0000","last_active":"2024-09-16T07:35:36.649130+0000","last_peered":"2024-09-16T07:35:36.649130+0000","last_clean":"2024-09-16T07:35:36.649130+0000","last_became_active":"2024-09-16T07:35:34.651624+0000","last_became_peered":"2024-09-16T07:35:34.651624+0000","last_unstale":"2024-09-16T07:35:36.649130+0000","last_undegraded":"2024-09-16T07:35:36.649130+0000","last_fullsized":"2024-09-16T07:35:36.649130+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:16:33.701483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651236+0000","last_change":"2024-09-16T07:35:35.663415+0000","last_active":"2024-09-16T07:35:36.651236+0000","last_peered":"2024-09-16T07:35:36.651236+0000","last_clean":"2024-09-16T07:35:36.651236+0000","last_became_active":"2024-09-16T07:35:35.663031+0000","last_became_peered":"2024-09-16T07:35:35.663031+0000","last_unstale":"2024-09-16T07:35:36.651236+0000","last_undegraded":"2024-09-16T07:35:36.651236+0000","last_fullsized":"2024-09-16T07:35:36.651236+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:52.088117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648862+0000","last_change":"2024-09-16T07:35:34.653143+0000","last_active":"2024-09-16T07:35:36.648862+0000","last_peered":"2024-09-16T07:35:36.648862+0000","last_clean":"2024-09-16T07:35:36.648862+0000","last_became_active":"2024-09-16T07:35:34.652777+0000","last_became_peered":"2024-09-16T07:35:34.652777+0000","last_unstale":"2024-09-16T07:35:36.648862+0000","last_undegraded":"2024-09-16T07:35:36.648862+0000","last_fullsized":"2024-09-16T07:35:36.648862+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:36.233160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671384+0000","last_change":"2024-09-16T07:35:35.663347+0000","last_active":"2024-09-16T07:35:35.671384+0000","last_peered":"2024-09-16T07:35:35.671384+0000","last_clean":"2024-09-16T07:35:35.671384+0000","last_became_active":"2024-09-16T07:35:35.663104+0000","last_became_peered":"2024-09-16T07:35:35.663104+0000","last_unstale":"2024-09-16T07:35:35.671384+0000","last_undegraded":"2024-09-16T07:35:35.671384+0000","last_fullsized":"2024-09-16T07:35:35.671384+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:07.331798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648714+0000","last_change":"2024-09-16T07:35:34.656103+0000","last_active":"2024-09-16T07:35:36.648714+0000","last_peered":"2024-09-16T07:35:36.648714+0000","last_clean":"2024-09-16T07:35:36.648714+0000","last_became_active":"2024-09-16T07:35:34.655883+0000","last_became_peered":"2024-09-16T07:35:34.655883+0000","last_unstale":"2024-09-16T07:35:36.648714+0000","last_undegraded":"2024-09-16T07:35:36.648714+0000","last_fullsized":"2024-09-16T07:35:36.648714+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:02.773598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649201+0000","last_change":"2024-09-16T07:35:35.650519+0000","last_active":"2024-09-16T07:35:36.649201+0000","last_peered":"2024-09-16T07:35:36.649201+0000","last_clean":"2024-09-16T07:35:36.649201+0000","last_became_active":"2024-09-16T07:35:35.650255+0000","last_became_peered":"2024-09-16T07:35:35.650255+0000","last_unstale":"2024-09-16T07:35:36.649201+0000","last_undegraded":"2024-09-16T07:35:36.649201+0000","last_fullsized":"2024-09-16T07:35:36.649201+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:58.609044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.651073+0000","last_change":"2024-09-16T07:35:34.652596+0000","last_active":"2024-09-16T07:35:36.651073+0000","last_peered":"2024-09-16T07:35:36.651073+0000","last_clean":"2024-09-16T07:35:36.651073+0000","last_became_active":"2024-09-16T07:35:34.650025+0000","last_became_peered":"2024-09-16T07:35:34.650025+0000","last_unstale":"2024-09-16T07:35:36.651073+0000","last_undegraded":"2024-09-16T07:35:36.651073+0000","last_fullsized":"2024-09-16T07:35:36.651073+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:54:30.936813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671505+0000","last_change":"2024-09-16T07:35:35.664299+0000","last_active":"2024-09-16T07:35:35.671505+0000","last_peered":"2024-09-16T07:35:35.671505+0000","last_clean":"2024-09-16T07:35:35.671505+0000","last_became_active":"2024-09-16T07:35:35.663976+0000","last_became_peered":"2024-09-16T07:35:35.663976+0000","last_unstale":"2024-09-16T07:35:35.671505+0000","last_undegraded":"2024-09-16T07:35:35.671505+0000","last_fullsized":"2024-09-16T07:35:35.671505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.727675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648431+0000","last_change":"2024-09-16T07:35:34.656729+0000","last_active":"2024-09-16T07:35:36.648431+0000","last_peered":"2024-09-16T07:35:36.648431+0000","last_clean":"2024-09-16T07:35:36.648431+0000","last_became_active":"2024-09-16T07:35:34.656517+0000","last_became_peered":"2024-09-16T07:35:34.656517+0000","last_unstale":"2024-09-16T07:35:36.648431+0000","last_undegraded":"2024-09-16T07:35:36.648431+0000","last_fullsized":"2024-09-16T07:35:36.648431+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:32:31.195911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648174+0000","last_change":"2024-09-16T07:35:35.656731+0000","last_active":"2024-09-16T07:35:36.648174+0000","last_peered":"2024-09-16T07:35:36.648174+0000","last_clean":"2024-09-16T07:35:36.648174+0000","last_became_active":"2024-09-16T07:35:35.656491+0000","last_became_peered":"2024-09-16T07:35:35.656491+0000","last_unstale":"2024-09-16T07:35:36.648174+0000","last_undegraded":"2024-09-16T07:35:36.648174+0000","last_fullsized":"2024-09-16T07:35:36.648174+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:25.576745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650646+0000","last_change":"2024-09-16T07:35:34.654623+0000","last_active":"2024-09-16T07:35:36.650646+0000","last_peered":"2024-09-16T07:35:36.650646+0000","last_clean":"2024-09-16T07:35:36.650646+0000","last_became_active":"2024-09-16T07:35:34.654323+0000","last_became_peered":"2024-09-16T07:35:34.654323+0000","last_unstale":"2024-09-16T07:35:36.650646+0000","last_undegraded":"2024-09-16T07:35:36.650646+0000","last_fullsized":"2024-09-16T07:35:36.650646+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:43.070977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164661+0000","last_change":"2024-09-16T07:35:35.654623+0000","last_active":"2024-09-16T07:35:38.164661+0000","last_peered":"2024-09-16T07:35:38.164661+0000","last_clean":"2024-09-16T07:35:38.164661+0000","last_became_active":"2024-09-16T07:35:35.654197+0000","last_became_peered":"2024-09-16T07:35:35.654197+0000","last_unstale":"2024-09-16T07:35:38.164661+0000","last_undegraded":"2024-09-16T07:35:38.164661+0000","last_fullsized":"2024-09-16T07:35:38.164661+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:43.624173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648148+0000","last_change":"2024-09-16T07:35:34.654487+0000","last_active":"2024-09-16T07:35:36.648148+0000","last_peered":"2024-09-16T07:35:36.648148+0000","last_clean":"2024-09-16T07:35:36.648148+0000","last_became_active":"2024-09-16T07:35:34.654176+0000","last_became_peered":"2024-09-16T07:35:34.654176+0000","last_unstale":"2024-09-16T07:35:36.648148+0000","last_undegraded":"2024-09-16T07:35:36.648148+0000","last_fullsized":"2024-09-16T07:35:36.648148+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:55:26.774873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670064+0000","last_change":"2024-09-16T07:35:35.666265+0000","last_active":"2024-09-16T07:35:35.670064+0000","last_peered":"2024-09-16T07:35:35.670064+0000","last_clean":"2024-09-16T07:35:35.670064+0000","last_became_active":"2024-09-16T07:35:35.665762+0000","last_became_peered":"2024-09-16T07:35:35.665762+0000","last_unstale":"2024-09-16T07:35:35.670064+0000","last_undegraded":"2024-09-16T07:35:35.670064+0000","last_fullsized":"2024-09-16T07:35:35.670064+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:52:21.298273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"140'2","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.661036+0000","last_change":"2024-09-16T07:35:34.647795+0000","last_active":"2024-09-16T07:35:35.661036+0000","last_peered":"2024-09-16T07:35:35.661036+0000","last_clean":"2024-09-16T07:35:35.661036+0000","last_became_active":"2024-09-16T07:35:34.647534+0000","last_became_peered":"2024-09-16T07:35:34.647534+0000","last_unstale":"2024-09-16T07:35:35.661036+0000","last_undegraded":"2024-09-16T07:35:35.661036+0000","last_fullsized":"2024-09-16T07:35:35.661036+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:05:56.753443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671571+0000","last_change":"2024-09-16T07:35:35.664933+0000","last_active":"2024-09-16T07:35:35.671571+0000","last_peered":"2024-09-16T07:35:35.671571+0000","last_clean":"2024-09-16T07:35:35.671571+0000","last_became_active":"2024-09-16T07:35:35.664196+0000","last_became_peered":"2024-09-16T07:35:35.664196+0000","last_unstale":"2024-09-16T07:35:35.671571+0000","last_undegraded":"2024-09-16T07:35:35.671571+0000","last_fullsized":"2024-09-16T07:35:35.671571+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:45:07.797248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"141'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.635926+0000","last_change":"2024-09-16T07:35:34.649452+0000","last_active":"2024-09-16T07:35:37.635926+0000","last_peered":"2024-09-16T07:35:37.635926+0000","last_clean":"2024-09-16T07:35:37.635926+0000","last_became_active":"2024-09-16T07:35:34.649195+0000","last_became_peered":"2024-09-16T07:35:34.649195+0000","last_unstale":"2024-09-16T07:35:37.635926+0000","last_undegraded":"2024-09-16T07:35:37.635926+0000","last_fullsized":"2024-09-16T07:35:37.635926+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:39.964344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:38.164575+0000","last_change":"2024-09-16T07:35:35.662711+0000","last_active":"2024-09-16T07:35:38.164575+0000","last_peered":"2024-09-16T07:35:38.164575+0000","last_clean":"2024-09-16T07:35:38.164575+0000","last_became_active":"2024-09-16T07:35:35.661974+0000","last_became_peered":"2024-09-16T07:35:35.661974+0000","last_unstale":"2024-09-16T07:35:38.164575+0000","last_undegraded":"2024-09-16T07:35:38.164575+0000","last_fullsized":"2024-09-16T07:35:38.164575+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:37:36.005879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883954+0000","last_change":"2024-09-16T07:35:34.648925+0000","last_active":"2024-09-16T07:35:37.883954+0000","last_peered":"2024-09-16T07:35:37.883954+0000","last_clean":"2024-09-16T07:35:37.883954+0000","last_became_active":"2024-09-16T07:35:34.648585+0000","last_became_peered":"2024-09-16T07:35:34.648585+0000","last_unstale":"2024-09-16T07:35:37.883954+0000","last_undegraded":"2024-09-16T07:35:37.883954+0000","last_fullsized":"2024-09-16T07:35:37.883954+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:06:45.682909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669910+0000","last_change":"2024-09-16T07:35:35.663020+0000","last_active":"2024-09-16T07:35:35.669910+0000","last_peered":"2024-09-16T07:35:35.669910+0000","last_clean":"2024-09-16T07:35:35.669910+0000","last_became_active":"2024-09-16T07:35:35.662764+0000","last_became_peered":"2024-09-16T07:35:35.662764+0000","last_unstale":"2024-09-16T07:35:35.669910+0000","last_undegraded":"2024-09-16T07:35:35.669910+0000","last_fullsized":"2024-09-16T07:35:35.669910+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:32:32.204585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.642278+0000","last_change":"2024-09-16T07:35:34.654458+0000","last_active":"2024-09-16T07:35:35.642278+0000","last_peered":"2024-09-16T07:35:35.642278+0000","last_clean":"2024-09-16T07:35:35.642278+0000","last_became_active":"2024-09-16T07:35:34.654195+0000","last_became_peered":"2024-09-16T07:35:34.654195+0000","last_unstale":"2024-09-16T07:35:35.642278+0000","last_undegraded":"2024-09-16T07:35:35.642278+0000","last_fullsized":"2024-09-16T07:35:35.642278+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:44:41.045028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.669714+0000","last_change":"2024-09-16T07:35:35.661701+0000","last_active":"2024-09-16T07:35:35.669714+0000","last_peered":"2024-09-16T07:35:35.669714+0000","last_clean":"2024-09-16T07:35:35.669714+0000","last_became_active":"2024-09-16T07:35:35.661338+0000","last_became_peered":"2024-09-16T07:35:35.661338+0000","last_unstale":"2024-09-16T07:35:35.669714+0000","last_undegraded":"2024-09-16T07:35:35.669714+0000","last_fullsized":"2024-09-16T07:35:35.669714+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:03.782272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636768+0000","last_change":"2024-09-16T07:35:34.642024+0000","last_active":"2024-09-16T07:35:37.636768+0000","last_peered":"2024-09-16T07:35:37.636768+0000","last_clean":"2024-09-16T07:35:37.636768+0000","last_became_active":"2024-09-16T07:35:34.641762+0000","last_became_peered":"2024-09-16T07:35:34.641762+0000","last_unstale":"2024-09-16T07:35:37.636768+0000","last_undegraded":"2024-09-16T07:35:37.636768+0000","last_fullsized":"2024-09-16T07:35:37.636768+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:58.371502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636966+0000","last_change":"2024-09-16T07:35:35.658670+0000","last_active":"2024-09-16T07:35:37.636966+0000","last_peered":"2024-09-16T07:35:37.636966+0000","last_clean":"2024-09-16T07:35:37.636966+0000","last_became_active":"2024-09-16T07:35:35.658412+0000","last_became_peered":"2024-09-16T07:35:35.658412+0000","last_unstale":"2024-09-16T07:35:37.636966+0000","last_undegraded":"2024-09-16T07:35:37.636966+0000","last_fullsized":"2024-09-16T07:35:37.636966+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:57.363085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.650761+0000","last_change":"2024-09-16T07:35:34.652876+0000","last_active":"2024-09-16T07:35:36.650761+0000","last_peered":"2024-09-16T07:35:36.650761+0000","last_clean":"2024-09-16T07:35:36.650761+0000","last_became_active":"2024-09-16T07:35:34.652613+0000","last_became_peered":"2024-09-16T07:35:34.652613+0000","last_unstale":"2024-09-16T07:35:36.650761+0000","last_undegraded":"2024-09-16T07:35:36.650761+0000","last_fullsized":"2024-09-16T07:35:36.650761+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:39.332687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.671376+0000","last_change":"2024-09-16T07:35:35.662649+0000","last_active":"2024-09-16T07:35:35.671376+0000","last_peered":"2024-09-16T07:35:35.671376+0000","last_clean":"2024-09-16T07:35:35.671376+0000","last_became_active":"2024-09-16T07:35:35.662362+0000","last_became_peered":"2024-09-16T07:35:35.662362+0000","last_unstale":"2024-09-16T07:35:35.671376+0000","last_undegraded":"2024-09-16T07:35:35.671376+0000","last_fullsized":"2024-09-16T07:35:35.671376+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:23:33.851376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.883714+0000","last_change":"2024-09-16T07:35:34.650260+0000","last_active":"2024-09-16T07:35:37.883714+0000","last_peered":"2024-09-16T07:35:37.883714+0000","last_clean":"2024-09-16T07:35:37.883714+0000","last_became_active":"2024-09-16T07:35:34.648114+0000","last_became_peered":"2024-09-16T07:35:34.648114+0000","last_unstale":"2024-09-16T07:35:37.883714+0000","last_undegraded":"2024-09-16T07:35:37.883714+0000","last_fullsized":"2024-09-16T07:35:37.883714+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:03.369840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.649277+0000","last_change":"2024-09-16T07:35:35.653757+0000","last_active":"2024-09-16T07:35:36.649277+0000","last_peered":"2024-09-16T07:35:36.649277+0000","last_clean":"2024-09-16T07:35:36.649277+0000","last_became_active":"2024-09-16T07:35:35.653488+0000","last_became_peered":"2024-09-16T07:35:35.653488+0000","last_unstale":"2024-09-16T07:35:36.649277+0000","last_undegraded":"2024-09-16T07:35:36.649277+0000","last_fullsized":"2024-09-16T07:35:36.649277+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:25.555794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.636749+0000","last_change":"2024-09-16T07:35:34.652585+0000","last_active":"2024-09-16T07:35:37.636749+0000","last_peered":"2024-09-16T07:35:37.636749+0000","last_clean":"2024-09-16T07:35:37.636749+0000","last_became_active":"2024-09-16T07:35:34.652034+0000","last_became_peered":"2024-09-16T07:35:34.652034+0000","last_unstale":"2024-09-16T07:35:37.636749+0000","last_undegraded":"2024-09-16T07:35:37.636749+0000","last_fullsized":"2024-09-16T07:35:37.636749+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:12.804777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-16T07:35:35.670043+0000","last_change":"2024-09-16T07:35:35.666006+0000","last_active":"2024-09-16T07:35:35.670043+0000","last_peered":"2024-09-16T07:35:35.670043+0000","last_clean":"2024-09-16T07:35:35.670043+0000","last_became_active":"2024-09-16T07:35:35.665421+0000","last_became_peered":"2024-09-16T07:35:35.665421+0000","last_unstale":"2024-09-16T07:35:35.670043+0000","last_undegraded":"2024-09-16T07:35:35.670043+0000","last_fullsized":"2024-09-16T07:35:35.670043+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:34.622817+0000","last_clean_scrub_stamp":"2024-09-16T07:35:34.622817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:37.241835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:37.637128+0000","last_change":"2024-09-16T07:35:34.644753+0000","last_active":"2024-09-16T07:35:37.637128+0000","last_peered":"2024-09-16T07:35:37.637128+0000","last_clean":"2024-09-16T07:35:37.637128+0000","last_became_active":"2024-09-16T07:35:34.643106+0000","last_became_peered":"2024-09-16T07:35:34.643106+0000","last_unstale":"2024-09-16T07:35:37.637128+0000","last_undegraded":"2024-09-16T07:35:37.637128+0000","last_fullsized":"2024-09-16T07:35:37.637128+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:35:33.614143+0000","last_clean_scrub_stamp":"2024-09-16T07:35:33.614143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:50.114840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":359,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-16T07:35:36.648207+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:35:36.648207+0000","last_peered":"2024-09-16T07:35:36.648207+0000","last_clean":"2024-09-16T07:35:36.648207+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:35:36.648207+0000","last_undegraded":"2024-09-16T07:35:36.648207+0000","last_fullsized":"2024-09-16T07:35:36.648207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2383872,"data_stored":1368950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":769922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1773568,"data_stored":776832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":777910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":769934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":769990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1769472,"data_stored":776262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2347008,"data_stored":1360268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:35:40.145 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:35:40.145 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:35:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.333+0000 7f8908400640 1 -- 172.21.15.114:0/3571852054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890015e790 msgr2=0x7f890015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.333+0000 7f8908400640 1 --2- 172.21.15.114:0/3571852054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890015e790 0x7f890015ebe0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f88ec005fd0 tx=0x7f88ec01c7c0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.333+0000 7f8908400640 1 -- 172.21.15.114:0/3571852054 shutdown_connections 2024-09-16T07:35:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.333+0000 7f8908400640 1 --2- 172.21.15.114:0/3571852054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f890015e790 0x7f890015ebe0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.333+0000 7f8908400640 1 -- 172.21.15.114:0/3571852054 >> 172.21.15.114:0/3571852054 conn(0x7f89000cce90 msgr2=0x7f89000cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.333+0000 7f8908400640 1 -- 172.21.15.114:0/3571852054 shutdown_connections 2024-09-16T07:35:40.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.333+0000 7f8908400640 1 -- 172.21.15.114:0/3571852054 wait complete. 2024-09-16T07:35:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 Processor -- start 2024-09-16T07:35:40.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 -- start start 2024-09-16T07:35:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89000ce8a0 0x7f89000b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89001585f0 0x7f8900154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f890015e790 0x7f8900151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8900168fb0 con 0x7f89000ce8a0 2024-09-16T07:35:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8900168e30 con 0x7f890015e790 2024-09-16T07:35:40.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8900169130 con 0x7f89001585f0 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89000ce8a0 0x7f89000b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89000ce8a0 0x7f89000b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57438/0 (socket says 172.21.15.114:57438) 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 -- 172.21.15.114:0/2271949338 learned_addr learned my addr 172.21.15.114:0/2271949338 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905000640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89001585f0 0x7f8900154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8906400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f890015e790 0x7f8900151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 -- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89001585f0 msgr2=0x7f8900154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89001585f0 0x7f8900154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 -- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f890015e790 msgr2=0x7f8900151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f890015e790 0x7f8900151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 -- 172.21.15.114:0/2271949338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89000b1ac0 con 0x7f89000ce8a0 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905000640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89001585f0 0x7f8900154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8906400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f890015e790 0x7f8900151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8905a00640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89000ce8a0 0x7f89000b0c00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c500 tx=0x7f88f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:40.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f88fd600640 1 -- 172.21.15.114:0/2271949338 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4017070 con 0x7f89000ce8a0 2024-09-16T07:35:40.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f88fd600640 1 -- 172.21.15.114:0/2271949338 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88f40053c0 con 0x7f89000ce8a0 2024-09-16T07:35:40.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89000b1da0 con 0x7f89000ce8a0 2024-09-16T07:35:40.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f88fd600640 1 -- 172.21.15.114:0/2271949338 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4012890 con 0x7f89000ce8a0 2024-09-16T07:35:40.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.337+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89000b2360 con 0x7f89000ce8a0 2024-09-16T07:35:40.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.341+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8900068e70 con 0x7f89000ce8a0 2024-09-16T07:35:40.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.341+0000 7f88fd600640 1 -- 172.21.15.114:0/2271949338 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f88f401a070 con 0x7f89000ce8a0 2024-09-16T07:35:40.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.341+0000 7f88fd600640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88e0073580 0x7f88e0075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.341+0000 7f88fd600640 1 -- 172.21.15.114:0/2271949338 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f88f4093ea0 con 0x7f89000ce8a0 2024-09-16T07:35:40.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.341+0000 7f8905000640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88e0073580 0x7f88e0075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.345+0000 7f8905000640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88e0073580 0x7f88e0075a40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ae000 tx=0x7f88ec01b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:40.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.345+0000 7f88fd600640 1 -- 172.21.15.114:0/2271949338 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f88f405e570 con 0x7f89000ce8a0 2024-09-16T07:35:40.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.577+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f89000b5dd0 con 0x7f89000ce8a0 2024-09-16T07:35:40.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.581+0000 7f88fd600640 1 -- 172.21.15.114:0/2271949338 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7f88f405de70 con 0x7f89000ce8a0 2024-09-16T07:35:40.580 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:35:40.580 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:35:40.580 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:35:40.580 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:35:40.580 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:35:40.581 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:35:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88e0073580 msgr2=0x7f88e0075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88e0073580 0x7f88e0075a40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ae000 tx=0x7f88ec01b060 comp rx=0 tx=0).stop 2024-09-16T07:35:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89000ce8a0 msgr2=0x7f89000b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89000ce8a0 0x7f89000b0c00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c500 tx=0x7f88f400c9c0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 shutdown_connections 2024-09-16T07:35:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f890015e790 0x7f8900151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f88e0073580 0x7f88e0075a40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f89001585f0 0x7f8900154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 --2- 172.21.15.114:0/2271949338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89000ce8a0 0x7f89000b0c00 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 >> 172.21.15.114:0/2271949338 conn(0x7f89000cce90 msgr2=0x7f89000ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 shutdown_connections 2024-09-16T07:35:40.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.585+0000 7f8908400640 1 -- 172.21.15.114:0/2271949338 wait complete. 2024-09-16T07:35:40.602 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:40.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- 172.21.15.114:0/1146654840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c0b4bd0 msgr2=0x7f329c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 --2- 172.21.15.114:0/1146654840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c0b4bd0 0x7f329c0cf130 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f329c06aab0 tx=0x7f329401cb80 comp rx=0 tx=0).stop 2024-09-16T07:35:40.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- 172.21.15.114:0/1146654840 shutdown_connections 2024-09-16T07:35:40.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 --2- 172.21.15.114:0/1146654840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c0b4bd0 0x7f329c0cf130 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 --2- 172.21.15.114:0/1146654840 >> v2:172.21.15.149:3300/0 conn(0x7f329c15ade0 0x7f329c0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- 172.21.15.114:0/1146654840 >> 172.21.15.114:0/1146654840 conn(0x7f329c0b18f0 msgr2=0x7f329c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:40.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- 172.21.15.114:0/1146654840 shutdown_connections 2024-09-16T07:35:40.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- 172.21.15.114:0/1146654840 wait complete. 2024-09-16T07:35:40.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 Processor -- start 2024-09-16T07:35:40.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- start start 2024-09-16T07:35:40.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f329c06e810 0x7f329c0736d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0b4bd0 0x7f329c148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c15ade0 0x7f329c073f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f329c168080 con 0x7f329c15ade0 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f329c167f00 con 0x7f329c0b4bd0 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f32a1800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f329c168200 con 0x7f329c06e810 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f329b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c15ade0 0x7f329c073f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f329b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c15ade0 0x7f329c073f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57458/0 (socket says 172.21.15.114:57458) 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f329b400640 1 -- 172.21.15.114:0/3919346 learned_addr learned my addr 172.21.15.114:0/3919346 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f329a000640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0b4bd0 0x7f329c148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.749+0000 7f329aa00640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f329c06e810 0x7f329c0736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f329b400640 1 -- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f329c06e810 msgr2=0x7f329c0736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f329b400640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f329c06e810 0x7f329c0736d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f329b400640 1 -- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0b4bd0 msgr2=0x7f329c148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f329b400640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0b4bd0 0x7f329c148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f329b400640 1 -- 172.21.15.114:0/3919346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c073c10 con 0x7f329c15ade0 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f329aa00640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f329c06e810 0x7f329c0736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f329b400640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c15ade0 0x7f329c073f60 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f329401c5f0 tx=0x7f3294005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f3292a00640 1 -- 172.21.15.114:0/3919346 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940b2040 con 0x7f329c15ade0 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f3292a00640 1 -- 172.21.15.114:0/3919346 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32940bb070 con 0x7f329c15ade0 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f3292a00640 1 -- 172.21.15.114:0/3919346 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294004330 con 0x7f329c15ade0 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329c148b90 con 0x7f329c15ade0 2024-09-16T07:35:40.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329c072910 con 0x7f329c15ade0 2024-09-16T07:35:40.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329c15e900 con 0x7f329c15ade0 2024-09-16T07:35:40.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f3292a00640 1 -- 172.21.15.114:0/3919346 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f32940044d0 con 0x7f329c15ade0 2024-09-16T07:35:40.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f3292a00640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f327c0735b0 0x7f327c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:40.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.753+0000 7f3292a00640 1 -- 172.21.15.114:0/3919346 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f329412f260 con 0x7f329c15ade0 2024-09-16T07:35:40.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.757+0000 7f329aa00640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f327c0735b0 0x7f327c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:40.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.757+0000 7f329aa00640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f327c0735b0 0x7f327c075a70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f328c005fd0 tx=0x7f328c005f00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:40.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.757+0000 7f3292a00640 1 -- 172.21.15.114:0/3919346 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3294016770 con 0x7f329c15ade0 2024-09-16T07:35:40.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.961+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f329c0ce620 con 0x7f329c15ade0 2024-09-16T07:35:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.961+0000 7f3292a00640 1 -- 172.21.15.114:0/3919346 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5241 (secure 0 0 0) 0x7f32940f9b40 con 0x7f329c15ade0 2024-09-16T07:35:40.961 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:40.961 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":103,"btime":"2024-09-16T07:35:38:658904+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4246164040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4246164040},{"type":"v1","addr":"172.21.15.114:6833","nonce":4246164040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2023547758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":2023547758},{"type":"v1","addr":"172.21.15.149:6835","nonce":2023547758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8409,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/4110489344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":4110489344},{"type":"v1","addr":"172.21.15.149:6834","nonce":4110489344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:35:35.026388+0000","modified":"2024-09-16T07:35:38.048575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8415":{"gid":8415,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1141336969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1141336969},{"type":"v1","addr":"172.21.15.114:6835","nonce":1141336969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8415,"qdb_cluster":[8415]},"id":11}]} 2024-09-16T07:35:40.961 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 103 2024-09-16T07:35:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f327c0735b0 msgr2=0x7f327c075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f327c0735b0 0x7f327c075a70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f328c005fd0 tx=0x7f328c005f00 comp rx=0 tx=0).stop 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c15ade0 msgr2=0x7f329c073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c15ade0 0x7f329c073f60 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f329401c5f0 tx=0x7f3294005b00 comp rx=0 tx=0).stop 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 shutdown_connections 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f329c15ade0 0x7f329c073f60 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f329c0b4bd0 0x7f329c148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f327c0735b0 0x7f327c075a70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 --2- 172.21.15.114:0/3919346 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f329c06e810 0x7f329c0736d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 >> 172.21.15.114:0/3919346 conn(0x7f329c0b18f0 msgr2=0x7f329c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 shutdown_connections 2024-09-16T07:35:40.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:40.965+0000 7f32a1800640 1 -- 172.21.15.114:0/3919346 wait complete. 2024-09-16T07:35:41.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:35:35.026388+0000', 'modified': '2024-09-16T07:35:38.048575+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8415}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8415': {'gid': 8415, 'name': 'c', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/1141336969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 1141336969}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 1141336969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8415, 'qdb_cluster': [8415]} 2024-09-16T07:35:41.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:35:41.387 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T07:35:41.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d2e00640 1 -- 172.21.15.114:0/2214113188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0004d50 msgr2=0x7f50b00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d2e00640 1 --2- 172.21.15.114:0/2214113188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50b0004d50 0x7f50b00051d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c310 tx=0x7f50c401f720 comp rx=0 tx=0).stop 2024-09-16T07:35:41.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d0e00640 1 -- 172.21.15.114:0/2214113188 reap_dead start 2024-09-16T07:35:41.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d2e00640 1 -- 172.21.15.114:0/2214113188 shutdown_connections 2024-09-16T07:35:41.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d2e00640 1 -- 172.21.15.114:0/2214113188 >> 172.21.15.114:0/2214113188 conn(0x7f50cc0d1ea0 msgr2=0x7f50cc0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d2e00640 1 -- 172.21.15.114:0/2214113188 shutdown_connections 2024-09-16T07:35:41.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d2e00640 1 -- 172.21.15.114:0/2214113188 wait complete. 2024-09-16T07:35:41.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.533+0000 7f50d2e00640 1 Processor -- start 2024-09-16T07:35:41.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 -- start start 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50b0004d50 0x7f50cc09f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50cc0c7480 0x7f50cc0b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50cc0b5210 0x7f50cc159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc0ceeb0 con 0x7f50cc0c7480 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc0ced30 con 0x7f50cc0b5210 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50cc0cdd60 con 0x7f50b0004d50 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50cc0c7480 0x7f50cc0b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50cc0c7480 0x7f50cc0b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57464/0 (socket says 172.21.15.114:57464) 2024-09-16T07:35:41.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 -- 172.21.15.114:0/2660644096 learned_addr learned my addr 172.21.15.114:0/2660644096 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50cbe00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50b0004d50 0x7f50cc09f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d0e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50cc0b5210 0x7f50cc159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 -- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50b0004d50 msgr2=0x7f50cc09f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50b0004d50 0x7f50cc09f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 -- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50cc0b5210 msgr2=0x7f50cc159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50cc0b5210 0x7f50cc159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 -- 172.21.15.114:0/2660644096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc0b5720 con 0x7f50cc0c7480 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50cbe00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50b0004d50 0x7f50cc09f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d0e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50cc0b5210 0x7f50cc159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c3400640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50cc0c7480 0x7f50cc0b4cd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f50b4011ab0 tx=0x7f50b4011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c8c00640 1 -- 172.21.15.114:0/2660644096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b401f070 con 0x7f50cc0c7480 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c8c00640 1 -- 172.21.15.114:0/2660644096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b4012450 con 0x7f50cc0c7480 2024-09-16T07:35:41.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50cc0b5a00 con 0x7f50cc0c7480 2024-09-16T07:35:41.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50c8c00640 1 -- 172.21.15.114:0/2660644096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b40128a0 con 0x7f50cc0c7480 2024-09-16T07:35:41.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.537+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50cc09eaf0 con 0x7f50cc0c7480 2024-09-16T07:35:41.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c8c00640 1 -- 172.21.15.114:0/2660644096 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f50b4022070 con 0x7f50cc0c7480 2024-09-16T07:35:41.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c8c00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a8073580 0x7f50a8075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 Processor -- start 2024-09-16T07:35:41.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c8c00640 1 -- 172.21.15.114:0/2660644096 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f50b4095550 con 0x7f50cc0c7480 2024-09-16T07:35:41.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 -- start start 2024-09-16T07:35:41.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a8073580 0x7f50a8075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a8073580 0x7f50a8075a40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009fd0 tx=0x7f50bc009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd39d0 0x55a0cabd3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd42f0 0x55a0cab878d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cab881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a0caaa83f0 con 0x55a0cabd39d0 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a0ca9e5b20 con 0x55a0cab87e10 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55a0ca9d4f50 con 0x55a0cabd42f0 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd39d0 0x55a0cabd3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd39d0 0x55a0cabd3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57466/0 (socket says 172.21.15.114:57466) 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 -- 172.21.15.114:0/2995767142 learned_addr learned my addr 172.21.15.114:0/2995767142 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50d0e00640 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cab881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c3400640 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd42f0 0x55a0cab878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 -- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd42f0 msgr2=0x55a0cab878d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd42f0 0x55a0cab878d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 -- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 msgr2=0x55a0cab881f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cab881f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 -- 172.21.15.114:0/2995767142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ca99c590 con 0x55a0cabd39d0 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c3400640 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd42f0 0x55a0cab878d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50cbe00640 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd39d0 0x55a0cabd3db0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009b60 tx=0x7f50bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1206c129aacc66a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c0c00640 1 -- 172.21.15.114:0/2995767142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc004d30 con 0x55a0cabd39d0 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c0c00640 1 -- 172.21.15.114:0/2995767142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50bc005020 con 0x55a0cabd39d0 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.541+0000 7f50c0c00640 1 -- 172.21.15.114:0/2995767142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc005430 con 0x55a0cabd39d0 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- 172.21.15.114:0/2995767142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd39d0 msgr2=0x55a0cabd3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd39d0 0x55a0cabd3db0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009b60 tx=0x7f50bc015000 comp rx=0 tx=0).stop 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- 172.21.15.114:0/2995767142 shutdown_connections 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cab881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd42f0 0x55a0cab878d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 --2- 172.21.15.114:0/2995767142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd39d0 0x55a0cabd3db0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- 172.21.15.114:0/2995767142 >> 172.21.15.114:0/2995767142 conn(0x55a0caa71130 msgr2=0x55a0cabb6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- 172.21.15.114:0/2995767142 shutdown_connections 2024-09-16T07:35:41.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- 172.21.15.114:0/2995767142 wait complete. 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- start start 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 Processor -- start 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cab87e10 0x55a0cab89240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd39d0 0x55a0cab89780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cab89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a0ca96f5d0 con 0x55a0cabd42f0 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a0ca9d8d60 con 0x55a0cabd39d0 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55a0ca97b500 con 0x55a0cab87e10 2024-09-16T07:35:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 10 client.0 _ll_register_callbacks cb 0x55a0ca97f810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cab89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50c3400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd39d0 0x55a0cab89780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cab89cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57472/0 (socket says 172.21.15.114:57472) 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 -- 172.21.15.114:0/3101221953 learned_addr learned my addr 172.21.15.114:0/3101221953 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50cbe00640 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cab87e10 0x55a0cab89240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 -- 172.21.15.114:0/3101221953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cab87e10 msgr2=0x55a0cab89240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cab87e10 0x55a0cab89240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 -- 172.21.15.114:0/3101221953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd39d0 msgr2=0x55a0cab89780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd39d0 0x55a0cab89780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 -- 172.21.15.114:0/3101221953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ca973170 con 0x55a0cabd42f0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d0e00640 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cab89cc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f50c401de20 tx=0x7f50c4001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8c7ae463814225 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50b9600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50b9600640 1 -- 172.21.15.114:0/3101221953 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c40c0060 con 0x55a0cabd42f0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0ca96d0f0 con 0x55a0cabd42f0 2024-09-16T07:35:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50b9600640 1 -- 172.21.15.114:0/3101221953 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f50c4006090 con 0x55a0cabd42f0 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.545+0000 7f50b9600640 1 -- 172.21.15.114:0/3101221953 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f50c40b2040 con 0x55a0cabd42f0 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 10 client.8532 fetch_fsmap learned FSMap version 103 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55a0caa59ef0 con 0x55a0cabd42f0 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50b9600640 1 -- 172.21.15.114:0/3101221953 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a0ca96d0f0 con 0x55a0cabd42f0 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50b9600640 1 -- 172.21.15.114:0/3101221953 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f50c40ac070 con 0x55a0cabd42f0 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 10 client.8532 fetch_fsmap finished waiting for FSMap version 103 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 10 client.8532 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 20 client.8532 populate_metadata read hostname 'smithi114' 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cabe2c70 0x55a0cabe5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 4 client.8532 mds_command: new command op to 8415 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 --> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0ca9e7a70 con 0x55a0cabe2c70 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50cbe00640 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cabe2c70 0x55a0cabe5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50cbe00640 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cabe2c70 0x55a0cabe5060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8b31e2c8c3a4902 server_cookie=ab2e86d24a732b7b in_seq=0 out_seq=0 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50b9600640 10 client.8532 ms_handle_connect on v2:172.21.15.114:6834/1141336969 2024-09-16T07:35:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50b9600640 1 -- 172.21.15.114:0/3101221953 <== mds.0 v2:172.21.15.114:6834/1141336969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0ca9e7a70 con 0x55a0cabe2c70 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50b9600640 10 client.8532 handle_command_reply: tid=0 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 client.8532 shutdown 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 msgr2=0x55a0cab89cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cab89cc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f50c401de20 tx=0x7f50c4001ce0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 shutdown_connections 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cabe2c70 0x55a0cabe5060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cab89cc0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd39d0 0x55a0cab89780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 --2- 172.21.15.114:0/3101221953 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cab87e10 0x55a0cab89240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50b9600640 0 client.8532 ms_handle_reset on v2:172.21.15.114:6834/1141336969 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 >> 172.21.15.114:0/3101221953 conn(0x55a0caa71130 msgr2=0x55a0cab86fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 shutdown_connections 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 1 -- 172.21.15.114:0/3101221953 wait complete. 2024-09-16T07:35:41.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.549+0000 7f50d6124000 20 client.8532 trim_cache size 0 max 16384 2024-09-16T07:35:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 Processor -- start 2024-09-16T07:35:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- start start 2024-09-16T07:35:41.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cab87e10 0x55a0cac453c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 0x55a0cac45900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd42f0 0x55a0cac45e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc1f8510 con 0x55a0cab87e10 2024-09-16T07:35:41.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc1e5e30 con 0x55a0cabd42f0 2024-09-16T07:35:41.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50cc1f7ec0 con 0x55a0cabd39d0 2024-09-16T07:35:41.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cab87e10 0x55a0cac453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cab87e10 0x55a0cac453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57474/0 (socket says 172.21.15.114:57474) 2024-09-16T07:35:41.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 -- 172.21.15.114:0/4091364451 learned_addr learned my addr 172.21.15.114:0/4091364451 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 -- 172.21.15.114:0/4091364451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 msgr2=0x55a0cac45900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 --2- 172.21.15.114:0/4091364451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 0x55a0cac45900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 -- 172.21.15.114:0/4091364451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd42f0 msgr2=0x55a0cac45e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 --2- 172.21.15.114:0/4091364451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd42f0 0x55a0cac45e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 -- 172.21.15.114:0/4091364451 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0caa30d90 con 0x55a0cab87e10 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50cbe00640 1 --2- 172.21.15.114:0/4091364451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cab87e10 0x55a0cac453c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f50bc004410 tx=0x7f50bc004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf38f5906c22be9b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50bbe00640 1 -- 172.21.15.114:0/4091364451 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc004d30 con 0x55a0cab87e10 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50bbe00640 1 -- 172.21.15.114:0/4091364451 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50bc01b720 con 0x55a0cab87e10 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50bbe00640 1 -- 172.21.15.114:0/4091364451 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc01bb70 con 0x55a0cab87e10 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- 172.21.15.114:0/4091364451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cab87e10 msgr2=0x55a0cac453c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 --2- 172.21.15.114:0/4091364451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cab87e10 0x55a0cac453c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f50bc004410 tx=0x7f50bc004a50 comp rx=0 tx=0).stop 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- 172.21.15.114:0/4091364451 shutdown_connections 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 --2- 172.21.15.114:0/4091364451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cabd42f0 0x55a0cac45e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 --2- 172.21.15.114:0/4091364451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 0x55a0cac45900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 --2- 172.21.15.114:0/4091364451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cab87e10 0x55a0cac453c0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- 172.21.15.114:0/4091364451 >> 172.21.15.114:0/4091364451 conn(0x55a0caa71130 msgr2=0x55a0cabeae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- 172.21.15.114:0/4091364451 shutdown_connections 2024-09-16T07:35:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.569+0000 7f50d6124000 1 -- 172.21.15.114:0/4091364451 wait complete. 2024-09-16T07:35:41.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 -- start start 2024-09-16T07:35:41.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 Processor -- start 2024-09-16T07:35:41.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cabe9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 0x55a0cac05580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cac05ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55a0ca9d8070 con 0x55a0cabd42f0 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a0ca9dd390 con 0x55a0cab87e10 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55a0ca9e48f0 con 0x55a0cabd39d0 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 10 client.0 _ll_register_callbacks cb 0x7f50c40b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cac05ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cac05ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57476/0 (socket says 172.21.15.114:57476) 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 -- 172.21.15.114:0/4184037469 learned_addr learned my addr 172.21.15.114:0/4184037469 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50cbe00640 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cabe9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50c3400640 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 0x55a0cac05580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 -- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 msgr2=0x55a0cac05580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 0x55a0cac05580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 -- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 msgr2=0x55a0cabe9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cabe9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 -- 172.21.15.114:0/4184037469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ca99ba90 con 0x55a0cabd42f0 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d0e00640 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cac05ac0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f50c401f990 tx=0x7f50c40a8fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ae63cb8f7c5b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50b9600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50b9600640 1 -- 172.21.15.114:0/4184037469 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c40d1060 con 0x55a0cabd42f0 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50b9600640 1 -- 172.21.15.114:0/4184037469 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f50c4006090 con 0x55a0cabd42f0 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50bc01b720 con 0x55a0cabd42f0 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50b9600640 1 -- 172.21.15.114:0/4184037469 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f50c40c6020 con 0x55a0cabd42f0 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 10 client.8538 fetch_fsmap learned FSMap version 103 2024-09-16T07:35:41.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55a0ca97a050 con 0x55a0cabd42f0 2024-09-16T07:35:41.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50b9600640 1 -- 172.21.15.114:0/4184037469 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50bc01b720 con 0x55a0cabd42f0 2024-09-16T07:35:41.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50b9600640 1 -- 172.21.15.114:0/4184037469 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 103) ==== 3502+0+0 (secure 0 0 0) 0x7f50c40ac040 con 0x55a0cabd42f0 2024-09-16T07:35:41.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 10 client.8538 fetch_fsmap finished waiting for FSMap version 103 2024-09-16T07:35:41.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 10 client.8538 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:35:41.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 20 client.8538 populate_metadata read hostname 'smithi114' 2024-09-16T07:35:41.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cac06000 0x55a0cac49610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 4 client.8538 mds_command: new command op to 8415 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 --> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] -- command(tid 0: {"prefix": "status"}) -- 0x55a0ca9e3520 con 0x55a0cac06000 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.573+0000 7f50cbe00640 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cac06000 0x55a0cac49610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50cbe00640 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cac06000 0x55a0cac49610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cefa0439447209eb server_cookie=815a9c30c22047bf in_seq=0 out_seq=0 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50b9600640 10 client.8538 ms_handle_connect on v2:172.21.15.114:6834/1141336969 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50b9600640 1 -- 172.21.15.114:0/4184037469 <== mds.0 v2:172.21.15.114:6834/1141336969 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55a0ca9e3520 con 0x55a0cac06000 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50b9600640 10 client.8538 handle_command_reply: tid=0 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 client.8538 shutdown 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 msgr2=0x55a0cac05ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cac05ac0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f50c401f990 tx=0x7f50c40a8fe0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 shutdown_connections 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:6834/1141336969,v1:172.21.15.114:6835/1141336969] conn(0x55a0cac06000 0x55a0cac49610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a0cabd42f0 0x55a0cac05ac0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a0cabd39d0 0x55a0cac05580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 --2- 172.21.15.114:0/4184037469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a0cab87e10 0x55a0cabe9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 >> 172.21.15.114:0/4184037469 conn(0x55a0caa71130 msgr2=0x55a0cab87470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50b9600640 0 client.8538 ms_handle_reset on v2:172.21.15.114:6834/1141336969 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 shutdown_connections 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 1 -- 172.21.15.114:0/4184037469 wait complete. 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d6124000 20 client.8538 trim_cache size 0 max 16384 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 8415, 2024-09-16T07:35:41.578 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 5.9477912740000001, 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 103, 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 141, 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 141, 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 11.500069521 2024-09-16T07:35:41.579 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a8073580 msgr2=0x7f50a8075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a8073580 0x7f50a8075a40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009fd0 tx=0x7f50bc009500 comp rx=0 tx=0).stop 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50cc0c7480 msgr2=0x7f50cc0b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50cc0c7480 0x7f50cc0b4cd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f50b4011ab0 tx=0x7f50b4011f70 comp rx=0 tx=0).stop 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 shutdown_connections 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f50cc0b5210 0x7f50cc159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50cc0c7480 0x7f50cc0b4cd0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f50a8073580 0x7f50a8075a40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 --2- 172.21.15.114:0/2660644096 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50b0004d50 0x7f50cc09f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 >> 172.21.15.114:0/2660644096 conn(0x7f50cc0d1ea0 msgr2=0x7f50cc15aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 shutdown_connections 2024-09-16T07:35:41.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.577+0000 7f50d2e00640 1 -- 172.21.15.114:0/2660644096 wait complete. 2024-09-16T07:35:41.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:35:41.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 -- 172.21.15.114:0/3606401498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40cdb30 msgr2=0x7f1ba40aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 --2- 172.21.15.114:0/3606401498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40cdb30 0x7f1ba40aeef0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40cc3a0 tx=0x7f1b9c01cb80 comp rx=0 tx=0).stop 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 -- 172.21.15.114:0/3606401498 shutdown_connections 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 --2- 172.21.15.114:0/3606401498 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40cdb30 0x7f1ba40aeef0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 --2- 172.21.15.114:0/3606401498 >> v2:172.21.15.149:3300/0 conn(0x7f1ba40ced80 0x7f1ba40ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 -- 172.21.15.114:0/3606401498 >> 172.21.15.114:0/3606401498 conn(0x7f1ba40d1dc0 msgr2=0x7f1ba40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 -- 172.21.15.114:0/3606401498 shutdown_connections 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.737+0000 7f1baae00640 1 -- 172.21.15.114:0/3606401498 wait complete. 2024-09-16T07:35:41.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 Processor -- start 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 -- start start 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba40cdb30 0x7f1ba414d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40ced80 0x7f1ba40cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba415bea0 0x7f1ba40cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba41692f0 con 0x7f1ba40ced80 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba4169170 con 0x7f1ba40cdb30 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba4169470 con 0x7f1ba415bea0 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40ced80 0x7f1ba40cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40ced80 0x7f1ba40cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57498/0 (socket says 172.21.15.114:57498) 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 -- 172.21.15.114:0/3327057625 learned_addr learned my addr 172.21.15.114:0/3327057625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1ba8e00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba415bea0 0x7f1ba40cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1ba3e00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba40cdb30 0x7f1ba414d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 -- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba415bea0 msgr2=0x7f1ba40cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba415bea0 0x7f1ba40cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 -- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba40cdb30 msgr2=0x7f1ba414d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba40cdb30 0x7f1ba414d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 -- 172.21.15.114:0/3327057625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba415a790 con 0x7f1ba40ced80 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1b9b400640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40ced80 0x7f1ba40cb060 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00e9f0 tx=0x7f1b8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1ba0c00640 1 -- 172.21.15.114:0/3327057625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00cd80 con 0x7f1ba40ced80 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1ba0c00640 1 -- 172.21.15.114:0/3327057625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b8c010430 con 0x7f1ba40ced80 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba41fbcd0 con 0x7f1ba40ced80 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1ba0c00640 1 -- 172.21.15.114:0/3327057625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c010860 con 0x7f1ba40ced80 2024-09-16T07:35:41.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba41f7f80 con 0x7f1ba40ced80 2024-09-16T07:35:41.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.741+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba40d2520 con 0x7f1ba40ced80 2024-09-16T07:35:41.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.745+0000 7f1ba0c00640 1 -- 172.21.15.114:0/3327057625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f1b8c010a00 con 0x7f1ba40ced80 2024-09-16T07:35:41.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.745+0000 7f1ba0c00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b80073580 0x7f1b80075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:41.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.745+0000 7f1ba0c00640 1 -- 172.21.15.114:0/3327057625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f1b8c0956c0 con 0x7f1ba40ced80 2024-09-16T07:35:41.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.745+0000 7f1ba3e00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b80073580 0x7f1b80075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:41.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.745+0000 7f1ba3e00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b80073580 0x7f1b80075a40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1b94000f70 tx=0x7f1b94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:41.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.749+0000 7f1ba0c00640 1 -- 172.21.15.114:0/3327057625 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1ba415a790 con 0x7f1ba40ced80 2024-09-16T07:35:41.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.949+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1ba40d2240 con 0x7f1ba40ced80 2024-09-16T07:35:41.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.949+0000 7f1ba0c00640 1 -- 172.21.15.114:0/3327057625 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v103) ==== 53+0+73 (secure 0 0 0) 0x7f1b8c05ff10 con 0x7f1ba40ced80 2024-09-16T07:35:41.950 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b80073580 msgr2=0x7f1b80075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b80073580 0x7f1b80075a40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1b94000f70 tx=0x7f1b94009040 comp rx=0 tx=0).stop 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40ced80 msgr2=0x7f1ba40cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40ced80 0x7f1ba40cb060 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00e9f0 tx=0x7f1b8c00eeb0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 shutdown_connections 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b80073580 0x7f1b80075a40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ba415bea0 0x7f1ba40cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ba40ced80 0x7f1ba40cb060 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 --2- 172.21.15.114:0/3327057625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ba40cdb30 0x7f1ba414d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:41.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 >> 172.21.15.114:0/3327057625 conn(0x7f1ba40d1dc0 msgr2=0x7f1ba406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:41.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 shutdown_connections 2024-09-16T07:35:41.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:41.953+0000 7f1baae00640 1 -- 172.21.15.114:0/3327057625 wait complete. 2024-09-16T07:35:41.970 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:35:41.970 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:35:41.970 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:35:41.971 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:35:41.971 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:41.971 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:35:41.971 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:35:41.971 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:35:41.971 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:35:41.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:41.971 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:35:41.980 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:41.981 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41999sec preferred_lft 41999sec 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:41.982 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:35:41.983 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:41.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:41.984 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:35:42.038 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:35:42.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:42.041 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:35:42.093 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:35:42.093 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:35:42.093 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:35:42.093 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:35:42.093 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:35:42.094 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:35:42.094 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:35:42.094 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:42.094 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:42.094 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:42.094 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:35:42.094 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:35:42.094 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:35:42.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:35:42.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:35:42.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:35:42.095 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:35:42.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:35:42.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:42.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:42.230 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:35:42.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:35:42.282 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:35:42.282 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:35:42.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:42.282 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:35:42.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:42.349 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:42.397 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:35:42.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:42.397 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:42.448 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:35:42.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:42.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:42.540 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:42.540 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:35:42.541 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:35:42.556 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:42.556 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:35:42.556 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:35:42.556 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:42.556 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:35:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:35:42.569 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:35:42.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:42.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:42.589 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:35:42.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:35:42.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:42.696 INFO:teuthology.orchestra.run.smithi114.stdout:client8550 2024-09-16T07:35:42.697 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:42.697 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:42.706 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:35:42.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- 172.21.15.114:0/2366077435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f60164c60 msgr2=0x7f6f60167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:42.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2366077435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f60164c60 0x7f6f60167050 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009bc0 tx=0x7f6f5801cae0 comp rx=0 tx=0).stop 2024-09-16T07:35:42.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- 172.21.15.114:0/2366077435 shutdown_connections 2024-09-16T07:35:42.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2366077435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f60164c60 0x7f6f60167050 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:42.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- 172.21.15.114:0/2366077435 >> 172.21.15.114:0/2366077435 conn(0x7f6f600d1e30 msgr2=0x7f6f600d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:42.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- 172.21.15.114:0/2366077435 shutdown_connections 2024-09-16T07:35:42.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- 172.21.15.114:0/2366077435 wait complete. 2024-09-16T07:35:42.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 Processor -- start 2024-09-16T07:35:42.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- start start 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f600b2e80 0x7f6f60159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f6015f490 0x7f6f601573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f60164c60 0x7f6f600d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60169f30 con 0x7f6f6015f490 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60169db0 con 0x7f6f60164c60 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f64c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6016a0b0 con 0x7f6f600b2e80 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f6015f490 0x7f6f601573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f6015f490 0x7f6f601573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57526/0 (socket says 172.21.15.114:57526) 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f5de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f600b2e80 0x7f6f60159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:42.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 -- 172.21.15.114:0/2363009716 learned_addr learned my addr 172.21.15.114:0/2363009716 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f5e800640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f60164c60 0x7f6f600d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 -- 172.21.15.114:0/2363009716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f600b2e80 msgr2=0x7f6f60159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f600b2e80 0x7f6f60159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 -- 172.21.15.114:0/2363009716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f60164c60 msgr2=0x7f6f600d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f60164c60 0x7f6f600d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 -- 172.21.15.114:0/2363009716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f600ccd10 con 0x7f6f6015f490 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.897+0000 7f6f55400640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f6015f490 0x7f6f601573d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800c480 tx=0x7f6f4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f56a00640 1 -- 172.21.15.114:0/2363009716 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48016020 con 0x7f6f6015f490 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f56a00640 1 -- 172.21.15.114:0/2363009716 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f48012920 con 0x7f6f6015f490 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f56a00640 1 -- 172.21.15.114:0/2363009716 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48012d70 con 0x7f6f6015f490 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f600ccff0 con 0x7f6f6015f490 2024-09-16T07:35:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f60157910 con 0x7f6f6015f490 2024-09-16T07:35:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f600b1c80 con 0x7f6f6015f490 2024-09-16T07:35:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f56a00640 1 -- 172.21.15.114:0/2363009716 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f6f48019020 con 0x7f6f6015f490 2024-09-16T07:35:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f56a00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c0735b0 0x7f6f3c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f56a00640 1 -- 172.21.15.114:0/2363009716 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f6f48094a60 con 0x7f6f6015f490 2024-09-16T07:35:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.901+0000 7f6f5de00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c0735b0 0x7f6f3c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.905+0000 7f6f5de00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c0735b0 0x7f6f3c075a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007fd0 tx=0x7f6f50007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:42.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:42.905+0000 7f6f56a00640 1 -- 172.21.15.114:0/2363009716 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6f48020020 con 0x7f6f6015f490 2024-09-16T07:35:43.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.109+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6f6015a260 con 0x7f6f6015f490 2024-09-16T07:35:43.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.109+0000 7f6f56a00640 1 -- 172.21.15.114:0/2363009716 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v103) ==== 53+0+73 (secure 0 0 0) 0x7f6f4805eb60 con 0x7f6f6015f490 2024-09-16T07:35:43.107 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c0735b0 msgr2=0x7f6f3c075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c0735b0 0x7f6f3c075a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f50007fd0 tx=0x7f6f50007e40 comp rx=0 tx=0).stop 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f6015f490 msgr2=0x7f6f601573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f6015f490 0x7f6f601573d0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800c480 tx=0x7f6f4800c940 comp rx=0 tx=0).stop 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 shutdown_connections 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f60164c60 0x7f6f600d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f6015f490 0x7f6f601573d0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f3c0735b0 0x7f6f3c075a70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:43.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 --2- 172.21.15.114:0/2363009716 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f600b2e80 0x7f6f60159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:43.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 >> 172.21.15.114:0/2363009716 conn(0x7f6f600d1e30 msgr2=0x7f6f60071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:43.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 shutdown_connections 2024-09-16T07:35:43.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.113+0000 7f6f64c00640 1 -- 172.21.15.114:0/2363009716 wait complete. 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:35:43.129 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:35:43.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:43.130 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:35:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:35:43.140 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:35:43.140 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:35:43.140 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.140 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:35:43.140 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.140 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42007sec preferred_lft 42007sec 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:35:43.141 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.142 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:35:43.143 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:35:43.143 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:35:43.143 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:35:43.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:43.144 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:35:43.210 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:35:43.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:43.212 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:35:43.271 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:35:43.271 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:35:43.272 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:35:43.273 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:35:43.273 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:35:43.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:35:43.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:35:43.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:35:43.273 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:35:43.371 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:35:43.414 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:43.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:43.421 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:35:43.431 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:35:43.431 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:35:43.431 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:35:43.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:43.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:35:43.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:43.494 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:43.542 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:35:43.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:35:43.542 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:43.593 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:35:43.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:43.594 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:43.687 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:43.688 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:35:43.688 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:35:43.704 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:43.704 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:35:43.704 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:35:43.704 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:43.704 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:43.712 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:35:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:35:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:35:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:35:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:35:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:35:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:35:43.713 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:35:43.716 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:35:43.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:43.717 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:43.737 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:35:43.829 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:35:43.832 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:35:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:43.838 INFO:teuthology.orchestra.run.smithi149.stdout:client7106 2024-09-16T07:35:43.838 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:43.838 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:43.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:35:43.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 -- 172.21.15.114:0/3773244329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb270006330 msgr2=0x7fb27000cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 --2- 172.21.15.114:0/3773244329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb270006330 0x7fb27000cae0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0768c0 tx=0x7fb28401d5b0 comp rx=0 tx=0).stop 2024-09-16T07:35:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 -- 172.21.15.114:0/3773244329 shutdown_connections 2024-09-16T07:35:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 --2- 172.21.15.114:0/3773244329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb270006330 0x7fb27000cae0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 -- 172.21.15.114:0/3773244329 >> 172.21.15.114:0/3773244329 conn(0x7fb28c0cfbc0 msgr2=0x7fb28c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 -- 172.21.15.114:0/3773244329 shutdown_connections 2024-09-16T07:35:43.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 -- 172.21.15.114:0/3773244329 wait complete. 2024-09-16T07:35:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 Processor -- start 2024-09-16T07:35:43.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:43.997+0000 7fb293200640 1 -- start start 2024-09-16T07:35:43.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb270006330 0x7fb28c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:43.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb28c1f8dc0 0x7fb28c153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:43.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb28c1f4bc0 0x7fb28c06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:43.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c0cf8e0 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c0cf760 con 0x7fb270006330 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c0cdac0 con 0x7fb28c1f8dc0 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb28c1f4bc0 0x7fb28c06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb28c1f4bc0 0x7fb28c06f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57540/0 (socket says 172.21.15.114:57540) 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 -- 172.21.15.114:0/1910797413 learned_addr learned my addr 172.21.15.114:0/1910797413 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb283400640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb28c1f8dc0 0x7fb28c153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb28be00640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb270006330 0x7fb28c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 -- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb28c1f8dc0 msgr2=0x7fb28c153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb28c1f8dc0 0x7fb28c153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 -- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb270006330 msgr2=0x7fb28c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb270006330 0x7fb28c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 -- 172.21.15.114:0/1910797413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c09c160 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb291200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb28c1f4bc0 0x7fb28c06f5c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb28401d020 tx=0x7fb284009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb288c00640 1 -- 172.21.15.114:0/1910797413 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2840ae030 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb288c00640 1 -- 172.21.15.114:0/1910797413 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2840ba070 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb288c00640 1 -- 172.21.15.114:0/1910797413 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284004390 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c1f5480 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c1f5a40 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28c069410 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.001+0000 7fb288c00640 1 -- 172.21.15.114:0/1910797413 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fb284004530 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.005+0000 7fb288c00640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb2680735b0 0x7fb268075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.005+0000 7fb288c00640 1 -- 172.21.15.114:0/1910797413 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fb28412fc30 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.005+0000 7fb28be00640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb2680735b0 0x7fb268075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.005+0000 7fb28be00640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb2680735b0 0x7fb268075a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000c10 tx=0x7fb27c006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:44.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.009+0000 7fb288c00640 1 -- 172.21.15.114:0/1910797413 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb2840172c0 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.209+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb28c0ce020 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.681+0000 7fb288c00640 1 -- 172.21.15.114:0/1910797413 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v104) ==== 136+0+0 (secure 0 0 0) 0x7fb2840fa3f0 con 0x7fb28c1f4bc0 2024-09-16T07:35:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb2680735b0 msgr2=0x7fb268075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb2680735b0 0x7fb268075a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000c10 tx=0x7fb27c006b80 comp rx=0 tx=0).stop 2024-09-16T07:35:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb28c1f4bc0 msgr2=0x7fb28c06f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb28c1f4bc0 0x7fb28c06f5c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb28401d020 tx=0x7fb284009b30 comp rx=0 tx=0).stop 2024-09-16T07:35:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 shutdown_connections 2024-09-16T07:35:44.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb28c1f4bc0 0x7fb28c06f5c0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb2680735b0 0x7fb268075a70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb28c1f8dc0 0x7fb28c153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 --2- 172.21.15.114:0/1910797413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb270006330 0x7fb28c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 >> 172.21.15.114:0/1910797413 conn(0x7fb28c0cfbc0 msgr2=0x7fb28c154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 shutdown_connections 2024-09-16T07:35:44.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.685+0000 7fb293200640 1 -- 172.21.15.114:0/1910797413 wait complete. 2024-09-16T07:35:44.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:35:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- 172.21.15.114:0/4040136127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c15dae0 msgr2=0x7fb87c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 --2- 172.21.15.114:0/4040136127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c15dae0 0x7fb87c0acd40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a950 tx=0x7fb87001dae0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- 172.21.15.114:0/4040136127 shutdown_connections 2024-09-16T07:35:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 --2- 172.21.15.114:0/4040136127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb87c0b49e0 0x7fb87c06f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 --2- 172.21.15.114:0/4040136127 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c15dae0 0x7fb87c0acd40 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- 172.21.15.114:0/4040136127 >> 172.21.15.114:0/4040136127 conn(0x7fb87c0b18f0 msgr2=0x7fb87c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- 172.21.15.114:0/4040136127 shutdown_connections 2024-09-16T07:35:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- 172.21.15.114:0/4040136127 wait complete. 2024-09-16T07:35:44.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 Processor -- start 2024-09-16T07:35:44.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- start start 2024-09-16T07:35:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb87c0b49e0 0x7fb87c162e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c0cd100 0x7fb87c1637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb87c15dae0 0x7fb87c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c0cf230 con 0x7fb87c0cd100 2024-09-16T07:35:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c0cf0b0 con 0x7fb87c15dae0 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb884200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb87c0cf3b0 con 0x7fb87c0b49e0 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb880e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c0cd100 0x7fb87c1637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb880e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c0cd100 0x7fb87c1637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38374/0 (socket says 172.21.15.114:38374) 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb880e00640 1 -- 172.21.15.114:0/4002788255 learned_addr learned my addr 172.21.15.114:0/4002788255 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb881800640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb87c0b49e0 0x7fb87c162e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.861+0000 7fb882200640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb87c15dae0 0x7fb87c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb880e00640 1 -- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb87c0b49e0 msgr2=0x7fb87c162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb880e00640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb87c0b49e0 0x7fb87c162e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb880e00640 1 -- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb87c15dae0 msgr2=0x7fb87c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb880e00640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb87c15dae0 0x7fb87c152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb880e00640 1 -- 172.21.15.114:0/4002788255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87c15c410 con 0x7fb87c0cd100 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb881800640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb87c0b49e0 0x7fb87c162e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:35:44.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb880e00640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c0cd100 0x7fb87c1637c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c450 tx=0x7fb86800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb879600640 1 -- 172.21.15.114:0/4002788255 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868011790 con 0x7fb87c0cd100 2024-09-16T07:35:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb879600640 1 -- 172.21.15.114:0/4002788255 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb868017070 con 0x7fb87c0cd100 2024-09-16T07:35:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87c15c6f0 con 0x7fb87c0cd100 2024-09-16T07:35:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb879600640 1 -- 172.21.15.114:0/4002788255 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868011cc0 con 0x7fb87c0cd100 2024-09-16T07:35:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb87c1529b0 con 0x7fb87c0cd100 2024-09-16T07:35:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb87c069410 con 0x7fb87c0cd100 2024-09-16T07:35:44.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.865+0000 7fb879600640 1 -- 172.21.15.114:0/4002788255 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fb86801c460 con 0x7fb87c0cd100 2024-09-16T07:35:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.869+0000 7fb879600640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb85c073580 0x7fb85c075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.869+0000 7fb879600640 1 -- 172.21.15.114:0/4002788255 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fb8680950f0 con 0x7fb87c0cd100 2024-09-16T07:35:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.869+0000 7fb881800640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb85c073580 0x7fb85c075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.869+0000 7fb881800640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb85c073580 0x7fb85c075a40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb8700b0000 tx=0x7fb87001c320 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:44.869+0000 7fb879600640 1 -- 172.21.15.114:0/4002788255 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb86805f400 con 0x7fb87c0cd100 2024-09-16T07:35:45.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.061+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fb87c0acd40 con 0x7fb85c073580 2024-09-16T07:35:45.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.061+0000 7fb879600640 1 -- 172.21.15.114:0/4002788255 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fb87c0acd40 con 0x7fb85c073580 2024-09-16T07:35:45.060 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:35:45.060 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:35:45.060 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:35:45.060 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:35:45.060 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:35:45.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb85c073580 msgr2=0x7fb85c075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb85c073580 0x7fb85c075a40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb8700b0000 tx=0x7fb87001c320 comp rx=0 tx=0).stop 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c0cd100 msgr2=0x7fb87c1637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c0cd100 0x7fb87c1637c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c450 tx=0x7fb86800c910 comp rx=0 tx=0).stop 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 shutdown_connections 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb87c15dae0 0x7fb87c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb87c0cd100 0x7fb87c1637c0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb85c073580 0x7fb85c075a40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 --2- 172.21.15.114:0/4002788255 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb87c0b49e0 0x7fb87c162e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 >> 172.21.15.114:0/4002788255 conn(0x7fb87c0b18f0 msgr2=0x7fb87c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 shutdown_connections 2024-09-16T07:35:45.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.065+0000 7fb884200640 1 -- 172.21.15.114:0/4002788255 wait complete. 2024-09-16T07:35:45.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:35:45.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 -- 172.21.15.114:0/564511200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 msgr2=0x7fe7dc0cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 --2- 172.21.15.114:0/564511200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc0cd3a0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc073bb0 tx=0x7fe7d401cd50 comp rx=0 tx=0).stop 2024-09-16T07:35:45.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 -- 172.21.15.114:0/564511200 shutdown_connections 2024-09-16T07:35:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 --2- 172.21.15.114:0/564511200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc0cd3a0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 --2- 172.21.15.114:0/564511200 >> v2:172.21.15.149:3300/0 conn(0x7fe7dc0b2a00 0x7fe7dc0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 --2- 172.21.15.114:0/564511200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7dc15f340 0x7fe7dc0b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 -- 172.21.15.114:0/564511200 >> 172.21.15.114:0/564511200 conn(0x7fe7dc0d1e00 msgr2=0x7fe7dc0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 -- 172.21.15.114:0/564511200 shutdown_connections 2024-09-16T07:35:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 -- 172.21.15.114:0/564511200 wait complete. 2024-09-16T07:35:45.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.229+0000 7fe7e4600640 1 Processor -- start 2024-09-16T07:35:45.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 -- start start 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7dc0b2a00 0x7fe7dc14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7dc15f340 0x7fe7dc15b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc0b1ad0 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe7dc0b1950 con 0x7fe7dc0b2a00 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe7dc0b1c50 con 0x7fe7dc15f340 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc15b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38390/0 (socket says 172.21.15.114:38390) 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 -- 172.21.15.114:0/2854816401 learned_addr learned my addr 172.21.15.114:0/2854816401 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:45.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e2600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7dc15f340 0x7fe7dc15b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1c00640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7dc0b2a00 0x7fe7dc14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 -- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7dc15f340 msgr2=0x7fe7dc15b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7dc15f340 0x7fe7dc15b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 -- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7dc0b2a00 msgr2=0x7fe7dc14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7dc0b2a00 0x7fe7dc14c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 -- 172.21.15.114:0/2854816401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc14d730 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1c00640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7dc0b2a00 0x7fe7dc14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e1200640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc15b140 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800d730 tx=0x7fe7c800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7d9600640 1 -- 172.21.15.114:0/2854816401 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8017070 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7d9600640 1 -- 172.21.15.114:0/2854816401 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7c8009a30 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7dc14da10 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7d9600640 1 -- 172.21.15.114:0/2854816401 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8009e60 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7dc165f30 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.233+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7dc0cd3a0 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.237+0000 7fe7d9600640 1 -- 172.21.15.114:0/2854816401 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7fe7c8004020 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.237+0000 7fe7d9600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7bc0735b0 0x7fe7bc075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.237+0000 7fe7d9600640 1 -- 172.21.15.114:0/2854816401 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fe7c8094b30 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.237+0000 7fe7e1c00640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7bc0735b0 0x7fe7bc075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.237+0000 7fe7e1c00640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7bc0735b0 0x7fe7bc075a70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000bbd0 tx=0x7fe7d000b5b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:45.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.241+0000 7fe7d9600640 1 -- 172.21.15.114:0/2854816401 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe7c805ec30 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.405+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe7dc15eb70 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7d9600640 1 -- 172.21.15.114:0/2854816401 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fe7c8063660 con 0x7fe7dc0ccf10 2024-09-16T07:35:45.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7bc0735b0 msgr2=0x7fe7bc075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7bc0735b0 0x7fe7bc075a70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000bbd0 tx=0x7fe7d000b5b0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 msgr2=0x7fe7dc15b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc15b140 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800d730 tx=0x7fe7c800dbf0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 shutdown_connections 2024-09-16T07:35:45.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe7bc0735b0 0x7fe7bc075a70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe7dc15f340 0x7fe7dc15b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7dc0ccf10 0x7fe7dc15b140 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 --2- 172.21.15.114:0/2854816401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe7dc0b2a00 0x7fe7dc14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 >> 172.21.15.114:0/2854816401 conn(0x7fe7dc0d1e00 msgr2=0x7fe7dc0aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:45.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 shutdown_connections 2024-09-16T07:35:45.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.409+0000 7fe7e4600640 1 -- 172.21.15.114:0/2854816401 wait complete. 2024-09-16T07:35:45.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:45.427 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol44430) 2024-09-16T07:35:45.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:45.455 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp97230/subvol36231) 2024-09-16T07:35:45.519 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol44430 2024-09-16T07:35:45.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.705+0000 7f2381a00640 1 -- 172.21.15.114:0/1673870975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c15c3e0 msgr2=0x7f237c15c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.705+0000 7f2381a00640 1 --2- 172.21.15.114:0/1673870975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c15c3e0 0x7f237c15c7c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f236c009c80 tx=0x7f236c01f560 comp rx=0 tx=0).stop 2024-09-16T07:35:45.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.705+0000 7f2381a00640 1 -- 172.21.15.114:0/1673870975 shutdown_connections 2024-09-16T07:35:45.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.705+0000 7f2381a00640 1 --2- 172.21.15.114:0/1673870975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f237c0cd540 0x7f237c15f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.705+0000 7f2381a00640 1 --2- 172.21.15.114:0/1673870975 >> v2:172.21.15.149:3300/0 conn(0x7f237c15bfa0 0x7f237c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.705+0000 7f2381a00640 1 --2- 172.21.15.114:0/1673870975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c15c3e0 0x7f237c15c7c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.705+0000 7f2381a00640 1 -- 172.21.15.114:0/1673870975 >> 172.21.15.114:0/1673870975 conn(0x7f237c0b18f0 msgr2=0x7f237c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:45.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 -- 172.21.15.114:0/1673870975 shutdown_connections 2024-09-16T07:35:45.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 -- 172.21.15.114:0/1673870975 wait complete. 2024-09-16T07:35:45.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 Processor -- start 2024-09-16T07:35:45.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 -- start start 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c0cd540 0x7f237c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f237c15bfa0 0x7f237c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f237c15c3e0 0x7f237c0c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f237c15ffd0 con 0x7f237c0cd540 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f237c15fe50 con 0x7f237c15bfa0 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.709+0000 7f2381a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f237c160150 con 0x7f237c15c3e0 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c0cd540 0x7f237c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c0cd540 0x7f237c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38410/0 (socket says 172.21.15.114:38410) 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 -- 172.21.15.114:0/2015543864 learned_addr learned my addr 172.21.15.114:0/2015543864 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237b400640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f237c15c3e0 0x7f237c0c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2372000640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f237c15bfa0 0x7f237c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 -- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f237c15c3e0 msgr2=0x7f237c0c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f237c15c3e0 0x7f237c0c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 -- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f237c15bfa0 msgr2=0x7f237c1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f237c15bfa0 0x7f237c1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 -- 172.21.15.114:0/2015543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c0ca590 con 0x7f237c0cd540 2024-09-16T07:35:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f237aa00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c0cd540 0x7f237c0b2cf0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f236c000f90 tx=0x7f236c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2373400640 1 -- 172.21.15.114:0/2015543864 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0c0070 con 0x7f237c0cd540 2024-09-16T07:35:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2373400640 1 -- 172.21.15.114:0/2015543864 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f236c004d40 con 0x7f237c0cd540 2024-09-16T07:35:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c0ca870 con 0x7f237c0cd540 2024-09-16T07:35:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2373400640 1 -- 172.21.15.114:0/2015543864 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c0b6040 con 0x7f237c0cd540 2024-09-16T07:35:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c156530 con 0x7f237c0cd540 2024-09-16T07:35:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c069410 con 0x7f237c0cd540 2024-09-16T07:35:45.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.713+0000 7f2373400640 1 -- 172.21.15.114:0/2015543864 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f236c0c3070 con 0x7f237c0cd540 2024-09-16T07:35:45.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.717+0000 7f2373400640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2358073580 0x7f2358075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:45.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.717+0000 7f2373400640 1 -- 172.21.15.114:0/2015543864 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f236c132170 con 0x7f237c0cd540 2024-09-16T07:35:45.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.717+0000 7f2372000640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2358073580 0x7f2358075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:45.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.717+0000 7f2372000640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2358073580 0x7f2358075a40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f237c157eb0 tx=0x7f236400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:45.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.721+0000 7f2373400640 1 -- 172.21.15.114:0/2015543864 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f236c0ab070 con 0x7f237c0cd540 2024-09-16T07:35:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.909+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol44430", "target": ["mon-mgr", ""]}) -- 0x7f237c0caa40 con 0x7f2358073580 2024-09-16T07:35:45.915 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:45.917+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:45.915 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:45.917+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:45.915 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:45.917+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:45.915 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:45.917+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:45.915 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:45.917+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:45.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.945+0000 7f2373400640 1 -- 172.21.15.114:0/2015543864 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f236400b870 con 0x7f2358073580 2024-09-16T07:35:45.943 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol44430 2024-09-16T07:35:45.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2358073580 msgr2=0x7f2358075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2358073580 0x7f2358075a40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f237c157eb0 tx=0x7f236400b390 comp rx=0 tx=0).stop 2024-09-16T07:35:45.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c0cd540 msgr2=0x7f237c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:45.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c0cd540 0x7f237c0b2cf0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f236c000f90 tx=0x7f236c0092c0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 shutdown_connections 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2358073580 0x7f2358075a40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f237c15c3e0 0x7f237c0c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f237c15bfa0 0x7f237c1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 --2- 172.21.15.114:0/2015543864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f237c0cd540 0x7f237c0b2cf0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 >> 172.21.15.114:0/2015543864 conn(0x7f237c0b18f0 msgr2=0x7f237c0cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 shutdown_connections 2024-09-16T07:35:45.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:45.949+0000 7f2381a00640 1 -- 172.21.15.114:0/2015543864 wait complete. 2024-09-16T07:35:45.965 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol36231 subvol_grp97230 2024-09-16T07:35:46.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 -- 172.21.15.114:0/3973950265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 msgr2=0x7f19400cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 --2- 172.21.15.114:0/3973950265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400cec40 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f1940073e00 tx=0x7f192c01f0b0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 -- 172.21.15.114:0/3973950265 shutdown_connections 2024-09-16T07:35:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 --2- 172.21.15.114:0/3973950265 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400cec40 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 --2- 172.21.15.114:0/3973950265 >> v2:172.21.15.149:3300/0 conn(0x7f194015be10 0x7f19400ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 -- 172.21.15.114:0/3973950265 >> 172.21.15.114:0/3973950265 conn(0x7f19400d1da0 msgr2=0x7f19400d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 -- 172.21.15.114:0/3973950265 shutdown_connections 2024-09-16T07:35:46.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 -- 172.21.15.114:0/3973950265 wait complete. 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 Processor -- start 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.113+0000 7f1948600640 1 -- start start 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19400b0b60 0x7f194014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f194015be10 0x7f194006ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f19400cf510 con 0x7f194015c1f0 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19400cf390 con 0x7f194015be10 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1940160290 con 0x7f19400b0b60 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38456/0 (socket says 172.21.15.114:38456) 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 -- 172.21.15.114:0/2277844786 learned_addr learned my addr 172.21.15.114:0/2277844786 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1945c00640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19400b0b60 0x7f194014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1945200640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f194015be10 0x7f194006ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 -- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19400b0b60 msgr2=0x7f194014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19400b0b60 0x7f194014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 -- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f194015be10 msgr2=0x7f194006ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f194015be10 0x7f194006ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 -- 172.21.15.114:0/2277844786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19400b4c90 con 0x7f194015c1f0 2024-09-16T07:35:46.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1946600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400c6ed0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f193800c3f0 tx=0x7f193800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f193d600640 1 -- 172.21.15.114:0/2277844786 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938011790 con 0x7f194015c1f0 2024-09-16T07:35:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f193d600640 1 -- 172.21.15.114:0/2277844786 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1938017070 con 0x7f194015c1f0 2024-09-16T07:35:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f193d600640 1 -- 172.21.15.114:0/2277844786 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938011cc0 con 0x7f194015c1f0 2024-09-16T07:35:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19400b4f70 con 0x7f194015c1f0 2024-09-16T07:35:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19400b5530 con 0x7f194015c1f0 2024-09-16T07:35:46.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.117+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19401607b0 con 0x7f194015c1f0 2024-09-16T07:35:46.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.121+0000 7f193d600640 1 -- 172.21.15.114:0/2277844786 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f193801c460 con 0x7f194015c1f0 2024-09-16T07:35:46.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.121+0000 7f193d600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1920073580 0x7f1920075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.121+0000 7f193d600640 1 -- 172.21.15.114:0/2277844786 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f19380945e0 con 0x7f194015c1f0 2024-09-16T07:35:46.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.121+0000 7f1945c00640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1920073580 0x7f1920075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.121+0000 7f1945c00640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1920073580 0x7f1920075a40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f19401f7f40 tx=0x7f1934009650 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:46.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.125+0000 7f193d600640 1 -- 172.21.15.114:0/2277844786 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f193805e920 con 0x7f194015c1f0 2024-09-16T07:35:46.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.317+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol36231", "group_name": "subvol_grp97230", "target": ["mon-mgr", ""]}) -- 0x7f19400d2220 con 0x7f1920073580 2024-09-16T07:35:46.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.333+0000 7f193d600640 1 -- 172.21.15.114:0/2277844786 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f19400d2220 con 0x7f1920073580 2024-09-16T07:35:46.332 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp97230/subvol36231 2024-09-16T07:35:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1920073580 msgr2=0x7f1920075a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1920073580 0x7f1920075a40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f19401f7f40 tx=0x7f1934009650 comp rx=0 tx=0).stop 2024-09-16T07:35:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 msgr2=0x7f19400c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400c6ed0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f193800c3f0 tx=0x7f193800c8b0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 shutdown_connections 2024-09-16T07:35:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f194015c1f0 0x7f19400c6ed0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f194015be10 0x7f194006ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1920073580 0x7f1920075a40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 --2- 172.21.15.114:0/2277844786 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f19400b0b60 0x7f194014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 >> 172.21.15.114:0/2277844786 conn(0x7f19400d1da0 msgr2=0x7f1940071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 shutdown_connections 2024-09-16T07:35:46.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.337+0000 7f1948600640 1 -- 172.21.15.114:0/2277844786 wait complete. 2024-09-16T07:35:46.354 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol44430 2024-09-16T07:35:46.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.501+0000 7f5fbae00640 1 -- 172.21.15.114:0/4104566436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f98004810 msgr2=0x7f5f98004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.501+0000 7f5fbae00640 1 --2- 172.21.15.114:0/4104566436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f98004810 0x7f5f98004c90 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c2e0 tx=0x7f5fa001f6e0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.501+0000 7f5fbae00640 1 -- 172.21.15.114:0/4104566436 shutdown_connections 2024-09-16T07:35:46.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.501+0000 7f5fbae00640 1 --2- 172.21.15.114:0/4104566436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f98004810 0x7f5f98004c90 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.501+0000 7f5fbae00640 1 -- 172.21.15.114:0/4104566436 >> 172.21.15.114:0/4104566436 conn(0x7f5fb40d1dd0 msgr2=0x7f5fb40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:46.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.501+0000 7f5fbae00640 1 -- 172.21.15.114:0/4104566436 shutdown_connections 2024-09-16T07:35:46.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.501+0000 7f5fbae00640 1 -- 172.21.15.114:0/4104566436 wait complete. 2024-09-16T07:35:46.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 Processor -- start 2024-09-16T07:35:46.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 -- start start 2024-09-16T07:35:46.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f98004810 0x7f5fb40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb415d1e0 0x7f5fb415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb415f3e0 0x7f5fb40b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb40b0e50 con 0x7f5fb415f3e0 2024-09-16T07:35:46.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb40b0cd0 con 0x7f5fb415d1e0 2024-09-16T07:35:46.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb40b1220 con 0x7f5f98004810 2024-09-16T07:35:46.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb415f3e0 0x7f5fb40b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb415f3e0 0x7f5fb40b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38464/0 (socket says 172.21.15.114:38464) 2024-09-16T07:35:46.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 -- 172.21.15.114:0/2218437986 learned_addr learned my addr 172.21.15.114:0/2218437986 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:46.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb3400640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb415d1e0 0x7f5fb415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb3e00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f98004810 0x7f5fb40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 -- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f98004810 msgr2=0x7f5fb40cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f98004810 0x7f5fb40cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 -- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb415d1e0 msgr2=0x7f5fb415eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb415d1e0 0x7f5fb415eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 -- 172.21.15.114:0/2218437986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb415da40 con 0x7f5fb415f3e0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fb8e00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb415f3e0 0x7f5fb40b68b0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4069c10 tx=0x7f5fac0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fabe00640 1 -- 172.21.15.114:0/2218437986 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac011870 con 0x7f5fb415f3e0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fabe00640 1 -- 172.21.15.114:0/2218437986 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fac017070 con 0x7f5fb415f3e0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb415d760 con 0x7f5fb415f3e0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fabe00640 1 -- 172.21.15.114:0/2218437986 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fac011da0 con 0x7f5fb415f3e0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb40b63b0 con 0x7f5fb415f3e0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.505+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb40b5f00 con 0x7f5fb415f3e0 2024-09-16T07:35:46.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.509+0000 7f5fabe00640 1 -- 172.21.15.114:0/2218437986 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 25) ==== 97692+0+0 (secure 0 0 0) 0x7f5fac01c460 con 0x7f5fb415f3e0 2024-09-16T07:35:46.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.509+0000 7f5fabe00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f940735b0 0x7f5f94075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:46.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.509+0000 7f5fabe00640 1 -- 172.21.15.114:0/2218437986 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f5fac095ba0 con 0x7f5fb415f3e0 2024-09-16T07:35:46.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.509+0000 7f5fb3e00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f940735b0 0x7f5f94075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:46.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.509+0000 7f5fb3e00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f940735b0 0x7f5f94075a70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4052940 tx=0x7f5fa40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:46.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.513+0000 7f5fabe00640 1 -- 172.21.15.114:0/2218437986 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5fb415da40 con 0x7f5fb415f3e0 2024-09-16T07:35:46.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.709+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol44430", "target": ["mon-mgr", ""]}) -- 0x7f5fb40d06e0 con 0x7f5f940735b0 2024-09-16T07:35:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.713+0000 7f5fabe00640 1 -- 172.21.15.114:0/2218437986 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f5fb40d06e0 con 0x7f5f940735b0 2024-09-16T07:35:46.711 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol44430 2024-09-16T07:35:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f940735b0 msgr2=0x7f5f94075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f940735b0 0x7f5f94075a70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4052940 tx=0x7f5fa40091e0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb415f3e0 msgr2=0x7f5fb40b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb415f3e0 0x7f5fb40b68b0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4069c10 tx=0x7f5fac0019c0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 shutdown_connections 2024-09-16T07:35:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb415f3e0 0x7f5fb40b68b0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fb415d1e0 0x7f5fb415eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5f940735b0 0x7f5f94075a70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 --2- 172.21.15.114:0/2218437986 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5f98004810 0x7f5fb40cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 >> 172.21.15.114:0/2218437986 conn(0x7f5fb40d1dd0 msgr2=0x7f5fb406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 shutdown_connections 2024-09-16T07:35:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:46.717+0000 7f5fbae00640 1 -- 172.21.15.114:0/2218437986 wait complete. 2024-09-16T07:35:46.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:46.734 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/1444b66145a88ab068a8f5a0d4df5c54.meta) 2024-09-16T07:35:48.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:35:48.703 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:35:50.083 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:35:50.083 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:35:50.083 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:35:50.083 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol44430 2024-09-16T07:35:50.083 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:35:50.083 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:50.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol36231 subvol_grp97230 2024-09-16T07:35:50.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 -- 172.21.15.114:0/2794713128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02280cb4c0 msgr2=0x7f02280cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 --2- 172.21.15.114:0/2794713128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02280cb4c0 0x7f02280cb900 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0220009c80 tx=0x7f022001cda0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 -- 172.21.15.114:0/2794713128 shutdown_connections 2024-09-16T07:35:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 --2- 172.21.15.114:0/2794713128 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f02280cb4c0 0x7f02280cb900 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 --2- 172.21.15.114:0/2794713128 >> v2:172.21.15.149:3300/0 conn(0x7f02280ccfd0 0x7f022806d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 -- 172.21.15.114:0/2794713128 >> 172.21.15.114:0/2794713128 conn(0x7f02280d0b90 msgr2=0x7f02280d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 -- 172.21.15.114:0/2794713128 shutdown_connections 2024-09-16T07:35:50.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.241+0000 7f022d400640 1 -- 172.21.15.114:0/2794713128 wait complete. 2024-09-16T07:35:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 Processor -- start 2024-09-16T07:35:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 -- start start 2024-09-16T07:35:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02280cb4c0 0x7f02280b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02280ccfd0 0x7f0228152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f022815bd70 0x7f0228153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0228168fa0 con 0x7f02280cb4c0 2024-09-16T07:35:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0228168e20 con 0x7f02280ccfd0 2024-09-16T07:35:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0228169120 con 0x7f022815bd70 2024-09-16T07:35:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02280cb4c0 0x7f02280b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02280cb4c0 0x7f02280b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38468/0 (socket says 172.21.15.114:38468) 2024-09-16T07:35:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 -- 172.21.15.114:0/2605908267 learned_addr learned my addr 172.21.15.114:0/2605908267 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f021f400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02280ccfd0 0x7f0228152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022ca00640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f022815bd70 0x7f0228153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 -- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f022815bd70 msgr2=0x7f0228153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f022815bd70 0x7f0228153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 -- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02280ccfd0 msgr2=0x7f0228152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02280ccfd0 0x7f0228152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 -- 172.21.15.114:0/2605908267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02280b6810 con 0x7f02280cb4c0 2024-09-16T07:35:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0227e00640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02280cb4c0 0x7f02280b45e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f021800c3c0 tx=0x7f021800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0224c00640 1 -- 172.21.15.114:0/2605908267 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02180052d0 con 0x7f02280cb4c0 2024-09-16T07:35:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0224c00640 1 -- 172.21.15.114:0/2605908267 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0218007020 con 0x7f02280cb4c0 2024-09-16T07:35:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f0224c00640 1 -- 172.21.15.114:0/2605908267 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218007470 con 0x7f02280cb4c0 2024-09-16T07:35:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02281fc250 con 0x7f02280cb4c0 2024-09-16T07:35:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02281fbf20 con 0x7f02280cb4c0 2024-09-16T07:35:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.245+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02280cb900 con 0x7f02280cb4c0 2024-09-16T07:35:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.249+0000 7f0224c00640 1 -- 172.21.15.114:0/2605908267 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 26) ==== 97743+0+0 (secure 0 0 0) 0x7f02180067e0 con 0x7f02280cb4c0 2024-09-16T07:35:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.249+0000 7f0224c00640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0204073610 0x7f0204075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.249+0000 7f0224c00640 1 -- 172.21.15.114:0/2605908267 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f0218094570 con 0x7f02280cb4c0 2024-09-16T07:35:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.249+0000 7f021f400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0204073610 0x7f0204075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.249+0000 7f021f400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0204073610 0x7f0204075ad0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0210009600 tx=0x7f02100091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.253+0000 7f0224c00640 1 -- 172.21.15.114:0/2605908267 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f021805e750 con 0x7f02280cb4c0 2024-09-16T07:35:50.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.445+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol36231", "group_name": "subvol_grp97230", "target": ["mon-mgr", ""]}) -- 0x7f02280d1900 con 0x7f0204073610 2024-09-16T07:35:50.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f0224c00640 1 -- 172.21.15.114:0/2605908267 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f02280d1900 con 0x7f0204073610 2024-09-16T07:35:50.447 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp97230/subvol36231 2024-09-16T07:35:50.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0204073610 msgr2=0x7f0204075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:50.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0204073610 0x7f0204075ad0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0210009600 tx=0x7f02100091e0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02280cb4c0 msgr2=0x7f02280b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02280cb4c0 0x7f02280b45e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f021800c3c0 tx=0x7f021800c880 comp rx=0 tx=0).stop 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 shutdown_connections 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0204073610 0x7f0204075ad0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f022815bd70 0x7f0228153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02280ccfd0 0x7f0228152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 --2- 172.21.15.114:0/2605908267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02280cb4c0 0x7f02280b45e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.449+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 >> 172.21.15.114:0/2605908267 conn(0x7f02280d0b90 msgr2=0x7f0228159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.453+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 shutdown_connections 2024-09-16T07:35:50.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:50.453+0000 7f022d400640 1 -- 172.21.15.114:0/2605908267 wait complete. 2024-09-16T07:35:50.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:50.469 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/05aa153897676e5957d84488901f4030.meta) 2024-09-16T07:35:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:35:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:35:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:35:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/subvol_grp97230/subvol36231 2024-09-16T07:35:55.083 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:35:55.083 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:55.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol44430 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 -- 172.21.15.114:0/2368694238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3415b580 msgr2=0x7fef3415b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 --2- 172.21.15.114:0/2368694238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3415b580 0x7fef3415b960 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fef24009c80 tx=0x7fef2401cda0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 -- 172.21.15.114:0/2368694238 shutdown_connections 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 --2- 172.21.15.114:0/2368694238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef340b3300 0x7fef340cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 --2- 172.21.15.114:0/2368694238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef3415b580 0x7fef3415b960 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 -- 172.21.15.114:0/2368694238 >> 172.21.15.114:0/2368694238 conn(0x7fef340b18f0 msgr2=0x7fef340b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 -- 172.21.15.114:0/2368694238 shutdown_connections 2024-09-16T07:35:55.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 -- 172.21.15.114:0/2368694238 wait complete. 2024-09-16T07:35:55.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 Processor -- start 2024-09-16T07:35:55.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.241+0000 7fef3aa00640 1 -- start start 2024-09-16T07:35:55.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef340b3300 0x7fef34073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef340b4bd0 0x7fef3414c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef3415b580 0x7fef341fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef34167eb0 con 0x7fef340b3300 2024-09-16T07:35:55.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef34167d30 con 0x7fef340b4bd0 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fef34168030 con 0x7fef3415b580 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef340b3300 0x7fef34073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef340b3300 0x7fef34073c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36136/0 (socket says 172.21.15.114:36136) 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 -- 172.21.15.114:0/3379817525 learned_addr learned my addr 172.21.15.114:0/3379817525 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33400640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef340b4bd0 0x7fef3414c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef38a00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef3415b580 0x7fef341fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 -- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef3415b580 msgr2=0x7fef341fbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef3415b580 0x7fef341fbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 -- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef340b4bd0 msgr2=0x7fef3414c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef340b4bd0 0x7fef3414c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 -- 172.21.15.114:0/3379817525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef341f7fe0 con 0x7fef340b3300 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef38a00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef3415b580 0x7fef341fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef33e00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef340b3300 0x7fef34073c70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fef24000f90 tx=0x7fef24009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef2be00640 1 -- 172.21.15.114:0/3379817525 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240bb070 con 0x7fef340b3300 2024-09-16T07:35:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef2be00640 1 -- 172.21.15.114:0/3379817525 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef24004d40 con 0x7fef340b3300 2024-09-16T07:35:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef341f8280 con 0x7fef340b3300 2024-09-16T07:35:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef2be00640 1 -- 172.21.15.114:0/3379817525 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240b2040 con 0x7fef340b3300 2024-09-16T07:35:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef341f8840 con 0x7fef340b3300 2024-09-16T07:35:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.245+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef34069410 con 0x7fef340b3300 2024-09-16T07:35:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.249+0000 7fef2be00640 1 -- 172.21.15.114:0/3379817525 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 26) ==== 97743+0+0 (secure 0 0 0) 0x7fef240be070 con 0x7fef340b3300 2024-09-16T07:35:55.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.249+0000 7fef2be00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fef14073610 0x7fef14075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.249+0000 7fef2be00640 1 -- 172.21.15.114:0/3379817525 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fef2412ec50 con 0x7fef340b3300 2024-09-16T07:35:55.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.249+0000 7fef33400640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fef14073610 0x7fef14075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.249+0000 7fef33400640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fef14073610 0x7fef14075ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fef3415ab30 tx=0x7fef20009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:55.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.253+0000 7fef2be00640 1 -- 172.21.15.114:0/3379817525 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fef240f30b0 con 0x7fef340b3300 2024-09-16T07:35:55.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.441+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol44430", "target": ["mon-mgr", ""]}) -- 0x7fef340b1240 con 0x7fef14073610 2024-09-16T07:35:55.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.469+0000 7fef2be00640 1 -- 172.21.15.114:0/3379817525 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fef340b1240 con 0x7fef14073610 2024-09-16T07:35:55.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fef14073610 msgr2=0x7fef14075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fef14073610 0x7fef14075ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fef3415ab30 tx=0x7fef20009040 comp rx=0 tx=0).stop 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef340b3300 msgr2=0x7fef34073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef340b3300 0x7fef34073c70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fef24000f90 tx=0x7fef24009360 comp rx=0 tx=0).stop 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 shutdown_connections 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fef14073610 0x7fef14075ad0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fef3415b580 0x7fef341fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef340b4bd0 0x7fef3414c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 --2- 172.21.15.114:0/3379817525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef340b3300 0x7fef34073c70 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 >> 172.21.15.114:0/3379817525 conn(0x7fef340b18f0 msgr2=0x7fef34150720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 shutdown_connections 2024-09-16T07:35:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.473+0000 7fef3aa00640 1 -- 172.21.15.114:0/3379817525 wait complete. 2024-09-16T07:35:55.472 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.473+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.472 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.473+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.472 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.473+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.472 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.473+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.472 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.473+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.490 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.493+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.490 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.493+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.490 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.493+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.490 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.493+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.490 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:35:55.493+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:35:55.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol36231 subvol_grp97230 2024-09-16T07:35:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 -- 172.21.15.114:0/2903114836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 msgr2=0x7ff1e80d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 --2- 172.21.15.114:0/2903114836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e80d1b60 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80d3b30 tx=0x7ff1d401c800 comp rx=0 tx=0).stop 2024-09-16T07:35:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 -- 172.21.15.114:0/2903114836 shutdown_connections 2024-09-16T07:35:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 --2- 172.21.15.114:0/2903114836 >> v2:172.21.15.149:3300/0 conn(0x7ff1e80d20a0 0x7ff1e80d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 --2- 172.21.15.114:0/2903114836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e80d1b60 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 -- 172.21.15.114:0/2903114836 >> 172.21.15.114:0/2903114836 conn(0x7ff1e80d3f90 msgr2=0x7ff1e80d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:55.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 -- 172.21.15.114:0/2903114836 shutdown_connections 2024-09-16T07:35:55.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.641+0000 7ff1f0600640 1 -- 172.21.15.114:0/2903114836 wait complete. 2024-09-16T07:35:55.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 Processor -- start 2024-09-16T07:35:55.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 -- start start 2024-09-16T07:35:55.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e80d20a0 0x7ff1e80b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e815de40 0x7ff1e814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e81fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e816b500 con 0x7ff1e815e220 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e816b380 con 0x7ff1e80d20a0 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e816b680 con 0x7ff1e815de40 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e81fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e81fbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36204/0 (socket says 172.21.15.114:36204) 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 -- 172.21.15.114:0/3250754251 learned_addr learned my addr 172.21.15.114:0/3250754251 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1edc00640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e80d20a0 0x7ff1e80b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ed200640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e815de40 0x7ff1e814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 -- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e815de40 msgr2=0x7ff1e814ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e815de40 0x7ff1e814ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 -- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e80d20a0 msgr2=0x7ff1e80b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e80d20a0 0x7ff1e80b93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 -- 172.21.15.114:0/3250754251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e80b6e80 con 0x7ff1e815e220 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1edc00640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e80d20a0 0x7ff1e80b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1ee600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e81fbfa0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000eb50 tx=0x7ff1e000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0004d30 con 0x7ff1e815e220 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1e000ee50 con 0x7ff1e815e220 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0005280 con 0x7ff1e815e220 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e80b7160 con 0x7ff1e815e220 2024-09-16T07:35:55.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.645+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e80b7720 con 0x7ff1e815e220 2024-09-16T07:35:55.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.649+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e80d2540 con 0x7ff1e815e220 2024-09-16T07:35:55.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.649+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 26) ==== 97743+0+0 (secure 0 0 0) 0x7ff1e0005420 con 0x7ff1e815e220 2024-09-16T07:35:55.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.649+0000 7ff1e5600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff1c8073640 0x7ff1c8075b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:55.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.649+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7ff1e0095d70 con 0x7ff1e815e220 2024-09-16T07:35:55.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.649+0000 7ff1edc00640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff1c8073640 0x7ff1c8075b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:55.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.649+0000 7ff1edc00640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff1c8073640 0x7ff1c8075b00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007fd0 tx=0x7ff1dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:55.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.653+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff1e005ff50 con 0x7ff1e815e220 2024-09-16T07:35:55.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.733+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7ff1e005bac0 con 0x7ff1e815e220 2024-09-16T07:35:55.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.857+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol36231", "group_name": "subvol_grp97230", "target": ["mon-mgr", ""]}) -- 0x7ff1e806ac00 con 0x7ff1c8073640 2024-09-16T07:35:55.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.881+0000 7ff1e5600640 1 -- 172.21.15.114:0/3250754251 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff1e806ac00 con 0x7ff1c8073640 2024-09-16T07:35:55.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff1c8073640 msgr2=0x7ff1c8075b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff1c8073640 0x7ff1c8075b00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc007fd0 tx=0x7ff1dc009040 comp rx=0 tx=0).stop 2024-09-16T07:35:55.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 msgr2=0x7ff1e81fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:55.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e81fbfa0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000eb50 tx=0x7ff1e000c6a0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 shutdown_connections 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1e815e220 0x7ff1e81fbfa0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff1c8073640 0x7ff1c8075b00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1e815de40 0x7ff1e814ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 --2- 172.21.15.114:0/3250754251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1e80d20a0 0x7ff1e80b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 >> 172.21.15.114:0/3250754251 conn(0x7ff1e80d3f90 msgr2=0x7ff1e81617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 shutdown_connections 2024-09-16T07:35:55.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55.885+0000 7ff1f0600640 1 -- 172.21.15.114:0/3250754251 wait complete. 2024-09-16T07:35:55.905 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T07:35:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:35:55.959 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-09-16T07:35:55.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:35:55.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp97230 2024-09-16T07:35:56.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- 172.21.15.114:0/4052481279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 msgr2=0x7f538c166800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 --2- 172.21.15.114:0/4052481279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c166800 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f5384009c80 tx=0x7f538401cda0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- 172.21.15.114:0/4052481279 shutdown_connections 2024-09-16T07:35:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 --2- 172.21.15.114:0/4052481279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c166800 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- 172.21.15.114:0/4052481279 >> 172.21.15.114:0/4052481279 conn(0x7f538c09aa10 msgr2=0x7f538c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- 172.21.15.114:0/4052481279 shutdown_connections 2024-09-16T07:35:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- 172.21.15.114:0/4052481279 wait complete. 2024-09-16T07:35:56.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 Processor -- start 2024-09-16T07:35:56.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- start start 2024-09-16T07:35:56.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f538c0b0d10 0x7f538c164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f538c15bd40 0x7f538c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f538c169eb0 con 0x7f538c0d22c0 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f538c169d30 con 0x7f538c0b0d10 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5392800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f538c16a030 con 0x7f538c15bd40 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5390a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5390a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36230/0 (socket says 172.21.15.114:36230) 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.113+0000 7f5390a00640 1 -- 172.21.15.114:0/2569414367 learned_addr learned my addr 172.21.15.114:0/2569414367 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5391400640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f538c0b0d10 0x7f538c164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5391e00640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f538c15bd40 0x7f538c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5390a00640 1 -- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f538c15bd40 msgr2=0x7f538c06efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5390a00640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f538c15bd40 0x7f538c06efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5390a00640 1 -- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f538c0b0d10 msgr2=0x7f538c164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5390a00640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f538c0b0d10 0x7f538c164260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5390a00640 1 -- 172.21.15.114:0/2569414367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c06e1e0 con 0x7f538c0d22c0 2024-09-16T07:35:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5390a00640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c14e700 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f537800c450 tx=0x7f537800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5389600640 1 -- 172.21.15.114:0/2569414367 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378005480 con 0x7f538c0d22c0 2024-09-16T07:35:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5389600640 1 -- 172.21.15.114:0/2569414367 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5378003600 con 0x7f538c0d22c0 2024-09-16T07:35:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5389600640 1 -- 172.21.15.114:0/2569414367 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378003a30 con 0x7f538c0d22c0 2024-09-16T07:35:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c06e4c0 con 0x7f538c0d22c0 2024-09-16T07:35:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c06ea80 con 0x7f538c0d22c0 2024-09-16T07:35:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538c0d1bb0 con 0x7f538c0d22c0 2024-09-16T07:35:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.117+0000 7f5389600640 1 -- 172.21.15.114:0/2569414367 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f5378003bd0 con 0x7f538c0d22c0 2024-09-16T07:35:56.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.121+0000 7f5389600640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f536c073760 0x7f536c075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.121+0000 7f5389600640 1 -- 172.21.15.114:0/2569414367 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f5378094af0 con 0x7f538c0d22c0 2024-09-16T07:35:56.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.121+0000 7f5391400640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f536c073760 0x7f536c075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.121+0000 7f5391400640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f536c073760 0x7f536c075c20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5380007fd0 tx=0x7f5380009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.125+0000 7f5389600640 1 -- 172.21.15.114:0/2569414367 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f537805e730 con 0x7f538c0d22c0 2024-09-16T07:35:56.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.313+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp97230", "target": ["mon-mgr", ""]}) -- 0x7f538c06df90 con 0x7f536c073760 2024-09-16T07:35:56.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5389600640 1 -- 172.21.15.114:0/2569414367 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f538c06df90 con 0x7f536c073760 2024-09-16T07:35:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f536c073760 msgr2=0x7f536c075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f536c073760 0x7f536c075c20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5380007fd0 tx=0x7f5380009040 comp rx=0 tx=0).stop 2024-09-16T07:35:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 msgr2=0x7f538c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c14e700 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f537800c450 tx=0x7f537800c910 comp rx=0 tx=0).stop 2024-09-16T07:35:56.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 shutdown_connections 2024-09-16T07:35:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f536c073760 0x7f536c075c20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f538c15bd40 0x7f538c06efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c0d22c0 0x7f538c14e700 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 --2- 172.21.15.114:0/2569414367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f538c0b0d10 0x7f538c164260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 >> 172.21.15.114:0/2569414367 conn(0x7f538c09aa10 msgr2=0x7f538c0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 shutdown_connections 2024-09-16T07:35:56.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.329+0000 7f5392800640 1 -- 172.21.15.114:0/2569414367 wait complete. 2024-09-16T07:35:56.348 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:35:56.349 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:35:56.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:35:56.530 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:35:56.530 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:56.530 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:56.530 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:56.540 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:56.540 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:56.590 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:35:56.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.781+0000 7f22ce400640 1 -- 172.21.15.114:0/2719140988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 msgr2=0x7f22ac003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.781+0000 7f22ce400640 1 --2- 172.21.15.114:0/2719140988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22ac003e80 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f22b80016c0 tx=0x7f22b801c6e0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.781+0000 7f22ce400640 1 -- 172.21.15.114:0/2719140988 shutdown_connections 2024-09-16T07:35:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.781+0000 7f22ce400640 1 --2- 172.21.15.114:0/2719140988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22ac003e80 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.781+0000 7f22ce400640 1 -- 172.21.15.114:0/2719140988 >> 172.21.15.114:0/2719140988 conn(0x7f22c80d1e30 msgr2=0x7f22c80d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.781+0000 7f22ce400640 1 -- 172.21.15.114:0/2719140988 shutdown_connections 2024-09-16T07:35:56.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.781+0000 7f22ce400640 1 -- 172.21.15.114:0/2719140988 wait complete. 2024-09-16T07:35:56.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 Processor -- start 2024-09-16T07:35:56.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 -- start start 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22c8153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22c815d690 0x7f22c80afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22c8154590 0x7f22c80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f22c80b1e50 con 0x7f22ac003a60 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f22c80b1cd0 con 0x7f22c8154590 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f22c80b1fd0 con 0x7f22c815d690 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22c8153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22c8153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36258/0 (socket says 172.21.15.114:36258) 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 -- 172.21.15.114:0/2190009064 learned_addr learned my addr 172.21.15.114:0/2190009064 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c6a00640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22c815d690 0x7f22c80afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7e00640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22c8154590 0x7f22c80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 -- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22c815d690 msgr2=0x7f22c80afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22c815d690 0x7f22c80afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 -- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22c8154590 msgr2=0x7f22c80b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22c8154590 0x7f22c80b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 -- 172.21.15.114:0/2190009064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c81fadf0 con 0x7f22ac003a60 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22c7400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22c8153e90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f22b8006040 tx=0x7f22b8006950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22bf400640 1 -- 172.21.15.114:0/2190009064 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8003680 con 0x7f22ac003a60 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22bf400640 1 -- 172.21.15.114:0/2190009064 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22b8003910 con 0x7f22ac003a60 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22bf400640 1 -- 172.21.15.114:0/2190009064 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8003d60 con 0x7f22ac003a60 2024-09-16T07:35:56.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c81fb0d0 con 0x7f22ac003a60 2024-09-16T07:35:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c80c8f00 con 0x7f22ac003a60 2024-09-16T07:35:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.785+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c80cffb0 con 0x7f22ac003a60 2024-09-16T07:35:56.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.789+0000 7f22bf400640 1 -- 172.21.15.114:0/2190009064 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f22b80a5520 con 0x7f22ac003a60 2024-09-16T07:35:56.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.789+0000 7f22bf400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f22a8073730 0x7f22a8075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:56.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.789+0000 7f22bf400640 1 -- 172.21.15.114:0/2190009064 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f22b812e660 con 0x7f22ac003a60 2024-09-16T07:35:56.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.789+0000 7f22c6a00640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f22a8073730 0x7f22a8075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:56.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.789+0000 7f22c6a00640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f22a8073730 0x7f22a8075bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f22c815da70 tx=0x7f22b40067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:56.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.793+0000 7f22bf400640 1 -- 172.21.15.114:0/2190009064 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f22b8016470 con 0x7f22ac003a60 2024-09-16T07:35:56.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f22c8071810 con 0x7f22ac003a60 2024-09-16T07:35:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22bf400640 1 -- 172.21.15.114:0/2190009064 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) ==== 80+0+0 (secure 0 0 0) 0x7f22b80f8dc0 con 0x7f22ac003a60 2024-09-16T07:35:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:35:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f22a8073730 msgr2=0x7f22a8075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f22a8073730 0x7f22a8075bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f22c815da70 tx=0x7f22b40067b0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 msgr2=0x7f22c8153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22c8153e90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f22b8006040 tx=0x7f22b8006950 comp rx=0 tx=0).stop 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 shutdown_connections 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22c8154590 0x7f22c80b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f22a8073730 0x7f22a8075bf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f22c815d690 0x7f22c80afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 --2- 172.21.15.114:0/2190009064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22ac003a60 0x7f22c8153e90 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 >> 172.21.15.114:0/2190009064 conn(0x7f22c80d1e30 msgr2=0x7f22c80ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 shutdown_connections 2024-09-16T07:35:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:56.973+0000 7f22ce400640 1 -- 172.21.15.114:0/2190009064 wait complete. 2024-09-16T07:35:56.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:35:56.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:56.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:35:57.018 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:35:57.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:57.018 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:35:57.073 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:57.074 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:57.074 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:57.083 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:57.083 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:57.134 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:35:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.277+0000 7f7779e00640 1 -- 172.21.15.114:0/469203754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c003a60 msgr2=0x7f775c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.277+0000 7f7779e00640 1 --2- 172.21.15.114:0/469203754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f775c003a60 0x7f775c003e80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f7768006fc0 tx=0x7f776801cf40 comp rx=0 tx=0).stop 2024-09-16T07:35:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.277+0000 7f7779400640 1 -- 172.21.15.114:0/469203754 reap_dead start 2024-09-16T07:35:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.277+0000 7f7779e00640 1 -- 172.21.15.114:0/469203754 shutdown_connections 2024-09-16T07:35:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.277+0000 7f7779e00640 1 -- 172.21.15.114:0/469203754 >> 172.21.15.114:0/469203754 conn(0x7f77740b3740 msgr2=0x7f77740b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 -- 172.21.15.114:0/469203754 shutdown_connections 2024-09-16T07:35:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 -- 172.21.15.114:0/469203754 wait complete. 2024-09-16T07:35:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 Processor -- start 2024-09-16T07:35:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 -- start start 2024-09-16T07:35:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f775c003a60 0x7f777406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777406eed0 0x7f77741f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f777406f330 0x7f77741f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77740afbb0 con 0x7f777406eed0 2024-09-16T07:35:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f77740afa30 con 0x7f777406f330 2024-09-16T07:35:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f77740afd30 con 0x7f775c003a60 2024-09-16T07:35:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7773e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777406eed0 0x7f77741f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f775c003a60 0x7f777406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f775c003a60 0x7f777406dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:35124/0 (socket says 172.21.15.114:35124) 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 -- 172.21.15.114:0/2014903389 learned_addr learned my addr 172.21.15.114:0/2014903389 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7779400640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f777406f330 0x7f77741f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 -- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f777406f330 msgr2=0x7f77741f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f777406f330 0x7f77741f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 -- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777406eed0 msgr2=0x7f77741f7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777406eed0 0x7f77741f7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 -- 172.21.15.114:0/2014903389 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77741f9360 con 0x7f775c003a60 2024-09-16T07:35:57.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.281+0000 7f7778a00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f775c003a60 0x7f777406dd30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7768006040 tx=0x7f7768006be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7770c00640 1 -- 172.21.15.114:0/2014903389 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77680a5b70 con 0x7f775c003a60 2024-09-16T07:35:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7770c00640 1 -- 172.21.15.114:0/2014903389 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77680014c0 con 0x7f775c003a60 2024-09-16T07:35:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7770c00640 1 -- 172.21.15.114:0/2014903389 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77680060d0 con 0x7f775c003a60 2024-09-16T07:35:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77740b6ee0 con 0x7f775c003a60 2024-09-16T07:35:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77741f8ac0 con 0x7f775c003a60 2024-09-16T07:35:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77740d09f0 con 0x7f775c003a60 2024-09-16T07:35:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7770c00640 1 -- 172.21.15.114:0/2014903389 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f7768006270 con 0x7f775c003a60 2024-09-16T07:35:57.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7770c00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7754073750 0x7f7754075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7770c00640 1 -- 172.21.15.114:0/2014903389 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f776812e6a0 con 0x7f775c003a60 2024-09-16T07:35:57.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.285+0000 7f7773e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7754073750 0x7f7754075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.289+0000 7f7773e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7754073750 0x7f7754075c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f77741fca60 tx=0x7f77600091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:57.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.289+0000 7f7770c00640 1 -- 172.21.15.114:0/2014903389 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f77680c8080 con 0x7f775c003a60 2024-09-16T07:35:57.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f77740aff40 con 0x7f775c003a60 2024-09-16T07:35:57.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7770c00640 1 -- 172.21.15.114:0/2014903389 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) ==== 80+0+0 (secure 0 0 0) 0x7f7768016cf0 con 0x7f775c003a60 2024-09-16T07:35:57.467 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:35:57.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7754073750 msgr2=0x7f7754075c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7754073750 0x7f7754075c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f77741fca60 tx=0x7f77600091e0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f775c003a60 msgr2=0x7f777406dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f775c003a60 0x7f777406dd30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7768006040 tx=0x7f7768006be0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 shutdown_connections 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f777406f330 0x7f77741f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f777406eed0 0x7f77741f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7754073750 0x7f7754075c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 --2- 172.21.15.114:0/2014903389 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f775c003a60 0x7f777406dd30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 >> 172.21.15.114:0/2014903389 conn(0x7f77740b3740 msgr2=0x7f777415f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 shutdown_connections 2024-09-16T07:35:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.469+0000 7f7779e00640 1 -- 172.21.15.114:0/2014903389 wait complete. 2024-09-16T07:35:57.488 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:35:57.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:57.489 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:35:57.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:35:57.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:35:57.517 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:35:57.571 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:57.571 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:35:57.571 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:57.580 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:35:57.580 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:35:57.580 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:35:57.580 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:35:57.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:35:57.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 -- 172.21.15.114:0/2538800772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40b2590 msgr2=0x7f1fb40b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 --2- 172.21.15.114:0/2538800772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40b2590 0x7f1fb40b29e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f1fb409b750 tx=0x7f1fac01cc60 comp rx=0 tx=0).stop 2024-09-16T07:35:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 -- 172.21.15.114:0/2538800772 shutdown_connections 2024-09-16T07:35:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 --2- 172.21.15.114:0/2538800772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40b2590 0x7f1fb40b29e0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 --2- 172.21.15.114:0/2538800772 >> v2:172.21.15.149:3300/0 conn(0x7f1fb415f000 0x7f1fb40d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 -- 172.21.15.114:0/2538800772 >> 172.21.15.114:0/2538800772 conn(0x7f1fb409aa10 msgr2=0x7f1fb409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 -- 172.21.15.114:0/2538800772 shutdown_connections 2024-09-16T07:35:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 -- 172.21.15.114:0/2538800772 wait complete. 2024-09-16T07:35:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 Processor -- start 2024-09-16T07:35:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.773+0000 7f1fba400640 1 -- start start 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40b2590 0x7f1fb4164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40cefb0 0x7f1fb41519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb415f000 0x7f1fb406f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb4168ea0 con 0x7f1fb40cefb0 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb4168d20 con 0x7f1fb40b2590 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb4169020 con 0x7f1fb415f000 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40cefb0 0x7f1fb41519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40cefb0 0x7f1fb41519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36316/0 (socket says 172.21.15.114:36316) 2024-09-16T07:35:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40b2590 0x7f1fb4164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 -- 172.21.15.114:0/3875882538 learned_addr learned my addr 172.21.15.114:0/3875882538 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb9a00640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb415f000 0x7f1fb406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 -- 172.21.15.114:0/3875882538 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb415f000 msgr2=0x7f1fb406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb415f000 0x7f1fb406f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 -- 172.21.15.114:0/3875882538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40b2590 msgr2=0x7f1fb4164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40b2590 0x7f1fb4164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 -- 172.21.15.114:0/3875882538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb41fb270 con 0x7f1fb40cefb0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb3e00640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40cefb0 0x7f1fb41519e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c4e0 tx=0x7f1fa000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb0c00640 1 -- 172.21.15.114:0/3875882538 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00052d0 con 0x7f1fb40cefb0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb0c00640 1 -- 172.21.15.114:0/3875882538 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fa0005470 con 0x7f1fb40cefb0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb0c00640 1 -- 172.21.15.114:0/3875882538 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0012890 con 0x7f1fb40cefb0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb41fb550 con 0x7f1fb40cefb0 2024-09-16T07:35:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb41fbb10 con 0x7f1fb40cefb0 2024-09-16T07:35:57.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb40b29e0 con 0x7f1fb40cefb0 2024-09-16T07:35:57.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.777+0000 7f1fb0c00640 1 -- 172.21.15.114:0/3875882538 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f1fa0003600 con 0x7f1fb40cefb0 2024-09-16T07:35:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.781+0000 7f1fb0c00640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1f94073730 0x7f1f94075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.781+0000 7f1fb0c00640 1 -- 172.21.15.114:0/3875882538 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f1fa0094ba0 con 0x7f1fb40cefb0 2024-09-16T07:35:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.781+0000 7f1fb9000640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1f94073730 0x7f1f94075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.781+0000 7f1fb9000640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1f94073730 0x7f1f94075bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009b40 tx=0x7f1fa80091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:57.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.785+0000 7f1fb0c00640 1 -- 172.21.15.114:0/3875882538 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1fb40cf400 con 0x7f1fb40cefb0 2024-09-16T07:35:57.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fb406d0d0 con 0x7f1fb40cefb0 2024-09-16T07:35:57.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fb0c00640 1 -- 172.21.15.114:0/3875882538 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5241 (secure 0 0 0) 0x7f1fa005e750 con 0x7f1fb40cefb0 2024-09-16T07:35:57.986 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:57.986 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":104,"btime":"2024-09-16T07:35:44:680761+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4246164040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4246164040},{"type":"v1","addr":"172.21.15.114:6833","nonce":4246164040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2023547758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":2023547758},{"type":"v1","addr":"172.21.15.149:6835","nonce":2023547758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8409,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/4110489344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":4110489344},{"type":"v1","addr":"172.21.15.149:6834","nonce":4110489344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:35:35.026388+0000","modified":"2024-09-16T07:35:38.048575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8415":{"gid":8415,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1141336969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1141336969},{"type":"v1","addr":"172.21.15.114:6835","nonce":1141336969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8415,"qdb_cluster":[8415]},"id":11}]} 2024-09-16T07:35:57.987 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 104 2024-09-16T07:35:57.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1f94073730 msgr2=0x7f1f94075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1f94073730 0x7f1f94075bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009b40 tx=0x7f1fa80091e0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40cefb0 msgr2=0x7f1fb41519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40cefb0 0x7f1fb41519e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c4e0 tx=0x7f1fa000c9a0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 shutdown_connections 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1f94073730 0x7f1f94075bf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1fb415f000 0x7f1fb406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb40cefb0 0x7f1fb41519e0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 --2- 172.21.15.114:0/3875882538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb40b2590 0x7f1fb4164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 >> 172.21.15.114:0/3875882538 conn(0x7f1fb409aa10 msgr2=0x7f1fb40aeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 shutdown_connections 2024-09-16T07:35:57.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:57.989+0000 7f1fba400640 1 -- 172.21.15.114:0/3875882538 wait complete. 2024-09-16T07:35:58.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 -- 172.21.15.114:0/606651202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec15ade0 msgr2=0x7f3cec0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 --2- 172.21.15.114:0/606651202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec15ade0 0x7f3cec0cebf0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f3cec070d80 tx=0x7f3ce001c5d0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 -- 172.21.15.114:0/606651202 shutdown_connections 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 --2- 172.21.15.114:0/606651202 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cec0b4bd0 0x7f3cec15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 --2- 172.21.15.114:0/606651202 >> v2:172.21.15.149:3300/0 conn(0x7f3cec06e810 0x7f3cec0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 --2- 172.21.15.114:0/606651202 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec15ade0 0x7f3cec0cebf0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 -- 172.21.15.114:0/606651202 >> 172.21.15.114:0/606651202 conn(0x7f3cec0b18f0 msgr2=0x7f3cec0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 -- 172.21.15.114:0/606651202 shutdown_connections 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.149+0000 7f3cf4200640 1 -- 172.21.15.114:0/606651202 wait complete. 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 Processor -- start 2024-09-16T07:35:58.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 -- start start 2024-09-16T07:35:58.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec06e810 0x7f3cec1f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cec0b4bd0 0x7f3cec0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cec15ade0 0x7f3cec1f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec0cdf30 con 0x7f3cec06e810 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec0cddb0 con 0x7f3cec15ade0 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3cec0ce0b0 con 0x7f3cec0b4bd0 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec06e810 0x7f3cec1f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec06e810 0x7f3cec1f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36348/0 (socket says 172.21.15.114:36348) 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 -- 172.21.15.114:0/3512329001 learned_addr learned my addr 172.21.15.114:0/3512329001 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 -- 172.21.15.114:0/3512329001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cec0b4bd0 msgr2=0x7f3cec0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cec0b4bd0 0x7f3cec0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 -- 172.21.15.114:0/3512329001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cec15ade0 msgr2=0x7f3cec1f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cec15ade0 0x7f3cec1f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 -- 172.21.15.114:0/3512329001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec1f55f0 con 0x7f3cec06e810 2024-09-16T07:35:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf1800640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec06e810 0x7f3cec1f5dd0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f3ce001ac80 tx=0x7f3ce00a95d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3ce9600640 1 -- 172.21.15.114:0/3512329001 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00ad070 con 0x7f3cec06e810 2024-09-16T07:35:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3ce9600640 1 -- 172.21.15.114:0/3512329001 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ce00a9d80 con 0x7f3cec06e810 2024-09-16T07:35:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3ce9600640 1 -- 172.21.15.114:0/3512329001 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0005290 con 0x7f3cec06e810 2024-09-16T07:35:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cec1f9440 con 0x7f3cec06e810 2024-09-16T07:35:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.153+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cec1f58b0 con 0x7f3cec06e810 2024-09-16T07:35:58.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.157+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cec069410 con 0x7f3cec06e810 2024-09-16T07:35:58.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.157+0000 7f3ce9600640 1 -- 172.21.15.114:0/3512329001 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f3ce00b0070 con 0x7f3cec06e810 2024-09-16T07:35:58.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.157+0000 7f3ce9600640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3ccc073730 0x7f3ccc075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.157+0000 7f3ce9600640 1 -- 172.21.15.114:0/3512329001 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f3ce012ef70 con 0x7f3cec06e810 2024-09-16T07:35:58.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.157+0000 7f3cf0e00640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3ccc073730 0x7f3ccc075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.157+0000 7f3cf0e00640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3ccc073730 0x7f3ccc075bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3cec15e840 tx=0x7f3cd8005c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:58.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.161+0000 7f3ce9600640 1 -- 172.21.15.114:0/3512329001 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3ce00c0070 con 0x7f3cec06e810 2024-09-16T07:35:58.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cec0cf720 con 0x7f3cec06e810 2024-09-16T07:35:58.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3ce9600640 1 -- 172.21.15.114:0/3512329001 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5241 (secure 0 0 0) 0x7f3ce00164b0 con 0x7f3cec06e810 2024-09-16T07:35:58.359 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:58.359 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":104,"btime":"2024-09-16T07:35:44:680761+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4246164040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4246164040},{"type":"v1","addr":"172.21.15.114:6833","nonce":4246164040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2023547758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":2023547758},{"type":"v1","addr":"172.21.15.149:6835","nonce":2023547758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8409,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/4110489344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":4110489344},{"type":"v1","addr":"172.21.15.149:6834","nonce":4110489344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:35:35.026388+0000","modified":"2024-09-16T07:35:38.048575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8415":{"gid":8415,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1141336969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1141336969},{"type":"v1","addr":"172.21.15.114:6835","nonce":1141336969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8415,"qdb_cluster":[8415]},"id":11}]} 2024-09-16T07:35:58.360 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 104 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3ccc073730 msgr2=0x7f3ccc075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3ccc073730 0x7f3ccc075bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3cec15e840 tx=0x7f3cd8005c10 comp rx=0 tx=0).stop 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec06e810 msgr2=0x7f3cec1f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec06e810 0x7f3cec1f5dd0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f3ce001ac80 tx=0x7f3ce00a95d0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 shutdown_connections 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cec15ade0 0x7f3cec1f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3ccc073730 0x7f3ccc075bf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3cec0b4bd0 0x7f3cec0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 --2- 172.21.15.114:0/3512329001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cec06e810 0x7f3cec1f5dd0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.361+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 >> 172.21.15.114:0/3512329001 conn(0x7f3cec0b18f0 msgr2=0x7f3cec06f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.365+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 shutdown_connections 2024-09-16T07:35:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.365+0000 7f3cf4200640 1 -- 172.21.15.114:0/3512329001 wait complete. 2024-09-16T07:35:58.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.529+0000 7f53dc600640 1 -- 172.21.15.114:0/806498594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 msgr2=0x7f53bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.529+0000 7f53dc600640 1 --2- 172.21.15.114:0/806498594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 0x7f53bc004810 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009b60 tx=0x7f53c001d270 comp rx=0 tx=0).stop 2024-09-16T07:35:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.529+0000 7f53da600640 1 -- 172.21.15.114:0/806498594 reap_dead start 2024-09-16T07:35:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.529+0000 7f53dc600640 1 -- 172.21.15.114:0/806498594 shutdown_connections 2024-09-16T07:35:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.529+0000 7f53dc600640 1 -- 172.21.15.114:0/806498594 >> 172.21.15.114:0/806498594 conn(0x7f53d40d1e30 msgr2=0x7f53d40d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.529+0000 7f53dc600640 1 -- 172.21.15.114:0/806498594 shutdown_connections 2024-09-16T07:35:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.529+0000 7f53dc600640 1 -- 172.21.15.114:0/806498594 wait complete. 2024-09-16T07:35:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 Processor -- start 2024-09-16T07:35:58.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 -- start start 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 0x7f53d40cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d41f53b0 0x7f53d4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53d415e3d0 0x7f53d40ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40d09e0 con 0x7f53bc004030 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40d0860 con 0x7f53d41f53b0 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f53d40afc50 con 0x7f53d415e3d0 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 0x7f53d40cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 0x7f53d40cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36366/0 (socket says 172.21.15.114:36366) 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 -- 172.21.15.114:0/839100857 learned_addr learned my addr 172.21.15.114:0/839100857 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9200640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d41f53b0 0x7f53d4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53da600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53d415e3d0 0x7f53d40ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 -- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53d415e3d0 msgr2=0x7f53d40ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53d415e3d0 0x7f53d40ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 -- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d41f53b0 msgr2=0x7f53d4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d41f53b0 0x7f53d4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 -- 172.21.15.114:0/839100857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40c63e0 con 0x7f53bc004030 2024-09-16T07:35:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d9c00640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 0x7f53d40cc760 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f53c8001cb0 tx=0x7f53c800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d1600640 1 -- 172.21.15.114:0/839100857 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8015070 con 0x7f53bc004030 2024-09-16T07:35:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d1600640 1 -- 172.21.15.114:0/839100857 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53c8010980 con 0x7f53bc004030 2024-09-16T07:35:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d40c7ec0 con 0x7f53bc004030 2024-09-16T07:35:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53d1600640 1 -- 172.21.15.114:0/839100857 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8010dd0 con 0x7f53bc004030 2024-09-16T07:35:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d41543d0 con 0x7f53bc004030 2024-09-16T07:35:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.533+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d40af710 con 0x7f53bc004030 2024-09-16T07:35:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.537+0000 7f53d1600640 1 -- 172.21.15.114:0/839100857 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f53c8018070 con 0x7f53bc004030 2024-09-16T07:35:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.537+0000 7f53d1600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53b4073760 0x7f53b4075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.537+0000 7f53d1600640 1 -- 172.21.15.114:0/839100857 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f53c8095460 con 0x7f53bc004030 2024-09-16T07:35:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.537+0000 7f53d9200640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53b4073760 0x7f53b4075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.537+0000 7f53d9200640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53b4073760 0x7f53b4075c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f53c00ae000 tx=0x7f53c001a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:58.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.541+0000 7f53d1600640 1 -- 172.21.15.114:0/839100857 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f53d40c63e0 con 0x7f53bc004030 2024-09-16T07:35:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.713+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53d40c83e0 con 0x7f53bc004030 2024-09-16T07:35:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.713+0000 7f53d1600640 1 -- 172.21.15.114:0/839100857 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16823 (secure 0 0 0) 0x7f53c805f010 con 0x7f53bc004030 2024-09-16T07:35:58.712 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:58.712 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":141,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:35:36.642863+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:35:32.721475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-16T07:35:33.996800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53b4073760 msgr2=0x7f53b4075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53b4073760 0x7f53b4075c20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f53c00ae000 tx=0x7f53c001a010 comp rx=0 tx=0).stop 2024-09-16T07:35:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 msgr2=0x7f53d40cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 0x7f53d40cc760 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f53c8001cb0 tx=0x7f53c800ea20 comp rx=0 tx=0).stop 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 shutdown_connections 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53b4073760 0x7f53b4075c20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f53d415e3d0 0x7f53d40ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f53d41f53b0 0x7f53d4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 --2- 172.21.15.114:0/839100857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53bc004030 0x7f53d40cc760 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 >> 172.21.15.114:0/839100857 conn(0x7f53d40d1e30 msgr2=0x7f53d40b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 shutdown_connections 2024-09-16T07:35:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.717+0000 7f53dc600640 1 -- 172.21.15.114:0/839100857 wait complete. 2024-09-16T07:35:58.735 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:35:58.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- 172.21.15.114:0/14205428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 msgr2=0x7fd5b00d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 --2- 172.21.15.114:0/14205428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b00d01b0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009bc0 tx=0x7fd5a001cb10 comp rx=0 tx=0).stop 2024-09-16T07:35:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- 172.21.15.114:0/14205428 shutdown_connections 2024-09-16T07:35:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 --2- 172.21.15.114:0/14205428 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5b00b2590 0x7fd5b00b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 --2- 172.21.15.114:0/14205428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b00d01b0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- 172.21.15.114:0/14205428 >> 172.21.15.114:0/14205428 conn(0x7fd5b009aa10 msgr2=0x7fd5b009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- 172.21.15.114:0/14205428 shutdown_connections 2024-09-16T07:35:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- 172.21.15.114:0/14205428 wait complete. 2024-09-16T07:35:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 Processor -- start 2024-09-16T07:35:58.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- start start 2024-09-16T07:35:58.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5b00b2590 0x7fd5b01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5b00cefb0 0x7fd5b0150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b0151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0168f10 con 0x7fd5b015f000 2024-09-16T07:35:58.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0168d90 con 0x7fd5b00cefb0 2024-09-16T07:35:58.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.881+0000 7fd5af200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b0169090 con 0x7fd5b00b2590 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5a5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5b00cefb0 0x7fd5b0150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b0151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b0151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36376/0 (socket says 172.21.15.114:36376) 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 -- 172.21.15.114:0/2674160522 learned_addr learned my addr 172.21.15.114:0/2674160522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5a5400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5b00cefb0 0x7fd5b0150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:41798/0 (socket says 172.21.15.114:41798) 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ade00640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5b00b2590 0x7fd5b01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 -- 172.21.15.114:0/2674160522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5b00b2590 msgr2=0x7fd5b01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5b00b2590 0x7fd5b01500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 -- 172.21.15.114:0/2674160522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5b00cefb0 msgr2=0x7fd5b0150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5b00cefb0 0x7fd5b0150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 -- 172.21.15.114:0/2674160522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b01505f0 con 0x7fd5b015f000 2024-09-16T07:35:58.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5ae800640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b0151450 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800d7b0 tx=0x7fd5a800dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:58.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2674160522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8017070 con 0x7fd5b015f000 2024-09-16T07:35:58.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2674160522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5a8009d20 con 0x7fd5b015f000 2024-09-16T07:35:58.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2674160522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8004280 con 0x7fd5b015f000 2024-09-16T07:35:58.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b006e6f0 con 0x7fd5b015f000 2024-09-16T07:35:58.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b006ec70 con 0x7fd5b015f000 2024-09-16T07:35:58.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b00af4e0 con 0x7fd5b015f000 2024-09-16T07:35:58.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.885+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2674160522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fd5a8003600 con 0x7fd5b015f000 2024-09-16T07:35:58.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.889+0000 7fd5a6a00640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd58c073730 0x7fd58c075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:58.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.889+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2674160522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fd5a8095290 con 0x7fd5b015f000 2024-09-16T07:35:58.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.889+0000 7fd5ade00640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd58c073730 0x7fd58c075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:58.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.889+0000 7fd5ade00640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd58c073730 0x7fd58c075bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00af000 tx=0x7fd5a001b350 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:58.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:58.893+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2674160522 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd5a805ee40 con 0x7fd5b015f000 2024-09-16T07:35:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5b0070970 con 0x7fd5b015f000 2024-09-16T07:35:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5a6a00640 1 -- 172.21.15.114:0/2674160522 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5241 (secure 0 0 0) 0x7fd5a8063870 con 0x7fd5b015f000 2024-09-16T07:35:59.091 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:59.091 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":104,"btime":"2024-09-16T07:35:44:680761+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4246164040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4246164040},{"type":"v1","addr":"172.21.15.114:6833","nonce":4246164040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2023547758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":2023547758},{"type":"v1","addr":"172.21.15.149:6835","nonce":2023547758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8409,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/4110489344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":4110489344},{"type":"v1","addr":"172.21.15.149:6834","nonce":4110489344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:35:35.026388+0000","modified":"2024-09-16T07:35:38.048575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8415":{"gid":8415,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1141336969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1141336969},{"type":"v1","addr":"172.21.15.114:6835","nonce":1141336969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8415,"qdb_cluster":[8415]},"id":11}]} 2024-09-16T07:35:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 104 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd58c073730 msgr2=0x7fd58c075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd58c073730 0x7fd58c075bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00af000 tx=0x7fd5a001b350 comp rx=0 tx=0).stop 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 msgr2=0x7fd5b0151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b0151450 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800d7b0 tx=0x7fd5a800dc70 comp rx=0 tx=0).stop 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 shutdown_connections 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5b015f000 0x7fd5b0151450 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5b00cefb0 0x7fd5b0150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd58c073730 0x7fd58c075bf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 --2- 172.21.15.114:0/2674160522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd5b00b2590 0x7fd5b01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 >> 172.21.15.114:0/2674160522 conn(0x7fd5b009aa10 msgr2=0x7fd5b00aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 shutdown_connections 2024-09-16T07:35:59.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.093+0000 7fd5af200640 1 -- 172.21.15.114:0/2674160522 wait complete. 2024-09-16T07:35:59.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:35:59.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.253+0000 7f86da000640 1 -- 172.21.15.114:0/2963913665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 msgr2=0x7f86b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.253+0000 7f86da000640 1 --2- 172.21.15.114:0/2963913665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 0x7f86b8004c90 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009b90 tx=0x7f86bc01d2b0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.253+0000 7f86d3e00640 1 -- 172.21.15.114:0/2963913665 reap_dead start 2024-09-16T07:35:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.253+0000 7f86da000640 1 -- 172.21.15.114:0/2963913665 shutdown_connections 2024-09-16T07:35:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.253+0000 7f86da000640 1 -- 172.21.15.114:0/2963913665 >> 172.21.15.114:0/2963913665 conn(0x7f86d40d1dc0 msgr2=0x7f86d40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 -- 172.21.15.114:0/2963913665 shutdown_connections 2024-09-16T07:35:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 -- 172.21.15.114:0/2963913665 wait complete. 2024-09-16T07:35:59.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 Processor -- start 2024-09-16T07:35:59.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 -- start start 2024-09-16T07:35:59.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 0x7f86d40c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86d40b25a0 0x7f86d40b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86d414dc60 0x7f86d414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86d415c470 con 0x7f86b8004810 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40d2af0 con 0x7f86d414dc60 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86da000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f86d40aeef0 con 0x7f86d40b25a0 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 0x7f86d40c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 0x7f86d40c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36396/0 (socket says 172.21.15.114:36396) 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 -- 172.21.15.114:0/525131821 learned_addr learned my addr 172.21.15.114:0/525131821 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3e00640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86d414dc60 0x7f86d414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86caa00640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86d40b25a0 0x7f86d40b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 -- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86d40b25a0 msgr2=0x7f86d40b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86d40b25a0 0x7f86d40b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 -- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86d414dc60 msgr2=0x7f86d414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86d414dc60 0x7f86d414e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 -- 172.21.15.114:0/525131821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d414e8b0 con 0x7f86b8004810 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86caa00640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86d40b25a0 0x7f86d40b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86d3400640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 0x7f86d40c7c70 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f86c40046d0 tx=0x7f86c40127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.257+0000 7f86cbe00640 1 -- 172.21.15.114:0/525131821 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4010890 con 0x7f86b8004810 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86cbe00640 1 -- 172.21.15.114:0/525131821 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86c4010a50 con 0x7f86b8004810 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86cbe00640 1 -- 172.21.15.114:0/525131821 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4013450 con 0x7f86b8004810 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d414eb90 con 0x7f86b8004810 2024-09-16T07:35:59.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d414f150 con 0x7f86b8004810 2024-09-16T07:35:59.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d40ae9b0 con 0x7f86b8004810 2024-09-16T07:35:59.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86cbe00640 1 -- 172.21.15.114:0/525131821 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f86c40135f0 con 0x7f86b8004810 2024-09-16T07:35:59.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86cbe00640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86b0073760 0x7f86b0075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86cbe00640 1 -- 172.21.15.114:0/525131821 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f86c4098b70 con 0x7f86b8004810 2024-09-16T07:35:59.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.261+0000 7f86caa00640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86b0073760 0x7f86b0075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.265+0000 7f86caa00640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86b0073760 0x7f86b0075c20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae000 tx=0x7f86bc01a050 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:59.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.265+0000 7f86cbe00640 1 -- 172.21.15.114:0/525131821 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f86c40631c0 con 0x7f86b8004810 2024-09-16T07:35:59.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.469+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86d41e1d40 con 0x7f86b8004810 2024-09-16T07:35:59.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86cbe00640 1 -- 172.21.15.114:0/525131821 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5241 (secure 0 0 0) 0x7f86c4062ac0 con 0x7f86b8004810 2024-09-16T07:35:59.470 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:59.470 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":104,"btime":"2024-09-16T07:35:44:680761+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4246164040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4246164040},{"type":"v1","addr":"172.21.15.114:6833","nonce":4246164040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2023547758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":2023547758},{"type":"v1","addr":"172.21.15.149:6835","nonce":2023547758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8409,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/4110489344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":4110489344},{"type":"v1","addr":"172.21.15.149:6834","nonce":4110489344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:35:35.026388+0000","modified":"2024-09-16T07:35:38.048575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8415},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8415":{"gid":8415,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/1141336969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1141336969},{"type":"v1","addr":"172.21.15.114:6835","nonce":1141336969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8415,"qdb_cluster":[8415]},"id":11}]} 2024-09-16T07:35:59.470 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 104 2024-09-16T07:35:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86b0073760 msgr2=0x7f86b0075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86b0073760 0x7f86b0075c20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae000 tx=0x7f86bc01a050 comp rx=0 tx=0).stop 2024-09-16T07:35:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 msgr2=0x7f86d40c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 0x7f86d40c7c70 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f86c40046d0 tx=0x7f86c40127b0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 shutdown_connections 2024-09-16T07:35:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86d414dc60 0x7f86d414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f86b0073760 0x7f86b0075c20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f86d40b25a0 0x7f86d40b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 --2- 172.21.15.114:0/525131821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86b8004810 0x7f86d40c7c70 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 >> 172.21.15.114:0/525131821 conn(0x7f86d40d1dc0 msgr2=0x7f86d40b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 shutdown_connections 2024-09-16T07:35:59.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.473+0000 7f86da000640 1 -- 172.21.15.114:0/525131821 wait complete. 2024-09-16T07:35:59.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:35:59.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 -- 172.21.15.114:0/2687625688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c06d330 msgr2=0x7f717c06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 --2- 172.21.15.114:0/2687625688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c06d330 0x7f717c06fa60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7174009bc0 tx=0x7f717401cac0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 -- 172.21.15.114:0/2687625688 shutdown_connections 2024-09-16T07:35:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 --2- 172.21.15.114:0/2687625688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c06d330 0x7f717c06fa60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 --2- 172.21.15.114:0/2687625688 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f717c073170 0x7f717c06f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 -- 172.21.15.114:0/2687625688 >> 172.21.15.114:0/2687625688 conn(0x7f717c0b2240 msgr2=0x7f717c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 -- 172.21.15.114:0/2687625688 shutdown_connections 2024-09-16T07:35:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.633+0000 7f7181200640 1 -- 172.21.15.114:0/2687625688 wait complete. 2024-09-16T07:35:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 Processor -- start 2024-09-16T07:35:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 -- start start 2024-09-16T07:35:59.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c06d330 0x7f717c12da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c073170 0x7f717c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f717c0ce800 0x7f717c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1683e0 con 0x7f717c06d330 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f717c168260 con 0x7f717c073170 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f717c168560 con 0x7f717c0ce800 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c06d330 0x7f717c12da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c06d330 0x7f717c12da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36412/0 (socket says 172.21.15.114:36412) 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 -- 172.21.15.114:0/1404608669 learned_addr learned my addr 172.21.15.114:0/1404608669 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7171400640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c073170 0x7f717c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f717a800640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f717c0ce800 0x7f717c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 -- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f717c0ce800 msgr2=0x7f717c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f717c0ce800 0x7f717c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 -- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c073170 msgr2=0x7f717c15c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c073170 0x7f717c15c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 -- 172.21.15.114:0/1404608669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c12e510 con 0x7f717c06d330 2024-09-16T07:35:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f717a800640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f717c0ce800 0x7f717c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:35:59.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7179e00640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c06d330 0x7f717c12da50 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c6e0 tx=0x7f716c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:59.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7172a00640 1 -- 172.21.15.114:0/1404608669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c016020 con 0x7f717c06d330 2024-09-16T07:35:59.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7172a00640 1 -- 172.21.15.114:0/1404608669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f716c00a8d0 con 0x7f717c06d330 2024-09-16T07:35:59.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7172a00640 1 -- 172.21.15.114:0/1404608669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c00ad20 con 0x7f717c06d330 2024-09-16T07:35:59.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c12e7f0 con 0x7f717c06d330 2024-09-16T07:35:59.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c1401d0 con 0x7f717c06d330 2024-09-16T07:35:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.637+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c12b9c0 con 0x7f717c06d330 2024-09-16T07:35:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.641+0000 7f7172a00640 1 -- 172.21.15.114:0/1404608669 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f716c019020 con 0x7f717c06d330 2024-09-16T07:35:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.641+0000 7f7172a00640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7158073730 0x7f7158075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.641+0000 7f7172a00640 1 -- 172.21.15.114:0/1404608669 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f716c095220 con 0x7f717c06d330 2024-09-16T07:35:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.641+0000 7f7171400640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7158073730 0x7f7158075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.641+0000 7f7171400640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7158073730 0x7f7158075bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f717c0affc0 tx=0x7f7164005f40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:59.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.645+0000 7f7172a00640 1 -- 172.21.15.114:0/1404608669 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f716c020020 con 0x7f717c06d330 2024-09-16T07:35:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f717c06cc20 con 0x7f717c06d330 2024-09-16T07:35:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7172a00640 1 -- 172.21.15.114:0/1404608669 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16823 (secure 0 0 0) 0x7f716c05f390 con 0x7f717c06d330 2024-09-16T07:35:59.819 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:35:59.820 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":141,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:35:36.642863+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:35:32.721475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-16T07:35:33.996800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:35:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7158073730 msgr2=0x7f7158075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7158073730 0x7f7158075bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f717c0affc0 tx=0x7f7164005f40 comp rx=0 tx=0).stop 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c06d330 msgr2=0x7f717c12da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c06d330 0x7f717c12da50 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c6e0 tx=0x7f716c00cba0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 shutdown_connections 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7158073730 0x7f7158075bf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f717c0ce800 0x7f717c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f717c073170 0x7f717c15c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.821+0000 7f7181200640 1 --2- 172.21.15.114:0/1404608669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f717c06d330 0x7f717c12da50 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.825+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 >> 172.21.15.114:0/1404608669 conn(0x7f717c0b2240 msgr2=0x7f717c06f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.825+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 shutdown_connections 2024-09-16T07:35:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.825+0000 7f7181200640 1 -- 172.21.15.114:0/1404608669 wait complete. 2024-09-16T07:35:59.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 -- 172.21.15.114:0/739507372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280b2e80 msgr2=0x7f0a280b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 --2- 172.21.15.114:0/739507372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280b2e80 0x7f0a280b1bd0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009840 tx=0x7f0a1001c760 comp rx=0 tx=0).stop 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 -- 172.21.15.114:0/739507372 shutdown_connections 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 --2- 172.21.15.114:0/739507372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a280afca0 0x7f0a280b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 --2- 172.21.15.114:0/739507372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a280b2e80 0x7f0a280b1bd0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 -- 172.21.15.114:0/739507372 >> 172.21.15.114:0/739507372 conn(0x7f0a280d1e30 msgr2=0x7f0a280d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 -- 172.21.15.114:0/739507372 shutdown_connections 2024-09-16T07:35:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 -- 172.21.15.114:0/739507372 wait complete. 2024-09-16T07:35:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 Processor -- start 2024-09-16T07:35:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 -- start start 2024-09-16T07:35:59.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a280afca0 0x7f0a28154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.985+0000 7f0a2f600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a280b2e80 0x7f0a280c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2815f490 0x7f0a2815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28168e00 con 0x7f0a2815f490 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2f600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28168c80 con 0x7f0a280afca0 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2f600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0a28168f80 con 0x7f0a280b2e80 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2815f490 0x7f0a2815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2815f490 0x7f0a2815af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36424/0 (socket says 172.21.15.114:36424) 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 -- 172.21.15.114:0/2711827548 learned_addr learned my addr 172.21.15.114:0/2711827548 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2cc00640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a280afca0 0x7f0a28154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a1fe00640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a280b2e80 0x7f0a280c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 -- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a280b2e80 msgr2=0x7f0a280c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a280b2e80 0x7f0a280c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 -- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a280afca0 msgr2=0x7f0a28154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a280afca0 0x7f0a28154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 -- 172.21.15.114:0/2711827548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a280c8540 con 0x7f0a2815f490 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2d600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2815f490 0x7f0a2815af30 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000da40 tx=0x7f0a2000df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a25600640 1 -- 172.21.15.114:0/2711827548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20017070 con 0x7f0a2815f490 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a25600640 1 -- 172.21.15.114:0/2711827548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a20004b30 con 0x7f0a2815f490 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a25600640 1 -- 172.21.15.114:0/2711827548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20005020 con 0x7f0a2815f490 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a280c8820 con 0x7f0a2815f490 2024-09-16T07:35:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a281f8e20 con 0x7f0a2815f490 2024-09-16T07:35:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a280b0110 con 0x7f0a2815f490 2024-09-16T07:35:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.989+0000 7f0a25600640 1 -- 172.21.15.114:0/2711827548 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f0a200051c0 con 0x7f0a2815f490 2024-09-16T07:35:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.993+0000 7f0a25600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a04073730 0x7f0a04075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:35:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.993+0000 7f0a25600640 1 -- 172.21.15.114:0/2711827548 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f0a200953d0 con 0x7f0a2815f490 2024-09-16T07:35:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.993+0000 7f0a2cc00640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a04073730 0x7f0a04075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:35:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.993+0000 7f0a2cc00640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a04073730 0x7f0a04075bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f70 tx=0x7f0a18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:35:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:35:59.997+0000 7f0a25600640 1 -- 172.21.15.114:0/2711827548 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0a20020070 con 0x7f0a2815f490 2024-09-16T07:36:00.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.197+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0a28154560 con 0x7f0a2815f490 2024-09-16T07:36:00.195 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:36:00.197+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:36:00.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.197+0000 7f0a25600640 1 -- 172.21.15.114:0/2711827548 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) ==== 161+0+0 (secure 0 0 0) 0x7f0a2005f010 con 0x7f0a2815f490 2024-09-16T07:36:00.197 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a04073730 msgr2=0x7f0a04075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a04073730 0x7f0a04075bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0a18000f70 tx=0x7f0a18009040 comp rx=0 tx=0).stop 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2815f490 msgr2=0x7f0a2815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2815f490 0x7f0a2815af30 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000da40 tx=0x7f0a2000df00 comp rx=0 tx=0).stop 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 shutdown_connections 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a2815f490 0x7f0a2815af30 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0a04073730 0x7f0a04075bf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0a280b2e80 0x7f0a280c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 --2- 172.21.15.114:0/2711827548 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a280afca0 0x7f0a28154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 >> 172.21.15.114:0/2711827548 conn(0x7f0a280d1e30 msgr2=0x7f0a280cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 shutdown_connections 2024-09-16T07:36:00.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.201+0000 7f0a2f600640 1 -- 172.21.15.114:0/2711827548 wait complete. 2024-09-16T07:36:00.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:36:00.265 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:36:00.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 -- 172.21.15.114:0/2112699204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a00c58b0 msgr2=0x7f05a00703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:00.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 --2- 172.21.15.114:0/2112699204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a00c58b0 0x7f05a00703d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f058801c860 comp rx=0 tx=0).stop 2024-09-16T07:36:00.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 -- 172.21.15.114:0/2112699204 shutdown_connections 2024-09-16T07:36:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 --2- 172.21.15.114:0/2112699204 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a00c58b0 0x7f05a00703d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 -- 172.21.15.114:0/2112699204 >> 172.21.15.114:0/2112699204 conn(0x7f05a0071420 msgr2=0x7f05a006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 -- 172.21.15.114:0/2112699204 shutdown_connections 2024-09-16T07:36:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 -- 172.21.15.114:0/2112699204 wait complete. 2024-09-16T07:36:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 Processor -- start 2024-09-16T07:36:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.373+0000 7f05a6200640 1 -- start start 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a0070910 0x7f05a0149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05a00c58b0 0x7f05a014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05a0155180 0x7f05a0157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0168f00 con 0x7f05a00c58b0 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0168d80 con 0x7f05a0155180 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f05a0169080 con 0x7f05a0070910 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05a00c58b0 0x7f05a014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05a00c58b0 0x7f05a014dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36466/0 (socket says 172.21.15.114:36466) 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 -- 172.21.15.114:0/967168604 learned_addr learned my addr 172.21.15.114:0/967168604 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f059f400640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a0070910 0x7f05a0149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f059fe00640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05a0155180 0x7f05a0157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 -- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a0070910 msgr2=0x7f05a0149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a0070910 0x7f05a0149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 -- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05a0155180 msgr2=0x7f05a0157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05a0155180 0x7f05a0157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 -- 172.21.15.114:0/967168604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a01570d0 con 0x7f05a00c58b0 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f059fe00640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05a0155180 0x7f05a0157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0596a00640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05a00c58b0 0x7f05a014dfd0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f0588019470 tx=0x7f0588005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0597e00640 1 -- 172.21.15.114:0/967168604 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880b2040 con 0x7f05a00c58b0 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0597e00640 1 -- 172.21.15.114:0/967168604 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0588004130 con 0x7f05a00c58b0 2024-09-16T07:36:00.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a0157370 con 0x7f05a00c58b0 2024-09-16T07:36:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0597e00640 1 -- 172.21.15.114:0/967168604 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588003600 con 0x7f05a00c58b0 2024-09-16T07:36:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a0157930 con 0x7f05a00c58b0 2024-09-16T07:36:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a00703d0 con 0x7f05a00c58b0 2024-09-16T07:36:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.377+0000 7f0597e00640 1 -- 172.21.15.114:0/967168604 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f05880bd030 con 0x7f05a00c58b0 2024-09-16T07:36:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.381+0000 7f0597e00640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f057c073730 0x7f057c075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.381+0000 7f0597e00640 1 -- 172.21.15.114:0/967168604 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5823+0+0 (secure 0 0 0) 0x7f058812e690 con 0x7f05a00c58b0 2024-09-16T07:36:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.381+0000 7f059f400640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f057c073730 0x7f057c075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:00.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.381+0000 7f059f400640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f057c073730 0x7f057c075bf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0590007fd0 tx=0x7f0590009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:00.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.385+0000 7f0597e00640 1 -- 172.21.15.114:0/967168604 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f05880c4060 con 0x7f05a00c58b0 2024-09-16T07:36:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:00.589+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f05a00b26b0 con 0x7f05a00c58b0 2024-09-16T07:36:01.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.205+0000 7f0597e00640 1 -- 172.21.15.114:0/967168604 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) ==== 104+0+0 (secure 0 0 0) 0x7f0588016450 con 0x7f05a00c58b0 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f057c073730 msgr2=0x7f057c075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f057c073730 0x7f057c075bf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0590007fd0 tx=0x7f0590009040 comp rx=0 tx=0).stop 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05a00c58b0 msgr2=0x7f05a014dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05a00c58b0 0x7f05a014dfd0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f0588019470 tx=0x7f0588005ca0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 shutdown_connections 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05a0155180 0x7f05a0157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05a00c58b0 0x7f05a014dfd0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f057c073730 0x7f057c075bf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 --2- 172.21.15.114:0/967168604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05a0070910 0x7f05a0149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 >> 172.21.15.114:0/967168604 conn(0x7f05a0071420 msgr2=0x7f05a00b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:01.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 shutdown_connections 2024-09-16T07:36:01.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.209+0000 7f05a6200640 1 -- 172.21.15.114:0/967168604 wait complete. 2024-09-16T07:36:01.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 -- 172.21.15.114:0/1039931699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 msgr2=0x7f6a300d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 --2- 172.21.15.114:0/1039931699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300d28c0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009900 tx=0x7f6a2401c8b0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 -- 172.21.15.114:0/1039931699 shutdown_connections 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 --2- 172.21.15.114:0/1039931699 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a3015f700 0x7f6a300d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 --2- 172.21.15.114:0/1039931699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300d28c0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 -- 172.21.15.114:0/1039931699 >> 172.21.15.114:0/1039931699 conn(0x7f6a300d1da0 msgr2=0x7f6a300d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 -- 172.21.15.114:0/1039931699 shutdown_connections 2024-09-16T07:36:01.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 -- 172.21.15.114:0/1039931699 wait complete. 2024-09-16T07:36:01.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 Processor -- start 2024-09-16T07:36:01.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.421+0000 7f6a36400640 1 -- start start 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a300d02e0 0x7f6a300b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3015f700 0x7f6a301f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300b0bb0 con 0x7f6a300cff00 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300b0a30 con 0x7f6a3015f700 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a300b0d30 con 0x7f6a300d02e0 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36482/0 (socket says 172.21.15.114:36482) 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 -- 172.21.15.114:0/321356941 learned_addr learned my addr 172.21.15.114:0/321356941 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a2fe00640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a300d02e0 0x7f6a300b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35a00640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3015f700 0x7f6a301f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:01.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 -- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a300d02e0 msgr2=0x7f6a300b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:01.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a300d02e0 0x7f6a300b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 -- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3015f700 msgr2=0x7f6a301f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:01.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3015f700 0x7f6a301f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:01.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 -- 172.21.15.114:0/321356941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a300cf240 con 0x7f6a300cff00 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a35000640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300b6ea0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6a240b0040 tx=0x7f6a24005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a2cc00640 1 -- 172.21.15.114:0/321356941 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a240ba020 con 0x7f6a300cff00 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a2cc00640 1 -- 172.21.15.114:0/321356941 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a240053e0 con 0x7f6a300cff00 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a300b6940 con 0x7f6a300cff00 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a2cc00640 1 -- 172.21.15.114:0/321356941 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a240b2040 con 0x7f6a300cff00 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a300b7920 con 0x7f6a300cff00 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.425+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a300d28c0 con 0x7f6a300cff00 2024-09-16T07:36:01.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.429+0000 7f6a2cc00640 1 -- 172.21.15.114:0/321356941 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f6a240046d0 con 0x7f6a300cff00 2024-09-16T07:36:01.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.429+0000 7f6a2cc00640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a10073720 0x7f6a10075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:01.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.429+0000 7f6a2cc00640 1 -- 172.21.15.114:0/321356941 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5823+0+0 (secure 0 0 0) 0x7f6a2412ef50 con 0x7f6a300cff00 2024-09-16T07:36:01.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.429+0000 7f6a2fe00640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a10073720 0x7f6a10075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:01.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.429+0000 7f6a2fe00640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a10073720 0x7f6a10075be0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6a3015c550 tx=0x7f6a1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:01.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.433+0000 7f6a2cc00640 1 -- 172.21.15.114:0/321356941 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6a240c4060 con 0x7f6a300cff00 2024-09-16T07:36:01.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:01.601+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a30156070 con 0x7f6a300cff00 2024-09-16T07:36:02.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a2cc00640 1 -- 172.21.15.114:0/321356941 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v143) ==== 181+0+0 (secure 0 0 0) 0x7f6a240164d0 con 0x7f6a300cff00 2024-09-16T07:36:02.205 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:36:02.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a10073720 msgr2=0x7f6a10075be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:02.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a10073720 0x7f6a10075be0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6a3015c550 tx=0x7f6a1c009040 comp rx=0 tx=0).stop 2024-09-16T07:36:02.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 msgr2=0x7f6a300b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:02.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300b6ea0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6a240b0040 tx=0x7f6a24005e70 comp rx=0 tx=0).stop 2024-09-16T07:36:02.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 shutdown_connections 2024-09-16T07:36:02.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a3015f700 0x7f6a301f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:02.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a10073720 0x7f6a10075be0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:02.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a300d02e0 0x7f6a300b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:02.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 --2- 172.21.15.114:0/321356941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a300cff00 0x7f6a300b6ea0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:02.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 >> 172.21.15.114:0/321356941 conn(0x7f6a300d1da0 msgr2=0x7f6a3015cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:02.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 shutdown_connections 2024-09-16T07:36:02.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.209+0000 7f6a36400640 1 -- 172.21.15.114:0/321356941 wait complete. 2024-09-16T07:36:02.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:36:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.381+0000 7f9f60e00640 1 -- 172.21.15.114:0/2348587483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f40003a60 msgr2=0x7f9f40003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.381+0000 7f9f60e00640 1 --2- 172.21.15.114:0/2348587483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f40003a60 0x7f9f40003e80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009ee0 tx=0x7f9f4c01d630 comp rx=0 tx=0).stop 2024-09-16T07:36:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.381+0000 7f9f5a800640 1 -- 172.21.15.114:0/2348587483 reap_dead start 2024-09-16T07:36:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.381+0000 7f9f60e00640 1 -- 172.21.15.114:0/2348587483 shutdown_connections 2024-09-16T07:36:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.381+0000 7f9f60e00640 1 -- 172.21.15.114:0/2348587483 >> 172.21.15.114:0/2348587483 conn(0x7f9f5c0cfbc0 msgr2=0x7f9f5c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 -- 172.21.15.114:0/2348587483 shutdown_connections 2024-09-16T07:36:02.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 -- 172.21.15.114:0/2348587483 wait complete. 2024-09-16T07:36:02.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 Processor -- start 2024-09-16T07:36:02.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 -- start start 2024-09-16T07:36:02.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f40003a60 0x7f9f5c1f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:02.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f5c152780 0x7f9f5c1f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:02.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f5c1f87b0 0x7f9f5c0b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c15e680 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c06fd60 con 0x7f9f5c152780 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c15e800 con 0x7f9f40003a60 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f5a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f5c1f87b0 0x7f9f5c0b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f51400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f5c152780 0x7f9f5c1f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f59e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f40003a60 0x7f9f5c1f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f51400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f5c152780 0x7f9f5c1f8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:41908/0 (socket says 172.21.15.114:41908) 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f51400640 1 -- 172.21.15.114:0/1038906595 learned_addr learned my addr 172.21.15.114:0/1038906595 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f5a800640 1 -- 172.21.15.114:0/1038906595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f40003a60 msgr2=0x7f9f5c1f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f5a800640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f40003a60 0x7f9f5c1f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f5a800640 1 -- 172.21.15.114:0/1038906595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f5c152780 msgr2=0x7f9f5c1f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:02.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f5a800640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f5c152780 0x7f9f5c1f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f5a800640 1 -- 172.21.15.114:0/1038906595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c1f4c80 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f5a800640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f5c1f87b0 0x7f9f5c0b04e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000bbd0 tx=0x7f9f540039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f52a00640 1 -- 172.21.15.114:0/1038906595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54015070 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f52a00640 1 -- 172.21.15.114:0/1038906595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f540118a0 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f52a00640 1 -- 172.21.15.114:0/1038906595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54011cf0 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.385+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c1f8cc0 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.389+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c1f4f40 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.389+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5c069410 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.389+0000 7f9f52a00640 1 -- 172.21.15.114:0/1038906595 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f9f54018070 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.389+0000 7f9f52a00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f38073760 0x7f9f38075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:02.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.389+0000 7f9f52a00640 1 -- 172.21.15.114:0/1038906595 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5385+0+0 (secure 0 0 0) 0x7f9f54095970 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.389+0000 7f9f59e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f38073760 0x7f9f38075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:02.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.389+0000 7f9f59e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f38073760 0x7f9f38075c20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0af000 tx=0x7f9f4c0b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:02.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.393+0000 7f9f52a00640 1 -- 172.21.15.114:0/1038906595 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9f54006550 con 0x7f9f5c1f87b0 2024-09-16T07:36:02.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:02.561+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f5c15dc10 con 0x7f9f5c1f87b0 2024-09-16T07:36:03.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.213+0000 7f9f52a00640 1 -- 172.21.15.114:0/1038906595 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v144) ==== 169+0+0 (secure 0 0 0) 0x7f9f5405f710 con 0x7f9f5c1f87b0 2024-09-16T07:36:03.213 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f38073760 msgr2=0x7f9f38075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f38073760 0x7f9f38075c20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0af000 tx=0x7f9f4c0b5040 comp rx=0 tx=0).stop 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f5c1f87b0 msgr2=0x7f9f5c0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f5c1f87b0 0x7f9f5c0b04e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000bbd0 tx=0x7f9f540039d0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 shutdown_connections 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9f5c1f87b0 0x7f9f5c0b04e0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9f5c152780 0x7f9f5c1f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9f38073760 0x7f9f38075c20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 --2- 172.21.15.114:0/1038906595 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9f40003a60 0x7f9f5c1f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 >> 172.21.15.114:0/1038906595 conn(0x7f9f5c0cfbc0 msgr2=0x7f9f5c070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:03.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.217+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 shutdown_connections 2024-09-16T07:36:03.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.221+0000 7f9f60e00640 1 -- 172.21.15.114:0/1038906595 wait complete. 2024-09-16T07:36:03.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:36:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- 172.21.15.114:0/1325399165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 msgr2=0x7f70dc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 --2- 172.21.15.114:0/1325399165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 0x7f70dc003e30 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c2e0 tx=0x7f70e801cfb0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fda00640 1 -- 172.21.15.114:0/1325399165 reap_dead start 2024-09-16T07:36:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- 172.21.15.114:0/1325399165 shutdown_connections 2024-09-16T07:36:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- 172.21.15.114:0/1325399165 >> 172.21.15.114:0/1325399165 conn(0x7f70f80b2240 msgr2=0x7f70f80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- 172.21.15.114:0/1325399165 shutdown_connections 2024-09-16T07:36:03.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- 172.21.15.114:0/1325399165 wait complete. 2024-09-16T07:36:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 Processor -- start 2024-09-16T07:36:03.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- start start 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 0x7f70f80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70f8138530 0x7f70f815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70f80b4320 0x7f70f815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8165bb0 con 0x7f70dc003a10 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8165a30 con 0x7f70f80b4320 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f70f8165d30 con 0x7f70f8138530 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 0x7f70f80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 0x7f70f80b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36506/0 (socket says 172.21.15.114:36506) 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 -- 172.21.15.114:0/1803965808 learned_addr learned my addr 172.21.15.114:0/1803965808 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70efe00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70f8138530 0x7f70f815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fda00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70f80b4320 0x7f70f815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 -- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70f8138530 msgr2=0x7f70f815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70f8138530 0x7f70f815c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 -- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70f80b4320 msgr2=0x7f70f815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70f80b4320 0x7f70f815cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 -- 172.21.15.114:0/1803965808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f815d280 con 0x7f70dc003a10 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70fd000640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 0x7f70f80b4eb0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f70e801ca70 tx=0x7f70e8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70f5600640 1 -- 172.21.15.114:0/1803965808 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8006090 con 0x7f70dc003a10 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70f5600640 1 -- 172.21.15.114:0/1803965808 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70f8144860 con 0x7f70dc003a10 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.389+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f815b760 con 0x7f70dc003a10 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.393+0000 7f70f5600640 1 -- 172.21.15.114:0/1803965808 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e80064f0 con 0x7f70dc003a10 2024-09-16T07:36:03.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.393+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f815bd20 con 0x7f70dc003a10 2024-09-16T07:36:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.393+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f806f520 con 0x7f70dc003a10 2024-09-16T07:36:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.393+0000 7f70f5600640 1 -- 172.21.15.114:0/1803965808 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f70e8003600 con 0x7f70dc003a10 2024-09-16T07:36:03.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.393+0000 7f70f5600640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70d4073730 0x7f70d4075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.393+0000 7f70f5600640 1 -- 172.21.15.114:0/1803965808 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f70e812c2a0 con 0x7f70dc003a10 2024-09-16T07:36:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.393+0000 7f70efe00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70d4073730 0x7f70d4075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.397+0000 7f70efe00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70d4073730 0x7f70d4075bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70f81fb660 tx=0x7f70e0005f40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:03.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.397+0000 7f70f5600640 1 -- 172.21.15.114:0/1803965808 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f70e8016d70 con 0x7f70dc003a10 2024-09-16T07:36:03.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.568+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f70f815af10 con 0x7f70dc003a10 2024-09-16T07:36:03.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70f5600640 1 -- 172.21.15.114:0/1803965808 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v45) ==== 71+0+0 (secure 0 0 0) 0x7f70e80f8fa0 con 0x7f70dc003a10 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70d4073730 msgr2=0x7f70d4075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70d4073730 0x7f70d4075bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f70f81fb660 tx=0x7f70e0005f40 comp rx=0 tx=0).stop 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 msgr2=0x7f70f80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 0x7f70f80b4eb0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f70e801ca70 tx=0x7f70e8001d80 comp rx=0 tx=0).stop 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 shutdown_connections 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70f80b4320 0x7f70f815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f70d4073730 0x7f70d4075bf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f70f8138530 0x7f70f815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 --2- 172.21.15.114:0/1803965808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f70dc003a10 0x7f70f80b4eb0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 >> 172.21.15.114:0/1803965808 conn(0x7f70f80b2240 msgr2=0x7f70f81411d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:03.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 shutdown_connections 2024-09-16T07:36:03.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.572+0000 7f70ffa00640 1 -- 172.21.15.114:0/1803965808 wait complete. 2024-09-16T07:36:03.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-16T07:36:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- 172.21.15.114:0/4156186080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5408004030 msgr2=0x7f5408004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 --2- 172.21.15.114:0/4156186080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5408004030 0x7f5408004810 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f54240b3a80 tx=0x7f540c01cd30 comp rx=0 tx=0).stop 2024-09-16T07:36:03.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5422800640 1 -- 172.21.15.114:0/4156186080 reap_dead start 2024-09-16T07:36:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- 172.21.15.114:0/4156186080 shutdown_connections 2024-09-16T07:36:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- 172.21.15.114:0/4156186080 >> 172.21.15.114:0/4156186080 conn(0x7f54240b18f0 msgr2=0x7f54240b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- 172.21.15.114:0/4156186080 shutdown_connections 2024-09-16T07:36:03.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- 172.21.15.114:0/4156186080 wait complete. 2024-09-16T07:36:03.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 Processor -- start 2024-09-16T07:36:03.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- start start 2024-09-16T07:36:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5408004030 0x7f54241f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5424152090 0x7f542406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f542406eb30 0x7f5424155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f542415a5d0 con 0x7f542406eb30 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54240cd7e0 con 0x7f5408004030 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5428a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f542415a750 con 0x7f5424152090 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5422800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f542406eb30 0x7f5424155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5422800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f542406eb30 0x7f5424155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36522/0 (socket says 172.21.15.114:36522) 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5422800640 1 -- 172.21.15.114:0/3290157029 learned_addr learned my addr 172.21.15.114:0/3290157029 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5421e00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5408004030 0x7f54241f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.736+0000 7f5419400640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5424152090 0x7f542406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5422800640 1 -- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5424152090 msgr2=0x7f542406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5422800640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5424152090 0x7f542406e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5422800640 1 -- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5408004030 msgr2=0x7f54241f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5422800640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5408004030 0x7f54241f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5422800640 1 -- 172.21.15.114:0/3290157029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5424153ac0 con 0x7f542406eb30 2024-09-16T07:36:03.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5422800640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f542406eb30 0x7f5424155890 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f541c011b20 tx=0x7f541c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f541aa00640 1 -- 172.21.15.114:0/3290157029 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c004b30 con 0x7f542406eb30 2024-09-16T07:36:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f541aa00640 1 -- 172.21.15.114:0/3290157029 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f541c004cd0 con 0x7f542406eb30 2024-09-16T07:36:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5424153da0 con 0x7f542406eb30 2024-09-16T07:36:03.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f541aa00640 1 -- 172.21.15.114:0/3290157029 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c003bc0 con 0x7f542406eb30 2024-09-16T07:36:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54241f0960 con 0x7f542406eb30 2024-09-16T07:36:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5424069410 con 0x7f542406eb30 2024-09-16T07:36:03.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f541aa00640 1 -- 172.21.15.114:0/3290157029 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f541c004030 con 0x7f542406eb30 2024-09-16T07:36:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f541aa00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5400073760 0x7f5400075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f541aa00640 1 -- 172.21.15.114:0/3290157029 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f541c092fa0 con 0x7f542406eb30 2024-09-16T07:36:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.740+0000 7f5421e00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5400073760 0x7f5400075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:03.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.744+0000 7f5421e00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5400073760 0x7f5400075c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5414001230 tx=0x7f5414006730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:03.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.744+0000 7f541aa00640 1 -- 172.21.15.114:0/3290157029 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f541c05f650 con 0x7f542406eb30 2024-09-16T07:36:03.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:03.984+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7f54240cc820 con 0x7f542406eb30 2024-09-16T07:36:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f541aa00640 1 -- 172.21.15.114:0/3290157029 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v434) ==== 149+0+0 (secure 0 0 0) 0x7f541c064080 con 0x7f542406eb30 2024-09-16T07:36:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5400073760 msgr2=0x7f5400075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5400073760 0x7f5400075c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5414001230 tx=0x7f5414006730 comp rx=0 tx=0).stop 2024-09-16T07:36:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f542406eb30 msgr2=0x7f5424155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f542406eb30 0x7f5424155890 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f541c011b20 tx=0x7f541c00f3c0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 shutdown_connections 2024-09-16T07:36:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f542406eb30 0x7f5424155890 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5400073760 0x7f5400075c20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5424152090 0x7f542406e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 --2- 172.21.15.114:0/3290157029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5408004030 0x7f54241f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 >> 172.21.15.114:0/3290157029 conn(0x7f54240b18f0 msgr2=0x7f54240d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 shutdown_connections 2024-09-16T07:36:04.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.216+0000 7f5428a00640 1 -- 172.21.15.114:0/3290157029 wait complete. 2024-09-16T07:36:04.237 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- rather than going through a full upgrade cycle, ... ok 2024-09-16T07:36:04.238 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-16T07:36:04.238 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:36:04.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 -- 172.21.15.114:0/4183004515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f541015bd50 msgr2=0x7f54100ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 --2- 172.21.15.114:0/4183004515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f541015bd50 0x7f54100ce5e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5400009840 tx=0x7f540001c700 comp rx=0 tx=0).stop 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 -- 172.21.15.114:0/4183004515 shutdown_connections 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 --2- 172.21.15.114:0/4183004515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f541015c130 0x7f54100ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 --2- 172.21.15.114:0/4183004515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f541015bd50 0x7f54100ce5e0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 -- 172.21.15.114:0/4183004515 >> 172.21.15.114:0/4183004515 conn(0x7f54100d1ea0 msgr2=0x7f54100d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 -- 172.21.15.114:0/4183004515 shutdown_connections 2024-09-16T07:36:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.380+0000 7f5415000640 1 -- 172.21.15.114:0/4183004515 wait complete. 2024-09-16T07:36:04.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 Processor -- start 2024-09-16T07:36:04.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 -- start start 2024-09-16T07:36:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54100cf4e0 0x7f5410153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f541015bd50 0x7f5410154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f541015c130 0x7f5410154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5410168e50 con 0x7f54100cf4e0 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5410168cd0 con 0x7f541015c130 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5410168fd0 con 0x7f541015bd50 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54100cf4e0 0x7f5410153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54100cf4e0 0x7f5410153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58512/0 (socket says 172.21.15.114:58512) 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 -- 172.21.15.114:0/2073983589 learned_addr learned my addr 172.21.15.114:0/2073983589 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5407e00640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f541015bd50 0x7f5410154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540e800640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f541015c130 0x7f5410154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 -- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f541015bd50 msgr2=0x7f5410154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f541015bd50 0x7f5410154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 -- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f541015c130 msgr2=0x7f5410154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f541015c130 0x7f5410154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 -- 172.21.15.114:0/2073983589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54100afe80 con 0x7f54100cf4e0 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f540de00640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54100cf4e0 0x7f5410153dc0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5400009790 tx=0x7f54000a6770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5406000640 1 -- 172.21.15.114:0/2073983589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54000bf020 con 0x7f54100cf4e0 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5406000640 1 -- 172.21.15.114:0/2073983589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5400005020 con 0x7f54100cf4e0 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54100b0100 con 0x7f54100cf4e0 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5406000640 1 -- 172.21.15.114:0/2073983589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400005430 con 0x7f54100cf4e0 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.384+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54100b06c0 con 0x7f54100cf4e0 2024-09-16T07:36:04.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.388+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54100c5dd0 con 0x7f54100cf4e0 2024-09-16T07:36:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.388+0000 7f5406000640 1 -- 172.21.15.114:0/2073983589 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f54000c2070 con 0x7f54100cf4e0 2024-09-16T07:36:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.388+0000 7f5406000640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53ec073730 0x7f53ec075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.388+0000 7f5406000640 1 -- 172.21.15.114:0/2073983589 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f540012f320 con 0x7f54100cf4e0 2024-09-16T07:36:04.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.388+0000 7f5407e00640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53ec073730 0x7f53ec075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.388+0000 7f5407e00640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53ec073730 0x7f53ec075bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f54100b2b30 tx=0x7f53f800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:04.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.392+0000 7f5406000640 1 -- 172.21.15.114:0/2073983589 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f54100afe80 con 0x7f54100cf4e0 2024-09-16T07:36:04.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5410076360 con 0x7f54100cf4e0 2024-09-16T07:36:04.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5406000640 1 -- 172.21.15.114:0/2073983589 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+13136 (secure 0 0 0) 0x7f5400016410 con 0x7f54100cf4e0 2024-09-16T07:36:04.563 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:04.563 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":144,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:03.212924+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/1141336969":"2024-09-17T07:36:00.202058+0000","172.21.15.114:6834/1141336969":"2024-09-17T07:36:00.202058+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53ec073730 msgr2=0x7f53ec075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53ec073730 0x7f53ec075bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f54100b2b30 tx=0x7f53f800b2e0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54100cf4e0 msgr2=0x7f5410153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54100cf4e0 0x7f5410153dc0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f5400009790 tx=0x7f54000a6770 comp rx=0 tx=0).stop 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 shutdown_connections 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f541015c130 0x7f5410154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f53ec073730 0x7f53ec075bf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f541015bd50 0x7f5410154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 --2- 172.21.15.114:0/2073983589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54100cf4e0 0x7f5410153dc0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 >> 172.21.15.114:0/2073983589 conn(0x7f54100d1ea0 msgr2=0x7f54100d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 shutdown_connections 2024-09-16T07:36:04.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.564+0000 7f5415000640 1 -- 172.21.15.114:0/2073983589 wait complete. 2024-09-16T07:36:04.584 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:36:04.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:36:04.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- 172.21.15.114:0/227023592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06ee20 msgr2=0x7f765c06f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 --2- 172.21.15.114:0/227023592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06ee20 0x7f765c06f2d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f7654009900 tx=0x7f765401f0d0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- 172.21.15.114:0/227023592 shutdown_connections 2024-09-16T07:36:04.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 --2- 172.21.15.114:0/227023592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c06ee20 0x7f765c06f2d0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 --2- 172.21.15.114:0/227023592 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c0cf400 0x7f765c0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- 172.21.15.114:0/227023592 >> 172.21.15.114:0/227023592 conn(0x7f765c0b18f0 msgr2=0x7f765c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:04.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- 172.21.15.114:0/227023592 shutdown_connections 2024-09-16T07:36:04.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- 172.21.15.114:0/227023592 wait complete. 2024-09-16T07:36:04.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 Processor -- start 2024-09-16T07:36:04.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- start start 2024-09-16T07:36:04.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c06ee20 0x7f765c1f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cf400 0x7f765c0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c15bee0 0x7f765c1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f765c15c430 con 0x7f765c15bee0 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f765c0cd190 con 0x7f765c0cf400 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7663200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f765c06f810 con 0x7f765c06ee20 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7661200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c15bee0 0x7f765c1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7661200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c15bee0 0x7f765c1541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58526/0 (socket says 172.21.15.114:58526) 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f7661200640 1 -- 172.21.15.114:0/3962970273 learned_addr learned my addr 172.21.15.114:0/3962970273 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f765b400640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cf400 0x7f765c0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.732+0000 7f765be00640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c06ee20 0x7f765c1f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7661200640 1 -- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c06ee20 msgr2=0x7f765c1f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7661200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c06ee20 0x7f765c1f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7661200640 1 -- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cf400 msgr2=0x7f765c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7661200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cf400 0x7f765c0cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7661200640 1 -- 172.21.15.114:0/3962970273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c1f4840 con 0x7f765c15bee0 2024-09-16T07:36:04.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7661200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c15bee0 0x7f765c1541c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f76540b3040 tx=0x7f7654005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7653e00640 1 -- 172.21.15.114:0/3962970273 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540b5040 con 0x7f765c15bee0 2024-09-16T07:36:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7653e00640 1 -- 172.21.15.114:0/3962970273 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7654005330 con 0x7f765c15bee0 2024-09-16T07:36:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7653e00640 1 -- 172.21.15.114:0/3962970273 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76540046d0 con 0x7f765c15bee0 2024-09-16T07:36:04.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c154ff0 con 0x7f765c15bee0 2024-09-16T07:36:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c1f4ae0 con 0x7f765c15bee0 2024-09-16T07:36:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765c069410 con 0x7f765c15bee0 2024-09-16T07:36:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7653e00640 1 -- 172.21.15.114:0/3962970273 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f7654004870 con 0x7f765c15bee0 2024-09-16T07:36:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.736+0000 7f7653e00640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f763c073760 0x7f763c075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.740+0000 7f7653e00640 1 -- 172.21.15.114:0/3962970273 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f7654131610 con 0x7f765c15bee0 2024-09-16T07:36:04.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.740+0000 7f765be00640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f763c073760 0x7f763c075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.740+0000 7f765be00640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f763c073760 0x7f763c075c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f764c001e40 tx=0x7f764c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:04.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.740+0000 7f7653e00640 1 -- 172.21.15.114:0/3962970273 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7654018c30 con 0x7f765c15bee0 2024-09-16T07:36:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.908+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f765c06fd00 con 0x7f765c15bee0 2024-09-16T07:36:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7653e00640 1 -- 172.21.15.114:0/3962970273 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) ==== 93+0+10 (secure 0 0 0) 0x7f76540fb8e0 con 0x7f765c15bee0 2024-09-16T07:36:04.910 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:36:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f763c073760 msgr2=0x7f763c075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f763c073760 0x7f763c075c20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f764c001e40 tx=0x7f764c009040 comp rx=0 tx=0).stop 2024-09-16T07:36:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c15bee0 msgr2=0x7f765c1541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c15bee0 0x7f765c1541c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f76540b3040 tx=0x7f7654005d80 comp rx=0 tx=0).stop 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 shutdown_connections 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f765c15bee0 0x7f765c1541c0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f765c0cf400 0x7f765c0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f763c073760 0x7f763c075c20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 --2- 172.21.15.114:0/3962970273 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f765c06ee20 0x7f765c1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 >> 172.21.15.114:0/3962970273 conn(0x7f765c0b18f0 msgr2=0x7f765c160320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 shutdown_connections 2024-09-16T07:36:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:04.912+0000 7f7663200640 1 -- 172.21.15.114:0/3962970273 wait complete. 2024-09-16T07:36:04.935 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-16T07:36:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.076+0000 7fc107400640 1 -- 172.21.15.114:0/2937795596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e80039f0 msgr2=0x7fc0e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.076+0000 7fc107400640 1 --2- 172.21.15.114:0/2937795596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc0e80039f0 0x7fc0e8003dd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4006f90 tx=0x7fc0f401cf00 comp rx=0 tx=0).stop 2024-09-16T07:36:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.076+0000 7fc105400640 1 -- 172.21.15.114:0/2937795596 reap_dead start 2024-09-16T07:36:05.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.076+0000 7fc107400640 1 -- 172.21.15.114:0/2937795596 shutdown_connections 2024-09-16T07:36:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.076+0000 7fc107400640 1 -- 172.21.15.114:0/2937795596 >> 172.21.15.114:0/2937795596 conn(0x7fc1000d1ea0 msgr2=0x7fc1000d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.076+0000 7fc107400640 1 -- 172.21.15.114:0/2937795596 shutdown_connections 2024-09-16T07:36:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.076+0000 7fc107400640 1 -- 172.21.15.114:0/2937795596 wait complete. 2024-09-16T07:36:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 Processor -- start 2024-09-16T07:36:05.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 -- start start 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e80039f0 0x7fc100156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001f5190 0x7fc100156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1001591b0 0x7fc100159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc1000cc940 con 0x7fc1001f5190 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1000cf7e0 con 0x7fc1001591b0 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc1000ccac0 con 0x7fc0e80039f0 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001f5190 0x7fc100156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001f5190 0x7fc100156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58540/0 (socket says 172.21.15.114:58540) 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 -- 172.21.15.114:0/746291425 learned_addr learned my addr 172.21.15.114:0/746291425 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc104a00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e80039f0 0x7fc100156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 -- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e80039f0 msgr2=0x7fc100156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:05.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc105400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1001591b0 0x7fc100159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e80039f0 0x7fc100156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 -- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1001591b0 msgr2=0x7fc100159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1001591b0 0x7fc100159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 -- 172.21.15.114:0/746291425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc100157570 con 0x7fc1001f5190 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc104a00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e80039f0 0x7fc100156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc105400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1001591b0 0x7fc100159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0ffe00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001f5190 0x7fc100156b30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec011cb0 tx=0x7fc0ec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0fcc00640 1 -- 172.21.15.114:0/746291425 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec01e070 con 0x7fc1001f5190 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0fcc00640 1 -- 172.21.15.114:0/746291425 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0ec00e8b0 con 0x7fc1001f5190 2024-09-16T07:36:05.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc0fcc00640 1 -- 172.21.15.114:0/746291425 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00eca0 con 0x7fc1001f5190 2024-09-16T07:36:05.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc100157850 con 0x7fc1001f5190 2024-09-16T07:36:05.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.080+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1000ca6e0 con 0x7fc1001f5190 2024-09-16T07:36:05.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.084+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1000ca8e0 con 0x7fc1001f5190 2024-09-16T07:36:05.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.084+0000 7fc0fcc00640 1 -- 172.21.15.114:0/746291425 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fc0ec021070 con 0x7fc1001f5190 2024-09-16T07:36:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.084+0000 7fc0fcc00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0e0073760 0x7fc0e0075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.084+0000 7fc0fcc00640 1 -- 172.21.15.114:0/746291425 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7fc0ec095de0 con 0x7fc1001f5190 2024-09-16T07:36:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.084+0000 7fc104a00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0e0073760 0x7fc0e0075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:05.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.084+0000 7fc104a00640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0e0073760 0x7fc0e0075c20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ac000 tx=0x7fc0f4019d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:05.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.088+0000 7fc0fcc00640 1 -- 172.21.15.114:0/746291425 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc1000ca8e0 con 0x7fc1001f5190 2024-09-16T07:36:05.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:05.320+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7fc10015b2d0 con 0x7fc1001f5190 2024-09-16T07:36:06.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.224+0000 7fc0fcc00640 1 -- 172.21.15.114:0/746291425 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v436) ==== 148+0+0 (secure 0 0 0) 0x7fc0ec05fc90 con 0x7fc1001f5190 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0e0073760 msgr2=0x7fc0e0075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0e0073760 0x7fc0e0075c20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ac000 tx=0x7fc0f4019d40 comp rx=0 tx=0).stop 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001f5190 msgr2=0x7fc100156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001f5190 0x7fc100156b30 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec011cb0 tx=0x7fc0ec00f790 comp rx=0 tx=0).stop 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 shutdown_connections 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1001591b0 0x7fc100159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc1001f5190 0x7fc100156b30 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc0e0073760 0x7fc0e0075c20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 --2- 172.21.15.114:0/746291425 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc0e80039f0 0x7fc100156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 >> 172.21.15.114:0/746291425 conn(0x7fc1000d1ea0 msgr2=0x7fc1000cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 shutdown_connections 2024-09-16T07:36:06.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.228+0000 7fc107400640 1 -- 172.21.15.114:0/746291425 wait complete. 2024-09-16T07:36:06.249 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:36:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 -- 172.21.15.114:0/648777895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c003a10 msgr2=0x7f303c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 --2- 172.21.15.114:0/648777895 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f303c003a10 0x7f303c003e30 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f304800c310 tx=0x7f304801cfc0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f3059c00640 1 -- 172.21.15.114:0/648777895 reap_dead start 2024-09-16T07:36:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 -- 172.21.15.114:0/648777895 shutdown_connections 2024-09-16T07:36:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 -- 172.21.15.114:0/648777895 >> 172.21.15.114:0/648777895 conn(0x7f305406dd30 msgr2=0x7f305406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 -- 172.21.15.114:0/648777895 shutdown_connections 2024-09-16T07:36:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 -- 172.21.15.114:0/648777895 wait complete. 2024-09-16T07:36:06.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 Processor -- start 2024-09-16T07:36:06.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.396+0000 7f305a600640 1 -- start start 2024-09-16T07:36:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c003a10 0x7f30541513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f305414fcd0 0x7f3054150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30540b1670 0x7f30540b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3054165950 con 0x7f305414fcd0 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f30540d0660 con 0x7f303c003a10 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3054165ad0 con 0x7f30540b1670 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f305414fcd0 0x7f3054150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f305414fcd0 0x7f3054150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58564/0 (socket says 172.21.15.114:58564) 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 -- 172.21.15.114:0/1254221803 learned_addr learned my addr 172.21.15.114:0/1254221803 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3059200640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c003a10 0x7f30541513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3059c00640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30540b1670 0x7f30540b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 -- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30540b1670 msgr2=0x7f30540b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30540b1670 0x7f30540b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 -- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c003a10 msgr2=0x7f30541513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c003a10 0x7f30541513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 -- 172.21.15.114:0/1254221803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3054160650 con 0x7f305414fcd0 2024-09-16T07:36:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3053e00640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f305414fcd0 0x7f3054150150 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3040011b10 tx=0x7f3040009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:06.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3050c00640 1 -- 172.21.15.114:0/1254221803 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304000fc80 con 0x7f305414fcd0 2024-09-16T07:36:06.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3050c00640 1 -- 172.21.15.114:0/1254221803 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f304000fe20 con 0x7f305414fcd0 2024-09-16T07:36:06.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3054150910 con 0x7f305414fcd0 2024-09-16T07:36:06.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f3050c00640 1 -- 172.21.15.114:0/1254221803 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040004280 con 0x7f305414fcd0 2024-09-16T07:36:06.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3054150ed0 con 0x7f305414fcd0 2024-09-16T07:36:06.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.400+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3054073b20 con 0x7f305414fcd0 2024-09-16T07:36:06.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.404+0000 7f3050c00640 1 -- 172.21.15.114:0/1254221803 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f3040003600 con 0x7f305414fcd0 2024-09-16T07:36:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.404+0000 7f3050c00640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3034073760 0x7f3034075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.404+0000 7f3050c00640 1 -- 172.21.15.114:0/1254221803 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f3040092f20 con 0x7f305414fcd0 2024-09-16T07:36:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.404+0000 7f3059200640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3034073760 0x7f3034075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.404+0000 7f3059200640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3034073760 0x7f3034075c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f30480ac000 tx=0x7f3048005040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:06.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.408+0000 7f3050c00640 1 -- 172.21.15.114:0/1254221803 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f304005f5b0 con 0x7f305414fcd0 2024-09-16T07:36:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.576+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f305406ebd0 con 0x7f305414fcd0 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.576+0000 7f3050c00640 1 -- 172.21.15.114:0/1254221803 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v45) ==== 59+0+1998 (secure 0 0 0) 0x7f3040063fe0 con 0x7f305414fcd0 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:36:06.577 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:36:06.578 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:36:06.579 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:36:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3034073760 msgr2=0x7f3034075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3034073760 0x7f3034075c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f30480ac000 tx=0x7f3048005040 comp rx=0 tx=0).stop 2024-09-16T07:36:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f305414fcd0 msgr2=0x7f3054150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f305414fcd0 0x7f3054150150 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3040011b10 tx=0x7f3040009f20 comp rx=0 tx=0).stop 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 shutdown_connections 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3034073760 0x7f3034075c20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30540b1670 0x7f30540b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f305414fcd0 0x7f3054150150 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 --2- 172.21.15.114:0/1254221803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f303c003a10 0x7f30541513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 >> 172.21.15.114:0/1254221803 conn(0x7f305406dd30 msgr2=0x7f305415b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 shutdown_connections 2024-09-16T07:36:06.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.580+0000 7f305a600640 1 -- 172.21.15.114:0/1254221803 wait complete. 2024-09-16T07:36:06.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:36:06.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.744+0000 7f6e38e00640 1 -- 172.21.15.114:0/3217617315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 msgr2=0x7f6e18004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.744+0000 7f6e38e00640 1 --2- 172.21.15.114:0/3217617315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 0x7f6e18004810 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00c290 tx=0x7f6e1c01d030 comp rx=0 tx=0).stop 2024-09-16T07:36:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.744+0000 7f6e32800640 1 -- 172.21.15.114:0/3217617315 reap_dead start 2024-09-16T07:36:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.744+0000 7f6e38e00640 1 -- 172.21.15.114:0/3217617315 shutdown_connections 2024-09-16T07:36:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.744+0000 7f6e38e00640 1 -- 172.21.15.114:0/3217617315 >> 172.21.15.114:0/3217617315 conn(0x7f6e340d1dc0 msgr2=0x7f6e340d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.744+0000 7f6e38e00640 1 -- 172.21.15.114:0/3217617315 shutdown_connections 2024-09-16T07:36:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.744+0000 7f6e38e00640 1 -- 172.21.15.114:0/3217617315 wait complete. 2024-09-16T07:36:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 Processor -- start 2024-09-16T07:36:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 -- start start 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 0x7f6e340cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e34153030 0x7f6e341f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e340ce7e0 0x7f6e340cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6e340af650 con 0x7f6e18003fe0 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6e34160970 con 0x7f6e340ce7e0 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6e340af7d0 con 0x7f6e34153030 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 0x7f6e340cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 0x7f6e340cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58592/0 (socket says 172.21.15.114:58592) 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 -- 172.21.15.114:0/3369197034 learned_addr learned my addr 172.21.15.114:0/3369197034 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e29400640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e34153030 0x7f6e341f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e32800640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e340ce7e0 0x7f6e340cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 -- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e34153030 msgr2=0x7f6e341f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e34153030 0x7f6e341f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 -- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e340ce7e0 msgr2=0x7f6e340cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e340ce7e0 0x7f6e340cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 -- 172.21.15.114:0/3369197034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e340ccb30 con 0x7f6e18003fe0 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e32800640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e340ce7e0 0x7f6e340cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e31e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 0x7f6e340cc5f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6e24011b10 tx=0x7f6e24009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e2aa00640 1 -- 172.21.15.114:0/3369197034 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400fd00 con 0x7f6e18003fe0 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e2aa00640 1 -- 172.21.15.114:0/3369197034 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e24004020 con 0x7f6e18003fe0 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e2aa00640 1 -- 172.21.15.114:0/3369197034 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400fea0 con 0x7f6e18003fe0 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e340cce00 con 0x7f6e18003fe0 2024-09-16T07:36:06.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3415d800 con 0x7f6e18003fe0 2024-09-16T07:36:06.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.748+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e340d0270 con 0x7f6e18003fe0 2024-09-16T07:36:06.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.752+0000 7f6e2aa00640 1 -- 172.21.15.114:0/3369197034 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f6e24003600 con 0x7f6e18003fe0 2024-09-16T07:36:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.752+0000 7f6e2aa00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6e10073790 0x7f6e10075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.752+0000 7f6e2aa00640 1 -- 172.21.15.114:0/3369197034 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f6e240957e0 con 0x7f6e18003fe0 2024-09-16T07:36:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.752+0000 7f6e29400640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6e10073790 0x7f6e10075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.752+0000 7f6e29400640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6e10073790 0x7f6e10075c50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0ac000 tx=0x7f6e1c019e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:06.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.756+0000 7f6e2aa00640 1 -- 172.21.15.114:0/3369197034 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6e24004470 con 0x7f6e18003fe0 2024-09-16T07:36:06.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.924+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6e3415b5c0 con 0x7f6e18003fe0 2024-09-16T07:36:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e2aa00640 1 -- 172.21.15.114:0/3369197034 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f6e2405fdb0 con 0x7f6e18003fe0 2024-09-16T07:36:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6e10073790 msgr2=0x7f6e10075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6e10073790 0x7f6e10075c50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0ac000 tx=0x7f6e1c019e70 comp rx=0 tx=0).stop 2024-09-16T07:36:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 msgr2=0x7f6e340cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 0x7f6e340cc5f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6e24011b10 tx=0x7f6e24009f20 comp rx=0 tx=0).stop 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 shutdown_connections 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6e340ce7e0 0x7f6e340cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6e10073790 0x7f6e10075c50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6e34153030 0x7f6e341f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 --2- 172.21.15.114:0/3369197034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6e18003fe0 0x7f6e340cc5f0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 >> 172.21.15.114:0/3369197034 conn(0x7f6e340d1dc0 msgr2=0x7f6e34070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 shutdown_connections 2024-09-16T07:36:06.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:06.928+0000 7f6e38e00640 1 -- 172.21.15.114:0/3369197034 wait complete. 2024-09-16T07:36:06.949 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:36:06.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:36:07.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:36:07.117 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:36:07.117 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:07.117 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:07.126 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:36:07.126 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:07.126 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:07.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:36:07.135 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:07.135 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:07.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:36:07.177 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:07.177 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:07.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:36:07.186 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:36:07.187 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 -- 172.21.15.114:0/3974655515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b406f930 msgr2=0x7fe5b406fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 --2- 172.21.15.114:0/3974655515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b406f930 0x7fe5b406fd70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4005fd0 tx=0x7fe5a401c820 comp rx=0 tx=0).stop 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 -- 172.21.15.114:0/3974655515 shutdown_connections 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 --2- 172.21.15.114:0/3974655515 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b406f930 0x7fe5b406fd70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 --2- 172.21.15.114:0/3974655515 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5b415f160 0x7fe5b40cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 -- 172.21.15.114:0/3974655515 >> 172.21.15.114:0/3974655515 conn(0x7fe5b40b2240 msgr2=0x7fe5b40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 -- 172.21.15.114:0/3974655515 shutdown_connections 2024-09-16T07:36:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 -- 172.21.15.114:0/3974655515 wait complete. 2024-09-16T07:36:07.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 Processor -- start 2024-09-16T07:36:07.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.360+0000 7fe5b9800640 1 -- start start 2024-09-16T07:36:07.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b406cc20 0x7fe5b4154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5b406f930 0x7fe5b40b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b415f160 0x7fe5b415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b416b800 con 0x7fe5b406cc20 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b416b980 con 0x7fe5b415f160 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b416bb00 con 0x7fe5b406f930 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b406cc20 0x7fe5b4154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b406cc20 0x7fe5b4154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58608/0 (socket says 172.21.15.114:58608) 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 -- 172.21.15.114:0/1533694558 learned_addr learned my addr 172.21.15.114:0/1533694558 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2000640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5b406f930 0x7fe5b40b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b3400640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b415f160 0x7fe5b415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 -- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5b406f930 msgr2=0x7fe5b40b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5b406f930 0x7fe5b40b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 -- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b415f160 msgr2=0x7fe5b415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b415f160 0x7fe5b415f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 -- 172.21.15.114:0/1533694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b4160390 con 0x7fe5b406cc20 2024-09-16T07:36:07.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b2a00640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b406cc20 0x7fe5b4154d60 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00e9f0 tx=0x7fe59c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:07.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5aaa00640 1 -- 172.21.15.114:0/1533694558 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00cd80 con 0x7fe5b406cc20 2024-09-16T07:36:07.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5aaa00640 1 -- 172.21.15.114:0/1533694558 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe59c004020 con 0x7fe5b406cc20 2024-09-16T07:36:07.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b4160670 con 0x7fe5b406cc20 2024-09-16T07:36:07.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5aaa00640 1 -- 172.21.15.114:0/1533694558 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c004470 con 0x7fe5b406cc20 2024-09-16T07:36:07.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b414f640 con 0x7fe5b406cc20 2024-09-16T07:36:07.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.364+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b406fd70 con 0x7fe5b406cc20 2024-09-16T07:36:07.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.368+0000 7fe5aaa00640 1 -- 172.21.15.114:0/1533694558 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fe59c003600 con 0x7fe5b406cc20 2024-09-16T07:36:07.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.368+0000 7fe5aaa00640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe590073730 0x7fe590075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.368+0000 7fe5aaa00640 1 -- 172.21.15.114:0/1533694558 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7fe59c092ea0 con 0x7fe5b406cc20 2024-09-16T07:36:07.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.368+0000 7fe5b2000640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe590073730 0x7fe590075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.368+0000 7fe5b2000640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe590073730 0x7fe590075bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40ae000 tx=0x7fe5a401b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.372+0000 7fe5aaa00640 1 -- 172.21.15.114:0/1533694558 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe59c05f550 con 0x7fe5b406cc20 2024-09-16T07:36:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.572+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5b40b5820 con 0x7fe5b406cc20 2024-09-16T07:36:07.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.572+0000 7fe5aaa00640 1 -- 172.21.15.114:0/1533694558 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+3925 (secure 0 0 0) 0x7fe59c063f80 con 0x7fe5b406cc20 2024-09-16T07:36:07.572 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:07.573 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":106,"btime":"2024-09-16T07:36:01:204767+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8403,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/4246164040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":4246164040},{"type":"v1","addr":"172.21.15.114:6833","nonce":4246164040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/2023547758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6801","nonce":2023547758},{"type":"v1","addr":"172.21.15.149:6835","nonce":2023547758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8409,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6834/4110489344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":4110489344},{"type":"v1","addr":"172.21.15.149:6834","nonce":4110489344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2221288562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2221288562},{"type":"v1","addr":"172.21.15.114:6835","nonce":2221288562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[]} 2024-09-16T07:36:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 106 2024-09-16T07:36:07.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe590073730 msgr2=0x7fe590075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe590073730 0x7fe590075bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40ae000 tx=0x7fe5a401b060 comp rx=0 tx=0).stop 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b406cc20 msgr2=0x7fe5b4154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b406cc20 0x7fe5b4154d60 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00e9f0 tx=0x7fe59c00edf0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 shutdown_connections 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5b415f160 0x7fe5b415f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe590073730 0x7fe590075bf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe5b406f930 0x7fe5b40b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 --2- 172.21.15.114:0/1533694558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5b406cc20 0x7fe5b4154d60 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 >> 172.21.15.114:0/1533694558 conn(0x7fe5b40b2240 msgr2=0x7fe5b40b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 shutdown_connections 2024-09-16T07:36:07.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.576+0000 7fe5b9800640 1 -- 172.21.15.114:0/1533694558 wait complete. 2024-09-16T07:36:07.595 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:36:07.595 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:36:07.595 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:36:07.595 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:07.596 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:36:07.596 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:36:07.596 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:36:07.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:07.597 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:36:07.597 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:36:07.597 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:36:07.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:07.597 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:36:07.597 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:36:07.597 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:36:07.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:07.607 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:36:07.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:36:07.608 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:36:07.608 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:36:07.612 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:36:07.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:36:07.613 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:36:07.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:36:07.651 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:36:07.652 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:07.653 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:36:07.653 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:07.657 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:36:07.657 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:07.658 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:36:07.659 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:07.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:36:07.738 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:36:07.739 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:36:07.748 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:36:07.749 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:36:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.808+0000 7ffbe8c00640 1 -- 172.21.15.114:0/4123525553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 msgr2=0x7ffbe40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.808+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/4123525553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe40cebb0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40745d0 tx=0x7ffbd001c830 comp rx=0 tx=0).stop 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.808+0000 7ffbe8c00640 1 -- 172.21.15.114:0/4123525553 shutdown_connections 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.808+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/4123525553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe40cebb0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.808+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/4123525553 >> v2:172.21.15.149:3300/0 conn(0x7ffbe415bea0 0x7ffbe40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.808+0000 7ffbe8c00640 1 -- 172.21.15.114:0/4123525553 >> 172.21.15.114:0/4123525553 conn(0x7ffbe40d1dc0 msgr2=0x7ffbe40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 -- 172.21.15.114:0/4123525553 shutdown_connections 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 -- 172.21.15.114:0/4123525553 wait complete. 2024-09-16T07:36:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 Processor -- start 2024-09-16T07:36:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 -- start start 2024-09-16T07:36:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe41580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbe40d28e0 0x7ffbe4157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe415bea0 0x7ffbe40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4168fc0 con 0x7ffbe40cdb30 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe4168e40 con 0x7ffbe415bea0 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe4169140 con 0x7ffbe40d28e0 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe41580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe41580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58662/0 (socket says 172.21.15.114:58662) 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 -- 172.21.15.114:0/2119037440 learned_addr learned my addr 172.21.15.114:0/2119037440 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1400640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbe40d28e0 0x7ffbe4157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe2800640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe415bea0 0x7ffbe40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 -- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbe40d28e0 msgr2=0x7ffbe4157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbe40d28e0 0x7ffbe4157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 -- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe415bea0 msgr2=0x7ffbe40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe415bea0 0x7ffbe40c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 -- 172.21.15.114:0/2119037440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe40b5c40 con 0x7ffbe40cdb30 2024-09-16T07:36:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe2800640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe415bea0 0x7ffbe40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe1e00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe41580b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400c9f0 tx=0x7ffbd400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbda000640 1 -- 172.21.15.114:0/2119037440 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4007bb0 con 0x7ffbe40cdb30 2024-09-16T07:36:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbda000640 1 -- 172.21.15.114:0/2119037440 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbd4007e40 con 0x7ffbe40cdb30 2024-09-16T07:36:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe41fbb00 con 0x7ffbe40cdb30 2024-09-16T07:36:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.812+0000 7ffbda000640 1 -- 172.21.15.114:0/2119037440 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400f690 con 0x7ffbe40cdb30 2024-09-16T07:36:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.816+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe40b61e0 con 0x7ffbe40cdb30 2024-09-16T07:36:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.816+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe40cc9d0 con 0x7ffbe40cdb30 2024-09-16T07:36:07.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-16T07:36:07.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-16T07:36:07.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-16T07:36:07.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-16T07:36:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.816+0000 7ffbda000640 1 -- 172.21.15.114:0/2119037440 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7ffbd400f830 con 0x7ffbe40cdb30 2024-09-16T07:36:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.816+0000 7ffbda000640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffbc4073730 0x7ffbc4075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.816+0000 7ffbda000640 1 -- 172.21.15.114:0/2119037440 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7ffbd4095580 con 0x7ffbe40cdb30 2024-09-16T07:36:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.816+0000 7ffbe1400640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffbc4073730 0x7ffbc4075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.820+0000 7ffbe1400640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffbc4073730 0x7ffbc4075bf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00af000 tx=0x7ffbd001b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:07.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:07.820+0000 7ffbda000640 1 -- 172.21.15.114:0/2119037440 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ffbd4014030 con 0x7ffbe40cdb30 2024-09-16T07:36:07.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.000+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ffbe40c98a0 con 0x7ffbe40cdb30 2024-09-16T07:36:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.248+0000 7ffbda000640 1 -- 172.21.15.114:0/2119037440 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v146) ==== 97+0+0 (secure 0 0 0) 0x7ffbd405fa80 con 0x7ffbe40cdb30 2024-09-16T07:36:08.249 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:36:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffbc4073730 msgr2=0x7ffbc4075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffbc4073730 0x7ffbc4075bf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00af000 tx=0x7ffbd001b070 comp rx=0 tx=0).stop 2024-09-16T07:36:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 msgr2=0x7ffbe41580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe41580b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400c9f0 tx=0x7ffbd400ceb0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 shutdown_connections 2024-09-16T07:36:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffbe415bea0 0x7ffbe40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffbc4073730 0x7ffbc4075bf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffbe40d28e0 0x7ffbe4157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 --2- 172.21.15.114:0/2119037440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbe40cdb30 0x7ffbe41580b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 >> 172.21.15.114:0/2119037440 conn(0x7ffbe40d1dc0 msgr2=0x7ffbe40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 shutdown_connections 2024-09-16T07:36:08.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.252+0000 7ffbe8c00640 1 -- 172.21.15.114:0/2119037440 wait complete. 2024-09-16T07:36:08.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- 172.21.15.114:0/2555204881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b980ced80 msgr2=0x7f7b980ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/2555204881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b980ced80 0x7f7b980ae9b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009840 tx=0x7f7b8401c6b0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- 172.21.15.114:0/2555204881 shutdown_connections 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/2555204881 >> v2:172.21.15.149:3300/0 conn(0x7f7b980cdb30 0x7f7b980aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/2555204881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b980ced80 0x7f7b980ae9b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- 172.21.15.114:0/2555204881 >> 172.21.15.114:0/2555204881 conn(0x7f7b980d1dc0 msgr2=0x7f7b980d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- 172.21.15.114:0/2555204881 shutdown_connections 2024-09-16T07:36:08.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- 172.21.15.114:0/2555204881 wait complete. 2024-09-16T07:36:08.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 Processor -- start 2024-09-16T07:36:08.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- start start 2024-09-16T07:36:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b980cdb30 0x7f7b981f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ced80 0x7f7b980cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b9815bea0 0x7f7b9815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7b98169290 con 0x7f7b980cdb30 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7b98169110 con 0x7f7b980ced80 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9fa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7b98169410 con 0x7f7b9815bea0 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.420+0000 7f7b9d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b980cdb30 0x7f7b981f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b980cdb30 0x7f7b981f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58666/0 (socket says 172.21.15.114:58666) 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 -- 172.21.15.114:0/3461788728 learned_addr learned my addr 172.21.15.114:0/3461788728 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b9815bea0 0x7f7b9815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b97e00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ced80 0x7f7b980cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 -- 172.21.15.114:0/3461788728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b9815bea0 msgr2=0x7f7b9815ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b9815bea0 0x7f7b9815ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 -- 172.21.15.114:0/3461788728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ced80 msgr2=0x7f7b980cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ced80 0x7f7b980cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 -- 172.21.15.114:0/3461788728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b981f8fe0 con 0x7f7b980cdb30 2024-09-16T07:36:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9d000640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b980cdb30 0x7f7b981f8aa0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00c560 tx=0x7f7b8c00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b94c00640 1 -- 172.21.15.114:0/3461788728 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c017070 con 0x7f7b980cdb30 2024-09-16T07:36:08.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b94c00640 1 -- 172.21.15.114:0/3461788728 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b8c003600 con 0x7f7b980cdb30 2024-09-16T07:36:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b980cb960 con 0x7f7b980cdb30 2024-09-16T07:36:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b94c00640 1 -- 172.21.15.114:0/3461788728 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c003a50 con 0x7f7b980cdb30 2024-09-16T07:36:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b980b2ce0 con 0x7f7b980cdb30 2024-09-16T07:36:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b980ce670 con 0x7f7b980cdb30 2024-09-16T07:36:08.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.424+0000 7f7b94c00640 1 -- 172.21.15.114:0/3461788728 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f7b8c01a070 con 0x7f7b980cdb30 2024-09-16T07:36:08.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.428+0000 7f7b94c00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b78073730 0x7f7b78075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.428+0000 7f7b94c00640 1 -- 172.21.15.114:0/3461788728 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4885+0+0 (secure 0 0 0) 0x7f7b8c0941e0 con 0x7f7b980cdb30 2024-09-16T07:36:08.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.428+0000 7f7b97e00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b78073730 0x7f7b78075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.428+0000 7f7b97e00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b78073730 0x7f7b78075bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7b840af000 tx=0x7f7b8401aef0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:08.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.432+0000 7f7b94c00640 1 -- 172.21.15.114:0/3461788728 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7b981f8fe0 con 0x7f7b980cdb30 2024-09-16T07:36:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.656+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7b980b4f70 con 0x7f7b980cdb30 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.656+0000 7f7b94c00640 1 -- 172.21.15.114:0/3461788728 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7f7b8c092e20 con 0x7f7b980cdb30 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:36:08.656 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:08.657 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.658 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.659 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.660 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.661 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.662 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.663 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.664 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.665 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.666 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:36:08.667 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.668 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.669 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:36:08.670 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:36:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b78073730 msgr2=0x7f7b78075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b78073730 0x7f7b78075bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7b840af000 tx=0x7f7b8401aef0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b980cdb30 msgr2=0x7f7b981f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b980cdb30 0x7f7b981f8aa0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00c560 tx=0x7f7b8c00ca20 comp rx=0 tx=0).stop 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 shutdown_connections 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7b78073730 0x7f7b78075bf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7b9815bea0 0x7f7b9815ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b980ced80 0x7f7b980cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 --2- 172.21.15.114:0/3461788728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b980cdb30 0x7f7b981f8aa0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 >> 172.21.15.114:0/3461788728 conn(0x7f7b980d1dc0 msgr2=0x7f7b980b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 shutdown_connections 2024-09-16T07:36:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.660+0000 7f7b9fa00640 1 -- 172.21.15.114:0/3461788728 wait complete. 2024-09-16T07:36:08.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:36:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.820+0000 7f99ad000640 1 -- 172.21.15.114:0/1453838830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a815be80 msgr2=0x7f99a80ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.820+0000 7f99ad000640 1 --2- 172.21.15.114:0/1453838830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a815be80 0x7f99a80ce4e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9998009bf0 tx=0x7f999801cb00 comp rx=0 tx=0).stop 2024-09-16T07:36:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.820+0000 7f99ad000640 1 -- 172.21.15.114:0/1453838830 shutdown_connections 2024-09-16T07:36:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.820+0000 7f99ad000640 1 --2- 172.21.15.114:0/1453838830 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a815be80 0x7f99a80ce4e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.820+0000 7f99ad000640 1 -- 172.21.15.114:0/1453838830 >> 172.21.15.114:0/1453838830 conn(0x7f99a80d1da0 msgr2=0x7f99a80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.820+0000 7f99ad000640 1 -- 172.21.15.114:0/1453838830 shutdown_connections 2024-09-16T07:36:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.820+0000 7f99ad000640 1 -- 172.21.15.114:0/1453838830 wait complete. 2024-09-16T07:36:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 Processor -- start 2024-09-16T07:36:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 -- start start 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a80cd8c0 0x7f99a81f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99a80d28c0 0x7f99a814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a815be80 0x7f99a81552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99a816a710 con 0x7f99a815be80 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f99a816a590 con 0x7f99a80d28c0 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f99a816a890 con 0x7f99a80cd8c0 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a815be80 0x7f99a81552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a815be80 0x7f99a81552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58680/0 (socket says 172.21.15.114:58680) 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 -- 172.21.15.114:0/2225020383 learned_addr learned my addr 172.21.15.114:0/2225020383 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f999d400640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99a80d28c0 0x7f99a814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a5e00640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a80cd8c0 0x7f99a81f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 -- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a80cd8c0 msgr2=0x7f99a81f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a80cd8c0 0x7f99a81f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 -- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99a80d28c0 msgr2=0x7f99a814c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99a80d28c0 0x7f99a814c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:08.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 -- 172.21.15.114:0/2225020383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a81f9180 con 0x7f99a815be80 2024-09-16T07:36:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99a6800640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a815be80 0x7f99a81552f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c4d0 tx=0x7f99a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f999ea00640 1 -- 172.21.15.114:0/2225020383 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00052d0 con 0x7f99a815be80 2024-09-16T07:36:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f999ea00640 1 -- 172.21.15.114:0/2225020383 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99a0005470 con 0x7f99a815be80 2024-09-16T07:36:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f999ea00640 1 -- 172.21.15.114:0/2225020383 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0012870 con 0x7f99a815be80 2024-09-16T07:36:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a814c6a0 con 0x7f99a815be80 2024-09-16T07:36:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.824+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a80c5ab0 con 0x7f99a815be80 2024-09-16T07:36:08.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.828+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a80c58d0 con 0x7f99a815be80 2024-09-16T07:36:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.828+0000 7f999ea00640 1 -- 172.21.15.114:0/2225020383 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f99a0012a10 con 0x7f99a815be80 2024-09-16T07:36:08.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.828+0000 7f999ea00640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9984073730 0x7f9984075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:08.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.828+0000 7f999ea00640 1 -- 172.21.15.114:0/2225020383 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4885+0+0 (secure 0 0 0) 0x7f99a003c020 con 0x7f99a815be80 2024-09-16T07:36:08.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.828+0000 7f99a5e00640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9984073730 0x7f9984075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:08.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.832+0000 7f99a5e00640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9984073730 0x7f9984075bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99980af000 tx=0x7f999801b340 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:08.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:08.832+0000 7f999ea00640 1 -- 172.21.15.114:0/2225020383 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f99a80c58d0 con 0x7f99a815be80 2024-09-16T07:36:09.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.000+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f99a80d2390 con 0x7f99a815be80 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f999ea00640 1 -- 172.21.15.114:0/2225020383 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v148) ==== 84+0+65 (secure 0 0 0) 0x7f99a005ecd0 con 0x7f99a815be80 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:09.002 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9984073730 msgr2=0x7f9984075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9984073730 0x7f9984075bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f99980af000 tx=0x7f999801b340 comp rx=0 tx=0).stop 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a815be80 msgr2=0x7f99a81552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a815be80 0x7f99a81552f0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c4d0 tx=0x7f99a000c990 comp rx=0 tx=0).stop 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 shutdown_connections 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99a815be80 0x7f99a81552f0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f99a80d28c0 0x7f99a814c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9984073730 0x7f9984075bf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 --2- 172.21.15.114:0/2225020383 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f99a80cd8c0 0x7f99a81f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 >> 172.21.15.114:0/2225020383 conn(0x7f99a80d1da0 msgr2=0x7f99a80b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:09.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 shutdown_connections 2024-09-16T07:36:09.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.004+0000 7f99ad000640 1 -- 172.21.15.114:0/2225020383 wait complete. 2024-09-16T07:36:09.022 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:36:09.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:36:09.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 -- 172.21.15.114:0/952045838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c15dff0 msgr2=0x7fec7c0d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 --2- 172.21.15.114:0/952045838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c15dff0 0x7fec7c0d1ae0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009840 tx=0x7fec6c01c820 comp rx=0 tx=0).stop 2024-09-16T07:36:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 -- 172.21.15.114:0/952045838 shutdown_connections 2024-09-16T07:36:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 --2- 172.21.15.114:0/952045838 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec7c0cf950 0x7fec7c0d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 --2- 172.21.15.114:0/952045838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c15dff0 0x7fec7c0d1ae0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 -- 172.21.15.114:0/952045838 >> 172.21.15.114:0/952045838 conn(0x7fec7c0d3f10 msgr2=0x7fec7c0d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 -- 172.21.15.114:0/952045838 shutdown_connections 2024-09-16T07:36:09.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 -- 172.21.15.114:0/952045838 wait complete. 2024-09-16T07:36:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 Processor -- start 2024-09-16T07:36:09.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.168+0000 7fec7be00640 1 -- start start 2024-09-16T07:36:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec7c0cf950 0x7fec7c0b9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c0d24d0 0x7fec7c0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:09.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec7c15dff0 0x7fec7c148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c16b6c0 con 0x7fec7c0d24d0 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c0cff40 con 0x7fec7c15dff0 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c16b840 con 0x7fec7c0cf950 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c0d24d0 0x7fec7c0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c0d24d0 0x7fec7c0cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58688/0 (socket says 172.21.15.114:58688) 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 -- 172.21.15.114:0/3934942910 learned_addr learned my addr 172.21.15.114:0/3934942910 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7aa00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec7c0cf950 0x7fec7c0b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7b400640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec7c15dff0 0x7fec7c148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 -- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec7c0cf950 msgr2=0x7fec7c0b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec7c0cf950 0x7fec7c0b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 -- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec7c15dff0 msgr2=0x7fec7c148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:09.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec7c15dff0 0x7fec7c148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 -- 172.21.15.114:0/3934942910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c14ca30 con 0x7fec7c0d24d0 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7b400640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec7c15dff0 0x7fec7c148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec73e00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c0d24d0 0x7fec7c0cb720 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e9f0 tx=0x7fec6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec72a00640 1 -- 172.21.15.114:0/3934942910 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6400cd80 con 0x7fec7c0d24d0 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec72a00640 1 -- 172.21.15.114:0/3934942910 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec64004020 con 0x7fec7c0d24d0 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec72a00640 1 -- 172.21.15.114:0/3934942910 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64004450 con 0x7fec7c0d24d0 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c14cd10 con 0x7fec7c0d24d0 2024-09-16T07:36:09.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c14d2d0 con 0x7fec7c0d24d0 2024-09-16T07:36:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.172+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c0d1280 con 0x7fec7c0d24d0 2024-09-16T07:36:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.176+0000 7fec72a00640 1 -- 172.21.15.114:0/3934942910 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fec64003600 con 0x7fec7c0d24d0 2024-09-16T07:36:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.176+0000 7fec72a00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec58073730 0x7fec58075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:09.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.176+0000 7fec72a00640 1 -- 172.21.15.114:0/3934942910 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4885+0+0 (secure 0 0 0) 0x7fec640957e0 con 0x7fec7c0d24d0 2024-09-16T07:36:09.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.176+0000 7fec7aa00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec58073730 0x7fec58075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:09.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.176+0000 7fec7aa00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec58073730 0x7fec58075bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0af000 tx=0x7fec6c0195c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:09.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.180+0000 7fec72a00640 1 -- 172.21.15.114:0/3934942910 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fec6405fe80 con 0x7fec7c0d24d0 2024-09-16T07:36:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:09.352+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fec7c0b9e90 con 0x7fec7c0d24d0 2024-09-16T07:36:10.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.272+0000 7fec72a00640 1 -- 172.21.15.114:0/3934942910 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v149) ==== 138+0+0 (secure 0 0 0) 0x7fec6405f780 con 0x7fec7c0d24d0 2024-09-16T07:36:10.272 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:36:10.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec58073730 msgr2=0x7fec58075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:10.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec58073730 0x7fec58075bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0af000 tx=0x7fec6c0195c0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c0d24d0 msgr2=0x7fec7c0cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c0d24d0 0x7fec7c0cb720 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e9f0 tx=0x7fec6400eeb0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 shutdown_connections 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec7c15dff0 0x7fec7c148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c0d24d0 0x7fec7c0cb720 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fec58073730 0x7fec58075bf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 --2- 172.21.15.114:0/3934942910 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec7c0cf950 0x7fec7c0b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 >> 172.21.15.114:0/3934942910 conn(0x7fec7c0d3f10 msgr2=0x7fec7c0b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 shutdown_connections 2024-09-16T07:36:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.276+0000 7fec7be00640 1 -- 172.21.15.114:0/3934942910 wait complete. 2024-09-16T07:36:10.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:36:10.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 -- 172.21.15.114:0/34187656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015bfa0 msgr2=0x7f84600cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:10.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 --2- 172.21.15.114:0/34187656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015bfa0 0x7f84600cd000 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f844c009900 tx=0x7f844c01f0d0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 -- 172.21.15.114:0/34187656 shutdown_connections 2024-09-16T07:36:10.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 --2- 172.21.15.114:0/34187656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015bfa0 0x7f84600cd000 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 --2- 172.21.15.114:0/34187656 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f846015c3e0 0x7f846015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 -- 172.21.15.114:0/34187656 >> 172.21.15.114:0/34187656 conn(0x7f84600b18f0 msgr2=0x7f84600b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 -- 172.21.15.114:0/34187656 shutdown_connections 2024-09-16T07:36:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.456+0000 7f8467400640 1 -- 172.21.15.114:0/34187656 wait complete. 2024-09-16T07:36:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 Processor -- start 2024-09-16T07:36:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 -- start start 2024-09-16T07:36:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84600cd540 0x7f84600c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846015bfa0 0x7f8460154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015c3e0 0x7f84601f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f84601601a0 con 0x7f846015c3e0 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8460160020 con 0x7f846015bfa0 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8460160320 con 0x7f84600cd540 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8465400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015c3e0 0x7f84601f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8464a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84600cd540 0x7f84600c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f845fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846015bfa0 0x7f8460154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8464a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84600cd540 0x7f84600c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:59842/0 (socket says 172.21.15.114:59842) 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8464a00640 1 -- 172.21.15.114:0/2252595140 learned_addr learned my addr 172.21.15.114:0/2252595140 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f845fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846015bfa0 0x7f8460154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:39742/0 (socket says 172.21.15.114:39742) 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8465400640 1 -- 172.21.15.114:0/2252595140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84600cd540 msgr2=0x7f84600c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:10.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8465400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84600cd540 0x7f84600c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8465400640 1 -- 172.21.15.114:0/2252595140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846015bfa0 msgr2=0x7f8460154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8465400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846015bfa0 0x7f8460154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8465400640 1 -- 172.21.15.114:0/2252595140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84601f52e0 con 0x7f846015c3e0 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8465400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015c3e0 0x7f84601f4ab0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f84600cfbb0 tx=0x7f845800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f845cc00640 1 -- 172.21.15.114:0/2252595140 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458017070 con 0x7f846015c3e0 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f845cc00640 1 -- 172.21.15.114:0/2252595140 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84580053c0 con 0x7f846015c3e0 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f845cc00640 1 -- 172.21.15.114:0/2252595140 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84580118b0 con 0x7f846015c3e0 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84601f55c0 con 0x7f846015c3e0 2024-09-16T07:36:10.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.460+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84600ad1f0 con 0x7f846015c3e0 2024-09-16T07:36:10.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.464+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8460069410 con 0x7f846015c3e0 2024-09-16T07:36:10.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.464+0000 7f845cc00640 1 -- 172.21.15.114:0/2252595140 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f845801a070 con 0x7f846015c3e0 2024-09-16T07:36:10.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.464+0000 7f845cc00640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8440073730 0x7f8440075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:10.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.464+0000 7f845cc00640 1 -- 172.21.15.114:0/2252595140 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5255+0+0 (secure 0 0 0) 0x7f8458094600 con 0x7f846015c3e0 2024-09-16T07:36:10.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.464+0000 7f8464a00640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8440073730 0x7f8440075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:10.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.468+0000 7f8464a00640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8440073730 0x7f8440075bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8450009fc0 tx=0x7f8450009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:10.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.468+0000 7f845cc00640 1 -- 172.21.15.114:0/2252595140 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8458021020 con 0x7f846015c3e0 2024-09-16T07:36:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:10.636+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f84600cd000 con 0x7f846015c3e0 2024-09-16T07:36:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.280+0000 7f845cc00640 1 -- 172.21.15.114:0/2252595140 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v150) ==== 170+0+0 (secure 0 0 0) 0x7f845805e410 con 0x7f846015c3e0 2024-09-16T07:36:11.281 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:36:11.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.284+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8440073730 msgr2=0x7f8440075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:11.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.284+0000 7f8467400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8440073730 0x7f8440075bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8450009fc0 tx=0x7f8450009500 comp rx=0 tx=0).stop 2024-09-16T07:36:11.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.284+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015c3e0 msgr2=0x7f84601f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:11.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.284+0000 7f8467400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015c3e0 0x7f84601f4ab0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f84600cfbb0 tx=0x7f845800c820 comp rx=0 tx=0).stop 2024-09-16T07:36:11.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 shutdown_connections 2024-09-16T07:36:11.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f846015c3e0 0x7f84601f4ab0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f846015bfa0 0x7f8460154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8440073730 0x7f8440075bf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 --2- 172.21.15.114:0/2252595140 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f84600cd540 0x7f84600c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 >> 172.21.15.114:0/2252595140 conn(0x7f84600b18f0 msgr2=0x7f84600cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:11.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 shutdown_connections 2024-09-16T07:36:11.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.288+0000 7f8467400640 1 -- 172.21.15.114:0/2252595140 wait complete. 2024-09-16T07:36:11.327 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:36:11.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- 172.21.15.114:0/3989184793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cfb20 msgr2=0x7f4c840ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:11.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 --2- 172.21.15.114:0/3989184793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cfb20 0x7f4c840ceea0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f4c8406aab0 tx=0x7f4c6c01c770 comp rx=0 tx=0).stop 2024-09-16T07:36:11.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- 172.21.15.114:0/3989184793 shutdown_connections 2024-09-16T07:36:11.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 --2- 172.21.15.114:0/3989184793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cfb20 0x7f4c840ceea0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 --2- 172.21.15.114:0/3989184793 >> v2:172.21.15.149:3300/0 conn(0x7f4c840ceac0 0x7f4c840d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- 172.21.15.114:0/3989184793 >> 172.21.15.114:0/3989184793 conn(0x7f4c840d0c90 msgr2=0x7f4c840d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:11.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- 172.21.15.114:0/3989184793 shutdown_connections 2024-09-16T07:36:11.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- 172.21.15.114:0/3989184793 wait complete. 2024-09-16T07:36:11.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 Processor -- start 2024-09-16T07:36:11.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- start start 2024-09-16T07:36:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cb2e0 0x7f4c84158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840ceac0 0x7f4c8415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:11.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c840cfb20 0x7f4c8415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:11.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4c84168060 con 0x7f4c840cb2e0 2024-09-16T07:36:11.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4c84070c60 con 0x7f4c840cfb20 2024-09-16T07:36:11.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c89000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4c841681e0 con 0x7f4c840ceac0 2024-09-16T07:36:11.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cb2e0 0x7f4c84158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cb2e0 0x7f4c84158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58722/0 (socket says 172.21.15.114:58722) 2024-09-16T07:36:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 -- 172.21.15.114:0/3218290703 learned_addr learned my addr 172.21.15.114:0/3218290703 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:11.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c82800640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c840cfb20 0x7f4c8415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c79400640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840ceac0 0x7f4c8415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 -- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840ceac0 msgr2=0x7f4c8415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840ceac0 0x7f4c8415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 -- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c840cfb20 msgr2=0x7f4c8415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c840cfb20 0x7f4c8415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:11.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c81e00640 1 -- 172.21.15.114:0/3218290703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8415d170 con 0x7f4c840cb2e0 2024-09-16T07:36:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.476+0000 7f4c79400640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840ceac0 0x7f4c8415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c81e00640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cb2e0 0x7f4c84158f40 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d980 tx=0x7f4c7400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c7aa00640 1 -- 172.21.15.114:0/3218290703 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74017070 con 0x7f4c840cb2e0 2024-09-16T07:36:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c7aa00640 1 -- 172.21.15.114:0/3218290703 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c74009d20 con 0x7f4c840cb2e0 2024-09-16T07:36:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c7aa00640 1 -- 172.21.15.114:0/3218290703 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c740106c0 con 0x7f4c840cb2e0 2024-09-16T07:36:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c8415d450 con 0x7f4c840cb2e0 2024-09-16T07:36:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c8415da10 con 0x7f4c840cb2e0 2024-09-16T07:36:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c840d05c0 con 0x7f4c840cb2e0 2024-09-16T07:36:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.480+0000 7f4c7aa00640 1 -- 172.21.15.114:0/3218290703 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f4c74010860 con 0x7f4c840cb2e0 2024-09-16T07:36:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.484+0000 7f4c7aa00640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c60073730 0x7f4c60075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.484+0000 7f4c7aa00640 1 -- 172.21.15.114:0/3218290703 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5637+0+0 (secure 0 0 0) 0x7f4c74092e60 con 0x7f4c840cb2e0 2024-09-16T07:36:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.484+0000 7f4c79400640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c60073730 0x7f4c60075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.484+0000 7f4c79400640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c60073730 0x7f4c60075bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0af000 tx=0x7f4c6c01afb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:11.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.484+0000 7f4c7aa00640 1 -- 172.21.15.114:0/3218290703 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4c7405f4f0 con 0x7f4c840cb2e0 2024-09-16T07:36:11.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:11.692+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4c840cab20 con 0x7f4c840cb2e0 2024-09-16T07:36:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.284+0000 7f4c7aa00640 1 -- 172.21.15.114:0/3218290703 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v109) ==== 174+0+0 (secure 0 0 0) 0x7f4c74063f20 con 0x7f4c840cb2e0 2024-09-16T07:36:12.283 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 24 and data pool 25 2024-09-16T07:36:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c60073730 msgr2=0x7f4c60075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c60073730 0x7f4c60075bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0af000 tx=0x7f4c6c01afb0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cb2e0 msgr2=0x7f4c84158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cb2e0 0x7f4c84158f40 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400d980 tx=0x7f4c7400de40 comp rx=0 tx=0).stop 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 shutdown_connections 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4c840cfb20 0x7f4c8415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c60073730 0x7f4c60075bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4c840ceac0 0x7f4c8415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 --2- 172.21.15.114:0/3218290703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c840cb2e0 0x7f4c84158f40 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 >> 172.21.15.114:0/3218290703 conn(0x7f4c840d0c90 msgr2=0x7f4c840b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 shutdown_connections 2024-09-16T07:36:12.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.288+0000 7f4c89000640 1 -- 172.21.15.114:0/3218290703 wait complete. 2024-09-16T07:36:12.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 -- 172.21.15.114:0/837841793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 msgr2=0x7fc2800cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 --2- 172.21.15.114:0/837841793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2800cefb0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fc278009bc0 tx=0x7fc27801cb10 comp rx=0 tx=0).stop 2024-09-16T07:36:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 -- 172.21.15.114:0/837841793 shutdown_connections 2024-09-16T07:36:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 --2- 172.21.15.114:0/837841793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2800cefb0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 -- 172.21.15.114:0/837841793 >> 172.21.15.114:0/837841793 conn(0x7fc28009aa10 msgr2=0x7fc28009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 -- 172.21.15.114:0/837841793 shutdown_connections 2024-09-16T07:36:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 -- 172.21.15.114:0/837841793 wait complete. 2024-09-16T07:36:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 Processor -- start 2024-09-16T07:36:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.472+0000 7fc27f200640 1 -- start start 2024-09-16T07:36:12.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2801f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2800d01b0 0x7fc280167020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc28015f000 0x7fc280070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc28016a050 con 0x7fc2800b2ca0 2024-09-16T07:36:12.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc280169ed0 con 0x7fc2800d01b0 2024-09-16T07:36:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc28016a1d0 con 0x7fc28015f000 2024-09-16T07:36:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2801f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2801f85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58732/0 (socket says 172.21.15.114:58732) 2024-09-16T07:36:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 -- 172.21.15.114:0/269208866 learned_addr learned my addr 172.21.15.114:0/269208866 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27e800640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc28015f000 0x7fc280070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27d400640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2800d01b0 0x7fc280167020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 -- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc28015f000 msgr2=0x7fc280070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc28015f000 0x7fc280070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 -- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2800d01b0 msgr2=0x7fc280167020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2800d01b0 0x7fc280167020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 -- 172.21.15.114:0/269208866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2800b7770 con 0x7fc2800b2ca0 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27de00640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2801f85c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c420 tx=0x7fc27000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc276000640 1 -- 172.21.15.114:0/269208866 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270017070 con 0x7fc2800b2ca0 2024-09-16T07:36:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc276000640 1 -- 172.21.15.114:0/269208866 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2700053c0 con 0x7fc2800b2ca0 2024-09-16T07:36:12.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2801f7ae0 con 0x7fc2800b2ca0 2024-09-16T07:36:12.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc276000640 1 -- 172.21.15.114:0/269208866 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270003860 con 0x7fc2800b2ca0 2024-09-16T07:36:12.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2801f80a0 con 0x7fc2800b2ca0 2024-09-16T07:36:12.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.476+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2800cefb0 con 0x7fc2800b2ca0 2024-09-16T07:36:12.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.480+0000 7fc276000640 1 -- 172.21.15.114:0/269208866 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fc27001a070 con 0x7fc2800b2ca0 2024-09-16T07:36:12.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.480+0000 7fc276000640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc260073730 0x7fc260075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.480+0000 7fc276000640 1 -- 172.21.15.114:0/269208866 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5737+0+0 (secure 0 0 0) 0x7fc2700943b0 con 0x7fc2800b2ca0 2024-09-16T07:36:12.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.480+0000 7fc27d400640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc260073730 0x7fc260075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.480+0000 7fc27d400640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc260073730 0x7fc260075bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc280156a30 tx=0x7fc26c007cd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:12.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.484+0000 7fc276000640 1 -- 172.21.15.114:0/269208866 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc27005dff0 con 0x7fc2800b2ca0 2024-09-16T07:36:12.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.656+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2800b2750 con 0x7fc2800b2ca0 2024-09-16T07:36:12.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.656+0000 7fc276000640 1 -- 172.21.15.114:0/269208866 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16844 (secure 0 0 0) 0x7fc270062a20 con 0x7fc2800b2ca0 2024-09-16T07:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:12.657 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":151,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:11.697526+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:09.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:10.653300+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:12.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc260073730 msgr2=0x7fc260075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc260073730 0x7fc260075bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc280156a30 tx=0x7fc26c007cd0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 msgr2=0x7fc2801f85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2801f85c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c420 tx=0x7fc27000c8e0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 shutdown_connections 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc260073730 0x7fc260075bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc28015f000 0x7fc280070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2800d01b0 0x7fc280167020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 --2- 172.21.15.114:0/269208866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2800b2ca0 0x7fc2801f85c0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 >> 172.21.15.114:0/269208866 conn(0x7fc28009aa10 msgr2=0x7fc2800ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 shutdown_connections 2024-09-16T07:36:12.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.660+0000 7fc27f200640 1 -- 172.21.15.114:0/269208866 wait complete. 2024-09-16T07:36:12.679 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 -- 172.21.15.114:0/3044825938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 msgr2=0x7fbd3c0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 --2- 172.21.15.114:0/3044825938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0cea20 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c074290 tx=0x7fbd2801c8c0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 -- 172.21.15.114:0/3044825938 shutdown_connections 2024-09-16T07:36:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 --2- 172.21.15.114:0/3044825938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0cea20 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 --2- 172.21.15.114:0/3044825938 >> v2:172.21.15.149:3300/0 conn(0x7fbd3c0b53f0 0x7fbd3c0b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 --2- 172.21.15.114:0/3044825938 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd3c15be80 0x7fbd3c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 -- 172.21.15.114:0/3044825938 >> 172.21.15.114:0/3044825938 conn(0x7fbd3c0d1da0 msgr2=0x7fbd3c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 -- 172.21.15.114:0/3044825938 shutdown_connections 2024-09-16T07:36:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.820+0000 7fbd44000640 1 -- 172.21.15.114:0/3044825938 wait complete. 2024-09-16T07:36:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 Processor -- start 2024-09-16T07:36:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 -- start start 2024-09-16T07:36:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd3c0b53f0 0x7fbd3c1fb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd3c15be80 0x7fbd3c159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c0ccfa0 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c0cce20 con 0x7fbd3c15be80 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3c0cd120 con 0x7fbd3c0b53f0 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58746/0 (socket says 172.21.15.114:58746) 2024-09-16T07:36:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 -- 172.21.15.114:0/3384873253 learned_addr learned my addr 172.21.15.114:0/3384873253 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd42000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd3c15be80 0x7fbd3c159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd41600640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd3c0b53f0 0x7fbd3c1fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 -- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd3c0b53f0 msgr2=0x7fbd3c1fb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd3c0b53f0 0x7fbd3c1fb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 -- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd3c15be80 msgr2=0x7fbd3c159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd3c15be80 0x7fbd3c159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 -- 172.21.15.114:0/3384873253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c0c5250 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd41600640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd3c0b53f0 0x7fbd3c1fb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd42000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd3c15be80 0x7fbd3c159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd40c00640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0c4d10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbd280b0040 tx=0x7fbd280a56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd39600640 1 -- 172.21.15.114:0/3384873253 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd280b2040 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd39600640 1 -- 172.21.15.114:0/3384873253 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd280043a0 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c0c75b0 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd39600640 1 -- 172.21.15.114:0/3384873253 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28005290 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.824+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c0c7b70 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.828+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3c0b5880 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.828+0000 7fbd39600640 1 -- 172.21.15.114:0/3384873253 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fbd3c0b65d0 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.828+0000 7fbd39600640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd1c073730 0x7fbd1c075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.828+0000 7fbd39600640 1 -- 172.21.15.114:0/3384873253 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5737+0+0 (secure 0 0 0) 0x7fbd2812c040 con 0x7fbd3c0d28c0 2024-09-16T07:36:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.828+0000 7fbd41600640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd1c073730 0x7fbd1c075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:12.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.828+0000 7fbd41600640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd1c073730 0x7fbd1c075bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005fd0 tx=0x7fbd30005d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:12.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:12.832+0000 7fbd39600640 1 -- 172.21.15.114:0/3384873253 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fbd280164b0 con 0x7fbd3c0d28c0 2024-09-16T07:36:13.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd3c06f7c0 con 0x7fbd3c0d28c0 2024-09-16T07:36:13.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd39600640 1 -- 172.21.15.114:0/3384873253 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16844 (secure 0 0 0) 0x7fbd280f8cc0 con 0x7fbd3c0d28c0 2024-09-16T07:36:13.003 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:13.003 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":151,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:11.697526+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:09.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:10.653300+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:13.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd1c073730 msgr2=0x7fbd1c075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:13.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd1c073730 0x7fbd1c075bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005fd0 tx=0x7fbd30005d60 comp rx=0 tx=0).stop 2024-09-16T07:36:13.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 msgr2=0x7fbd3c0c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:13.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0c4d10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbd280b0040 tx=0x7fbd280a56d0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 shutdown_connections 2024-09-16T07:36:13.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd3c15be80 0x7fbd3c159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd3c0d28c0 0x7fbd3c0c4d10 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fbd1c073730 0x7fbd1c075bf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 --2- 172.21.15.114:0/3384873253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbd3c0b53f0 0x7fbd3c1fb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 >> 172.21.15.114:0/3384873253 conn(0x7fbd3c0d1da0 msgr2=0x7fbd3c0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:13.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 shutdown_connections 2024-09-16T07:36:13.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.004+0000 7fbd44000640 1 -- 172.21.15.114:0/3384873253 wait complete. 2024-09-16T07:36:13.024 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:36:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 -- 172.21.15.114:0/540664205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f40b4bd0 msgr2=0x7fb0f40cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 --2- 172.21.15.114:0/540664205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f40b4bd0 0x7fb0f40cf130 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fb0f406aab0 tx=0x7fb0ec01c8c0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 -- 172.21.15.114:0/540664205 shutdown_connections 2024-09-16T07:36:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 --2- 172.21.15.114:0/540664205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f40b4bd0 0x7fb0f40cf130 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 --2- 172.21.15.114:0/540664205 >> v2:172.21.15.149:3300/0 conn(0x7fb0f415ade0 0x7fb0f40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 -- 172.21.15.114:0/540664205 >> 172.21.15.114:0/540664205 conn(0x7fb0f40b18f0 msgr2=0x7fb0f40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 -- 172.21.15.114:0/540664205 shutdown_connections 2024-09-16T07:36:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.168+0000 7fb0faa00640 1 -- 172.21.15.114:0/540664205 wait complete. 2024-09-16T07:36:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 Processor -- start 2024-09-16T07:36:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 -- start start 2024-09-16T07:36:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f406e810 0x7fb0f4163d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0f40b4bd0 0x7fb0f4073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f415ade0 0x7fb0f41502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f41680e0 con 0x7fb0f415ade0 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4167f60 con 0x7fb0f406e810 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f4168260 con 0x7fb0f40b4bd0 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f415ade0 0x7fb0f41502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f415ade0 0x7fb0f41502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58760/0 (socket says 172.21.15.114:58760) 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 -- 172.21.15.114:0/4285254894 learned_addr learned my addr 172.21.15.114:0/4285254894 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0eb400640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0f40b4bd0 0x7fb0f4073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 -- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0f40b4bd0 msgr2=0x7fb0f4073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0f40b4bd0 0x7fb0f4073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f3e00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f406e810 0x7fb0f4163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 -- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f406e810 msgr2=0x7fb0f4163d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f406e810 0x7fb0f4163d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 -- 172.21.15.114:0/4285254894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f4074520 con 0x7fb0f415ade0 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0eb400640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0f40b4bd0 0x7fb0f4073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f3e00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f406e810 0x7fb0f4163d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f8a00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f415ade0 0x7fb0f41502b0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec01cda0 tx=0x7fb0ec0a6450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f0c00640 1 -- 172.21.15.114:0/4285254894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0ac070 con 0x7fb0f415ade0 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f0c00640 1 -- 172.21.15.114:0/4285254894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0ec0053b0 con 0x7fb0f415ade0 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f414f7d0 con 0x7fb0f415ade0 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0f0c00640 1 -- 172.21.15.114:0/4285254894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0046d0 con 0x7fb0f415ade0 2024-09-16T07:36:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.172+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f4164260 con 0x7fb0f415ade0 2024-09-16T07:36:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.176+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f415e900 con 0x7fb0f415ade0 2024-09-16T07:36:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.176+0000 7fb0f0c00640 1 -- 172.21.15.114:0/4285254894 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fb0ec0af070 con 0x7fb0f415ade0 2024-09-16T07:36:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.176+0000 7fb0f0c00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0d0073760 0x7fb0d0075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.176+0000 7fb0f0c00640 1 -- 172.21.15.114:0/4285254894 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5737+0+0 (secure 0 0 0) 0x7fb0ec12ed80 con 0x7fb0f415ade0 2024-09-16T07:36:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.176+0000 7fb0f3e00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0d0073760 0x7fb0d0075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.176+0000 7fb0f3e00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0d0073760 0x7fb0d0075c20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009d90 tx=0x7fb0e4009320 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.180+0000 7fb0f0c00640 1 -- 172.21.15.114:0/4285254894 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb0ec0b6070 con 0x7fb0f415ade0 2024-09-16T07:36:13.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:13.388+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb0f41552a0 con 0x7fb0f415ade0 2024-09-16T07:36:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.316+0000 7fb0f0c00640 1 -- 172.21.15.114:0/4285254894 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v112) ==== 118+0+0 (secure 0 0 0) 0x7fb0ec0164b0 con 0x7fb0f415ade0 2024-09-16T07:36:14.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0d0073760 msgr2=0x7fb0d0075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:14.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0d0073760 0x7fb0d0075c20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009d90 tx=0x7fb0e4009320 comp rx=0 tx=0).stop 2024-09-16T07:36:14.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f415ade0 msgr2=0x7fb0f41502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:14.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f415ade0 0x7fb0f41502b0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec01cda0 tx=0x7fb0ec0a6450 comp rx=0 tx=0).stop 2024-09-16T07:36:14.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 shutdown_connections 2024-09-16T07:36:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0f415ade0 0x7fb0f41502b0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0d0073760 0x7fb0d0075c20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0f40b4bd0 0x7fb0f4073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 --2- 172.21.15.114:0/4285254894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0f406e810 0x7fb0f4163d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 >> 172.21.15.114:0/4285254894 conn(0x7fb0f40b18f0 msgr2=0x7fb0f41557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 shutdown_connections 2024-09-16T07:36:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.320+0000 7fb0faa00640 1 -- 172.21.15.114:0/4285254894 wait complete. 2024-09-16T07:36:14.341 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:36:14.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:36:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- 172.21.15.114:0/447938638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 msgr2=0x7f6f140051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 --2- 172.21.15.114:0/447938638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 0x7f6f140051d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009ef0 tx=0x7f6f2801d1d0 comp rx=0 tx=0).stop 2024-09-16T07:36:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f2e800640 1 -- 172.21.15.114:0/447938638 reap_dead start 2024-09-16T07:36:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- 172.21.15.114:0/447938638 shutdown_connections 2024-09-16T07:36:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- 172.21.15.114:0/447938638 >> 172.21.15.114:0/447938638 conn(0x7f6f3006ecb0 msgr2=0x7f6f3006f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- 172.21.15.114:0/447938638 shutdown_connections 2024-09-16T07:36:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- 172.21.15.114:0/447938638 wait complete. 2024-09-16T07:36:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 Processor -- start 2024-09-16T07:36:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- start start 2024-09-16T07:36:14.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 0x7f6f30142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:14.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f300ca400 0x7f6f30142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:14.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f30143100 0x7f6f30157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:14.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30074500 con 0x7f6f14004d50 2024-09-16T07:36:14.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30158ac0 con 0x7f6f300ca400 2024-09-16T07:36:14.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.492+0000 7f6f35000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f30074680 con 0x7f6f30143100 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 0x7f6f30142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 0x7f6f30142680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36756/0 (socket says 172.21.15.114:36756) 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 -- 172.21.15.114:0/2960056479 learned_addr learned my addr 172.21.15.114:0/2960056479 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f27e00640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f300ca400 0x7f6f30142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2e800640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f30143100 0x7f6f30157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 -- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f30143100 msgr2=0x7f6f30157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f30143100 0x7f6f30157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 -- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f300ca400 msgr2=0x7f6f30142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f300ca400 0x7f6f30142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 -- 172.21.15.114:0/2960056479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f30154f70 con 0x7f6f14004d50 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f2de00640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 0x7f6f30142680 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000e600 tx=0x7f6f2000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f26000640 1 -- 172.21.15.114:0/2960056479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20015070 con 0x7f6f14004d50 2024-09-16T07:36:14.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f26000640 1 -- 172.21.15.114:0/2960056479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f2000cab0 con 0x7f6f14004d50 2024-09-16T07:36:14.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f30155250 con 0x7f6f14004d50 2024-09-16T07:36:14.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f26000640 1 -- 172.21.15.114:0/2960056479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20011460 con 0x7f6f14004d50 2024-09-16T07:36:14.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f30157690 con 0x7f6f14004d50 2024-09-16T07:36:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3015b860 con 0x7f6f14004d50 2024-09-16T07:36:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.496+0000 7f6f26000640 1 -- 172.21.15.114:0/2960056479 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f6f20018070 con 0x7f6f14004d50 2024-09-16T07:36:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.500+0000 7f6f26000640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f0c073760 0x7f6f0c075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.500+0000 7f6f26000640 1 -- 172.21.15.114:0/2960056479 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f6f200954b0 con 0x7f6f14004d50 2024-09-16T07:36:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.500+0000 7f6f27e00640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f0c073760 0x7f6f0c075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.500+0000 7f6f27e00640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f0c073760 0x7f6f0c075c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6f300d0750 tx=0x7f6f180091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:14.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.500+0000 7f6f26000640 1 -- 172.21.15.114:0/2960056479 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6f2005f0f0 con 0x7f6f14004d50 2024-09-16T07:36:14.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-16T07:36:14.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-16T07:36:14.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-16T07:36:14.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-16T07:36:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:14.704+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6f30155420 con 0x7f6f14004d50 2024-09-16T07:36:15.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.324+0000 7f6f26000640 1 -- 172.21.15.114:0/2960056479 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v113) ==== 122+0+0 (secure 0 0 0) 0x7f6f20063b20 con 0x7f6f14004d50 2024-09-16T07:36:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f0c073760 msgr2=0x7f6f0c075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f0c073760 0x7f6f0c075c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6f300d0750 tx=0x7f6f180091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 msgr2=0x7f6f30142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 0x7f6f30142680 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000e600 tx=0x7f6f2000eac0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 shutdown_connections 2024-09-16T07:36:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f0c073760 0x7f6f0c075c20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f30143100 0x7f6f30157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f300ca400 0x7f6f30142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 --2- 172.21.15.114:0/2960056479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f14004d50 0x7f6f30142680 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 >> 172.21.15.114:0/2960056479 conn(0x7f6f3006ecb0 msgr2=0x7f6f3015a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:15.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 shutdown_connections 2024-09-16T07:36:15.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.328+0000 7f6f35000640 1 -- 172.21.15.114:0/2960056479 wait complete. 2024-09-16T07:36:15.350 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:36:15.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:15.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 -- 172.21.15.114:0/3423116759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540b2590 msgr2=0x7f6b540b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 --2- 172.21.15.114:0/3423116759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540b2590 0x7f6b540b2a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009c80 tx=0x7f6b4c01cd10 comp rx=0 tx=0).stop 2024-09-16T07:36:15.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 -- 172.21.15.114:0/3423116759 shutdown_connections 2024-09-16T07:36:15.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 --2- 172.21.15.114:0/3423116759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540b2590 0x7f6b540b2a00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 --2- 172.21.15.114:0/3423116759 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b540d01b0 0x7f6b540cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 -- 172.21.15.114:0/3423116759 >> 172.21.15.114:0/3423116759 conn(0x7f6b5409aa10 msgr2=0x7f6b5409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:15.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 -- 172.21.15.114:0/3423116759 shutdown_connections 2024-09-16T07:36:15.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.496+0000 7f6b5a000640 1 -- 172.21.15.114:0/3423116759 wait complete. 2024-09-16T07:36:15.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 Processor -- start 2024-09-16T07:36:15.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 -- start start 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b540b2590 0x7f6b5415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540d01b0 0x7f6b5415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b5415f000 0x7f6b5414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54168df0 con 0x7f6b540b2590 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54168c70 con 0x7f6b540d01b0 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b54168f70 con 0x7f6b5415f000 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b540b2590 0x7f6b5415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:15.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b540b2590 0x7f6b5415c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36768/0 (socket says 172.21.15.114:36768) 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 -- 172.21.15.114:0/657507206 learned_addr learned my addr 172.21.15.114:0/657507206 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 -- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b5415f000 msgr2=0x7f6b5414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b53e00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540d01b0 0x7f6b5415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b5415f000 0x7f6b5414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 -- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540d01b0 msgr2=0x7f6b5415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540d01b0 0x7f6b5415d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 -- 172.21.15.114:0/657507206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5415dc30 con 0x7f6b540b2590 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b53e00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540d01b0 0x7f6b5415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:15.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b58c00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b540b2590 0x7f6b5415c7e0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c400 tx=0x7f6b4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:15.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b50c00640 1 -- 172.21.15.114:0/657507206 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48017070 con 0x7f6b540b2590 2024-09-16T07:36:15.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b50c00640 1 -- 172.21.15.114:0/657507206 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b48003600 con 0x7f6b540b2590 2024-09-16T07:36:15.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5414e4d0 con 0x7f6b540b2590 2024-09-16T07:36:15.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b50c00640 1 -- 172.21.15.114:0/657507206 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48003a50 con 0x7f6b540b2590 2024-09-16T07:36:15.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b540c9de0 con 0x7f6b540b2590 2024-09-16T07:36:15.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.500+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b540cefb0 con 0x7f6b540b2590 2024-09-16T07:36:15.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.504+0000 7f6b50c00640 1 -- 172.21.15.114:0/657507206 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f6b4801a070 con 0x7f6b540b2590 2024-09-16T07:36:15.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.504+0000 7f6b50c00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b34073730 0x7f6b34075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.504+0000 7f6b50c00640 1 -- 172.21.15.114:0/657507206 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f6b480944a0 con 0x7f6b540b2590 2024-09-16T07:36:15.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.504+0000 7f6b53e00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b34073730 0x7f6b34075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:15.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.504+0000 7f6b53e00640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b34073730 0x7f6b34075bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6b540b6a20 tx=0x7f6b400091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:15.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.508+0000 7f6b50c00640 1 -- 172.21.15.114:0/657507206 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6b5414e4d0 con 0x7f6b540b2590 2024-09-16T07:36:15.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b54076210 con 0x7f6b540b2590 2024-09-16T07:36:15.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b50c00640 1 -- 172.21.15.114:0/657507206 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5245 (secure 0 0 0) 0x7f6b5415dc30 con 0x7f6b540b2590 2024-09-16T07:36:15.730 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:15.730 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":113,"btime":"2024-09-16T07:36:15:322996+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3808879086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3808879086},{"type":"v1","addr":"172.21.15.149:6801","nonce":3808879086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3577511191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3577511191},{"type":"v1","addr":"172.21.15.149:6835","nonce":3577511191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1372619733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1372619733},{"type":"v1","addr":"172.21.15.114:6835","nonce":1372619733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:11.697492+0000","modified":"2024-09-16T07:36:14.712190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6834/2318653579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2318653579},{"type":"v1","addr":"172.21.15.114:6834","nonce":2318653579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8796,"qdb_cluster":[8796]},"id":12}]} 2024-09-16T07:36:15.731 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 113 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b34073730 msgr2=0x7f6b34075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b34073730 0x7f6b34075bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6b540b6a20 tx=0x7f6b400091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b540b2590 msgr2=0x7f6b5415c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b540b2590 0x7f6b5415c7e0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c400 tx=0x7f6b4800c8c0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 shutdown_connections 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b34073730 0x7f6b34075bf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b5415f000 0x7f6b5414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b540d01b0 0x7f6b5415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 --2- 172.21.15.114:0/657507206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b540b2590 0x7f6b5415c7e0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 >> 172.21.15.114:0/657507206 conn(0x7f6b5409aa10 msgr2=0x7f6b5415e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 shutdown_connections 2024-09-16T07:36:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.712+0000 7f6b5a000640 1 -- 172.21.15.114:0/657507206 wait complete. 2024-09-16T07:36:15.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:15.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 -- 172.21.15.114:0/1155657528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540cebf0 msgr2=0x7f18540cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 --2- 172.21.15.114:0/1155657528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540cebf0 0x7f18540cc8b0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f18540b7e50 tx=0x7f184001c800 comp rx=0 tx=0).stop 2024-09-16T07:36:15.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 -- 172.21.15.114:0/1155657528 shutdown_connections 2024-09-16T07:36:15.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 --2- 172.21.15.114:0/1155657528 >> v2:172.21.15.149:3300/0 conn(0x7f18540b6400 0x7f18540ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 --2- 172.21.15.114:0/1155657528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540cebf0 0x7f18540cc8b0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 -- 172.21.15.114:0/1155657528 >> 172.21.15.114:0/1155657528 conn(0x7f18540d1da0 msgr2=0x7f18540d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:15.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 -- 172.21.15.114:0/1155657528 shutdown_connections 2024-09-16T07:36:15.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 -- 172.21.15.114:0/1155657528 wait complete. 2024-09-16T07:36:15.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 Processor -- start 2024-09-16T07:36:15.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.876+0000 7f185c400640 1 -- start start 2024-09-16T07:36:15.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540b6400 0x7f1854147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18540cebf0 0x7f185415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f185415be80 0x7f18541fbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f18541692b0 con 0x7f18540b6400 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1854169130 con 0x7f185415be80 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1854169430 con 0x7f18540cebf0 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540b6400 0x7f1854147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540b6400 0x7f1854147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36780/0 (socket says 172.21.15.114:36780) 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 -- 172.21.15.114:0/3129905462 learned_addr learned my addr 172.21.15.114:0/3129905462 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185a400640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f185415be80 0x7f18541fbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859000640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18540cebf0 0x7f185415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 -- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18540cebf0 msgr2=0x7f185415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18540cebf0 0x7f185415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 -- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f185415be80 msgr2=0x7f18541fbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f185415be80 0x7f18541fbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 -- 172.21.15.114:0/3129905462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18541484d0 con 0x7f18540b6400 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859000640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18540cebf0 0x7f185415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1859a00640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540b6400 0x7f1854147f40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f184800c400 tx=0x7f184800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1851600640 1 -- 172.21.15.114:0/3129905462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1848017070 con 0x7f18540b6400 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1851600640 1 -- 172.21.15.114:0/3129905462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1848003600 con 0x7f18540b6400 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f1851600640 1 -- 172.21.15.114:0/3129905462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1848003a50 con 0x7f18540b6400 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18541487b0 con 0x7f18540b6400 2024-09-16T07:36:15.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18541fb620 con 0x7f18540b6400 2024-09-16T07:36:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.880+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18540ce4e0 con 0x7f18540b6400 2024-09-16T07:36:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.884+0000 7f1851600640 1 -- 172.21.15.114:0/3129905462 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f184801a070 con 0x7f18540b6400 2024-09-16T07:36:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.884+0000 7f1851600640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1834073730 0x7f1834075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.884+0000 7f1851600640 1 -- 172.21.15.114:0/3129905462 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f1848094300 con 0x7f18540b6400 2024-09-16T07:36:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.884+0000 7f1859000640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1834073730 0x7f1834075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.884+0000 7f1859000640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1834073730 0x7f1834075bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f18400af000 tx=0x7f184001b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:15.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:15.888+0000 7f1851600640 1 -- 172.21.15.114:0/3129905462 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f18540d0350 con 0x7f18540b6400 2024-09-16T07:36:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18540b74e0 con 0x7f18540b6400 2024-09-16T07:36:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f1851600640 1 -- 172.21.15.114:0/3129905462 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16831 (secure 0 0 0) 0x7f184807d1d0 con 0x7f18540b6400 2024-09-16T07:36:16.054 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:16.055 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":152,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:13.303232+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:09.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:10.653300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1834073730 msgr2=0x7f1834075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1834073730 0x7f1834075bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f18400af000 tx=0x7f184001b040 comp rx=0 tx=0).stop 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540b6400 msgr2=0x7f1854147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540b6400 0x7f1854147f40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f184800c400 tx=0x7f184800c8c0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 shutdown_connections 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f185415be80 0x7f18541fbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1834073730 0x7f1834075bf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f18540cebf0 0x7f185415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 --2- 172.21.15.114:0/3129905462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18540b6400 0x7f1854147f40 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 >> 172.21.15.114:0/3129905462 conn(0x7f18540d1da0 msgr2=0x7f185415a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:16.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 shutdown_connections 2024-09-16T07:36:16.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.056+0000 7f185c400640 1 -- 172.21.15.114:0/3129905462 wait complete. 2024-09-16T07:36:16.077 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:36:16.078 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:36:16.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 -- 172.21.15.114:0/765740152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f671415bfa0 msgr2=0x7f67140cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 --2- 172.21.15.114:0/765740152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f671415bfa0 0x7f67140cd000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6704009840 tx=0x7f670401f010 comp rx=0 tx=0).stop 2024-09-16T07:36:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 -- 172.21.15.114:0/765740152 shutdown_connections 2024-09-16T07:36:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 --2- 172.21.15.114:0/765740152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f671415bfa0 0x7f67140cd000 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 --2- 172.21.15.114:0/765740152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f671415c3e0 0x7f671415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 -- 172.21.15.114:0/765740152 >> 172.21.15.114:0/765740152 conn(0x7f67140b18f0 msgr2=0x7f67140b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 -- 172.21.15.114:0/765740152 shutdown_connections 2024-09-16T07:36:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 -- 172.21.15.114:0/765740152 wait complete. 2024-09-16T07:36:16.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 Processor -- start 2024-09-16T07:36:16.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.220+0000 7f671c800640 1 -- start start 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67140cd540 0x7f67141f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f671415bfa0 0x7f67140aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f671415c3e0 0x7f671415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67141601a0 con 0x7f671415c3e0 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6714160020 con 0x7f67140cd540 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6714160320 con 0x7f671415bfa0 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f671415c3e0 0x7f671415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f671415c3e0 0x7f671415d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36796/0 (socket says 172.21.15.114:36796) 2024-09-16T07:36:16.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 -- 172.21.15.114:0/3251351226 learned_addr learned my addr 172.21.15.114:0/3251351226 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f6719400640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f671415bfa0 0x7f67140aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f6719e00640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67140cd540 0x7f67141f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 -- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f671415bfa0 msgr2=0x7f67140aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f671415bfa0 0x7f67140aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 -- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67140cd540 msgr2=0x7f67141f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67140cd540 0x7f67141f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 -- 172.21.15.114:0/3251351226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671415ed10 con 0x7f671415c3e0 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f6719400640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f671415bfa0 0x7f67140aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f6719e00640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67140cd540 0x7f67141f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671a800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f671415c3e0 0x7f671415d420 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f671000cbc0 tx=0x7f671000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f670e000640 1 -- 172.21.15.114:0/3251351226 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710016020 con 0x7f671415c3e0 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f670e000640 1 -- 172.21.15.114:0/3251351226 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f671000ab40 con 0x7f671415c3e0 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f670e000640 1 -- 172.21.15.114:0/3251351226 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671000ce40 con 0x7f671415c3e0 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67140af140 con 0x7f671415c3e0 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f671415df50 con 0x7f671415c3e0 2024-09-16T07:36:16.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.224+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67140cbf00 con 0x7f671415c3e0 2024-09-16T07:36:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.228+0000 7f670e000640 1 -- 172.21.15.114:0/3251351226 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f6710019020 con 0x7f671415c3e0 2024-09-16T07:36:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.228+0000 7f670e000640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f66f8073730 0x7f66f8075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.228+0000 7f670e000640 1 -- 172.21.15.114:0/3251351226 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f6710092610 con 0x7f671415c3e0 2024-09-16T07:36:16.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.228+0000 7f6719e00640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f66f8073730 0x7f66f8075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.228+0000 7f6719e00640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f66f8073730 0x7f66f8075bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6708009ac0 tx=0x7f67080091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.232+0000 7f670e000640 1 -- 172.21.15.114:0/3251351226 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6710020030 con 0x7f671415c3e0 2024-09-16T07:36:16.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.396+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67140ccfb0 con 0x7f66f8073730 2024-09-16T07:36:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.400+0000 7f670e000640 1 -- 172.21.15.114:0/3251351226 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7f67140ccfb0 con 0x7f66f8073730 2024-09-16T07:36:16.404 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:36:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f66f8073730 msgr2=0x7f66f8075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f66f8073730 0x7f66f8075bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6708009ac0 tx=0x7f67080091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f671415c3e0 msgr2=0x7f671415d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f671415c3e0 0x7f671415d420 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f671000cbc0 tx=0x7f671000cbf0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 shutdown_connections 2024-09-16T07:36:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f671415c3e0 0x7f671415d420 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f66f8073730 0x7f66f8075bf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f671415bfa0 0x7f67140aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 --2- 172.21.15.114:0/3251351226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f67140cd540 0x7f67141f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 >> 172.21.15.114:0/3251351226 conn(0x7f67140b18f0 msgr2=0x7f67140b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 shutdown_connections 2024-09-16T07:36:16.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.404+0000 7f671c800640 1 -- 172.21.15.114:0/3251351226 wait complete. 2024-09-16T07:36:16.424 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-16T07:36:14.418816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265580,"kb_used_data":16040,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709140,"statfs":{"total":773094113280,"available":772822159360,"internally_reserved":0,"allocated":16424960,"data_stored":7852820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.137056"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.390002+0000","last_change":"2024-09-16T07:36:12.328109+0000","last_active":"2024-09-16T07:36:13.390002+0000","last_peered":"2024-09-16T07:36:13.390002+0000","last_clean":"2024-09-16T07:36:13.390002+0000","last_became_active":"2024-09-16T07:36:12.327830+0000","last_became_peered":"2024-09-16T07:36:12.327830+0000","last_unstale":"2024-09-16T07:36:13.390002+0000","last_undegraded":"2024-09-16T07:36:13.390002+0000","last_fullsized":"2024-09-16T07:36:13.390002+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:34.796877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312228+0000","last_change":"2024-09-16T07:36:12.319186+0000","last_active":"2024-09-16T07:36:13.312228+0000","last_peered":"2024-09-16T07:36:13.312228+0000","last_clean":"2024-09-16T07:36:13.312228+0000","last_became_active":"2024-09-16T07:36:12.318873+0000","last_became_peered":"2024-09-16T07:36:12.318873+0000","last_unstale":"2024-09-16T07:36:13.312228+0000","last_undegraded":"2024-09-16T07:36:13.312228+0000","last_fullsized":"2024-09-16T07:36:13.312228+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.066065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.396010+0000","last_change":"2024-09-16T07:36:12.317351+0000","last_active":"2024-09-16T07:36:13.396010+0000","last_peered":"2024-09-16T07:36:13.396010+0000","last_clean":"2024-09-16T07:36:13.396010+0000","last_became_active":"2024-09-16T07:36:12.317055+0000","last_became_peered":"2024-09-16T07:36:12.317055+0000","last_unstale":"2024-09-16T07:36:13.396010+0000","last_undegraded":"2024-09-16T07:36:13.396010+0000","last_fullsized":"2024-09-16T07:36:13.396010+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:47.057700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312511+0000","last_change":"2024-09-16T07:36:12.305713+0000","last_active":"2024-09-16T07:36:13.312511+0000","last_peered":"2024-09-16T07:36:13.312511+0000","last_clean":"2024-09-16T07:36:13.312511+0000","last_became_active":"2024-09-16T07:36:12.305386+0000","last_became_peered":"2024-09-16T07:36:12.305386+0000","last_unstale":"2024-09-16T07:36:13.312511+0000","last_undegraded":"2024-09-16T07:36:13.312511+0000","last_fullsized":"2024-09-16T07:36:13.312511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:51.030840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393874+0000","last_change":"2024-09-16T07:36:12.313093+0000","last_active":"2024-09-16T07:36:13.393874+0000","last_peered":"2024-09-16T07:36:13.393874+0000","last_clean":"2024-09-16T07:36:13.393874+0000","last_became_active":"2024-09-16T07:36:12.312805+0000","last_became_peered":"2024-09-16T07:36:12.312805+0000","last_unstale":"2024-09-16T07:36:13.393874+0000","last_undegraded":"2024-09-16T07:36:13.393874+0000","last_fullsized":"2024-09-16T07:36:13.393874+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:32:53.436393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394990+0000","last_change":"2024-09-16T07:36:12.312603+0000","last_active":"2024-09-16T07:36:13.394990+0000","last_peered":"2024-09-16T07:36:13.394990+0000","last_clean":"2024-09-16T07:36:13.394990+0000","last_became_active":"2024-09-16T07:36:12.312308+0000","last_became_peered":"2024-09-16T07:36:12.312308+0000","last_unstale":"2024-09-16T07:36:13.394990+0000","last_undegraded":"2024-09-16T07:36:13.394990+0000","last_fullsized":"2024-09-16T07:36:13.394990+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:21:01.497390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313252+0000","last_change":"2024-09-16T07:36:12.325555+0000","last_active":"2024-09-16T07:36:13.313252+0000","last_peered":"2024-09-16T07:36:13.313252+0000","last_clean":"2024-09-16T07:36:13.313252+0000","last_became_active":"2024-09-16T07:36:12.325258+0000","last_became_peered":"2024-09-16T07:36:12.325258+0000","last_unstale":"2024-09-16T07:36:13.313252+0000","last_undegraded":"2024-09-16T07:36:13.313252+0000","last_fullsized":"2024-09-16T07:36:13.313252+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:39.701702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392952+0000","last_change":"2024-09-16T07:36:12.322547+0000","last_active":"2024-09-16T07:36:13.392952+0000","last_peered":"2024-09-16T07:36:13.392952+0000","last_clean":"2024-09-16T07:36:13.392952+0000","last_became_active":"2024-09-16T07:36:12.322298+0000","last_became_peered":"2024-09-16T07:36:12.322298+0000","last_unstale":"2024-09-16T07:36:13.392952+0000","last_undegraded":"2024-09-16T07:36:13.392952+0000","last_fullsized":"2024-09-16T07:36:13.392952+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:59.244859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314677+0000","last_change":"2024-09-16T07:36:12.299874+0000","last_active":"2024-09-16T07:36:13.314677+0000","last_peered":"2024-09-16T07:36:13.314677+0000","last_clean":"2024-09-16T07:36:13.314677+0000","last_became_active":"2024-09-16T07:36:12.299600+0000","last_became_peered":"2024-09-16T07:36:12.299600+0000","last_unstale":"2024-09-16T07:36:13.314677+0000","last_undegraded":"2024-09-16T07:36:13.314677+0000","last_fullsized":"2024-09-16T07:36:13.314677+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:41.075874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394384+0000","last_change":"2024-09-16T07:36:12.329374+0000","last_active":"2024-09-16T07:36:13.394384+0000","last_peered":"2024-09-16T07:36:13.394384+0000","last_clean":"2024-09-16T07:36:13.394384+0000","last_became_active":"2024-09-16T07:36:12.328840+0000","last_became_peered":"2024-09-16T07:36:12.328840+0000","last_unstale":"2024-09-16T07:36:13.394384+0000","last_undegraded":"2024-09-16T07:36:13.394384+0000","last_fullsized":"2024-09-16T07:36:13.394384+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:52.299540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313264+0000","last_change":"2024-09-16T07:36:12.309938+0000","last_active":"2024-09-16T07:36:13.313264+0000","last_peered":"2024-09-16T07:36:13.313264+0000","last_clean":"2024-09-16T07:36:13.313264+0000","last_became_active":"2024-09-16T07:36:12.309670+0000","last_became_peered":"2024-09-16T07:36:12.309670+0000","last_unstale":"2024-09-16T07:36:13.313264+0000","last_undegraded":"2024-09-16T07:36:13.313264+0000","last_fullsized":"2024-09-16T07:36:13.313264+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.420129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312128+0000","last_change":"2024-09-16T07:36:12.313986+0000","last_active":"2024-09-16T07:36:13.312128+0000","last_peered":"2024-09-16T07:36:13.312128+0000","last_clean":"2024-09-16T07:36:13.312128+0000","last_became_active":"2024-09-16T07:36:12.313699+0000","last_became_peered":"2024-09-16T07:36:12.313699+0000","last_unstale":"2024-09-16T07:36:13.312128+0000","last_undegraded":"2024-09-16T07:36:13.312128+0000","last_fullsized":"2024-09-16T07:36:13.312128+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:38.301657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311862+0000","last_change":"2024-09-16T07:36:12.300894+0000","last_active":"2024-09-16T07:36:13.311862+0000","last_peered":"2024-09-16T07:36:13.311862+0000","last_clean":"2024-09-16T07:36:13.311862+0000","last_became_active":"2024-09-16T07:36:12.300568+0000","last_became_peered":"2024-09-16T07:36:12.300568+0000","last_unstale":"2024-09-16T07:36:13.311862+0000","last_undegraded":"2024-09-16T07:36:13.311862+0000","last_fullsized":"2024-09-16T07:36:13.311862+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:22:40.583178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314045+0000","last_change":"2024-09-16T07:36:12.324091+0000","last_active":"2024-09-16T07:36:13.314045+0000","last_peered":"2024-09-16T07:36:13.314045+0000","last_clean":"2024-09-16T07:36:13.314045+0000","last_became_active":"2024-09-16T07:36:12.323746+0000","last_became_peered":"2024-09-16T07:36:12.323746+0000","last_unstale":"2024-09-16T07:36:13.314045+0000","last_undegraded":"2024-09-16T07:36:13.314045+0000","last_fullsized":"2024-09-16T07:36:13.314045+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:10.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311844+0000","last_change":"2024-09-16T07:36:12.319472+0000","last_active":"2024-09-16T07:36:13.311844+0000","last_peered":"2024-09-16T07:36:13.311844+0000","last_clean":"2024-09-16T07:36:13.311844+0000","last_became_active":"2024-09-16T07:36:12.319211+0000","last_became_peered":"2024-09-16T07:36:12.319211+0000","last_unstale":"2024-09-16T07:36:13.311844+0000","last_undegraded":"2024-09-16T07:36:13.311844+0000","last_fullsized":"2024-09-16T07:36:13.311844+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:26:31.716299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393642+0000","last_change":"2024-09-16T07:36:12.317932+0000","last_active":"2024-09-16T07:36:13.393642+0000","last_peered":"2024-09-16T07:36:13.393642+0000","last_clean":"2024-09-16T07:36:13.393642+0000","last_became_active":"2024-09-16T07:36:12.316885+0000","last_became_peered":"2024-09-16T07:36:12.316885+0000","last_unstale":"2024-09-16T07:36:13.393642+0000","last_undegraded":"2024-09-16T07:36:13.393642+0000","last_fullsized":"2024-09-16T07:36:13.393642+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:26.864444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394292+0000","last_change":"2024-09-16T07:36:12.314067+0000","last_active":"2024-09-16T07:36:13.394292+0000","last_peered":"2024-09-16T07:36:13.394292+0000","last_clean":"2024-09-16T07:36:13.394292+0000","last_became_active":"2024-09-16T07:36:12.313827+0000","last_became_peered":"2024-09-16T07:36:12.313827+0000","last_unstale":"2024-09-16T07:36:13.394292+0000","last_undegraded":"2024-09-16T07:36:13.394292+0000","last_fullsized":"2024-09-16T07:36:13.394292+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:46:19.997667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389914+0000","last_change":"2024-09-16T07:36:12.316842+0000","last_active":"2024-09-16T07:36:13.389914+0000","last_peered":"2024-09-16T07:36:13.389914+0000","last_clean":"2024-09-16T07:36:13.389914+0000","last_became_active":"2024-09-16T07:36:12.315565+0000","last_became_peered":"2024-09-16T07:36:12.315565+0000","last_unstale":"2024-09-16T07:36:13.389914+0000","last_undegraded":"2024-09-16T07:36:13.389914+0000","last_fullsized":"2024-09-16T07:36:13.389914+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:53:15.064155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393276+0000","last_change":"2024-09-16T07:36:12.320387+0000","last_active":"2024-09-16T07:36:13.393276+0000","last_peered":"2024-09-16T07:36:13.393276+0000","last_clean":"2024-09-16T07:36:13.393276+0000","last_became_active":"2024-09-16T07:36:12.320077+0000","last_became_peered":"2024-09-16T07:36:12.320077+0000","last_unstale":"2024-09-16T07:36:13.393276+0000","last_undegraded":"2024-09-16T07:36:13.393276+0000","last_fullsized":"2024-09-16T07:36:13.393276+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:05:58.783212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393509+0000","last_change":"2024-09-16T07:36:12.311734+0000","last_active":"2024-09-16T07:36:13.393509+0000","last_peered":"2024-09-16T07:36:13.393509+0000","last_clean":"2024-09-16T07:36:13.393509+0000","last_became_active":"2024-09-16T07:36:12.310769+0000","last_became_peered":"2024-09-16T07:36:12.310769+0000","last_unstale":"2024-09-16T07:36:13.393509+0000","last_undegraded":"2024-09-16T07:36:13.393509+0000","last_fullsized":"2024-09-16T07:36:13.393509+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:24.349966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394055+0000","last_change":"2024-09-16T07:36:12.312899+0000","last_active":"2024-09-16T07:36:13.394055+0000","last_peered":"2024-09-16T07:36:13.394055+0000","last_clean":"2024-09-16T07:36:13.394055+0000","last_became_active":"2024-09-16T07:36:12.310450+0000","last_became_peered":"2024-09-16T07:36:12.310450+0000","last_unstale":"2024-09-16T07:36:13.394055+0000","last_undegraded":"2024-09-16T07:36:13.394055+0000","last_fullsized":"2024-09-16T07:36:13.394055+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:07.866178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393552+0000","last_change":"2024-09-16T07:36:12.328840+0000","last_active":"2024-09-16T07:36:13.393552+0000","last_peered":"2024-09-16T07:36:13.393552+0000","last_clean":"2024-09-16T07:36:13.393552+0000","last_became_active":"2024-09-16T07:36:12.328528+0000","last_became_peered":"2024-09-16T07:36:12.328528+0000","last_unstale":"2024-09-16T07:36:13.393552+0000","last_undegraded":"2024-09-16T07:36:13.393552+0000","last_fullsized":"2024-09-16T07:36:13.393552+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:16.496589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395048+0000","last_change":"2024-09-16T07:36:12.328022+0000","last_active":"2024-09-16T07:36:13.395048+0000","last_peered":"2024-09-16T07:36:13.395048+0000","last_clean":"2024-09-16T07:36:13.395048+0000","last_became_active":"2024-09-16T07:36:12.327703+0000","last_became_peered":"2024-09-16T07:36:12.327703+0000","last_unstale":"2024-09-16T07:36:13.395048+0000","last_undegraded":"2024-09-16T07:36:13.395048+0000","last_fullsized":"2024-09-16T07:36:13.395048+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:38.301657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393850+0000","last_change":"2024-09-16T07:36:12.317386+0000","last_active":"2024-09-16T07:36:13.393850+0000","last_peered":"2024-09-16T07:36:13.393850+0000","last_clean":"2024-09-16T07:36:13.393850+0000","last_became_active":"2024-09-16T07:36:12.316394+0000","last_became_peered":"2024-09-16T07:36:12.316394+0000","last_unstale":"2024-09-16T07:36:13.393850+0000","last_undegraded":"2024-09-16T07:36:13.393850+0000","last_fullsized":"2024-09-16T07:36:13.393850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:46.610138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312594+0000","last_change":"2024-09-16T07:36:12.326177+0000","last_active":"2024-09-16T07:36:13.312594+0000","last_peered":"2024-09-16T07:36:13.312594+0000","last_clean":"2024-09-16T07:36:13.312594+0000","last_became_active":"2024-09-16T07:36:12.325820+0000","last_became_peered":"2024-09-16T07:36:12.325820+0000","last_unstale":"2024-09-16T07:36:13.312594+0000","last_undegraded":"2024-09-16T07:36:13.312594+0000","last_fullsized":"2024-09-16T07:36:13.312594+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.420129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313582+0000","last_change":"2024-09-16T07:36:12.330291+0000","last_active":"2024-09-16T07:36:13.313582+0000","last_peered":"2024-09-16T07:36:13.313582+0000","last_clean":"2024-09-16T07:36:13.313582+0000","last_became_active":"2024-09-16T07:36:12.329993+0000","last_became_peered":"2024-09-16T07:36:12.329993+0000","last_unstale":"2024-09-16T07:36:13.313582+0000","last_undegraded":"2024-09-16T07:36:13.313582+0000","last_fullsized":"2024-09-16T07:36:13.313582+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:30:59.086139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.396017+0000","last_change":"2024-09-16T07:36:12.313256+0000","last_active":"2024-09-16T07:36:13.396017+0000","last_peered":"2024-09-16T07:36:13.396017+0000","last_clean":"2024-09-16T07:36:13.396017+0000","last_became_active":"2024-09-16T07:36:12.312956+0000","last_became_peered":"2024-09-16T07:36:12.312956+0000","last_unstale":"2024-09-16T07:36:13.396017+0000","last_undegraded":"2024-09-16T07:36:13.396017+0000","last_fullsized":"2024-09-16T07:36:13.396017+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.420129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393699+0000","last_change":"2024-09-16T07:36:12.329657+0000","last_active":"2024-09-16T07:36:13.393699+0000","last_peered":"2024-09-16T07:36:13.393699+0000","last_clean":"2024-09-16T07:36:13.393699+0000","last_became_active":"2024-09-16T07:36:12.329386+0000","last_became_peered":"2024-09-16T07:36:12.329386+0000","last_unstale":"2024-09-16T07:36:13.393699+0000","last_undegraded":"2024-09-16T07:36:13.393699+0000","last_fullsized":"2024-09-16T07:36:13.393699+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:55.031350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312111+0000","last_change":"2024-09-16T07:36:12.317909+0000","last_active":"2024-09-16T07:36:13.312111+0000","last_peered":"2024-09-16T07:36:13.312111+0000","last_clean":"2024-09-16T07:36:13.312111+0000","last_became_active":"2024-09-16T07:36:12.317589+0000","last_became_peered":"2024-09-16T07:36:12.317589+0000","last_unstale":"2024-09-16T07:36:13.312111+0000","last_undegraded":"2024-09-16T07:36:13.312111+0000","last_fullsized":"2024-09-16T07:36:13.312111+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:21:01.497390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314126+0000","last_change":"2024-09-16T07:36:12.309955+0000","last_active":"2024-09-16T07:36:13.314126+0000","last_peered":"2024-09-16T07:36:13.314126+0000","last_clean":"2024-09-16T07:36:13.314126+0000","last_became_active":"2024-09-16T07:36:12.308897+0000","last_became_peered":"2024-09-16T07:36:12.308897+0000","last_unstale":"2024-09-16T07:36:13.314126+0000","last_undegraded":"2024-09-16T07:36:13.314126+0000","last_fullsized":"2024-09-16T07:36:13.314126+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:43.988737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395231+0000","last_change":"2024-09-16T07:36:12.310933+0000","last_active":"2024-09-16T07:36:13.395231+0000","last_peered":"2024-09-16T07:36:13.395231+0000","last_clean":"2024-09-16T07:36:13.395231+0000","last_became_active":"2024-09-16T07:36:12.308546+0000","last_became_peered":"2024-09-16T07:36:12.308546+0000","last_unstale":"2024-09-16T07:36:13.395231+0000","last_undegraded":"2024-09-16T07:36:13.395231+0000","last_fullsized":"2024-09-16T07:36:13.395231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:37.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392686+0000","last_change":"2024-09-16T07:36:12.313024+0000","last_active":"2024-09-16T07:36:13.392686+0000","last_peered":"2024-09-16T07:36:13.392686+0000","last_clean":"2024-09-16T07:36:13.392686+0000","last_became_active":"2024-09-16T07:36:12.311790+0000","last_became_peered":"2024-09-16T07:36:12.311790+0000","last_unstale":"2024-09-16T07:36:13.392686+0000","last_undegraded":"2024-09-16T07:36:13.392686+0000","last_fullsized":"2024-09-16T07:36:13.392686+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:11:51.421307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394813+0000","last_change":"2024-09-16T07:36:12.316450+0000","last_active":"2024-09-16T07:36:13.394813+0000","last_peered":"2024-09-16T07:36:13.394813+0000","last_clean":"2024-09-16T07:36:13.394813+0000","last_became_active":"2024-09-16T07:36:12.315752+0000","last_became_peered":"2024-09-16T07:36:12.315752+0000","last_unstale":"2024-09-16T07:36:13.394813+0000","last_undegraded":"2024-09-16T07:36:13.394813+0000","last_fullsized":"2024-09-16T07:36:13.394813+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:58:55.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"151'4","reported_seq":19,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394336+0000","last_change":"2024-09-16T07:36:11.310676+0000","last_active":"2024-09-16T07:36:13.394336+0000","last_peered":"2024-09-16T07:36:13.394336+0000","last_clean":"2024-09-16T07:36:13.394336+0000","last_became_active":"2024-09-16T07:36:11.310216+0000","last_became_peered":"2024-09-16T07:36:11.310216+0000","last_unstale":"2024-09-16T07:36:13.394336+0000","last_undegraded":"2024-09-16T07:36:13.394336+0000","last_fullsized":"2024-09-16T07:36:13.394336+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:45.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393961+0000","last_change":"2024-09-16T07:36:12.330938+0000","last_active":"2024-09-16T07:36:13.393961+0000","last_peered":"2024-09-16T07:36:13.393961+0000","last_clean":"2024-09-16T07:36:13.393961+0000","last_became_active":"2024-09-16T07:36:12.330428+0000","last_became_peered":"2024-09-16T07:36:12.330428+0000","last_unstale":"2024-09-16T07:36:13.393961+0000","last_undegraded":"2024-09-16T07:36:13.393961+0000","last_fullsized":"2024-09-16T07:36:13.393961+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:57:56.432675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314560+0000","last_change":"2024-09-16T07:36:11.304391+0000","last_active":"2024-09-16T07:36:13.314560+0000","last_peered":"2024-09-16T07:36:13.314560+0000","last_clean":"2024-09-16T07:36:13.314560+0000","last_became_active":"2024-09-16T07:36:11.304073+0000","last_became_peered":"2024-09-16T07:36:11.304073+0000","last_unstale":"2024-09-16T07:36:13.314560+0000","last_undegraded":"2024-09-16T07:36:13.314560+0000","last_fullsized":"2024-09-16T07:36:13.314560+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:21.218229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313204+0000","last_change":"2024-09-16T07:36:12.314748+0000","last_active":"2024-09-16T07:36:13.313204+0000","last_peered":"2024-09-16T07:36:13.313204+0000","last_clean":"2024-09-16T07:36:13.313204+0000","last_became_active":"2024-09-16T07:36:12.312870+0000","last_became_peered":"2024-09-16T07:36:12.312870+0000","last_unstale":"2024-09-16T07:36:13.313204+0000","last_undegraded":"2024-09-16T07:36:13.313204+0000","last_fullsized":"2024-09-16T07:36:13.313204+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:10.542247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.396128+0000","last_change":"2024-09-16T07:36:11.311008+0000","last_active":"2024-09-16T07:36:13.396128+0000","last_peered":"2024-09-16T07:36:13.396128+0000","last_clean":"2024-09-16T07:36:13.396128+0000","last_became_active":"2024-09-16T07:36:11.309377+0000","last_became_peered":"2024-09-16T07:36:11.309377+0000","last_unstale":"2024-09-16T07:36:13.396128+0000","last_undegraded":"2024-09-16T07:36:13.396128+0000","last_fullsized":"2024-09-16T07:36:13.396128+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:39.434629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314728+0000","last_change":"2024-09-16T07:36:12.302320+0000","last_active":"2024-09-16T07:36:13.314728+0000","last_peered":"2024-09-16T07:36:13.314728+0000","last_clean":"2024-09-16T07:36:13.314728+0000","last_became_active":"2024-09-16T07:36:12.302004+0000","last_became_peered":"2024-09-16T07:36:12.302004+0000","last_unstale":"2024-09-16T07:36:13.314728+0000","last_undegraded":"2024-09-16T07:36:13.314728+0000","last_fullsized":"2024-09-16T07:36:13.314728+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:45:44.454187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312249+0000","last_change":"2024-09-16T07:36:11.301088+0000","last_active":"2024-09-16T07:36:13.312249+0000","last_peered":"2024-09-16T07:36:13.312249+0000","last_clean":"2024-09-16T07:36:13.312249+0000","last_became_active":"2024-09-16T07:36:11.300843+0000","last_became_peered":"2024-09-16T07:36:11.300843+0000","last_unstale":"2024-09-16T07:36:13.312249+0000","last_undegraded":"2024-09-16T07:36:13.312249+0000","last_fullsized":"2024-09-16T07:36:13.312249+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:33.414475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393353+0000","last_change":"2024-09-16T07:36:12.333104+0000","last_active":"2024-09-16T07:36:13.393353+0000","last_peered":"2024-09-16T07:36:13.393353+0000","last_clean":"2024-09-16T07:36:13.393353+0000","last_became_active":"2024-09-16T07:36:12.331819+0000","last_became_peered":"2024-09-16T07:36:12.331819+0000","last_unstale":"2024-09-16T07:36:13.393353+0000","last_undegraded":"2024-09-16T07:36:13.393353+0000","last_fullsized":"2024-09-16T07:36:13.393353+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:14.086368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394225+0000","last_change":"2024-09-16T07:36:11.315362+0000","last_active":"2024-09-16T07:36:13.394225+0000","last_peered":"2024-09-16T07:36:13.394225+0000","last_clean":"2024-09-16T07:36:13.394225+0000","last_became_active":"2024-09-16T07:36:11.315141+0000","last_became_peered":"2024-09-16T07:36:11.315141+0000","last_unstale":"2024-09-16T07:36:13.394225+0000","last_undegraded":"2024-09-16T07:36:13.394225+0000","last_fullsized":"2024-09-16T07:36:13.394225+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:56.047993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394113+0000","last_change":"2024-09-16T07:36:12.321219+0000","last_active":"2024-09-16T07:36:13.394113+0000","last_peered":"2024-09-16T07:36:13.394113+0000","last_clean":"2024-09-16T07:36:13.394113+0000","last_became_active":"2024-09-16T07:36:12.320896+0000","last_became_peered":"2024-09-16T07:36:12.320896+0000","last_unstale":"2024-09-16T07:36:13.394113+0000","last_undegraded":"2024-09-16T07:36:13.394113+0000","last_fullsized":"2024-09-16T07:36:13.394113+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:08.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393867+0000","last_change":"2024-09-16T07:36:11.304767+0000","last_active":"2024-09-16T07:36:13.393867+0000","last_peered":"2024-09-16T07:36:13.393867+0000","last_clean":"2024-09-16T07:36:13.393867+0000","last_became_active":"2024-09-16T07:36:11.303691+0000","last_became_peered":"2024-09-16T07:36:11.303691+0000","last_unstale":"2024-09-16T07:36:13.393867+0000","last_undegraded":"2024-09-16T07:36:13.393867+0000","last_fullsized":"2024-09-16T07:36:13.393867+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:00.584364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313014+0000","last_change":"2024-09-16T07:36:12.316036+0000","last_active":"2024-09-16T07:36:13.313014+0000","last_peered":"2024-09-16T07:36:13.313014+0000","last_clean":"2024-09-16T07:36:13.313014+0000","last_became_active":"2024-09-16T07:36:12.315539+0000","last_became_peered":"2024-09-16T07:36:12.315539+0000","last_unstale":"2024-09-16T07:36:13.313014+0000","last_undegraded":"2024-09-16T07:36:13.313014+0000","last_fullsized":"2024-09-16T07:36:13.313014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:39.951732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389317+0000","last_change":"2024-09-16T07:36:11.307190+0000","last_active":"2024-09-16T07:36:13.389317+0000","last_peered":"2024-09-16T07:36:13.389317+0000","last_clean":"2024-09-16T07:36:13.389317+0000","last_became_active":"2024-09-16T07:36:11.306853+0000","last_became_peered":"2024-09-16T07:36:11.306853+0000","last_unstale":"2024-09-16T07:36:13.389317+0000","last_undegraded":"2024-09-16T07:36:13.389317+0000","last_fullsized":"2024-09-16T07:36:13.389317+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:07:35.042057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395752+0000","last_change":"2024-09-16T07:36:12.322440+0000","last_active":"2024-09-16T07:36:13.395752+0000","last_peered":"2024-09-16T07:36:13.395752+0000","last_clean":"2024-09-16T07:36:13.395752+0000","last_became_active":"2024-09-16T07:36:12.322028+0000","last_became_peered":"2024-09-16T07:36:12.322028+0000","last_unstale":"2024-09-16T07:36:13.395752+0000","last_undegraded":"2024-09-16T07:36:13.395752+0000","last_fullsized":"2024-09-16T07:36:13.395752+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:10.542247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313543+0000","last_change":"2024-09-16T07:36:11.295924+0000","last_active":"2024-09-16T07:36:13.313543+0000","last_peered":"2024-09-16T07:36:13.313543+0000","last_clean":"2024-09-16T07:36:13.313543+0000","last_became_active":"2024-09-16T07:36:11.295660+0000","last_became_peered":"2024-09-16T07:36:11.295660+0000","last_unstale":"2024-09-16T07:36:13.313543+0000","last_undegraded":"2024-09-16T07:36:13.313543+0000","last_fullsized":"2024-09-16T07:36:13.313543+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:07.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394881+0000","last_change":"2024-09-16T07:36:12.332720+0000","last_active":"2024-09-16T07:36:13.394881+0000","last_peered":"2024-09-16T07:36:13.394881+0000","last_clean":"2024-09-16T07:36:13.394881+0000","last_became_active":"2024-09-16T07:36:12.332312+0000","last_became_peered":"2024-09-16T07:36:12.332312+0000","last_unstale":"2024-09-16T07:36:13.394881+0000","last_undegraded":"2024-09-16T07:36:13.394881+0000","last_fullsized":"2024-09-16T07:36:13.394881+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:17.764358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394006+0000","last_change":"2024-09-16T07:36:11.311727+0000","last_active":"2024-09-16T07:36:13.394006+0000","last_peered":"2024-09-16T07:36:13.394006+0000","last_clean":"2024-09-16T07:36:13.394006+0000","last_became_active":"2024-09-16T07:36:11.311406+0000","last_became_peered":"2024-09-16T07:36:11.311406+0000","last_unstale":"2024-09-16T07:36:13.394006+0000","last_undegraded":"2024-09-16T07:36:13.394006+0000","last_fullsized":"2024-09-16T07:36:13.394006+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:06.578292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313338+0000","last_change":"2024-09-16T07:36:12.304880+0000","last_active":"2024-09-16T07:36:13.313338+0000","last_peered":"2024-09-16T07:36:13.313338+0000","last_clean":"2024-09-16T07:36:13.313338+0000","last_became_active":"2024-09-16T07:36:12.304298+0000","last_became_peered":"2024-09-16T07:36:12.304298+0000","last_unstale":"2024-09-16T07:36:13.313338+0000","last_undegraded":"2024-09-16T07:36:13.313338+0000","last_fullsized":"2024-09-16T07:36:13.313338+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:46.039127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"151'3","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394501+0000","last_change":"2024-09-16T07:36:11.314196+0000","last_active":"2024-09-16T07:36:13.394501+0000","last_peered":"2024-09-16T07:36:13.394501+0000","last_clean":"2024-09-16T07:36:13.394501+0000","last_became_active":"2024-09-16T07:36:11.313790+0000","last_became_peered":"2024-09-16T07:36:11.313790+0000","last_unstale":"2024-09-16T07:36:13.394501+0000","last_undegraded":"2024-09-16T07:36:13.394501+0000","last_fullsized":"2024-09-16T07:36:13.394501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:10.678432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393501+0000","last_change":"2024-09-16T07:36:12.324901+0000","last_active":"2024-09-16T07:36:13.393501+0000","last_peered":"2024-09-16T07:36:13.393501+0000","last_clean":"2024-09-16T07:36:13.393501+0000","last_became_active":"2024-09-16T07:36:12.324655+0000","last_became_peered":"2024-09-16T07:36:12.324655+0000","last_unstale":"2024-09-16T07:36:13.393501+0000","last_undegraded":"2024-09-16T07:36:13.393501+0000","last_fullsized":"2024-09-16T07:36:13.393501+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:52.824899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"151'6","reported_seq":21,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395487+0000","last_change":"2024-09-16T07:36:11.302633+0000","last_active":"2024-09-16T07:36:13.395487+0000","last_peered":"2024-09-16T07:36:13.395487+0000","last_clean":"2024-09-16T07:36:13.395487+0000","last_became_active":"2024-09-16T07:36:11.299983+0000","last_became_peered":"2024-09-16T07:36:11.299983+0000","last_unstale":"2024-09-16T07:36:13.395487+0000","last_undegraded":"2024-09-16T07:36:13.395487+0000","last_fullsized":"2024-09-16T07:36:13.395487+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:00.697346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395238+0000","last_change":"2024-09-16T07:36:12.327696+0000","last_active":"2024-09-16T07:36:13.395238+0000","last_peered":"2024-09-16T07:36:13.395238+0000","last_clean":"2024-09-16T07:36:13.395238+0000","last_became_active":"2024-09-16T07:36:12.327273+0000","last_became_peered":"2024-09-16T07:36:12.327273+0000","last_unstale":"2024-09-16T07:36:13.395238+0000","last_undegraded":"2024-09-16T07:36:13.395238+0000","last_fullsized":"2024-09-16T07:36:13.395238+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:51.030840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389823+0000","last_change":"2024-09-16T07:36:11.307269+0000","last_active":"2024-09-16T07:36:13.389823+0000","last_peered":"2024-09-16T07:36:13.389823+0000","last_clean":"2024-09-16T07:36:13.389823+0000","last_became_active":"2024-09-16T07:36:11.306929+0000","last_became_peered":"2024-09-16T07:36:11.306929+0000","last_unstale":"2024-09-16T07:36:13.389823+0000","last_undegraded":"2024-09-16T07:36:13.389823+0000","last_fullsized":"2024-09-16T07:36:13.389823+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:19.412802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313179+0000","last_change":"2024-09-16T07:36:12.328409+0000","last_active":"2024-09-16T07:36:13.313179+0000","last_peered":"2024-09-16T07:36:13.313179+0000","last_clean":"2024-09-16T07:36:13.313179+0000","last_became_active":"2024-09-16T07:36:12.328045+0000","last_became_peered":"2024-09-16T07:36:12.328045+0000","last_unstale":"2024-09-16T07:36:13.313179+0000","last_undegraded":"2024-09-16T07:36:13.313179+0000","last_fullsized":"2024-09-16T07:36:13.313179+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:56:58.848112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393657+0000","last_change":"2024-09-16T07:36:11.313552+0000","last_active":"2024-09-16T07:36:13.393657+0000","last_peered":"2024-09-16T07:36:13.393657+0000","last_clean":"2024-09-16T07:36:13.393657+0000","last_became_active":"2024-09-16T07:36:11.313314+0000","last_became_peered":"2024-09-16T07:36:11.313314+0000","last_unstale":"2024-09-16T07:36:13.393657+0000","last_undegraded":"2024-09-16T07:36:13.393657+0000","last_fullsized":"2024-09-16T07:36:13.393657+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:20.887909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313972+0000","last_change":"2024-09-16T07:36:12.310555+0000","last_active":"2024-09-16T07:36:13.313972+0000","last_peered":"2024-09-16T07:36:13.313972+0000","last_clean":"2024-09-16T07:36:13.313972+0000","last_became_active":"2024-09-16T07:36:12.310305+0000","last_became_peered":"2024-09-16T07:36:12.310305+0000","last_unstale":"2024-09-16T07:36:13.313972+0000","last_undegraded":"2024-09-16T07:36:13.313972+0000","last_fullsized":"2024-09-16T07:36:13.313972+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:30.271371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393119+0000","last_change":"2024-09-16T07:36:11.302856+0000","last_active":"2024-09-16T07:36:13.393119+0000","last_peered":"2024-09-16T07:36:13.393119+0000","last_clean":"2024-09-16T07:36:13.393119+0000","last_became_active":"2024-09-16T07:36:11.302576+0000","last_became_peered":"2024-09-16T07:36:11.302576+0000","last_unstale":"2024-09-16T07:36:13.393119+0000","last_undegraded":"2024-09-16T07:36:13.393119+0000","last_fullsized":"2024-09-16T07:36:13.393119+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:48.596900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394522+0000","last_change":"2024-09-16T07:36:12.326765+0000","last_active":"2024-09-16T07:36:13.394522+0000","last_peered":"2024-09-16T07:36:13.394522+0000","last_clean":"2024-09-16T07:36:13.394522+0000","last_became_active":"2024-09-16T07:36:12.326494+0000","last_became_peered":"2024-09-16T07:36:12.326494+0000","last_unstale":"2024-09-16T07:36:13.394522+0000","last_undegraded":"2024-09-16T07:36:13.394522+0000","last_fullsized":"2024-09-16T07:36:13.394522+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.002328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"151'8","reported_seq":23,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389430+0000","last_change":"2024-09-16T07:36:11.307325+0000","last_active":"2024-09-16T07:36:13.389430+0000","last_peered":"2024-09-16T07:36:13.389430+0000","last_clean":"2024-09-16T07:36:13.389430+0000","last_became_active":"2024-09-16T07:36:11.306839+0000","last_became_peered":"2024-09-16T07:36:11.306839+0000","last_unstale":"2024-09-16T07:36:13.389430+0000","last_undegraded":"2024-09-16T07:36:13.389430+0000","last_fullsized":"2024-09-16T07:36:13.389430+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:48.372016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394580+0000","last_change":"2024-09-16T07:36:12.329689+0000","last_active":"2024-09-16T07:36:13.394580+0000","last_peered":"2024-09-16T07:36:13.394580+0000","last_clean":"2024-09-16T07:36:13.394580+0000","last_became_active":"2024-09-16T07:36:12.329133+0000","last_became_peered":"2024-09-16T07:36:12.329133+0000","last_unstale":"2024-09-16T07:36:13.394580+0000","last_undegraded":"2024-09-16T07:36:13.394580+0000","last_fullsized":"2024-09-16T07:36:13.394580+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:13.568064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394366+0000","last_change":"2024-09-16T07:36:11.316741+0000","last_active":"2024-09-16T07:36:13.394366+0000","last_peered":"2024-09-16T07:36:13.394366+0000","last_clean":"2024-09-16T07:36:13.394366+0000","last_became_active":"2024-09-16T07:36:11.316066+0000","last_became_peered":"2024-09-16T07:36:11.316066+0000","last_unstale":"2024-09-16T07:36:13.394366+0000","last_undegraded":"2024-09-16T07:36:13.394366+0000","last_fullsized":"2024-09-16T07:36:13.394366+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:23.097199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314729+0000","last_change":"2024-09-16T07:36:12.327139+0000","last_active":"2024-09-16T07:36:13.314729+0000","last_peered":"2024-09-16T07:36:13.314729+0000","last_clean":"2024-09-16T07:36:13.314729+0000","last_became_active":"2024-09-16T07:36:12.326874+0000","last_became_peered":"2024-09-16T07:36:12.326874+0000","last_unstale":"2024-09-16T07:36:13.314729+0000","last_undegraded":"2024-09-16T07:36:13.314729+0000","last_fullsized":"2024-09-16T07:36:13.314729+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:31.491129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394917+0000","last_change":"2024-09-16T07:36:11.301183+0000","last_active":"2024-09-16T07:36:13.394917+0000","last_peered":"2024-09-16T07:36:13.394917+0000","last_clean":"2024-09-16T07:36:13.394917+0000","last_became_active":"2024-09-16T07:36:11.299410+0000","last_became_peered":"2024-09-16T07:36:11.299410+0000","last_unstale":"2024-09-16T07:36:13.394917+0000","last_undegraded":"2024-09-16T07:36:13.394917+0000","last_fullsized":"2024-09-16T07:36:13.394917+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:07.403781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314414+0000","last_change":"2024-09-16T07:36:12.313761+0000","last_active":"2024-09-16T07:36:13.314414+0000","last_peered":"2024-09-16T07:36:13.314414+0000","last_clean":"2024-09-16T07:36:13.314414+0000","last_became_active":"2024-09-16T07:36:12.313502+0000","last_became_peered":"2024-09-16T07:36:12.313502+0000","last_unstale":"2024-09-16T07:36:13.314414+0000","last_undegraded":"2024-09-16T07:36:13.314414+0000","last_fullsized":"2024-09-16T07:36:13.314414+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:38.384613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389855+0000","last_change":"2024-09-16T07:36:11.309775+0000","last_active":"2024-09-16T07:36:13.389855+0000","last_peered":"2024-09-16T07:36:13.389855+0000","last_clean":"2024-09-16T07:36:13.389855+0000","last_became_active":"2024-09-16T07:36:11.309530+0000","last_became_peered":"2024-09-16T07:36:11.309530+0000","last_unstale":"2024-09-16T07:36:13.389855+0000","last_undegraded":"2024-09-16T07:36:13.389855+0000","last_fullsized":"2024-09-16T07:36:13.389855+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:50:38.430242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312155+0000","last_change":"2024-09-16T07:36:12.315380+0000","last_active":"2024-09-16T07:36:13.312155+0000","last_peered":"2024-09-16T07:36:13.312155+0000","last_clean":"2024-09-16T07:36:13.312155+0000","last_became_active":"2024-09-16T07:36:12.314465+0000","last_became_peered":"2024-09-16T07:36:12.314465+0000","last_unstale":"2024-09-16T07:36:13.312155+0000","last_undegraded":"2024-09-16T07:36:13.312155+0000","last_fullsized":"2024-09-16T07:36:13.312155+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:37.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313317+0000","last_change":"2024-09-16T07:36:11.309068+0000","last_active":"2024-09-16T07:36:13.313317+0000","last_peered":"2024-09-16T07:36:13.313317+0000","last_clean":"2024-09-16T07:36:13.313317+0000","last_became_active":"2024-09-16T07:36:11.308724+0000","last_became_peered":"2024-09-16T07:36:11.308724+0000","last_unstale":"2024-09-16T07:36:13.313317+0000","last_undegraded":"2024-09-16T07:36:13.313317+0000","last_fullsized":"2024-09-16T07:36:13.313317+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:12.894192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393562+0000","last_change":"2024-09-16T07:36:12.323904+0000","last_active":"2024-09-16T07:36:13.393562+0000","last_peered":"2024-09-16T07:36:13.393562+0000","last_clean":"2024-09-16T07:36:13.393562+0000","last_became_active":"2024-09-16T07:36:12.323556+0000","last_became_peered":"2024-09-16T07:36:12.323556+0000","last_unstale":"2024-09-16T07:36:13.393562+0000","last_undegraded":"2024-09-16T07:36:13.393562+0000","last_fullsized":"2024-09-16T07:36:13.393562+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:34.574308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395716+0000","last_change":"2024-09-16T07:36:11.314157+0000","last_active":"2024-09-16T07:36:13.395716+0000","last_peered":"2024-09-16T07:36:13.395716+0000","last_clean":"2024-09-16T07:36:13.395716+0000","last_became_active":"2024-09-16T07:36:11.313910+0000","last_became_peered":"2024-09-16T07:36:11.313910+0000","last_unstale":"2024-09-16T07:36:13.395716+0000","last_undegraded":"2024-09-16T07:36:13.395716+0000","last_fullsized":"2024-09-16T07:36:13.395716+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:07.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313253+0000","last_change":"2024-09-16T07:36:12.319256+0000","last_active":"2024-09-16T07:36:13.313253+0000","last_peered":"2024-09-16T07:36:13.313253+0000","last_clean":"2024-09-16T07:36:13.313253+0000","last_became_active":"2024-09-16T07:36:12.318982+0000","last_became_peered":"2024-09-16T07:36:12.318982+0000","last_unstale":"2024-09-16T07:36:13.313253+0000","last_undegraded":"2024-09-16T07:36:13.313253+0000","last_fullsized":"2024-09-16T07:36:13.313253+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.066065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394636+0000","last_change":"2024-09-16T07:36:11.308534+0000","last_active":"2024-09-16T07:36:13.394636+0000","last_peered":"2024-09-16T07:36:13.394636+0000","last_clean":"2024-09-16T07:36:13.394636+0000","last_became_active":"2024-09-16T07:36:11.308226+0000","last_became_peered":"2024-09-16T07:36:11.308226+0000","last_unstale":"2024-09-16T07:36:13.394636+0000","last_undegraded":"2024-09-16T07:36:13.394636+0000","last_fullsized":"2024-09-16T07:36:13.394636+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:40.344903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312243+0000","last_change":"2024-09-16T07:36:12.315451+0000","last_active":"2024-09-16T07:36:13.312243+0000","last_peered":"2024-09-16T07:36:13.312243+0000","last_clean":"2024-09-16T07:36:13.312243+0000","last_became_active":"2024-09-16T07:36:12.313739+0000","last_became_peered":"2024-09-16T07:36:12.313739+0000","last_unstale":"2024-09-16T07:36:13.312243+0000","last_undegraded":"2024-09-16T07:36:13.312243+0000","last_fullsized":"2024-09-16T07:36:13.312243+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:10.542247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395148+0000","last_change":"2024-09-16T07:36:11.311647+0000","last_active":"2024-09-16T07:36:13.395148+0000","last_peered":"2024-09-16T07:36:13.395148+0000","last_clean":"2024-09-16T07:36:13.395148+0000","last_became_active":"2024-09-16T07:36:11.311355+0000","last_became_peered":"2024-09-16T07:36:11.311355+0000","last_unstale":"2024-09-16T07:36:13.395148+0000","last_undegraded":"2024-09-16T07:36:13.395148+0000","last_fullsized":"2024-09-16T07:36:13.395148+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:03.435904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392775+0000","last_change":"2024-09-16T07:36:12.313527+0000","last_active":"2024-09-16T07:36:13.392775+0000","last_peered":"2024-09-16T07:36:13.392775+0000","last_clean":"2024-09-16T07:36:13.392775+0000","last_became_active":"2024-09-16T07:36:12.313371+0000","last_became_peered":"2024-09-16T07:36:12.313371+0000","last_unstale":"2024-09-16T07:36:13.392775+0000","last_undegraded":"2024-09-16T07:36:13.392775+0000","last_fullsized":"2024-09-16T07:36:13.392775+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:53.423757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313953+0000","last_change":"2024-09-16T07:36:11.298699+0000","last_active":"2024-09-16T07:36:13.313953+0000","last_peered":"2024-09-16T07:36:13.313953+0000","last_clean":"2024-09-16T07:36:13.313953+0000","last_became_active":"2024-09-16T07:36:11.298420+0000","last_became_peered":"2024-09-16T07:36:11.298420+0000","last_unstale":"2024-09-16T07:36:13.313953+0000","last_undegraded":"2024-09-16T07:36:13.313953+0000","last_fullsized":"2024-09-16T07:36:13.313953+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:53:00.690449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393908+0000","last_change":"2024-09-16T07:36:12.311385+0000","last_active":"2024-09-16T07:36:13.393908+0000","last_peered":"2024-09-16T07:36:13.393908+0000","last_clean":"2024-09-16T07:36:13.393908+0000","last_became_active":"2024-09-16T07:36:12.311165+0000","last_became_peered":"2024-09-16T07:36:12.311165+0000","last_unstale":"2024-09-16T07:36:13.393908+0000","last_undegraded":"2024-09-16T07:36:13.393908+0000","last_fullsized":"2024-09-16T07:36:13.393908+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:11:21.569710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389912+0000","last_change":"2024-09-16T07:36:11.308652+0000","last_active":"2024-09-16T07:36:13.389912+0000","last_peered":"2024-09-16T07:36:13.389912+0000","last_clean":"2024-09-16T07:36:13.389912+0000","last_became_active":"2024-09-16T07:36:11.308389+0000","last_became_peered":"2024-09-16T07:36:11.308389+0000","last_unstale":"2024-09-16T07:36:13.389912+0000","last_undegraded":"2024-09-16T07:36:13.389912+0000","last_fullsized":"2024-09-16T07:36:13.389912+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:48.596900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393964+0000","last_change":"2024-09-16T07:36:12.329630+0000","last_active":"2024-09-16T07:36:13.393964+0000","last_peered":"2024-09-16T07:36:13.393964+0000","last_clean":"2024-09-16T07:36:13.393964+0000","last_became_active":"2024-09-16T07:36:12.329298+0000","last_became_peered":"2024-09-16T07:36:12.329298+0000","last_unstale":"2024-09-16T07:36:13.393964+0000","last_undegraded":"2024-09-16T07:36:13.393964+0000","last_fullsized":"2024-09-16T07:36:13.393964+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:12.871460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394677+0000","last_change":"2024-09-16T07:36:11.312942+0000","last_active":"2024-09-16T07:36:13.394677+0000","last_peered":"2024-09-16T07:36:13.394677+0000","last_clean":"2024-09-16T07:36:13.394677+0000","last_became_active":"2024-09-16T07:36:11.312038+0000","last_became_peered":"2024-09-16T07:36:11.312038+0000","last_unstale":"2024-09-16T07:36:13.394677+0000","last_undegraded":"2024-09-16T07:36:13.394677+0000","last_fullsized":"2024-09-16T07:36:13.394677+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:20:33.327726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395506+0000","last_change":"2024-09-16T07:36:12.321457+0000","last_active":"2024-09-16T07:36:13.395506+0000","last_peered":"2024-09-16T07:36:13.395506+0000","last_clean":"2024-09-16T07:36:13.395506+0000","last_became_active":"2024-09-16T07:36:12.321126+0000","last_became_peered":"2024-09-16T07:36:12.321126+0000","last_unstale":"2024-09-16T07:36:13.395506+0000","last_undegraded":"2024-09-16T07:36:13.395506+0000","last_fullsized":"2024-09-16T07:36:13.395506+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:24.699102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393532+0000","last_change":"2024-09-16T07:36:11.312644+0000","last_active":"2024-09-16T07:36:13.393532+0000","last_peered":"2024-09-16T07:36:13.393532+0000","last_clean":"2024-09-16T07:36:13.393532+0000","last_became_active":"2024-09-16T07:36:11.312374+0000","last_became_peered":"2024-09-16T07:36:11.312374+0000","last_unstale":"2024-09-16T07:36:13.393532+0000","last_undegraded":"2024-09-16T07:36:13.393532+0000","last_fullsized":"2024-09-16T07:36:13.393532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:41.039603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394417+0000","last_change":"2024-09-16T07:36:12.314632+0000","last_active":"2024-09-16T07:36:13.394417+0000","last_peered":"2024-09-16T07:36:13.394417+0000","last_clean":"2024-09-16T07:36:13.394417+0000","last_became_active":"2024-09-16T07:36:12.314374+0000","last_became_peered":"2024-09-16T07:36:12.314374+0000","last_unstale":"2024-09-16T07:36:13.394417+0000","last_undegraded":"2024-09-16T07:36:13.394417+0000","last_fullsized":"2024-09-16T07:36:13.394417+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:51.041989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395598+0000","last_change":"2024-09-16T07:36:11.299963+0000","last_active":"2024-09-16T07:36:13.395598+0000","last_peered":"2024-09-16T07:36:13.395598+0000","last_clean":"2024-09-16T07:36:13.395598+0000","last_became_active":"2024-09-16T07:36:11.299667+0000","last_became_peered":"2024-09-16T07:36:11.299667+0000","last_unstale":"2024-09-16T07:36:13.395598+0000","last_undegraded":"2024-09-16T07:36:13.395598+0000","last_fullsized":"2024-09-16T07:36:13.395598+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:33.319553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389758+0000","last_change":"2024-09-16T07:36:12.322219+0000","last_active":"2024-09-16T07:36:13.389758+0000","last_peered":"2024-09-16T07:36:13.389758+0000","last_clean":"2024-09-16T07:36:13.389758+0000","last_became_active":"2024-09-16T07:36:12.321879+0000","last_became_peered":"2024-09-16T07:36:12.321879+0000","last_unstale":"2024-09-16T07:36:13.389758+0000","last_undegraded":"2024-09-16T07:36:13.389758+0000","last_fullsized":"2024-09-16T07:36:13.389758+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:00.972615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314241+0000","last_change":"2024-09-16T07:36:11.307756+0000","last_active":"2024-09-16T07:36:13.314241+0000","last_peered":"2024-09-16T07:36:13.314241+0000","last_clean":"2024-09-16T07:36:13.314241+0000","last_became_active":"2024-09-16T07:36:11.307289+0000","last_became_peered":"2024-09-16T07:36:11.307289+0000","last_unstale":"2024-09-16T07:36:13.314241+0000","last_undegraded":"2024-09-16T07:36:13.314241+0000","last_fullsized":"2024-09-16T07:36:13.314241+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:39.606244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389921+0000","last_change":"2024-09-16T07:36:12.318163+0000","last_active":"2024-09-16T07:36:13.389921+0000","last_peered":"2024-09-16T07:36:13.389921+0000","last_clean":"2024-09-16T07:36:13.389921+0000","last_became_active":"2024-09-16T07:36:12.317806+0000","last_became_peered":"2024-09-16T07:36:12.317806+0000","last_unstale":"2024-09-16T07:36:13.389921+0000","last_undegraded":"2024-09-16T07:36:13.389921+0000","last_fullsized":"2024-09-16T07:36:13.389921+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:20:34.332307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314166+0000","last_change":"2024-09-16T07:36:11.295882+0000","last_active":"2024-09-16T07:36:13.314166+0000","last_peered":"2024-09-16T07:36:13.314166+0000","last_clean":"2024-09-16T07:36:13.314166+0000","last_became_active":"2024-09-16T07:36:11.294790+0000","last_became_peered":"2024-09-16T07:36:11.294790+0000","last_unstale":"2024-09-16T07:36:13.314166+0000","last_undegraded":"2024-09-16T07:36:13.314166+0000","last_fullsized":"2024-09-16T07:36:13.314166+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:12:54.216810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311778+0000","last_change":"2024-09-16T07:36:12.314019+0000","last_active":"2024-09-16T07:36:13.311778+0000","last_peered":"2024-09-16T07:36:13.311778+0000","last_clean":"2024-09-16T07:36:13.311778+0000","last_became_active":"2024-09-16T07:36:12.313367+0000","last_became_peered":"2024-09-16T07:36:12.313367+0000","last_unstale":"2024-09-16T07:36:13.311778+0000","last_undegraded":"2024-09-16T07:36:13.311778+0000","last_fullsized":"2024-09-16T07:36:13.311778+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:52.869858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311974+0000","last_change":"2024-09-16T07:36:11.300375+0000","last_active":"2024-09-16T07:36:13.311974+0000","last_peered":"2024-09-16T07:36:13.311974+0000","last_clean":"2024-09-16T07:36:13.311974+0000","last_became_active":"2024-09-16T07:36:11.300105+0000","last_became_peered":"2024-09-16T07:36:11.300105+0000","last_unstale":"2024-09-16T07:36:13.311974+0000","last_undegraded":"2024-09-16T07:36:13.311974+0000","last_fullsized":"2024-09-16T07:36:13.311974+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:26:48.729516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392971+0000","last_change":"2024-09-16T07:36:12.313633+0000","last_active":"2024-09-16T07:36:13.392971+0000","last_peered":"2024-09-16T07:36:13.392971+0000","last_clean":"2024-09-16T07:36:13.392971+0000","last_became_active":"2024-09-16T07:36:12.313370+0000","last_became_peered":"2024-09-16T07:36:12.313370+0000","last_unstale":"2024-09-16T07:36:13.392971+0000","last_undegraded":"2024-09-16T07:36:13.392971+0000","last_fullsized":"2024-09-16T07:36:13.392971+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:29.141436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394960+0000","last_change":"2024-09-16T07:36:11.307570+0000","last_active":"2024-09-16T07:36:13.394960+0000","last_peered":"2024-09-16T07:36:13.394960+0000","last_clean":"2024-09-16T07:36:13.394960+0000","last_became_active":"2024-09-16T07:36:11.307177+0000","last_became_peered":"2024-09-16T07:36:11.307177+0000","last_unstale":"2024-09-16T07:36:13.394960+0000","last_undegraded":"2024-09-16T07:36:13.394960+0000","last_fullsized":"2024-09-16T07:36:13.394960+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:12.894192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393196+0000","last_change":"2024-09-16T07:36:12.318551+0000","last_active":"2024-09-16T07:36:13.393196+0000","last_peered":"2024-09-16T07:36:13.393196+0000","last_clean":"2024-09-16T07:36:13.393196+0000","last_became_active":"2024-09-16T07:36:12.317685+0000","last_became_peered":"2024-09-16T07:36:12.317685+0000","last_unstale":"2024-09-16T07:36:13.393196+0000","last_undegraded":"2024-09-16T07:36:13.393196+0000","last_fullsized":"2024-09-16T07:36:13.393196+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:22:24.931864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389483+0000","last_change":"2024-09-16T07:36:11.298358+0000","last_active":"2024-09-16T07:36:13.389483+0000","last_peered":"2024-09-16T07:36:13.389483+0000","last_clean":"2024-09-16T07:36:13.389483+0000","last_became_active":"2024-09-16T07:36:11.297995+0000","last_became_peered":"2024-09-16T07:36:11.297995+0000","last_unstale":"2024-09-16T07:36:13.389483+0000","last_undegraded":"2024-09-16T07:36:13.389483+0000","last_fullsized":"2024-09-16T07:36:13.389483+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:00.584364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":378,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389383+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:36:13.389383+0000","last_peered":"2024-09-16T07:36:13.389383+0000","last_clean":"2024-09-16T07:36:13.389383+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:36:13.389383+0000","last_undegraded":"2024-09-16T07:36:13.389383+0000","last_fullsized":"2024-09-16T07:36:13.389383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33632,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338208,"statfs":{"total":96636764160,"available":96602324992,"internally_reserved":0,"allocated":2498560,"data_stored":1423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1896448,"data_stored":833408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33048,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1896448,"data_stored":833408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33064,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338776,"statfs":{"total":96636764160,"available":96602906624,"internally_reserved":0,"allocated":1912832,"data_stored":835602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":833602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542244,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":834102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1908736,"data_stored":835020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33632,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338208,"statfs":{"total":96636764160,"available":96602324992,"internally_reserved":0,"allocated":2494464,"data_stored":1423798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:36:16.429 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:36:16.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 -- 172.21.15.114:0/2448120822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a280d28e0 msgr2=0x7f5a280cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/2448120822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a280d28e0 0x7f5a280cc9d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5a28074010 tx=0x7f5a2001cd80 comp rx=0 tx=0).stop 2024-09-16T07:36:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 -- 172.21.15.114:0/2448120822 shutdown_connections 2024-09-16T07:36:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/2448120822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a280d28e0 0x7f5a280cc9d0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/2448120822 >> v2:172.21.15.149:3300/0 conn(0x7f5a280cdb30 0x7f5a280cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/2448120822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a2815bea0 0x7f5a280ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 -- 172.21.15.114:0/2448120822 >> 172.21.15.114:0/2448120822 conn(0x7f5a280d1dc0 msgr2=0x7f5a280d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 -- 172.21.15.114:0/2448120822 shutdown_connections 2024-09-16T07:36:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 -- 172.21.15.114:0/2448120822 wait complete. 2024-09-16T07:36:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 Processor -- start 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.612+0000 7f5a2ec00640 1 -- start start 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a280cdb30 0x7f5a280ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a280d28e0 0x7f5a28152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a2815bea0 0x7f5a28152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5a280af1b0 con 0x7f5a2815bea0 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a280af030 con 0x7f5a280cdb30 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5a280af330 con 0x7f5a280d28e0 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a2815bea0 0x7f5a28152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a27400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a280d28e0 0x7f5a28152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a2815bea0 0x7f5a28152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36814/0 (socket says 172.21.15.114:36814) 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 -- 172.21.15.114:0/4082806822 learned_addr learned my addr 172.21.15.114:0/4082806822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a27e00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a280cdb30 0x7f5a280ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 -- 172.21.15.114:0/4082806822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a280d28e0 msgr2=0x7f5a28152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a280d28e0 0x7f5a28152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 -- 172.21.15.114:0/4082806822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a280cdb30 msgr2=0x7f5a280ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a280cdb30 0x7f5a280ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 -- 172.21.15.114:0/4082806822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a281571d0 con 0x7f5a2815bea0 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2cc00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a2815bea0 0x7f5a28152b10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f5a2001b430 tx=0x7f5a20003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a1fe00640 1 -- 172.21.15.114:0/4082806822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a200bb070 con 0x7f5a2815bea0 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a1fe00640 1 -- 172.21.15.114:0/4082806822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a20004e00 con 0x7f5a2815bea0 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a1fe00640 1 -- 172.21.15.114:0/4082806822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a200b2040 con 0x7f5a2815bea0 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a281574b0 con 0x7f5a2815bea0 2024-09-16T07:36:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a28157a70 con 0x7f5a2815bea0 2024-09-16T07:36:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.616+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a280af8c0 con 0x7f5a2815bea0 2024-09-16T07:36:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.620+0000 7f5a1fe00640 1 -- 172.21.15.114:0/4082806822 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f5a200a5ca0 con 0x7f5a2815bea0 2024-09-16T07:36:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.620+0000 7f5a1fe00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a08073760 0x7f5a08075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.620+0000 7f5a1fe00640 1 -- 172.21.15.114:0/4082806822 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f5a2012ea10 con 0x7f5a2815bea0 2024-09-16T07:36:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.620+0000 7f5a27e00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a08073760 0x7f5a08075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.620+0000 7f5a27e00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a08073760 0x7f5a08075c20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a18004630 tx=0x7f5a1800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:16.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.624+0000 7f5a1fe00640 1 -- 172.21.15.114:0/4082806822 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5a20016970 con 0x7f5a2815bea0 2024-09-16T07:36:16.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.788+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a2815a0e0 con 0x7f5a08073760 2024-09-16T07:36:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.792+0000 7f5a1fe00640 1 -- 172.21.15.114:0/4082806822 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7f5a2815a0e0 con 0x7f5a08073760 2024-09-16T07:36:16.797 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:36:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a08073760 msgr2=0x7f5a08075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a08073760 0x7f5a08075c20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5a18004630 tx=0x7f5a1800b2e0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a2815bea0 msgr2=0x7f5a28152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:16.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a2815bea0 0x7f5a28152b10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f5a2001b430 tx=0x7f5a20003f60 comp rx=0 tx=0).stop 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 shutdown_connections 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a2815bea0 0x7f5a28152b10 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a08073760 0x7f5a08075c20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5a280d28e0 0x7f5a28152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 --2- 172.21.15.114:0/4082806822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a280cdb30 0x7f5a280ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 >> 172.21.15.114:0/4082806822 conn(0x7f5a280d1dc0 msgr2=0x7f5a280c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 shutdown_connections 2024-09-16T07:36:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:16.796+0000 7f5a2ec00640 1 -- 172.21.15.114:0/4082806822 wait complete. 2024-09-16T07:36:16.816 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-16T07:36:16.419274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265580,"kb_used_data":16040,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709140,"statfs":{"total":773094113280,"available":772822159360,"internally_reserved":0,"allocated":16424960,"data_stored":7852820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001129"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.390002+0000","last_change":"2024-09-16T07:36:12.328109+0000","last_active":"2024-09-16T07:36:13.390002+0000","last_peered":"2024-09-16T07:36:13.390002+0000","last_clean":"2024-09-16T07:36:13.390002+0000","last_became_active":"2024-09-16T07:36:12.327830+0000","last_became_peered":"2024-09-16T07:36:12.327830+0000","last_unstale":"2024-09-16T07:36:13.390002+0000","last_undegraded":"2024-09-16T07:36:13.390002+0000","last_fullsized":"2024-09-16T07:36:13.390002+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:34.796877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312228+0000","last_change":"2024-09-16T07:36:12.319186+0000","last_active":"2024-09-16T07:36:13.312228+0000","last_peered":"2024-09-16T07:36:13.312228+0000","last_clean":"2024-09-16T07:36:13.312228+0000","last_became_active":"2024-09-16T07:36:12.318873+0000","last_became_peered":"2024-09-16T07:36:12.318873+0000","last_unstale":"2024-09-16T07:36:13.312228+0000","last_undegraded":"2024-09-16T07:36:13.312228+0000","last_fullsized":"2024-09-16T07:36:13.312228+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.066065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.396010+0000","last_change":"2024-09-16T07:36:12.317351+0000","last_active":"2024-09-16T07:36:13.396010+0000","last_peered":"2024-09-16T07:36:13.396010+0000","last_clean":"2024-09-16T07:36:13.396010+0000","last_became_active":"2024-09-16T07:36:12.317055+0000","last_became_peered":"2024-09-16T07:36:12.317055+0000","last_unstale":"2024-09-16T07:36:13.396010+0000","last_undegraded":"2024-09-16T07:36:13.396010+0000","last_fullsized":"2024-09-16T07:36:13.396010+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:47.057700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312511+0000","last_change":"2024-09-16T07:36:12.305713+0000","last_active":"2024-09-16T07:36:13.312511+0000","last_peered":"2024-09-16T07:36:13.312511+0000","last_clean":"2024-09-16T07:36:13.312511+0000","last_became_active":"2024-09-16T07:36:12.305386+0000","last_became_peered":"2024-09-16T07:36:12.305386+0000","last_unstale":"2024-09-16T07:36:13.312511+0000","last_undegraded":"2024-09-16T07:36:13.312511+0000","last_fullsized":"2024-09-16T07:36:13.312511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:51.030840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393874+0000","last_change":"2024-09-16T07:36:12.313093+0000","last_active":"2024-09-16T07:36:13.393874+0000","last_peered":"2024-09-16T07:36:13.393874+0000","last_clean":"2024-09-16T07:36:13.393874+0000","last_became_active":"2024-09-16T07:36:12.312805+0000","last_became_peered":"2024-09-16T07:36:12.312805+0000","last_unstale":"2024-09-16T07:36:13.393874+0000","last_undegraded":"2024-09-16T07:36:13.393874+0000","last_fullsized":"2024-09-16T07:36:13.393874+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:32:53.436393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394990+0000","last_change":"2024-09-16T07:36:12.312603+0000","last_active":"2024-09-16T07:36:13.394990+0000","last_peered":"2024-09-16T07:36:13.394990+0000","last_clean":"2024-09-16T07:36:13.394990+0000","last_became_active":"2024-09-16T07:36:12.312308+0000","last_became_peered":"2024-09-16T07:36:12.312308+0000","last_unstale":"2024-09-16T07:36:13.394990+0000","last_undegraded":"2024-09-16T07:36:13.394990+0000","last_fullsized":"2024-09-16T07:36:13.394990+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:21:01.497390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313252+0000","last_change":"2024-09-16T07:36:12.325555+0000","last_active":"2024-09-16T07:36:13.313252+0000","last_peered":"2024-09-16T07:36:13.313252+0000","last_clean":"2024-09-16T07:36:13.313252+0000","last_became_active":"2024-09-16T07:36:12.325258+0000","last_became_peered":"2024-09-16T07:36:12.325258+0000","last_unstale":"2024-09-16T07:36:13.313252+0000","last_undegraded":"2024-09-16T07:36:13.313252+0000","last_fullsized":"2024-09-16T07:36:13.313252+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:39.701702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392952+0000","last_change":"2024-09-16T07:36:12.322547+0000","last_active":"2024-09-16T07:36:13.392952+0000","last_peered":"2024-09-16T07:36:13.392952+0000","last_clean":"2024-09-16T07:36:13.392952+0000","last_became_active":"2024-09-16T07:36:12.322298+0000","last_became_peered":"2024-09-16T07:36:12.322298+0000","last_unstale":"2024-09-16T07:36:13.392952+0000","last_undegraded":"2024-09-16T07:36:13.392952+0000","last_fullsized":"2024-09-16T07:36:13.392952+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:59.244859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314677+0000","last_change":"2024-09-16T07:36:12.299874+0000","last_active":"2024-09-16T07:36:13.314677+0000","last_peered":"2024-09-16T07:36:13.314677+0000","last_clean":"2024-09-16T07:36:13.314677+0000","last_became_active":"2024-09-16T07:36:12.299600+0000","last_became_peered":"2024-09-16T07:36:12.299600+0000","last_unstale":"2024-09-16T07:36:13.314677+0000","last_undegraded":"2024-09-16T07:36:13.314677+0000","last_fullsized":"2024-09-16T07:36:13.314677+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:41.075874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394384+0000","last_change":"2024-09-16T07:36:12.329374+0000","last_active":"2024-09-16T07:36:13.394384+0000","last_peered":"2024-09-16T07:36:13.394384+0000","last_clean":"2024-09-16T07:36:13.394384+0000","last_became_active":"2024-09-16T07:36:12.328840+0000","last_became_peered":"2024-09-16T07:36:12.328840+0000","last_unstale":"2024-09-16T07:36:13.394384+0000","last_undegraded":"2024-09-16T07:36:13.394384+0000","last_fullsized":"2024-09-16T07:36:13.394384+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:52.299540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313264+0000","last_change":"2024-09-16T07:36:12.309938+0000","last_active":"2024-09-16T07:36:13.313264+0000","last_peered":"2024-09-16T07:36:13.313264+0000","last_clean":"2024-09-16T07:36:13.313264+0000","last_became_active":"2024-09-16T07:36:12.309670+0000","last_became_peered":"2024-09-16T07:36:12.309670+0000","last_unstale":"2024-09-16T07:36:13.313264+0000","last_undegraded":"2024-09-16T07:36:13.313264+0000","last_fullsized":"2024-09-16T07:36:13.313264+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.420129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312128+0000","last_change":"2024-09-16T07:36:12.313986+0000","last_active":"2024-09-16T07:36:13.312128+0000","last_peered":"2024-09-16T07:36:13.312128+0000","last_clean":"2024-09-16T07:36:13.312128+0000","last_became_active":"2024-09-16T07:36:12.313699+0000","last_became_peered":"2024-09-16T07:36:12.313699+0000","last_unstale":"2024-09-16T07:36:13.312128+0000","last_undegraded":"2024-09-16T07:36:13.312128+0000","last_fullsized":"2024-09-16T07:36:13.312128+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:38.301657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311862+0000","last_change":"2024-09-16T07:36:12.300894+0000","last_active":"2024-09-16T07:36:13.311862+0000","last_peered":"2024-09-16T07:36:13.311862+0000","last_clean":"2024-09-16T07:36:13.311862+0000","last_became_active":"2024-09-16T07:36:12.300568+0000","last_became_peered":"2024-09-16T07:36:12.300568+0000","last_unstale":"2024-09-16T07:36:13.311862+0000","last_undegraded":"2024-09-16T07:36:13.311862+0000","last_fullsized":"2024-09-16T07:36:13.311862+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:22:40.583178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314045+0000","last_change":"2024-09-16T07:36:12.324091+0000","last_active":"2024-09-16T07:36:13.314045+0000","last_peered":"2024-09-16T07:36:13.314045+0000","last_clean":"2024-09-16T07:36:13.314045+0000","last_became_active":"2024-09-16T07:36:12.323746+0000","last_became_peered":"2024-09-16T07:36:12.323746+0000","last_unstale":"2024-09-16T07:36:13.314045+0000","last_undegraded":"2024-09-16T07:36:13.314045+0000","last_fullsized":"2024-09-16T07:36:13.314045+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:24:10.508314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311844+0000","last_change":"2024-09-16T07:36:12.319472+0000","last_active":"2024-09-16T07:36:13.311844+0000","last_peered":"2024-09-16T07:36:13.311844+0000","last_clean":"2024-09-16T07:36:13.311844+0000","last_became_active":"2024-09-16T07:36:12.319211+0000","last_became_peered":"2024-09-16T07:36:12.319211+0000","last_unstale":"2024-09-16T07:36:13.311844+0000","last_undegraded":"2024-09-16T07:36:13.311844+0000","last_fullsized":"2024-09-16T07:36:13.311844+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:26:31.716299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393642+0000","last_change":"2024-09-16T07:36:12.317932+0000","last_active":"2024-09-16T07:36:13.393642+0000","last_peered":"2024-09-16T07:36:13.393642+0000","last_clean":"2024-09-16T07:36:13.393642+0000","last_became_active":"2024-09-16T07:36:12.316885+0000","last_became_peered":"2024-09-16T07:36:12.316885+0000","last_unstale":"2024-09-16T07:36:13.393642+0000","last_undegraded":"2024-09-16T07:36:13.393642+0000","last_fullsized":"2024-09-16T07:36:13.393642+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:31:26.864444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394292+0000","last_change":"2024-09-16T07:36:12.314067+0000","last_active":"2024-09-16T07:36:13.394292+0000","last_peered":"2024-09-16T07:36:13.394292+0000","last_clean":"2024-09-16T07:36:13.394292+0000","last_became_active":"2024-09-16T07:36:12.313827+0000","last_became_peered":"2024-09-16T07:36:12.313827+0000","last_unstale":"2024-09-16T07:36:13.394292+0000","last_undegraded":"2024-09-16T07:36:13.394292+0000","last_fullsized":"2024-09-16T07:36:13.394292+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:46:19.997667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389914+0000","last_change":"2024-09-16T07:36:12.316842+0000","last_active":"2024-09-16T07:36:13.389914+0000","last_peered":"2024-09-16T07:36:13.389914+0000","last_clean":"2024-09-16T07:36:13.389914+0000","last_became_active":"2024-09-16T07:36:12.315565+0000","last_became_peered":"2024-09-16T07:36:12.315565+0000","last_unstale":"2024-09-16T07:36:13.389914+0000","last_undegraded":"2024-09-16T07:36:13.389914+0000","last_fullsized":"2024-09-16T07:36:13.389914+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:53:15.064155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393276+0000","last_change":"2024-09-16T07:36:12.320387+0000","last_active":"2024-09-16T07:36:13.393276+0000","last_peered":"2024-09-16T07:36:13.393276+0000","last_clean":"2024-09-16T07:36:13.393276+0000","last_became_active":"2024-09-16T07:36:12.320077+0000","last_became_peered":"2024-09-16T07:36:12.320077+0000","last_unstale":"2024-09-16T07:36:13.393276+0000","last_undegraded":"2024-09-16T07:36:13.393276+0000","last_fullsized":"2024-09-16T07:36:13.393276+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:05:58.783212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393509+0000","last_change":"2024-09-16T07:36:12.311734+0000","last_active":"2024-09-16T07:36:13.393509+0000","last_peered":"2024-09-16T07:36:13.393509+0000","last_clean":"2024-09-16T07:36:13.393509+0000","last_became_active":"2024-09-16T07:36:12.310769+0000","last_became_peered":"2024-09-16T07:36:12.310769+0000","last_unstale":"2024-09-16T07:36:13.393509+0000","last_undegraded":"2024-09-16T07:36:13.393509+0000","last_fullsized":"2024-09-16T07:36:13.393509+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:24.349966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394055+0000","last_change":"2024-09-16T07:36:12.312899+0000","last_active":"2024-09-16T07:36:13.394055+0000","last_peered":"2024-09-16T07:36:13.394055+0000","last_clean":"2024-09-16T07:36:13.394055+0000","last_became_active":"2024-09-16T07:36:12.310450+0000","last_became_peered":"2024-09-16T07:36:12.310450+0000","last_unstale":"2024-09-16T07:36:13.394055+0000","last_undegraded":"2024-09-16T07:36:13.394055+0000","last_fullsized":"2024-09-16T07:36:13.394055+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:07.866178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393552+0000","last_change":"2024-09-16T07:36:12.328840+0000","last_active":"2024-09-16T07:36:13.393552+0000","last_peered":"2024-09-16T07:36:13.393552+0000","last_clean":"2024-09-16T07:36:13.393552+0000","last_became_active":"2024-09-16T07:36:12.328528+0000","last_became_peered":"2024-09-16T07:36:12.328528+0000","last_unstale":"2024-09-16T07:36:13.393552+0000","last_undegraded":"2024-09-16T07:36:13.393552+0000","last_fullsized":"2024-09-16T07:36:13.393552+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:16.496589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395048+0000","last_change":"2024-09-16T07:36:12.328022+0000","last_active":"2024-09-16T07:36:13.395048+0000","last_peered":"2024-09-16T07:36:13.395048+0000","last_clean":"2024-09-16T07:36:13.395048+0000","last_became_active":"2024-09-16T07:36:12.327703+0000","last_became_peered":"2024-09-16T07:36:12.327703+0000","last_unstale":"2024-09-16T07:36:13.395048+0000","last_undegraded":"2024-09-16T07:36:13.395048+0000","last_fullsized":"2024-09-16T07:36:13.395048+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:38.301657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393850+0000","last_change":"2024-09-16T07:36:12.317386+0000","last_active":"2024-09-16T07:36:13.393850+0000","last_peered":"2024-09-16T07:36:13.393850+0000","last_clean":"2024-09-16T07:36:13.393850+0000","last_became_active":"2024-09-16T07:36:12.316394+0000","last_became_peered":"2024-09-16T07:36:12.316394+0000","last_unstale":"2024-09-16T07:36:13.393850+0000","last_undegraded":"2024-09-16T07:36:13.393850+0000","last_fullsized":"2024-09-16T07:36:13.393850+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:46.610138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312594+0000","last_change":"2024-09-16T07:36:12.326177+0000","last_active":"2024-09-16T07:36:13.312594+0000","last_peered":"2024-09-16T07:36:13.312594+0000","last_clean":"2024-09-16T07:36:13.312594+0000","last_became_active":"2024-09-16T07:36:12.325820+0000","last_became_peered":"2024-09-16T07:36:12.325820+0000","last_unstale":"2024-09-16T07:36:13.312594+0000","last_undegraded":"2024-09-16T07:36:13.312594+0000","last_fullsized":"2024-09-16T07:36:13.312594+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.420129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313582+0000","last_change":"2024-09-16T07:36:12.330291+0000","last_active":"2024-09-16T07:36:13.313582+0000","last_peered":"2024-09-16T07:36:13.313582+0000","last_clean":"2024-09-16T07:36:13.313582+0000","last_became_active":"2024-09-16T07:36:12.329993+0000","last_became_peered":"2024-09-16T07:36:12.329993+0000","last_unstale":"2024-09-16T07:36:13.313582+0000","last_undegraded":"2024-09-16T07:36:13.313582+0000","last_fullsized":"2024-09-16T07:36:13.313582+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:30:59.086139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.396017+0000","last_change":"2024-09-16T07:36:12.313256+0000","last_active":"2024-09-16T07:36:13.396017+0000","last_peered":"2024-09-16T07:36:13.396017+0000","last_clean":"2024-09-16T07:36:13.396017+0000","last_became_active":"2024-09-16T07:36:12.312956+0000","last_became_peered":"2024-09-16T07:36:12.312956+0000","last_unstale":"2024-09-16T07:36:13.396017+0000","last_undegraded":"2024-09-16T07:36:13.396017+0000","last_fullsized":"2024-09-16T07:36:13.396017+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.420129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393699+0000","last_change":"2024-09-16T07:36:12.329657+0000","last_active":"2024-09-16T07:36:13.393699+0000","last_peered":"2024-09-16T07:36:13.393699+0000","last_clean":"2024-09-16T07:36:13.393699+0000","last_became_active":"2024-09-16T07:36:12.329386+0000","last_became_peered":"2024-09-16T07:36:12.329386+0000","last_unstale":"2024-09-16T07:36:13.393699+0000","last_undegraded":"2024-09-16T07:36:13.393699+0000","last_fullsized":"2024-09-16T07:36:13.393699+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:55.031350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312111+0000","last_change":"2024-09-16T07:36:12.317909+0000","last_active":"2024-09-16T07:36:13.312111+0000","last_peered":"2024-09-16T07:36:13.312111+0000","last_clean":"2024-09-16T07:36:13.312111+0000","last_became_active":"2024-09-16T07:36:12.317589+0000","last_became_peered":"2024-09-16T07:36:12.317589+0000","last_unstale":"2024-09-16T07:36:13.312111+0000","last_undegraded":"2024-09-16T07:36:13.312111+0000","last_fullsized":"2024-09-16T07:36:13.312111+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:21:01.497390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314126+0000","last_change":"2024-09-16T07:36:12.309955+0000","last_active":"2024-09-16T07:36:13.314126+0000","last_peered":"2024-09-16T07:36:13.314126+0000","last_clean":"2024-09-16T07:36:13.314126+0000","last_became_active":"2024-09-16T07:36:12.308897+0000","last_became_peered":"2024-09-16T07:36:12.308897+0000","last_unstale":"2024-09-16T07:36:13.314126+0000","last_undegraded":"2024-09-16T07:36:13.314126+0000","last_fullsized":"2024-09-16T07:36:13.314126+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:43.988737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395231+0000","last_change":"2024-09-16T07:36:12.310933+0000","last_active":"2024-09-16T07:36:13.395231+0000","last_peered":"2024-09-16T07:36:13.395231+0000","last_clean":"2024-09-16T07:36:13.395231+0000","last_became_active":"2024-09-16T07:36:12.308546+0000","last_became_peered":"2024-09-16T07:36:12.308546+0000","last_unstale":"2024-09-16T07:36:13.395231+0000","last_undegraded":"2024-09-16T07:36:13.395231+0000","last_fullsized":"2024-09-16T07:36:13.395231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:37.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392686+0000","last_change":"2024-09-16T07:36:12.313024+0000","last_active":"2024-09-16T07:36:13.392686+0000","last_peered":"2024-09-16T07:36:13.392686+0000","last_clean":"2024-09-16T07:36:13.392686+0000","last_became_active":"2024-09-16T07:36:12.311790+0000","last_became_peered":"2024-09-16T07:36:12.311790+0000","last_unstale":"2024-09-16T07:36:13.392686+0000","last_undegraded":"2024-09-16T07:36:13.392686+0000","last_fullsized":"2024-09-16T07:36:13.392686+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:11:51.421307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394813+0000","last_change":"2024-09-16T07:36:12.316450+0000","last_active":"2024-09-16T07:36:13.394813+0000","last_peered":"2024-09-16T07:36:13.394813+0000","last_clean":"2024-09-16T07:36:13.394813+0000","last_became_active":"2024-09-16T07:36:12.315752+0000","last_became_peered":"2024-09-16T07:36:12.315752+0000","last_unstale":"2024-09-16T07:36:13.394813+0000","last_undegraded":"2024-09-16T07:36:13.394813+0000","last_fullsized":"2024-09-16T07:36:13.394813+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:58:55.696313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"151'4","reported_seq":19,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394336+0000","last_change":"2024-09-16T07:36:11.310676+0000","last_active":"2024-09-16T07:36:13.394336+0000","last_peered":"2024-09-16T07:36:13.394336+0000","last_clean":"2024-09-16T07:36:13.394336+0000","last_became_active":"2024-09-16T07:36:11.310216+0000","last_became_peered":"2024-09-16T07:36:11.310216+0000","last_unstale":"2024-09-16T07:36:13.394336+0000","last_undegraded":"2024-09-16T07:36:13.394336+0000","last_fullsized":"2024-09-16T07:36:13.394336+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:45.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393961+0000","last_change":"2024-09-16T07:36:12.330938+0000","last_active":"2024-09-16T07:36:13.393961+0000","last_peered":"2024-09-16T07:36:13.393961+0000","last_clean":"2024-09-16T07:36:13.393961+0000","last_became_active":"2024-09-16T07:36:12.330428+0000","last_became_peered":"2024-09-16T07:36:12.330428+0000","last_unstale":"2024-09-16T07:36:13.393961+0000","last_undegraded":"2024-09-16T07:36:13.393961+0000","last_fullsized":"2024-09-16T07:36:13.393961+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:57:56.432675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314560+0000","last_change":"2024-09-16T07:36:11.304391+0000","last_active":"2024-09-16T07:36:13.314560+0000","last_peered":"2024-09-16T07:36:13.314560+0000","last_clean":"2024-09-16T07:36:13.314560+0000","last_became_active":"2024-09-16T07:36:11.304073+0000","last_became_peered":"2024-09-16T07:36:11.304073+0000","last_unstale":"2024-09-16T07:36:13.314560+0000","last_undegraded":"2024-09-16T07:36:13.314560+0000","last_fullsized":"2024-09-16T07:36:13.314560+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:21.218229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313204+0000","last_change":"2024-09-16T07:36:12.314748+0000","last_active":"2024-09-16T07:36:13.313204+0000","last_peered":"2024-09-16T07:36:13.313204+0000","last_clean":"2024-09-16T07:36:13.313204+0000","last_became_active":"2024-09-16T07:36:12.312870+0000","last_became_peered":"2024-09-16T07:36:12.312870+0000","last_unstale":"2024-09-16T07:36:13.313204+0000","last_undegraded":"2024-09-16T07:36:13.313204+0000","last_fullsized":"2024-09-16T07:36:13.313204+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:10.542247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.396128+0000","last_change":"2024-09-16T07:36:11.311008+0000","last_active":"2024-09-16T07:36:13.396128+0000","last_peered":"2024-09-16T07:36:13.396128+0000","last_clean":"2024-09-16T07:36:13.396128+0000","last_became_active":"2024-09-16T07:36:11.309377+0000","last_became_peered":"2024-09-16T07:36:11.309377+0000","last_unstale":"2024-09-16T07:36:13.396128+0000","last_undegraded":"2024-09-16T07:36:13.396128+0000","last_fullsized":"2024-09-16T07:36:13.396128+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:05:39.434629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314728+0000","last_change":"2024-09-16T07:36:12.302320+0000","last_active":"2024-09-16T07:36:13.314728+0000","last_peered":"2024-09-16T07:36:13.314728+0000","last_clean":"2024-09-16T07:36:13.314728+0000","last_became_active":"2024-09-16T07:36:12.302004+0000","last_became_peered":"2024-09-16T07:36:12.302004+0000","last_unstale":"2024-09-16T07:36:13.314728+0000","last_undegraded":"2024-09-16T07:36:13.314728+0000","last_fullsized":"2024-09-16T07:36:13.314728+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:45:44.454187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312249+0000","last_change":"2024-09-16T07:36:11.301088+0000","last_active":"2024-09-16T07:36:13.312249+0000","last_peered":"2024-09-16T07:36:13.312249+0000","last_clean":"2024-09-16T07:36:13.312249+0000","last_became_active":"2024-09-16T07:36:11.300843+0000","last_became_peered":"2024-09-16T07:36:11.300843+0000","last_unstale":"2024-09-16T07:36:13.312249+0000","last_undegraded":"2024-09-16T07:36:13.312249+0000","last_fullsized":"2024-09-16T07:36:13.312249+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:33.414475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393353+0000","last_change":"2024-09-16T07:36:12.333104+0000","last_active":"2024-09-16T07:36:13.393353+0000","last_peered":"2024-09-16T07:36:13.393353+0000","last_clean":"2024-09-16T07:36:13.393353+0000","last_became_active":"2024-09-16T07:36:12.331819+0000","last_became_peered":"2024-09-16T07:36:12.331819+0000","last_unstale":"2024-09-16T07:36:13.393353+0000","last_undegraded":"2024-09-16T07:36:13.393353+0000","last_fullsized":"2024-09-16T07:36:13.393353+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:14.086368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394225+0000","last_change":"2024-09-16T07:36:11.315362+0000","last_active":"2024-09-16T07:36:13.394225+0000","last_peered":"2024-09-16T07:36:13.394225+0000","last_clean":"2024-09-16T07:36:13.394225+0000","last_became_active":"2024-09-16T07:36:11.315141+0000","last_became_peered":"2024-09-16T07:36:11.315141+0000","last_unstale":"2024-09-16T07:36:13.394225+0000","last_undegraded":"2024-09-16T07:36:13.394225+0000","last_fullsized":"2024-09-16T07:36:13.394225+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:12:56.047993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394113+0000","last_change":"2024-09-16T07:36:12.321219+0000","last_active":"2024-09-16T07:36:13.394113+0000","last_peered":"2024-09-16T07:36:13.394113+0000","last_clean":"2024-09-16T07:36:13.394113+0000","last_became_active":"2024-09-16T07:36:12.320896+0000","last_became_peered":"2024-09-16T07:36:12.320896+0000","last_unstale":"2024-09-16T07:36:13.394113+0000","last_undegraded":"2024-09-16T07:36:13.394113+0000","last_fullsized":"2024-09-16T07:36:13.394113+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:08.474022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393867+0000","last_change":"2024-09-16T07:36:11.304767+0000","last_active":"2024-09-16T07:36:13.393867+0000","last_peered":"2024-09-16T07:36:13.393867+0000","last_clean":"2024-09-16T07:36:13.393867+0000","last_became_active":"2024-09-16T07:36:11.303691+0000","last_became_peered":"2024-09-16T07:36:11.303691+0000","last_unstale":"2024-09-16T07:36:13.393867+0000","last_undegraded":"2024-09-16T07:36:13.393867+0000","last_fullsized":"2024-09-16T07:36:13.393867+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:00.584364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313014+0000","last_change":"2024-09-16T07:36:12.316036+0000","last_active":"2024-09-16T07:36:13.313014+0000","last_peered":"2024-09-16T07:36:13.313014+0000","last_clean":"2024-09-16T07:36:13.313014+0000","last_became_active":"2024-09-16T07:36:12.315539+0000","last_became_peered":"2024-09-16T07:36:12.315539+0000","last_unstale":"2024-09-16T07:36:13.313014+0000","last_undegraded":"2024-09-16T07:36:13.313014+0000","last_fullsized":"2024-09-16T07:36:13.313014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:39.951732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389317+0000","last_change":"2024-09-16T07:36:11.307190+0000","last_active":"2024-09-16T07:36:13.389317+0000","last_peered":"2024-09-16T07:36:13.389317+0000","last_clean":"2024-09-16T07:36:13.389317+0000","last_became_active":"2024-09-16T07:36:11.306853+0000","last_became_peered":"2024-09-16T07:36:11.306853+0000","last_unstale":"2024-09-16T07:36:13.389317+0000","last_undegraded":"2024-09-16T07:36:13.389317+0000","last_fullsized":"2024-09-16T07:36:13.389317+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:07:35.042057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395752+0000","last_change":"2024-09-16T07:36:12.322440+0000","last_active":"2024-09-16T07:36:13.395752+0000","last_peered":"2024-09-16T07:36:13.395752+0000","last_clean":"2024-09-16T07:36:13.395752+0000","last_became_active":"2024-09-16T07:36:12.322028+0000","last_became_peered":"2024-09-16T07:36:12.322028+0000","last_unstale":"2024-09-16T07:36:13.395752+0000","last_undegraded":"2024-09-16T07:36:13.395752+0000","last_fullsized":"2024-09-16T07:36:13.395752+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:10.542247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313543+0000","last_change":"2024-09-16T07:36:11.295924+0000","last_active":"2024-09-16T07:36:13.313543+0000","last_peered":"2024-09-16T07:36:13.313543+0000","last_clean":"2024-09-16T07:36:13.313543+0000","last_became_active":"2024-09-16T07:36:11.295660+0000","last_became_peered":"2024-09-16T07:36:11.295660+0000","last_unstale":"2024-09-16T07:36:13.313543+0000","last_undegraded":"2024-09-16T07:36:13.313543+0000","last_fullsized":"2024-09-16T07:36:13.313543+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:07.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394881+0000","last_change":"2024-09-16T07:36:12.332720+0000","last_active":"2024-09-16T07:36:13.394881+0000","last_peered":"2024-09-16T07:36:13.394881+0000","last_clean":"2024-09-16T07:36:13.394881+0000","last_became_active":"2024-09-16T07:36:12.332312+0000","last_became_peered":"2024-09-16T07:36:12.332312+0000","last_unstale":"2024-09-16T07:36:13.394881+0000","last_undegraded":"2024-09-16T07:36:13.394881+0000","last_fullsized":"2024-09-16T07:36:13.394881+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:17.764358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394006+0000","last_change":"2024-09-16T07:36:11.311727+0000","last_active":"2024-09-16T07:36:13.394006+0000","last_peered":"2024-09-16T07:36:13.394006+0000","last_clean":"2024-09-16T07:36:13.394006+0000","last_became_active":"2024-09-16T07:36:11.311406+0000","last_became_peered":"2024-09-16T07:36:11.311406+0000","last_unstale":"2024-09-16T07:36:13.394006+0000","last_undegraded":"2024-09-16T07:36:13.394006+0000","last_fullsized":"2024-09-16T07:36:13.394006+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:06.578292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313338+0000","last_change":"2024-09-16T07:36:12.304880+0000","last_active":"2024-09-16T07:36:13.313338+0000","last_peered":"2024-09-16T07:36:13.313338+0000","last_clean":"2024-09-16T07:36:13.313338+0000","last_became_active":"2024-09-16T07:36:12.304298+0000","last_became_peered":"2024-09-16T07:36:12.304298+0000","last_unstale":"2024-09-16T07:36:13.313338+0000","last_undegraded":"2024-09-16T07:36:13.313338+0000","last_fullsized":"2024-09-16T07:36:13.313338+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:46.039127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"151'3","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394501+0000","last_change":"2024-09-16T07:36:11.314196+0000","last_active":"2024-09-16T07:36:13.394501+0000","last_peered":"2024-09-16T07:36:13.394501+0000","last_clean":"2024-09-16T07:36:13.394501+0000","last_became_active":"2024-09-16T07:36:11.313790+0000","last_became_peered":"2024-09-16T07:36:11.313790+0000","last_unstale":"2024-09-16T07:36:13.394501+0000","last_undegraded":"2024-09-16T07:36:13.394501+0000","last_fullsized":"2024-09-16T07:36:13.394501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:15:10.678432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393501+0000","last_change":"2024-09-16T07:36:12.324901+0000","last_active":"2024-09-16T07:36:13.393501+0000","last_peered":"2024-09-16T07:36:13.393501+0000","last_clean":"2024-09-16T07:36:13.393501+0000","last_became_active":"2024-09-16T07:36:12.324655+0000","last_became_peered":"2024-09-16T07:36:12.324655+0000","last_unstale":"2024-09-16T07:36:13.393501+0000","last_undegraded":"2024-09-16T07:36:13.393501+0000","last_fullsized":"2024-09-16T07:36:13.393501+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:52.824899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"151'6","reported_seq":21,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395487+0000","last_change":"2024-09-16T07:36:11.302633+0000","last_active":"2024-09-16T07:36:13.395487+0000","last_peered":"2024-09-16T07:36:13.395487+0000","last_clean":"2024-09-16T07:36:13.395487+0000","last_became_active":"2024-09-16T07:36:11.299983+0000","last_became_peered":"2024-09-16T07:36:11.299983+0000","last_unstale":"2024-09-16T07:36:13.395487+0000","last_undegraded":"2024-09-16T07:36:13.395487+0000","last_fullsized":"2024-09-16T07:36:13.395487+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:03:00.697346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395238+0000","last_change":"2024-09-16T07:36:12.327696+0000","last_active":"2024-09-16T07:36:13.395238+0000","last_peered":"2024-09-16T07:36:13.395238+0000","last_clean":"2024-09-16T07:36:13.395238+0000","last_became_active":"2024-09-16T07:36:12.327273+0000","last_became_peered":"2024-09-16T07:36:12.327273+0000","last_unstale":"2024-09-16T07:36:13.395238+0000","last_undegraded":"2024-09-16T07:36:13.395238+0000","last_fullsized":"2024-09-16T07:36:13.395238+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:51.030840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389823+0000","last_change":"2024-09-16T07:36:11.307269+0000","last_active":"2024-09-16T07:36:13.389823+0000","last_peered":"2024-09-16T07:36:13.389823+0000","last_clean":"2024-09-16T07:36:13.389823+0000","last_became_active":"2024-09-16T07:36:11.306929+0000","last_became_peered":"2024-09-16T07:36:11.306929+0000","last_unstale":"2024-09-16T07:36:13.389823+0000","last_undegraded":"2024-09-16T07:36:13.389823+0000","last_fullsized":"2024-09-16T07:36:13.389823+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:19.412802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313179+0000","last_change":"2024-09-16T07:36:12.328409+0000","last_active":"2024-09-16T07:36:13.313179+0000","last_peered":"2024-09-16T07:36:13.313179+0000","last_clean":"2024-09-16T07:36:13.313179+0000","last_became_active":"2024-09-16T07:36:12.328045+0000","last_became_peered":"2024-09-16T07:36:12.328045+0000","last_unstale":"2024-09-16T07:36:13.313179+0000","last_undegraded":"2024-09-16T07:36:13.313179+0000","last_fullsized":"2024-09-16T07:36:13.313179+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:56:58.848112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393657+0000","last_change":"2024-09-16T07:36:11.313552+0000","last_active":"2024-09-16T07:36:13.393657+0000","last_peered":"2024-09-16T07:36:13.393657+0000","last_clean":"2024-09-16T07:36:13.393657+0000","last_became_active":"2024-09-16T07:36:11.313314+0000","last_became_peered":"2024-09-16T07:36:11.313314+0000","last_unstale":"2024-09-16T07:36:13.393657+0000","last_undegraded":"2024-09-16T07:36:13.393657+0000","last_fullsized":"2024-09-16T07:36:13.393657+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:20.887909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313972+0000","last_change":"2024-09-16T07:36:12.310555+0000","last_active":"2024-09-16T07:36:13.313972+0000","last_peered":"2024-09-16T07:36:13.313972+0000","last_clean":"2024-09-16T07:36:13.313972+0000","last_became_active":"2024-09-16T07:36:12.310305+0000","last_became_peered":"2024-09-16T07:36:12.310305+0000","last_unstale":"2024-09-16T07:36:13.313972+0000","last_undegraded":"2024-09-16T07:36:13.313972+0000","last_fullsized":"2024-09-16T07:36:13.313972+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:30.271371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393119+0000","last_change":"2024-09-16T07:36:11.302856+0000","last_active":"2024-09-16T07:36:13.393119+0000","last_peered":"2024-09-16T07:36:13.393119+0000","last_clean":"2024-09-16T07:36:13.393119+0000","last_became_active":"2024-09-16T07:36:11.302576+0000","last_became_peered":"2024-09-16T07:36:11.302576+0000","last_unstale":"2024-09-16T07:36:13.393119+0000","last_undegraded":"2024-09-16T07:36:13.393119+0000","last_fullsized":"2024-09-16T07:36:13.393119+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:48.596900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394522+0000","last_change":"2024-09-16T07:36:12.326765+0000","last_active":"2024-09-16T07:36:13.394522+0000","last_peered":"2024-09-16T07:36:13.394522+0000","last_clean":"2024-09-16T07:36:13.394522+0000","last_became_active":"2024-09-16T07:36:12.326494+0000","last_became_peered":"2024-09-16T07:36:12.326494+0000","last_unstale":"2024-09-16T07:36:13.394522+0000","last_undegraded":"2024-09-16T07:36:13.394522+0000","last_fullsized":"2024-09-16T07:36:13.394522+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:04:43.002328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"151'8","reported_seq":23,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389430+0000","last_change":"2024-09-16T07:36:11.307325+0000","last_active":"2024-09-16T07:36:13.389430+0000","last_peered":"2024-09-16T07:36:13.389430+0000","last_clean":"2024-09-16T07:36:13.389430+0000","last_became_active":"2024-09-16T07:36:11.306839+0000","last_became_peered":"2024-09-16T07:36:11.306839+0000","last_unstale":"2024-09-16T07:36:13.389430+0000","last_undegraded":"2024-09-16T07:36:13.389430+0000","last_fullsized":"2024-09-16T07:36:13.389430+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:48.372016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394580+0000","last_change":"2024-09-16T07:36:12.329689+0000","last_active":"2024-09-16T07:36:13.394580+0000","last_peered":"2024-09-16T07:36:13.394580+0000","last_clean":"2024-09-16T07:36:13.394580+0000","last_became_active":"2024-09-16T07:36:12.329133+0000","last_became_peered":"2024-09-16T07:36:12.329133+0000","last_unstale":"2024-09-16T07:36:13.394580+0000","last_undegraded":"2024-09-16T07:36:13.394580+0000","last_fullsized":"2024-09-16T07:36:13.394580+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:13.568064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394366+0000","last_change":"2024-09-16T07:36:11.316741+0000","last_active":"2024-09-16T07:36:13.394366+0000","last_peered":"2024-09-16T07:36:13.394366+0000","last_clean":"2024-09-16T07:36:13.394366+0000","last_became_active":"2024-09-16T07:36:11.316066+0000","last_became_peered":"2024-09-16T07:36:11.316066+0000","last_unstale":"2024-09-16T07:36:13.394366+0000","last_undegraded":"2024-09-16T07:36:13.394366+0000","last_fullsized":"2024-09-16T07:36:13.394366+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:23.097199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314729+0000","last_change":"2024-09-16T07:36:12.327139+0000","last_active":"2024-09-16T07:36:13.314729+0000","last_peered":"2024-09-16T07:36:13.314729+0000","last_clean":"2024-09-16T07:36:13.314729+0000","last_became_active":"2024-09-16T07:36:12.326874+0000","last_became_peered":"2024-09-16T07:36:12.326874+0000","last_unstale":"2024-09-16T07:36:13.314729+0000","last_undegraded":"2024-09-16T07:36:13.314729+0000","last_fullsized":"2024-09-16T07:36:13.314729+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:31.491129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394917+0000","last_change":"2024-09-16T07:36:11.301183+0000","last_active":"2024-09-16T07:36:13.394917+0000","last_peered":"2024-09-16T07:36:13.394917+0000","last_clean":"2024-09-16T07:36:13.394917+0000","last_became_active":"2024-09-16T07:36:11.299410+0000","last_became_peered":"2024-09-16T07:36:11.299410+0000","last_unstale":"2024-09-16T07:36:13.394917+0000","last_undegraded":"2024-09-16T07:36:13.394917+0000","last_fullsized":"2024-09-16T07:36:13.394917+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:07.403781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314414+0000","last_change":"2024-09-16T07:36:12.313761+0000","last_active":"2024-09-16T07:36:13.314414+0000","last_peered":"2024-09-16T07:36:13.314414+0000","last_clean":"2024-09-16T07:36:13.314414+0000","last_became_active":"2024-09-16T07:36:12.313502+0000","last_became_peered":"2024-09-16T07:36:12.313502+0000","last_unstale":"2024-09-16T07:36:13.314414+0000","last_undegraded":"2024-09-16T07:36:13.314414+0000","last_fullsized":"2024-09-16T07:36:13.314414+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:38.384613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389855+0000","last_change":"2024-09-16T07:36:11.309775+0000","last_active":"2024-09-16T07:36:13.389855+0000","last_peered":"2024-09-16T07:36:13.389855+0000","last_clean":"2024-09-16T07:36:13.389855+0000","last_became_active":"2024-09-16T07:36:11.309530+0000","last_became_peered":"2024-09-16T07:36:11.309530+0000","last_unstale":"2024-09-16T07:36:13.389855+0000","last_undegraded":"2024-09-16T07:36:13.389855+0000","last_fullsized":"2024-09-16T07:36:13.389855+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:50:38.430242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312155+0000","last_change":"2024-09-16T07:36:12.315380+0000","last_active":"2024-09-16T07:36:13.312155+0000","last_peered":"2024-09-16T07:36:13.312155+0000","last_clean":"2024-09-16T07:36:13.312155+0000","last_became_active":"2024-09-16T07:36:12.314465+0000","last_became_peered":"2024-09-16T07:36:12.314465+0000","last_unstale":"2024-09-16T07:36:13.312155+0000","last_undegraded":"2024-09-16T07:36:13.312155+0000","last_fullsized":"2024-09-16T07:36:13.312155+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:37.643913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313317+0000","last_change":"2024-09-16T07:36:11.309068+0000","last_active":"2024-09-16T07:36:13.313317+0000","last_peered":"2024-09-16T07:36:13.313317+0000","last_clean":"2024-09-16T07:36:13.313317+0000","last_became_active":"2024-09-16T07:36:11.308724+0000","last_became_peered":"2024-09-16T07:36:11.308724+0000","last_unstale":"2024-09-16T07:36:13.313317+0000","last_undegraded":"2024-09-16T07:36:13.313317+0000","last_fullsized":"2024-09-16T07:36:13.313317+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:12.894192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393562+0000","last_change":"2024-09-16T07:36:12.323904+0000","last_active":"2024-09-16T07:36:13.393562+0000","last_peered":"2024-09-16T07:36:13.393562+0000","last_clean":"2024-09-16T07:36:13.393562+0000","last_became_active":"2024-09-16T07:36:12.323556+0000","last_became_peered":"2024-09-16T07:36:12.323556+0000","last_unstale":"2024-09-16T07:36:13.393562+0000","last_undegraded":"2024-09-16T07:36:13.393562+0000","last_fullsized":"2024-09-16T07:36:13.393562+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:34.574308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395716+0000","last_change":"2024-09-16T07:36:11.314157+0000","last_active":"2024-09-16T07:36:13.395716+0000","last_peered":"2024-09-16T07:36:13.395716+0000","last_clean":"2024-09-16T07:36:13.395716+0000","last_became_active":"2024-09-16T07:36:11.313910+0000","last_became_peered":"2024-09-16T07:36:11.313910+0000","last_unstale":"2024-09-16T07:36:13.395716+0000","last_undegraded":"2024-09-16T07:36:13.395716+0000","last_fullsized":"2024-09-16T07:36:13.395716+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:33:07.856942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313253+0000","last_change":"2024-09-16T07:36:12.319256+0000","last_active":"2024-09-16T07:36:13.313253+0000","last_peered":"2024-09-16T07:36:13.313253+0000","last_clean":"2024-09-16T07:36:13.313253+0000","last_became_active":"2024-09-16T07:36:12.318982+0000","last_became_peered":"2024-09-16T07:36:12.318982+0000","last_unstale":"2024-09-16T07:36:13.313253+0000","last_undegraded":"2024-09-16T07:36:13.313253+0000","last_fullsized":"2024-09-16T07:36:13.313253+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:28.066065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394636+0000","last_change":"2024-09-16T07:36:11.308534+0000","last_active":"2024-09-16T07:36:13.394636+0000","last_peered":"2024-09-16T07:36:13.394636+0000","last_clean":"2024-09-16T07:36:13.394636+0000","last_became_active":"2024-09-16T07:36:11.308226+0000","last_became_peered":"2024-09-16T07:36:11.308226+0000","last_unstale":"2024-09-16T07:36:13.394636+0000","last_undegraded":"2024-09-16T07:36:13.394636+0000","last_fullsized":"2024-09-16T07:36:13.394636+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:40.344903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.312243+0000","last_change":"2024-09-16T07:36:12.315451+0000","last_active":"2024-09-16T07:36:13.312243+0000","last_peered":"2024-09-16T07:36:13.312243+0000","last_clean":"2024-09-16T07:36:13.312243+0000","last_became_active":"2024-09-16T07:36:12.313739+0000","last_became_peered":"2024-09-16T07:36:12.313739+0000","last_unstale":"2024-09-16T07:36:13.312243+0000","last_undegraded":"2024-09-16T07:36:13.312243+0000","last_fullsized":"2024-09-16T07:36:13.312243+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:10.542247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395148+0000","last_change":"2024-09-16T07:36:11.311647+0000","last_active":"2024-09-16T07:36:13.395148+0000","last_peered":"2024-09-16T07:36:13.395148+0000","last_clean":"2024-09-16T07:36:13.395148+0000","last_became_active":"2024-09-16T07:36:11.311355+0000","last_became_peered":"2024-09-16T07:36:11.311355+0000","last_unstale":"2024-09-16T07:36:13.395148+0000","last_undegraded":"2024-09-16T07:36:13.395148+0000","last_fullsized":"2024-09-16T07:36:13.395148+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:56:03.435904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392775+0000","last_change":"2024-09-16T07:36:12.313527+0000","last_active":"2024-09-16T07:36:13.392775+0000","last_peered":"2024-09-16T07:36:13.392775+0000","last_clean":"2024-09-16T07:36:13.392775+0000","last_became_active":"2024-09-16T07:36:12.313371+0000","last_became_peered":"2024-09-16T07:36:12.313371+0000","last_unstale":"2024-09-16T07:36:13.392775+0000","last_undegraded":"2024-09-16T07:36:13.392775+0000","last_fullsized":"2024-09-16T07:36:13.392775+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:53.423757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.313953+0000","last_change":"2024-09-16T07:36:11.298699+0000","last_active":"2024-09-16T07:36:13.313953+0000","last_peered":"2024-09-16T07:36:13.313953+0000","last_clean":"2024-09-16T07:36:13.313953+0000","last_became_active":"2024-09-16T07:36:11.298420+0000","last_became_peered":"2024-09-16T07:36:11.298420+0000","last_unstale":"2024-09-16T07:36:13.313953+0000","last_undegraded":"2024-09-16T07:36:13.313953+0000","last_fullsized":"2024-09-16T07:36:13.313953+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:53:00.690449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393908+0000","last_change":"2024-09-16T07:36:12.311385+0000","last_active":"2024-09-16T07:36:13.393908+0000","last_peered":"2024-09-16T07:36:13.393908+0000","last_clean":"2024-09-16T07:36:13.393908+0000","last_became_active":"2024-09-16T07:36:12.311165+0000","last_became_peered":"2024-09-16T07:36:12.311165+0000","last_unstale":"2024-09-16T07:36:13.393908+0000","last_undegraded":"2024-09-16T07:36:13.393908+0000","last_fullsized":"2024-09-16T07:36:13.393908+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:11:21.569710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389912+0000","last_change":"2024-09-16T07:36:11.308652+0000","last_active":"2024-09-16T07:36:13.389912+0000","last_peered":"2024-09-16T07:36:13.389912+0000","last_clean":"2024-09-16T07:36:13.389912+0000","last_became_active":"2024-09-16T07:36:11.308389+0000","last_became_peered":"2024-09-16T07:36:11.308389+0000","last_unstale":"2024-09-16T07:36:13.389912+0000","last_undegraded":"2024-09-16T07:36:13.389912+0000","last_fullsized":"2024-09-16T07:36:13.389912+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:48.596900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393964+0000","last_change":"2024-09-16T07:36:12.329630+0000","last_active":"2024-09-16T07:36:13.393964+0000","last_peered":"2024-09-16T07:36:13.393964+0000","last_clean":"2024-09-16T07:36:13.393964+0000","last_became_active":"2024-09-16T07:36:12.329298+0000","last_became_peered":"2024-09-16T07:36:12.329298+0000","last_unstale":"2024-09-16T07:36:13.393964+0000","last_undegraded":"2024-09-16T07:36:13.393964+0000","last_fullsized":"2024-09-16T07:36:13.393964+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:12.871460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394677+0000","last_change":"2024-09-16T07:36:11.312942+0000","last_active":"2024-09-16T07:36:13.394677+0000","last_peered":"2024-09-16T07:36:13.394677+0000","last_clean":"2024-09-16T07:36:13.394677+0000","last_became_active":"2024-09-16T07:36:11.312038+0000","last_became_peered":"2024-09-16T07:36:11.312038+0000","last_unstale":"2024-09-16T07:36:13.394677+0000","last_undegraded":"2024-09-16T07:36:13.394677+0000","last_fullsized":"2024-09-16T07:36:13.394677+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:20:33.327726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395506+0000","last_change":"2024-09-16T07:36:12.321457+0000","last_active":"2024-09-16T07:36:13.395506+0000","last_peered":"2024-09-16T07:36:13.395506+0000","last_clean":"2024-09-16T07:36:13.395506+0000","last_became_active":"2024-09-16T07:36:12.321126+0000","last_became_peered":"2024-09-16T07:36:12.321126+0000","last_unstale":"2024-09-16T07:36:13.395506+0000","last_undegraded":"2024-09-16T07:36:13.395506+0000","last_fullsized":"2024-09-16T07:36:13.395506+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:24.699102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393532+0000","last_change":"2024-09-16T07:36:11.312644+0000","last_active":"2024-09-16T07:36:13.393532+0000","last_peered":"2024-09-16T07:36:13.393532+0000","last_clean":"2024-09-16T07:36:13.393532+0000","last_became_active":"2024-09-16T07:36:11.312374+0000","last_became_peered":"2024-09-16T07:36:11.312374+0000","last_unstale":"2024-09-16T07:36:13.393532+0000","last_undegraded":"2024-09-16T07:36:13.393532+0000","last_fullsized":"2024-09-16T07:36:13.393532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:41.039603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394417+0000","last_change":"2024-09-16T07:36:12.314632+0000","last_active":"2024-09-16T07:36:13.394417+0000","last_peered":"2024-09-16T07:36:13.394417+0000","last_clean":"2024-09-16T07:36:13.394417+0000","last_became_active":"2024-09-16T07:36:12.314374+0000","last_became_peered":"2024-09-16T07:36:12.314374+0000","last_unstale":"2024-09-16T07:36:13.394417+0000","last_undegraded":"2024-09-16T07:36:13.394417+0000","last_fullsized":"2024-09-16T07:36:13.394417+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:51.041989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.395598+0000","last_change":"2024-09-16T07:36:11.299963+0000","last_active":"2024-09-16T07:36:13.395598+0000","last_peered":"2024-09-16T07:36:13.395598+0000","last_clean":"2024-09-16T07:36:13.395598+0000","last_became_active":"2024-09-16T07:36:11.299667+0000","last_became_peered":"2024-09-16T07:36:11.299667+0000","last_unstale":"2024-09-16T07:36:13.395598+0000","last_undegraded":"2024-09-16T07:36:13.395598+0000","last_fullsized":"2024-09-16T07:36:13.395598+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:17:33.319553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389758+0000","last_change":"2024-09-16T07:36:12.322219+0000","last_active":"2024-09-16T07:36:13.389758+0000","last_peered":"2024-09-16T07:36:13.389758+0000","last_clean":"2024-09-16T07:36:13.389758+0000","last_became_active":"2024-09-16T07:36:12.321879+0000","last_became_peered":"2024-09-16T07:36:12.321879+0000","last_unstale":"2024-09-16T07:36:13.389758+0000","last_undegraded":"2024-09-16T07:36:13.389758+0000","last_fullsized":"2024-09-16T07:36:13.389758+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:00.972615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314241+0000","last_change":"2024-09-16T07:36:11.307756+0000","last_active":"2024-09-16T07:36:13.314241+0000","last_peered":"2024-09-16T07:36:13.314241+0000","last_clean":"2024-09-16T07:36:13.314241+0000","last_became_active":"2024-09-16T07:36:11.307289+0000","last_became_peered":"2024-09-16T07:36:11.307289+0000","last_unstale":"2024-09-16T07:36:13.314241+0000","last_undegraded":"2024-09-16T07:36:13.314241+0000","last_fullsized":"2024-09-16T07:36:13.314241+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:39.606244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389921+0000","last_change":"2024-09-16T07:36:12.318163+0000","last_active":"2024-09-16T07:36:13.389921+0000","last_peered":"2024-09-16T07:36:13.389921+0000","last_clean":"2024-09-16T07:36:13.389921+0000","last_became_active":"2024-09-16T07:36:12.317806+0000","last_became_peered":"2024-09-16T07:36:12.317806+0000","last_unstale":"2024-09-16T07:36:13.389921+0000","last_undegraded":"2024-09-16T07:36:13.389921+0000","last_fullsized":"2024-09-16T07:36:13.389921+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:20:34.332307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.314166+0000","last_change":"2024-09-16T07:36:11.295882+0000","last_active":"2024-09-16T07:36:13.314166+0000","last_peered":"2024-09-16T07:36:13.314166+0000","last_clean":"2024-09-16T07:36:13.314166+0000","last_became_active":"2024-09-16T07:36:11.294790+0000","last_became_peered":"2024-09-16T07:36:11.294790+0000","last_unstale":"2024-09-16T07:36:13.314166+0000","last_undegraded":"2024-09-16T07:36:13.314166+0000","last_fullsized":"2024-09-16T07:36:13.314166+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:12:54.216810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311778+0000","last_change":"2024-09-16T07:36:12.314019+0000","last_active":"2024-09-16T07:36:13.311778+0000","last_peered":"2024-09-16T07:36:13.311778+0000","last_clean":"2024-09-16T07:36:13.311778+0000","last_became_active":"2024-09-16T07:36:12.313367+0000","last_became_peered":"2024-09-16T07:36:12.313367+0000","last_unstale":"2024-09-16T07:36:13.311778+0000","last_undegraded":"2024-09-16T07:36:13.311778+0000","last_fullsized":"2024-09-16T07:36:13.311778+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:23:52.869858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.311974+0000","last_change":"2024-09-16T07:36:11.300375+0000","last_active":"2024-09-16T07:36:13.311974+0000","last_peered":"2024-09-16T07:36:13.311974+0000","last_clean":"2024-09-16T07:36:13.311974+0000","last_became_active":"2024-09-16T07:36:11.300105+0000","last_became_peered":"2024-09-16T07:36:11.300105+0000","last_unstale":"2024-09-16T07:36:13.311974+0000","last_undegraded":"2024-09-16T07:36:13.311974+0000","last_fullsized":"2024-09-16T07:36:13.311974+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:26:48.729516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.392971+0000","last_change":"2024-09-16T07:36:12.313633+0000","last_active":"2024-09-16T07:36:13.392971+0000","last_peered":"2024-09-16T07:36:13.392971+0000","last_clean":"2024-09-16T07:36:13.392971+0000","last_became_active":"2024-09-16T07:36:12.313370+0000","last_became_peered":"2024-09-16T07:36:12.313370+0000","last_unstale":"2024-09-16T07:36:13.392971+0000","last_undegraded":"2024-09-16T07:36:13.392971+0000","last_fullsized":"2024-09-16T07:36:13.392971+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:29.141436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.394960+0000","last_change":"2024-09-16T07:36:11.307570+0000","last_active":"2024-09-16T07:36:13.394960+0000","last_peered":"2024-09-16T07:36:13.394960+0000","last_clean":"2024-09-16T07:36:13.394960+0000","last_became_active":"2024-09-16T07:36:11.307177+0000","last_became_peered":"2024-09-16T07:36:11.307177+0000","last_unstale":"2024-09-16T07:36:13.394960+0000","last_undegraded":"2024-09-16T07:36:13.394960+0000","last_fullsized":"2024-09-16T07:36:13.394960+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:12.894192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.393196+0000","last_change":"2024-09-16T07:36:12.318551+0000","last_active":"2024-09-16T07:36:13.393196+0000","last_peered":"2024-09-16T07:36:13.393196+0000","last_clean":"2024-09-16T07:36:13.393196+0000","last_became_active":"2024-09-16T07:36:12.317685+0000","last_became_peered":"2024-09-16T07:36:12.317685+0000","last_unstale":"2024-09-16T07:36:13.393196+0000","last_undegraded":"2024-09-16T07:36:13.393196+0000","last_fullsized":"2024-09-16T07:36:13.393196+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:11.279756+0000","last_clean_scrub_stamp":"2024-09-16T07:36:11.279756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:22:24.931864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389483+0000","last_change":"2024-09-16T07:36:11.298358+0000","last_active":"2024-09-16T07:36:13.389483+0000","last_peered":"2024-09-16T07:36:13.389483+0000","last_clean":"2024-09-16T07:36:13.389483+0000","last_became_active":"2024-09-16T07:36:11.297995+0000","last_became_peered":"2024-09-16T07:36:11.297995+0000","last_unstale":"2024-09-16T07:36:13.389483+0000","last_undegraded":"2024-09-16T07:36:13.389483+0000","last_fullsized":"2024-09-16T07:36:13.389483+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:10.275174+0000","last_clean_scrub_stamp":"2024-09-16T07:36:10.275174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:00.584364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":378,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T07:36:13.389383+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:36:13.389383+0000","last_peered":"2024-09-16T07:36:13.389383+0000","last_clean":"2024-09-16T07:36:13.389383+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:36:13.389383+0000","last_undegraded":"2024-09-16T07:36:13.389383+0000","last_fullsized":"2024-09-16T07:36:13.389383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33632,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338208,"statfs":{"total":96636764160,"available":96602324992,"internally_reserved":0,"allocated":2498560,"data_stored":1423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1896448,"data_stored":833408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33048,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1896448,"data_stored":833408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33064,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338776,"statfs":{"total":96636764160,"available":96602906624,"internally_reserved":0,"allocated":1912832,"data_stored":835602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":833602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542244,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":834102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1908736,"data_stored":835020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33632,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338208,"statfs":{"total":96636764160,"available":96602324992,"internally_reserved":0,"allocated":2494464,"data_stored":1423798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:36:16.820 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:36:16.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:36:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 -- 172.21.15.114:0/4061431924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8b8004810 msgr2=0x7fe8b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 --2- 172.21.15.114:0/4061431924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8b8004810 0x7fe8b8004c90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009d30 tx=0x7fe8bc01d450 comp rx=0 tx=0).stop 2024-09-16T07:36:17.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d3400640 1 -- 172.21.15.114:0/4061431924 reap_dead start 2024-09-16T07:36:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 -- 172.21.15.114:0/4061431924 shutdown_connections 2024-09-16T07:36:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 -- 172.21.15.114:0/4061431924 >> 172.21.15.114:0/4061431924 conn(0x7fe8d40b18f0 msgr2=0x7fe8d40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 -- 172.21.15.114:0/4061431924 shutdown_connections 2024-09-16T07:36:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 -- 172.21.15.114:0/4061431924 wait complete. 2024-09-16T07:36:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 Processor -- start 2024-09-16T07:36:17.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.008+0000 7fe8d9800640 1 -- start start 2024-09-16T07:36:17.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8b8004810 0x7fe8d414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8d41f8bc0 0x7fe8d4073e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d40743a0 0x7fe8d40af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d415bbb0 con 0x7fe8d40743a0 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d40b3130 con 0x7fe8d41f8bc0 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d409aab0 con 0x7fe8b8004810 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d40743a0 0x7fe8d40af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d40743a0 0x7fe8d40af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36826/0 (socket says 172.21.15.114:36826) 2024-09-16T07:36:17.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 -- 172.21.15.114:0/4200482894 learned_addr learned my addr 172.21.15.114:0/4200482894 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d2a00640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8b8004810 0x7fe8d414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 -- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8b8004810 msgr2=0x7fe8d414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8b8004810 0x7fe8d414ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8ca000640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8d41f8bc0 0x7fe8d4073e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 -- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8d41f8bc0 msgr2=0x7fe8d4073e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8d41f8bc0 0x7fe8d4073e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 -- 172.21.15.114:0/4200482894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d40b08e0 con 0x7fe8d40743a0 2024-09-16T07:36:17.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8ca000640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8d41f8bc0 0x7fe8d4073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:17.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d3400640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d40743a0 0x7fe8d40af3e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe8d406db60 tx=0x7fe8cc00f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:17.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8cb400640 1 -- 172.21.15.114:0/4200482894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00fea0 con 0x7fe8d40743a0 2024-09-16T07:36:17.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8cb400640 1 -- 172.21.15.114:0/4200482894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8cc007da0 con 0x7fe8d40743a0 2024-09-16T07:36:17.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d40b0ea0 con 0x7fe8d40743a0 2024-09-16T07:36:17.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8cb400640 1 -- 172.21.15.114:0/4200482894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00a290 con 0x7fe8d40743a0 2024-09-16T07:36:17.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d41f9040 con 0x7fe8d40743a0 2024-09-16T07:36:17.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d4074820 con 0x7fe8d40743a0 2024-09-16T07:36:17.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.012+0000 7fe8cb400640 1 -- 172.21.15.114:0/4200482894 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fe8cc00a430 con 0x7fe8d40743a0 2024-09-16T07:36:17.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.016+0000 7fe8cb400640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe8b0073730 0x7fe8b0075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.016+0000 7fe8cb400640 1 -- 172.21.15.114:0/4200482894 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fe8cc097480 con 0x7fe8d40743a0 2024-09-16T07:36:17.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.016+0000 7fe8d2a00640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe8b0073730 0x7fe8b0075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.016+0000 7fe8d2a00640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe8b0073730 0x7fe8b0075bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4005b50 tx=0x7fe8c40098c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:17.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.020+0000 7fe8cb400640 1 -- 172.21.15.114:0/4200482894 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe8cc061680 con 0x7fe8d40743a0 2024-09-16T07:36:17.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.248+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe8d40b2bf0 con 0x7fe8d40743a0 2024-09-16T07:36:17.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8cb400640 1 -- 172.21.15.114:0/4200482894 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7fe8cc060f80 con 0x7fe8d40743a0 2024-09-16T07:36:17.250 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:36:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:36:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:36:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:36:17.250 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:36:17.251 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:36:17.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe8b0073730 msgr2=0x7fe8b0075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe8b0073730 0x7fe8b0075bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4005b50 tx=0x7fe8c40098c0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d40743a0 msgr2=0x7fe8d40af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d40743a0 0x7fe8d40af3e0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe8d406db60 tx=0x7fe8cc00f820 comp rx=0 tx=0).stop 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 shutdown_connections 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d40743a0 0x7fe8d40af3e0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe8d41f8bc0 0x7fe8d4073e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe8b0073730 0x7fe8b0075bf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 --2- 172.21.15.114:0/4200482894 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe8b8004810 0x7fe8d414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 >> 172.21.15.114:0/4200482894 conn(0x7fe8d40b18f0 msgr2=0x7fe8d40cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 shutdown_connections 2024-09-16T07:36:17.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.252+0000 7fe8d9800640 1 -- 172.21.15.114:0/4200482894 wait complete. 2024-09-16T07:36:17.273 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- 172.21.15.114:0/2236721872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f4005920 msgr2=0x7fa2f4005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 --2- 172.21.15.114:0/2236721872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2f4005920 0x7fa2f4005da0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fa3100cfbb0 tx=0x7fa2f801eeb0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 -- 172.21.15.114:0/2236721872 reap_dead start 2024-09-16T07:36:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- 172.21.15.114:0/2236721872 shutdown_connections 2024-09-16T07:36:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- 172.21.15.114:0/2236721872 >> 172.21.15.114:0/2236721872 conn(0x7fa3100b18f0 msgr2=0x7fa3100b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- 172.21.15.114:0/2236721872 shutdown_connections 2024-09-16T07:36:17.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- 172.21.15.114:0/2236721872 wait complete. 2024-09-16T07:36:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 Processor -- start 2024-09-16T07:36:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- start start 2024-09-16T07:36:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f4005920 0x7fa3101608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3101fc4b0 0x7fa3101f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101f9890 0x7fa3100c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa310166120 con 0x7fa3101f9890 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100cf4e0 con 0x7fa2f4005920 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa317400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa3101662a0 con 0x7fa3101fc4b0 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101f9890 0x7fa3100c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101f9890 0x7fa3100c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36850/0 (socket says 172.21.15.114:36850) 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 -- 172.21.15.114:0/4092358900 learned_addr learned my addr 172.21.15.114:0/4092358900 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa314a00640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f4005920 0x7fa3101608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa307e00640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3101fc4b0 0x7fa3101f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 -- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3101fc4b0 msgr2=0x7fa3101f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3101fc4b0 0x7fa3101f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 -- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f4005920 msgr2=0x7fa3101608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f4005920 0x7fa3101608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 -- 172.21.15.114:0/4092358900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31015b060 con 0x7fa3101f9890 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa314a00640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f4005920 0x7fa3101608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.420+0000 7fa315400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101f9890 0x7fa3100c9020 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fa3100b37a0 tx=0x7fa308006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa30d600640 1 -- 172.21.15.114:0/4092358900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300001480 con 0x7fa3101f9890 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa30d600640 1 -- 172.21.15.114:0/4092358900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa308018070 con 0x7fa3101f9890 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31015b340 con 0x7fa3101f9890 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa30d600640 1 -- 172.21.15.114:0/4092358900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30800fd60 con 0x7fa3101f9890 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31015b900 con 0x7fa3101f9890 2024-09-16T07:36:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310069410 con 0x7fa3101f9890 2024-09-16T07:36:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa30d600640 1 -- 172.21.15.114:0/4092358900 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fa30801d460 con 0x7fa3101f9890 2024-09-16T07:36:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa30d600640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa2ec073730 0x7fa2ec075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa30d600640 1 -- 172.21.15.114:0/4092358900 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fa308095660 con 0x7fa3101f9890 2024-09-16T07:36:17.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa314a00640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa2ec073730 0x7fa2ec075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:17.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.424+0000 7fa314a00640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa2ec073730 0x7fa2ec075bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa300006fd0 tx=0x7fa300006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:17.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.428+0000 7fa30d600640 1 -- 172.21.15.114:0/4092358900 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fa30805f860 con 0x7fa3101f9890 2024-09-16T07:36:17.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.632+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3100ce810 con 0x7fa3101f9890 2024-09-16T07:36:17.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.632+0000 7fa30d600640 1 -- 172.21.15.114:0/4092358900 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5245 (secure 0 0 0) 0x7fa30805f160 con 0x7fa3101f9890 2024-09-16T07:36:17.631 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:17.631 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":113,"btime":"2024-09-16T07:36:15:322996+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3808879086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3808879086},{"type":"v1","addr":"172.21.15.149:6801","nonce":3808879086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3577511191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3577511191},{"type":"v1","addr":"172.21.15.149:6835","nonce":3577511191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1372619733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1372619733},{"type":"v1","addr":"172.21.15.114:6835","nonce":1372619733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:11.697492+0000","modified":"2024-09-16T07:36:14.712190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6834/2318653579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2318653579},{"type":"v1","addr":"172.21.15.114:6834","nonce":2318653579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8796,"qdb_cluster":[8796]},"id":12}]} 2024-09-16T07:36:17.632 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 113 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa2ec073730 msgr2=0x7fa2ec075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa2ec073730 0x7fa2ec075bf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa300006fd0 tx=0x7fa300006b20 comp rx=0 tx=0).stop 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101f9890 msgr2=0x7fa3100c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101f9890 0x7fa3100c9020 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fa3100b37a0 tx=0x7fa308006720 comp rx=0 tx=0).stop 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 shutdown_connections 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3101f9890 0x7fa3100c9020 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa2ec073730 0x7fa2ec075bf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa3101fc4b0 0x7fa3101f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 --2- 172.21.15.114:0/4092358900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa2f4005920 0x7fa3101608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:17.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 >> 172.21.15.114:0/4092358900 conn(0x7fa3100b18f0 msgr2=0x7fa31015a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:17.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 shutdown_connections 2024-09-16T07:36:17.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:17.636+0000 7fa317400640 1 -- 172.21.15.114:0/4092358900 wait complete. 2024-09-16T07:36:18.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 113, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:36:11.697492+0000', 'modified': '2024-09-16T07:36:14.712190+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8796}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8796': {'gid': 8796, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6834/2318653579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6832', 'nonce': 2318653579}, {'type': 'v1', 'addr': '172.21.15.114:6834', 'nonce': 2318653579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8796, 'qdb_cluster': [8796]} 2024-09-16T07:36:18.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:36:18.055 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T07:36:18.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 -- 172.21.15.114:0/3515592772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb0003a60 msgr2=0x7f7fb0003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 --2- 172.21.15.114:0/3515592772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb0003a60 0x7f7fb0003e80 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009b60 tx=0x7f7fbc01d2b0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fcbe00640 1 -- 172.21.15.114:0/3515592772 reap_dead start 2024-09-16T07:36:18.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 -- 172.21.15.114:0/3515592772 shutdown_connections 2024-09-16T07:36:18.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 -- 172.21.15.114:0/3515592772 >> 172.21.15.114:0/3515592772 conn(0x7f7fcc0d1dc0 msgr2=0x7f7fcc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 -- 172.21.15.114:0/3515592772 shutdown_connections 2024-09-16T07:36:18.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 -- 172.21.15.114:0/3515592772 wait complete. 2024-09-16T07:36:18.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 Processor -- start 2024-09-16T07:36:18.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.204+0000 7f7fd2200640 1 -- start start 2024-09-16T07:36:18.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb0003a60 0x7f7fcc15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc1fb4c0 0x7f7fcc1fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc0c90c0 0x7f7fcc0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc166f00 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc166d80 con 0x7f7fb0003a60 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc167080 con 0x7f7fcc1fb4c0 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc0c90c0 0x7f7fcc0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcb400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb0003a60 0x7f7fcc15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc0c90c0 0x7f7fcc0c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36862/0 (socket says 172.21.15.114:36862) 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 -- 172.21.15.114:0/1942082707 learned_addr learned my addr 172.21.15.114:0/1942082707 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc1fb4c0 0x7f7fcc1fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 -- 172.21.15.114:0/1942082707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc1fb4c0 msgr2=0x7f7fcc1fb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc1fb4c0 0x7f7fcc1fb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 -- 172.21.15.114:0/1942082707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb0003a60 msgr2=0x7f7fcc15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb0003a60 0x7f7fcc15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 -- 172.21.15.114:0/1942082707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc0c9dd0 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc0c90c0 0x7f7fcc0c9540 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc074010 tx=0x7f7fc400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fc3400640 1 -- 172.21.15.114:0/1942082707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc400ca10 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fc3400640 1 -- 172.21.15.114:0/1942082707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc4018070 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc0ca0b0 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fc3400640 1 -- 172.21.15.114:0/1942082707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4011460 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.208+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc160ec0 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fc3400640 1 -- 172.21.15.114:0/1942082707 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f7fc4011810 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 Processor -- start 2024-09-16T07:36:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fc3400640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fa8073760 0x7f7fa8075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 -- start start 2024-09-16T07:36:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fc3400640 1 -- 172.21.15.114:0/1942082707 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f7fc4095690 con 0x7f7fcc0c90c0 2024-09-16T07:36:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fa8073760 0x7f7fa8075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fa8073760 0x7f7fa8075c20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc166480 tx=0x7f7fb40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f8d76d63f0 con 0x55f8d78019d0 2024-09-16T07:36:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f8d7613b20 con 0x55f8d78022f0 2024-09-16T07:36:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55f8d7602f50 con 0x55f8d77b5e10 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36874/0 (socket says 172.21.15.114:36874) 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 -- 172.21.15.114:0/785497120 learned_addr learned my addr 172.21.15.114:0/785497120 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 -- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 msgr2=0x55f8d77b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 -- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 msgr2=0x55f8d77b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 -- 172.21.15.114:0/785497120 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d75ca590 con 0x55f8d78019d0 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.212+0000 7f7fcb400640 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801db0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009b60 tx=0x7f7fb0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd3d08a8ef2de62 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fbbe00640 1 -- 172.21.15.114:0/785497120 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0bc070 con 0x55f8d78019d0 2024-09-16T07:36:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fbbe00640 1 -- 172.21.15.114:0/785497120 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fbc004340 con 0x55f8d78019d0 2024-09-16T07:36:18.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fbbe00640 1 -- 172.21.15.114:0/785497120 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0b1040 con 0x55f8d78019d0 2024-09-16T07:36:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- 172.21.15.114:0/785497120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 msgr2=0x55f8d7801db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801db0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009b60 tx=0x7f7fb0005840 comp rx=0 tx=0).stop 2024-09-16T07:36:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- 172.21.15.114:0/785497120 shutdown_connections 2024-09-16T07:36:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 --2- 172.21.15.114:0/785497120 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801db0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- 172.21.15.114:0/785497120 >> 172.21.15.114:0/785497120 conn(0x55f8d769f130 msgr2=0x55f8d77e4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- 172.21.15.114:0/785497120 shutdown_connections 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- 172.21.15.114:0/785497120 wait complete. 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- start start 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 Processor -- start 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d77e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f8d759d5d0 con 0x55f8d78019d0 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f8d7606d60 con 0x55f8d78022f0 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55f8d75a9500 con 0x55f8d77b5e10 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fd5678000 10 client.0 _ll_register_callbacks cb 0x55f8d75ad810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d77e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d77e2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36888/0 (socket says 172.21.15.114:36888) 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 -- 172.21.15.114:0/4143913382 learned_addr learned my addr 172.21.15.114:0/4143913382 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fcb400640 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 -- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 msgr2=0x55f8d77e26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77e26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 -- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 msgr2=0x55f8d77e33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77e33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 -- 172.21.15.114:0/4143913382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d75a1170 con 0x55f8d78019d0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d77e2e70 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40206d0 tx=0x7f7fb4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e79a8ea50beb89 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.216+0000 7f7fb8c00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 1 -- 172.21.15.114:0/4143913382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4004020 con 0x55f8d78019d0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8d759b0f0 con 0x55f8d78019d0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 1 -- 172.21.15.114:0/4143913382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f7fb4018030 con 0x55f8d78019d0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 1 -- 172.21.15.114:0/4143913382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f7fb4033050 con 0x55f8d78019d0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 10 client.8925 fetch_fsmap learned FSMap version 113 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55f8d7687ef0 con 0x55f8d78019d0 2024-09-16T07:36:18.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 1 -- 172.21.15.114:0/4143913382 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f8d759b0f0 con 0x55f8d78019d0 2024-09-16T07:36:18.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 1 -- 172.21.15.114:0/4143913382 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7f7fb4036020 con 0x55f8d78019d0 2024-09-16T07:36:18.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 10 client.8925 fetch_fsmap finished waiting for FSMap version 113 2024-09-16T07:36:18.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 10 client.8925 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:36:18.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 20 client.8925 populate_metadata read hostname 'smithi114' 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d77e40f0 0x55f8d7813c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 4 client.8925 mds_command: new command op to 8796 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 --> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8d7615a70 con 0x55f8d77e40f0 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fcb400640 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d77e40f0 0x55f8d7813c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 10 client.8925 ms_handle_connect on v2:172.21.15.114:6832/2318653579 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fcb400640 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d77e40f0 0x55f8d7813c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88832a5a9498e53b server_cookie=97e6809edc77c48 in_seq=0 out_seq=0 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 1 -- 172.21.15.114:0/4143913382 <== mds.0 v2:172.21.15.114:6832/2318653579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8d7615a70 con 0x55f8d77e40f0 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 10 client.8925 handle_command_reply: tid=0 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 client.8925 shutdown 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 msgr2=0x55f8d77e2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d77e2e70 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40206d0 tx=0x7f7fb4004740 comp rx=0 tx=0).stop 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 shutdown_connections 2024-09-16T07:36:18.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d77e40f0 0x55f8d7813c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78022f0 0x55f8d77e33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d77e2e70 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fb8c00640 0 client.8925 ms_handle_reset on v2:172.21.15.114:6832/2318653579 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 --2- 172.21.15.114:0/4143913382 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d77e26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 >> 172.21.15.114:0/4143913382 conn(0x55f8d769f130 msgr2=0x55f8d77b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 shutdown_connections 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 1 -- 172.21.15.114:0/4143913382 wait complete. 2024-09-16T07:36:18.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.220+0000 7f7fd5678000 20 client.8925 trim_cache size 0 max 16384 2024-09-16T07:36:18.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 Processor -- start 2024-09-16T07:36:18.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- start start 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d77b5e10 0x55f8d7800cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d78022f0 0x55f8d77b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc204b50 con 0x55f8d78019d0 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc203bd0 con 0x55f8d77b5e10 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc161cf0 con 0x55f8d78022f0 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36898/0 (socket says 172.21.15.114:36898) 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 -- 172.21.15.114:0/1314153753 learned_addr learned my addr 172.21.15.114:0/1314153753 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 -- 172.21.15.114:0/1314153753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d78022f0 msgr2=0x55f8d77b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/1314153753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d78022f0 0x55f8d77b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 -- 172.21.15.114:0/1314153753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d77b5e10 msgr2=0x55f8d7800cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/1314153753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d77b5e10 0x55f8d7800cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 -- 172.21.15.114:0/1314153753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d765ed90 con 0x55f8d78019d0 2024-09-16T07:36:18.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/1314153753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801200 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4004300 tx=0x7f7fb40128a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faded02888f0b8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fbb400640 1 -- 172.21.15.114:0/1314153753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4004400 con 0x55f8d78019d0 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fbb400640 1 -- 172.21.15.114:0/1314153753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fb401e040 con 0x55f8d78019d0 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fbb400640 1 -- 172.21.15.114:0/1314153753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb401e830 con 0x55f8d78019d0 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- 172.21.15.114:0/1314153753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 msgr2=0x55f8d7801200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 --2- 172.21.15.114:0/1314153753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801200 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4004300 tx=0x7f7fb40128a0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- 172.21.15.114:0/1314153753 shutdown_connections 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 --2- 172.21.15.114:0/1314153753 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d78022f0 0x55f8d77b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 --2- 172.21.15.114:0/1314153753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78019d0 0x55f8d7801200 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 --2- 172.21.15.114:0/1314153753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d77b5e10 0x55f8d7800cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- 172.21.15.114:0/1314153753 >> 172.21.15.114:0/1314153753 conn(0x55f8d769f130 msgr2=0x55f8d78005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- 172.21.15.114:0/1314153753 shutdown_connections 2024-09-16T07:36:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.240+0000 7f7fd5678000 1 -- 172.21.15.114:0/1314153753 wait complete. 2024-09-16T07:36:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 -- start start 2024-09-16T07:36:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 Processor -- start 2024-09-16T07:36:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d7880410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78019d0 0x55f8d7880950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78022f0 0x55f8d7880e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x55f8d75ceec0 con 0x55f8d78022f0 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc162340 con 0x55f8d78019d0 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x55f8d759d5d0 con 0x55f8d77b5e10 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 10 client.0 _ll_register_callbacks cb 0x7f7fb40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78022f0 0x55f8d7880e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78022f0 0x55f8d7880e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36914/0 (socket says 172.21.15.114:36914) 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 -- 172.21.15.114:0/3283793761 learned_addr learned my addr 172.21.15.114:0/3283793761 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcb400640 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d7880410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fc3e00640 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78019d0 0x55f8d7880950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 -- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 msgr2=0x55f8d7880410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d7880410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 -- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78019d0 msgr2=0x55f8d7880950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78019d0 0x55f8d7880950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 -- 172.21.15.114:0/3283793761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d75c9a90 con 0x55f8d78022f0 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcbe00640 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78022f0 0x55f8d7880e90 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4002240 tx=0x7f7fc40662e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f8dbf814803545 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fb8c00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fb8c00640 1 -- 172.21.15.114:0/3283793761 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc405ed50 con 0x55f8d78022f0 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fb8c00640 1 -- 172.21.15.114:0/3283793761 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f7fc405e6b0 con 0x55f8d78022f0 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb401e040 con 0x55f8d78022f0 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fb8c00640 1 -- 172.21.15.114:0/3283793761 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f7fc4077070 con 0x55f8d78022f0 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 10 client.8931 fetch_fsmap learned FSMap version 113 2024-09-16T07:36:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55f8d75a8050 con 0x55f8d78022f0 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fb8c00640 1 -- 172.21.15.114:0/3283793761 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fb401e040 con 0x55f8d78022f0 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fb8c00640 1 -- 172.21.15.114:0/3283793761 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7f7fc4011b00 con 0x55f8d78022f0 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 10 client.8931 fetch_fsmap finished waiting for FSMap version 113 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 10 client.8931 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 20 client.8931 populate_metadata read hostname 'smithi114' 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d7817080 0x55f8d7816190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 4 client.8931 mds_command: new command op to 8796 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 --> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] -- command(tid 0: {"prefix": "status"}) -- 0x55f8d7611520 con 0x55f8d7817080 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcb400640 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d7817080 0x55f8d7816190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fb8c00640 10 client.8931 ms_handle_connect on v2:172.21.15.114:6832/2318653579 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.244+0000 7f7fcb400640 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d7817080 0x55f8d7816190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca526280a4754d9 server_cookie=e7a1ae13b0d40bde in_seq=0 out_seq=0 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fb8c00640 1 -- 172.21.15.114:0/3283793761 <== mds.0 v2:172.21.15.114:6832/2318653579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55f8d7611520 con 0x55f8d7817080 2024-09-16T07:36:18.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fb8c00640 10 client.8931 handle_command_reply: tid=0 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 client.8931 shutdown 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78022f0 msgr2=0x55f8d7880e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78022f0 0x55f8d7880e90 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4002240 tx=0x7f7fc40662e0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 shutdown_connections 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:6832/2318653579,v1:172.21.15.114:6834/2318653579] conn(0x55f8d7817080 0x55f8d7816190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f8d78022f0 0x55f8d7880e90 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f8d78019d0 0x55f8d7880950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fb8c00640 0 client.8931 ms_handle_reset on v2:172.21.15.114:6832/2318653579 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 --2- 172.21.15.114:0/3283793761 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55f8d77b5e10 0x55f8d7880410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 >> 172.21.15.114:0/3283793761 conn(0x55f8d769f130 msgr2=0x55f8d77b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 shutdown_connections 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 1 -- 172.21.15.114:0/3283793761 wait complete. 2024-09-16T07:36:18.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd5678000 20 client.8931 trim_cache size 0 max 16384 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 8796, 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 5.9617508939999997, 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 113, 2024-09-16T07:36:18.251 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 152, 2024-09-16T07:36:18.252 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 152, 2024-09-16T07:36:18.252 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 10.504298495 2024-09-16T07:36:18.252 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:36:18.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fa8073760 msgr2=0x7f7fa8075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fa8073760 0x7f7fa8075c20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc166480 tx=0x7f7fb40091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc0c90c0 msgr2=0x7f7fcc0c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc0c90c0 0x7f7fcc0c9540 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc074010 tx=0x7f7fc400ecf0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 shutdown_connections 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fcc0c90c0 0x7f7fcc0c9540 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7fa8073760 0x7f7fa8075c20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7fcc1fb4c0 0x7f7fcc1fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 --2- 172.21.15.114:0/1942082707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7fb0003a60 0x7f7fcc15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 >> 172.21.15.114:0/1942082707 conn(0x7f7fcc0d1dc0 msgr2=0x7f7fcc0b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 shutdown_connections 2024-09-16T07:36:18.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.248+0000 7f7fd2200640 1 -- 172.21.15.114:0/1942082707 wait complete. 2024-09-16T07:36:18.254 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-09-16T07:36:18.252+0000 7fcf0a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:36:18.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- 172.21.15.114:0/3923683980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c540d1350 msgr2=0x7f5c540b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 --2- 172.21.15.114:0/3923683980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c540d1350 0x7f5c540b48f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009bc0 tx=0x7f5c4c01cba0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- 172.21.15.114:0/3923683980 shutdown_connections 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 --2- 172.21.15.114:0/3923683980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c540d1350 0x7f5c540b48f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 --2- 172.21.15.114:0/3923683980 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c5415a7e0 0x7f5c540ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- 172.21.15.114:0/3923683980 >> 172.21.15.114:0/3923683980 conn(0x7f5c5406dd30 msgr2=0x7f5c5406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- 172.21.15.114:0/3923683980 shutdown_connections 2024-09-16T07:36:18.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- 172.21.15.114:0/3923683980 wait complete. 2024-09-16T07:36:18.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 Processor -- start 2024-09-16T07:36:18.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- start start 2024-09-16T07:36:18.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c540aea10 0x7f5c540af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c540d1350 0x7f5c540b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c5415a7e0 0x7f5c54149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54168140 con 0x7f5c540d1350 2024-09-16T07:36:18.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54167fc0 con 0x7f5c5415a7e0 2024-09-16T07:36:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c58c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5c541682c0 con 0x7f5c540aea10 2024-09-16T07:36:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c540d1350 0x7f5c540b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c540d1350 0x7f5c540b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36924/0 (socket says 172.21.15.114:36924) 2024-09-16T07:36:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 -- 172.21.15.114:0/1262144357 learned_addr learned my addr 172.21.15.114:0/1262144357 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c51e00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c540aea10 0x7f5c540af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c52800640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c5415a7e0 0x7f5c54149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 -- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c540aea10 msgr2=0x7f5c540af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c540aea10 0x7f5c540af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 -- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c5415a7e0 msgr2=0x7f5c54149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c5415a7e0 0x7f5c54149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c4be00640 1 -- 172.21.15.114:0/1262144357 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5415f7f0 con 0x7f5c540d1350 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.412+0000 7f5c52800640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c5415a7e0 0x7f5c54149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:18.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c4be00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c540d1350 0x7f5c540b00d0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c400 tx=0x7f5c3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c4a000640 1 -- 172.21.15.114:0/1262144357 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c011790 con 0x7f5c540d1350 2024-09-16T07:36:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c4a000640 1 -- 172.21.15.114:0/1262144357 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c3c017070 con 0x7f5c540d1350 2024-09-16T07:36:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c4a000640 1 -- 172.21.15.114:0/1262144357 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c011ce0 con 0x7f5c540d1350 2024-09-16T07:36:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5415fa90 con 0x7f5c540d1350 2024-09-16T07:36:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c54160050 con 0x7f5c540d1350 2024-09-16T07:36:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c540b48f0 con 0x7f5c540d1350 2024-09-16T07:36:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c4a000640 1 -- 172.21.15.114:0/1262144357 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f5c3c01c460 con 0x7f5c540d1350 2024-09-16T07:36:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c4a000640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5c30073730 0x7f5c30075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c4a000640 1 -- 172.21.15.114:0/1262144357 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f5c3c0923b0 con 0x7f5c540d1350 2024-09-16T07:36:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.416+0000 7f5c51e00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5c30073730 0x7f5c30075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.420+0000 7f5c51e00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5c30073730 0x7f5c30075bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009b40 tx=0x7f5c440091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:18.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.420+0000 7f5c4a000640 1 -- 172.21.15.114:0/1262144357 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5c3c05f010 con 0x7f5c540d1350 2024-09-16T07:36:18.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.624+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c5406d860 con 0x7f5c540d1350 2024-09-16T07:36:18.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.624+0000 7f5c4a000640 1 -- 172.21.15.114:0/1262144357 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v113) ==== 53+0+73 (secure 0 0 0) 0x7f5c3c05e910 con 0x7f5c540d1350 2024-09-16T07:36:18.624 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:36:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5c30073730 msgr2=0x7f5c30075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5c30073730 0x7f5c30075bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009b40 tx=0x7f5c440091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c540d1350 msgr2=0x7f5c540b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c540d1350 0x7f5c540b00d0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c400 tx=0x7f5c3c00c8c0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 shutdown_connections 2024-09-16T07:36:18.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5c5415a7e0 0x7f5c54149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c540d1350 0x7f5c540b00d0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5c30073730 0x7f5c30075bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 --2- 172.21.15.114:0/1262144357 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5c540aea10 0x7f5c540af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 >> 172.21.15.114:0/1262144357 conn(0x7f5c5406dd30 msgr2=0x7f5c540b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 shutdown_connections 2024-09-16T07:36:18.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18.628+0000 7f5c58c00640 1 -- 172.21.15.114:0/1262144357 wait complete. 2024-09-16T07:36:18.644 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:36:18.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:36:18.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:36:18.648 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:36:18.649 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:36:18.649 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:36:18.649 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:36:18.649 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:36:18.649 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:36:18.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:18.649 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:36:18.658 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:36:18.659 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41962sec preferred_lft 41962sec 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:36:18.660 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:36:18.661 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:36:18.662 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:18.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:18.663 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:36:18.722 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:36:18.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:18.724 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:36:18.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:36:18.778 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:36:18.778 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:36:18.778 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:36:18.778 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:36:18.779 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:36:18.779 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:36:18.779 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:36:18.779 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:18.779 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:18.779 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:18.779 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:36:18.779 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:36:18.779 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:36:18.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:36:18.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:36:18.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:36:18.780 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:36:18.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:36:18.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:36:18.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:36:18.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:18.920 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:36:18.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:36:18.969 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:36:18.970 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:36:18.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:18.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:36:19.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:36:19.032 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:36:19.084 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:36:19.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:36:19.085 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:36:19.136 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:36:19.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:19.136 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:36:19.225 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:36:19.225 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:36:19.225 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:36:19.240 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:36:19.240 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:36:19.240 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:36:19.241 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:36:19.241 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:36:19.249 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:36:19.249 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:36:19.249 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:36:19.249 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:36:19.249 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:36:19.249 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:36:19.250 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:36:19.250 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:36:19.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:36:19.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:19.253 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:36:19.273 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:36:19.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:36:19.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:36:19.382 INFO:teuthology.orchestra.run.smithi114.stdout:client8937 2024-09-16T07:36:19.382 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:19.383 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:19.392 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:36:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- 172.21.15.114:0/2481336942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa006e810 msgr2=0x7f5aa006f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 --2- 172.21.15.114:0/2481336942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa006e810 0x7f5aa006f1f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009bc0 tx=0x7f5a9c01cb70 comp rx=0 tx=0).stop 2024-09-16T07:36:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- 172.21.15.114:0/2481336942 shutdown_connections 2024-09-16T07:36:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 --2- 172.21.15.114:0/2481336942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa006e810 0x7f5aa006f1f0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 --2- 172.21.15.114:0/2481336942 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa00cf300 0x7f5aa006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- 172.21.15.114:0/2481336942 >> 172.21.15.114:0/2481336942 conn(0x7f5aa00b18f0 msgr2=0x7f5aa00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- 172.21.15.114:0/2481336942 shutdown_connections 2024-09-16T07:36:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- 172.21.15.114:0/2481336942 wait complete. 2024-09-16T07:36:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 Processor -- start 2024-09-16T07:36:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- start start 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa006e810 0x7f5aa0153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa00cf300 0x7f5aa00b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa015ade0 0x7f5aa00b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa0168840 con 0x7f5aa015ade0 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa01686c0 con 0x7f5aa00cf300 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa8800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa01689c0 con 0x7f5aa006e810 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa015ade0 0x7f5aa00b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa015ade0 0x7f5aa00b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36940/0 (socket says 172.21.15.114:36940) 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa6800640 1 -- 172.21.15.114:0/49688115 learned_addr learned my addr 172.21.15.114:0/49688115 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa5e00640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa006e810 0x7f5aa0153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:19.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.576+0000 7f5aa5400640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa00cf300 0x7f5aa00b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa6800640 1 -- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa006e810 msgr2=0x7f5aa0153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa6800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa006e810 0x7f5aa0153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa6800640 1 -- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa00cf300 msgr2=0x7f5aa00b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa6800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa00cf300 0x7f5aa00b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa6800640 1 -- 172.21.15.114:0/49688115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa01542f0 con 0x7f5aa015ade0 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa6800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa015ade0 0x7f5aa00b1220 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0b0040 tx=0x7f5a9c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5a9a000640 1 -- 172.21.15.114:0/49688115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c0b2040 con 0x7f5aa015ade0 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5a9a000640 1 -- 172.21.15.114:0/49688115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a9c004040 con 0x7f5aa015ade0 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5a9a000640 1 -- 172.21.15.114:0/49688115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c004430 con 0x7f5aa015ade0 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa0154800 con 0x7f5aa015ade0 2024-09-16T07:36:19.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa009ad90 con 0x7f5aa015ade0 2024-09-16T07:36:19.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa00cebf0 con 0x7f5aa015ade0 2024-09-16T07:36:19.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.580+0000 7f5a9a000640 1 -- 172.21.15.114:0/49688115 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f5a9c0bd030 con 0x7f5aa015ade0 2024-09-16T07:36:19.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.584+0000 7f5a9a000640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a84073730 0x7f5a84075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:19.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.584+0000 7f5a9a000640 1 -- 172.21.15.114:0/49688115 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f5a9c12ec00 con 0x7f5aa015ade0 2024-09-16T07:36:19.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.584+0000 7f5aa5e00640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a84073730 0x7f5a84075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:19.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.584+0000 7f5aa5e00640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a84073730 0x7f5a84075bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5a94001870 tx=0x7f5a94001380 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:19.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.588+0000 7f5a9a000640 1 -- 172.21.15.114:0/49688115 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5a9c130e20 con 0x7f5aa015ade0 2024-09-16T07:36:19.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.788+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5aa00b2010 con 0x7f5aa015ade0 2024-09-16T07:36:19.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.788+0000 7f5a9a000640 1 -- 172.21.15.114:0/49688115 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v113) ==== 53+0+73 (secure 0 0 0) 0x7f5a9c0c4060 con 0x7f5aa015ade0 2024-09-16T07:36:19.789 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:36:19.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a84073730 msgr2=0x7f5a84075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:19.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a84073730 0x7f5a84075bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5a94001870 tx=0x7f5a94001380 comp rx=0 tx=0).stop 2024-09-16T07:36:19.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa015ade0 msgr2=0x7f5aa00b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:19.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa015ade0 0x7f5aa00b1220 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0b0040 tx=0x7f5a9c005b00 comp rx=0 tx=0).stop 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 shutdown_connections 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aa015ade0 0x7f5aa00b1220 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5aa00cf300 0x7f5aa00b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5a84073730 0x7f5a84075bf0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 --2- 172.21.15.114:0/49688115 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5aa006e810 0x7f5aa0153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 >> 172.21.15.114:0/49688115 conn(0x7f5aa00b18f0 msgr2=0x7f5aa0155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 shutdown_connections 2024-09-16T07:36:19.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:19.792+0000 7f5aa8800640 1 -- 172.21.15.114:0/49688115 wait complete. 2024-09-16T07:36:19.814 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:36:19.814 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:36:19.814 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:36:19.814 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:36:19.814 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:36:19.815 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:36:19.815 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:36:19.815 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:36:19.815 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:36:19.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:19.815 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:36:19.825 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:19.826 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 41970sec preferred_lft 41970sec 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:36:19.827 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:36:19.828 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:19.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:19.830 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:36:19.893 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:36:19.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:19.896 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:19.955 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:36:19.956 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:36:19.956 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:36:19.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:36:19.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:36:19.956 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:36:19.956 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:36:20.048 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:36:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:36:20.090 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:36:20.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:20.097 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:36:20.106 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:36:20.107 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:36:20.107 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:36:20.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:20.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:36:20.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:36:20.173 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:36:20.222 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:36:20.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:36:20.222 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:36:20.273 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:36:20.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:20.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:36:20.368 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:36:20.368 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:36:20.368 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:36:20.383 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:36:20.383 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:36:20.383 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:36:20.384 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:36:20.384 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:36:20.392 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:36:20.396 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:36:20.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:20.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:36:20.416 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:36:20.509 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:36:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:36:20.513 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:36:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:36:20.519 INFO:teuthology.orchestra.run.smithi149.stdout:client8949 2024-09-16T07:36:20.520 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:20.520 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:20.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:36:20.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- 172.21.15.114:0/1037115481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd34c004b50 msgr2=0x7fd34c004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 --2- 172.21.15.114:0/1037115481 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd34c004b50 0x7fd34c004f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd35800c2e0 tx=0x7fd35801f740 comp rx=0 tx=0).stop 2024-09-16T07:36:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd367400640 1 -- 172.21.15.114:0/1037115481 reap_dead start 2024-09-16T07:36:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- 172.21.15.114:0/1037115481 shutdown_connections 2024-09-16T07:36:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- 172.21.15.114:0/1037115481 >> 172.21.15.114:0/1037115481 conn(0x7fd3680cfbc0 msgr2=0x7fd3680cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- 172.21.15.114:0/1037115481 shutdown_connections 2024-09-16T07:36:20.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- 172.21.15.114:0/1037115481 wait complete. 2024-09-16T07:36:20.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 Processor -- start 2024-09-16T07:36:20.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- start start 2024-09-16T07:36:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd34c004b50 0x7fd3680b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3681f69c0 0x7fd36809d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3681465c0 0x7fd3681f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:20.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680cdc40 con 0x7fd34c004b50 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3680cdac0 con 0x7fd3681465c0 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd36de00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd3680cddc0 con 0x7fd3681f69c0 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd366a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd34c004b50 0x7fd3680b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.728+0000 7fd366a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd34c004b50 0x7fd3680b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36956/0 (socket says 172.21.15.114:36956) 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd366a00640 1 -- 172.21.15.114:0/3571804792 learned_addr learned my addr 172.21.15.114:0/3571804792 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd35fe00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3681f69c0 0x7fd36809d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd367400640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3681465c0 0x7fd3681f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd366a00640 1 -- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3681f69c0 msgr2=0x7fd36809d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd366a00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3681f69c0 0x7fd36809d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd366a00640 1 -- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3681465c0 msgr2=0x7fd3681f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:20.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd366a00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3681465c0 0x7fd3681f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd366a00640 1 -- 172.21.15.114:0/3571804792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3681e5f10 con 0x7fd34c004b50 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd35fe00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3681f69c0 0x7fd36809d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd367400640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3681465c0 0x7fd3681f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd366a00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd34c004b50 0x7fd3680b51d0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd35801e010 tx=0x7fd358006c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd35f400640 1 -- 172.21.15.114:0/3571804792 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b3070 con 0x7fd34c004b50 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd35f400640 1 -- 172.21.15.114:0/3571804792 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd358003600 con 0x7fd34c004b50 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3681e61b0 con 0x7fd34c004b50 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd35f400640 1 -- 172.21.15.114:0/3571804792 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd358003a50 con 0x7fd34c004b50 2024-09-16T07:36:20.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3680b49d0 con 0x7fd34c004b50 2024-09-16T07:36:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd368069410 con 0x7fd34c004b50 2024-09-16T07:36:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.732+0000 7fd35f400640 1 -- 172.21.15.114:0/3571804792 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fd358003bf0 con 0x7fd34c004b50 2024-09-16T07:36:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.736+0000 7fd35f400640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd344073730 0x7fd344075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.736+0000 7fd35f400640 1 -- 172.21.15.114:0/3571804792 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fd358132c30 con 0x7fd34c004b50 2024-09-16T07:36:20.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.736+0000 7fd35fe00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd344073730 0x7fd344075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:20.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.736+0000 7fd35fe00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd344073730 0x7fd344075bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b4620 tx=0x7fd350006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:20.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.740+0000 7fd35f400640 1 -- 172.21.15.114:0/3571804792 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd3580194f0 con 0x7fd34c004b50 2024-09-16T07:36:20.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:20.940+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fd3680d0850 con 0x7fd34c004b50 2024-09-16T07:36:21.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.344+0000 7fd35f400640 1 -- 172.21.15.114:0/3571804792 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v114) ==== 136+0+0 (secure 0 0 0) 0x7fd3580fd240 con 0x7fd34c004b50 2024-09-16T07:36:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd344073730 msgr2=0x7fd344075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd344073730 0x7fd344075bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd3680b4620 tx=0x7fd350006b80 comp rx=0 tx=0).stop 2024-09-16T07:36:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd34c004b50 msgr2=0x7fd3680b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd34c004b50 0x7fd3680b51d0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd35801e010 tx=0x7fd358006c60 comp rx=0 tx=0).stop 2024-09-16T07:36:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 shutdown_connections 2024-09-16T07:36:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3681465c0 0x7fd3681f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd344073730 0x7fd344075bf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd3681f69c0 0x7fd36809d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 --2- 172.21.15.114:0/3571804792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd34c004b50 0x7fd3680b51d0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 >> 172.21.15.114:0/3571804792 conn(0x7fd3680cfbc0 msgr2=0x7fd36815bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:21.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 shutdown_connections 2024-09-16T07:36:21.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.348+0000 7fd36de00640 1 -- 172.21.15.114:0/3571804792 wait complete. 2024-09-16T07:36:21.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:36:21.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- 172.21.15.114:0/3002825717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 msgr2=0x7f30640ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 --2- 172.21.15.114:0/3002825717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640ce670 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f30640cc3a0 tx=0x7f305401c830 comp rx=0 tx=0).stop 2024-09-16T07:36:21.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- 172.21.15.114:0/3002825717 shutdown_connections 2024-09-16T07:36:21.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 --2- 172.21.15.114:0/3002825717 >> v2:172.21.15.149:3300/0 conn(0x7f30640d28e0 0x7f30640cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 --2- 172.21.15.114:0/3002825717 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640ce670 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- 172.21.15.114:0/3002825717 >> 172.21.15.114:0/3002825717 conn(0x7f30640d1dc0 msgr2=0x7f30640d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:21.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- 172.21.15.114:0/3002825717 shutdown_connections 2024-09-16T07:36:21.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- 172.21.15.114:0/3002825717 wait complete. 2024-09-16T07:36:21.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 Processor -- start 2024-09-16T07:36:21.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- start start 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30640cdb30 0x7f30641f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30640d28e0 0x7f3064157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3064168fc0 con 0x7f306415bea0 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3064168e40 con 0x7f30640d28e0 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3069800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3064169140 con 0x7f30640cdb30 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3063400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3062a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30640cdb30 0x7f30641f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3063400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36970/0 (socket says 172.21.15.114:36970) 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f3063400640 1 -- 172.21.15.114:0/2314253193 learned_addr learned my addr 172.21.15.114:0/2314253193 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.516+0000 7f305be00640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30640d28e0 0x7f3064157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3063400640 1 -- 172.21.15.114:0/2314253193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30640cdb30 msgr2=0x7f30641f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3063400640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30640cdb30 0x7f30641f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3063400640 1 -- 172.21.15.114:0/2314253193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30640d28e0 msgr2=0x7f3064157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3063400640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30640d28e0 0x7f3064157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3063400640 1 -- 172.21.15.114:0/2314253193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30640b7240 con 0x7f306415bea0 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3063400640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640b22d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f305c00dad0 tx=0x7f305c00df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f305aa00640 1 -- 172.21.15.114:0/2314253193 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c017070 con 0x7f306415bea0 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f305aa00640 1 -- 172.21.15.114:0/2314253193 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f305c004b30 con 0x7f306415bea0 2024-09-16T07:36:21.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f305aa00640 1 -- 172.21.15.114:0/2314253193 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c005020 con 0x7f306415bea0 2024-09-16T07:36:21.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30640c8a20 con 0x7f306415bea0 2024-09-16T07:36:21.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30640b5b50 con 0x7f306415bea0 2024-09-16T07:36:21.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30640cc9d0 con 0x7f306415bea0 2024-09-16T07:36:21.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f305aa00640 1 -- 172.21.15.114:0/2314253193 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f305c0051c0 con 0x7f306415bea0 2024-09-16T07:36:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.520+0000 7f305aa00640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3040073730 0x7f3040075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.524+0000 7f305aa00640 1 -- 172.21.15.114:0/2314253193 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f305c095450 con 0x7f306415bea0 2024-09-16T07:36:21.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.524+0000 7f3062a00640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3040073730 0x7f3040075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.524+0000 7f3062a00640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3040073730 0x7f3040075bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f30540af000 tx=0x7f30540a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.524+0000 7f305aa00640 1 -- 172.21.15.114:0/2314253193 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f305c020070 con 0x7f306415bea0 2024-09-16T07:36:21.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.716+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f30640b08f0 con 0x7f3040073730 2024-09-16T07:36:21.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.716+0000 7f305aa00640 1 -- 172.21.15.114:0/2314253193 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f30640b08f0 con 0x7f3040073730 2024-09-16T07:36:21.716 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:36:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:36:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:21.717 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:36:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3040073730 msgr2=0x7f3040075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3040073730 0x7f3040075bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f30540af000 tx=0x7f30540a7040 comp rx=0 tx=0).stop 2024-09-16T07:36:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 msgr2=0x7f30640b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640b22d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f305c00dad0 tx=0x7f305c00df90 comp rx=0 tx=0).stop 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 shutdown_connections 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f306415bea0 0x7f30640b22d0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30640d28e0 0x7f3064157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3040073730 0x7f3040075bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 --2- 172.21.15.114:0/2314253193 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30640cdb30 0x7f30641f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 >> 172.21.15.114:0/2314253193 conn(0x7f30640d1dc0 msgr2=0x7f3064070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 shutdown_connections 2024-09-16T07:36:21.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.720+0000 7f3069800640 1 -- 172.21.15.114:0/2314253193 wait complete. 2024-09-16T07:36:21.737 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:36:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.884+0000 7fd35b400640 1 -- 172.21.15.114:0/2700022737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd338004810 msgr2=0x7fd338004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.884+0000 7fd35b400640 1 --2- 172.21.15.114:0/2700022737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd338004810 0x7fd338004c90 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009b90 tx=0x7fd33c01d2b0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.884+0000 7fd359400640 1 -- 172.21.15.114:0/2700022737 reap_dead start 2024-09-16T07:36:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.884+0000 7fd35b400640 1 -- 172.21.15.114:0/2700022737 shutdown_connections 2024-09-16T07:36:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.884+0000 7fd35b400640 1 -- 172.21.15.114:0/2700022737 >> 172.21.15.114:0/2700022737 conn(0x7fd3540b18f0 msgr2=0x7fd3540b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.884+0000 7fd35b400640 1 -- 172.21.15.114:0/2700022737 shutdown_connections 2024-09-16T07:36:21.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.884+0000 7fd35b400640 1 -- 172.21.15.114:0/2700022737 wait complete. 2024-09-16T07:36:21.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 Processor -- start 2024-09-16T07:36:21.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 -- start start 2024-09-16T07:36:21.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd338004810 0x7fd35414a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd35409c7e0 0x7fd35409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35406f630 0x7fd35406fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd3540cc6d0 con 0x7fd35406f630 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3540cc550 con 0x7fd35409c7e0 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd3540cc850 con 0x7fd338004810 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35406f630 0x7fd35406fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35406f630 0x7fd35406fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37000/0 (socket says 172.21.15.114:37000) 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 -- 172.21.15.114:0/4173059426 learned_addr learned my addr 172.21.15.114:0/4173059426 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd34be00640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd35409c7e0 0x7fd35409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd358a00640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd338004810 0x7fd35414a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 -- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd338004810 msgr2=0x7fd35414a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd338004810 0x7fd35414a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 -- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd35409c7e0 msgr2=0x7fd35409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd35409c7e0 0x7fd35409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 -- 172.21.15.114:0/4173059426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd354151710 con 0x7fd35406f630 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd34be00640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd35409c7e0 0x7fd35409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd358a00640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd338004810 0x7fd35414a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd359400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35406f630 0x7fd35406fae0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fd3540cbe80 tx=0x7fd34c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd351600640 1 -- 172.21.15.114:0/4173059426 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c004b30 con 0x7fd35406f630 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd351600640 1 -- 172.21.15.114:0/4173059426 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd34c004cd0 con 0x7fd35406f630 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35409abb0 con 0x7fd35406f630 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd351600640 1 -- 172.21.15.114:0/4173059426 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34c003be0 con 0x7fd35406f630 2024-09-16T07:36:21.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.888+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35409b170 con 0x7fd35406f630 2024-09-16T07:36:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.892+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3540b2bf0 con 0x7fd35406f630 2024-09-16T07:36:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.892+0000 7fd351600640 1 -- 172.21.15.114:0/4173059426 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fd34c004030 con 0x7fd35406f630 2024-09-16T07:36:21.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.892+0000 7fd351600640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd330073760 0x7fd330075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.892+0000 7fd351600640 1 -- 172.21.15.114:0/4173059426 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fd34c03a070 con 0x7fd35406f630 2024-09-16T07:36:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.892+0000 7fd358a00640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd330073760 0x7fd330075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:21.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.892+0000 7fd358a00640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd330073760 0x7fd330075c20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd344001580 tx=0x7fd3440067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:21.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:21.896+0000 7fd351600640 1 -- 172.21.15.114:0/4173059426 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd34c05fc10 con 0x7fd35406f630 2024-09-16T07:36:22.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.064+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd35415c7d0 con 0x7fd35406f630 2024-09-16T07:36:22.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.064+0000 7fd351600640 1 -- 172.21.15.114:0/4173059426 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fd34c05f510 con 0x7fd35406f630 2024-09-16T07:36:22.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd330073760 msgr2=0x7fd330075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd330073760 0x7fd330075c20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd344001580 tx=0x7fd3440067b0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35406f630 msgr2=0x7fd35406fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35406f630 0x7fd35406fae0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fd3540cbe80 tx=0x7fd34c00f3c0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 shutdown_connections 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd35406f630 0x7fd35406fae0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd35409c7e0 0x7fd35409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd330073760 0x7fd330075c20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 --2- 172.21.15.114:0/4173059426 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd338004810 0x7fd35414a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 >> 172.21.15.114:0/4173059426 conn(0x7fd3540b18f0 msgr2=0x7fd35415da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 shutdown_connections 2024-09-16T07:36:22.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.068+0000 7fd35b400640 1 -- 172.21.15.114:0/4173059426 wait complete. 2024-09-16T07:36:22.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:22.085 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol48880/89ed8dee-1571-4de8-b653-217b77300505) 2024-09-16T07:36:22.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:22.112 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:36:22.162 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:36:22.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:22.163 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol48880/89ed8dee-1571-4de8-b653-217b77300505) 2024-09-16T07:36:22.229 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:22.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol48880/.meta 2024-09-16T07:36:22.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:22.301 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp80060/subvol37701/74fa3b45-11cc-4e2b-baab-d966dd847473) 2024-09-16T07:36:22.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:22.367 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:36:22.418 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:36:22.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:22.418 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp80060/subvol37701/74fa3b45-11cc-4e2b-baab-d966dd847473) 2024-09-16T07:36:22.486 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:22.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp80060/subvol37701/.meta 2024-09-16T07:36:22.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol48880 2024-09-16T07:36:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 -- 172.21.15.114:0/1317725678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380b43d0 msgr2=0x7f47380b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 --2- 172.21.15.114:0/1317725678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380b43d0 0x7f47380b47b0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f47380cfbb0 tx=0x7f472801dbc0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 -- 172.21.15.114:0/1317725678 shutdown_connections 2024-09-16T07:36:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 --2- 172.21.15.114:0/1317725678 >> v2:172.21.15.149:3300/0 conn(0x7f47380cd100 0x7f473806e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 --2- 172.21.15.114:0/1317725678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380b43d0 0x7f47380b47b0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 -- 172.21.15.114:0/1317725678 >> 172.21.15.114:0/1317725678 conn(0x7f47380b18f0 msgr2=0x7f47380b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 -- 172.21.15.114:0/1317725678 shutdown_connections 2024-09-16T07:36:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.740+0000 7f473f000640 1 -- 172.21.15.114:0/1317725678 wait complete. 2024-09-16T07:36:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 Processor -- start 2024-09-16T07:36:22.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 -- start start 2024-09-16T07:36:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47380b2bf0 0x7f473813e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47380b43d0 0x7f47381546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380cd100 0x7f473815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f47381672c0 con 0x7f47380cd100 2024-09-16T07:36:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f473815b830 con 0x7f47380b2bf0 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4738167440 con 0x7f47380b43d0 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380cd100 0x7f473815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380cd100 0x7f473815bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37024/0 (socket says 172.21.15.114:37024) 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 -- 172.21.15.114:0/3724280585 learned_addr learned my addr 172.21.15.114:0/3724280585 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f472f400640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47380b43d0 0x7f47381546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f4737e00640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47380b2bf0 0x7f473813e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 -- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47380b43d0 msgr2=0x7f47381546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47380b43d0 0x7f47381546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 -- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47380b2bf0 msgr2=0x7f473813e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47380b2bf0 0x7f473813e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 -- 172.21.15.114:0/3724280585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4738153630 con 0x7f47380cd100 2024-09-16T07:36:22.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f472f400640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47380b43d0 0x7f47381546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473d000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380cd100 0x7f473815bad0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f473000c780 tx=0x7f473000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f4734c00640 1 -- 172.21.15.114:0/3724280585 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730016020 con 0x7f47380cd100 2024-09-16T07:36:22.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f4734c00640 1 -- 172.21.15.114:0/3724280585 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f473000ab20 con 0x7f47380cd100 2024-09-16T07:36:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f4734c00640 1 -- 172.21.15.114:0/3724280585 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473000ce30 con 0x7f47380cd100 2024-09-16T07:36:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.744+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4738153910 con 0x7f47380cd100 2024-09-16T07:36:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.748+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4738153ed0 con 0x7f47380cd100 2024-09-16T07:36:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.748+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4738069410 con 0x7f47380cd100 2024-09-16T07:36:22.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.748+0000 7f4734c00640 1 -- 172.21.15.114:0/3724280585 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f4730019020 con 0x7f47380cd100 2024-09-16T07:36:22.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.748+0000 7f4734c00640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4714073730 0x7f4714075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:22.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.748+0000 7f4734c00640 1 -- 172.21.15.114:0/3724280585 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f4730094f80 con 0x7f47380cd100 2024-09-16T07:36:22.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.748+0000 7f4737e00640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4714073730 0x7f4714075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:22.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.752+0000 7f4737e00640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4714073730 0x7f4714075bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f47280b0000 tx=0x7f472801c400 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:22.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.756+0000 7f4734c00640 1 -- 172.21.15.114:0/3724280585 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4730020030 con 0x7f47380cd100 2024-09-16T07:36:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:22.948+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol48880", "target": ["mon-mgr", ""]}) -- 0x7f47380729a0 con 0x7f4714073730 2024-09-16T07:36:22.952 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:22.952+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:22.953 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:22.952+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:22.953 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:22.952+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:22.953 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:22.952+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:22.953 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:22.952+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.000+0000 7f4734c00640 1 -- 172.21.15.114:0/3724280585 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f47380729a0 con 0x7f4714073730 2024-09-16T07:36:23.001 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/_nogroup/subvol48880/89ed8dee-1571-4de8-b653-217b77300505 2024-09-16T07:36:23.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4714073730 msgr2=0x7f4714075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4714073730 0x7f4714075bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f47280b0000 tx=0x7f472801c400 comp rx=0 tx=0).stop 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380cd100 msgr2=0x7f473815bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380cd100 0x7f473815bad0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f473000c780 tx=0x7f473000cc40 comp rx=0 tx=0).stop 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 shutdown_connections 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47380cd100 0x7f473815bad0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4714073730 0x7f4714075bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f47380b43d0 0x7f47381546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 --2- 172.21.15.114:0/3724280585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47380b2bf0 0x7f473813e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 >> 172.21.15.114:0/3724280585 conn(0x7f47380b18f0 msgr2=0x7f473814c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 shutdown_connections 2024-09-16T07:36:23.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.004+0000 7f473f000640 1 -- 172.21.15.114:0/3724280585 wait complete. 2024-09-16T07:36:23.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol37701 subvol_grp80060 2024-09-16T07:36:23.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- 172.21.15.114:0/2259590114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980734f0 msgr2=0x7fcf9815a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 --2- 172.21.15.114:0/2259590114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980734f0 0x7fcf9815a9d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009bc0 tx=0x7fcf8801ca00 comp rx=0 tx=0).stop 2024-09-16T07:36:23.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- 172.21.15.114:0/2259590114 shutdown_connections 2024-09-16T07:36:23.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 --2- 172.21.15.114:0/2259590114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980734f0 0x7fcf9815a9d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- 172.21.15.114:0/2259590114 >> 172.21.15.114:0/2259590114 conn(0x7fcf980cfbc0 msgr2=0x7fcf980cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:23.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- 172.21.15.114:0/2259590114 shutdown_connections 2024-09-16T07:36:23.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- 172.21.15.114:0/2259590114 wait complete. 2024-09-16T07:36:23.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 Processor -- start 2024-09-16T07:36:23.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- start start 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf980734f0 0x7fcf9809d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980cea60 0x7fcf980b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf980cf440 0x7fcf980b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9806fc40 con 0x7fcf980cf440 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9806fac0 con 0x7fcf980cea60 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf9da00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9806fdc0 con 0x7fcf980734f0 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf980cf440 0x7fcf980b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf980cf440 0x7fcf980b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37048/0 (socket says 172.21.15.114:37048) 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 -- 172.21.15.114:0/1206088318 learned_addr learned my addr 172.21.15.114:0/1206088318 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf8e000640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980cea60 0x7fcf980b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf96a00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf980734f0 0x7fcf9809d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:23.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 -- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf980734f0 msgr2=0x7fcf9809d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf980734f0 0x7fcf9809d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 -- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980cea60 msgr2=0x7fcf980b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980cea60 0x7fcf980b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.168+0000 7fcf97400640 1 -- 172.21.15.114:0/1206088318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9809ad50 con 0x7fcf980cf440 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf8e000640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980cea60 0x7fcf980b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf97400640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf980cf440 0x7fcf980b5240 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c530 tx=0x7fcf9000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf8f400640 1 -- 172.21.15.114:0/1206088318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90016020 con 0x7fcf980cf440 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf8f400640 1 -- 172.21.15.114:0/1206088318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf90012920 con 0x7fcf980cf440 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9809b030 con 0x7fcf980cf440 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf8f400640 1 -- 172.21.15.114:0/1206088318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90012d70 con 0x7fcf980cf440 2024-09-16T07:36:23.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9809b5f0 con 0x7fcf980cf440 2024-09-16T07:36:23.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf98069410 con 0x7fcf980cf440 2024-09-16T07:36:23.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf8f400640 1 -- 172.21.15.114:0/1206088318 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7fcf90019020 con 0x7fcf980cf440 2024-09-16T07:36:23.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf8f400640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf74073730 0x7fcf74075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf8f400640 1 -- 172.21.15.114:0/1206088318 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fcf90095350 con 0x7fcf980cf440 2024-09-16T07:36:23.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.172+0000 7fcf96a00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf74073730 0x7fcf74075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:23.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.176+0000 7fcf96a00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf74073730 0x7fcf74075bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf880af000 tx=0x7fcf8801b240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.176+0000 7fcf8f400640 1 -- 172.21.15.114:0/1206088318 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcf90020030 con 0x7fcf980cf440 2024-09-16T07:36:23.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.372+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol37701", "group_name": "subvol_grp80060", "target": ["mon-mgr", ""]}) -- 0x7fcf9815a9d0 con 0x7fcf74073730 2024-09-16T07:36:23.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.420+0000 7fcf8f400640 1 -- 172.21.15.114:0/1206088318 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7fcf9815a9d0 con 0x7fcf74073730 2024-09-16T07:36:23.420 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp80060/subvol37701/74fa3b45-11cc-4e2b-baab-d966dd847473 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf74073730 msgr2=0x7fcf74075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf74073730 0x7fcf74075bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcf880af000 tx=0x7fcf8801b240 comp rx=0 tx=0).stop 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf980cf440 msgr2=0x7fcf980b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf980cf440 0x7fcf980b5240 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c530 tx=0x7fcf9000c9f0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 shutdown_connections 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf980cf440 0x7fcf980b5240 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf980cea60 0x7fcf980b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fcf74073730 0x7fcf74075bf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 --2- 172.21.15.114:0/1206088318 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcf980734f0 0x7fcf9809d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 >> 172.21.15.114:0/1206088318 conn(0x7fcf980cfbc0 msgr2=0x7fcf98070060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:23.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 shutdown_connections 2024-09-16T07:36:23.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.424+0000 7fcf9da00640 1 -- 172.21.15.114:0/1206088318 wait complete. 2024-09-16T07:36:23.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:23.441 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol48880/.meta) 2024-09-16T07:36:23.462 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:36:23.462 INFO:teuthology.orchestra.run.smithi114.stdout:version = 2 2024-09-16T07:36:23.462 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:36:23.462 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/_nogroup/subvol48880/89ed8dee-1571-4de8-b653-217b77300505 2024-09-16T07:36:23.462 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:36:23.462 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:23.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:23.464 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp80060/subvol37701/.meta) 2024-09-16T07:36:23.523 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:36:23.523 INFO:teuthology.orchestra.run.smithi114.stdout:version = 2 2024-09-16T07:36:23.523 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:36:23.523 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/subvol_grp80060/subvol37701/74fa3b45-11cc-4e2b-baab-d966dd847473 2024-09-16T07:36:23.524 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:36:23.524 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:23.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol48880 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 -- 172.21.15.114:0/2854280017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 msgr2=0x7f8558073c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 --2- 172.21.15.114:0/2854280017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558073c80 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f8544009840 tx=0x7f854401c7f0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 -- 172.21.15.114:0/2854280017 shutdown_connections 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 --2- 172.21.15.114:0/2854280017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558073c80 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 --2- 172.21.15.114:0/2854280017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f855815be10 0x7f85581602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 -- 172.21.15.114:0/2854280017 >> 172.21.15.114:0/2854280017 conn(0x7f85580cd740 msgr2=0x7f85580cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 -- 172.21.15.114:0/2854280017 shutdown_connections 2024-09-16T07:36:23.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.712+0000 7f855f600640 1 -- 172.21.15.114:0/2854280017 wait complete. 2024-09-16T07:36:23.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 Processor -- start 2024-09-16T07:36:23.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 -- start start 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f855806cc20 0x7f8558165d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558166270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f855815be10 0x7f85580b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8558169750 con 0x7f85580cbeb0 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85581695d0 con 0x7f855815be10 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f85581698d0 con 0x7f855806cc20 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558166270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558166270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37080/0 (socket says 172.21.15.114:37080) 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 -- 172.21.15.114:0/1001459333 learned_addr learned my addr 172.21.15.114:0/1001459333 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 -- 172.21.15.114:0/1001459333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f855806cc20 msgr2=0x7f8558165d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f855806cc20 0x7f8558165d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 -- 172.21.15.114:0/1001459333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f855815be10 msgr2=0x7f85580b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f855815be10 0x7f85580b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 -- 172.21.15.114:0/1001459333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855815b240 con 0x7f85580cbeb0 2024-09-16T07:36:23.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8557e00640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558166270 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f8544009790 tx=0x7f8544004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8554c00640 1 -- 172.21.15.114:0/1001459333 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85440b2040 con 0x7f85580cbeb0 2024-09-16T07:36:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8554c00640 1 -- 172.21.15.114:0/1001459333 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8544003600 con 0x7f85580cbeb0 2024-09-16T07:36:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f8554c00640 1 -- 172.21.15.114:0/1001459333 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544003a30 con 0x7f85580cbeb0 2024-09-16T07:36:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855815af60 con 0x7f85580cbeb0 2024-09-16T07:36:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.716+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85580b1520 con 0x7f85580cbeb0 2024-09-16T07:36:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.720+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85580b6a30 con 0x7f85580cbeb0 2024-09-16T07:36:23.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.720+0000 7f8554c00640 1 -- 172.21.15.114:0/1001459333 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f85440bd060 con 0x7f85580cbeb0 2024-09-16T07:36:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.720+0000 7f8554c00640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8538073760 0x7f8538075c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:23.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.720+0000 7f8554c00640 1 -- 172.21.15.114:0/1001459333 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f854412e660 con 0x7f85580cbeb0 2024-09-16T07:36:23.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.720+0000 7f855cc00640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8538073760 0x7f8538075c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:23.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.720+0000 7f855cc00640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8538073760 0x7f8538075c20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f85580cad60 tx=0x7f854c006c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:23.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.724+0000 7f8554c00640 1 -- 172.21.15.114:0/1001459333 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8544016410 con 0x7f85580cbeb0 2024-09-16T07:36:23.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.916+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol48880", "target": ["mon-mgr", ""]}) -- 0x7f8558073c80 con 0x7f8538073760 2024-09-16T07:36:23.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.932+0000 7f8554c00640 1 -- 172.21.15.114:0/1001459333 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8558073c80 con 0x7f8538073760 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8538073760 msgr2=0x7f8538075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8538073760 0x7f8538075c20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f85580cad60 tx=0x7f854c006c00 comp rx=0 tx=0).stop 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 msgr2=0x7f8558166270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558166270 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f8544009790 tx=0x7f8544004040 comp rx=0 tx=0).stop 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 shutdown_connections 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f855815be10 0x7f85580b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85580cbeb0 0x7f8558166270 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8538073760 0x7f8538075c20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 --2- 172.21.15.114:0/1001459333 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f855806cc20 0x7f8558165d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:23.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 >> 172.21.15.114:0/1001459333 conn(0x7f85580cd740 msgr2=0x7f8558153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:23.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 shutdown_connections 2024-09-16T07:36:23.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:23.936+0000 7f855f600640 1 -- 172.21.15.114:0/1001459333 wait complete. 2024-09-16T07:36:23.937 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.940+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.937 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.940+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.937 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.940+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.937 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.940+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.938 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.940+0000 7f4e15600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.955 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.956+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.955 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.956+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.955 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.956+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.955 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.956+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.955 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:36:23.956+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:36:23.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol37701 subvol_grp80060 2024-09-16T07:36:24.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.108+0000 7f096a400640 1 -- 172.21.15.114:0/1530213475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0948004810 msgr2=0x7f0948004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:24.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.108+0000 7f096a400640 1 --2- 172.21.15.114:0/1530213475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0948004810 0x7f0948004c90 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f096415c5d0 tx=0x7f095001d2d0 comp rx=0 tx=0).stop 2024-09-16T07:36:24.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.108+0000 7f0963e00640 1 -- 172.21.15.114:0/1530213475 reap_dead start 2024-09-16T07:36:24.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.108+0000 7f096a400640 1 -- 172.21.15.114:0/1530213475 shutdown_connections 2024-09-16T07:36:24.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.108+0000 7f096a400640 1 -- 172.21.15.114:0/1530213475 >> 172.21.15.114:0/1530213475 conn(0x7f09640d1da0 msgr2=0x7f09640d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:24.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.108+0000 7f096a400640 1 -- 172.21.15.114:0/1530213475 shutdown_connections 2024-09-16T07:36:24.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.108+0000 7f096a400640 1 -- 172.21.15.114:0/1530213475 wait complete. 2024-09-16T07:36:24.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 Processor -- start 2024-09-16T07:36:24.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 -- start start 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0948004810 0x7f0964156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09641f3380 0x7f09640b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0964159310 0x7f096415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f09640cf390 con 0x7f09641f3380 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f09640cf210 con 0x7f0964159310 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f09640cf510 con 0x7f0948004810 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09641f3380 0x7f09640b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09641f3380 0x7f09640b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37134/0 (socket says 172.21.15.114:37134) 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 -- 172.21.15.114:0/2549415279 learned_addr learned my addr 172.21.15.114:0/2549415279 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:24.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0963400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0948004810 0x7f0964156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0963e00640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0964159310 0x7f096415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 -- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0948004810 msgr2=0x7f0964156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0948004810 0x7f0964156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 -- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0964159310 msgr2=0x7f096415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0964159310 0x7f096415a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 -- 172.21.15.114:0/2549415279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0964158550 con 0x7f09641f3380 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0963e00640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0964159310 0x7f096415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f0962a00640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09641f3380 0x7f09640b7250 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f09500af040 tx=0x7f09500ade90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09500b1040 con 0x7f09641f3380 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09500be070 con 0x7f09641f3380 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950005260 con 0x7f09641f3380 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0964158830 con 0x7f09641f3380 2024-09-16T07:36:24.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0964158df0 con 0x7f09641f3380 2024-09-16T07:36:24.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.112+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09640ccbd0 con 0x7f09641f3380 2024-09-16T07:36:24.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.116+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 27) ==== 97845+0+0 (secure 0 0 0) 0x7f0950005400 con 0x7f09641f3380 2024-09-16T07:36:24.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.116+0000 7f095b400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0944073730 0x7f0944075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:24.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.116+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f095012dde0 con 0x7f09641f3380 2024-09-16T07:36:24.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.116+0000 7f0963400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0944073730 0x7f0944075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:24.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.116+0000 7f0963400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0944073730 0x7f0944075bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f09640cc310 tx=0x7f0954006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:24.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.120+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0950016fe0 con 0x7f09641f3380 2024-09-16T07:36:24.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.312+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol37701", "group_name": "subvol_grp80060", "target": ["mon-mgr", ""]}) -- 0x7f0964070350 con 0x7f0944073730 2024-09-16T07:36:24.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:24.368+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 28) ==== 97896+0+0 (secure 0 0 0) 0x7f09500f6630 con 0x7f09641f3380 2024-09-16T07:36:26.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:26.376+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f0950111330 con 0x7f09641f3380 2024-09-16T07:36:32.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.760+0000 7f095b400640 1 -- 172.21.15.114:0/2549415279 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0964070350 con 0x7f0944073730 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0944073730 msgr2=0x7f0944075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0944073730 0x7f0944075bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f09640cc310 tx=0x7f0954006b20 comp rx=0 tx=0).stop 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09641f3380 msgr2=0x7f09640b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09641f3380 0x7f09640b7250 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f09500af040 tx=0x7f09500ade90 comp rx=0 tx=0).stop 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 shutdown_connections 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0964159310 0x7f096415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09641f3380 0x7f09640b7250 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0944073730 0x7f0944075bf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 --2- 172.21.15.114:0/2549415279 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0948004810 0x7f0964156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 >> 172.21.15.114:0/2549415279 conn(0x7f09640d1da0 msgr2=0x7f09640cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:32.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 shutdown_connections 2024-09-16T07:36:32.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32.764+0000 7f096a400640 1 -- 172.21.15.114:0/2549415279 wait complete. 2024-09-16T07:36:32.788 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T07:36:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:36:32.845 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-09-16T07:36:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:36:32.853 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:36:32.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:36:32.943 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:36:33.033 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:36:33.033 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:36:33.033 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:33.033 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:33.042 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:33.042 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:33.097 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:36:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 -- 172.21.15.114:0/394994407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c15dea0 msgr2=0x7fba0c0b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 --2- 172.21.15.114:0/394994407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c15dea0 0x7fba0c0b3150 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fba0c06dbc0 tx=0x7fba0001c5d0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 -- 172.21.15.114:0/394994407 shutdown_connections 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 --2- 172.21.15.114:0/394994407 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba0c0aeed0 0x7fba0c06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 --2- 172.21.15.114:0/394994407 >> v2:172.21.15.149:3300/0 conn(0x7fba0c15e280 0x7fba0c0ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 --2- 172.21.15.114:0/394994407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c15dea0 0x7fba0c0b3150 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 -- 172.21.15.114:0/394994407 >> 172.21.15.114:0/394994407 conn(0x7fba0c0d1da0 msgr2=0x7fba0c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 -- 172.21.15.114:0/394994407 shutdown_connections 2024-09-16T07:36:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 -- 172.21.15.114:0/394994407 wait complete. 2024-09-16T07:36:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.284+0000 7fba14800640 1 Processor -- start 2024-09-16T07:36:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 -- start start 2024-09-16T07:36:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c0aeed0 0x7fba0c156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0c15dea0 0x7fba0c1fb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba0c15e280 0x7fba0c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c0d0560 con 0x7fba0c0aeed0 2024-09-16T07:36:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c0d03e0 con 0x7fba0c15dea0 2024-09-16T07:36:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fba0c0d06e0 con 0x7fba0c15e280 2024-09-16T07:36:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c0aeed0 0x7fba0c156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c0aeed0 0x7fba0c156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54892/0 (socket says 172.21.15.114:54892) 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 -- 172.21.15.114:0/3458346043 learned_addr learned my addr 172.21.15.114:0/3458346043 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11400640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0c15dea0 0x7fba0c1fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba12800640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba0c15e280 0x7fba0c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 -- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba0c15e280 msgr2=0x7fba0c1569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba0c15e280 0x7fba0c1569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 -- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0c15dea0 msgr2=0x7fba0c1fb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0c15dea0 0x7fba0c1fb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 -- 172.21.15.114:0/3458346043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c09dc10 con 0x7fba0c0aeed0 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba11e00640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c0aeed0 0x7fba0c156300 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fba00009850 tx=0x7fba000a6570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba06000640 1 -- 172.21.15.114:0/3458346043 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba000ac070 con 0x7fba0c0aeed0 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba06000640 1 -- 172.21.15.114:0/3458346043 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba00004340 con 0x7fba0c0aeed0 2024-09-16T07:36:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c15ade0 con 0x7fba0c0aeed0 2024-09-16T07:36:33.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba06000640 1 -- 172.21.15.114:0/3458346043 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba000053a0 con 0x7fba0c0aeed0 2024-09-16T07:36:33.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c1fae10 con 0x7fba0c0aeed0 2024-09-16T07:36:33.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.288+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0c0b3150 con 0x7fba0c0aeed0 2024-09-16T07:36:33.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.292+0000 7fba06000640 1 -- 172.21.15.114:0/3458346043 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fba000af070 con 0x7fba0c0aeed0 2024-09-16T07:36:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.292+0000 7fba06000640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9f00738e0 0x7fb9f0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.292+0000 7fba06000640 1 -- 172.21.15.114:0/3458346043 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7fba0012cc60 con 0x7fba0c0aeed0 2024-09-16T07:36:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.292+0000 7fba11400640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9f00738e0 0x7fb9f0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.292+0000 7fba11400640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9f00738e0 0x7fb9f0075da0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc006fd0 tx=0x7fb9fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:33.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.296+0000 7fba06000640 1 -- 172.21.15.114:0/3458346043 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fba000164b0 con 0x7fba0c0aeed0 2024-09-16T07:36:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.480+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba0c15be60 con 0x7fba0c0aeed0 2024-09-16T07:36:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba06000640 1 -- 172.21.15.114:0/3458346043 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v154) ==== 80+0+0 (secure 0 0 0) 0x7fba000f9940 con 0x7fba0c0aeed0 2024-09-16T07:36:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9f00738e0 msgr2=0x7fb9f0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9f00738e0 0x7fb9f0075da0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc006fd0 tx=0x7fb9fc008040 comp rx=0 tx=0).stop 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c0aeed0 msgr2=0x7fba0c156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c0aeed0 0x7fba0c156300 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fba00009850 tx=0x7fba000a6570 comp rx=0 tx=0).stop 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 shutdown_connections 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb9f00738e0 0x7fb9f0075da0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fba0c15e280 0x7fba0c1569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0c15dea0 0x7fba0c1fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 --2- 172.21.15.114:0/3458346043 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba0c0aeed0 0x7fba0c156300 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 >> 172.21.15.114:0/3458346043 conn(0x7fba0c0d1da0 msgr2=0x7fba0c15c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 shutdown_connections 2024-09-16T07:36:33.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.484+0000 7fba14800640 1 -- 172.21.15.114:0/3458346043 wait complete. 2024-09-16T07:36:33.505 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:36:33.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:33.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:36:33.556 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:36:33.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:33.556 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:36:33.577 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:36:33.577 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:33.577 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:33.586 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:33.586 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:33.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:36:33.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 -- 172.21.15.114:0/779868129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 msgr2=0x7f2ba4004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 --2- 172.21.15.114:0/779868129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 0x7f2ba4004020 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009b60 tx=0x7f2bb001d270 comp rx=0 tx=0).stop 2024-09-16T07:36:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc4e00640 1 -- 172.21.15.114:0/779868129 reap_dead start 2024-09-16T07:36:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 -- 172.21.15.114:0/779868129 shutdown_connections 2024-09-16T07:36:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 -- 172.21.15.114:0/779868129 >> 172.21.15.114:0/779868129 conn(0x7f2bc00b18f0 msgr2=0x7f2bc00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 -- 172.21.15.114:0/779868129 shutdown_connections 2024-09-16T07:36:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 -- 172.21.15.114:0/779868129 wait complete. 2024-09-16T07:36:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 Processor -- start 2024-09-16T07:36:33.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.780+0000 7f2bc6e00640 1 -- start start 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 0x7f2bc0159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc01507b0 0x7f2bc00b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc00b1440 0x7f2bc01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc01672b0 con 0x7f2ba4003c20 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc0167130 con 0x7f2bc00b1440 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc0167430 con 0x7f2bc01507b0 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 0x7f2bc0159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 0x7f2bc0159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54912/0 (socket says 172.21.15.114:54912) 2024-09-16T07:36:33.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 -- 172.21.15.114:0/1800068208 learned_addr learned my addr 172.21.15.114:0/1800068208 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bb7400640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc01507b0 0x7f2bc00b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc4e00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc00b1440 0x7f2bc01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 -- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc01507b0 msgr2=0x7f2bc00b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc01507b0 0x7f2bc00b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 -- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc00b1440 msgr2=0x7f2bc01548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc00b1440 0x7f2bc01548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 -- 172.21.15.114:0/1800068208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc00b0160 con 0x7f2ba4003c20 2024-09-16T07:36:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbfe00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 0x7f2bc0159010 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f2bb001d0a0 tx=0x7f2bb0005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbcc00640 1 -- 172.21.15.114:0/1800068208 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00b1040 con 0x7f2ba4003c20 2024-09-16T07:36:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbcc00640 1 -- 172.21.15.114:0/1800068208 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bb00bb070 con 0x7f2ba4003c20 2024-09-16T07:36:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc00b0440 con 0x7f2ba4003c20 2024-09-16T07:36:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbcc00640 1 -- 172.21.15.114:0/1800068208 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0009730 con 0x7f2ba4003c20 2024-09-16T07:36:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc00b0a00 con 0x7f2ba4003c20 2024-09-16T07:36:33.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc00b42d0 con 0x7f2ba4003c20 2024-09-16T07:36:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.784+0000 7f2bbcc00640 1 -- 172.21.15.114:0/1800068208 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f2bb0004270 con 0x7f2ba4003c20 2024-09-16T07:36:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.788+0000 7f2bbcc00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2b9c0738e0 0x7f2b9c075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.788+0000 7f2bbcc00640 1 -- 172.21.15.114:0/1800068208 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7f2bb012d570 con 0x7f2ba4003c20 2024-09-16T07:36:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.788+0000 7f2bb7400640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2b9c0738e0 0x7f2b9c075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.788+0000 7f2bb7400640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2b9c0738e0 0x7f2b9c075da0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8001870 tx=0x7f2ba8006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.792+0000 7f2bbcc00640 1 -- 172.21.15.114:0/1800068208 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2bb0016f80 con 0x7f2ba4003c20 2024-09-16T07:36:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.972+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2bc006ec20 con 0x7f2ba4003c20 2024-09-16T07:36:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.972+0000 7f2bbcc00640 1 -- 172.21.15.114:0/1800068208 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v154) ==== 80+0+0 (secure 0 0 0) 0x7f2bb00f9bc0 con 0x7f2ba4003c20 2024-09-16T07:36:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2b9c0738e0 msgr2=0x7f2b9c075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2b9c0738e0 0x7f2b9c075da0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8001870 tx=0x7f2ba8006040 comp rx=0 tx=0).stop 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 msgr2=0x7f2bc0159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 0x7f2bc0159010 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f2bb001d0a0 tx=0x7f2bb0005590 comp rx=0 tx=0).stop 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 shutdown_connections 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bc00b1440 0x7f2bc01548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2b9c0738e0 0x7f2b9c075da0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2bc01507b0 0x7f2bc00b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 --2- 172.21.15.114:0/1800068208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba4003c20 0x7f2bc0159010 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 >> 172.21.15.114:0/1800068208 conn(0x7f2bc00b18f0 msgr2=0x7f2bc009da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 shutdown_connections 2024-09-16T07:36:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:33.976+0000 7f2bc6e00640 1 -- 172.21.15.114:0/1800068208 wait complete. 2024-09-16T07:36:33.994 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:36:33.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:33.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:36:34.020 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:36:34.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:34.020 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:36:34.070 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:36:34.071 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:34.071 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:34.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:36:34.080 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:36:34.080 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:34.080 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:34.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:36:34.122 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:34.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.264+0000 7f463fc00640 1 -- 172.21.15.114:0/3622449512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4620003a60 msgr2=0x7f4620003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.264+0000 7f463fc00640 1 --2- 172.21.15.114:0/3622449512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4620003a60 0x7f4620003e80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f462c0016c0 tx=0x7f462c01c710 comp rx=0 tx=0).stop 2024-09-16T07:36:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.264+0000 7f463fc00640 1 -- 172.21.15.114:0/3622449512 shutdown_connections 2024-09-16T07:36:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.264+0000 7f463fc00640 1 --2- 172.21.15.114:0/3622449512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4620003a60 0x7f4620003e80 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.264+0000 7f463fc00640 1 -- 172.21.15.114:0/3622449512 >> 172.21.15.114:0/3622449512 conn(0x7f46380d1dc0 msgr2=0x7f46380d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.264+0000 7f463fc00640 1 -- 172.21.15.114:0/3622449512 shutdown_connections 2024-09-16T07:36:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.264+0000 7f463fc00640 1 -- 172.21.15.114:0/3622449512 wait complete. 2024-09-16T07:36:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 Processor -- start 2024-09-16T07:36:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 -- start start 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4620003a60 0x7f46380cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f463815caf0 0x7f463814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f463809d3a0 0x7f46380c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46380b0950 con 0x7f463815caf0 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f46380b07d0 con 0x7f463809d3a0 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f463809dc60 con 0x7f4620003a60 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f463815caf0 0x7f463814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f463815caf0 0x7f463814d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34128/0 (socket says 172.21.15.114:34128) 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 -- 172.21.15.114:0/726584645 learned_addr learned my addr 172.21.15.114:0/726584645 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463dc00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f463809d3a0 0x7f46380c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463d200640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4620003a60 0x7f46380cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 -- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4620003a60 msgr2=0x7f46380cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4620003a60 0x7f46380cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 -- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f463809d3a0 msgr2=0x7f46380c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f463809d3a0 0x7f46380c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 -- 172.21.15.114:0/726584645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463809df40 con 0x7f463815caf0 2024-09-16T07:36:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4637e00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f463815caf0 0x7f463814d170 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f4624001870 tx=0x7f46240066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4634c00640 1 -- 172.21.15.114:0/726584645 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624015070 con 0x7f463815caf0 2024-09-16T07:36:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4634c00640 1 -- 172.21.15.114:0/726584645 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4624011920 con 0x7f463815caf0 2024-09-16T07:36:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f4634c00640 1 -- 172.21.15.114:0/726584645 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624011d70 con 0x7f463815caf0 2024-09-16T07:36:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463809e220 con 0x7f463815caf0 2024-09-16T07:36:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.268+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463809e7e0 con 0x7f463815caf0 2024-09-16T07:36:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.272+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46380b2ad0 con 0x7f463815caf0 2024-09-16T07:36:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.272+0000 7f4634c00640 1 -- 172.21.15.114:0/726584645 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f4624018070 con 0x7f463815caf0 2024-09-16T07:36:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.272+0000 7f4634c00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4618073910 0x7f4618075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.272+0000 7f4634c00640 1 -- 172.21.15.114:0/726584645 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7f4624093560 con 0x7f463815caf0 2024-09-16T07:36:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.272+0000 7f463d200640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4618073910 0x7f4618075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.272+0000 7f463d200640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4618073910 0x7f4618075dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f46200057f0 tx=0x7f462c0b0040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:34.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.276+0000 7f4634c00640 1 -- 172.21.15.114:0/726584645 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f462405f990 con 0x7f463815caf0 2024-09-16T07:36:34.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.480+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46380b4170 con 0x7f463815caf0 2024-09-16T07:36:34.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f4634c00640 1 -- 172.21.15.114:0/726584645 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f46240643c0 con 0x7f463815caf0 2024-09-16T07:36:34.482 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:34.482 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"btime":"2024-09-16T07:36:21:346567+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3808879086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3808879086},{"type":"v1","addr":"172.21.15.149:6801","nonce":3808879086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3577511191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3577511191},{"type":"v1","addr":"172.21.15.149:6835","nonce":3577511191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1372619733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1372619733},{"type":"v1","addr":"172.21.15.114:6835","nonce":1372619733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:11.697492+0000","modified":"2024-09-16T07:36:14.712190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6834/2318653579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2318653579},{"type":"v1","addr":"172.21.15.114:6834","nonce":2318653579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8796,"qdb_cluster":[8796]},"id":12}]} 2024-09-16T07:36:34.483 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 114 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4618073910 msgr2=0x7f4618075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4618073910 0x7f4618075dd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f46200057f0 tx=0x7f462c0b0040 comp rx=0 tx=0).stop 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f463815caf0 msgr2=0x7f463814d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f463815caf0 0x7f463814d170 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f4624001870 tx=0x7f46240066c0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 shutdown_connections 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f463809d3a0 0x7f46380c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f463815caf0 0x7f463814d170 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4618073910 0x7f4618075dd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 --2- 172.21.15.114:0/726584645 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4620003a60 0x7f46380cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 >> 172.21.15.114:0/726584645 conn(0x7f46380d1dc0 msgr2=0x7f46380720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:34.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 shutdown_connections 2024-09-16T07:36:34.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.484+0000 7f463fc00640 1 -- 172.21.15.114:0/726584645 wait complete. 2024-09-16T07:36:34.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 -- 172.21.15.114:0/851986757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0280cdb30 msgr2=0x7ff0280aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 --2- 172.21.15.114:0/851986757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0280cdb30 0x7ff0280aeef0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ff0280cc3a0 tx=0x7ff02001c800 comp rx=0 tx=0).stop 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 -- 172.21.15.114:0/851986757 shutdown_connections 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 --2- 172.21.15.114:0/851986757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0280cdb30 0x7ff0280aeef0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 --2- 172.21.15.114:0/851986757 >> v2:172.21.15.149:3300/0 conn(0x7ff0280ced80 0x7ff0280ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 -- 172.21.15.114:0/851986757 >> 172.21.15.114:0/851986757 conn(0x7ff0280d1dc0 msgr2=0x7ff0280d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 -- 172.21.15.114:0/851986757 shutdown_connections 2024-09-16T07:36:34.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.648+0000 7ff02e800640 1 -- 172.21.15.114:0/851986757 wait complete. 2024-09-16T07:36:34.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 Processor -- start 2024-09-16T07:36:34.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 -- start start 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0280cdb30 0x7ff0281fb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0280ced80 0x7ff0280c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02815bea0 0x7ff0280b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff0281692f0 con 0x7ff02815bea0 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff028169170 con 0x7ff0280ced80 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff028169470 con 0x7ff0280cdb30 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02815bea0 0x7ff0280b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02815bea0 0x7ff0280b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34150/0 (socket says 172.21.15.114:34150) 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 -- 172.21.15.114:0/490568119 learned_addr learned my addr 172.21.15.114:0/490568119 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027400640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0280cdb30 0x7ff0281fb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff01ea00640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0280ced80 0x7ff0280c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 -- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0280cdb30 msgr2=0x7ff0281fb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0280cdb30 0x7ff0281fb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 -- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0280ced80 msgr2=0x7ff0280c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0280ced80 0x7ff0280c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 -- 172.21.15.114:0/490568119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0280b7cd0 con 0x7ff02815bea0 2024-09-16T07:36:34.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff027e00640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02815bea0 0x7ff0280b12d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff020009790 tx=0x7ff0200a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:34.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff01fe00640 1 -- 172.21.15.114:0/490568119 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0200bb070 con 0x7ff02815bea0 2024-09-16T07:36:34.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff01fe00640 1 -- 172.21.15.114:0/490568119 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0200043b0 con 0x7ff02815bea0 2024-09-16T07:36:34.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff01fe00640 1 -- 172.21.15.114:0/490568119 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0200b2040 con 0x7ff02815bea0 2024-09-16T07:36:34.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0280b79f0 con 0x7ff02815bea0 2024-09-16T07:36:34.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0280ca4a0 con 0x7ff02815bea0 2024-09-16T07:36:34.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.652+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0280c9fd0 con 0x7ff02815bea0 2024-09-16T07:36:34.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.656+0000 7ff01fe00640 1 -- 172.21.15.114:0/490568119 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7ff020005290 con 0x7ff02815bea0 2024-09-16T07:36:34.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.656+0000 7ff01fe00640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff0040738e0 0x7ff004075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:34.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.656+0000 7ff01fe00640 1 -- 172.21.15.114:0/490568119 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7ff02012c240 con 0x7ff02815bea0 2024-09-16T07:36:34.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.656+0000 7ff027400640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff0040738e0 0x7ff004075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:34.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.656+0000 7ff027400640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff0040738e0 0x7ff004075da0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff018007fd0 tx=0x7ff018009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:34.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.660+0000 7ff01fe00640 1 -- 172.21.15.114:0/490568119 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff0200163f0 con 0x7ff02815bea0 2024-09-16T07:36:34.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.860+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0280ce670 con 0x7ff02815bea0 2024-09-16T07:36:34.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.860+0000 7ff01fe00640 1 -- 172.21.15.114:0/490568119 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7ff0200ff030 con 0x7ff02815bea0 2024-09-16T07:36:34.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:34.861 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"btime":"2024-09-16T07:36:21:346567+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3808879086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3808879086},{"type":"v1","addr":"172.21.15.149:6801","nonce":3808879086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3577511191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3577511191},{"type":"v1","addr":"172.21.15.149:6835","nonce":3577511191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1372619733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1372619733},{"type":"v1","addr":"172.21.15.114:6835","nonce":1372619733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:11.697492+0000","modified":"2024-09-16T07:36:14.712190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6834/2318653579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2318653579},{"type":"v1","addr":"172.21.15.114:6834","nonce":2318653579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8796,"qdb_cluster":[8796]},"id":12}]} 2024-09-16T07:36:34.861 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 114 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff0040738e0 msgr2=0x7ff004075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff0040738e0 0x7ff004075da0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff018007fd0 tx=0x7ff018009040 comp rx=0 tx=0).stop 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02815bea0 msgr2=0x7ff0280b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02815bea0 0x7ff0280b12d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff020009790 tx=0x7ff0200a5670 comp rx=0 tx=0).stop 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 shutdown_connections 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff02815bea0 0x7ff0280b12d0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff0280ced80 0x7ff0280c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff0040738e0 0x7ff004075da0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 --2- 172.21.15.114:0/490568119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff0280cdb30 0x7ff0281fb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:34.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 >> 172.21.15.114:0/490568119 conn(0x7ff0280d1dc0 msgr2=0x7ff0280b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:34.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 shutdown_connections 2024-09-16T07:36:34.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:34.864+0000 7ff02e800640 1 -- 172.21.15.114:0/490568119 wait complete. 2024-09-16T07:36:34.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:35.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 -- 172.21.15.114:0/1700768006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0cdb30 msgr2=0x7f03dc0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 --2- 172.21.15.114:0/1700768006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0cdb30 0x7f03dc0cebb0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009900 tx=0x7f03c801c8e0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 -- 172.21.15.114:0/1700768006 shutdown_connections 2024-09-16T07:36:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 --2- 172.21.15.114:0/1700768006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0cdb30 0x7f03dc0cebb0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 --2- 172.21.15.114:0/1700768006 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03dc15bea0 0x7f03dc0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 -- 172.21.15.114:0/1700768006 >> 172.21.15.114:0/1700768006 conn(0x7f03dc0d1dc0 msgr2=0x7f03dc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 -- 172.21.15.114:0/1700768006 shutdown_connections 2024-09-16T07:36:35.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.024+0000 7f03e1600640 1 -- 172.21.15.114:0/1700768006 wait complete. 2024-09-16T07:36:35.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 Processor -- start 2024-09-16T07:36:35.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 -- start start 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03dc0cdb30 0x7f03dc0b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0d28e0 0x7f03dc157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03dc15bea0 0x7f03dc0ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc168fc0 con 0x7f03dc0d28e0 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc168e40 con 0x7f03dc15bea0 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc169140 con 0x7f03dc0cdb30 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0d28e0 0x7f03dc157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03daa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03dc0cdb30 0x7f03dc0b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0d28e0 0x7f03dc157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34158/0 (socket says 172.21.15.114:34158) 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 -- 172.21.15.114:0/3524930270 learned_addr learned my addr 172.21.15.114:0/3524930270 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03db400640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03dc15bea0 0x7f03dc0ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 -- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03dc0cdb30 msgr2=0x7f03dc0b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03dc0cdb30 0x7f03dc0b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 -- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03dc15bea0 msgr2=0x7f03dc0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03dc15bea0 0x7f03dc0ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 -- 172.21.15.114:0/3524930270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc0b3200 con 0x7f03dc0d28e0 2024-09-16T07:36:35.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03daa00640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03dc0cdb30 0x7f03dc0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:36:35.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03da000640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0d28e0 0x7f03dc157630 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009850 tx=0x7f03c8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03d2a00640 1 -- 172.21.15.114:0/3524930270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c80b2040 con 0x7f03dc0d28e0 2024-09-16T07:36:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03d2a00640 1 -- 172.21.15.114:0/3524930270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03c8005030 con 0x7f03dc0d28e0 2024-09-16T07:36:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03d2a00640 1 -- 172.21.15.114:0/3524930270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c80044f0 con 0x7f03dc0d28e0 2024-09-16T07:36:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03dc0b34e0 con 0x7f03dc0d28e0 2024-09-16T07:36:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03dc0ca360 con 0x7f03dc0d28e0 2024-09-16T07:36:35.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.028+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03dc0cc9d0 con 0x7f03dc0d28e0 2024-09-16T07:36:35.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.032+0000 7f03d2a00640 1 -- 172.21.15.114:0/3524930270 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f03c8005440 con 0x7f03dc0d28e0 2024-09-16T07:36:35.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.032+0000 7f03d2a00640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f03bc0738e0 0x7f03bc075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.032+0000 7f03d2a00640 1 -- 172.21.15.114:0/3524930270 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7f03c812c3c0 con 0x7f03dc0d28e0 2024-09-16T07:36:35.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.032+0000 7f03daa00640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f03bc0738e0 0x7f03bc075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.032+0000 7f03daa00640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f03bc0738e0 0x7f03bc075da0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00bf40 tx=0x7f03cc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:35.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.036+0000 7f03d2a00640 1 -- 172.21.15.114:0/3524930270 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f03c80164d0 con 0x7f03dc0d28e0 2024-09-16T07:36:35.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.204+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03dc15b7b0 con 0x7f03dc0d28e0 2024-09-16T07:36:35.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.204+0000 7f03d2a00640 1 -- 172.21.15.114:0/3524930270 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16873 (secure 0 0 0) 0x7f03c80f8850 con 0x7f03dc0d28e0 2024-09-16T07:36:35.203 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:35.203 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":154,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:25.367088+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:09.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:10.653300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.10","mappings":[{"from":0,"to":1}]},{"pgid":"25.18","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f03bc0738e0 msgr2=0x7f03bc075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f03bc0738e0 0x7f03bc075da0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00bf40 tx=0x7f03cc00b2e0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0d28e0 msgr2=0x7f03dc157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0d28e0 0x7f03dc157630 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009850 tx=0x7f03c8004040 comp rx=0 tx=0).stop 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 shutdown_connections 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03dc15bea0 0x7f03dc0ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03dc0d28e0 0x7f03dc157630 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f03bc0738e0 0x7f03bc075da0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 --2- 172.21.15.114:0/3524930270 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03dc0cdb30 0x7f03dc0b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 >> 172.21.15.114:0/3524930270 conn(0x7f03dc0d1dc0 msgr2=0x7f03dc06f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 shutdown_connections 2024-09-16T07:36:35.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.208+0000 7f03e1600640 1 -- 172.21.15.114:0/3524930270 wait complete. 2024-09-16T07:36:35.225 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:36:35.225 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- 172.21.15.114:0/338361618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe718164c60 msgr2=0x7fe718167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 --2- 172.21.15.114:0/338361618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe718164c60 0x7fe718167050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe710009bf0 tx=0x7fe71001ca40 comp rx=0 tx=0).stop 2024-09-16T07:36:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- 172.21.15.114:0/338361618 shutdown_connections 2024-09-16T07:36:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 --2- 172.21.15.114:0/338361618 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe718164c60 0x7fe718167050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- 172.21.15.114:0/338361618 >> 172.21.15.114:0/338361618 conn(0x7fe7180d1e30 msgr2=0x7fe7180d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- 172.21.15.114:0/338361618 shutdown_connections 2024-09-16T07:36:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- 172.21.15.114:0/338361618 wait complete. 2024-09-16T07:36:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 Processor -- start 2024-09-16T07:36:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- start start 2024-09-16T07:36:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7180b2e80 0x7fe7180ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71815f490 0x7fe71815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe718164c60 0x7fe718155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe718169f30 con 0x7fe7180b2e80 2024-09-16T07:36:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe718169db0 con 0x7fe71815f490 2024-09-16T07:36:35.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71fe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe71816a0b0 con 0x7fe718164c60 2024-09-16T07:36:35.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7180b2e80 0x7fe7180ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7180b2e80 0x7fe7180ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34174/0 (socket says 172.21.15.114:34174) 2024-09-16T07:36:35.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 -- 172.21.15.114:0/3884472026 learned_addr learned my addr 172.21.15.114:0/3884472026 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:35.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71ca00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71815f490 0x7fe71815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 -- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe718164c60 msgr2=0x7fe718155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe718164c60 0x7fe718155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 -- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71815f490 msgr2=0x7fe71815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71815f490 0x7fe71815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71d400640 1 -- 172.21.15.114:0/3884472026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7180cc180 con 0x7fe7180b2e80 2024-09-16T07:36:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.372+0000 7fe71ca00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71815f490 0x7fe71815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe71d400640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7180b2e80 0x7fe7180ccac0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fe70c001230 tx=0x7fe70c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe715600640 1 -- 172.21.15.114:0/3884472026 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c016020 con 0x7fe7180b2e80 2024-09-16T07:36:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe715600640 1 -- 172.21.15.114:0/3884472026 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe70c00a8f0 con 0x7fe7180b2e80 2024-09-16T07:36:35.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7180b5670 con 0x7fe7180b2e80 2024-09-16T07:36:35.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe715600640 1 -- 172.21.15.114:0/3884472026 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c00ad40 con 0x7fe7180b2e80 2024-09-16T07:36:35.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7180b5c30 con 0x7fe7180b2e80 2024-09-16T07:36:35.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7180b14c0 con 0x7fe7180b2e80 2024-09-16T07:36:35.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe715600640 1 -- 172.21.15.114:0/3884472026 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fe70c019020 con 0x7fe7180b2e80 2024-09-16T07:36:35.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe715600640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe6f80738e0 0x7fe6f8075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe715600640 1 -- 172.21.15.114:0/3884472026 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7fe70c0956f0 con 0x7fe7180b2e80 2024-09-16T07:36:35.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.376+0000 7fe71ca00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe6f80738e0 0x7fe6f8075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.380+0000 7fe71ca00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe6f80738e0 0x7fe6f8075da0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe718156170 tx=0x7fe704009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:35.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.380+0000 7fe715600640 1 -- 172.21.15.114:0/3884472026 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe70c020020 con 0x7fe7180b2e80 2024-09-16T07:36:35.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.584+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7180cd000 con 0x7fe7180b2e80 2024-09-16T07:36:35.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.584+0000 7fe715600640 1 -- 172.21.15.114:0/3884472026 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7fe70c05f490 con 0x7fe7180b2e80 2024-09-16T07:36:35.585 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:35.585 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"btime":"2024-09-16T07:36:21:346567+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3808879086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3808879086},{"type":"v1","addr":"172.21.15.149:6801","nonce":3808879086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3577511191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3577511191},{"type":"v1","addr":"172.21.15.149:6835","nonce":3577511191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1372619733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1372619733},{"type":"v1","addr":"172.21.15.114:6835","nonce":1372619733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:11.697492+0000","modified":"2024-09-16T07:36:14.712190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6834/2318653579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2318653579},{"type":"v1","addr":"172.21.15.114:6834","nonce":2318653579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8796,"qdb_cluster":[8796]},"id":12}]} 2024-09-16T07:36:35.586 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 114 2024-09-16T07:36:35.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe6f80738e0 msgr2=0x7fe6f8075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe6f80738e0 0x7fe6f8075da0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe718156170 tx=0x7fe704009040 comp rx=0 tx=0).stop 2024-09-16T07:36:35.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7180b2e80 msgr2=0x7fe7180ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7180b2e80 0x7fe7180ccac0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fe70c001230 tx=0x7fe70c00cb90 comp rx=0 tx=0).stop 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 shutdown_connections 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe6f80738e0 0x7fe6f8075da0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe718164c60 0x7fe718155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe71815f490 0x7fe71815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 --2- 172.21.15.114:0/3884472026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7180b2e80 0x7fe7180ccac0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 >> 172.21.15.114:0/3884472026 conn(0x7fe7180d1e30 msgr2=0x7fe7180718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 shutdown_connections 2024-09-16T07:36:35.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.588+0000 7fe71fe00640 1 -- 172.21.15.114:0/3884472026 wait complete. 2024-09-16T07:36:35.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.748+0000 7ff5d7200640 1 -- 172.21.15.114:0/3387584881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00b49e0 msgr2=0x7ff5d00acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.748+0000 7ff5d7200640 1 --2- 172.21.15.114:0/3387584881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00b49e0 0x7ff5d00acd40 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800ad90 tx=0x7ff5c801dc20 comp rx=0 tx=0).stop 2024-09-16T07:36:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- 172.21.15.114:0/3387584881 shutdown_connections 2024-09-16T07:36:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 --2- 172.21.15.114:0/3387584881 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00b49e0 0x7ff5d00acd40 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 --2- 172.21.15.114:0/3387584881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d00cd100 0x7ff5d006f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- 172.21.15.114:0/3387584881 >> 172.21.15.114:0/3387584881 conn(0x7ff5d00b18f0 msgr2=0x7ff5d00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- 172.21.15.114:0/3387584881 shutdown_connections 2024-09-16T07:36:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- 172.21.15.114:0/3387584881 wait complete. 2024-09-16T07:36:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 Processor -- start 2024-09-16T07:36:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- start start 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d00b49e0 0x7ff5d009adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00cd100 0x7ff5d009bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d015dae0 0x7ff5d015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00cf1a0 con 0x7ff5d00cd100 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00cf020 con 0x7ff5d00b49e0 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5d7200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d00cf320 con 0x7ff5d015dae0 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00cd100 0x7ff5d009bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00cd100 0x7ff5d009bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34194/0 (socket says 172.21.15.114:34194) 2024-09-16T07:36:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 -- 172.21.15.114:0/390393292 learned_addr learned my addr 172.21.15.114:0/390393292 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 -- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d015dae0 msgr2=0x7ff5d015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d015dae0 0x7ff5d015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 -- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d00b49e0 msgr2=0x7ff5d009adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cfe00640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d00b49e0 0x7ff5d009adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d00b49e0 0x7ff5d009adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 -- 172.21.15.114:0/390393292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d00b25e0 con 0x7ff5d00cd100 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cfe00640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d00b49e0 0x7ff5d009adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.752+0000 7ff5cf400640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00cd100 0x7ff5d009bb90 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00e9f0 tx=0x7ff5bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5c7e00640 1 -- 172.21.15.114:0/390393292 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00cd20 con 0x7ff5d00cd100 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5c7e00640 1 -- 172.21.15.114:0/390393292 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5bc004020 con 0x7ff5d00cd100 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d01f7760 con 0x7ff5d00cd100 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5c7e00640 1 -- 172.21.15.114:0/390393292 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc004450 con 0x7ff5d00cd100 2024-09-16T07:36:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d01f7d20 con 0x7ff5d00cd100 2024-09-16T07:36:35.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d00acd40 con 0x7ff5d00cd100 2024-09-16T07:36:35.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5c7e00640 1 -- 172.21.15.114:0/390393292 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7ff5bc003600 con 0x7ff5d00cd100 2024-09-16T07:36:35.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5c7e00640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b00738e0 0x7ff5b0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:35.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5c7e00640 1 -- 172.21.15.114:0/390393292 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7ff5bc0933c0 con 0x7ff5d00cd100 2024-09-16T07:36:35.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.756+0000 7ff5cfe00640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b00738e0 0x7ff5b0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:35.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.760+0000 7ff5cfe00640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b00738e0 0x7ff5b0075da0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0001630 tx=0x7ff5c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.760+0000 7ff5c7e00640 1 -- 172.21.15.114:0/390393292 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff5bc097e20 con 0x7ff5d00cd100 2024-09-16T07:36:35.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5d01f7410 con 0x7ff5d00cd100 2024-09-16T07:36:35.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5c7e00640 1 -- 172.21.15.114:0/390393292 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7ff5bc05ff00 con 0x7ff5d00cd100 2024-09-16T07:36:35.967 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:35.967 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":114,"btime":"2024-09-16T07:36:21:346567+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3808879086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3808879086},{"type":"v1","addr":"172.21.15.149:6801","nonce":3808879086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3577511191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3577511191},{"type":"v1","addr":"172.21.15.149:6835","nonce":3577511191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1372619733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1372619733},{"type":"v1","addr":"172.21.15.114:6835","nonce":1372619733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:11.697492+0000","modified":"2024-09-16T07:36:14.712190+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8796":{"gid":8796,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6834/2318653579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2318653579},{"type":"v1","addr":"172.21.15.114:6834","nonce":2318653579}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8796,"qdb_cluster":[8796]},"id":12}]} 2024-09-16T07:36:35.967 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 114 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b00738e0 msgr2=0x7ff5b0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b00738e0 0x7ff5b0075da0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0001630 tx=0x7ff5c0009040 comp rx=0 tx=0).stop 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00cd100 msgr2=0x7ff5d009bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00cd100 0x7ff5d009bb90 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00e9f0 tx=0x7ff5bc00eeb0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 shutdown_connections 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff5b00738e0 0x7ff5b0075da0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5d015dae0 0x7ff5d015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5d00cd100 0x7ff5d009bb90 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 --2- 172.21.15.114:0/390393292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5d00b49e0 0x7ff5d009adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:35.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 >> 172.21.15.114:0/390393292 conn(0x7ff5d00b18f0 msgr2=0x7ff5d015cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:35.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 shutdown_connections 2024-09-16T07:36:35.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:35.968+0000 7ff5d7200640 1 -- 172.21.15.114:0/390393292 wait complete. 2024-09-16T07:36:35.988 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:36.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- 172.21.15.114:0/2133129157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 msgr2=0x7fb0bc0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 --2- 172.21.15.114:0/2133129157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0aeef0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009c80 tx=0x7fb0b401cda0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- 172.21.15.114:0/2133129157 shutdown_connections 2024-09-16T07:36:36.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 --2- 172.21.15.114:0/2133129157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0aeef0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 --2- 172.21.15.114:0/2133129157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0bc0ced80 0x7fb0bc0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- 172.21.15.114:0/2133129157 >> 172.21.15.114:0/2133129157 conn(0x7fb0bc0d1dc0 msgr2=0x7fb0bc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:36.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- 172.21.15.114:0/2133129157 shutdown_connections 2024-09-16T07:36:36.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- 172.21.15.114:0/2133129157 wait complete. 2024-09-16T07:36:36.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 Processor -- start 2024-09-16T07:36:36.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- start start 2024-09-16T07:36:36.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0bc0ced80 0x7fb0bc0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc15bea0 0x7fb0bc0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc169290 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc169110 con 0x7fb0bc15bea0 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0c2600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc169410 con 0x7fb0bc0ced80 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34220/0 (socket says 172.21.15.114:34220) 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 -- 172.21.15.114:0/3584939122 learned_addr learned my addr 172.21.15.114:0/3584939122 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0b3e00640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0bc0ced80 0x7fb0bc0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bbe00640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc15bea0 0x7fb0bc0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 -- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0bc0ced80 msgr2=0x7fb0bc0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0bc0ced80 0x7fb0bc0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 -- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc15bea0 msgr2=0x7fb0bc0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc15bea0 0x7fb0bc0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.132+0000 7fb0bb400640 1 -- 172.21.15.114:0/3584939122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc0cb750 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0bb400640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0b3b00 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00c3c0 tx=0x7fb0ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:36.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0b3400640 1 -- 172.21.15.114:0/3584939122 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac017070 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0b3400640 1 -- 172.21.15.114:0/3584939122 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0ac0053c0 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0b3400640 1 -- 172.21.15.114:0/3584939122 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac003860 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0bc0cba30 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0bc0b4040 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0bc0ce670 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0b3400640 1 -- 172.21.15.114:0/3584939122 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fb0ac01a070 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0b3400640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0980738e0 0x7fb098075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0b3400640 1 -- 172.21.15.114:0/3584939122 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7fb0ac091c70 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.136+0000 7fb0b3e00640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0980738e0 0x7fb098075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.140+0000 7fb0b3e00640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0980738e0 0x7fb098075da0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc06ff10 tx=0x7fb0a40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:36.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.140+0000 7fb0b3400640 1 -- 172.21.15.114:0/3584939122 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb0ac05e6f0 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.308+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0bc0d2520 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0b3400640 1 -- 172.21.15.114:0/3584939122 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16873 (secure 0 0 0) 0x7fb0ac05dff0 con 0x7fb0bc0cdb30 2024-09-16T07:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:36.310 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":154,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:25.367088+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:09.368934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:10.653300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.10","mappings":[{"from":0,"to":1}]},{"pgid":"25.18","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:36.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0980738e0 msgr2=0x7fb098075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0980738e0 0x7fb098075da0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc06ff10 tx=0x7fb0a40091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 msgr2=0x7fb0bc0b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0b3b00 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac00c3c0 tx=0x7fb0ac00c880 comp rx=0 tx=0).stop 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 shutdown_connections 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0bc15bea0 0x7fb0bc0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb0980738e0 0x7fb098075da0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0bc0ced80 0x7fb0bc0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 --2- 172.21.15.114:0/3584939122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0bc0cdb30 0x7fb0bc0b3b00 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 >> 172.21.15.114:0/3584939122 conn(0x7fb0bc0d1dc0 msgr2=0x7fb0bc0b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 shutdown_connections 2024-09-16T07:36:36.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.312+0000 7fb0c2600640 1 -- 172.21.15.114:0/3584939122 wait complete. 2024-09-16T07:36:36.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:36:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 -- 172.21.15.114:0/3981064732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200cd100 msgr2=0x7f142006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 --2- 172.21.15.114:0/3981064732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200cd100 0x7f142006f7b0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f14200af830 tx=0x7f140801dad0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 -- 172.21.15.114:0/3981064732 shutdown_connections 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 --2- 172.21.15.114:0/3981064732 >> v2:172.21.15.149:3300/0 conn(0x7f14200b49e0 0x7f14200acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 --2- 172.21.15.114:0/3981064732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200cd100 0x7f142006f7b0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 -- 172.21.15.114:0/3981064732 >> 172.21.15.114:0/3981064732 conn(0x7f14200b18f0 msgr2=0x7f14200b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 -- 172.21.15.114:0/3981064732 shutdown_connections 2024-09-16T07:36:36.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.476+0000 7f1424a00640 1 -- 172.21.15.114:0/3981064732 wait complete. 2024-09-16T07:36:36.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 Processor -- start 2024-09-16T07:36:36.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 -- start start 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200b49e0 0x7f1420153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14200cd100 0x7f14201f9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f142015dae0 0x7f1420073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f14200cf070 con 0x7f14200b49e0 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f14200ceef0 con 0x7f142015dae0 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f14200cf1f0 con 0x7f14200cd100 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200b49e0 0x7f1420153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200b49e0 0x7f1420153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34236/0 (socket says 172.21.15.114:34236) 2024-09-16T07:36:36.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 -- 172.21.15.114:0/933897136 learned_addr learned my addr 172.21.15.114:0/933897136 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1415400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14200cd100 0x7f14201f9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141e800640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f142015dae0 0x7f1420073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 -- 172.21.15.114:0/933897136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14200cd100 msgr2=0x7f14201f9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14200cd100 0x7f14201f9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 -- 172.21.15.114:0/933897136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f142015dae0 msgr2=0x7f1420073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f142015dae0 0x7f1420073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 -- 172.21.15.114:0/933897136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14201540d0 con 0x7f14200b49e0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f141de00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200b49e0 0x7f1420153b90 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f141000b410 tx=0x7f141000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1416a00640 1 -- 172.21.15.114:0/933897136 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1410015030 con 0x7f14200b49e0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1416a00640 1 -- 172.21.15.114:0/933897136 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1410004020 con 0x7f14200b49e0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1416a00640 1 -- 172.21.15.114:0/933897136 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14100044b0 con 0x7f14200b49e0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142015e100 con 0x7f14200b49e0 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142015e680 con 0x7f14200b49e0 2024-09-16T07:36:36.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.480+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1420069410 con 0x7f14200b49e0 2024-09-16T07:36:36.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.484+0000 7f1416a00640 1 -- 172.21.15.114:0/933897136 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f1410018070 con 0x7f14200b49e0 2024-09-16T07:36:36.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.484+0000 7f1416a00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13fc0738e0 0x7f13fc075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.484+0000 7f1416a00640 1 -- 172.21.15.114:0/933897136 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5795+0+0 (secure 0 0 0) 0x7f14100923d0 con 0x7f14200b49e0 2024-09-16T07:36:36.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.484+0000 7f1415400640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13fc0738e0 0x7f13fc075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.484+0000 7f1415400640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13fc0738e0 0x7f13fc075da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f14080b0000 tx=0x7f14080a8040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:36.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.492+0000 7f1416a00640 1 -- 172.21.15.114:0/933897136 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1410098030 con 0x7f14200b49e0 2024-09-16T07:36:36.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.692+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f14200b1ee0 con 0x7f14200b49e0 2024-09-16T07:36:36.691 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:36:36.692+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:36:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1416a00640 1 -- 172.21.15.114:0/933897136 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v115) ==== 161+0+0 (secure 0 0 0) 0x7f141005e800 con 0x7f14200b49e0 2024-09-16T07:36:36.693 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:36:36.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13fc0738e0 msgr2=0x7f13fc075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13fc0738e0 0x7f13fc075da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f14080b0000 tx=0x7f14080a8040 comp rx=0 tx=0).stop 2024-09-16T07:36:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200b49e0 msgr2=0x7f1420153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200b49e0 0x7f1420153b90 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f141000b410 tx=0x7f141000b8d0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 shutdown_connections 2024-09-16T07:36:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f142015dae0 0x7f1420073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f13fc0738e0 0x7f13fc075da0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14200cd100 0x7f14201f9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 --2- 172.21.15.114:0/933897136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14200b49e0 0x7f1420153b90 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 >> 172.21.15.114:0/933897136 conn(0x7f14200b18f0 msgr2=0x7f1420156250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:36.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 shutdown_connections 2024-09-16T07:36:36.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.696+0000 7f1424a00640 1 -- 172.21.15.114:0/933897136 wait complete. 2024-09-16T07:36:36.716 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:36:36.762 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:36:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 -- 172.21.15.114:0/1726395626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d00f0 msgr2=0x7feb100b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 --2- 172.21.15.114:0/1726395626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d00f0 0x7feb100b15e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7feb00009840 tx=0x7feb0001f010 comp rx=0 tx=0).stop 2024-09-16T07:36:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 -- 172.21.15.114:0/1726395626 shutdown_connections 2024-09-16T07:36:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 --2- 172.21.15.114:0/1726395626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb100d04d0 0x7feb100af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 --2- 172.21.15.114:0/1726395626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d00f0 0x7feb100b15e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 -- 172.21.15.114:0/1726395626 >> 172.21.15.114:0/1726395626 conn(0x7feb100d1e90 msgr2=0x7feb100d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 -- 172.21.15.114:0/1726395626 shutdown_connections 2024-09-16T07:36:36.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 -- 172.21.15.114:0/1726395626 wait complete. 2024-09-16T07:36:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 Processor -- start 2024-09-16T07:36:36.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.864+0000 7feb15000640 1 -- start start 2024-09-16T07:36:36.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb100d00f0 0x7feb101f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d04d0 0x7feb10156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb100d29b0 0x7feb101e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feb100b0ed0 con 0x7feb100d29b0 2024-09-16T07:36:36.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feb100b0d50 con 0x7feb100d04d0 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7feb100af740 con 0x7feb100d00f0 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb100d29b0 0x7feb101e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb100d29b0 0x7feb101e6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34254/0 (socket says 172.21.15.114:34254) 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 -- 172.21.15.114:0/1320921157 learned_addr learned my addr 172.21.15.114:0/1320921157 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0d400640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d04d0 0x7feb10156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0de00640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb100d00f0 0x7feb101f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 -- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb100d00f0 msgr2=0x7feb101f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb100d00f0 0x7feb101f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 -- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d04d0 msgr2=0x7feb10156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d04d0 0x7feb10156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:36.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 -- 172.21.15.114:0/1320921157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb10072260 con 0x7feb100d29b0 2024-09-16T07:36:36.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb0e800640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb100d29b0 0x7feb101e6e60 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7feb0800efd0 tx=0x7feb0800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb06000640 1 -- 172.21.15.114:0/1320921157 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08003b80 con 0x7feb100d29b0 2024-09-16T07:36:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb06000640 1 -- 172.21.15.114:0/1320921157 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb08003d20 con 0x7feb100d29b0 2024-09-16T07:36:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb101f8530 con 0x7feb100d29b0 2024-09-16T07:36:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb06000640 1 -- 172.21.15.114:0/1320921157 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08004280 con 0x7feb100d29b0 2024-09-16T07:36:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb101f8af0 con 0x7feb100d29b0 2024-09-16T07:36:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.868+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb100c7650 con 0x7feb100d29b0 2024-09-16T07:36:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.872+0000 7feb06000640 1 -- 172.21.15.114:0/1320921157 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7feb08004420 con 0x7feb100d29b0 2024-09-16T07:36:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.872+0000 7feb06000640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feaf00738e0 0x7feaf0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.872+0000 7feb06000640 1 -- 172.21.15.114:0/1320921157 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5881+0+0 (secure 0 0 0) 0x7feb080936f0 con 0x7feb100d29b0 2024-09-16T07:36:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.872+0000 7feb0de00640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feaf00738e0 0x7feaf0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.872+0000 7feb0de00640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feaf00738e0 0x7feaf0075da0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feb000b2000 tx=0x7feb0001d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:36.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:36.876+0000 7feb06000640 1 -- 172.21.15.114:0/1320921157 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7feb08060170 con 0x7feb100d29b0 2024-09-16T07:36:37.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.076+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feb100af200 con 0x7feb100d29b0 2024-09-16T07:36:37.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.696+0000 7feb06000640 1 -- 172.21.15.114:0/1320921157 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v116) ==== 104+0+0 (secure 0 0 0) 0x7feb0805fa70 con 0x7feb100d29b0 2024-09-16T07:36:37.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feaf00738e0 msgr2=0x7feaf0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feaf00738e0 0x7feaf0075da0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feb000b2000 tx=0x7feb0001d850 comp rx=0 tx=0).stop 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb100d29b0 msgr2=0x7feb101e6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb100d29b0 0x7feb101e6e60 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7feb0800efd0 tx=0x7feb0800c6a0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 shutdown_connections 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb100d29b0 0x7feb101e6e60 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb100d04d0 0x7feb10156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7feaf00738e0 0x7feaf0075da0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 --2- 172.21.15.114:0/1320921157 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7feb100d00f0 0x7feb101f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 >> 172.21.15.114:0/1320921157 conn(0x7feb100d1e90 msgr2=0x7feb100b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 shutdown_connections 2024-09-16T07:36:37.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.700+0000 7feb15000640 1 -- 172.21.15.114:0/1320921157 wait complete. 2024-09-16T07:36:37.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:36:37.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.916+0000 7f1506a00640 1 -- 172.21.15.114:0/2599487752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e4005220 msgr2=0x7f14e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.916+0000 7f1506a00640 1 --2- 172.21.15.114:0/2599487752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e4005220 0x7f14e400b9d0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009e00 tx=0x7f14f801d170 comp rx=0 tx=0).stop 2024-09-16T07:36:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.916+0000 7f1506a00640 1 -- 172.21.15.114:0/2599487752 shutdown_connections 2024-09-16T07:36:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.916+0000 7f1506a00640 1 --2- 172.21.15.114:0/2599487752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e4005220 0x7f14e400b9d0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.916+0000 7f1506a00640 1 -- 172.21.15.114:0/2599487752 >> 172.21.15.114:0/2599487752 conn(0x7f15000d1dc0 msgr2=0x7f15000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.916+0000 7f1506a00640 1 -- 172.21.15.114:0/2599487752 shutdown_connections 2024-09-16T07:36:37.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.916+0000 7f1506a00640 1 -- 172.21.15.114:0/2599487752 wait complete. 2024-09-16T07:36:37.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 Processor -- start 2024-09-16T07:36:37.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 -- start start 2024-09-16T07:36:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14e4005220 0x7f15000cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:37.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15001566c0 0x7f15001f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f150014b470 0x7f15000ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f150015f880 con 0x7f150014b470 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f15000b33a0 con 0x7f15001566c0 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f15000cfc30 con 0x7f14e4005220 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f150014b470 0x7f15000ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f150014b470 0x7f15000ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34272/0 (socket says 172.21.15.114:34272) 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 -- 172.21.15.114:0/124388260 learned_addr learned my addr 172.21.15.114:0/124388260 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f14ffe00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14e4005220 0x7f15000cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f14f7e00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15001566c0 0x7f15001f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 -- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14e4005220 msgr2=0x7f15000cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:37.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14e4005220 0x7f15000cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 -- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15001566c0 msgr2=0x7f15001f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15001566c0 0x7f15001f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 -- 172.21.15.114:0/124388260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15000b61a0 con 0x7f150014b470 2024-09-16T07:36:37.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f14ffe00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14e4005220 0x7f15000cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:37.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1504a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f150014b470 0x7f15000ceca0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009d50 tx=0x7f14f80046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:37.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f14fcc00640 1 -- 172.21.15.114:0/124388260 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f80bd070 con 0x7f150014b470 2024-09-16T07:36:37.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f14fcc00640 1 -- 172.21.15.114:0/124388260 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14f80a5e60 con 0x7f150014b470 2024-09-16T07:36:37.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f14fcc00640 1 -- 172.21.15.114:0/124388260 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8009a00 con 0x7f150014b470 2024-09-16T07:36:37.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15001f6d80 con 0x7f150014b470 2024-09-16T07:36:37.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.920+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15000b26e0 con 0x7f150014b470 2024-09-16T07:36:37.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.924+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15000d0080 con 0x7f150014b470 2024-09-16T07:36:37.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.924+0000 7f14fcc00640 1 -- 172.21.15.114:0/124388260 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f14f80c0070 con 0x7f150014b470 2024-09-16T07:36:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.924+0000 7f14fcc00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f14dc0738e0 0x7f14dc075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.924+0000 7f14fcc00640 1 -- 172.21.15.114:0/124388260 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5881+0+0 (secure 0 0 0) 0x7f14f812f740 con 0x7f150014b470 2024-09-16T07:36:37.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.924+0000 7f14ffe00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f14dc0738e0 0x7f14dc075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:37.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.924+0000 7f14ffe00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f14dc0738e0 0x7f14dc075da0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15000b5e50 tx=0x7f14f0001d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:37.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:37.928+0000 7f14fcc00640 1 -- 172.21.15.114:0/124388260 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f15001f6d80 con 0x7f150014b470 2024-09-16T07:36:38.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.096+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f150015e7c0 con 0x7f150014b470 2024-09-16T07:36:38.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f14fcc00640 1 -- 172.21.15.114:0/124388260 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v156) ==== 181+0+0 (secure 0 0 0) 0x7f14f8016e80 con 0x7f150014b470 2024-09-16T07:36:38.702 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:36:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f14dc0738e0 msgr2=0x7f14dc075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f14dc0738e0 0x7f14dc075da0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f15000b5e50 tx=0x7f14f0001d40 comp rx=0 tx=0).stop 2024-09-16T07:36:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f150014b470 msgr2=0x7f15000ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f150014b470 0x7f15000ceca0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009d50 tx=0x7f14f80046a0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 shutdown_connections 2024-09-16T07:36:38.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f150014b470 0x7f15000ceca0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15001566c0 0x7f15001f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f14dc0738e0 0x7f14dc075da0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 --2- 172.21.15.114:0/124388260 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f14e4005220 0x7f15000cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 >> 172.21.15.114:0/124388260 conn(0x7f15000d1dc0 msgr2=0x7f15000d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:38.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 shutdown_connections 2024-09-16T07:36:38.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.704+0000 7f1506a00640 1 -- 172.21.15.114:0/124388260 wait complete. 2024-09-16T07:36:38.724 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:36:38.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.872+0000 7f6b57a00640 1 -- 172.21.15.114:0/1086513572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 msgr2=0x7f6b500cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:38.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.872+0000 7f6b57a00640 1 --2- 172.21.15.114:0/1086513572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b500cee10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009900 tx=0x7f6b3801f0d0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.872+0000 7f6b57a00640 1 -- 172.21.15.114:0/1086513572 shutdown_connections 2024-09-16T07:36:38.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.872+0000 7f6b57a00640 1 --2- 172.21.15.114:0/1086513572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b500cee10 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.872+0000 7f6b57a00640 1 -- 172.21.15.114:0/1086513572 >> 172.21.15.114:0/1086513572 conn(0x7f6b500d1da0 msgr2=0x7f6b500d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:38.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.872+0000 7f6b57a00640 1 -- 172.21.15.114:0/1086513572 shutdown_connections 2024-09-16T07:36:38.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.872+0000 7f6b57a00640 1 -- 172.21.15.114:0/1086513572 wait complete. 2024-09-16T07:36:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 Processor -- start 2024-09-16T07:36:38.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 -- start start 2024-09-16T07:36:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b500b0b60 0x7f6b5015f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b5015be10 0x7f6b501f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b50159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:38.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6b500cd670 con 0x7f6b5015c1f0 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6b500cd4f0 con 0x7f6b5015be10 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6b500cd7f0 con 0x7f6b500b0b60 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b50159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b50159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34292/0 (socket says 172.21.15.114:34292) 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 -- 172.21.15.114:0/3951130551 learned_addr learned my addr 172.21.15.114:0/3951130551 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55000640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b500b0b60 0x7f6b5015f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b47e00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b5015be10 0x7f6b501f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 -- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b500b0b60 msgr2=0x7f6b5015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b500b0b60 0x7f6b5015f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 -- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b5015be10 msgr2=0x7f6b501f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b5015be10 0x7f6b501f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 -- 172.21.15.114:0/3951130551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5015f620 con 0x7f6b5015c1f0 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b55a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b50159c30 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c7d0 tx=0x7f6b4800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b4d600640 1 -- 172.21.15.114:0/3951130551 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48003b80 con 0x7f6b5015c1f0 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b4d600640 1 -- 172.21.15.114:0/3951130551 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b48003d40 con 0x7f6b5015c1f0 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5015d050 con 0x7f6b5015c1f0 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b4d600640 1 -- 172.21.15.114:0/3951130551 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800aab0 con 0x7f6b5015c1f0 2024-09-16T07:36:38.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b5015af50 con 0x7f6b5015c1f0 2024-09-16T07:36:38.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.876+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5015d220 con 0x7f6b5015c1f0 2024-09-16T07:36:38.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.880+0000 7f6b4d600640 1 -- 172.21.15.114:0/3951130551 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f6b4800ac50 con 0x7f6b5015c1f0 2024-09-16T07:36:38.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.880+0000 7f6b4d600640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b2c0738e0 0x7f6b2c075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:38.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.880+0000 7f6b4d600640 1 -- 172.21.15.114:0/3951130551 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5443+0+0 (secure 0 0 0) 0x7f6b48092660 con 0x7f6b5015c1f0 2024-09-16T07:36:38.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.880+0000 7f6b55000640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b2c0738e0 0x7f6b2c075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:38.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.880+0000 7f6b55000640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b2c0738e0 0x7f6b2c075da0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6b5015f080 tx=0x7f6b40007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:38.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:38.884+0000 7f6b4d600640 1 -- 172.21.15.114:0/3951130551 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6b5015f620 con 0x7f6b5015c1f0 2024-09-16T07:36:39.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.052+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b500cdca0 con 0x7f6b5015c1f0 2024-09-16T07:36:39.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.704+0000 7f6b4d600640 1 -- 172.21.15.114:0/3951130551 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v157) ==== 169+0+0 (secure 0 0 0) 0x7f6b4805ea90 con 0x7f6b5015c1f0 2024-09-16T07:36:39.704 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:36:39.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b2c0738e0 msgr2=0x7f6b2c075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:39.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b2c0738e0 0x7f6b2c075da0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6b5015f080 tx=0x7f6b40007e40 comp rx=0 tx=0).stop 2024-09-16T07:36:39.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 msgr2=0x7f6b50159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:39.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b50159c30 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800c7d0 tx=0x7f6b4800cc90 comp rx=0 tx=0).stop 2024-09-16T07:36:39.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 shutdown_connections 2024-09-16T07:36:39.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6b5015c1f0 0x7f6b50159c30 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b5015be10 0x7f6b501f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6b2c0738e0 0x7f6b2c075da0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 --2- 172.21.15.114:0/3951130551 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b500b0b60 0x7f6b5015f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 >> 172.21.15.114:0/3951130551 conn(0x7f6b500d1da0 msgr2=0x7f6b500b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:39.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 shutdown_connections 2024-09-16T07:36:39.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.708+0000 7f6b57a00640 1 -- 172.21.15.114:0/3951130551 wait complete. 2024-09-16T07:36:39.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:36:39.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 -- 172.21.15.114:0/1324345879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 msgr2=0x7f30040b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:39.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 --2- 172.21.15.114:0/1324345879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 0x7f30040b41e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009840 tx=0x7f2ffc01c790 comp rx=0 tx=0).stop 2024-09-16T07:36:39.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 -- 172.21.15.114:0/1324345879 shutdown_connections 2024-09-16T07:36:39.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 --2- 172.21.15.114:0/1324345879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 0x7f30040b41e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 --2- 172.21.15.114:0/1324345879 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f300406f8c0 0x7f300406fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 -- 172.21.15.114:0/1324345879 >> 172.21.15.114:0/1324345879 conn(0x7f30040b18f0 msgr2=0x7f30040b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:39.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 -- 172.21.15.114:0/1324345879 shutdown_connections 2024-09-16T07:36:39.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 -- 172.21.15.114:0/1324345879 wait complete. 2024-09-16T07:36:39.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 Processor -- start 2024-09-16T07:36:39.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.880+0000 7f300c200640 1 -- start start 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300406f8c0 0x7f300409cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 0x7f300413e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30040cc740 0x7f300413e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3004165550 con 0x7f300406f8c0 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f30041653d0 con 0x7f30040b3d30 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f30041656d0 con 0x7f30040cc740 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300406f8c0 0x7f300409cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300406f8c0 0x7f300409cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34306/0 (socket says 172.21.15.114:34306) 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 -- 172.21.15.114:0/11485954 learned_addr learned my addr 172.21.15.114:0/11485954 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:39.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3008e00640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 0x7f300413e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:39.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300a200640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30040cc740 0x7f300413e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:39.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 -- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30040cc740 msgr2=0x7f300413e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:39.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30040cc740 0x7f300413e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 -- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 msgr2=0x7f300413e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:39.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 0x7f300413e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:39.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 -- 172.21.15.114:0/11485954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300413be50 con 0x7f300406f8c0 2024-09-16T07:36:39.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3009800640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300406f8c0 0x7f300409cfe0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009dc0 tx=0x7f2ff800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:39.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3001600640 1 -- 172.21.15.114:0/11485954 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8003b80 con 0x7f300406f8c0 2024-09-16T07:36:39.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3001600640 1 -- 172.21.15.114:0/11485954 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ff8003d20 con 0x7f300406f8c0 2024-09-16T07:36:39.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f3001600640 1 -- 172.21.15.114:0/11485954 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8004280 con 0x7f300406f8c0 2024-09-16T07:36:39.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3004166c00 con 0x7f300406f8c0 2024-09-16T07:36:39.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300413c300 con 0x7f300406f8c0 2024-09-16T07:36:39.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.884+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3004069410 con 0x7f300406f8c0 2024-09-16T07:36:39.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.888+0000 7f3001600640 1 -- 172.21.15.114:0/11485954 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f2ff8004420 con 0x7f300406f8c0 2024-09-16T07:36:39.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.888+0000 7f3001600640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2fe40738e0 0x7f2fe4075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:39.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.888+0000 7f3001600640 1 -- 172.21.15.114:0/11485954 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7f2ff8093630 con 0x7f300406f8c0 2024-09-16T07:36:39.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.888+0000 7f3008e00640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2fe40738e0 0x7f2fe4075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:39.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.888+0000 7f3008e00640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2fe40738e0 0x7f2fe4075da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f300409dc10 tx=0x7f2ff0001380 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:39.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:39.892+0000 7f3001600640 1 -- 172.21.15.114:0/11485954 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2ff805f9e0 con 0x7f300406f8c0 2024-09-16T07:36:40.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.060+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f30041669f0 con 0x7f300406f8c0 2024-09-16T07:36:40.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.064+0000 7f3001600640 1 -- 172.21.15.114:0/11485954 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v47) ==== 71+0+0 (secure 0 0 0) 0x7f2ff8064410 con 0x7f300406f8c0 2024-09-16T07:36:40.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2fe40738e0 msgr2=0x7f2fe4075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2fe40738e0 0x7f2fe4075da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f300409dc10 tx=0x7f2ff0001380 comp rx=0 tx=0).stop 2024-09-16T07:36:40.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300406f8c0 msgr2=0x7f300409cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300406f8c0 0x7f300409cfe0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009dc0 tx=0x7f2ff800c6a0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 shutdown_connections 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2fe40738e0 0x7f2fe4075da0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30040cc740 0x7f300413e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30040b3d30 0x7f300413e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 --2- 172.21.15.114:0/11485954 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f300406f8c0 0x7f300409cfe0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 >> 172.21.15.114:0/11485954 conn(0x7f30040b18f0 msgr2=0x7f300415de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 shutdown_connections 2024-09-16T07:36:40.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.068+0000 7f300c200640 1 -- 172.21.15.114:0/11485954 wait complete. 2024-09-16T07:36:40.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-16T07:36:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 -- 172.21.15.114:0/917613996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1613d0 msgr2=0x7f0fbc0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/917613996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1613d0 0x7f0fbc0d0540 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009840 tx=0x7f0fac01c7b0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 -- 172.21.15.114:0/917613996 shutdown_connections 2024-09-16T07:36:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/917613996 >> v2:172.21.15.149:3300/0 conn(0x7f0fbc0d29e0 0x7f0fbc0b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/917613996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1613d0 0x7f0fbc0d0540 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 -- 172.21.15.114:0/917613996 >> 172.21.15.114:0/917613996 conn(0x7f0fbc0d3e00 msgr2=0x7f0fbc0d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 -- 172.21.15.114:0/917613996 shutdown_connections 2024-09-16T07:36:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 -- 172.21.15.114:0/917613996 wait complete. 2024-09-16T07:36:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 Processor -- start 2024-09-16T07:36:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.228+0000 7f0fc0a00640 1 -- start start 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fbc0d29e0 0x7f0fbc156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fbc1613d0 0x7f0fbc15ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1617b0 0x7f0fbc152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc16acc0 con 0x7f0fbc1617b0 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0b8260 con 0x7f0fbc0d29e0 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc16ae40 con 0x7f0fbc1613d0 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1617b0 0x7f0fbc152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1617b0 0x7f0fbc152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34318/0 (socket says 172.21.15.114:34318) 2024-09-16T07:36:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 -- 172.21.15.114:0/2738863594 learned_addr learned my addr 172.21.15.114:0/2738863594 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbaa00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fbc1613d0 0x7f0fbc15ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbb400640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fbc0d29e0 0x7f0fbc156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 -- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fbc1613d0 msgr2=0x7f0fbc15ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fbc1613d0 0x7f0fbc15ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 -- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fbc0d29e0 msgr2=0x7f0fbc156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fbc0d29e0 0x7f0fbc156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 -- 172.21.15.114:0/2738863594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc0cf280 con 0x7f0fbc1617b0 2024-09-16T07:36:40.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fbbe00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1617b0 0x7f0fbc152e20 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400b9e0 tx=0x7f0fb400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fb3400640 1 -- 172.21.15.114:0/2738863594 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4019070 con 0x7f0fbc1617b0 2024-09-16T07:36:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fb3400640 1 -- 172.21.15.114:0/2738863594 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb400cc10 con 0x7f0fbc1617b0 2024-09-16T07:36:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc0d43f0 con 0x7f0fbc1617b0 2024-09-16T07:36:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fb3400640 1 -- 172.21.15.114:0/2738863594 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40146a0 con 0x7f0fbc1617b0 2024-09-16T07:36:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc15d2e0 con 0x7f0fbc1617b0 2024-09-16T07:36:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.232+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc0b9a50 con 0x7f0fbc1617b0 2024-09-16T07:36:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.236+0000 7f0fb3400640 1 -- 172.21.15.114:0/2738863594 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f0fb401c070 con 0x7f0fbc1617b0 2024-09-16T07:36:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.236+0000 7f0fb3400640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f9c0738e0 0x7f0f9c075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.236+0000 7f0fb3400640 1 -- 172.21.15.114:0/2738863594 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7f0fb4092690 con 0x7f0fbc1617b0 2024-09-16T07:36:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.236+0000 7f0fbb400640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f9c0738e0 0x7f0f9c075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.236+0000 7f0fbb400640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f9c0738e0 0x7f0f9c075da0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0af000 tx=0x7f0fac01aff0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.240+0000 7f0fb3400640 1 -- 172.21.15.114:0/2738863594 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0fb405eac0 con 0x7f0fbc1617b0 2024-09-16T07:36:40.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.468+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7f0fbc0b6f60 con 0x7f0fbc1617b0 2024-09-16T07:36:40.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fb3400640 1 -- 172.21.15.114:0/2738863594 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v467) ==== 145+0+0 (secure 0 0 0) 0x7f0fb40634f0 con 0x7f0fbc1617b0 2024-09-16T07:36:40.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f9c0738e0 msgr2=0x7f0f9c075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f9c0738e0 0x7f0f9c075da0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0af000 tx=0x7f0fac01aff0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1617b0 msgr2=0x7f0fbc152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1617b0 0x7f0fbc152e20 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400b9e0 tx=0x7f0fb400bea0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 shutdown_connections 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fbc1617b0 0x7f0fbc152e20 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f9c0738e0 0x7f0f9c075da0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0fbc1613d0 0x7f0fbc15ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 --2- 172.21.15.114:0/2738863594 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0fbc0d29e0 0x7f0fbc156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 >> 172.21.15.114:0/2738863594 conn(0x7f0fbc0d3e00 msgr2=0x7f0fbc0b9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 shutdown_connections 2024-09-16T07:36:40.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.716+0000 7f0fc0a00640 1 -- 172.21.15.114:0/2738863594 wait complete. 2024-09-16T07:36:40.736 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-16T07:36:40.736 INFO:tasks.cephfs_test_runner:Starting test: test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate unparseable text .meta file on legacy subvol root doesn't break the system 2024-09-16T07:36:40.736 INFO:tasks.cephfs_test_runner:test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-16T07:36:40.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 -- 172.21.15.114:0/1141083587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e415c3e0 msgr2=0x7fe0e415c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/1141083587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e415c3e0 0x7fe0e415c7c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009840 tx=0x7fe0d401f010 comp rx=0 tx=0).stop 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 -- 172.21.15.114:0/1141083587 shutdown_connections 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/1141083587 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e415bfa0 0x7fe0e40cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/1141083587 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e415c3e0 0x7fe0e415c7c0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 -- 172.21.15.114:0/1141083587 >> 172.21.15.114:0/1141083587 conn(0x7fe0e40b18f0 msgr2=0x7fe0e40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 -- 172.21.15.114:0/1141083587 shutdown_connections 2024-09-16T07:36:40.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 -- 172.21.15.114:0/1141083587 wait complete. 2024-09-16T07:36:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 Processor -- start 2024-09-16T07:36:40.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.884+0000 7fe0eaa00640 1 -- start start 2024-09-16T07:36:40.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e40cd540 0x7fe0e41f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e415bfa0 0x7fe0e41590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e415c3e0 0x7fe0e415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e4160020 con 0x7fe0e40cd540 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e406f890 con 0x7fe0e415bfa0 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e41601a0 con 0x7fe0e415c3e0 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e40cd540 0x7fe0e41f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e40cd540 0x7fe0e41f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34332/0 (socket says 172.21.15.114:34332) 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 -- 172.21.15.114:0/227107622 learned_addr learned my addr 172.21.15.114:0/227107622 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e8a00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e415c3e0 0x7fe0e415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0dbe00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e415bfa0 0x7fe0e41590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 -- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e415c3e0 msgr2=0x7fe0e415d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e415c3e0 0x7fe0e415d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 -- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e415bfa0 msgr2=0x7fe0e41590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e415bfa0 0x7fe0e41590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 -- 172.21.15.114:0/227107622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e415b7f0 con 0x7fe0e40cd540 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e3e00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e40cd540 0x7fe0e41f1ee0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009930 tx=0x7fe0d4005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e0c00640 1 -- 172.21.15.114:0/227107622 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d40b5040 con 0x7fe0e40cd540 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e0c00640 1 -- 172.21.15.114:0/227107622 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d4003600 con 0x7fe0e40cd540 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e0c00640 1 -- 172.21.15.114:0/227107622 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d40039d0 con 0x7fe0e40cd540 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e4159a70 con 0x7fe0e40cd540 2024-09-16T07:36:40.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e41588d0 con 0x7fe0e40cd540 2024-09-16T07:36:40.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e4069410 con 0x7fe0e40cd540 2024-09-16T07:36:40.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.888+0000 7fe0e0c00640 1 -- 172.21.15.114:0/227107622 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fe0d40c0030 con 0x7fe0e40cd540 2024-09-16T07:36:40.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.892+0000 7fe0e0c00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0c00738e0 0x7fe0c0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:40.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.892+0000 7fe0e0c00640 1 -- 172.21.15.114:0/227107622 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7fe0d412fce0 con 0x7fe0e40cd540 2024-09-16T07:36:40.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.892+0000 7fe0dbe00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0c00738e0 0x7fe0c0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:40.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.892+0000 7fe0dbe00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0c00738e0 0x7fe0c0075da0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0058d0 tx=0x7fe0cc005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:40.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:40.896+0000 7fe0e0c00640 1 -- 172.21.15.114:0/227107622 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe0d40c7020 con 0x7fe0e40cd540 2024-09-16T07:36:41.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.060+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0e4160620 con 0x7fe0e40cd540 2024-09-16T07:36:41.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.060+0000 7fe0e0c00640 1 -- 172.21.15.114:0/227107622 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+13136 (secure 0 0 0) 0x7fe0d4018b70 con 0x7fe0e40cd540 2024-09-16T07:36:41.061 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:41.061 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":157,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:39.708964+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6834/2318653579":"2024-09-17T07:36:36.698323+0000","172.21.15.114:6832/2318653579":"2024-09-17T07:36:36.698323+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0c00738e0 msgr2=0x7fe0c0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0c00738e0 0x7fe0c0075da0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0058d0 tx=0x7fe0cc005860 comp rx=0 tx=0).stop 2024-09-16T07:36:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e40cd540 msgr2=0x7fe0e41f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e40cd540 0x7fe0e41f1ee0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009930 tx=0x7fe0d4005d20 comp rx=0 tx=0).stop 2024-09-16T07:36:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 shutdown_connections 2024-09-16T07:36:41.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe0c00738e0 0x7fe0c0075da0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe0e415c3e0 0x7fe0e415d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0e415bfa0 0x7fe0e41590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 --2- 172.21.15.114:0/227107622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0e40cd540 0x7fe0e41f1ee0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 >> 172.21.15.114:0/227107622 conn(0x7fe0e40b18f0 msgr2=0x7fe0e40cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 shutdown_connections 2024-09-16T07:36:41.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.064+0000 7fe0eaa00640 1 -- 172.21.15.114:0/227107622 wait complete. 2024-09-16T07:36:41.083 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T07:28:11.019635+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T07:36:41.083 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T07:36:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 -- 172.21.15.114:0/2665717089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 msgr2=0x7f550c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 --2- 172.21.15.114:0/2665717089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c0ce670 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f550c0cf780 tx=0x7f550401ca60 comp rx=0 tx=0).stop 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 -- 172.21.15.114:0/2665717089 shutdown_connections 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 --2- 172.21.15.114:0/2665717089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c0ce670 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 --2- 172.21.15.114:0/2665717089 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f550c0b0d10 0x7f550c0d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 --2- 172.21.15.114:0/2665717089 >> v2:172.21.15.149:3300/0 conn(0x7f550c15bd40 0x7f550c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 -- 172.21.15.114:0/2665717089 >> 172.21.15.114:0/2665717089 conn(0x7f550c09aa10 msgr2=0x7f550c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 -- 172.21.15.114:0/2665717089 shutdown_connections 2024-09-16T07:36:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 -- 172.21.15.114:0/2665717089 wait complete. 2024-09-16T07:36:41.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.228+0000 7f5511800640 1 Processor -- start 2024-09-16T07:36:41.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 -- start start 2024-09-16T07:36:41.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f550c0b0d10 0x7f550c14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f550c15bd40 0x7f550c15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0cce60 con 0x7f550c0d20f0 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0ccce0 con 0x7f550c15bd40 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f550c0ccfe0 con 0x7f550c0b0d10 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c15e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34354/0 (socket says 172.21.15.114:34354) 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 -- 172.21.15.114:0/2869417313 learned_addr learned my addr 172.21.15.114:0/2869417313 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5510e00640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f550c15bd40 0x7f550c15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550be00640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f550c0b0d10 0x7f550c14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 -- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f550c0b0d10 msgr2=0x7f550c14c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f550c0b0d10 0x7f550c14c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 -- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f550c15bd40 msgr2=0x7f550c15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f550c15bd40 0x7f550c15ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 -- 172.21.15.114:0/2869417313 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c0d1ea0 con 0x7f550c0d20f0 2024-09-16T07:36:41.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f550b400640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c15e930 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f54f800d750 tx=0x7f54f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:41.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5503e00640 1 -- 172.21.15.114:0/2869417313 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8017070 con 0x7f550c0d20f0 2024-09-16T07:36:41.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5503e00640 1 -- 172.21.15.114:0/2869417313 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54f8009d20 con 0x7f550c0d20f0 2024-09-16T07:36:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5503e00640 1 -- 172.21.15.114:0/2869417313 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f800de60 con 0x7f550c0d20f0 2024-09-16T07:36:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c14c5b0 con 0x7f550c0d20f0 2024-09-16T07:36:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c15de50 con 0x7f550c0d20f0 2024-09-16T07:36:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.232+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550c0cd500 con 0x7f550c0d20f0 2024-09-16T07:36:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.236+0000 7f5503e00640 1 -- 172.21.15.114:0/2869417313 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f54f8005280 con 0x7f550c0d20f0 2024-09-16T07:36:41.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.236+0000 7f5503e00640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54ec0738e0 0x7f54ec075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.236+0000 7f5503e00640 1 -- 172.21.15.114:0/2869417313 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7f54f8092ac0 con 0x7f550c0d20f0 2024-09-16T07:36:41.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.236+0000 7f550be00640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54ec0738e0 0x7f54ec075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.236+0000 7f550be00640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54ec0738e0 0x7f54ec075da0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00bb50 tx=0x7f54fc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.240+0000 7f5503e00640 1 -- 172.21.15.114:0/2869417313 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f54f805eeb0 con 0x7f550c0d20f0 2024-09-16T07:36:41.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.404+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f550c071450 con 0x7f550c0d20f0 2024-09-16T07:36:41.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.404+0000 7f5503e00640 1 -- 172.21.15.114:0/2869417313 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) ==== 93+0+10 (secure 0 0 0) 0x7f54f80638e0 con 0x7f550c0d20f0 2024-09-16T07:36:41.404 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54ec0738e0 msgr2=0x7f54ec075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54ec0738e0 0x7f54ec075da0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00bb50 tx=0x7f54fc00b2e0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 msgr2=0x7f550c15e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c15e930 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f54f800d750 tx=0x7f54f800dc10 comp rx=0 tx=0).stop 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 shutdown_connections 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f550c15bd40 0x7f550c15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f550c0d20f0 0x7f550c15e930 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f54ec0738e0 0x7f54ec075da0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 --2- 172.21.15.114:0/2869417313 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f550c0b0d10 0x7f550c14c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 >> 172.21.15.114:0/2869417313 conn(0x7f550c09aa10 msgr2=0x7f550c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:41.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 shutdown_connections 2024-09-16T07:36:41.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.408+0000 7f5511800640 1 -- 172.21.15.114:0/2869417313 wait complete. 2024-09-16T07:36:41.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-16T07:36:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- 172.21.15.114:0/4125645871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c0b2590 msgr2=0x7f4b7c0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 --2- 172.21.15.114:0/4125645871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c0b2590 0x7f4b7c0b2a00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009bc0 tx=0x7f4b7401cb10 comp rx=0 tx=0).stop 2024-09-16T07:36:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- 172.21.15.114:0/4125645871 shutdown_connections 2024-09-16T07:36:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 --2- 172.21.15.114:0/4125645871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c0b2590 0x7f4b7c0b2a00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 --2- 172.21.15.114:0/4125645871 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4b7c0d01b0 0x7f4b7c0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- 172.21.15.114:0/4125645871 >> 172.21.15.114:0/4125645871 conn(0x7f4b7c09aa10 msgr2=0x7f4b7c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:41.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- 172.21.15.114:0/4125645871 shutdown_connections 2024-09-16T07:36:41.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- 172.21.15.114:0/4125645871 wait complete. 2024-09-16T07:36:41.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 Processor -- start 2024-09-16T07:36:41.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- start start 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4b7c0b2590 0x7f4b7c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b7c0d01b0 0x7f4b7c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c15f000 0x7f4b7c0af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c168ea0 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c168d20 con 0x7f4b7c15f000 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7b200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c169020 con 0x7f4b7c0b2590 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b71400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b7c0d01b0 0x7f4b7c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b71400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b7c0d01b0 0x7f4b7c14ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34362/0 (socket says 172.21.15.114:34362) 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b71400640 1 -- 172.21.15.114:0/258951220 learned_addr learned my addr 172.21.15.114:0/258951220 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b7a800640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c15f000 0x7f4b7c0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.568+0000 7f4b79e00640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4b7c0b2590 0x7f4b7c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b71400640 1 -- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4b7c0b2590 msgr2=0x7f4b7c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b71400640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4b7c0b2590 0x7f4b7c159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b71400640 1 -- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c15f000 msgr2=0x7f4b7c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b71400640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c15f000 0x7f4b7c0af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b71400640 1 -- 172.21.15.114:0/258951220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c15bf80 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b71400640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b7c0d01b0 0x7f4b7c14ffb0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400e9f0 tx=0x7f4b6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:41.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b72a00640 1 -- 172.21.15.114:0/258951220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400cd80 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b72a00640 1 -- 172.21.15.114:0/258951220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b64010430 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b72a00640 1 -- 172.21.15.114:0/258951220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64010860 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c15c260 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c0b63c0 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b7c0cefb0 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b72a00640 1 -- 172.21.15.114:0/258951220 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f4b64010a00 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b72a00640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4b580738e0 0x7f4b58075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b72a00640 1 -- 172.21.15.114:0/258951220 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7f4b640934c0 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.572+0000 7f4b79e00640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4b580738e0 0x7f4b58075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:41.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.576+0000 7f4b79e00640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4b580738e0 0x7f4b58075da0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c001640 tx=0x7f4b6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:41.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.576+0000 7f4b72a00640 1 -- 172.21.15.114:0/258951220 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4b64060040 con 0x7f4b7c0d01b0 2024-09-16T07:36:41.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:41.804+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f4b7c159980 con 0x7f4b7c0d01b0 2024-09-16T07:36:42.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.724+0000 7f4b72a00640 1 -- 172.21.15.114:0/258951220 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v469) ==== 166+0+0 (secure 0 0 0) 0x7f4b6405f940 con 0x7f4b7c0d01b0 2024-09-16T07:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4b580738e0 msgr2=0x7f4b58075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4b580738e0 0x7f4b58075da0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c001640 tx=0x7f4b6c009040 comp rx=0 tx=0).stop 2024-09-16T07:36:42.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b7c0d01b0 msgr2=0x7f4b7c14ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b7c0d01b0 0x7f4b7c14ffb0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400e9f0 tx=0x7f4b6400eeb0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 shutdown_connections 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b7c15f000 0x7f4b7c0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b7c0d01b0 0x7f4b7c14ffb0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4b580738e0 0x7f4b58075da0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 --2- 172.21.15.114:0/258951220 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4b7c0b2590 0x7f4b7c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 >> 172.21.15.114:0/258951220 conn(0x7f4b7c09aa10 msgr2=0x7f4b7c0ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 shutdown_connections 2024-09-16T07:36:42.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.728+0000 7f4b7b200640 1 -- 172.21.15.114:0/258951220 wait complete. 2024-09-16T07:36:42.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 -- 172.21.15.114:0/2994674762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c15e330 msgr2=0x7ff44c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 --2- 172.21.15.114:0/2994674762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c15e330 0x7ff44c06ec80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff438009900 tx=0x7ff43801c7c0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 -- 172.21.15.114:0/2994674762 shutdown_connections 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 --2- 172.21.15.114:0/2994674762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c15e330 0x7ff44c06ec80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 --2- 172.21.15.114:0/2994674762 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff44c15df50 0x7ff44c06e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 -- 172.21.15.114:0/2994674762 >> 172.21.15.114:0/2994674762 conn(0x7ff44c0d1dc0 msgr2=0x7ff44c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 -- 172.21.15.114:0/2994674762 shutdown_connections 2024-09-16T07:36:42.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.896+0000 7ff452000640 1 -- 172.21.15.114:0/2994674762 wait complete. 2024-09-16T07:36:42.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 Processor -- start 2024-09-16T07:36:42.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 -- start start 2024-09-16T07:36:42.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c0b11d0 0x7ff44c1fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff44c15df50 0x7ff44c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff44c15e330 0x7ff44c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff44c0d0760 con 0x7ff44c15e330 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff44c0d05e0 con 0x7ff44c0b11d0 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff44c0d08e0 con 0x7ff44c15df50 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff44c15e330 0x7ff44c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff44c15e330 0x7ff44c15c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34366/0 (socket says 172.21.15.114:34366) 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 -- 172.21.15.114:0/736759951 learned_addr learned my addr 172.21.15.114:0/736759951 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44aa00640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff44c15df50 0x7ff44c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44b400640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c0b11d0 0x7ff44c1fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 -- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff44c15df50 msgr2=0x7ff44c156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff44c15df50 0x7ff44c156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 -- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c0b11d0 msgr2=0x7ff44c1fb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:42.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c0b11d0 0x7ff44c1fb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 -- 172.21.15.114:0/736759951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44c0ce720 con 0x7ff44c15e330 2024-09-16T07:36:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff44be00640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff44c15e330 0x7ff44c15c470 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff44400c790 tx=0x7ff44400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff443400640 1 -- 172.21.15.114:0/736759951 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff444003b80 con 0x7ff44c15e330 2024-09-16T07:36:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff443400640 1 -- 172.21.15.114:0/736759951 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff444003d40 con 0x7ff44c15e330 2024-09-16T07:36:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff44c0cea00 con 0x7ff44c15e330 2024-09-16T07:36:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff443400640 1 -- 172.21.15.114:0/736759951 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44400aab0 con 0x7ff44c15e330 2024-09-16T07:36:42.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff44c14b9b0 con 0x7ff44c15e330 2024-09-16T07:36:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.900+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44c0afcd0 con 0x7ff44c15e330 2024-09-16T07:36:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.904+0000 7ff443400640 1 -- 172.21.15.114:0/736759951 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7ff44400ac50 con 0x7ff44c15e330 2024-09-16T07:36:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.904+0000 7ff443400640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff42c0738e0 0x7ff42c075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.904+0000 7ff443400640 1 -- 172.21.15.114:0/736759951 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7ff444092640 con 0x7ff44c15e330 2024-09-16T07:36:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.904+0000 7ff44b400640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff42c0738e0 0x7ff42c075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:42.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.904+0000 7ff44b400640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff42c0738e0 0x7ff42c075da0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009600 tx=0x7ff43c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:42.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:42.908+0000 7ff443400640 1 -- 172.21.15.114:0/736759951 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ff44405ea70 con 0x7ff44c15e330 2024-09-16T07:36:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff44c14d9a0 con 0x7ff44c15e330 2024-09-16T07:36:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff443400640 1 -- 172.21.15.114:0/736759951 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v47) ==== 59+0+1998 (secure 0 0 0) 0x7ff4440634a0 con 0x7ff44c15e330 2024-09-16T07:36:43.074 INFO:teuthology.orchestra.run.smithi114.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4856.514718 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4714.958148 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6215.503000 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4897.149583 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3862.707768 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.307388 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3702.837272 2024-09-16T07:36:43.075 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4218.668316 2024-09-16T07:36:43.076 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds 20/20 2024-09-16T07:36:43.076 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T07:36:43.076 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced debug_ms 2/2 2024-09-16T07:36:43.076 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_frag true 2024-09-16T07:36:43.076 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_debug_scatterstat true 2024-09-16T07:36:43.076 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T07:36:43.076 INFO:teuthology.orchestra.run.smithi114.stdout:mds dev mds_verify_scatter true 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced client_mount_timeout 600 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_client 20/20 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced debug_ms 1/1 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T07:36:43.077 INFO:teuthology.orchestra.run.smithi114.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T07:36:43.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff42c0738e0 msgr2=0x7ff42c075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff42c0738e0 0x7ff42c075da0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009600 tx=0x7ff43c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff44c15e330 msgr2=0x7ff44c15c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff44c15e330 0x7ff44c15c470 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff44400c790 tx=0x7ff44400cc50 comp rx=0 tx=0).stop 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 shutdown_connections 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff44c15e330 0x7ff44c15c470 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff42c0738e0 0x7ff42c075da0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff44c15df50 0x7ff44c156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 --2- 172.21.15.114:0/736759951 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff44c0b11d0 0x7ff44c1fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 >> 172.21.15.114:0/736759951 conn(0x7ff44c0d1dc0 msgr2=0x7ff44c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 shutdown_connections 2024-09-16T07:36:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.076+0000 7ff452000640 1 -- 172.21.15.114:0/736759951 wait complete. 2024-09-16T07:36:43.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:36:43.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.240+0000 7f2a84800640 1 -- 172.21.15.114:0/3466039628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a64004d50 msgr2=0x7f2a640051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.240+0000 7f2a84800640 1 --2- 172.21.15.114:0/3466039628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a64004d50 0x7f2a640051d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f2a7800c640 tx=0x7f2a7801fa80 comp rx=0 tx=0).stop 2024-09-16T07:36:43.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.240+0000 7f2a82800640 1 -- 172.21.15.114:0/3466039628 reap_dead start 2024-09-16T07:36:43.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.240+0000 7f2a84800640 1 -- 172.21.15.114:0/3466039628 shutdown_connections 2024-09-16T07:36:43.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.240+0000 7f2a84800640 1 -- 172.21.15.114:0/3466039628 >> 172.21.15.114:0/3466039628 conn(0x7f2a7c0b18f0 msgr2=0x7f2a7c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:43.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.240+0000 7f2a84800640 1 -- 172.21.15.114:0/3466039628 shutdown_connections 2024-09-16T07:36:43.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.240+0000 7f2a84800640 1 -- 172.21.15.114:0/3466039628 wait complete. 2024-09-16T07:36:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 Processor -- start 2024-09-16T07:36:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 -- start start 2024-09-16T07:36:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64004d50 0x7f2a7c1485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a7c1572a0 0x7f2a7c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c073970 0x7f2a7c073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c06fb40 con 0x7f2a7c073970 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c06f9c0 con 0x7f2a64004d50 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c0acd40 con 0x7f2a7c1572a0 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c073970 0x7f2a7c073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c073970 0x7f2a7c073df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34388/0 (socket says 172.21.15.114:34388) 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 -- 172.21.15.114:0/1168305337 learned_addr learned my addr 172.21.15.114:0/1168305337 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a81e00640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64004d50 0x7f2a7c1485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a81400640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a7c1572a0 0x7f2a7c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 -- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a7c1572a0 msgr2=0x7f2a7c157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a7c1572a0 0x7f2a7c157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 -- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64004d50 msgr2=0x7f2a7c1485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64004d50 0x7f2a7c1485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 -- 172.21.15.114:0/1168305337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c1f29d0 con 0x7f2a7c073970 2024-09-16T07:36:43.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a82800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c073970 0x7f2a7c073df0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f2a78020320 tx=0x7f2a780020f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:43.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a76000640 1 -- 172.21.15.114:0/1168305337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a780011d0 con 0x7f2a7c073970 2024-09-16T07:36:43.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a76000640 1 -- 172.21.15.114:0/1168305337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a78003980 con 0x7f2a7c073970 2024-09-16T07:36:43.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a76000640 1 -- 172.21.15.114:0/1168305337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78003d30 con 0x7f2a7c073970 2024-09-16T07:36:43.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c1f2cb0 con 0x7f2a7c073970 2024-09-16T07:36:43.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c1f3270 con 0x7f2a7c073970 2024-09-16T07:36:43.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.244+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c069410 con 0x7f2a7c073970 2024-09-16T07:36:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.248+0000 7f2a76000640 1 -- 172.21.15.114:0/1168305337 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f2a780ba030 con 0x7f2a7c073970 2024-09-16T07:36:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.248+0000 7f2a76000640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2a60073910 0x7f2a60075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.248+0000 7f2a76000640 1 -- 172.21.15.114:0/1168305337 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7f2a7812f3c0 con 0x7f2a7c073970 2024-09-16T07:36:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.248+0000 7f2a81e00640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2a60073910 0x7f2a60075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.248+0000 7f2a81e00640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2a60073910 0x7f2a60075dd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009b60 tx=0x7f2a700091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:43.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.252+0000 7f2a76000640 1 -- 172.21.15.114:0/1168305337 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f2a78019830 con 0x7f2a7c073970 2024-09-16T07:36:43.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.420+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2a7c0cd570 con 0x7f2a7c073970 2024-09-16T07:36:43.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a76000640 1 -- 172.21.15.114:0/1168305337 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f2a780fb7f0 con 0x7f2a7c073970 2024-09-16T07:36:43.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2a60073910 msgr2=0x7f2a60075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2a60073910 0x7f2a60075dd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009b60 tx=0x7f2a700091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c073970 msgr2=0x7f2a7c073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c073970 0x7f2a7c073df0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f2a78020320 tx=0x7f2a780020f0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 shutdown_connections 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a7c073970 0x7f2a7c073df0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2a60073910 0x7f2a60075dd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2a7c1572a0 0x7f2a7c157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 --2- 172.21.15.114:0/1168305337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a64004d50 0x7f2a7c1485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 >> 172.21.15.114:0/1168305337 conn(0x7f2a7c0b18f0 msgr2=0x7f2a7c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 shutdown_connections 2024-09-16T07:36:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.424+0000 7f2a84800640 1 -- 172.21.15.114:0/1168305337 wait complete. 2024-09-16T07:36:43.445 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:36:43.445 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:36:43.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:36:43.613 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:36:43.613 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:43.613 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:43.622 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:36:43.622 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:43.622 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:43.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:36:43.632 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:36:43.632 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:43.673 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:36:43.673 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:36:43.673 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:36:43.682 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:36:43.682 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T07:36:43.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:43.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- 172.21.15.114:0/3219407583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 msgr2=0x7f1ab000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 --2- 172.21.15.114:0/3219407583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ab000b9d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000e400 tx=0x7f1ac001d7f0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- 172.21.15.114:0/3219407583 shutdown_connections 2024-09-16T07:36:43.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 --2- 172.21.15.114:0/3219407583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ab000b9d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- 172.21.15.114:0/3219407583 >> 172.21.15.114:0/3219407583 conn(0x7f1ac80d1dc0 msgr2=0x7f1ac80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:43.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- 172.21.15.114:0/3219407583 shutdown_connections 2024-09-16T07:36:43.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- 172.21.15.114:0/3219407583 wait complete. 2024-09-16T07:36:43.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 Processor -- start 2024-09-16T07:36:43.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- start start 2024-09-16T07:36:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ac81e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac814a1d0 0x7f1ac80ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac80cb9b0 0x7f1ac81ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac80d2a60 con 0x7f1ab00051d0 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac80d28e0 con 0x7f1ac80cb9b0 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ad0200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac80d2be0 con 0x7f1ac814a1d0 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ac81e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ac81e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34406/0 (socket says 172.21.15.114:34406) 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 -- 172.21.15.114:0/4214617723 learned_addr learned my addr 172.21.15.114:0/4214617723 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ace200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac80cb9b0 0x7f1ac81ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acce00640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac814a1d0 0x7f1ac80ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 -- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac814a1d0 msgr2=0x7f1ac80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac814a1d0 0x7f1ac80ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 -- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac80cb9b0 msgr2=0x7f1ac81ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:43.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac80cb9b0 0x7f1ac81ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 -- 172.21.15.114:0/4214617723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac80ca650 con 0x7f1ab00051d0 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acce00640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac814a1d0 0x7f1ac80ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1ace200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac80cb9b0 0x7f1ac81ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.864+0000 7f1acd800640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ac81e7890 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f1abc003f90 tx=0x7f1abc0017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ac5600640 1 -- 172.21.15.114:0/4214617723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc015070 con 0x7f1ab00051d0 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ac5600640 1 -- 172.21.15.114:0/4214617723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1abc011900 con 0x7f1ab00051d0 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ac5600640 1 -- 172.21.15.114:0/4214617723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc011d30 con 0x7f1ab00051d0 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac80ca910 con 0x7f1ab00051d0 2024-09-16T07:36:43.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac80caed0 con 0x7f1ab00051d0 2024-09-16T07:36:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac80ce910 con 0x7f1ab00051d0 2024-09-16T07:36:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ac5600640 1 -- 172.21.15.114:0/4214617723 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f1abc018070 con 0x7f1ab00051d0 2024-09-16T07:36:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ac5600640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1aa8073910 0x7f1aa8075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1ac5600640 1 -- 172.21.15.114:0/4214617723 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7f1abc0936a0 con 0x7f1ab00051d0 2024-09-16T07:36:43.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.868+0000 7f1acce00640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1aa8073910 0x7f1aa8075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:43.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.872+0000 7f1acce00640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1aa8073910 0x7f1aa8075dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4001d70 tx=0x7f1ab40067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:43.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:43.872+0000 7f1ac5600640 1 -- 172.21.15.114:0/4214617723 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1abc060120 con 0x7f1ab00051d0 2024-09-16T07:36:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.076+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ac80afb00 con 0x7f1ab00051d0 2024-09-16T07:36:44.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.076+0000 7f1ac5600640 1 -- 172.21.15.114:0/4214617723 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+3925 (secure 0 0 0) 0x7f1abc05fa20 con 0x7f1ab00051d0 2024-09-16T07:36:44.076 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:44.076 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":116,"btime":"2024-09-16T07:36:37:700627+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7289,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3808879086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3808879086},{"type":"v1","addr":"172.21.15.149:6801","nonce":3808879086}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/3577511191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":3577511191},{"type":"v1","addr":"172.21.15.149:6835","nonce":3577511191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1372619733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":1372619733},{"type":"v1","addr":"172.21.15.114:6835","nonce":1372619733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":9078,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/317320856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":317320856},{"type":"v1","addr":"172.21.15.114:6834","nonce":317320856}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[]} 2024-09-16T07:36:44.076 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 116 2024-09-16T07:36:44.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1aa8073910 msgr2=0x7f1aa8075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1aa8073910 0x7f1aa8075dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4001d70 tx=0x7f1ab40067b0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 msgr2=0x7f1ac81e7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ac81e7890 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f1abc003f90 tx=0x7f1abc0017e0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 shutdown_connections 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ac80cb9b0 0x7f1ac81ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1aa8073910 0x7f1aa8075dd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ac814a1d0 0x7f1ac80ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 --2- 172.21.15.114:0/4214617723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ab00051d0 0x7f1ac81e7890 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 >> 172.21.15.114:0/4214617723 conn(0x7f1ac80d1dc0 msgr2=0x7f1ac815af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 shutdown_connections 2024-09-16T07:36:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.080+0000 7f1ad0200640 1 -- 172.21.15.114:0/4214617723 wait complete. 2024-09-16T07:36:44.098 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T07:36:44.098 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T07:36:44.098 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:36:44.098 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:44.098 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T07:36:44.098 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T07:36:44.099 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:36:44.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:44.099 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T07:36:44.099 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T07:36:44.099 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:36:44.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:44.100 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T07:36:44.100 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T07:36:44.100 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:36:44.100 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:36:44.113 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:36:44.114 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T07:36:44.115 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:36:44.115 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T07:36:44.117 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:36:44.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T07:36:44.117 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:36:44.117 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T07:36:44.163 INFO:tasks.ceph.mds.a:Started 2024-09-16T07:36:44.164 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:44.164 INFO:tasks.ceph.mds.b:Started 2024-09-16T07:36:44.165 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:44.165 INFO:tasks.ceph.mds.c:Started 2024-09-16T07:36:44.165 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:44.167 INFO:tasks.ceph.mds.d:Started 2024-09-16T07:36:44.167 DEBUG:teuthology.parallel:result is None 2024-09-16T07:36:44.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T07:36:44.250 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-16T07:36:44.250 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:36:44.258 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2024-09-16T07:36:44.258 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2024-09-16T07:36:44.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 -- 172.21.15.114:0/1246319156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15ef90 msgr2=0x7fe27c0cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 --2- 172.21.15.114:0/1246319156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15ef90 0x7fe27c0cc740 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fe26c009900 tx=0x7fe26c01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 -- 172.21.15.114:0/1246319156 shutdown_connections 2024-09-16T07:36:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 --2- 172.21.15.114:0/1246319156 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe27c0cd3e0 0x7fe27c068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 --2- 172.21.15.114:0/1246319156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15ef90 0x7fe27c0cc740 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 -- 172.21.15.114:0/1246319156 >> 172.21.15.114:0/1246319156 conn(0x7fe27c073490 msgr2=0x7fe27c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 -- 172.21.15.114:0/1246319156 shutdown_connections 2024-09-16T07:36:44.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.316+0000 7fe27be00640 1 -- 172.21.15.114:0/1246319156 wait complete. 2024-09-16T07:36:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 Processor -- start 2024-09-16T07:36:44.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 -- start start 2024-09-16T07:36:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c0cd3e0 0x7fe27c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe27c15ef90 0x7fe27c1f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15f700 0x7fe27c0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe27c168a10 con 0x7fe27c15f700 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe27c168890 con 0x7fe27c0cd3e0 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe27c168b90 con 0x7fe27c15ef90 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15f700 0x7fe27c0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15f700 0x7fe27c0ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42588/0 (socket says 172.21.15.114:42588) 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 -- 172.21.15.114:0/344469087 learned_addr learned my addr 172.21.15.114:0/344469087 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27aa00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c0cd3e0 0x7fe27c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe272000640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe27c15ef90 0x7fe27c1f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 -- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe27c15ef90 msgr2=0x7fe27c1f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe27c15ef90 0x7fe27c1f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 -- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c0cd3e0 msgr2=0x7fe27c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c0cd3e0 0x7fe27c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 -- 172.21.15.114:0/344469087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27c0ca650 con 0x7fe27c15f700 2024-09-16T07:36:44.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27b400640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15f700 0x7fe27c0ca110 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fe27400d720 tx=0x7fe27400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:44.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe273400640 1 -- 172.21.15.114:0/344469087 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274017070 con 0x7fe27c15f700 2024-09-16T07:36:44.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe273400640 1 -- 172.21.15.114:0/344469087 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe274009d20 con 0x7fe27c15f700 2024-09-16T07:36:44.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe27c1f5a60 con 0x7fe27c15f700 2024-09-16T07:36:44.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe273400640 1 -- 172.21.15.114:0/344469087 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274004280 con 0x7fe27c15f700 2024-09-16T07:36:44.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.320+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe27c1f6020 con 0x7fe27c15f700 2024-09-16T07:36:44.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.324+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe27c068960 con 0x7fe27c15f700 2024-09-16T07:36:44.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.324+0000 7fe273400640 1 -- 172.21.15.114:0/344469087 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fe274003600 con 0x7fe27c15f700 2024-09-16T07:36:44.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.324+0000 7fe273400640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe2580738e0 0x7fe258075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.324+0000 7fe273400640 1 -- 172.21.15.114:0/344469087 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 4971+0+0 (secure 0 0 0) 0x7fe2740929a0 con 0x7fe27c15f700 2024-09-16T07:36:44.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.324+0000 7fe27aa00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe2580738e0 0x7fe258075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.324+0000 7fe27aa00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe2580738e0 0x7fe258075da0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0af000 tx=0x7fe26c01b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:44.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.328+0000 7fe273400640 1 -- 172.21.15.114:0/344469087 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe274020030 con 0x7fe27c15f700 2024-09-16T07:36:44.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.508+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe27c0c6a10 con 0x7fe27c15f700 2024-09-16T07:36:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.748+0000 7fe273400640 1 -- 172.21.15.114:0/344469087 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v159) ==== 97+0+0 (secure 0 0 0) 0x7fe27405ed40 con 0x7fe27c15f700 2024-09-16T07:36:44.747 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-16T07:36:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe2580738e0 msgr2=0x7fe258075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe2580738e0 0x7fe258075da0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0af000 tx=0x7fe26c01b120 comp rx=0 tx=0).stop 2024-09-16T07:36:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15f700 msgr2=0x7fe27c0ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15f700 0x7fe27c0ca110 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fe27400d720 tx=0x7fe27400dbe0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 shutdown_connections 2024-09-16T07:36:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe27c15f700 0x7fe27c0ca110 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe2580738e0 0x7fe258075da0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe27c15ef90 0x7fe27c1f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 --2- 172.21.15.114:0/344469087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe27c0cd3e0 0x7fe27c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 >> 172.21.15.114:0/344469087 conn(0x7fe27c073490 msgr2=0x7fe27c15b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 shutdown_connections 2024-09-16T07:36:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.752+0000 7fe27be00640 1 -- 172.21.15.114:0/344469087 wait complete. 2024-09-16T07:36:44.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 -- 172.21.15.114:0/3009671399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 msgr2=0x7f40e80af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 --2- 172.21.15.114:0/3009671399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e80af900 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f40e8074080 tx=0x7f40d401c8a0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 -- 172.21.15.114:0/3009671399 shutdown_connections 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 --2- 172.21.15.114:0/3009671399 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e80af900 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 --2- 172.21.15.114:0/3009671399 >> v2:172.21.15.149:3300/0 conn(0x7f40e80d03e0 0x7f40e80d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 --2- 172.21.15.114:0/3009671399 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e815bde0 0x7f40e8068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 -- 172.21.15.114:0/3009671399 >> 172.21.15.114:0/3009671399 conn(0x7f40e80b2240 msgr2=0x7f40e80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 -- 172.21.15.114:0/3009671399 shutdown_connections 2024-09-16T07:36:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 -- 172.21.15.114:0/3009671399 wait complete. 2024-09-16T07:36:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 Processor -- start 2024-09-16T07:36:44.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.916+0000 7f40efc00640 1 -- start start 2024-09-16T07:36:44.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e81edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e80d03e0 0x7f40e81ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e815bde0 0x7f40e81f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f40e815fbf0 con 0x7f40e80b4270 2024-09-16T07:36:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40e815fa70 con 0x7f40e815bde0 2024-09-16T07:36:44.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f40e815fd70 con 0x7f40e80d03e0 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e81edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e81edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42600/0 (socket says 172.21.15.114:42600) 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 -- 172.21.15.114:0/1358454207 learned_addr learned my addr 172.21.15.114:0/1358454207 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40e7e00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e80d03e0 0x7f40e81ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40edc00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e815bde0 0x7f40e81f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 -- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e80d03e0 msgr2=0x7f40e81ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e80d03e0 0x7f40e81ee0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 -- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e815bde0 msgr2=0x7f40e81f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e815bde0 0x7f40e81f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:44.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 -- 172.21.15.114:0/1358454207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e81ee5f0 con 0x7f40e80b4270 2024-09-16T07:36:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40ed200640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e81edb70 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f40d800e7f0 tx=0x7f40d800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40e4c00640 1 -- 172.21.15.114:0/1358454207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d800cac0 con 0x7f40e80b4270 2024-09-16T07:36:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40e4c00640 1 -- 172.21.15.114:0/1358454207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40d800cc80 con 0x7f40e80b4270 2024-09-16T07:36:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e814b8a0 con 0x7f40e80b4270 2024-09-16T07:36:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40e4c00640 1 -- 172.21.15.114:0/1358454207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8005280 con 0x7f40e80b4270 2024-09-16T07:36:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e814d540 con 0x7f40e80b4270 2024-09-16T07:36:44.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e80d0890 con 0x7f40e80b4270 2024-09-16T07:36:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.920+0000 7f40e4c00640 1 -- 172.21.15.114:0/1358454207 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f40d8005420 con 0x7f40e80b4270 2024-09-16T07:36:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.924+0000 7f40e4c00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f40c80738e0 0x7f40c8075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:44.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.924+0000 7f40e4c00640 1 -- 172.21.15.114:0/1358454207 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4885+0+0 (secure 0 0 0) 0x7f40d80931c0 con 0x7f40e80b4270 2024-09-16T07:36:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.924+0000 7f40e7e00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f40c80738e0 0x7f40c8075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:44.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.924+0000 7f40e7e00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f40c80738e0 0x7f40c8075da0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f40d40af000 tx=0x7f40d401b0e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:44.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:44.928+0000 7f40e4c00640 1 -- 172.21.15.114:0/1358454207 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f40d805fc40 con 0x7f40e80b4270 2024-09-16T07:36:45.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.148+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f40e81656f0 con 0x7f40e80b4270 2024-09-16T07:36:45.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40e4c00640 1 -- 172.21.15.114:0/1358454207 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) ==== 80+0+5304 (secure 0 0 0) 0x7f40d8066070 con 0x7f40e80b4270 2024-09-16T07:36:45.149 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:36:45.149 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-16T07:36:45.149 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6pCqLxAAC3wzbGr1VRQ4SxA47bCIQA==", 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmMAiqABAA6MQDAMkiPzOZjPSitnmHgw==", 2024-09-16T07:36:45.150 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmK3zqNhAA2mpu24aDp5y9Pz05aXP8ag==", 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:45.151 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmVmn5BxAAYKlcB21Sw2Cd8a+p3oZflw==", 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.152 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDb3edmDkh1DBAAcz9+bOYpw1TFIPJ90HXFbQ==", 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDe3edmp9I8IBAAEG807RX7VriO461oKf9UDQ==", 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.153 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDh3edmssfTNhAAz8f7GuX21pDtfccjIHCv6A==", 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.154 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDl3edmHQDfDhAA7BYA1lvCO78CwVdAYVro0A==", 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDr3edmtD/aHBAAvVAv8v4x2tvEW9X365Ky+w==", 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.155 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDu3edmaBYnMRAA1fz1a/+ZpxYrDJasjd8NdQ==", 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.156 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDy3edmMRoGCxAA+0n1hYyI04lhEPnf9QP+Ew==", 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQD13edm1ekeIBAAUl5XUUQP5eMtshiHRtZjtQ==", 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.157 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA==", 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow r", 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.158 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmkaNiFRAA1kWktyEPqlcSMarMssJNyw==", 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.159 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmpdF2ERAAptw3wl6tWWkOD8REOaG3NQ==", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDY3edmIYKLGxAA4zl9YclBrCKBtiv3TemQqw==", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-16T07:36:45.160 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmU+3XExAARw9yC5cwdiV3j7VHMGxslA==", 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.161 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edm6bymKxAA5o0DhUA8a0/ln/G+CDgJeg==", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQDX3edmmpd6JxAAizduAXnXdVWNAfpTi9Qw5Q==", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-16T07:36:45.162 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-16T07:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T07:36:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:36:45.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f40c80738e0 msgr2=0x7f40c8075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f40c80738e0 0x7f40c8075da0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f40d40af000 tx=0x7f40d401b0e0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 msgr2=0x7f40e81edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e81edb70 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f40d800e7f0 tx=0x7f40d800ebf0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 shutdown_connections 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40e815bde0 0x7f40e81f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f40c80738e0 0x7f40c8075da0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f40e80d03e0 0x7f40e81ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 --2- 172.21.15.114:0/1358454207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40e80b4270 0x7f40e81edb70 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 >> 172.21.15.114:0/1358454207 conn(0x7f40e80b2240 msgr2=0x7f40e8166230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 shutdown_connections 2024-09-16T07:36:45.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.152+0000 7f40efc00640 1 -- 172.21.15.114:0/1358454207 wait complete. 2024-09-16T07:36:45.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T07:36:45.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 -- 172.21.15.114:0/3553574853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 msgr2=0x7f8c9c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 --2- 172.21.15.114:0/3553574853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0aeef0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009bc0 tx=0x7f8c9401cba0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 -- 172.21.15.114:0/3553574853 shutdown_connections 2024-09-16T07:36:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 --2- 172.21.15.114:0/3553574853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0aeef0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 --2- 172.21.15.114:0/3553574853 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c9c0ced80 0x7f8c9c0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 -- 172.21.15.114:0/3553574853 >> 172.21.15.114:0/3553574853 conn(0x7f8c9c0d1dc0 msgr2=0x7f8c9c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 -- 172.21.15.114:0/3553574853 shutdown_connections 2024-09-16T07:36:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.312+0000 7f8ca3000640 1 -- 172.21.15.114:0/3553574853 wait complete. 2024-09-16T07:36:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 Processor -- start 2024-09-16T07:36:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 -- start start 2024-09-16T07:36:45.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c9c0ced80 0x7f8c9c1f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9c15bea0 0x7f8c9c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c169340 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c1691c0 con 0x7f8c9c15bea0 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9c1694c0 con 0x7f8c9c0ced80 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42618/0 (socket says 172.21.15.114:42618) 2024-09-16T07:36:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 -- 172.21.15.114:0/1455927289 learned_addr learned my addr 172.21.15.114:0/1455927289 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:45.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 -- 172.21.15.114:0/1455927289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c9c0ced80 msgr2=0x7f8c9c1f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c9c0ced80 0x7f8c9c1f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 -- 172.21.15.114:0/1455927289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9c15bea0 msgr2=0x7f8c9c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9c15bea0 0x7f8c9c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 -- 172.21.15.114:0/1455927289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9c1f82b0 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c9be00640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0c6650 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c430 tx=0x7f8c8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c98c00640 1 -- 172.21.15.114:0/1455927289 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c011790 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c98c00640 1 -- 172.21.15.114:0/1455927289 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c8c017070 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8c98c00640 1 -- 172.21.15.114:0/1455927289 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c011ce0 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9c1f8590 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.316+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9c0c6b90 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.320+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9c0ce670 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.320+0000 7f8c98c00640 1 -- 172.21.15.114:0/1455927289 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f8c8c01c460 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.320+0000 7f8c98c00640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8c780738e0 0x7f8c78075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.320+0000 7f8c98c00640 1 -- 172.21.15.114:0/1455927289 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4885+0+0 (secure 0 0 0) 0x7f8c8c092700 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.320+0000 7f8c93e00640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8c780738e0 0x7f8c78075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.320+0000 7f8c93e00640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8c780738e0 0x7f8c78075da0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0c59c0 tx=0x7f8c84005f50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:45.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.324+0000 7f8c98c00640 1 -- 172.21.15.114:0/1455927289 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8c8c099070 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8c9c0b09a0 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8c98c00640 1 -- 172.21.15.114:0/1455927289 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) ==== 84+0+65 (secure 0 0 0) 0x7f8c8c05f240 con 0x7f8c9c0cdb30 2024-09-16T07:36:45.490 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:45.490 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:36:45.490 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:36:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-16T07:36:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-16T07:36:45.491 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:36:45.491 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:36:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8c780738e0 msgr2=0x7f8c78075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8c780738e0 0x7f8c78075da0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0c59c0 tx=0x7f8c84005f50 comp rx=0 tx=0).stop 2024-09-16T07:36:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 msgr2=0x7f8c9c0c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0c6650 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c430 tx=0x7f8c8c00c8f0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 shutdown_connections 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c9c15bea0 0x7f8c9c071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f8c780738e0 0x7f8c78075da0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8c9c0ced80 0x7f8c9c1f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 --2- 172.21.15.114:0/1455927289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c9c0cdb30 0x7f8c9c0c6650 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 >> 172.21.15.114:0/1455927289 conn(0x7f8c9c0d1dc0 msgr2=0x7f8c9c06ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 shutdown_connections 2024-09-16T07:36:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.492+0000 7f8ca3000640 1 -- 172.21.15.114:0/1455927289 wait complete. 2024-09-16T07:36:45.512 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T07:36:45.512 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T07:36:45.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.656+0000 7f7283000640 1 -- 172.21.15.114:0/2846218999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0cdac0 msgr2=0x7f727c0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.656+0000 7f7283000640 1 --2- 172.21.15.114:0/2846218999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0cdac0 0x7f727c0cdf70 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f7274009840 tx=0x7f727401c820 comp rx=0 tx=0).stop 2024-09-16T07:36:45.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.656+0000 7f7283000640 1 -- 172.21.15.114:0/2846218999 shutdown_connections 2024-09-16T07:36:45.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 --2- 172.21.15.114:0/2846218999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c0cdac0 0x7f727c0cdf70 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 --2- 172.21.15.114:0/2846218999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727c15bf60 0x7f727c0733a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- 172.21.15.114:0/2846218999 >> 172.21.15.114:0/2846218999 conn(0x7f727c0cfbc0 msgr2=0x7f727c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:45.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- 172.21.15.114:0/2846218999 shutdown_connections 2024-09-16T07:36:45.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- 172.21.15.114:0/2846218999 wait complete. 2024-09-16T07:36:45.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 Processor -- start 2024-09-16T07:36:45.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- start start 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c0b5170 0x7f727c159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727c0cdac0 0x7f727c164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c15bf60 0x7f727c1653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f727c169070 con 0x7f727c15bf60 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f727c168ef0 con 0x7f727c0b5170 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f727c1691f0 con 0x7f727c0cdac0 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c15bf60 0x7f727c1653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c15bf60 0x7f727c1653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42638/0 (socket says 172.21.15.114:42638) 2024-09-16T07:36:45.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 -- 172.21.15.114:0/570821152 learned_addr learned my addr 172.21.15.114:0/570821152 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:45.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f727be00640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c0b5170 0x7f727c159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:45.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7273400640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727c0cdac0 0x7f727c164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:45.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 -- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727c0cdac0 msgr2=0x7f727c164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727c0cdac0 0x7f727c164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 -- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c0b5170 msgr2=0x7f727c159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:45.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c0b5170 0x7f727c159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:45.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 -- 172.21.15.114:0/570821152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c15a3c0 con 0x7f727c15bf60 2024-09-16T07:36:45.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7281000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c15bf60 0x7f727c1653c0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f727401a450 tx=0x7f72740041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:45.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7278c00640 1 -- 172.21.15.114:0/570821152 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72740b2040 con 0x7f727c15bf60 2024-09-16T07:36:45.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7278c00640 1 -- 172.21.15.114:0/570821152 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7274005020 con 0x7f727c15bf60 2024-09-16T07:36:45.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c15ef10 con 0x7f727c15bf60 2024-09-16T07:36:45.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.660+0000 7f7278c00640 1 -- 172.21.15.114:0/570821152 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7274005410 con 0x7f727c15bf60 2024-09-16T07:36:45.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.664+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c15f4d0 con 0x7f727c15bf60 2024-09-16T07:36:45.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.664+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727c069410 con 0x7f727c15bf60 2024-09-16T07:36:45.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.664+0000 7f7278c00640 1 -- 172.21.15.114:0/570821152 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f72740be060 con 0x7f727c15bf60 2024-09-16T07:36:45.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.664+0000 7f7278c00640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f72580738e0 0x7f7258075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:45.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.664+0000 7f7278c00640 1 -- 172.21.15.114:0/570821152 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4885+0+0 (secure 0 0 0) 0x7f727412e360 con 0x7f727c15bf60 2024-09-16T07:36:45.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.664+0000 7f727be00640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f72580738e0 0x7f7258075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:45.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.664+0000 7f727be00640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f72580738e0 0x7f7258075da0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f726c009e50 tx=0x7f726c0095e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:45.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.668+0000 7f7278c00640 1 -- 172.21.15.114:0/570821152 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7274016410 con 0x7f727c15bf60 2024-09-16T07:36:45.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:45.840+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f727c0cdf70 con 0x7f727c15bf60 2024-09-16T07:36:46.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.756+0000 7f7278c00640 1 -- 172.21.15.114:0/570821152 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) ==== 138+0+0 (secure 0 0 0) 0x7f72740f8470 con 0x7f727c15bf60 2024-09-16T07:36:46.754 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-16T07:36:46.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.756+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f72580738e0 msgr2=0x7f7258075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.756+0000 7f7283000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f72580738e0 0x7f7258075da0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f726c009e50 tx=0x7f726c0095e0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.756+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c15bf60 msgr2=0x7f727c1653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.756+0000 7f7283000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c15bf60 0x7f727c1653c0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f727401a450 tx=0x7f72740041a0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 shutdown_connections 2024-09-16T07:36:46.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f727c15bf60 0x7f727c1653c0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f72580738e0 0x7f7258075da0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f727c0cdac0 0x7f727c164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 --2- 172.21.15.114:0/570821152 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f727c0b5170 0x7f727c159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 >> 172.21.15.114:0/570821152 conn(0x7f727c0cfbc0 msgr2=0x7f727c158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 shutdown_connections 2024-09-16T07:36:46.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.760+0000 7f7283000640 1 -- 172.21.15.114:0/570821152 wait complete. 2024-09-16T07:36:46.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T07:36:46.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 -- 172.21.15.114:0/2657892130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 msgr2=0x7f3dc8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 --2- 172.21.15.114:0/2657892130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 0x7f3dc8004810 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009b60 tx=0x7f3dcc01cf90 comp rx=0 tx=0).stop 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3de3e00640 1 -- 172.21.15.114:0/2657892130 reap_dead start 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 -- 172.21.15.114:0/2657892130 shutdown_connections 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 -- 172.21.15.114:0/2657892130 >> 172.21.15.114:0/2657892130 conn(0x7f3de40d1ea0 msgr2=0x7f3de40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 -- 172.21.15.114:0/2657892130 shutdown_connections 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 -- 172.21.15.114:0/2657892130 wait complete. 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 Processor -- start 2024-09-16T07:36:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.940+0000 7f3dea800640 1 -- start start 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 0x7f3de41f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3de40b3bf0 0x7f3de40ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de40cac40 0x7f3de4156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3de4167b70 con 0x7f3dc8003fe0 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3de41679f0 con 0x7f3de40cac40 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3de4167cf0 con 0x7f3de40b3bf0 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 0x7f3de41f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 0x7f3de41f9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42656/0 (socket says 172.21.15.114:42656) 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 -- 172.21.15.114:0/388757419 learned_addr learned my addr 172.21.15.114:0/388757419 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3e00640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de40cac40 0x7f3de4156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3ddaa00640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3de40b3bf0 0x7f3de40ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 -- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3de40b3bf0 msgr2=0x7f3de40ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3de40b3bf0 0x7f3de40ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 -- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de40cac40 msgr2=0x7f3de4156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de40cac40 0x7f3de4156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 -- 172.21.15.114:0/388757419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de409ed20 con 0x7f3dc8003fe0 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3de3400640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 0x7f3de41f9a00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40066b0 tx=0x7f3dd40039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3ddbe00640 1 -- 172.21.15.114:0/388757419 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4011700 con 0x7f3dc8003fe0 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3ddbe00640 1 -- 172.21.15.114:0/388757419 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dd4016020 con 0x7f3dc8003fe0 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3ddbe00640 1 -- 172.21.15.114:0/388757419 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4011b40 con 0x7f3dc8003fe0 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de4157a00 con 0x7f3dc8003fe0 2024-09-16T07:36:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de409f280 con 0x7f3dc8003fe0 2024-09-16T07:36:46.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.944+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de40cc940 con 0x7f3dc8003fe0 2024-09-16T07:36:46.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.948+0000 7f3ddbe00640 1 -- 172.21.15.114:0/388757419 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f3dd4011ce0 con 0x7f3dc8003fe0 2024-09-16T07:36:46.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.948+0000 7f3ddbe00640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dc00738e0 0x7f3dc0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:46.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.948+0000 7f3ddbe00640 1 -- 172.21.15.114:0/388757419 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5255+0+0 (secure 0 0 0) 0x7f3dd40938d0 con 0x7f3dc8003fe0 2024-09-16T07:36:46.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.948+0000 7f3ddaa00640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dc00738e0 0x7f3dc0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:46.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.948+0000 7f3ddaa00640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dc00738e0 0x7f3dc0075da0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0af000 tx=0x7f3dcc01a050 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:46.952+0000 7f3ddbe00640 1 -- 172.21.15.114:0/388757419 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3dd4020020 con 0x7f3dc8003fe0 2024-09-16T07:36:47.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.120+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3de4076360 con 0x7f3dc8003fe0 2024-09-16T07:36:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3ddbe00640 1 -- 172.21.15.114:0/388757419 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) ==== 170+0+0 (secure 0 0 0) 0x7f3de409ed20 con 0x7f3dc8003fe0 2024-09-16T07:36:47.757 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-16T07:36:47.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dc00738e0 msgr2=0x7f3dc0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:47.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dc00738e0 0x7f3dc0075da0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0af000 tx=0x7f3dcc01a050 comp rx=0 tx=0).stop 2024-09-16T07:36:47.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 msgr2=0x7f3de41f9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:47.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 0x7f3de41f9a00 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40066b0 tx=0x7f3dd40039d0 comp rx=0 tx=0).stop 2024-09-16T07:36:47.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 shutdown_connections 2024-09-16T07:36:47.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3de40cac40 0x7f3de4156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:47.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3dc00738e0 0x7f3dc0075da0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3de40b3bf0 0x7f3de40ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 --2- 172.21.15.114:0/388757419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dc8003fe0 0x7f3de41f9a00 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 >> 172.21.15.114:0/388757419 conn(0x7f3de40d1ea0 msgr2=0x7f3de415a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 shutdown_connections 2024-09-16T07:36:47.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.760+0000 7f3dea800640 1 -- 172.21.15.114:0/388757419 wait complete. 2024-09-16T07:36:47.803 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T07:36:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 -- 172.21.15.114:0/3821960337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f3c004d50 msgr2=0x7f6f3c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 --2- 172.21.15.114:0/3821960337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f3c004d50 0x7f6f3c0051d0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e60 tx=0x7f6f5001d150 comp rx=0 tx=0).stop 2024-09-16T07:36:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f56800640 1 -- 172.21.15.114:0/3821960337 reap_dead start 2024-09-16T07:36:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 -- 172.21.15.114:0/3821960337 shutdown_connections 2024-09-16T07:36:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 -- 172.21.15.114:0/3821960337 >> 172.21.15.114:0/3821960337 conn(0x7f6f5809aa10 msgr2=0x7f6f5809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 -- 172.21.15.114:0/3821960337 shutdown_connections 2024-09-16T07:36:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 -- 172.21.15.114:0/3821960337 wait complete. 2024-09-16T07:36:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 Processor -- start 2024-09-16T07:36:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.952+0000 7f6f57200640 1 -- start start 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f3c004d50 0x7f6f581f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f58154f20 0x7f6f58154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f581f4ab0 0x7f6f581561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580b1bc0 con 0x7f6f581f4ab0 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580b1a40 con 0x7f6f3c004d50 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6f580b1d40 con 0x7f6f58154f20 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f581f4ab0 0x7f6f581561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f581f4ab0 0x7f6f581561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42680/0 (socket says 172.21.15.114:42680) 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 -- 172.21.15.114:0/1119790200 learned_addr learned my addr 172.21.15.114:0/1119790200 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f55e00640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f3c004d50 0x7f6f581f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f55400640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f58154f20 0x7f6f58154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:47.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 -- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f58154f20 msgr2=0x7f6f58154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f58154f20 0x7f6f58154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 -- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f3c004d50 msgr2=0x7f6f581f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f3c004d50 0x7f6f581f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 -- 172.21.15.114:0/1119790200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f581f7de0 con 0x7f6f581f4ab0 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f56800640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f581f4ab0 0x7f6f581561d0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e60 tx=0x7f6f500add50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f4e000640 1 -- 172.21.15.114:0/1119790200 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500b1040 con 0x7f6f581f4ab0 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f4e000640 1 -- 172.21.15.114:0/1119790200 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f500bc070 con 0x7f6f581f4ab0 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f581f80b0 con 0x7f6f581f4ab0 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f4e000640 1 -- 172.21.15.114:0/1119790200 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50009a00 con 0x7f6f581f4ab0 2024-09-16T07:36:47.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f581f8670 con 0x7f6f581f4ab0 2024-09-16T07:36:47.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.956+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f580d0530 con 0x7f6f581f4ab0 2024-09-16T07:36:47.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.960+0000 7f6f4e000640 1 -- 172.21.15.114:0/1119790200 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f6f50004a50 con 0x7f6f581f4ab0 2024-09-16T07:36:47.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.960+0000 7f6f4e000640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f380738e0 0x7f6f38075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:47.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.960+0000 7f6f4e000640 1 -- 172.21.15.114:0/1119790200 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5637+0+0 (secure 0 0 0) 0x7f6f5012d9d0 con 0x7f6f581f4ab0 2024-09-16T07:36:47.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.960+0000 7f6f55e00640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f380738e0 0x7f6f38075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:47.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.960+0000 7f6f55e00640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f380738e0 0x7f6f38075da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6f48001c10 tx=0x7f6f48001ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:47.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:47.964+0000 7f6f4e000640 1 -- 172.21.15.114:0/1119790200 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6f500c6020 con 0x7f6f581f4ab0 2024-09-16T07:36:48.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.164+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6f580aff40 con 0x7f6f581f4ab0 2024-09-16T07:36:48.791 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 26 and data pool 27 2024-09-16T07:36:48.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.792+0000 7f6f4e000640 1 -- 172.21.15.114:0/1119790200 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v119) ==== 174+0+0 (secure 0 0 0) 0x7f6f50016e60 con 0x7f6f581f4ab0 2024-09-16T07:36:48.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.800+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f380738e0 msgr2=0x7f6f38075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:48.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.800+0000 7f6f57200640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f380738e0 0x7f6f38075da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6f48001c10 tx=0x7f6f48001ba0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.800+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f581f4ab0 msgr2=0x7f6f581561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:48.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.800+0000 7f6f57200640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f581f4ab0 0x7f6f581561d0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e60 tx=0x7f6f500add50 comp rx=0 tx=0).stop 2024-09-16T07:36:48.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 shutdown_connections 2024-09-16T07:36:48.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f581f4ab0 0x7f6f581561d0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6f380738e0 0x7f6f38075da0 secure :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6f48001c10 tx=0x7f6f48001ba0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f58154f20 0x7f6f58154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 --2- 172.21.15.114:0/1119790200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f3c004d50 0x7f6f581f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 >> 172.21.15.114:0/1119790200 conn(0x7f6f5809aa10 msgr2=0x7f6f580af390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:48.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 shutdown_connections 2024-09-16T07:36:48.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.804+0000 7f6f57200640 1 -- 172.21.15.114:0/1119790200 wait complete. 2024-09-16T07:36:48.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:48.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:36:48.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:36:48.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 -- 172.21.15.114:0/398493769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d2060 msgr2=0x7f76e00cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:48.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 --2- 172.21.15.114:0/398493769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d2060 0x7f76e00cf660 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009840 tx=0x7f76d001d280 comp rx=0 tx=0).stop 2024-09-16T07:36:48.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 -- 172.21.15.114:0/398493769 shutdown_connections 2024-09-16T07:36:48.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 --2- 172.21.15.114:0/398493769 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76e00d2440 0x7f76e00d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 --2- 172.21.15.114:0/398493769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d2060 0x7f76e00cf660 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 -- 172.21.15.114:0/398493769 >> 172.21.15.114:0/398493769 conn(0x7f76e00d3fe0 msgr2=0x7f76e00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:48.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 -- 172.21.15.114:0/398493769 shutdown_connections 2024-09-16T07:36:48.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 -- 172.21.15.114:0/398493769 wait complete. 2024-09-16T07:36:48.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.984+0000 7f76e4e00640 1 Processor -- start 2024-09-16T07:36:48.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 -- start start 2024-09-16T07:36:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d09f0 0x7f76e01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e00d2060 0x7f76e00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76e00d2440 0x7f76e00cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:48.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f76e016ba90 con 0x7f76e00d09f0 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76e016b910 con 0x7f76e00d2060 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f76e016bc10 con 0x7f76e00d2440 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d09f0 0x7f76e01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d09f0 0x7f76e01599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42704/0 (socket says 172.21.15.114:42704) 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 -- 172.21.15.114:0/2543321177 learned_addr learned my addr 172.21.15.114:0/2543321177 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dd400640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e00d2060 0x7f76e00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76de800640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76e00d2440 0x7f76e00cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 -- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76e00d2440 msgr2=0x7f76e00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76e00d2440 0x7f76e00cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 -- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e00d2060 msgr2=0x7f76e00ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e00d2060 0x7f76e00ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 -- 172.21.15.114:0/2543321177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e015a480 con 0x7f76e00d09f0 2024-09-16T07:36:48.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dd400640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e00d2060 0x7f76e00ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76dde00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d09f0 0x7f76e01599f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009790 tx=0x7f76d00a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76d6000640 1 -- 172.21.15.114:0/2543321177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00b2040 con 0x7f76e00d09f0 2024-09-16T07:36:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76d6000640 1 -- 172.21.15.114:0/2543321177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d0005030 con 0x7f76e00d09f0 2024-09-16T07:36:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e015a760 con 0x7f76e00d09f0 2024-09-16T07:36:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76d6000640 1 -- 172.21.15.114:0/2543321177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00044f0 con 0x7f76e00d09f0 2024-09-16T07:36:48.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e0159f30 con 0x7f76e00d09f0 2024-09-16T07:36:48.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.988+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e00cf660 con 0x7f76e00d09f0 2024-09-16T07:36:48.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.992+0000 7f76d6000640 1 -- 172.21.15.114:0/2543321177 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f76d0005440 con 0x7f76e00d09f0 2024-09-16T07:36:48.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.992+0000 7f76d6000640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f76c00738e0 0x7f76c0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:48.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.992+0000 7f76d6000640 1 -- 172.21.15.114:0/2543321177 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5737+0+0 (secure 0 0 0) 0x7f76d012c7d0 con 0x7f76e00d09f0 2024-09-16T07:36:48.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.992+0000 7f76dd400640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f76c00738e0 0x7f76c0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:48.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.992+0000 7f76dd400640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f76c00738e0 0x7f76c0075da0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f76e00b4b60 tx=0x7f76cc00b5b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:48.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:48.996+0000 7f76d6000640 1 -- 172.21.15.114:0/2543321177 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f76d00bd060 con 0x7f76e00d09f0 2024-09-16T07:36:49.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.164+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76e00d0ee0 con 0x7f76e00d09f0 2024-09-16T07:36:49.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.164+0000 7f76d6000640 1 -- 172.21.15.114:0/2543321177 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) ==== 74+0+16848 (secure 0 0 0) 0x7f76d0016410 con 0x7f76e00d09f0 2024-09-16T07:36:49.164 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:49.164 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":164,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:48.170300+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:45.857532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:47.134690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:49.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f76c00738e0 msgr2=0x7f76c0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f76c00738e0 0x7f76c0075da0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f76e00b4b60 tx=0x7f76cc00b5b0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d09f0 msgr2=0x7f76e01599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d09f0 0x7f76e01599f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009790 tx=0x7f76d00a56e0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 shutdown_connections 2024-09-16T07:36:49.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f76c00738e0 0x7f76c0075da0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f76e00d2440 0x7f76e00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76e00d2060 0x7f76e00ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 --2- 172.21.15.114:0/2543321177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76e00d09f0 0x7f76e01599f0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 >> 172.21.15.114:0/2543321177 conn(0x7f76e00d3fe0 msgr2=0x7f76e015bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 shutdown_connections 2024-09-16T07:36:49.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.168+0000 7f76e4e00640 1 -- 172.21.15.114:0/2543321177 wait complete. 2024-09-16T07:36:49.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:49.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 -- 172.21.15.114:0/2761973607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b5870 msgr2=0x7f1bb4165670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 --2- 172.21.15.114:0/2761973607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b5870 0x7f1bb4165670 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4069da0 tx=0x7f1bac01cb80 comp rx=0 tx=0).stop 2024-09-16T07:36:49.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 -- 172.21.15.114:0/2761973607 shutdown_connections 2024-09-16T07:36:49.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 --2- 172.21.15.114:0/2761973607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b5870 0x7f1bb4165670 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 --2- 172.21.15.114:0/2761973607 >> v2:172.21.15.149:3300/0 conn(0x7f1bb40b4d80 0x7f1bb40b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 -- 172.21.15.114:0/2761973607 >> 172.21.15.114:0/2761973607 conn(0x7f1bb409aa10 msgr2=0x7f1bb409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:49.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 -- 172.21.15.114:0/2761973607 shutdown_connections 2024-09-16T07:36:49.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 -- 172.21.15.114:0/2761973607 wait complete. 2024-09-16T07:36:49.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 Processor -- start 2024-09-16T07:36:49.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.328+0000 7f1bb3200640 1 -- start start 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b0ce0 0x7f1bb4145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bb40b4d80 0x7f1bb4154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40b5870 0x7f1bb41509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4168a70 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41688f0 con 0x7f1bb40b5870 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb4168bf0 con 0x7f1bb40b4d80 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b0ce0 0x7f1bb4145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b0ce0 0x7f1bb4145fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42718/0 (socket says 172.21.15.114:42718) 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 -- 172.21.15.114:0/418160354 learned_addr learned my addr 172.21.15.114:0/418160354 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb2800640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40b5870 0x7f1bb41509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1400640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bb40b4d80 0x7f1bb4154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 -- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bb40b4d80 msgr2=0x7f1bb4154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bb40b4d80 0x7f1bb4154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 -- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40b5870 msgr2=0x7f1bb41509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40b5870 0x7f1bb41509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 -- 172.21.15.114:0/418160354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb4146520 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb1e00640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b0ce0 0x7f1bb4145fe0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400d980 tx=0x7f1ba400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1baa000640 1 -- 172.21.15.114:0/418160354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4017030 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1baa000640 1 -- 172.21.15.114:0/418160354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba4009b20 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb415d540 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1baa000640 1 -- 172.21.15.114:0/418160354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4004020 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb415db00 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.332+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb40b11a0 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.336+0000 7f1baa000640 1 -- 172.21.15.114:0/418160354 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f1ba401a070 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.336+0000 7f1baa000640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b940738e0 0x7f1b94075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.336+0000 7f1baa000640 1 -- 172.21.15.114:0/418160354 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5737+0+0 (secure 0 0 0) 0x7f1ba4092bc0 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.336+0000 7f1bb1400640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b940738e0 0x7f1b94075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.336+0000 7f1bb1400640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b940738e0 0x7f1b94075da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1bb41596c0 tx=0x7f1ba0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:49.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.340+0000 7f1baa000640 1 -- 172.21.15.114:0/418160354 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f1bb4146520 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.504+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bb415b520 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1baa000640 1 -- 172.21.15.114:0/418160354 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) ==== 74+0+16848 (secure 0 0 0) 0x7f1ba405f640 con 0x7f1bb40b0ce0 2024-09-16T07:36:49.506 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:49.506 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":164,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:48.170300+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:45.857532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:47.134690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b940738e0 msgr2=0x7f1b94075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b940738e0 0x7f1b94075da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1bb41596c0 tx=0x7f1ba0009040 comp rx=0 tx=0).stop 2024-09-16T07:36:49.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b0ce0 msgr2=0x7f1bb4145fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b0ce0 0x7f1bb4145fe0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400d980 tx=0x7f1ba400de40 comp rx=0 tx=0).stop 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 shutdown_connections 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bb40b5870 0x7f1bb41509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f1b940738e0 0x7f1b94075da0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bb40b4d80 0x7f1bb4154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 --2- 172.21.15.114:0/418160354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bb40b0ce0 0x7f1bb4145fe0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 >> 172.21.15.114:0/418160354 conn(0x7f1bb409aa10 msgr2=0x7f1bb415ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 shutdown_connections 2024-09-16T07:36:49.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.508+0000 7f1bb3200640 1 -- 172.21.15.114:0/418160354 wait complete. 2024-09-16T07:36:49.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- 172.21.15.114:0/596333706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 msgr2=0x7fb6f40acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 --2- 172.21.15.114:0/596333706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 0x7fb6f40acd40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400a950 tx=0x7fb6e401dae0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- 172.21.15.114:0/596333706 shutdown_connections 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 --2- 172.21.15.114:0/596333706 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f40b4a50 0x7fb6f40ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 --2- 172.21.15.114:0/596333706 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 0x7fb6f40acd40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- 172.21.15.114:0/596333706 >> 172.21.15.114:0/596333706 conn(0x7fb6f40b18f0 msgr2=0x7fb6f40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- 172.21.15.114:0/596333706 shutdown_connections 2024-09-16T07:36:49.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- 172.21.15.114:0/596333706 wait complete. 2024-09-16T07:36:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 Processor -- start 2024-09-16T07:36:49.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- start start 2024-09-16T07:36:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f40b4a50 0x7fb6f40c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f40cd100 0x7fb6f40c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 0x7fb6f4072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f4167120 con 0x7fb6f40cd100 2024-09-16T07:36:49.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40cf550 con 0x7fb6f415db50 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6fb800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f41672a0 con 0x7fb6f40b4a50 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6ebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f40cd100 0x7fb6f40c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6ebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f40cd100 0x7fb6f40c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42728/0 (socket says 172.21.15.114:42728) 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.676+0000 7fb6ebe00640 1 -- 172.21.15.114:0/1554366679 learned_addr learned my addr 172.21.15.114:0/1554366679 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6f9800640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 0x7fb6f4072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6f8e00640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f40b4a50 0x7fb6f40c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6ebe00640 1 -- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f40b4a50 msgr2=0x7fb6f40c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6ebe00640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f40b4a50 0x7fb6f40c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6ebe00640 1 -- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 msgr2=0x7fb6f4072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6ebe00640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 0x7fb6f4072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6ebe00640 1 -- 172.21.15.114:0/1554366679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f41fc350 con 0x7fb6f40cd100 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6f8e00640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f40b4a50 0x7fb6f40c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:49.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6ebe00640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f40cd100 0x7fb6f40c50a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c500 tx=0x7fb6dc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6f1600640 1 -- 172.21.15.114:0/1554366679 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc011790 con 0x7fb6f40cd100 2024-09-16T07:36:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6f1600640 1 -- 172.21.15.114:0/1554366679 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6dc017070 con 0x7fb6f40cd100 2024-09-16T07:36:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f41f8130 con 0x7fb6f40cd100 2024-09-16T07:36:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6f1600640 1 -- 172.21.15.114:0/1554366679 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc011cc0 con 0x7fb6f40cd100 2024-09-16T07:36:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f41f83d0 con 0x7fb6f40cd100 2024-09-16T07:36:49.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f4069410 con 0x7fb6f40cd100 2024-09-16T07:36:49.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.680+0000 7fb6f1600640 1 -- 172.21.15.114:0/1554366679 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fb6dc03e020 con 0x7fb6f40cd100 2024-09-16T07:36:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.684+0000 7fb6f1600640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6d00738e0 0x7fb6d0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.684+0000 7fb6f1600640 1 -- 172.21.15.114:0/1554366679 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5737+0+0 (secure 0 0 0) 0x7fb6dc092fa0 con 0x7fb6f40cd100 2024-09-16T07:36:49.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.684+0000 7fb6f8e00640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6d00738e0 0x7fb6d0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:49.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.684+0000 7fb6f8e00640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6d00738e0 0x7fb6d0075da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b0000 tx=0x7fb6e401c320 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:49.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.684+0000 7fb6f1600640 1 -- 172.21.15.114:0/1554366679 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb6dc05fa20 con 0x7fb6f40cd100 2024-09-16T07:36:49.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:49.892+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb6f40706e0 con 0x7fb6f40cd100 2024-09-16T07:36:50.753 INFO:tasks.ceph.mds.c.smithi114.stderr:2024-09-16T07:36:50.756+0000 7f30d6600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T07:36:50.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6f1600640 1 -- 172.21.15.114:0/1554366679 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v122) ==== 118+0+0 (secure 0 0 0) 0x7fb6dc05f320 con 0x7fb6f40cd100 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6d00738e0 msgr2=0x7fb6d0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6d00738e0 0x7fb6d0075da0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40b0000 tx=0x7fb6e401c320 comp rx=0 tx=0).stop 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f40cd100 msgr2=0x7fb6f40c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f40cd100 0x7fb6f40c50a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c500 tx=0x7fb6dc00c900 comp rx=0 tx=0).stop 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 shutdown_connections 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6f415db50 0x7fb6f4072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6f40cd100 0x7fb6f40c50a0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb6d00738e0 0x7fb6d0075da0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 --2- 172.21.15.114:0/1554366679 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb6f40b4a50 0x7fb6f40c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.816+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 >> 172.21.15.114:0/1554366679 conn(0x7fb6f40b18f0 msgr2=0x7fb6f415a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:50.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.820+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 shutdown_connections 2024-09-16T07:36:50.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.820+0000 7fb6fb800640 1 -- 172.21.15.114:0/1554366679 wait complete. 2024-09-16T07:36:50.841 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T07:36:50.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T07:36:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.992+0000 7fd9e0e00640 1 -- 172.21.15.114:0/22228091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 msgr2=0x7fd9c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.992+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/22228091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9c0004c90 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c310 tx=0x7fd9c401f6a0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.992+0000 7fd9e0e00640 1 -- 172.21.15.114:0/22228091 shutdown_connections 2024-09-16T07:36:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.992+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/22228091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9c0004c90 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.992+0000 7fd9e0e00640 1 -- 172.21.15.114:0/22228091 >> 172.21.15.114:0/22228091 conn(0x7fd9dc0cce90 msgr2=0x7fd9dc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.992+0000 7fd9e0e00640 1 -- 172.21.15.114:0/22228091 shutdown_connections 2024-09-16T07:36:50.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.992+0000 7fd9e0e00640 1 -- 172.21.15.114:0/22228091 wait complete. 2024-09-16T07:36:50.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 Processor -- start 2024-09-16T07:36:50.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 -- start start 2024-09-16T07:36:50.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9dc1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:50.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9dc0b2a30 0x7fd9dc151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:50.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9dc14f7d0 0x7fd9dc14fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:50.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc073da0 con 0x7fd9c0004810 2024-09-16T07:36:50.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc073c20 con 0x7fd9dc0b2a30 2024-09-16T07:36:50.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd9dc15e790 con 0x7fd9dc14f7d0 2024-09-16T07:36:50.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9dc1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9dc1f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42742/0 (socket says 172.21.15.114:42742) 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 -- 172.21.15.114:0/378547648 learned_addr learned my addr 172.21.15.114:0/378547648 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9da800640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9dc14f7d0 0x7fd9dc14fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d1400640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9dc0b2a30 0x7fd9dc151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 -- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9dc14f7d0 msgr2=0x7fd9dc14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9dc14f7d0 0x7fd9dc14fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 -- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9dc0b2a30 msgr2=0x7fd9dc151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9dc0b2a30 0x7fd9dc151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 -- 172.21.15.114:0/378547648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc1f64b0 con 0x7fd9c0004810 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9da800640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9dc14f7d0 0x7fd9dc14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d1400640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9dc0b2a30 0x7fd9dc151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:50.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d9e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9dc1f5e20 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc011a40 tx=0x7fd9cc011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:50.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d2a00640 1 -- 172.21.15.114:0/378547648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc01e070 con 0x7fd9c0004810 2024-09-16T07:36:50.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d2a00640 1 -- 172.21.15.114:0/378547648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9cc00fe70 con 0x7fd9c0004810 2024-09-16T07:36:50.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9dc1f6790 con 0x7fd9c0004810 2024-09-16T07:36:50.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9d2a00640 1 -- 172.21.15.114:0/378547648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0042b0 con 0x7fd9c0004810 2024-09-16T07:36:50.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9dc1f29d0 con 0x7fd9c0004810 2024-09-16T07:36:50.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:50.996+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9dc15b1a0 con 0x7fd9c0004810 2024-09-16T07:36:50.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.000+0000 7fd9d2a00640 1 -- 172.21.15.114:0/378547648 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fd9cc021070 con 0x7fd9c0004810 2024-09-16T07:36:50.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.000+0000 7fd9d2a00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9b8073910 0x7fd9b8075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:50.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.000+0000 7fd9d2a00640 1 -- 172.21.15.114:0/378547648 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fd9cc0930a0 con 0x7fd9c0004810 2024-09-16T07:36:51.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.000+0000 7fd9d1400640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9b8073910 0x7fd9b8075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:51.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.000+0000 7fd9d1400640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9b8073910 0x7fd9b8075dd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40af000 tx=0x7fd9c40b4040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:51.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.004+0000 7fd9d2a00640 1 -- 172.21.15.114:0/378547648 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd9cc05f6f0 con 0x7fd9c0004810 2024-09-16T07:36:51.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.208+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd9dc068e70 con 0x7fd9c0004810 2024-09-16T07:36:51.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9d2a00640 1 -- 172.21.15.114:0/378547648 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v123) ==== 122+0+0 (secure 0 0 0) 0x7fd9cc064120 con 0x7fd9c0004810 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9b8073910 msgr2=0x7fd9b8075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9b8073910 0x7fd9b8075dd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40af000 tx=0x7fd9c40b4040 comp rx=0 tx=0).stop 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 msgr2=0x7fd9dc1f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9dc1f5e20 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc011a40 tx=0x7fd9cc011f00 comp rx=0 tx=0).stop 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 shutdown_connections 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd9b8073910 0x7fd9b8075dd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd9dc14f7d0 0x7fd9dc14fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd9dc0b2a30 0x7fd9dc151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 --2- 172.21.15.114:0/378547648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd9c0004810 0x7fd9dc1f5e20 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 >> 172.21.15.114:0/378547648 conn(0x7fd9dc0cce90 msgr2=0x7fd9dc06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:51.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.820+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 shutdown_connections 2024-09-16T07:36:51.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.824+0000 7fd9e0e00640 1 -- 172.21.15.114:0/378547648 wait complete. 2024-09-16T07:36:51.842 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T07:36:51.842 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 -- 172.21.15.114:0/1514509076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0cfe80 msgr2=0x7f4bfc0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1514509076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0cfe80 0x7f4bfc0d0260 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009bc0 tx=0x7f4bec01cb10 comp rx=0 tx=0).stop 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 -- 172.21.15.114:0/1514509076 shutdown_connections 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1514509076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0b2760 0x7f4bfc1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1514509076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0cfe80 0x7f4bfc0d0260 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 -- 172.21.15.114:0/1514509076 >> 172.21.15.114:0/1514509076 conn(0x7f4bfc0d1e40 msgr2=0x7f4bfc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 -- 172.21.15.114:0/1514509076 shutdown_connections 2024-09-16T07:36:51.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.984+0000 7f4c00a00640 1 -- 172.21.15.114:0/1514509076 wait complete. 2024-09-16T07:36:51.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 Processor -- start 2024-09-16T07:36:51.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 -- start start 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0b2760 0x7f4bfc15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0b2d00 0x7f4bfc15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0cfe80 0x7f4bfc160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0b08e0 con 0x7f4bfc0b2760 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0b0760 con 0x7f4bfc0cfe80 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0b0a60 con 0x7f4bfc0b2d00 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0b2760 0x7f4bfc15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0b2760 0x7f4bfc15f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42752/0 (socket says 172.21.15.114:42752) 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 -- 172.21.15.114:0/1776122353 learned_addr learned my addr 172.21.15.114:0/1776122353 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf1400640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0b2d00 0x7f4bfc15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:51.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bfa800640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0cfe80 0x7f4bfc160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 -- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0b2d00 msgr2=0x7f4bfc15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0b2d00 0x7f4bfc15fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 -- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0cfe80 msgr2=0x7f4bfc160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0cfe80 0x7f4bfc160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 -- 172.21.15.114:0/1776122353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc15f7f0 con 0x7f4bfc0b2760 2024-09-16T07:36:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf1400640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0b2d00 0x7f4bfc15fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:51.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf9e00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0b2760 0x7f4bfc15f2b0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009b10 tx=0x7f4bec005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf2a00640 1 -- 172.21.15.114:0/1776122353 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0b2040 con 0x7f4bfc0b2760 2024-09-16T07:36:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf2a00640 1 -- 172.21.15.114:0/1776122353 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bec004330 con 0x7f4bfc0b2760 2024-09-16T07:36:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc1f5480 con 0x7f4bfc0b2760 2024-09-16T07:36:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4bf2a00640 1 -- 172.21.15.114:0/1776122353 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec004720 con 0x7f4bfc0b2760 2024-09-16T07:36:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.988+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc1f5a40 con 0x7f4bfc0b2760 2024-09-16T07:36:51.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.992+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc0d0260 con 0x7f4bfc0b2760 2024-09-16T07:36:51.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.992+0000 7f4bf2a00640 1 -- 172.21.15.114:0/1776122353 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f4bec0bd060 con 0x7f4bfc0b2760 2024-09-16T07:36:51.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.992+0000 7f4bf2a00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073910 0x7f4bd8075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:51.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.992+0000 7f4bf2a00640 1 -- 172.21.15.114:0/1776122353 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f4bec12c630 con 0x7f4bfc0b2760 2024-09-16T07:36:51.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.992+0000 7f4bf1400640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073910 0x7f4bd8075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:51.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.992+0000 7f4bf1400640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073910 0x7f4bd8075dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0c8d10 tx=0x7f4be4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:51.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:51.996+0000 7f4bf2a00640 1 -- 172.21.15.114:0/1776122353 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4bfc15f7f0 con 0x7f4bfc0b2760 2024-09-16T07:36:52.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bfc15fa20 con 0x7f4bfc0b2760 2024-09-16T07:36:52.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4bf2a00640 1 -- 172.21.15.114:0/1776122353 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5239 (secure 0 0 0) 0x7f4bec016790 con 0x7f4bfc0b2760 2024-09-16T07:36:52.198 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:52.198 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":123,"btime":"2024-09-16T07:36:51:820962+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3201169795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3201169795},{"type":"v1","addr":"172.21.15.149:6801","nonce":3201169795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/64911771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":64911771},{"type":"v1","addr":"172.21.15.149:6835","nonce":64911771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9168,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3812839687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3812839687},{"type":"v1","addr":"172.21.15.114:6834","nonce":3812839687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:48.170239+0000","modified":"2024-09-16T07:36:51.212927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9171":{"gid":9171,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/2790565513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2790565513},{"type":"v1","addr":"172.21.15.114:6835","nonce":2790565513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9171,"qdb_cluster":[9171]},"id":13}]} 2024-09-16T07:36:52.198 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 123 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073910 msgr2=0x7f4bd8075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073910 0x7f4bd8075dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0c8d10 tx=0x7f4be4009040 comp rx=0 tx=0).stop 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0b2760 msgr2=0x7f4bfc15f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0b2760 0x7f4bfc15f2b0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009b10 tx=0x7f4bec005ae0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 shutdown_connections 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bfc0cfe80 0x7f4bfc160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4bd8073910 0x7f4bd8075dd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bfc0b2d00 0x7f4bfc15fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 --2- 172.21.15.114:0/1776122353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bfc0b2760 0x7f4bfc15f2b0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 >> 172.21.15.114:0/1776122353 conn(0x7f4bfc0d1e40 msgr2=0x7f4bfc0cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:52.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 shutdown_connections 2024-09-16T07:36:52.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.200+0000 7f4c00a00640 1 -- 172.21.15.114:0/1776122353 wait complete. 2024-09-16T07:36:52.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- 172.21.15.114:0/123522566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 msgr2=0x7f95080b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 --2- 172.21.15.114:0/123522566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f95080b14c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009840 tx=0x7f94f801c760 comp rx=0 tx=0).stop 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- 172.21.15.114:0/123522566 shutdown_connections 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 --2- 172.21.15.114:0/123522566 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080afca0 0x7f95080b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 --2- 172.21.15.114:0/123522566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f95080b14c0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- 172.21.15.114:0/123522566 >> 172.21.15.114:0/123522566 conn(0x7f95080d1e30 msgr2=0x7f95080d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- 172.21.15.114:0/123522566 shutdown_connections 2024-09-16T07:36:52.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- 172.21.15.114:0/123522566 wait complete. 2024-09-16T07:36:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 Processor -- start 2024-09-16T07:36:52.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- start start 2024-09-16T07:36:52.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95080afca0 0x7f950814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080b2e80 0x7f95081594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f950815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9508168e00 con 0x7f950815f490 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9508168c80 con 0x7f95080afca0 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ee00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9508168f80 con 0x7f95080b2e80 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f950815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f950815dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42770/0 (socket says 172.21.15.114:42770) 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f950ce00640 1 -- 172.21.15.114:0/686997748 learned_addr learned my addr 172.21.15.114:0/686997748 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:52.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f9507e00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95080afca0 0x7f950814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.364+0000 7f94ff400640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080b2e80 0x7f95081594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ce00640 1 -- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080b2e80 msgr2=0x7f95081594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ce00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080b2e80 0x7f95081594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ce00640 1 -- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95080afca0 msgr2=0x7f950814e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ce00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95080afca0 0x7f950814e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ce00640 1 -- 172.21.15.114:0/686997748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080b0360 con 0x7f950815f490 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ce00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f950815dee0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f950000da10 tx=0x7f950000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f9504c00640 1 -- 172.21.15.114:0/686997748 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500017070 con 0x7f950815f490 2024-09-16T07:36:52.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f9504c00640 1 -- 172.21.15.114:0/686997748 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9500004b30 con 0x7f950815f490 2024-09-16T07:36:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f9504c00640 1 -- 172.21.15.114:0/686997748 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950000be60 con 0x7f950815f490 2024-09-16T07:36:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9508166a90 con 0x7f950815f490 2024-09-16T07:36:52.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950815d6c0 con 0x7f950815f490 2024-09-16T07:36:52.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080b0110 con 0x7f950815f490 2024-09-16T07:36:52.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f9504c00640 1 -- 172.21.15.114:0/686997748 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f9500010460 con 0x7f950815f490 2024-09-16T07:36:52.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f9504c00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f94e40738e0 0x7f94e4075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.368+0000 7f9504c00640 1 -- 172.21.15.114:0/686997748 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f9500092cf0 con 0x7f950815f490 2024-09-16T07:36:52.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.372+0000 7f9507e00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f94e40738e0 0x7f94e4075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.372+0000 7f9507e00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f94e40738e0 0x7f94e4075da0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f94f80af000 tx=0x7f94f801afa0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.372+0000 7f9504c00640 1 -- 172.21.15.114:0/686997748 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9500020070 con 0x7f950815f490 2024-09-16T07:36:52.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.548+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95081599f0 con 0x7f950815f490 2024-09-16T07:36:52.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.548+0000 7f9504c00640 1 -- 172.21.15.114:0/686997748 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16835 (secure 0 0 0) 0x7f9508166a90 con 0x7f950815f490 2024-09-16T07:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:52.548 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":165,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:49.795356+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:45.857532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:47.134690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f94e40738e0 msgr2=0x7f94e4075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f94e40738e0 0x7f94e4075da0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f94f80af000 tx=0x7f94f801afa0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 msgr2=0x7f950815dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f950815dee0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f950000da10 tx=0x7f950000ded0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 shutdown_connections 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f950815f490 0x7f950815dee0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f94e40738e0 0x7f94e4075da0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95080b2e80 0x7f95081594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 --2- 172.21.15.114:0/686997748 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95080afca0 0x7f950814e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 >> 172.21.15.114:0/686997748 conn(0x7f95080d1e30 msgr2=0x7f95080d23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 shutdown_connections 2024-09-16T07:36:52.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.552+0000 7f950ee00640 1 -- 172.21.15.114:0/686997748 wait complete. 2024-09-16T07:36:52.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:36:52.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:36:52.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.712+0000 7fdbbec00640 1 -- 172.21.15.114:0/2861325410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb80cdb30 msgr2=0x7fdbb80af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.712+0000 7fdbbec00640 1 --2- 172.21.15.114:0/2861325410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb80cdb30 0x7fdbb80af0c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0009bc0 tx=0x7fdbb001cba0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.712+0000 7fdbbec00640 1 -- 172.21.15.114:0/2861325410 shutdown_connections 2024-09-16T07:36:52.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.712+0000 7fdbbec00640 1 --2- 172.21.15.114:0/2861325410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb80cdb30 0x7fdbb80af0c0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.712+0000 7fdbbec00640 1 -- 172.21.15.114:0/2861325410 >> 172.21.15.114:0/2861325410 conn(0x7fdbb80d1dc0 msgr2=0x7fdbb80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:52.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.712+0000 7fdbbec00640 1 -- 172.21.15.114:0/2861325410 shutdown_connections 2024-09-16T07:36:52.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.712+0000 7fdbbec00640 1 -- 172.21.15.114:0/2861325410 wait complete. 2024-09-16T07:36:52.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 Processor -- start 2024-09-16T07:36:52.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 -- start start 2024-09-16T07:36:52.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb80cdb30 0x7fdbb8159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb80ced80 0x7fdbb809bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb815bea0 0x7fdbb81fc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb816a8a0 con 0x7fdbb815bea0 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb816a720 con 0x7fdbb80cdb30 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb816aa20 con 0x7fdbb80ced80 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb815bea0 0x7fdbb81fc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb815bea0 0x7fdbb81fc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42780/0 (socket says 172.21.15.114:42780) 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 -- 172.21.15.114:0/4281665177 learned_addr learned my addr 172.21.15.114:0/4281665177 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbb7e00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb80cdb30 0x7fdbb8159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbaf400640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb80ced80 0x7fdbb809bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 -- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb80ced80 msgr2=0x7fdbb809bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb80ced80 0x7fdbb809bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 -- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb80cdb30 msgr2=0x7fdbb8159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb80cdb30 0x7fdbb8159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 -- 172.21.15.114:0/4281665177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb815a3c0 con 0x7fdbb815bea0 2024-09-16T07:36:52.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbcc00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb815bea0 0x7fdbb81fc1d0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00197b0 tx=0x7fdbb0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:52.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbb4c00640 1 -- 172.21.15.114:0/4281665177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00b2040 con 0x7fdbb815bea0 2024-09-16T07:36:52.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbb4c00640 1 -- 172.21.15.114:0/4281665177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbb0004d40 con 0x7fdbb815bea0 2024-09-16T07:36:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbb4c00640 1 -- 172.21.15.114:0/4281665177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0004240 con 0x7fdbb815bea0 2024-09-16T07:36:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb809c070 con 0x7fdbb815bea0 2024-09-16T07:36:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb809cf30 con 0x7fdbb815bea0 2024-09-16T07:36:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.716+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb80ce670 con 0x7fdbb815bea0 2024-09-16T07:36:52.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.720+0000 7fdbb4c00640 1 -- 172.21.15.114:0/4281665177 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fdbb00be060 con 0x7fdbb815bea0 2024-09-16T07:36:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.720+0000 7fdbb4c00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb940738e0 0x7fdb94075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.720+0000 7fdbb4c00640 1 -- 172.21.15.114:0/4281665177 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fdbb012c760 con 0x7fdbb815bea0 2024-09-16T07:36:52.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.720+0000 7fdbb7e00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb940738e0 0x7fdb94075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:52.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.720+0000 7fdbb7e00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb940738e0 0x7fdb94075da0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdba8001650 tx=0x7fdba8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:52.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.724+0000 7fdbb4c00640 1 -- 172.21.15.114:0/4281665177 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdbb00a5e20 con 0x7fdbb815bea0 2024-09-16T07:36:52.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.892+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbb80d2480 con 0x7fdb940738e0 2024-09-16T07:36:52.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.896+0000 7fdbb4c00640 1 -- 172.21.15.114:0/4281665177 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247115 (secure 0 0 0) 0x7fdbb80d2480 con 0x7fdb940738e0 2024-09-16T07:36:52.896 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:52.897 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:36:52.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb940738e0 msgr2=0x7fdb94075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb940738e0 0x7fdb94075da0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdba8001650 tx=0x7fdba8009040 comp rx=0 tx=0).stop 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb815bea0 msgr2=0x7fdbb81fc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb815bea0 0x7fdbb81fc1d0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00197b0 tx=0x7fdbb0009300 comp rx=0 tx=0).stop 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 shutdown_connections 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdbb815bea0 0x7fdbb81fc1d0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdb940738e0 0x7fdb94075da0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdbb80ced80 0x7fdbb809bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 --2- 172.21.15.114:0/4281665177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbb80cdb30 0x7fdbb8159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 >> 172.21.15.114:0/4281665177 conn(0x7fdbb80d1dc0 msgr2=0x7fdbb80b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 shutdown_connections 2024-09-16T07:36:52.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:52.900+0000 7fdbbec00640 1 -- 172.21.15.114:0/4281665177 wait complete. 2024-09-16T07:36:52.917 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-16T07:36:52.427063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266688,"kb_used_data":17144,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708032,"statfs":{"total":773094113280,"available":772821024768,"internally_reserved":0,"allocated":17555456,"data_stored":8374140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.665173"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782760+0000","last_change":"2024-09-16T07:36:47.782760+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782760+0000","last_undegraded":"2024-09-16T07:36:47.782760+0000","last_fullsized":"2024-09-16T07:36:47.782760+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772397+0000","last_change":"2024-09-16T07:36:47.772397+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772397+0000","last_undegraded":"2024-09-16T07:36:47.772397+0000","last_fullsized":"2024-09-16T07:36:47.772397+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780219+0000","last_change":"2024-09-16T07:36:47.780219+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780219+0000","last_undegraded":"2024-09-16T07:36:47.780219+0000","last_fullsized":"2024-09-16T07:36:47.780219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777443+0000","last_change":"2024-09-16T07:36:47.777443+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777443+0000","last_undegraded":"2024-09-16T07:36:47.777443+0000","last_fullsized":"2024-09-16T07:36:47.777443+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778403+0000","last_change":"2024-09-16T07:36:47.778403+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778403+0000","last_undegraded":"2024-09-16T07:36:47.778403+0000","last_fullsized":"2024-09-16T07:36:47.778403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779044+0000","last_change":"2024-09-16T07:36:47.779044+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779044+0000","last_undegraded":"2024-09-16T07:36:47.779044+0000","last_fullsized":"2024-09-16T07:36:47.779044+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780859+0000","last_change":"2024-09-16T07:36:47.780859+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780859+0000","last_undegraded":"2024-09-16T07:36:47.780859+0000","last_fullsized":"2024-09-16T07:36:47.780859+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779353+0000","last_change":"2024-09-16T07:36:47.779353+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779353+0000","last_undegraded":"2024-09-16T07:36:47.779353+0000","last_fullsized":"2024-09-16T07:36:47.779353+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771826+0000","last_change":"2024-09-16T07:36:47.771826+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771826+0000","last_undegraded":"2024-09-16T07:36:47.771826+0000","last_fullsized":"2024-09-16T07:36:47.771826+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778464+0000","last_change":"2024-09-16T07:36:47.778464+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778464+0000","last_undegraded":"2024-09-16T07:36:47.778464+0000","last_fullsized":"2024-09-16T07:36:47.778464+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779800+0000","last_change":"2024-09-16T07:36:47.779800+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779800+0000","last_undegraded":"2024-09-16T07:36:47.779800+0000","last_fullsized":"2024-09-16T07:36:47.779800+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774173+0000","last_change":"2024-09-16T07:36:47.774173+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774173+0000","last_undegraded":"2024-09-16T07:36:47.774173+0000","last_fullsized":"2024-09-16T07:36:47.774173+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.773774+0000","last_change":"2024-09-16T07:36:47.773774+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.773774+0000","last_undegraded":"2024-09-16T07:36:47.773774+0000","last_fullsized":"2024-09-16T07:36:47.773774+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781665+0000","last_change":"2024-09-16T07:36:47.781665+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781665+0000","last_undegraded":"2024-09-16T07:36:47.781665+0000","last_fullsized":"2024-09-16T07:36:47.781665+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780405+0000","last_change":"2024-09-16T07:36:47.780405+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780405+0000","last_undegraded":"2024-09-16T07:36:47.780405+0000","last_fullsized":"2024-09-16T07:36:47.780405+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777186+0000","last_change":"2024-09-16T07:36:47.777186+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777186+0000","last_undegraded":"2024-09-16T07:36:47.777186+0000","last_fullsized":"2024-09-16T07:36:47.777186+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782229+0000","last_change":"2024-09-16T07:36:47.782229+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782229+0000","last_undegraded":"2024-09-16T07:36:47.782229+0000","last_fullsized":"2024-09-16T07:36:47.782229+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777381+0000","last_change":"2024-09-16T07:36:47.777381+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777381+0000","last_undegraded":"2024-09-16T07:36:47.777381+0000","last_fullsized":"2024-09-16T07:36:47.777381+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776274+0000","last_change":"2024-09-16T07:36:47.776274+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776274+0000","last_undegraded":"2024-09-16T07:36:47.776274+0000","last_fullsized":"2024-09-16T07:36:47.776274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780718+0000","last_change":"2024-09-16T07:36:47.780718+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780718+0000","last_undegraded":"2024-09-16T07:36:47.780718+0000","last_fullsized":"2024-09-16T07:36:47.780718+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777117+0000","last_change":"2024-09-16T07:36:47.777117+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777117+0000","last_undegraded":"2024-09-16T07:36:47.777117+0000","last_fullsized":"2024-09-16T07:36:47.777117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767727+0000","last_change":"2024-09-16T07:36:47.767727+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767727+0000","last_undegraded":"2024-09-16T07:36:47.767727+0000","last_fullsized":"2024-09-16T07:36:47.767727+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767742+0000","last_change":"2024-09-16T07:36:47.767742+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767742+0000","last_undegraded":"2024-09-16T07:36:47.767742+0000","last_fullsized":"2024-09-16T07:36:47.767742+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777086+0000","last_change":"2024-09-16T07:36:47.777086+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777086+0000","last_undegraded":"2024-09-16T07:36:47.777086+0000","last_fullsized":"2024-09-16T07:36:47.777086+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772860+0000","last_change":"2024-09-16T07:36:47.772860+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772860+0000","last_undegraded":"2024-09-16T07:36:47.772860+0000","last_fullsized":"2024-09-16T07:36:47.772860+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782198+0000","last_change":"2024-09-16T07:36:47.782198+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782198+0000","last_undegraded":"2024-09-16T07:36:47.782198+0000","last_fullsized":"2024-09-16T07:36:47.782198+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772397+0000","last_change":"2024-09-16T07:36:47.772397+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772397+0000","last_undegraded":"2024-09-16T07:36:47.772397+0000","last_fullsized":"2024-09-16T07:36:47.772397+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778104+0000","last_change":"2024-09-16T07:36:47.778104+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778104+0000","last_undegraded":"2024-09-16T07:36:47.778104+0000","last_fullsized":"2024-09-16T07:36:47.778104+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774654+0000","last_change":"2024-09-16T07:36:47.774654+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774654+0000","last_undegraded":"2024-09-16T07:36:47.774654+0000","last_fullsized":"2024-09-16T07:36:47.774654+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.769663+0000","last_change":"2024-09-16T07:36:47.769663+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.769663+0000","last_undegraded":"2024-09-16T07:36:47.769663+0000","last_fullsized":"2024-09-16T07:36:47.769663+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776786+0000","last_change":"2024-09-16T07:36:47.776786+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776786+0000","last_undegraded":"2024-09-16T07:36:47.776786+0000","last_fullsized":"2024-09-16T07:36:47.776786+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779997+0000","last_change":"2024-09-16T07:36:47.779997+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779997+0000","last_undegraded":"2024-09-16T07:36:47.779997+0000","last_fullsized":"2024-09-16T07:36:47.779997+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771925+0000","last_change":"2024-09-16T07:36:47.771925+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771925+0000","last_undegraded":"2024-09-16T07:36:47.771925+0000","last_fullsized":"2024-09-16T07:36:47.771925+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788098+0000","last_change":"2024-09-16T07:36:47.783864+0000","last_active":"2024-09-16T07:36:47.788098+0000","last_peered":"2024-09-16T07:36:47.788098+0000","last_clean":"2024-09-16T07:36:47.788098+0000","last_became_active":"2024-09-16T07:36:47.783569+0000","last_became_peered":"2024-09-16T07:36:47.783569+0000","last_unstale":"2024-09-16T07:36:47.788098+0000","last_undegraded":"2024-09-16T07:36:47.788098+0000","last_fullsized":"2024-09-16T07:36:47.788098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:55.891100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.768905+0000","last_change":"2024-09-16T07:36:47.768905+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.768905+0000","last_undegraded":"2024-09-16T07:36:47.768905+0000","last_fullsized":"2024-09-16T07:36:47.768905+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788551+0000","last_change":"2024-09-16T07:36:47.785063+0000","last_active":"2024-09-16T07:36:47.788551+0000","last_peered":"2024-09-16T07:36:47.788551+0000","last_clean":"2024-09-16T07:36:47.788551+0000","last_became_active":"2024-09-16T07:36:47.784686+0000","last_became_peered":"2024-09-16T07:36:47.784686+0000","last_unstale":"2024-09-16T07:36:47.788551+0000","last_undegraded":"2024-09-16T07:36:47.788551+0000","last_fullsized":"2024-09-16T07:36:47.788551+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:26.504556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781273+0000","last_change":"2024-09-16T07:36:47.781273+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781273+0000","last_undegraded":"2024-09-16T07:36:47.781273+0000","last_fullsized":"2024-09-16T07:36:47.781273+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792471+0000","last_change":"2024-09-16T07:36:47.789633+0000","last_active":"2024-09-16T07:36:47.792471+0000","last_peered":"2024-09-16T07:36:47.792471+0000","last_clean":"2024-09-16T07:36:47.792471+0000","last_became_active":"2024-09-16T07:36:47.789328+0000","last_became_peered":"2024-09-16T07:36:47.789328+0000","last_unstale":"2024-09-16T07:36:47.792471+0000","last_undegraded":"2024-09-16T07:36:47.792471+0000","last_fullsized":"2024-09-16T07:36:47.792471+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:16.180075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775800+0000","last_change":"2024-09-16T07:36:47.775800+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775800+0000","last_undegraded":"2024-09-16T07:36:47.775800+0000","last_fullsized":"2024-09-16T07:36:47.775800+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795019+0000","last_change":"2024-09-16T07:36:47.794481+0000","last_active":"2024-09-16T07:36:47.795019+0000","last_peered":"2024-09-16T07:36:47.795019+0000","last_clean":"2024-09-16T07:36:47.795019+0000","last_became_active":"2024-09-16T07:36:47.794271+0000","last_became_peered":"2024-09-16T07:36:47.794271+0000","last_unstale":"2024-09-16T07:36:47.795019+0000","last_undegraded":"2024-09-16T07:36:47.795019+0000","last_fullsized":"2024-09-16T07:36:47.795019+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:53.238074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776623+0000","last_change":"2024-09-16T07:36:47.776623+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776623+0000","last_undegraded":"2024-09-16T07:36:47.776623+0000","last_fullsized":"2024-09-16T07:36:47.776623+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795217+0000","last_change":"2024-09-16T07:36:47.786771+0000","last_active":"2024-09-16T07:36:47.795217+0000","last_peered":"2024-09-16T07:36:47.795217+0000","last_clean":"2024-09-16T07:36:47.795217+0000","last_became_active":"2024-09-16T07:36:47.786344+0000","last_became_peered":"2024-09-16T07:36:47.786344+0000","last_unstale":"2024-09-16T07:36:47.795217+0000","last_undegraded":"2024-09-16T07:36:47.795217+0000","last_fullsized":"2024-09-16T07:36:47.795217+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:27:24.850313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778923+0000","last_change":"2024-09-16T07:36:47.778923+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778923+0000","last_undegraded":"2024-09-16T07:36:47.778923+0000","last_fullsized":"2024-09-16T07:36:47.778923+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798172+0000","last_change":"2024-09-16T07:36:47.792142+0000","last_active":"2024-09-16T07:36:47.798172+0000","last_peered":"2024-09-16T07:36:47.798172+0000","last_clean":"2024-09-16T07:36:47.798172+0000","last_became_active":"2024-09-16T07:36:47.791887+0000","last_became_peered":"2024-09-16T07:36:47.791887+0000","last_unstale":"2024-09-16T07:36:47.798172+0000","last_undegraded":"2024-09-16T07:36:47.798172+0000","last_fullsized":"2024-09-16T07:36:47.798172+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:51:14.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776627+0000","last_change":"2024-09-16T07:36:47.776627+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776627+0000","last_undegraded":"2024-09-16T07:36:47.776627+0000","last_fullsized":"2024-09-16T07:36:47.776627+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.780146+0000","last_change":"2024-09-16T07:36:47.775955+0000","last_active":"2024-09-16T07:36:47.780146+0000","last_peered":"2024-09-16T07:36:47.780146+0000","last_clean":"2024-09-16T07:36:47.780146+0000","last_became_active":"2024-09-16T07:36:47.774675+0000","last_became_peered":"2024-09-16T07:36:47.774675+0000","last_unstale":"2024-09-16T07:36:47.780146+0000","last_undegraded":"2024-09-16T07:36:47.780146+0000","last_fullsized":"2024-09-16T07:36:47.780146+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:55.771795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777937+0000","last_change":"2024-09-16T07:36:47.777937+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777937+0000","last_undegraded":"2024-09-16T07:36:47.777937+0000","last_fullsized":"2024-09-16T07:36:47.777937+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798082+0000","last_change":"2024-09-16T07:36:47.790849+0000","last_active":"2024-09-16T07:36:47.798082+0000","last_peered":"2024-09-16T07:36:47.798082+0000","last_clean":"2024-09-16T07:36:47.798082+0000","last_became_active":"2024-09-16T07:36:47.790581+0000","last_became_peered":"2024-09-16T07:36:47.790581+0000","last_unstale":"2024-09-16T07:36:47.798082+0000","last_undegraded":"2024-09-16T07:36:47.798082+0000","last_fullsized":"2024-09-16T07:36:47.798082+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:55.891100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777144+0000","last_change":"2024-09-16T07:36:47.777144+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777144+0000","last_undegraded":"2024-09-16T07:36:47.777144+0000","last_fullsized":"2024-09-16T07:36:47.777144+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.780220+0000","last_change":"2024-09-16T07:36:47.776292+0000","last_active":"2024-09-16T07:36:47.780220+0000","last_peered":"2024-09-16T07:36:47.780220+0000","last_clean":"2024-09-16T07:36:47.780220+0000","last_became_active":"2024-09-16T07:36:47.775815+0000","last_became_peered":"2024-09-16T07:36:47.775815+0000","last_unstale":"2024-09-16T07:36:47.780220+0000","last_undegraded":"2024-09-16T07:36:47.780220+0000","last_fullsized":"2024-09-16T07:36:47.780220+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:46.845007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776865+0000","last_change":"2024-09-16T07:36:47.776865+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776865+0000","last_undegraded":"2024-09-16T07:36:47.776865+0000","last_fullsized":"2024-09-16T07:36:47.776865+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798028+0000","last_change":"2024-09-16T07:36:47.794548+0000","last_active":"2024-09-16T07:36:47.798028+0000","last_peered":"2024-09-16T07:36:47.798028+0000","last_clean":"2024-09-16T07:36:47.798028+0000","last_became_active":"2024-09-16T07:36:47.793042+0000","last_became_peered":"2024-09-16T07:36:47.793042+0000","last_unstale":"2024-09-16T07:36:47.798028+0000","last_undegraded":"2024-09-16T07:36:47.798028+0000","last_fullsized":"2024-09-16T07:36:47.798028+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:26.858727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781244+0000","last_change":"2024-09-16T07:36:47.781244+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781244+0000","last_undegraded":"2024-09-16T07:36:47.781244+0000","last_fullsized":"2024-09-16T07:36:47.781244+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793168+0000","last_change":"2024-09-16T07:36:47.789226+0000","last_active":"2024-09-16T07:36:47.793168+0000","last_peered":"2024-09-16T07:36:47.793168+0000","last_clean":"2024-09-16T07:36:47.793168+0000","last_became_active":"2024-09-16T07:36:47.788766+0000","last_became_peered":"2024-09-16T07:36:47.788766+0000","last_unstale":"2024-09-16T07:36:47.793168+0000","last_undegraded":"2024-09-16T07:36:47.793168+0000","last_fullsized":"2024-09-16T07:36:47.793168+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:59:31.170029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778537+0000","last_change":"2024-09-16T07:36:47.778537+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778537+0000","last_undegraded":"2024-09-16T07:36:47.778537+0000","last_fullsized":"2024-09-16T07:36:47.778537+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.787867+0000","last_change":"2024-09-16T07:36:47.781350+0000","last_active":"2024-09-16T07:36:47.787867+0000","last_peered":"2024-09-16T07:36:47.787867+0000","last_clean":"2024-09-16T07:36:47.787867+0000","last_became_active":"2024-09-16T07:36:47.781033+0000","last_became_peered":"2024-09-16T07:36:47.781033+0000","last_unstale":"2024-09-16T07:36:47.787867+0000","last_undegraded":"2024-09-16T07:36:47.787867+0000","last_fullsized":"2024-09-16T07:36:47.787867+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:17.517901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775989+0000","last_change":"2024-09-16T07:36:47.775989+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775989+0000","last_undegraded":"2024-09-16T07:36:47.775989+0000","last_fullsized":"2024-09-16T07:36:47.775989+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.785549+0000","last_change":"2024-09-16T07:36:47.781137+0000","last_active":"2024-09-16T07:36:47.785549+0000","last_peered":"2024-09-16T07:36:47.785549+0000","last_clean":"2024-09-16T07:36:47.785549+0000","last_became_active":"2024-09-16T07:36:47.780684+0000","last_became_peered":"2024-09-16T07:36:47.780684+0000","last_unstale":"2024-09-16T07:36:47.785549+0000","last_undegraded":"2024-09-16T07:36:47.785549+0000","last_fullsized":"2024-09-16T07:36:47.785549+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:50:42.775969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777085+0000","last_change":"2024-09-16T07:36:47.777085+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777085+0000","last_undegraded":"2024-09-16T07:36:47.777085+0000","last_fullsized":"2024-09-16T07:36:47.777085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793098+0000","last_change":"2024-09-16T07:36:47.786759+0000","last_active":"2024-09-16T07:36:47.793098+0000","last_peered":"2024-09-16T07:36:47.793098+0000","last_clean":"2024-09-16T07:36:47.793098+0000","last_became_active":"2024-09-16T07:36:47.786477+0000","last_became_peered":"2024-09-16T07:36:47.786477+0000","last_unstale":"2024-09-16T07:36:47.793098+0000","last_undegraded":"2024-09-16T07:36:47.793098+0000","last_fullsized":"2024-09-16T07:36:47.793098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:18.476045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779948+0000","last_change":"2024-09-16T07:36:47.779948+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779948+0000","last_undegraded":"2024-09-16T07:36:47.779948+0000","last_fullsized":"2024-09-16T07:36:47.779948+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792272+0000","last_change":"2024-09-16T07:36:47.788463+0000","last_active":"2024-09-16T07:36:47.792272+0000","last_peered":"2024-09-16T07:36:47.792272+0000","last_clean":"2024-09-16T07:36:47.792272+0000","last_became_active":"2024-09-16T07:36:47.788206+0000","last_became_peered":"2024-09-16T07:36:47.788206+0000","last_unstale":"2024-09-16T07:36:47.792272+0000","last_undegraded":"2024-09-16T07:36:47.792272+0000","last_fullsized":"2024-09-16T07:36:47.792272+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:37.773632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771461+0000","last_change":"2024-09-16T07:36:47.771461+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771461+0000","last_undegraded":"2024-09-16T07:36:47.771461+0000","last_fullsized":"2024-09-16T07:36:47.771461+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.801979+0000","last_change":"2024-09-16T07:36:47.799092+0000","last_active":"2024-09-16T07:36:47.801979+0000","last_peered":"2024-09-16T07:36:47.801979+0000","last_clean":"2024-09-16T07:36:47.801979+0000","last_became_active":"2024-09-16T07:36:47.798679+0000","last_became_peered":"2024-09-16T07:36:47.798679+0000","last_unstale":"2024-09-16T07:36:47.801979+0000","last_undegraded":"2024-09-16T07:36:47.801979+0000","last_fullsized":"2024-09-16T07:36:47.801979+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:43.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772417+0000","last_change":"2024-09-16T07:36:47.772417+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772417+0000","last_undegraded":"2024-09-16T07:36:47.772417+0000","last_fullsized":"2024-09-16T07:36:47.772417+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.786115+0000","last_change":"2024-09-16T07:36:47.781253+0000","last_active":"2024-09-16T07:36:47.786115+0000","last_peered":"2024-09-16T07:36:47.786115+0000","last_clean":"2024-09-16T07:36:47.786115+0000","last_became_active":"2024-09-16T07:36:47.780968+0000","last_became_peered":"2024-09-16T07:36:47.780968+0000","last_unstale":"2024-09-16T07:36:47.786115+0000","last_undegraded":"2024-09-16T07:36:47.786115+0000","last_fullsized":"2024-09-16T07:36:47.786115+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:13.117629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777566+0000","last_change":"2024-09-16T07:36:47.777566+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777566+0000","last_undegraded":"2024-09-16T07:36:47.777566+0000","last_fullsized":"2024-09-16T07:36:47.777566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795398+0000","last_change":"2024-09-16T07:36:47.792016+0000","last_active":"2024-09-16T07:36:47.795398+0000","last_peered":"2024-09-16T07:36:47.795398+0000","last_clean":"2024-09-16T07:36:47.795398+0000","last_became_active":"2024-09-16T07:36:47.791765+0000","last_became_peered":"2024-09-16T07:36:47.791765+0000","last_unstale":"2024-09-16T07:36:47.795398+0000","last_undegraded":"2024-09-16T07:36:47.795398+0000","last_fullsized":"2024-09-16T07:36:47.795398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:43.222917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775124+0000","last_change":"2024-09-16T07:36:47.775124+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775124+0000","last_undegraded":"2024-09-16T07:36:47.775124+0000","last_fullsized":"2024-09-16T07:36:47.775124+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792529+0000","last_change":"2024-09-16T07:36:47.789887+0000","last_active":"2024-09-16T07:36:47.792529+0000","last_peered":"2024-09-16T07:36:47.792529+0000","last_clean":"2024-09-16T07:36:47.792529+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:47.792529+0000","last_undegraded":"2024-09-16T07:36:47.792529+0000","last_fullsized":"2024-09-16T07:36:47.792529+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:02.432650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775586+0000","last_change":"2024-09-16T07:36:47.775586+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775586+0000","last_undegraded":"2024-09-16T07:36:47.775586+0000","last_fullsized":"2024-09-16T07:36:47.775586+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793848+0000","last_change":"2024-09-16T07:36:47.788288+0000","last_active":"2024-09-16T07:36:47.793848+0000","last_peered":"2024-09-16T07:36:47.793848+0000","last_clean":"2024-09-16T07:36:47.793848+0000","last_became_active":"2024-09-16T07:36:47.788033+0000","last_became_peered":"2024-09-16T07:36:47.788033+0000","last_unstale":"2024-09-16T07:36:47.793848+0000","last_undegraded":"2024-09-16T07:36:47.793848+0000","last_fullsized":"2024-09-16T07:36:47.793848+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:49.041780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776593+0000","last_change":"2024-09-16T07:36:47.776593+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776593+0000","last_undegraded":"2024-09-16T07:36:47.776593+0000","last_fullsized":"2024-09-16T07:36:47.776593+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790145+0000","last_change":"2024-09-16T07:36:47.788687+0000","last_active":"2024-09-16T07:36:47.790145+0000","last_peered":"2024-09-16T07:36:47.790145+0000","last_clean":"2024-09-16T07:36:47.790145+0000","last_became_active":"2024-09-16T07:36:47.788264+0000","last_became_peered":"2024-09-16T07:36:47.788264+0000","last_unstale":"2024-09-16T07:36:47.790145+0000","last_undegraded":"2024-09-16T07:36:47.790145+0000","last_fullsized":"2024-09-16T07:36:47.790145+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:35.994602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.770368+0000","last_change":"2024-09-16T07:36:47.770368+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.770368+0000","last_undegraded":"2024-09-16T07:36:47.770368+0000","last_fullsized":"2024-09-16T07:36:47.770368+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790277+0000","last_change":"2024-09-16T07:36:47.788394+0000","last_active":"2024-09-16T07:36:47.790277+0000","last_peered":"2024-09-16T07:36:47.790277+0000","last_clean":"2024-09-16T07:36:47.790277+0000","last_became_active":"2024-09-16T07:36:47.788042+0000","last_became_peered":"2024-09-16T07:36:47.788042+0000","last_unstale":"2024-09-16T07:36:47.790277+0000","last_undegraded":"2024-09-16T07:36:47.790277+0000","last_fullsized":"2024-09-16T07:36:47.790277+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:21.155725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767276+0000","last_change":"2024-09-16T07:36:47.767276+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767276+0000","last_undegraded":"2024-09-16T07:36:47.767276+0000","last_fullsized":"2024-09-16T07:36:47.767276+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798895+0000","last_change":"2024-09-16T07:36:47.795994+0000","last_active":"2024-09-16T07:36:47.798895+0000","last_peered":"2024-09-16T07:36:47.798895+0000","last_clean":"2024-09-16T07:36:47.798895+0000","last_became_active":"2024-09-16T07:36:47.795685+0000","last_became_peered":"2024-09-16T07:36:47.795685+0000","last_unstale":"2024-09-16T07:36:47.798895+0000","last_undegraded":"2024-09-16T07:36:47.798895+0000","last_fullsized":"2024-09-16T07:36:47.798895+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:09.797850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775269+0000","last_change":"2024-09-16T07:36:47.775269+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775269+0000","last_undegraded":"2024-09-16T07:36:47.775269+0000","last_fullsized":"2024-09-16T07:36:47.775269+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.791780+0000","last_change":"2024-09-16T07:36:47.786354+0000","last_active":"2024-09-16T07:36:47.791780+0000","last_peered":"2024-09-16T07:36:47.791780+0000","last_clean":"2024-09-16T07:36:47.791780+0000","last_became_active":"2024-09-16T07:36:47.786079+0000","last_became_peered":"2024-09-16T07:36:47.786079+0000","last_unstale":"2024-09-16T07:36:47.791780+0000","last_undegraded":"2024-09-16T07:36:47.791780+0000","last_fullsized":"2024-09-16T07:36:47.791780+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:51.563187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781810+0000","last_change":"2024-09-16T07:36:47.781810+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781810+0000","last_undegraded":"2024-09-16T07:36:47.781810+0000","last_fullsized":"2024-09-16T07:36:47.781810+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790547+0000","last_change":"2024-09-16T07:36:47.787281+0000","last_active":"2024-09-16T07:36:47.790547+0000","last_peered":"2024-09-16T07:36:47.790547+0000","last_clean":"2024-09-16T07:36:47.790547+0000","last_became_active":"2024-09-16T07:36:47.786935+0000","last_became_peered":"2024-09-16T07:36:47.786935+0000","last_unstale":"2024-09-16T07:36:47.790547+0000","last_undegraded":"2024-09-16T07:36:47.790547+0000","last_fullsized":"2024-09-16T07:36:47.790547+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:26.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771033+0000","last_change":"2024-09-16T07:36:47.771033+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771033+0000","last_undegraded":"2024-09-16T07:36:47.771033+0000","last_fullsized":"2024-09-16T07:36:47.771033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798781+0000","last_change":"2024-09-16T07:36:47.793515+0000","last_active":"2024-09-16T07:36:47.798781+0000","last_peered":"2024-09-16T07:36:47.798781+0000","last_clean":"2024-09-16T07:36:47.798781+0000","last_became_active":"2024-09-16T07:36:47.793043+0000","last_became_peered":"2024-09-16T07:36:47.793043+0000","last_unstale":"2024-09-16T07:36:47.798781+0000","last_undegraded":"2024-09-16T07:36:47.798781+0000","last_fullsized":"2024-09-16T07:36:47.798781+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:25.075197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.768639+0000","last_change":"2024-09-16T07:36:47.768639+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.768639+0000","last_undegraded":"2024-09-16T07:36:47.768639+0000","last_fullsized":"2024-09-16T07:36:47.768639+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.787318+0000","last_change":"2024-09-16T07:36:47.785322+0000","last_active":"2024-09-16T07:36:47.787318+0000","last_peered":"2024-09-16T07:36:47.787318+0000","last_clean":"2024-09-16T07:36:47.787318+0000","last_became_active":"2024-09-16T07:36:47.785024+0000","last_became_peered":"2024-09-16T07:36:47.785024+0000","last_unstale":"2024-09-16T07:36:47.787318+0000","last_undegraded":"2024-09-16T07:36:47.787318+0000","last_fullsized":"2024-09-16T07:36:47.787318+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:55.588973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780708+0000","last_change":"2024-09-16T07:36:47.780708+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780708+0000","last_undegraded":"2024-09-16T07:36:47.780708+0000","last_fullsized":"2024-09-16T07:36:47.780708+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.797511+0000","last_change":"2024-09-16T07:36:47.795318+0000","last_active":"2024-09-16T07:36:47.797511+0000","last_peered":"2024-09-16T07:36:47.797511+0000","last_clean":"2024-09-16T07:36:47.797511+0000","last_became_active":"2024-09-16T07:36:47.795051+0000","last_became_peered":"2024-09-16T07:36:47.795051+0000","last_unstale":"2024-09-16T07:36:47.797511+0000","last_undegraded":"2024-09-16T07:36:47.797511+0000","last_fullsized":"2024-09-16T07:36:47.797511+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:44:00.172819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774222+0000","last_change":"2024-09-16T07:36:47.774222+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774222+0000","last_undegraded":"2024-09-16T07:36:47.774222+0000","last_fullsized":"2024-09-16T07:36:47.774222+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798867+0000","last_change":"2024-09-16T07:36:47.795227+0000","last_active":"2024-09-16T07:36:47.798867+0000","last_peered":"2024-09-16T07:36:47.798867+0000","last_clean":"2024-09-16T07:36:47.798867+0000","last_became_active":"2024-09-16T07:36:47.794955+0000","last_became_peered":"2024-09-16T07:36:47.794955+0000","last_unstale":"2024-09-16T07:36:47.798867+0000","last_undegraded":"2024-09-16T07:36:47.798867+0000","last_fullsized":"2024-09-16T07:36:47.798867+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:37.062662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776542+0000","last_change":"2024-09-16T07:36:47.776542+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776542+0000","last_undegraded":"2024-09-16T07:36:47.776542+0000","last_fullsized":"2024-09-16T07:36:47.776542+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788039+0000","last_change":"2024-09-16T07:36:47.781443+0000","last_active":"2024-09-16T07:36:47.788039+0000","last_peered":"2024-09-16T07:36:47.788039+0000","last_clean":"2024-09-16T07:36:47.788039+0000","last_became_active":"2024-09-16T07:36:47.781151+0000","last_became_peered":"2024-09-16T07:36:47.781151+0000","last_unstale":"2024-09-16T07:36:47.788039+0000","last_undegraded":"2024-09-16T07:36:47.788039+0000","last_fullsized":"2024-09-16T07:36:47.788039+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:24:05.734638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.770847+0000","last_change":"2024-09-16T07:36:47.770847+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.770847+0000","last_undegraded":"2024-09-16T07:36:47.770847+0000","last_fullsized":"2024-09-16T07:36:47.770847+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.786325+0000","last_change":"2024-09-16T07:36:47.782624+0000","last_active":"2024-09-16T07:36:47.786325+0000","last_peered":"2024-09-16T07:36:47.786325+0000","last_clean":"2024-09-16T07:36:47.786325+0000","last_became_active":"2024-09-16T07:36:47.782288+0000","last_became_peered":"2024-09-16T07:36:47.782288+0000","last_unstale":"2024-09-16T07:36:47.786325+0000","last_undegraded":"2024-09-16T07:36:47.786325+0000","last_fullsized":"2024-09-16T07:36:47.786325+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:27:24.850313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781165+0000","last_change":"2024-09-16T07:36:47.781165+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781165+0000","last_undegraded":"2024-09-16T07:36:47.781165+0000","last_fullsized":"2024-09-16T07:36:47.781165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793036+0000","last_change":"2024-09-16T07:36:47.789860+0000","last_active":"2024-09-16T07:36:47.793036+0000","last_peered":"2024-09-16T07:36:47.793036+0000","last_clean":"2024-09-16T07:36:47.793036+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:47.793036+0000","last_undegraded":"2024-09-16T07:36:47.793036+0000","last_fullsized":"2024-09-16T07:36:47.793036+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:51:14.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":399,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.779852+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:36:47.779852+0000","last_peered":"2024-09-16T07:36:47.779852+0000","last_clean":"2024-09-16T07:36:47.779852+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:36:47.779852+0000","last_undegraded":"2024-09-16T07:36:47.779852+0000","last_fullsized":"2024-09-16T07:36:47.779852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33772,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338068,"statfs":{"total":96636764160,"available":96602181632,"internally_reserved":0,"allocated":2646016,"data_stored":1492695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542251,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33764,"kb_used_data":2572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338076,"statfs":{"total":96636764160,"available":96602189824,"internally_reserved":0,"allocated":2633728,"data_stored":1486392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:36:52.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:36:53.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 -- 172.21.15.114:0/1387233593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f940b2e80 msgr2=0x7f0f940b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/1387233593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f940b2e80 0x7f0f940b1a00 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f0f94074c80 tx=0x7f0f8001c770 comp rx=0 tx=0).stop 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 -- 172.21.15.114:0/1387233593 shutdown_connections 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/1387233593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f940b2e80 0x7f0f940b1a00 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/1387233593 >> v2:172.21.15.149:3300/0 conn(0x7f0f940b1f40 0x7f0f940cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/1387233593 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f9415f490 0x7f0f940b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 -- 172.21.15.114:0/1387233593 >> 172.21.15.114:0/1387233593 conn(0x7f0f940d1e30 msgr2=0x7f0f940d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 -- 172.21.15.114:0/1387233593 shutdown_connections 2024-09-16T07:36:53.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 -- 172.21.15.114:0/1387233593 wait complete. 2024-09-16T07:36:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 Processor -- start 2024-09-16T07:36:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.104+0000 7f0f9ae00640 1 -- start start 2024-09-16T07:36:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f940b1f40 0x7f0f9414f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f940b2e80 0x7f0f94158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f9415f490 0x7f0f941589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940b00b0 con 0x7f0f9415f490 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940aff30 con 0x7f0f940b1f40 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0f940b0230 con 0x7f0f940b2e80 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f9415f490 0x7f0f941589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f9415f490 0x7f0f941589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42812/0 (socket says 172.21.15.114:42812) 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 -- 172.21.15.114:0/3194012449 learned_addr learned my addr 172.21.15.114:0/3194012449 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f93400640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f940b2e80 0x7f0f94158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f93e00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f940b1f40 0x7f0f9414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 -- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f940b2e80 msgr2=0x7f0f94158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f940b2e80 0x7f0f94158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 -- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f940b1f40 msgr2=0x7f0f9414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f940b1f40 0x7f0f9414f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 -- 172.21.15.114:0/3194012449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f940cb280 con 0x7f0f9415f490 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f93400640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f940b2e80 0x7f0f94158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f93e00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f940b1f40 0x7f0f9414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f98e00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f9415f490 0x7f0f941589a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b430 tx=0x7f0f8c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f8be00640 1 -- 172.21.15.114:0/3194012449 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c015020 con 0x7f0f9415f490 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f8be00640 1 -- 172.21.15.114:0/3194012449 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f8c011920 con 0x7f0f9415f490 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f941fb1b0 con 0x7f0f9415f490 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f8be00640 1 -- 172.21.15.114:0/3194012449 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c011d70 con 0x7f0f9415f490 2024-09-16T07:36:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f941fb770 con 0x7f0f9415f490 2024-09-16T07:36:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f940cfda0 con 0x7f0f9415f490 2024-09-16T07:36:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.108+0000 7f0f8be00640 1 -- 172.21.15.114:0/3194012449 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f0f8c018020 con 0x7f0f9415f490 2024-09-16T07:36:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.112+0000 7f0f8be00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f740738e0 0x7f0f74075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.112+0000 7f0f8be00640 1 -- 172.21.15.114:0/3194012449 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f0f8c0928c0 con 0x7f0f9415f490 2024-09-16T07:36:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.112+0000 7f0f93e00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f740738e0 0x7f0f74075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.112+0000 7f0f93e00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f740738e0 0x7f0f74075da0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007eb0 tx=0x7f0f840073c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:53.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.116+0000 7f0f8be00640 1 -- 172.21.15.114:0/3194012449 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0f8c01f020 con 0x7f0f9415f490 2024-09-16T07:36:53.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.284+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f940c90b0 con 0x7f0f740738e0 2024-09-16T07:36:53.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.288+0000 7f0f8be00640 1 -- 172.21.15.114:0/3194012449 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247115 (secure 0 0 0) 0x7f0f940c90b0 con 0x7f0f740738e0 2024-09-16T07:36:53.288 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:53.289 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:36:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.288+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f740738e0 msgr2=0x7f0f74075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f740738e0 0x7f0f74075da0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007eb0 tx=0x7f0f840073c0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f9415f490 msgr2=0x7f0f941589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f9415f490 0x7f0f941589a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b430 tx=0x7f0f8c00b8f0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 shutdown_connections 2024-09-16T07:36:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f9415f490 0x7f0f941589a0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0f740738e0 0x7f0f74075da0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0f940b2e80 0x7f0f94158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 --2- 172.21.15.114:0/3194012449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0f940b1f40 0x7f0f9414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 >> 172.21.15.114:0/3194012449 conn(0x7f0f940d1e30 msgr2=0x7f0f9415e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:53.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 shutdown_connections 2024-09-16T07:36:53.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.292+0000 7f0f9ae00640 1 -- 172.21.15.114:0/3194012449 wait complete. 2024-09-16T07:36:53.308 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-16T07:36:52.427063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266688,"kb_used_data":17144,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708032,"statfs":{"total":773094113280,"available":772821024768,"internally_reserved":0,"allocated":17555456,"data_stored":8374140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.665173"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782760+0000","last_change":"2024-09-16T07:36:47.782760+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782760+0000","last_undegraded":"2024-09-16T07:36:47.782760+0000","last_fullsized":"2024-09-16T07:36:47.782760+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772397+0000","last_change":"2024-09-16T07:36:47.772397+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772397+0000","last_undegraded":"2024-09-16T07:36:47.772397+0000","last_fullsized":"2024-09-16T07:36:47.772397+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780219+0000","last_change":"2024-09-16T07:36:47.780219+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780219+0000","last_undegraded":"2024-09-16T07:36:47.780219+0000","last_fullsized":"2024-09-16T07:36:47.780219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777443+0000","last_change":"2024-09-16T07:36:47.777443+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777443+0000","last_undegraded":"2024-09-16T07:36:47.777443+0000","last_fullsized":"2024-09-16T07:36:47.777443+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778403+0000","last_change":"2024-09-16T07:36:47.778403+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778403+0000","last_undegraded":"2024-09-16T07:36:47.778403+0000","last_fullsized":"2024-09-16T07:36:47.778403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779044+0000","last_change":"2024-09-16T07:36:47.779044+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779044+0000","last_undegraded":"2024-09-16T07:36:47.779044+0000","last_fullsized":"2024-09-16T07:36:47.779044+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780859+0000","last_change":"2024-09-16T07:36:47.780859+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780859+0000","last_undegraded":"2024-09-16T07:36:47.780859+0000","last_fullsized":"2024-09-16T07:36:47.780859+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779353+0000","last_change":"2024-09-16T07:36:47.779353+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779353+0000","last_undegraded":"2024-09-16T07:36:47.779353+0000","last_fullsized":"2024-09-16T07:36:47.779353+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771826+0000","last_change":"2024-09-16T07:36:47.771826+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771826+0000","last_undegraded":"2024-09-16T07:36:47.771826+0000","last_fullsized":"2024-09-16T07:36:47.771826+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778464+0000","last_change":"2024-09-16T07:36:47.778464+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778464+0000","last_undegraded":"2024-09-16T07:36:47.778464+0000","last_fullsized":"2024-09-16T07:36:47.778464+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779800+0000","last_change":"2024-09-16T07:36:47.779800+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779800+0000","last_undegraded":"2024-09-16T07:36:47.779800+0000","last_fullsized":"2024-09-16T07:36:47.779800+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774173+0000","last_change":"2024-09-16T07:36:47.774173+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774173+0000","last_undegraded":"2024-09-16T07:36:47.774173+0000","last_fullsized":"2024-09-16T07:36:47.774173+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.773774+0000","last_change":"2024-09-16T07:36:47.773774+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.773774+0000","last_undegraded":"2024-09-16T07:36:47.773774+0000","last_fullsized":"2024-09-16T07:36:47.773774+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781665+0000","last_change":"2024-09-16T07:36:47.781665+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781665+0000","last_undegraded":"2024-09-16T07:36:47.781665+0000","last_fullsized":"2024-09-16T07:36:47.781665+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780405+0000","last_change":"2024-09-16T07:36:47.780405+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780405+0000","last_undegraded":"2024-09-16T07:36:47.780405+0000","last_fullsized":"2024-09-16T07:36:47.780405+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777186+0000","last_change":"2024-09-16T07:36:47.777186+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777186+0000","last_undegraded":"2024-09-16T07:36:47.777186+0000","last_fullsized":"2024-09-16T07:36:47.777186+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782229+0000","last_change":"2024-09-16T07:36:47.782229+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782229+0000","last_undegraded":"2024-09-16T07:36:47.782229+0000","last_fullsized":"2024-09-16T07:36:47.782229+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777381+0000","last_change":"2024-09-16T07:36:47.777381+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777381+0000","last_undegraded":"2024-09-16T07:36:47.777381+0000","last_fullsized":"2024-09-16T07:36:47.777381+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776274+0000","last_change":"2024-09-16T07:36:47.776274+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776274+0000","last_undegraded":"2024-09-16T07:36:47.776274+0000","last_fullsized":"2024-09-16T07:36:47.776274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780718+0000","last_change":"2024-09-16T07:36:47.780718+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780718+0000","last_undegraded":"2024-09-16T07:36:47.780718+0000","last_fullsized":"2024-09-16T07:36:47.780718+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777117+0000","last_change":"2024-09-16T07:36:47.777117+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777117+0000","last_undegraded":"2024-09-16T07:36:47.777117+0000","last_fullsized":"2024-09-16T07:36:47.777117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767727+0000","last_change":"2024-09-16T07:36:47.767727+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767727+0000","last_undegraded":"2024-09-16T07:36:47.767727+0000","last_fullsized":"2024-09-16T07:36:47.767727+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767742+0000","last_change":"2024-09-16T07:36:47.767742+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767742+0000","last_undegraded":"2024-09-16T07:36:47.767742+0000","last_fullsized":"2024-09-16T07:36:47.767742+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777086+0000","last_change":"2024-09-16T07:36:47.777086+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777086+0000","last_undegraded":"2024-09-16T07:36:47.777086+0000","last_fullsized":"2024-09-16T07:36:47.777086+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772860+0000","last_change":"2024-09-16T07:36:47.772860+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772860+0000","last_undegraded":"2024-09-16T07:36:47.772860+0000","last_fullsized":"2024-09-16T07:36:47.772860+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782198+0000","last_change":"2024-09-16T07:36:47.782198+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782198+0000","last_undegraded":"2024-09-16T07:36:47.782198+0000","last_fullsized":"2024-09-16T07:36:47.782198+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772397+0000","last_change":"2024-09-16T07:36:47.772397+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772397+0000","last_undegraded":"2024-09-16T07:36:47.772397+0000","last_fullsized":"2024-09-16T07:36:47.772397+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778104+0000","last_change":"2024-09-16T07:36:47.778104+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778104+0000","last_undegraded":"2024-09-16T07:36:47.778104+0000","last_fullsized":"2024-09-16T07:36:47.778104+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774654+0000","last_change":"2024-09-16T07:36:47.774654+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774654+0000","last_undegraded":"2024-09-16T07:36:47.774654+0000","last_fullsized":"2024-09-16T07:36:47.774654+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.769663+0000","last_change":"2024-09-16T07:36:47.769663+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.769663+0000","last_undegraded":"2024-09-16T07:36:47.769663+0000","last_fullsized":"2024-09-16T07:36:47.769663+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776786+0000","last_change":"2024-09-16T07:36:47.776786+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776786+0000","last_undegraded":"2024-09-16T07:36:47.776786+0000","last_fullsized":"2024-09-16T07:36:47.776786+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779997+0000","last_change":"2024-09-16T07:36:47.779997+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779997+0000","last_undegraded":"2024-09-16T07:36:47.779997+0000","last_fullsized":"2024-09-16T07:36:47.779997+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771925+0000","last_change":"2024-09-16T07:36:47.771925+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771925+0000","last_undegraded":"2024-09-16T07:36:47.771925+0000","last_fullsized":"2024-09-16T07:36:47.771925+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788098+0000","last_change":"2024-09-16T07:36:47.783864+0000","last_active":"2024-09-16T07:36:47.788098+0000","last_peered":"2024-09-16T07:36:47.788098+0000","last_clean":"2024-09-16T07:36:47.788098+0000","last_became_active":"2024-09-16T07:36:47.783569+0000","last_became_peered":"2024-09-16T07:36:47.783569+0000","last_unstale":"2024-09-16T07:36:47.788098+0000","last_undegraded":"2024-09-16T07:36:47.788098+0000","last_fullsized":"2024-09-16T07:36:47.788098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:55.891100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.768905+0000","last_change":"2024-09-16T07:36:47.768905+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.768905+0000","last_undegraded":"2024-09-16T07:36:47.768905+0000","last_fullsized":"2024-09-16T07:36:47.768905+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788551+0000","last_change":"2024-09-16T07:36:47.785063+0000","last_active":"2024-09-16T07:36:47.788551+0000","last_peered":"2024-09-16T07:36:47.788551+0000","last_clean":"2024-09-16T07:36:47.788551+0000","last_became_active":"2024-09-16T07:36:47.784686+0000","last_became_peered":"2024-09-16T07:36:47.784686+0000","last_unstale":"2024-09-16T07:36:47.788551+0000","last_undegraded":"2024-09-16T07:36:47.788551+0000","last_fullsized":"2024-09-16T07:36:47.788551+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:26.504556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781273+0000","last_change":"2024-09-16T07:36:47.781273+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781273+0000","last_undegraded":"2024-09-16T07:36:47.781273+0000","last_fullsized":"2024-09-16T07:36:47.781273+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792471+0000","last_change":"2024-09-16T07:36:47.789633+0000","last_active":"2024-09-16T07:36:47.792471+0000","last_peered":"2024-09-16T07:36:47.792471+0000","last_clean":"2024-09-16T07:36:47.792471+0000","last_became_active":"2024-09-16T07:36:47.789328+0000","last_became_peered":"2024-09-16T07:36:47.789328+0000","last_unstale":"2024-09-16T07:36:47.792471+0000","last_undegraded":"2024-09-16T07:36:47.792471+0000","last_fullsized":"2024-09-16T07:36:47.792471+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:16.180075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775800+0000","last_change":"2024-09-16T07:36:47.775800+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775800+0000","last_undegraded":"2024-09-16T07:36:47.775800+0000","last_fullsized":"2024-09-16T07:36:47.775800+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795019+0000","last_change":"2024-09-16T07:36:47.794481+0000","last_active":"2024-09-16T07:36:47.795019+0000","last_peered":"2024-09-16T07:36:47.795019+0000","last_clean":"2024-09-16T07:36:47.795019+0000","last_became_active":"2024-09-16T07:36:47.794271+0000","last_became_peered":"2024-09-16T07:36:47.794271+0000","last_unstale":"2024-09-16T07:36:47.795019+0000","last_undegraded":"2024-09-16T07:36:47.795019+0000","last_fullsized":"2024-09-16T07:36:47.795019+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:53.238074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776623+0000","last_change":"2024-09-16T07:36:47.776623+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776623+0000","last_undegraded":"2024-09-16T07:36:47.776623+0000","last_fullsized":"2024-09-16T07:36:47.776623+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795217+0000","last_change":"2024-09-16T07:36:47.786771+0000","last_active":"2024-09-16T07:36:47.795217+0000","last_peered":"2024-09-16T07:36:47.795217+0000","last_clean":"2024-09-16T07:36:47.795217+0000","last_became_active":"2024-09-16T07:36:47.786344+0000","last_became_peered":"2024-09-16T07:36:47.786344+0000","last_unstale":"2024-09-16T07:36:47.795217+0000","last_undegraded":"2024-09-16T07:36:47.795217+0000","last_fullsized":"2024-09-16T07:36:47.795217+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:27:24.850313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778923+0000","last_change":"2024-09-16T07:36:47.778923+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778923+0000","last_undegraded":"2024-09-16T07:36:47.778923+0000","last_fullsized":"2024-09-16T07:36:47.778923+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798172+0000","last_change":"2024-09-16T07:36:47.792142+0000","last_active":"2024-09-16T07:36:47.798172+0000","last_peered":"2024-09-16T07:36:47.798172+0000","last_clean":"2024-09-16T07:36:47.798172+0000","last_became_active":"2024-09-16T07:36:47.791887+0000","last_became_peered":"2024-09-16T07:36:47.791887+0000","last_unstale":"2024-09-16T07:36:47.798172+0000","last_undegraded":"2024-09-16T07:36:47.798172+0000","last_fullsized":"2024-09-16T07:36:47.798172+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:51:14.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776627+0000","last_change":"2024-09-16T07:36:47.776627+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776627+0000","last_undegraded":"2024-09-16T07:36:47.776627+0000","last_fullsized":"2024-09-16T07:36:47.776627+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.780146+0000","last_change":"2024-09-16T07:36:47.775955+0000","last_active":"2024-09-16T07:36:47.780146+0000","last_peered":"2024-09-16T07:36:47.780146+0000","last_clean":"2024-09-16T07:36:47.780146+0000","last_became_active":"2024-09-16T07:36:47.774675+0000","last_became_peered":"2024-09-16T07:36:47.774675+0000","last_unstale":"2024-09-16T07:36:47.780146+0000","last_undegraded":"2024-09-16T07:36:47.780146+0000","last_fullsized":"2024-09-16T07:36:47.780146+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:55.771795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777937+0000","last_change":"2024-09-16T07:36:47.777937+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777937+0000","last_undegraded":"2024-09-16T07:36:47.777937+0000","last_fullsized":"2024-09-16T07:36:47.777937+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798082+0000","last_change":"2024-09-16T07:36:47.790849+0000","last_active":"2024-09-16T07:36:47.798082+0000","last_peered":"2024-09-16T07:36:47.798082+0000","last_clean":"2024-09-16T07:36:47.798082+0000","last_became_active":"2024-09-16T07:36:47.790581+0000","last_became_peered":"2024-09-16T07:36:47.790581+0000","last_unstale":"2024-09-16T07:36:47.798082+0000","last_undegraded":"2024-09-16T07:36:47.798082+0000","last_fullsized":"2024-09-16T07:36:47.798082+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:55.891100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777144+0000","last_change":"2024-09-16T07:36:47.777144+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777144+0000","last_undegraded":"2024-09-16T07:36:47.777144+0000","last_fullsized":"2024-09-16T07:36:47.777144+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.780220+0000","last_change":"2024-09-16T07:36:47.776292+0000","last_active":"2024-09-16T07:36:47.780220+0000","last_peered":"2024-09-16T07:36:47.780220+0000","last_clean":"2024-09-16T07:36:47.780220+0000","last_became_active":"2024-09-16T07:36:47.775815+0000","last_became_peered":"2024-09-16T07:36:47.775815+0000","last_unstale":"2024-09-16T07:36:47.780220+0000","last_undegraded":"2024-09-16T07:36:47.780220+0000","last_fullsized":"2024-09-16T07:36:47.780220+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:46.845007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776865+0000","last_change":"2024-09-16T07:36:47.776865+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776865+0000","last_undegraded":"2024-09-16T07:36:47.776865+0000","last_fullsized":"2024-09-16T07:36:47.776865+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798028+0000","last_change":"2024-09-16T07:36:47.794548+0000","last_active":"2024-09-16T07:36:47.798028+0000","last_peered":"2024-09-16T07:36:47.798028+0000","last_clean":"2024-09-16T07:36:47.798028+0000","last_became_active":"2024-09-16T07:36:47.793042+0000","last_became_peered":"2024-09-16T07:36:47.793042+0000","last_unstale":"2024-09-16T07:36:47.798028+0000","last_undegraded":"2024-09-16T07:36:47.798028+0000","last_fullsized":"2024-09-16T07:36:47.798028+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:26.858727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781244+0000","last_change":"2024-09-16T07:36:47.781244+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781244+0000","last_undegraded":"2024-09-16T07:36:47.781244+0000","last_fullsized":"2024-09-16T07:36:47.781244+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793168+0000","last_change":"2024-09-16T07:36:47.789226+0000","last_active":"2024-09-16T07:36:47.793168+0000","last_peered":"2024-09-16T07:36:47.793168+0000","last_clean":"2024-09-16T07:36:47.793168+0000","last_became_active":"2024-09-16T07:36:47.788766+0000","last_became_peered":"2024-09-16T07:36:47.788766+0000","last_unstale":"2024-09-16T07:36:47.793168+0000","last_undegraded":"2024-09-16T07:36:47.793168+0000","last_fullsized":"2024-09-16T07:36:47.793168+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:59:31.170029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778537+0000","last_change":"2024-09-16T07:36:47.778537+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778537+0000","last_undegraded":"2024-09-16T07:36:47.778537+0000","last_fullsized":"2024-09-16T07:36:47.778537+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.787867+0000","last_change":"2024-09-16T07:36:47.781350+0000","last_active":"2024-09-16T07:36:47.787867+0000","last_peered":"2024-09-16T07:36:47.787867+0000","last_clean":"2024-09-16T07:36:47.787867+0000","last_became_active":"2024-09-16T07:36:47.781033+0000","last_became_peered":"2024-09-16T07:36:47.781033+0000","last_unstale":"2024-09-16T07:36:47.787867+0000","last_undegraded":"2024-09-16T07:36:47.787867+0000","last_fullsized":"2024-09-16T07:36:47.787867+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:17.517901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775989+0000","last_change":"2024-09-16T07:36:47.775989+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775989+0000","last_undegraded":"2024-09-16T07:36:47.775989+0000","last_fullsized":"2024-09-16T07:36:47.775989+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.785549+0000","last_change":"2024-09-16T07:36:47.781137+0000","last_active":"2024-09-16T07:36:47.785549+0000","last_peered":"2024-09-16T07:36:47.785549+0000","last_clean":"2024-09-16T07:36:47.785549+0000","last_became_active":"2024-09-16T07:36:47.780684+0000","last_became_peered":"2024-09-16T07:36:47.780684+0000","last_unstale":"2024-09-16T07:36:47.785549+0000","last_undegraded":"2024-09-16T07:36:47.785549+0000","last_fullsized":"2024-09-16T07:36:47.785549+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:50:42.775969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777085+0000","last_change":"2024-09-16T07:36:47.777085+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777085+0000","last_undegraded":"2024-09-16T07:36:47.777085+0000","last_fullsized":"2024-09-16T07:36:47.777085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793098+0000","last_change":"2024-09-16T07:36:47.786759+0000","last_active":"2024-09-16T07:36:47.793098+0000","last_peered":"2024-09-16T07:36:47.793098+0000","last_clean":"2024-09-16T07:36:47.793098+0000","last_became_active":"2024-09-16T07:36:47.786477+0000","last_became_peered":"2024-09-16T07:36:47.786477+0000","last_unstale":"2024-09-16T07:36:47.793098+0000","last_undegraded":"2024-09-16T07:36:47.793098+0000","last_fullsized":"2024-09-16T07:36:47.793098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:18.476045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779948+0000","last_change":"2024-09-16T07:36:47.779948+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779948+0000","last_undegraded":"2024-09-16T07:36:47.779948+0000","last_fullsized":"2024-09-16T07:36:47.779948+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792272+0000","last_change":"2024-09-16T07:36:47.788463+0000","last_active":"2024-09-16T07:36:47.792272+0000","last_peered":"2024-09-16T07:36:47.792272+0000","last_clean":"2024-09-16T07:36:47.792272+0000","last_became_active":"2024-09-16T07:36:47.788206+0000","last_became_peered":"2024-09-16T07:36:47.788206+0000","last_unstale":"2024-09-16T07:36:47.792272+0000","last_undegraded":"2024-09-16T07:36:47.792272+0000","last_fullsized":"2024-09-16T07:36:47.792272+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:37.773632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771461+0000","last_change":"2024-09-16T07:36:47.771461+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771461+0000","last_undegraded":"2024-09-16T07:36:47.771461+0000","last_fullsized":"2024-09-16T07:36:47.771461+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.801979+0000","last_change":"2024-09-16T07:36:47.799092+0000","last_active":"2024-09-16T07:36:47.801979+0000","last_peered":"2024-09-16T07:36:47.801979+0000","last_clean":"2024-09-16T07:36:47.801979+0000","last_became_active":"2024-09-16T07:36:47.798679+0000","last_became_peered":"2024-09-16T07:36:47.798679+0000","last_unstale":"2024-09-16T07:36:47.801979+0000","last_undegraded":"2024-09-16T07:36:47.801979+0000","last_fullsized":"2024-09-16T07:36:47.801979+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:43.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772417+0000","last_change":"2024-09-16T07:36:47.772417+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772417+0000","last_undegraded":"2024-09-16T07:36:47.772417+0000","last_fullsized":"2024-09-16T07:36:47.772417+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.786115+0000","last_change":"2024-09-16T07:36:47.781253+0000","last_active":"2024-09-16T07:36:47.786115+0000","last_peered":"2024-09-16T07:36:47.786115+0000","last_clean":"2024-09-16T07:36:47.786115+0000","last_became_active":"2024-09-16T07:36:47.780968+0000","last_became_peered":"2024-09-16T07:36:47.780968+0000","last_unstale":"2024-09-16T07:36:47.786115+0000","last_undegraded":"2024-09-16T07:36:47.786115+0000","last_fullsized":"2024-09-16T07:36:47.786115+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:13.117629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777566+0000","last_change":"2024-09-16T07:36:47.777566+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777566+0000","last_undegraded":"2024-09-16T07:36:47.777566+0000","last_fullsized":"2024-09-16T07:36:47.777566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795398+0000","last_change":"2024-09-16T07:36:47.792016+0000","last_active":"2024-09-16T07:36:47.795398+0000","last_peered":"2024-09-16T07:36:47.795398+0000","last_clean":"2024-09-16T07:36:47.795398+0000","last_became_active":"2024-09-16T07:36:47.791765+0000","last_became_peered":"2024-09-16T07:36:47.791765+0000","last_unstale":"2024-09-16T07:36:47.795398+0000","last_undegraded":"2024-09-16T07:36:47.795398+0000","last_fullsized":"2024-09-16T07:36:47.795398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:43.222917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775124+0000","last_change":"2024-09-16T07:36:47.775124+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775124+0000","last_undegraded":"2024-09-16T07:36:47.775124+0000","last_fullsized":"2024-09-16T07:36:47.775124+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792529+0000","last_change":"2024-09-16T07:36:47.789887+0000","last_active":"2024-09-16T07:36:47.792529+0000","last_peered":"2024-09-16T07:36:47.792529+0000","last_clean":"2024-09-16T07:36:47.792529+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:47.792529+0000","last_undegraded":"2024-09-16T07:36:47.792529+0000","last_fullsized":"2024-09-16T07:36:47.792529+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:02.432650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775586+0000","last_change":"2024-09-16T07:36:47.775586+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775586+0000","last_undegraded":"2024-09-16T07:36:47.775586+0000","last_fullsized":"2024-09-16T07:36:47.775586+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793848+0000","last_change":"2024-09-16T07:36:47.788288+0000","last_active":"2024-09-16T07:36:47.793848+0000","last_peered":"2024-09-16T07:36:47.793848+0000","last_clean":"2024-09-16T07:36:47.793848+0000","last_became_active":"2024-09-16T07:36:47.788033+0000","last_became_peered":"2024-09-16T07:36:47.788033+0000","last_unstale":"2024-09-16T07:36:47.793848+0000","last_undegraded":"2024-09-16T07:36:47.793848+0000","last_fullsized":"2024-09-16T07:36:47.793848+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:49.041780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776593+0000","last_change":"2024-09-16T07:36:47.776593+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776593+0000","last_undegraded":"2024-09-16T07:36:47.776593+0000","last_fullsized":"2024-09-16T07:36:47.776593+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790145+0000","last_change":"2024-09-16T07:36:47.788687+0000","last_active":"2024-09-16T07:36:47.790145+0000","last_peered":"2024-09-16T07:36:47.790145+0000","last_clean":"2024-09-16T07:36:47.790145+0000","last_became_active":"2024-09-16T07:36:47.788264+0000","last_became_peered":"2024-09-16T07:36:47.788264+0000","last_unstale":"2024-09-16T07:36:47.790145+0000","last_undegraded":"2024-09-16T07:36:47.790145+0000","last_fullsized":"2024-09-16T07:36:47.790145+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:35.994602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.770368+0000","last_change":"2024-09-16T07:36:47.770368+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.770368+0000","last_undegraded":"2024-09-16T07:36:47.770368+0000","last_fullsized":"2024-09-16T07:36:47.770368+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790277+0000","last_change":"2024-09-16T07:36:47.788394+0000","last_active":"2024-09-16T07:36:47.790277+0000","last_peered":"2024-09-16T07:36:47.790277+0000","last_clean":"2024-09-16T07:36:47.790277+0000","last_became_active":"2024-09-16T07:36:47.788042+0000","last_became_peered":"2024-09-16T07:36:47.788042+0000","last_unstale":"2024-09-16T07:36:47.790277+0000","last_undegraded":"2024-09-16T07:36:47.790277+0000","last_fullsized":"2024-09-16T07:36:47.790277+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:21.155725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767276+0000","last_change":"2024-09-16T07:36:47.767276+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767276+0000","last_undegraded":"2024-09-16T07:36:47.767276+0000","last_fullsized":"2024-09-16T07:36:47.767276+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798895+0000","last_change":"2024-09-16T07:36:47.795994+0000","last_active":"2024-09-16T07:36:47.798895+0000","last_peered":"2024-09-16T07:36:47.798895+0000","last_clean":"2024-09-16T07:36:47.798895+0000","last_became_active":"2024-09-16T07:36:47.795685+0000","last_became_peered":"2024-09-16T07:36:47.795685+0000","last_unstale":"2024-09-16T07:36:47.798895+0000","last_undegraded":"2024-09-16T07:36:47.798895+0000","last_fullsized":"2024-09-16T07:36:47.798895+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:09.797850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775269+0000","last_change":"2024-09-16T07:36:47.775269+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775269+0000","last_undegraded":"2024-09-16T07:36:47.775269+0000","last_fullsized":"2024-09-16T07:36:47.775269+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.791780+0000","last_change":"2024-09-16T07:36:47.786354+0000","last_active":"2024-09-16T07:36:47.791780+0000","last_peered":"2024-09-16T07:36:47.791780+0000","last_clean":"2024-09-16T07:36:47.791780+0000","last_became_active":"2024-09-16T07:36:47.786079+0000","last_became_peered":"2024-09-16T07:36:47.786079+0000","last_unstale":"2024-09-16T07:36:47.791780+0000","last_undegraded":"2024-09-16T07:36:47.791780+0000","last_fullsized":"2024-09-16T07:36:47.791780+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:51.563187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781810+0000","last_change":"2024-09-16T07:36:47.781810+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781810+0000","last_undegraded":"2024-09-16T07:36:47.781810+0000","last_fullsized":"2024-09-16T07:36:47.781810+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790547+0000","last_change":"2024-09-16T07:36:47.787281+0000","last_active":"2024-09-16T07:36:47.790547+0000","last_peered":"2024-09-16T07:36:47.790547+0000","last_clean":"2024-09-16T07:36:47.790547+0000","last_became_active":"2024-09-16T07:36:47.786935+0000","last_became_peered":"2024-09-16T07:36:47.786935+0000","last_unstale":"2024-09-16T07:36:47.790547+0000","last_undegraded":"2024-09-16T07:36:47.790547+0000","last_fullsized":"2024-09-16T07:36:47.790547+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:26.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771033+0000","last_change":"2024-09-16T07:36:47.771033+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771033+0000","last_undegraded":"2024-09-16T07:36:47.771033+0000","last_fullsized":"2024-09-16T07:36:47.771033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798781+0000","last_change":"2024-09-16T07:36:47.793515+0000","last_active":"2024-09-16T07:36:47.798781+0000","last_peered":"2024-09-16T07:36:47.798781+0000","last_clean":"2024-09-16T07:36:47.798781+0000","last_became_active":"2024-09-16T07:36:47.793043+0000","last_became_peered":"2024-09-16T07:36:47.793043+0000","last_unstale":"2024-09-16T07:36:47.798781+0000","last_undegraded":"2024-09-16T07:36:47.798781+0000","last_fullsized":"2024-09-16T07:36:47.798781+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:25.075197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.768639+0000","last_change":"2024-09-16T07:36:47.768639+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.768639+0000","last_undegraded":"2024-09-16T07:36:47.768639+0000","last_fullsized":"2024-09-16T07:36:47.768639+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.787318+0000","last_change":"2024-09-16T07:36:47.785322+0000","last_active":"2024-09-16T07:36:47.787318+0000","last_peered":"2024-09-16T07:36:47.787318+0000","last_clean":"2024-09-16T07:36:47.787318+0000","last_became_active":"2024-09-16T07:36:47.785024+0000","last_became_peered":"2024-09-16T07:36:47.785024+0000","last_unstale":"2024-09-16T07:36:47.787318+0000","last_undegraded":"2024-09-16T07:36:47.787318+0000","last_fullsized":"2024-09-16T07:36:47.787318+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:55.588973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780708+0000","last_change":"2024-09-16T07:36:47.780708+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780708+0000","last_undegraded":"2024-09-16T07:36:47.780708+0000","last_fullsized":"2024-09-16T07:36:47.780708+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.797511+0000","last_change":"2024-09-16T07:36:47.795318+0000","last_active":"2024-09-16T07:36:47.797511+0000","last_peered":"2024-09-16T07:36:47.797511+0000","last_clean":"2024-09-16T07:36:47.797511+0000","last_became_active":"2024-09-16T07:36:47.795051+0000","last_became_peered":"2024-09-16T07:36:47.795051+0000","last_unstale":"2024-09-16T07:36:47.797511+0000","last_undegraded":"2024-09-16T07:36:47.797511+0000","last_fullsized":"2024-09-16T07:36:47.797511+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:44:00.172819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774222+0000","last_change":"2024-09-16T07:36:47.774222+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774222+0000","last_undegraded":"2024-09-16T07:36:47.774222+0000","last_fullsized":"2024-09-16T07:36:47.774222+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798867+0000","last_change":"2024-09-16T07:36:47.795227+0000","last_active":"2024-09-16T07:36:47.798867+0000","last_peered":"2024-09-16T07:36:47.798867+0000","last_clean":"2024-09-16T07:36:47.798867+0000","last_became_active":"2024-09-16T07:36:47.794955+0000","last_became_peered":"2024-09-16T07:36:47.794955+0000","last_unstale":"2024-09-16T07:36:47.798867+0000","last_undegraded":"2024-09-16T07:36:47.798867+0000","last_fullsized":"2024-09-16T07:36:47.798867+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:37.062662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776542+0000","last_change":"2024-09-16T07:36:47.776542+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776542+0000","last_undegraded":"2024-09-16T07:36:47.776542+0000","last_fullsized":"2024-09-16T07:36:47.776542+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788039+0000","last_change":"2024-09-16T07:36:47.781443+0000","last_active":"2024-09-16T07:36:47.788039+0000","last_peered":"2024-09-16T07:36:47.788039+0000","last_clean":"2024-09-16T07:36:47.788039+0000","last_became_active":"2024-09-16T07:36:47.781151+0000","last_became_peered":"2024-09-16T07:36:47.781151+0000","last_unstale":"2024-09-16T07:36:47.788039+0000","last_undegraded":"2024-09-16T07:36:47.788039+0000","last_fullsized":"2024-09-16T07:36:47.788039+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:24:05.734638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.770847+0000","last_change":"2024-09-16T07:36:47.770847+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.770847+0000","last_undegraded":"2024-09-16T07:36:47.770847+0000","last_fullsized":"2024-09-16T07:36:47.770847+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.786325+0000","last_change":"2024-09-16T07:36:47.782624+0000","last_active":"2024-09-16T07:36:47.786325+0000","last_peered":"2024-09-16T07:36:47.786325+0000","last_clean":"2024-09-16T07:36:47.786325+0000","last_became_active":"2024-09-16T07:36:47.782288+0000","last_became_peered":"2024-09-16T07:36:47.782288+0000","last_unstale":"2024-09-16T07:36:47.786325+0000","last_undegraded":"2024-09-16T07:36:47.786325+0000","last_fullsized":"2024-09-16T07:36:47.786325+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:27:24.850313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781165+0000","last_change":"2024-09-16T07:36:47.781165+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781165+0000","last_undegraded":"2024-09-16T07:36:47.781165+0000","last_fullsized":"2024-09-16T07:36:47.781165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793036+0000","last_change":"2024-09-16T07:36:47.789860+0000","last_active":"2024-09-16T07:36:47.793036+0000","last_peered":"2024-09-16T07:36:47.793036+0000","last_clean":"2024-09-16T07:36:47.793036+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:47.793036+0000","last_undegraded":"2024-09-16T07:36:47.793036+0000","last_fullsized":"2024-09-16T07:36:47.793036+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:51:14.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":399,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.779852+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:36:47.779852+0000","last_peered":"2024-09-16T07:36:47.779852+0000","last_clean":"2024-09-16T07:36:47.779852+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:36:47.779852+0000","last_undegraded":"2024-09-16T07:36:47.779852+0000","last_fullsized":"2024-09-16T07:36:47.779852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33772,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338068,"statfs":{"total":96636764160,"available":96602181632,"internally_reserved":0,"allocated":2646016,"data_stored":1492695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542251,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33764,"kb_used_data":2572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338076,"statfs":{"total":96636764160,"available":96602189824,"internally_reserved":0,"allocated":2633728,"data_stored":1486392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:36:53.312 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:36:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.496+0000 7f9e9e800640 1 -- 172.21.15.114:0/1044541146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c003a40 msgr2=0x7f9e7c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.496+0000 7f9e9e800640 1 --2- 172.21.15.114:0/1044541146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e7c003a40 0x7f9e7c003e60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f9e880016f0 tx=0x7f9e8801c7b0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.496+0000 7f9e97e00640 1 -- 172.21.15.114:0/1044541146 reap_dead start 2024-09-16T07:36:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.496+0000 7f9e9e800640 1 -- 172.21.15.114:0/1044541146 shutdown_connections 2024-09-16T07:36:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.496+0000 7f9e9e800640 1 -- 172.21.15.114:0/1044541146 >> 172.21.15.114:0/1044541146 conn(0x7f9e980d1dc0 msgr2=0x7f9e980d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.496+0000 7f9e9e800640 1 -- 172.21.15.114:0/1044541146 shutdown_connections 2024-09-16T07:36:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.496+0000 7f9e9e800640 1 -- 172.21.15.114:0/1044541146 wait complete. 2024-09-16T07:36:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 Processor -- start 2024-09-16T07:36:53.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 -- start start 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e7c003a40 0x7f9e981f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e98158f00 0x7f9e98159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e980c9260 0x7f9e98161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98168510 con 0x7f9e98158f00 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98168390 con 0x7f9e7c003a40 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9e98168690 con 0x7f9e980c9260 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e98158f00 0x7f9e98159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e98158f00 0x7f9e98159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42832/0 (socket says 172.21.15.114:42832) 2024-09-16T07:36:53.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 -- 172.21.15.114:0/1268786456 learned_addr learned my addr 172.21.15.114:0/1268786456 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:53.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e97400640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e7c003a40 0x7f9e981f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e97e00640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e980c9260 0x7f9e98161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 -- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e980c9260 msgr2=0x7f9e98161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e980c9260 0x7f9e98161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 -- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e7c003a40 msgr2=0x7f9e981f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e7c003a40 0x7f9e981f8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 -- 172.21.15.114:0/1268786456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e98160c50 con 0x7f9e98158f00 2024-09-16T07:36:53.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e97e00640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e980c9260 0x7f9e98161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e96a00640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e98158f00 0x7f9e98159380 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f9e84011a80 tx=0x7f9e84011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e8f400640 1 -- 172.21.15.114:0/1268786456 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400fe10 con 0x7f9e98158f00 2024-09-16T07:36:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e8f400640 1 -- 172.21.15.114:0/1268786456 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e84016070 con 0x7f9e98158f00 2024-09-16T07:36:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e98160f30 con 0x7f9e98158f00 2024-09-16T07:36:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e8f400640 1 -- 172.21.15.114:0/1268786456 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84012690 con 0x7f9e98158f00 2024-09-16T07:36:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.500+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9806eb00 con 0x7f9e98158f00 2024-09-16T07:36:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.504+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e980ce670 con 0x7f9e98158f00 2024-09-16T07:36:53.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.504+0000 7f9e8f400640 1 -- 172.21.15.114:0/1268786456 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f9e84018030 con 0x7f9e98158f00 2024-09-16T07:36:53.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.504+0000 7f9e8f400640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9e78073910 0x7f9e78075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.504+0000 7f9e8f400640 1 -- 172.21.15.114:0/1268786456 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f9e840930f0 con 0x7f9e98158f00 2024-09-16T07:36:53.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.504+0000 7f9e97400640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9e78073910 0x7f9e78075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.504+0000 7f9e97400640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9e78073910 0x7f9e78075dd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9e880016c0 tx=0x7f9e880a8040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:53.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.508+0000 7f9e8f400640 1 -- 172.21.15.114:0/1268786456 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9e8405fb70 con 0x7f9e98158f00 2024-09-16T07:36:53.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.672+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e9806ee90 con 0x7f9e78073910 2024-09-16T07:36:53.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e8f400640 1 -- 172.21.15.114:0/1268786456 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247115 (secure 0 0 0) 0x7f9e9806ee90 con 0x7f9e78073910 2024-09-16T07:36:53.677 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:53.679 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:36:53.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9e78073910 msgr2=0x7f9e78075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9e78073910 0x7f9e78075dd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9e880016c0 tx=0x7f9e880a8040 comp rx=0 tx=0).stop 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e98158f00 msgr2=0x7f9e98159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e98158f00 0x7f9e98159380 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f9e84011a80 tx=0x7f9e84011f40 comp rx=0 tx=0).stop 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 shutdown_connections 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9e78073910 0x7f9e78075dd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e980c9260 0x7f9e98161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e98158f00 0x7f9e98159380 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 --2- 172.21.15.114:0/1268786456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e7c003a40 0x7f9e981f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 >> 172.21.15.114:0/1268786456 conn(0x7f9e980d1dc0 msgr2=0x7f9e98159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 shutdown_connections 2024-09-16T07:36:53.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.680+0000 7f9e9e800640 1 -- 172.21.15.114:0/1268786456 wait complete. 2024-09-16T07:36:53.697 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-16T07:36:52.427063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266688,"kb_used_data":17144,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708032,"statfs":{"total":773094113280,"available":772821024768,"internally_reserved":0,"allocated":17555456,"data_stored":8374140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.665173"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782760+0000","last_change":"2024-09-16T07:36:47.782760+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782760+0000","last_undegraded":"2024-09-16T07:36:47.782760+0000","last_fullsized":"2024-09-16T07:36:47.782760+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772397+0000","last_change":"2024-09-16T07:36:47.772397+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772397+0000","last_undegraded":"2024-09-16T07:36:47.772397+0000","last_fullsized":"2024-09-16T07:36:47.772397+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780219+0000","last_change":"2024-09-16T07:36:47.780219+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780219+0000","last_undegraded":"2024-09-16T07:36:47.780219+0000","last_fullsized":"2024-09-16T07:36:47.780219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777443+0000","last_change":"2024-09-16T07:36:47.777443+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777443+0000","last_undegraded":"2024-09-16T07:36:47.777443+0000","last_fullsized":"2024-09-16T07:36:47.777443+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778403+0000","last_change":"2024-09-16T07:36:47.778403+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778403+0000","last_undegraded":"2024-09-16T07:36:47.778403+0000","last_fullsized":"2024-09-16T07:36:47.778403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779044+0000","last_change":"2024-09-16T07:36:47.779044+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779044+0000","last_undegraded":"2024-09-16T07:36:47.779044+0000","last_fullsized":"2024-09-16T07:36:47.779044+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780859+0000","last_change":"2024-09-16T07:36:47.780859+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780859+0000","last_undegraded":"2024-09-16T07:36:47.780859+0000","last_fullsized":"2024-09-16T07:36:47.780859+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779353+0000","last_change":"2024-09-16T07:36:47.779353+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779353+0000","last_undegraded":"2024-09-16T07:36:47.779353+0000","last_fullsized":"2024-09-16T07:36:47.779353+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771826+0000","last_change":"2024-09-16T07:36:47.771826+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771826+0000","last_undegraded":"2024-09-16T07:36:47.771826+0000","last_fullsized":"2024-09-16T07:36:47.771826+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778464+0000","last_change":"2024-09-16T07:36:47.778464+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778464+0000","last_undegraded":"2024-09-16T07:36:47.778464+0000","last_fullsized":"2024-09-16T07:36:47.778464+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779800+0000","last_change":"2024-09-16T07:36:47.779800+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779800+0000","last_undegraded":"2024-09-16T07:36:47.779800+0000","last_fullsized":"2024-09-16T07:36:47.779800+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774173+0000","last_change":"2024-09-16T07:36:47.774173+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774173+0000","last_undegraded":"2024-09-16T07:36:47.774173+0000","last_fullsized":"2024-09-16T07:36:47.774173+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.773774+0000","last_change":"2024-09-16T07:36:47.773774+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.773774+0000","last_undegraded":"2024-09-16T07:36:47.773774+0000","last_fullsized":"2024-09-16T07:36:47.773774+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781665+0000","last_change":"2024-09-16T07:36:47.781665+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781665+0000","last_undegraded":"2024-09-16T07:36:47.781665+0000","last_fullsized":"2024-09-16T07:36:47.781665+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780405+0000","last_change":"2024-09-16T07:36:47.780405+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780405+0000","last_undegraded":"2024-09-16T07:36:47.780405+0000","last_fullsized":"2024-09-16T07:36:47.780405+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777186+0000","last_change":"2024-09-16T07:36:47.777186+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777186+0000","last_undegraded":"2024-09-16T07:36:47.777186+0000","last_fullsized":"2024-09-16T07:36:47.777186+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782229+0000","last_change":"2024-09-16T07:36:47.782229+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782229+0000","last_undegraded":"2024-09-16T07:36:47.782229+0000","last_fullsized":"2024-09-16T07:36:47.782229+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777381+0000","last_change":"2024-09-16T07:36:47.777381+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777381+0000","last_undegraded":"2024-09-16T07:36:47.777381+0000","last_fullsized":"2024-09-16T07:36:47.777381+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776274+0000","last_change":"2024-09-16T07:36:47.776274+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776274+0000","last_undegraded":"2024-09-16T07:36:47.776274+0000","last_fullsized":"2024-09-16T07:36:47.776274+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780718+0000","last_change":"2024-09-16T07:36:47.780718+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780718+0000","last_undegraded":"2024-09-16T07:36:47.780718+0000","last_fullsized":"2024-09-16T07:36:47.780718+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777117+0000","last_change":"2024-09-16T07:36:47.777117+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777117+0000","last_undegraded":"2024-09-16T07:36:47.777117+0000","last_fullsized":"2024-09-16T07:36:47.777117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767727+0000","last_change":"2024-09-16T07:36:47.767727+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767727+0000","last_undegraded":"2024-09-16T07:36:47.767727+0000","last_fullsized":"2024-09-16T07:36:47.767727+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767742+0000","last_change":"2024-09-16T07:36:47.767742+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767742+0000","last_undegraded":"2024-09-16T07:36:47.767742+0000","last_fullsized":"2024-09-16T07:36:47.767742+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777086+0000","last_change":"2024-09-16T07:36:47.777086+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777086+0000","last_undegraded":"2024-09-16T07:36:47.777086+0000","last_fullsized":"2024-09-16T07:36:47.777086+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772860+0000","last_change":"2024-09-16T07:36:47.772860+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772860+0000","last_undegraded":"2024-09-16T07:36:47.772860+0000","last_fullsized":"2024-09-16T07:36:47.772860+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.782198+0000","last_change":"2024-09-16T07:36:47.782198+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.782198+0000","last_undegraded":"2024-09-16T07:36:47.782198+0000","last_fullsized":"2024-09-16T07:36:47.782198+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772397+0000","last_change":"2024-09-16T07:36:47.772397+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772397+0000","last_undegraded":"2024-09-16T07:36:47.772397+0000","last_fullsized":"2024-09-16T07:36:47.772397+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778104+0000","last_change":"2024-09-16T07:36:47.778104+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778104+0000","last_undegraded":"2024-09-16T07:36:47.778104+0000","last_fullsized":"2024-09-16T07:36:47.778104+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774654+0000","last_change":"2024-09-16T07:36:47.774654+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774654+0000","last_undegraded":"2024-09-16T07:36:47.774654+0000","last_fullsized":"2024-09-16T07:36:47.774654+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.769663+0000","last_change":"2024-09-16T07:36:47.769663+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.769663+0000","last_undegraded":"2024-09-16T07:36:47.769663+0000","last_fullsized":"2024-09-16T07:36:47.769663+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776786+0000","last_change":"2024-09-16T07:36:47.776786+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776786+0000","last_undegraded":"2024-09-16T07:36:47.776786+0000","last_fullsized":"2024-09-16T07:36:47.776786+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779997+0000","last_change":"2024-09-16T07:36:47.779997+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779997+0000","last_undegraded":"2024-09-16T07:36:47.779997+0000","last_fullsized":"2024-09-16T07:36:47.779997+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771925+0000","last_change":"2024-09-16T07:36:47.771925+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771925+0000","last_undegraded":"2024-09-16T07:36:47.771925+0000","last_fullsized":"2024-09-16T07:36:47.771925+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788098+0000","last_change":"2024-09-16T07:36:47.783864+0000","last_active":"2024-09-16T07:36:47.788098+0000","last_peered":"2024-09-16T07:36:47.788098+0000","last_clean":"2024-09-16T07:36:47.788098+0000","last_became_active":"2024-09-16T07:36:47.783569+0000","last_became_peered":"2024-09-16T07:36:47.783569+0000","last_unstale":"2024-09-16T07:36:47.788098+0000","last_undegraded":"2024-09-16T07:36:47.788098+0000","last_fullsized":"2024-09-16T07:36:47.788098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:55.891100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.768905+0000","last_change":"2024-09-16T07:36:47.768905+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.768905+0000","last_undegraded":"2024-09-16T07:36:47.768905+0000","last_fullsized":"2024-09-16T07:36:47.768905+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788551+0000","last_change":"2024-09-16T07:36:47.785063+0000","last_active":"2024-09-16T07:36:47.788551+0000","last_peered":"2024-09-16T07:36:47.788551+0000","last_clean":"2024-09-16T07:36:47.788551+0000","last_became_active":"2024-09-16T07:36:47.784686+0000","last_became_peered":"2024-09-16T07:36:47.784686+0000","last_unstale":"2024-09-16T07:36:47.788551+0000","last_undegraded":"2024-09-16T07:36:47.788551+0000","last_fullsized":"2024-09-16T07:36:47.788551+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:26.504556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781273+0000","last_change":"2024-09-16T07:36:47.781273+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781273+0000","last_undegraded":"2024-09-16T07:36:47.781273+0000","last_fullsized":"2024-09-16T07:36:47.781273+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792471+0000","last_change":"2024-09-16T07:36:47.789633+0000","last_active":"2024-09-16T07:36:47.792471+0000","last_peered":"2024-09-16T07:36:47.792471+0000","last_clean":"2024-09-16T07:36:47.792471+0000","last_became_active":"2024-09-16T07:36:47.789328+0000","last_became_peered":"2024-09-16T07:36:47.789328+0000","last_unstale":"2024-09-16T07:36:47.792471+0000","last_undegraded":"2024-09-16T07:36:47.792471+0000","last_fullsized":"2024-09-16T07:36:47.792471+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:16.180075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775800+0000","last_change":"2024-09-16T07:36:47.775800+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775800+0000","last_undegraded":"2024-09-16T07:36:47.775800+0000","last_fullsized":"2024-09-16T07:36:47.775800+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795019+0000","last_change":"2024-09-16T07:36:47.794481+0000","last_active":"2024-09-16T07:36:47.795019+0000","last_peered":"2024-09-16T07:36:47.795019+0000","last_clean":"2024-09-16T07:36:47.795019+0000","last_became_active":"2024-09-16T07:36:47.794271+0000","last_became_peered":"2024-09-16T07:36:47.794271+0000","last_unstale":"2024-09-16T07:36:47.795019+0000","last_undegraded":"2024-09-16T07:36:47.795019+0000","last_fullsized":"2024-09-16T07:36:47.795019+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:53.238074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776623+0000","last_change":"2024-09-16T07:36:47.776623+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776623+0000","last_undegraded":"2024-09-16T07:36:47.776623+0000","last_fullsized":"2024-09-16T07:36:47.776623+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795217+0000","last_change":"2024-09-16T07:36:47.786771+0000","last_active":"2024-09-16T07:36:47.795217+0000","last_peered":"2024-09-16T07:36:47.795217+0000","last_clean":"2024-09-16T07:36:47.795217+0000","last_became_active":"2024-09-16T07:36:47.786344+0000","last_became_peered":"2024-09-16T07:36:47.786344+0000","last_unstale":"2024-09-16T07:36:47.795217+0000","last_undegraded":"2024-09-16T07:36:47.795217+0000","last_fullsized":"2024-09-16T07:36:47.795217+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:27:24.850313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778923+0000","last_change":"2024-09-16T07:36:47.778923+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778923+0000","last_undegraded":"2024-09-16T07:36:47.778923+0000","last_fullsized":"2024-09-16T07:36:47.778923+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798172+0000","last_change":"2024-09-16T07:36:47.792142+0000","last_active":"2024-09-16T07:36:47.798172+0000","last_peered":"2024-09-16T07:36:47.798172+0000","last_clean":"2024-09-16T07:36:47.798172+0000","last_became_active":"2024-09-16T07:36:47.791887+0000","last_became_peered":"2024-09-16T07:36:47.791887+0000","last_unstale":"2024-09-16T07:36:47.798172+0000","last_undegraded":"2024-09-16T07:36:47.798172+0000","last_fullsized":"2024-09-16T07:36:47.798172+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:51:14.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776627+0000","last_change":"2024-09-16T07:36:47.776627+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776627+0000","last_undegraded":"2024-09-16T07:36:47.776627+0000","last_fullsized":"2024-09-16T07:36:47.776627+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.780146+0000","last_change":"2024-09-16T07:36:47.775955+0000","last_active":"2024-09-16T07:36:47.780146+0000","last_peered":"2024-09-16T07:36:47.780146+0000","last_clean":"2024-09-16T07:36:47.780146+0000","last_became_active":"2024-09-16T07:36:47.774675+0000","last_became_peered":"2024-09-16T07:36:47.774675+0000","last_unstale":"2024-09-16T07:36:47.780146+0000","last_undegraded":"2024-09-16T07:36:47.780146+0000","last_fullsized":"2024-09-16T07:36:47.780146+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:55.771795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777937+0000","last_change":"2024-09-16T07:36:47.777937+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777937+0000","last_undegraded":"2024-09-16T07:36:47.777937+0000","last_fullsized":"2024-09-16T07:36:47.777937+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798082+0000","last_change":"2024-09-16T07:36:47.790849+0000","last_active":"2024-09-16T07:36:47.798082+0000","last_peered":"2024-09-16T07:36:47.798082+0000","last_clean":"2024-09-16T07:36:47.798082+0000","last_became_active":"2024-09-16T07:36:47.790581+0000","last_became_peered":"2024-09-16T07:36:47.790581+0000","last_unstale":"2024-09-16T07:36:47.798082+0000","last_undegraded":"2024-09-16T07:36:47.798082+0000","last_fullsized":"2024-09-16T07:36:47.798082+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:55.891100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777144+0000","last_change":"2024-09-16T07:36:47.777144+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777144+0000","last_undegraded":"2024-09-16T07:36:47.777144+0000","last_fullsized":"2024-09-16T07:36:47.777144+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.780220+0000","last_change":"2024-09-16T07:36:47.776292+0000","last_active":"2024-09-16T07:36:47.780220+0000","last_peered":"2024-09-16T07:36:47.780220+0000","last_clean":"2024-09-16T07:36:47.780220+0000","last_became_active":"2024-09-16T07:36:47.775815+0000","last_became_peered":"2024-09-16T07:36:47.775815+0000","last_unstale":"2024-09-16T07:36:47.780220+0000","last_undegraded":"2024-09-16T07:36:47.780220+0000","last_fullsized":"2024-09-16T07:36:47.780220+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:46.845007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776865+0000","last_change":"2024-09-16T07:36:47.776865+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776865+0000","last_undegraded":"2024-09-16T07:36:47.776865+0000","last_fullsized":"2024-09-16T07:36:47.776865+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798028+0000","last_change":"2024-09-16T07:36:47.794548+0000","last_active":"2024-09-16T07:36:47.798028+0000","last_peered":"2024-09-16T07:36:47.798028+0000","last_clean":"2024-09-16T07:36:47.798028+0000","last_became_active":"2024-09-16T07:36:47.793042+0000","last_became_peered":"2024-09-16T07:36:47.793042+0000","last_unstale":"2024-09-16T07:36:47.798028+0000","last_undegraded":"2024-09-16T07:36:47.798028+0000","last_fullsized":"2024-09-16T07:36:47.798028+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:58:26.858727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781244+0000","last_change":"2024-09-16T07:36:47.781244+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781244+0000","last_undegraded":"2024-09-16T07:36:47.781244+0000","last_fullsized":"2024-09-16T07:36:47.781244+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793168+0000","last_change":"2024-09-16T07:36:47.789226+0000","last_active":"2024-09-16T07:36:47.793168+0000","last_peered":"2024-09-16T07:36:47.793168+0000","last_clean":"2024-09-16T07:36:47.793168+0000","last_became_active":"2024-09-16T07:36:47.788766+0000","last_became_peered":"2024-09-16T07:36:47.788766+0000","last_unstale":"2024-09-16T07:36:47.793168+0000","last_undegraded":"2024-09-16T07:36:47.793168+0000","last_fullsized":"2024-09-16T07:36:47.793168+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:59:31.170029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.778537+0000","last_change":"2024-09-16T07:36:47.778537+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.778537+0000","last_undegraded":"2024-09-16T07:36:47.778537+0000","last_fullsized":"2024-09-16T07:36:47.778537+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.787867+0000","last_change":"2024-09-16T07:36:47.781350+0000","last_active":"2024-09-16T07:36:47.787867+0000","last_peered":"2024-09-16T07:36:47.787867+0000","last_clean":"2024-09-16T07:36:47.787867+0000","last_became_active":"2024-09-16T07:36:47.781033+0000","last_became_peered":"2024-09-16T07:36:47.781033+0000","last_unstale":"2024-09-16T07:36:47.787867+0000","last_undegraded":"2024-09-16T07:36:47.787867+0000","last_fullsized":"2024-09-16T07:36:47.787867+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:17.517901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775989+0000","last_change":"2024-09-16T07:36:47.775989+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775989+0000","last_undegraded":"2024-09-16T07:36:47.775989+0000","last_fullsized":"2024-09-16T07:36:47.775989+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.785549+0000","last_change":"2024-09-16T07:36:47.781137+0000","last_active":"2024-09-16T07:36:47.785549+0000","last_peered":"2024-09-16T07:36:47.785549+0000","last_clean":"2024-09-16T07:36:47.785549+0000","last_became_active":"2024-09-16T07:36:47.780684+0000","last_became_peered":"2024-09-16T07:36:47.780684+0000","last_unstale":"2024-09-16T07:36:47.785549+0000","last_undegraded":"2024-09-16T07:36:47.785549+0000","last_fullsized":"2024-09-16T07:36:47.785549+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:50:42.775969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777085+0000","last_change":"2024-09-16T07:36:47.777085+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777085+0000","last_undegraded":"2024-09-16T07:36:47.777085+0000","last_fullsized":"2024-09-16T07:36:47.777085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793098+0000","last_change":"2024-09-16T07:36:47.786759+0000","last_active":"2024-09-16T07:36:47.793098+0000","last_peered":"2024-09-16T07:36:47.793098+0000","last_clean":"2024-09-16T07:36:47.793098+0000","last_became_active":"2024-09-16T07:36:47.786477+0000","last_became_peered":"2024-09-16T07:36:47.786477+0000","last_unstale":"2024-09-16T07:36:47.793098+0000","last_undegraded":"2024-09-16T07:36:47.793098+0000","last_fullsized":"2024-09-16T07:36:47.793098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:18.476045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.779948+0000","last_change":"2024-09-16T07:36:47.779948+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.779948+0000","last_undegraded":"2024-09-16T07:36:47.779948+0000","last_fullsized":"2024-09-16T07:36:47.779948+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792272+0000","last_change":"2024-09-16T07:36:47.788463+0000","last_active":"2024-09-16T07:36:47.792272+0000","last_peered":"2024-09-16T07:36:47.792272+0000","last_clean":"2024-09-16T07:36:47.792272+0000","last_became_active":"2024-09-16T07:36:47.788206+0000","last_became_peered":"2024-09-16T07:36:47.788206+0000","last_unstale":"2024-09-16T07:36:47.792272+0000","last_undegraded":"2024-09-16T07:36:47.792272+0000","last_fullsized":"2024-09-16T07:36:47.792272+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:27:37.773632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771461+0000","last_change":"2024-09-16T07:36:47.771461+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771461+0000","last_undegraded":"2024-09-16T07:36:47.771461+0000","last_fullsized":"2024-09-16T07:36:47.771461+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.801979+0000","last_change":"2024-09-16T07:36:47.799092+0000","last_active":"2024-09-16T07:36:47.801979+0000","last_peered":"2024-09-16T07:36:47.801979+0000","last_clean":"2024-09-16T07:36:47.801979+0000","last_became_active":"2024-09-16T07:36:47.798679+0000","last_became_peered":"2024-09-16T07:36:47.798679+0000","last_unstale":"2024-09-16T07:36:47.801979+0000","last_undegraded":"2024-09-16T07:36:47.801979+0000","last_fullsized":"2024-09-16T07:36:47.801979+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:43.882078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.772417+0000","last_change":"2024-09-16T07:36:47.772417+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.772417+0000","last_undegraded":"2024-09-16T07:36:47.772417+0000","last_fullsized":"2024-09-16T07:36:47.772417+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.786115+0000","last_change":"2024-09-16T07:36:47.781253+0000","last_active":"2024-09-16T07:36:47.786115+0000","last_peered":"2024-09-16T07:36:47.786115+0000","last_clean":"2024-09-16T07:36:47.786115+0000","last_became_active":"2024-09-16T07:36:47.780968+0000","last_became_peered":"2024-09-16T07:36:47.780968+0000","last_unstale":"2024-09-16T07:36:47.786115+0000","last_undegraded":"2024-09-16T07:36:47.786115+0000","last_fullsized":"2024-09-16T07:36:47.786115+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:13.117629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.777566+0000","last_change":"2024-09-16T07:36:47.777566+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.777566+0000","last_undegraded":"2024-09-16T07:36:47.777566+0000","last_fullsized":"2024-09-16T07:36:47.777566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.795398+0000","last_change":"2024-09-16T07:36:47.792016+0000","last_active":"2024-09-16T07:36:47.795398+0000","last_peered":"2024-09-16T07:36:47.795398+0000","last_clean":"2024-09-16T07:36:47.795398+0000","last_became_active":"2024-09-16T07:36:47.791765+0000","last_became_peered":"2024-09-16T07:36:47.791765+0000","last_unstale":"2024-09-16T07:36:47.795398+0000","last_undegraded":"2024-09-16T07:36:47.795398+0000","last_fullsized":"2024-09-16T07:36:47.795398+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:43.222917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775124+0000","last_change":"2024-09-16T07:36:47.775124+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775124+0000","last_undegraded":"2024-09-16T07:36:47.775124+0000","last_fullsized":"2024-09-16T07:36:47.775124+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.792529+0000","last_change":"2024-09-16T07:36:47.789887+0000","last_active":"2024-09-16T07:36:47.792529+0000","last_peered":"2024-09-16T07:36:47.792529+0000","last_clean":"2024-09-16T07:36:47.792529+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:47.792529+0000","last_undegraded":"2024-09-16T07:36:47.792529+0000","last_fullsized":"2024-09-16T07:36:47.792529+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:02.432650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775586+0000","last_change":"2024-09-16T07:36:47.775586+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775586+0000","last_undegraded":"2024-09-16T07:36:47.775586+0000","last_fullsized":"2024-09-16T07:36:47.775586+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793848+0000","last_change":"2024-09-16T07:36:47.788288+0000","last_active":"2024-09-16T07:36:47.793848+0000","last_peered":"2024-09-16T07:36:47.793848+0000","last_clean":"2024-09-16T07:36:47.793848+0000","last_became_active":"2024-09-16T07:36:47.788033+0000","last_became_peered":"2024-09-16T07:36:47.788033+0000","last_unstale":"2024-09-16T07:36:47.793848+0000","last_undegraded":"2024-09-16T07:36:47.793848+0000","last_fullsized":"2024-09-16T07:36:47.793848+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:49.041780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776593+0000","last_change":"2024-09-16T07:36:47.776593+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776593+0000","last_undegraded":"2024-09-16T07:36:47.776593+0000","last_fullsized":"2024-09-16T07:36:47.776593+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790145+0000","last_change":"2024-09-16T07:36:47.788687+0000","last_active":"2024-09-16T07:36:47.790145+0000","last_peered":"2024-09-16T07:36:47.790145+0000","last_clean":"2024-09-16T07:36:47.790145+0000","last_became_active":"2024-09-16T07:36:47.788264+0000","last_became_peered":"2024-09-16T07:36:47.788264+0000","last_unstale":"2024-09-16T07:36:47.790145+0000","last_undegraded":"2024-09-16T07:36:47.790145+0000","last_fullsized":"2024-09-16T07:36:47.790145+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:27:35.994602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.770368+0000","last_change":"2024-09-16T07:36:47.770368+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.770368+0000","last_undegraded":"2024-09-16T07:36:47.770368+0000","last_fullsized":"2024-09-16T07:36:47.770368+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790277+0000","last_change":"2024-09-16T07:36:47.788394+0000","last_active":"2024-09-16T07:36:47.790277+0000","last_peered":"2024-09-16T07:36:47.790277+0000","last_clean":"2024-09-16T07:36:47.790277+0000","last_became_active":"2024-09-16T07:36:47.788042+0000","last_became_peered":"2024-09-16T07:36:47.788042+0000","last_unstale":"2024-09-16T07:36:47.790277+0000","last_undegraded":"2024-09-16T07:36:47.790277+0000","last_fullsized":"2024-09-16T07:36:47.790277+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:21.155725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.767276+0000","last_change":"2024-09-16T07:36:47.767276+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.767276+0000","last_undegraded":"2024-09-16T07:36:47.767276+0000","last_fullsized":"2024-09-16T07:36:47.767276+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798895+0000","last_change":"2024-09-16T07:36:47.795994+0000","last_active":"2024-09-16T07:36:47.798895+0000","last_peered":"2024-09-16T07:36:47.798895+0000","last_clean":"2024-09-16T07:36:47.798895+0000","last_became_active":"2024-09-16T07:36:47.795685+0000","last_became_peered":"2024-09-16T07:36:47.795685+0000","last_unstale":"2024-09-16T07:36:47.798895+0000","last_undegraded":"2024-09-16T07:36:47.798895+0000","last_fullsized":"2024-09-16T07:36:47.798895+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:09.797850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.775269+0000","last_change":"2024-09-16T07:36:47.775269+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.775269+0000","last_undegraded":"2024-09-16T07:36:47.775269+0000","last_fullsized":"2024-09-16T07:36:47.775269+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.791780+0000","last_change":"2024-09-16T07:36:47.786354+0000","last_active":"2024-09-16T07:36:47.791780+0000","last_peered":"2024-09-16T07:36:47.791780+0000","last_clean":"2024-09-16T07:36:47.791780+0000","last_became_active":"2024-09-16T07:36:47.786079+0000","last_became_peered":"2024-09-16T07:36:47.786079+0000","last_unstale":"2024-09-16T07:36:47.791780+0000","last_undegraded":"2024-09-16T07:36:47.791780+0000","last_fullsized":"2024-09-16T07:36:47.791780+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:51.563187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781810+0000","last_change":"2024-09-16T07:36:47.781810+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781810+0000","last_undegraded":"2024-09-16T07:36:47.781810+0000","last_fullsized":"2024-09-16T07:36:47.781810+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.790547+0000","last_change":"2024-09-16T07:36:47.787281+0000","last_active":"2024-09-16T07:36:47.790547+0000","last_peered":"2024-09-16T07:36:47.790547+0000","last_clean":"2024-09-16T07:36:47.790547+0000","last_became_active":"2024-09-16T07:36:47.786935+0000","last_became_peered":"2024-09-16T07:36:47.786935+0000","last_unstale":"2024-09-16T07:36:47.790547+0000","last_undegraded":"2024-09-16T07:36:47.790547+0000","last_fullsized":"2024-09-16T07:36:47.790547+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:26.515706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.771033+0000","last_change":"2024-09-16T07:36:47.771033+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.771033+0000","last_undegraded":"2024-09-16T07:36:47.771033+0000","last_fullsized":"2024-09-16T07:36:47.771033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798781+0000","last_change":"2024-09-16T07:36:47.793515+0000","last_active":"2024-09-16T07:36:47.798781+0000","last_peered":"2024-09-16T07:36:47.798781+0000","last_clean":"2024-09-16T07:36:47.798781+0000","last_became_active":"2024-09-16T07:36:47.793043+0000","last_became_peered":"2024-09-16T07:36:47.793043+0000","last_unstale":"2024-09-16T07:36:47.798781+0000","last_undegraded":"2024-09-16T07:36:47.798781+0000","last_fullsized":"2024-09-16T07:36:47.798781+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:56:25.075197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.768639+0000","last_change":"2024-09-16T07:36:47.768639+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.768639+0000","last_undegraded":"2024-09-16T07:36:47.768639+0000","last_fullsized":"2024-09-16T07:36:47.768639+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.787318+0000","last_change":"2024-09-16T07:36:47.785322+0000","last_active":"2024-09-16T07:36:47.787318+0000","last_peered":"2024-09-16T07:36:47.787318+0000","last_clean":"2024-09-16T07:36:47.787318+0000","last_became_active":"2024-09-16T07:36:47.785024+0000","last_became_peered":"2024-09-16T07:36:47.785024+0000","last_unstale":"2024-09-16T07:36:47.787318+0000","last_undegraded":"2024-09-16T07:36:47.787318+0000","last_fullsized":"2024-09-16T07:36:47.787318+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:20:55.588973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.780708+0000","last_change":"2024-09-16T07:36:47.780708+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.780708+0000","last_undegraded":"2024-09-16T07:36:47.780708+0000","last_fullsized":"2024-09-16T07:36:47.780708+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.797511+0000","last_change":"2024-09-16T07:36:47.795318+0000","last_active":"2024-09-16T07:36:47.797511+0000","last_peered":"2024-09-16T07:36:47.797511+0000","last_clean":"2024-09-16T07:36:47.797511+0000","last_became_active":"2024-09-16T07:36:47.795051+0000","last_became_peered":"2024-09-16T07:36:47.795051+0000","last_unstale":"2024-09-16T07:36:47.797511+0000","last_undegraded":"2024-09-16T07:36:47.797511+0000","last_fullsized":"2024-09-16T07:36:47.797511+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:44:00.172819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.774222+0000","last_change":"2024-09-16T07:36:47.774222+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.774222+0000","last_undegraded":"2024-09-16T07:36:47.774222+0000","last_fullsized":"2024-09-16T07:36:47.774222+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.798867+0000","last_change":"2024-09-16T07:36:47.795227+0000","last_active":"2024-09-16T07:36:47.798867+0000","last_peered":"2024-09-16T07:36:47.798867+0000","last_clean":"2024-09-16T07:36:47.798867+0000","last_became_active":"2024-09-16T07:36:47.794955+0000","last_became_peered":"2024-09-16T07:36:47.794955+0000","last_unstale":"2024-09-16T07:36:47.798867+0000","last_undegraded":"2024-09-16T07:36:47.798867+0000","last_fullsized":"2024-09-16T07:36:47.798867+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:37.062662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.776542+0000","last_change":"2024-09-16T07:36:47.776542+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.776542+0000","last_undegraded":"2024-09-16T07:36:47.776542+0000","last_fullsized":"2024-09-16T07:36:47.776542+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.788039+0000","last_change":"2024-09-16T07:36:47.781443+0000","last_active":"2024-09-16T07:36:47.788039+0000","last_peered":"2024-09-16T07:36:47.788039+0000","last_clean":"2024-09-16T07:36:47.788039+0000","last_became_active":"2024-09-16T07:36:47.781151+0000","last_became_peered":"2024-09-16T07:36:47.781151+0000","last_unstale":"2024-09-16T07:36:47.788039+0000","last_undegraded":"2024-09-16T07:36:47.788039+0000","last_fullsized":"2024-09-16T07:36:47.788039+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:24:05.734638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.770847+0000","last_change":"2024-09-16T07:36:47.770847+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.770847+0000","last_undegraded":"2024-09-16T07:36:47.770847+0000","last_fullsized":"2024-09-16T07:36:47.770847+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.786325+0000","last_change":"2024-09-16T07:36:47.782624+0000","last_active":"2024-09-16T07:36:47.786325+0000","last_peered":"2024-09-16T07:36:47.786325+0000","last_clean":"2024-09-16T07:36:47.786325+0000","last_became_active":"2024-09-16T07:36:47.782288+0000","last_became_peered":"2024-09-16T07:36:47.782288+0000","last_unstale":"2024-09-16T07:36:47.786325+0000","last_undegraded":"2024-09-16T07:36:47.786325+0000","last_fullsized":"2024-09-16T07:36:47.786325+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:27:24.850313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-16T07:36:47.781165+0000","last_change":"2024-09-16T07:36:47.781165+0000","last_active":"2024-09-16T07:36:47.760771+0000","last_peered":"2024-09-16T07:36:47.760771+0000","last_clean":"2024-09-16T07:36:47.760771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:36:47.781165+0000","last_undegraded":"2024-09-16T07:36:47.781165+0000","last_fullsized":"2024-09-16T07:36:47.781165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.793036+0000","last_change":"2024-09-16T07:36:47.789860+0000","last_active":"2024-09-16T07:36:47.793036+0000","last_peered":"2024-09-16T07:36:47.793036+0000","last_clean":"2024-09-16T07:36:47.793036+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:47.793036+0000","last_undegraded":"2024-09-16T07:36:47.793036+0000","last_fullsized":"2024-09-16T07:36:47.793036+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:51:14.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":399,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-16T07:36:47.779852+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:36:47.779852+0000","last_peered":"2024-09-16T07:36:47.779852+0000","last_clean":"2024-09-16T07:36:47.779852+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:36:47.779852+0000","last_undegraded":"2024-09-16T07:36:47.779852+0000","last_fullsized":"2024-09-16T07:36:47.779852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33772,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338068,"statfs":{"total":96636764160,"available":96602181632,"internally_reserved":0,"allocated":2646016,"data_stored":1492695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":902327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542251,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2039808,"data_stored":896024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33764,"kb_used_data":2572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338076,"statfs":{"total":96636764160,"available":96602189824,"internally_reserved":0,"allocated":2633728,"data_stored":1486392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:36:53.701 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3f is not active+clean 2024-09-16T07:36:53.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.782760+0000', 'last_change': '2024-09-16T07:36:47.782760+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.782760+0000', 'last_undegraded': '2024-09-16T07:36:47.782760+0000', 'last_fullsized': '2024-09-16T07:36:47.782760+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.701 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3e is not active+clean 2024-09-16T07:36:53.701 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.772397+0000', 'last_change': '2024-09-16T07:36:47.772397+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.772397+0000', 'last_undegraded': '2024-09-16T07:36:47.772397+0000', 'last_fullsized': '2024-09-16T07:36:47.772397+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3d is not active+clean 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.780219+0000', 'last_change': '2024-09-16T07:36:47.780219+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.780219+0000', 'last_undegraded': '2024-09-16T07:36:47.780219+0000', 'last_fullsized': '2024-09-16T07:36:47.780219+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3c is not active+clean 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777443+0000', 'last_change': '2024-09-16T07:36:47.777443+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777443+0000', 'last_undegraded': '2024-09-16T07:36:47.777443+0000', 'last_fullsized': '2024-09-16T07:36:47.777443+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3b is not active+clean 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.778403+0000', 'last_change': '2024-09-16T07:36:47.778403+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.778403+0000', 'last_undegraded': '2024-09-16T07:36:47.778403+0000', 'last_fullsized': '2024-09-16T07:36:47.778403+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3a is not active+clean 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.779044+0000', 'last_change': '2024-09-16T07:36:47.779044+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.779044+0000', 'last_undegraded': '2024-09-16T07:36:47.779044+0000', 'last_fullsized': '2024-09-16T07:36:47.779044+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:PG 27.39 is not active+clean 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.780859+0000', 'last_change': '2024-09-16T07:36:47.780859+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.780859+0000', 'last_undegraded': '2024-09-16T07:36:47.780859+0000', 'last_fullsized': '2024-09-16T07:36:47.780859+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.702 INFO:tasks.ceph.ceph_manager.ceph:PG 27.38 is not active+clean 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.779353+0000', 'last_change': '2024-09-16T07:36:47.779353+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.779353+0000', 'last_undegraded': '2024-09-16T07:36:47.779353+0000', 'last_fullsized': '2024-09-16T07:36:47.779353+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:PG 27.37 is not active+clean 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.771826+0000', 'last_change': '2024-09-16T07:36:47.771826+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.771826+0000', 'last_undegraded': '2024-09-16T07:36:47.771826+0000', 'last_fullsized': '2024-09-16T07:36:47.771826+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:PG 27.36 is not active+clean 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.778464+0000', 'last_change': '2024-09-16T07:36:47.778464+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.778464+0000', 'last_undegraded': '2024-09-16T07:36:47.778464+0000', 'last_fullsized': '2024-09-16T07:36:47.778464+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:PG 27.35 is not active+clean 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.779800+0000', 'last_change': '2024-09-16T07:36:47.779800+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.779800+0000', 'last_undegraded': '2024-09-16T07:36:47.779800+0000', 'last_fullsized': '2024-09-16T07:36:47.779800+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:PG 27.34 is not active+clean 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.774173+0000', 'last_change': '2024-09-16T07:36:47.774173+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.774173+0000', 'last_undegraded': '2024-09-16T07:36:47.774173+0000', 'last_fullsized': '2024-09-16T07:36:47.774173+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:PG 27.33 is not active+clean 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.773774+0000', 'last_change': '2024-09-16T07:36:47.773774+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.773774+0000', 'last_undegraded': '2024-09-16T07:36:47.773774+0000', 'last_fullsized': '2024-09-16T07:36:47.773774+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:36:53.703 INFO:tasks.ceph.ceph_manager.ceph:PG 27.32 is not active+clean 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.781665+0000', 'last_change': '2024-09-16T07:36:47.781665+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.781665+0000', 'last_undegraded': '2024-09-16T07:36:47.781665+0000', 'last_fullsized': '2024-09-16T07:36:47.781665+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:PG 27.31 is not active+clean 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.780405+0000', 'last_change': '2024-09-16T07:36:47.780405+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.780405+0000', 'last_undegraded': '2024-09-16T07:36:47.780405+0000', 'last_fullsized': '2024-09-16T07:36:47.780405+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:PG 27.30 is not active+clean 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777186+0000', 'last_change': '2024-09-16T07:36:47.777186+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777186+0000', 'last_undegraded': '2024-09-16T07:36:47.777186+0000', 'last_fullsized': '2024-09-16T07:36:47.777186+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2f is not active+clean 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.782229+0000', 'last_change': '2024-09-16T07:36:47.782229+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.782229+0000', 'last_undegraded': '2024-09-16T07:36:47.782229+0000', 'last_fullsized': '2024-09-16T07:36:47.782229+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2e is not active+clean 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777381+0000', 'last_change': '2024-09-16T07:36:47.777381+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777381+0000', 'last_undegraded': '2024-09-16T07:36:47.777381+0000', 'last_fullsized': '2024-09-16T07:36:47.777381+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2d is not active+clean 2024-09-16T07:36:53.704 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.776274+0000', 'last_change': '2024-09-16T07:36:47.776274+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.776274+0000', 'last_undegraded': '2024-09-16T07:36:47.776274+0000', 'last_fullsized': '2024-09-16T07:36:47.776274+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2c is not active+clean 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.780718+0000', 'last_change': '2024-09-16T07:36:47.780718+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.780718+0000', 'last_undegraded': '2024-09-16T07:36:47.780718+0000', 'last_fullsized': '2024-09-16T07:36:47.780718+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2b is not active+clean 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777117+0000', 'last_change': '2024-09-16T07:36:47.777117+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777117+0000', 'last_undegraded': '2024-09-16T07:36:47.777117+0000', 'last_fullsized': '2024-09-16T07:36:47.777117+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2a is not active+clean 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.767727+0000', 'last_change': '2024-09-16T07:36:47.767727+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.767727+0000', 'last_undegraded': '2024-09-16T07:36:47.767727+0000', 'last_fullsized': '2024-09-16T07:36:47.767727+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:PG 27.29 is not active+clean 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.767742+0000', 'last_change': '2024-09-16T07:36:47.767742+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.767742+0000', 'last_undegraded': '2024-09-16T07:36:47.767742+0000', 'last_fullsized': '2024-09-16T07:36:47.767742+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:PG 27.28 is not active+clean 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777086+0000', 'last_change': '2024-09-16T07:36:47.777086+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777086+0000', 'last_undegraded': '2024-09-16T07:36:47.777086+0000', 'last_fullsized': '2024-09-16T07:36:47.777086+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:PG 27.27 is not active+clean 2024-09-16T07:36:53.705 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.772860+0000', 'last_change': '2024-09-16T07:36:47.772860+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.772860+0000', 'last_undegraded': '2024-09-16T07:36:47.772860+0000', 'last_fullsized': '2024-09-16T07:36:47.772860+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:PG 27.26 is not active+clean 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.782198+0000', 'last_change': '2024-09-16T07:36:47.782198+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.782198+0000', 'last_undegraded': '2024-09-16T07:36:47.782198+0000', 'last_fullsized': '2024-09-16T07:36:47.782198+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:PG 27.25 is not active+clean 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.772397+0000', 'last_change': '2024-09-16T07:36:47.772397+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.772397+0000', 'last_undegraded': '2024-09-16T07:36:47.772397+0000', 'last_fullsized': '2024-09-16T07:36:47.772397+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:PG 27.24 is not active+clean 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.778104+0000', 'last_change': '2024-09-16T07:36:47.778104+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.778104+0000', 'last_undegraded': '2024-09-16T07:36:47.778104+0000', 'last_fullsized': '2024-09-16T07:36:47.778104+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:PG 27.23 is not active+clean 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.774654+0000', 'last_change': '2024-09-16T07:36:47.774654+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.774654+0000', 'last_undegraded': '2024-09-16T07:36:47.774654+0000', 'last_fullsized': '2024-09-16T07:36:47.774654+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:PG 27.22 is not active+clean 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.769663+0000', 'last_change': '2024-09-16T07:36:47.769663+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.769663+0000', 'last_undegraded': '2024-09-16T07:36:47.769663+0000', 'last_fullsized': '2024-09-16T07:36:47.769663+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.706 INFO:tasks.ceph.ceph_manager.ceph:PG 27.21 is not active+clean 2024-09-16T07:36:53.707 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.776786+0000', 'last_change': '2024-09-16T07:36:47.776786+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.776786+0000', 'last_undegraded': '2024-09-16T07:36:47.776786+0000', 'last_fullsized': '2024-09-16T07:36:47.776786+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.708 INFO:tasks.ceph.ceph_manager.ceph:PG 27.20 is not active+clean 2024-09-16T07:36:53.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.779997+0000', 'last_change': '2024-09-16T07:36:47.779997+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.779997+0000', 'last_undegraded': '2024-09-16T07:36:47.779997+0000', 'last_fullsized': '2024-09-16T07:36:47.779997+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.708 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1e is not active+clean 2024-09-16T07:36:53.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.771925+0000', 'last_change': '2024-09-16T07:36:47.771925+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.771925+0000', 'last_undegraded': '2024-09-16T07:36:47.771925+0000', 'last_fullsized': '2024-09-16T07:36:47.771925+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.708 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1f is not active+clean 2024-09-16T07:36:53.708 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.768905+0000', 'last_change': '2024-09-16T07:36:47.768905+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.768905+0000', 'last_undegraded': '2024-09-16T07:36:47.768905+0000', 'last_fullsized': '2024-09-16T07:36:47.768905+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1c is not active+clean 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.781273+0000', 'last_change': '2024-09-16T07:36:47.781273+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.781273+0000', 'last_undegraded': '2024-09-16T07:36:47.781273+0000', 'last_fullsized': '2024-09-16T07:36:47.781273+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1d is not active+clean 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.775800+0000', 'last_change': '2024-09-16T07:36:47.775800+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.775800+0000', 'last_undegraded': '2024-09-16T07:36:47.775800+0000', 'last_fullsized': '2024-09-16T07:36:47.775800+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1b is not active+clean 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.776623+0000', 'last_change': '2024-09-16T07:36:47.776623+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.776623+0000', 'last_undegraded': '2024-09-16T07:36:47.776623+0000', 'last_fullsized': '2024-09-16T07:36:47.776623+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:PG 27.18 is not active+clean 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.778923+0000', 'last_change': '2024-09-16T07:36:47.778923+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.778923+0000', 'last_undegraded': '2024-09-16T07:36:47.778923+0000', 'last_fullsized': '2024-09-16T07:36:47.778923+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:PG 27.19 is not active+clean 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.776627+0000', 'last_change': '2024-09-16T07:36:47.776627+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.776627+0000', 'last_undegraded': '2024-09-16T07:36:47.776627+0000', 'last_fullsized': '2024-09-16T07:36:47.776627+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:PG 27.16 is not active+clean 2024-09-16T07:36:53.709 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777937+0000', 'last_change': '2024-09-16T07:36:47.777937+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777937+0000', 'last_undegraded': '2024-09-16T07:36:47.777937+0000', 'last_fullsized': '2024-09-16T07:36:47.777937+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:PG 27.17 is not active+clean 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777144+0000', 'last_change': '2024-09-16T07:36:47.777144+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777144+0000', 'last_undegraded': '2024-09-16T07:36:47.777144+0000', 'last_fullsized': '2024-09-16T07:36:47.777144+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:PG 27.14 is not active+clean 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.776865+0000', 'last_change': '2024-09-16T07:36:47.776865+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.776865+0000', 'last_undegraded': '2024-09-16T07:36:47.776865+0000', 'last_fullsized': '2024-09-16T07:36:47.776865+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:PG 27.15 is not active+clean 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.781244+0000', 'last_change': '2024-09-16T07:36:47.781244+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.781244+0000', 'last_undegraded': '2024-09-16T07:36:47.781244+0000', 'last_fullsized': '2024-09-16T07:36:47.781244+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:PG 27.12 is not active+clean 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.778537+0000', 'last_change': '2024-09-16T07:36:47.778537+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.778537+0000', 'last_undegraded': '2024-09-16T07:36:47.778537+0000', 'last_fullsized': '2024-09-16T07:36:47.778537+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:PG 27.13 is not active+clean 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.775989+0000', 'last_change': '2024-09-16T07:36:47.775989+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.775989+0000', 'last_undegraded': '2024-09-16T07:36:47.775989+0000', 'last_fullsized': '2024-09-16T07:36:47.775989+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.710 INFO:tasks.ceph.ceph_manager.ceph:PG 27.10 is not active+clean 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777085+0000', 'last_change': '2024-09-16T07:36:47.777085+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777085+0000', 'last_undegraded': '2024-09-16T07:36:47.777085+0000', 'last_fullsized': '2024-09-16T07:36:47.777085+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:PG 27.11 is not active+clean 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.779948+0000', 'last_change': '2024-09-16T07:36:47.779948+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.779948+0000', 'last_undegraded': '2024-09-16T07:36:47.779948+0000', 'last_fullsized': '2024-09-16T07:36:47.779948+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:PG 27.e is not active+clean 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.771461+0000', 'last_change': '2024-09-16T07:36:47.771461+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.771461+0000', 'last_undegraded': '2024-09-16T07:36:47.771461+0000', 'last_fullsized': '2024-09-16T07:36:47.771461+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:PG 27.f is not active+clean 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.772417+0000', 'last_change': '2024-09-16T07:36:47.772417+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.772417+0000', 'last_undegraded': '2024-09-16T07:36:47.772417+0000', 'last_fullsized': '2024-09-16T07:36:47.772417+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:PG 27.c is not active+clean 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.777566+0000', 'last_change': '2024-09-16T07:36:47.777566+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.777566+0000', 'last_undegraded': '2024-09-16T07:36:47.777566+0000', 'last_fullsized': '2024-09-16T07:36:47.777566+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:PG 27.d is not active+clean 2024-09-16T07:36:53.711 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.775124+0000', 'last_change': '2024-09-16T07:36:47.775124+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.775124+0000', 'last_undegraded': '2024-09-16T07:36:47.775124+0000', 'last_fullsized': '2024-09-16T07:36:47.775124+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:PG 27.a is not active+clean 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.775586+0000', 'last_change': '2024-09-16T07:36:47.775586+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.775586+0000', 'last_undegraded': '2024-09-16T07:36:47.775586+0000', 'last_fullsized': '2024-09-16T07:36:47.775586+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:PG 27.b is not active+clean 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.776593+0000', 'last_change': '2024-09-16T07:36:47.776593+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.776593+0000', 'last_undegraded': '2024-09-16T07:36:47.776593+0000', 'last_fullsized': '2024-09-16T07:36:47.776593+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:PG 27.8 is not active+clean 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.770368+0000', 'last_change': '2024-09-16T07:36:47.770368+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.770368+0000', 'last_undegraded': '2024-09-16T07:36:47.770368+0000', 'last_fullsized': '2024-09-16T07:36:47.770368+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:PG 27.9 is not active+clean 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.767276+0000', 'last_change': '2024-09-16T07:36:47.767276+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.767276+0000', 'last_undegraded': '2024-09-16T07:36:47.767276+0000', 'last_fullsized': '2024-09-16T07:36:47.767276+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:PG 27.6 is not active+clean 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.775269+0000', 'last_change': '2024-09-16T07:36:47.775269+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.775269+0000', 'last_undegraded': '2024-09-16T07:36:47.775269+0000', 'last_fullsized': '2024-09-16T07:36:47.775269+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:36:53.712 INFO:tasks.ceph.ceph_manager.ceph:PG 27.7 is not active+clean 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.781810+0000', 'last_change': '2024-09-16T07:36:47.781810+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.781810+0000', 'last_undegraded': '2024-09-16T07:36:47.781810+0000', 'last_fullsized': '2024-09-16T07:36:47.781810+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:PG 27.4 is not active+clean 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.771033+0000', 'last_change': '2024-09-16T07:36:47.771033+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.771033+0000', 'last_undegraded': '2024-09-16T07:36:47.771033+0000', 'last_fullsized': '2024-09-16T07:36:47.771033+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:PG 27.5 is not active+clean 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.768639+0000', 'last_change': '2024-09-16T07:36:47.768639+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.768639+0000', 'last_undegraded': '2024-09-16T07:36:47.768639+0000', 'last_fullsized': '2024-09-16T07:36:47.768639+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2 is not active+clean 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.780708+0000', 'last_change': '2024-09-16T07:36:47.780708+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.780708+0000', 'last_undegraded': '2024-09-16T07:36:47.780708+0000', 'last_fullsized': '2024-09-16T07:36:47.780708+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3 is not active+clean 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.774222+0000', 'last_change': '2024-09-16T07:36:47.774222+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.774222+0000', 'last_undegraded': '2024-09-16T07:36:47.774222+0000', 'last_fullsized': '2024-09-16T07:36:47.774222+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:PG 27.0 is not active+clean 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.776542+0000', 'last_change': '2024-09-16T07:36:47.776542+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.776542+0000', 'last_undegraded': '2024-09-16T07:36:47.776542+0000', 'last_fullsized': '2024-09-16T07:36:47.776542+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T07:36:53.713 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1 is not active+clean 2024-09-16T07:36:53.714 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.770847+0000', 'last_change': '2024-09-16T07:36:47.770847+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.770847+0000', 'last_undegraded': '2024-09-16T07:36:47.770847+0000', 'last_fullsized': '2024-09-16T07:36:47.770847+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T07:36:53.714 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1a is not active+clean 2024-09-16T07:36:53.714 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-16T07:36:47.781165+0000', 'last_change': '2024-09-16T07:36:47.781165+0000', 'last_active': '2024-09-16T07:36:47.760771+0000', 'last_peered': '2024-09-16T07:36:47.760771+0000', 'last_clean': '2024-09-16T07:36:47.760771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T07:36:47.781165+0000', 'last_undegraded': '2024-09-16T07:36:47.781165+0000', 'last_fullsized': '2024-09-16T07:36:47.781165+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'last_clean_scrub_stamp': '2024-09-16T07:36:47.760771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T07:36:53.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:36:53.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 -- 172.21.15.114:0/4168555989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2760 msgr2=0x7fad900d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 --2- 172.21.15.114:0/4168555989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2760 0x7fad900d0260 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fad900b33d0 tx=0x7fad7801c7c0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 -- 172.21.15.114:0/4168555989 shutdown_connections 2024-09-16T07:36:53.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 --2- 172.21.15.114:0/4168555989 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900b2d00 0x7fad901605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 --2- 172.21.15.114:0/4168555989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2760 0x7fad900d0260 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 -- 172.21.15.114:0/4168555989 >> 172.21.15.114:0/4168555989 conn(0x7fad900d1e40 msgr2=0x7fad900d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:53.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 -- 172.21.15.114:0/4168555989 shutdown_connections 2024-09-16T07:36:53.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 -- 172.21.15.114:0/4168555989 wait complete. 2024-09-16T07:36:53.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 Processor -- start 2024-09-16T07:36:53.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.884+0000 7fad95400640 1 -- start start 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900b2760 0x7fad90151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2d00 0x7fad9015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad900cfe80 0x7fad9015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fad900b0940 con 0x7fad900b2d00 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fad900b07c0 con 0x7fad900cfe80 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fad900b0ac0 con 0x7fad900b2760 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2d00 0x7fad9015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2d00 0x7fad9015ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42860/0 (socket says 172.21.15.114:42860) 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 -- 172.21.15.114:0/271471820 learned_addr learned my addr 172.21.15.114:0/271471820 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad8f200640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad900cfe80 0x7fad9015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad8e800640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900b2760 0x7fad90151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 -- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900b2760 msgr2=0x7fad90151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900b2760 0x7fad90151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 -- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad900cfe80 msgr2=0x7fad9015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad900cfe80 0x7fad9015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 -- 172.21.15.114:0/271471820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9015c970 con 0x7fad900b2d00 2024-09-16T07:36:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad8e800640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900b2760 0x7fad90151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad85e00640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2d00 0x7fad9015ac70 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fad7801cca0 tx=0x7fad780a6510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad87400640 1 -- 172.21.15.114:0/271471820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad780ac070 con 0x7fad900b2d00 2024-09-16T07:36:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad87400640 1 -- 172.21.15.114:0/271471820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad78004340 con 0x7fad900b2d00 2024-09-16T07:36:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad87400640 1 -- 172.21.15.114:0/271471820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78005320 con 0x7fad900b2d00 2024-09-16T07:36:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad900b7280 con 0x7fad900b2d00 2024-09-16T07:36:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad900b7840 con 0x7fad900b2d00 2024-09-16T07:36:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad900d0260 con 0x7fad900b2d00 2024-09-16T07:36:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.888+0000 7fad87400640 1 -- 172.21.15.114:0/271471820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fad780af070 con 0x7fad900b2d00 2024-09-16T07:36:53.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.892+0000 7fad87400640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fad6c073910 0x7fad6c075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:53.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.892+0000 7fad87400640 1 -- 172.21.15.114:0/271471820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fad7812c860 con 0x7fad900b2d00 2024-09-16T07:36:53.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.892+0000 7fad8e800640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fad6c073910 0x7fad6c075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:53.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.892+0000 7fad8e800640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fad6c073910 0x7fad6c075dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad800016b0 tx=0x7fad80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:53.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:53.896+0000 7fad87400640 1 -- 172.21.15.114:0/271471820 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fad780164d0 con 0x7fad900b2d00 2024-09-16T07:36:54.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.120+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fad9015a3f0 con 0x7fad900b2d00 2024-09-16T07:36:54.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad87400640 1 -- 172.21.15.114:0/271471820 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1500 (secure 0 0 0) 0x7fad780f8e30 con 0x7fad900b2d00 2024-09-16T07:36:54.121 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:54.121 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":538,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":165,"num_osds":8,"num_up_osds":8,"osd_up_since":1726471689,"num_in_osds":8,"osd_in_since":1726471679,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":273088512,"bytes_avail":772821024768,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":123,"btime":"2024-09-16T07:36:51:820962+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"c","status":"up:active","gid":9171}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-16T07:36:00.416595+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T07:36:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fad6c073910 msgr2=0x7fad6c075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fad6c073910 0x7fad6c075dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad800016b0 tx=0x7fad80009040 comp rx=0 tx=0).stop 2024-09-16T07:36:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2d00 msgr2=0x7fad9015ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:54.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2d00 0x7fad9015ac70 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fad7801cca0 tx=0x7fad780a6510 comp rx=0 tx=0).stop 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 shutdown_connections 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fad900cfe80 0x7fad9015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900b2d00 0x7fad9015ac70 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fad6c073910 0x7fad6c075dd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 --2- 172.21.15.114:0/271471820 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fad900b2760 0x7fad90151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 >> 172.21.15.114:0/271471820 conn(0x7fad900d1e40 msgr2=0x7fad90159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 shutdown_connections 2024-09-16T07:36:54.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.124+0000 7fad95400640 1 -- 172.21.15.114:0/271471820 wait complete. 2024-09-16T07:36:54.142 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:36:54.142 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:36:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 -- 172.21.15.114:0/4235283056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc15f4f0 msgr2=0x7f0afc074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 --2- 172.21.15.114:0/4235283056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc15f4f0 0x7f0afc074340 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f0afc072ee0 tx=0x7f0ae801c8c0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 -- 172.21.15.114:0/4235283056 shutdown_connections 2024-09-16T07:36:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 --2- 172.21.15.114:0/4235283056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc15f4f0 0x7f0afc074340 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 --2- 172.21.15.114:0/4235283056 >> v2:172.21.15.149:3300/0 conn(0x7f0afc0af240 0x7f0afc074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 --2- 172.21.15.114:0/4235283056 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0afc15f110 0x7f0afc0af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 -- 172.21.15.114:0/4235283056 >> 172.21.15.114:0/4235283056 conn(0x7f0afc073490 msgr2=0x7f0afc0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 -- 172.21.15.114:0/4235283056 shutdown_connections 2024-09-16T07:36:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 -- 172.21.15.114:0/4235283056 wait complete. 2024-09-16T07:36:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 Processor -- start 2024-09-16T07:36:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.284+0000 7f0b02600640 1 -- start start 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc0af240 0x7f0afc1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0afc15f110 0x7f0afc154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc15f4f0 0x7f0afc0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc0caec0 con 0x7f0afc0af240 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc0cad40 con 0x7f0afc15f4f0 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f0afc0cb040 con 0x7f0afc15f110 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc0af240 0x7f0afc1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc0af240 0x7f0afc1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55518/0 (socket says 172.21.15.114:55518) 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 -- 172.21.15.114:0/3314104091 learned_addr learned my addr 172.21.15.114:0/3314104091 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0afbe00640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0afc15f110 0x7f0afc154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01c00640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc15f4f0 0x7f0afc0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 -- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0afc15f110 msgr2=0x7f0afc154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0afc15f110 0x7f0afc154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 -- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc15f4f0 msgr2=0x7f0afc0b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc15f4f0 0x7f0afc0b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 -- 172.21.15.114:0/3314104091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc0b3d50 con 0x7f0afc0af240 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01c00640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc15f4f0 0x7f0afc0b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b01200640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc0af240 0x7f0afc1552e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f0af000e940 tx=0x7f0af000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0af8c00640 1 -- 172.21.15.114:0/3314104091 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000cd80 con 0x7f0afc0af240 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0af8c00640 1 -- 172.21.15.114:0/3314104091 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0af0005020 con 0x7f0afc0af240 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0af8c00640 1 -- 172.21.15.114:0/3314104091 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0005450 con 0x7f0afc0af240 2024-09-16T07:36:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc0b4030 con 0x7f0afc0af240 2024-09-16T07:36:54.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0afc0c2060 con 0x7f0afc0af240 2024-09-16T07:36:54.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.288+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0afc0af770 con 0x7f0afc0af240 2024-09-16T07:36:54.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.292+0000 7f0af8c00640 1 -- 172.21.15.114:0/3314104091 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f0af00047b0 con 0x7f0afc0af240 2024-09-16T07:36:54.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.292+0000 7f0af8c00640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0adc0738e0 0x7f0adc075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:54.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.292+0000 7f0af8c00640 1 -- 172.21.15.114:0/3314104091 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f0af00933d0 con 0x7f0afc0af240 2024-09-16T07:36:54.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.292+0000 7f0afbe00640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0adc0738e0 0x7f0adc075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:54.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.292+0000 7f0afbe00640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0adc0738e0 0x7f0adc075da0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80af000 tx=0x7f0ae80a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:54.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.296+0000 7f0af8c00640 1 -- 172.21.15.114:0/3314104091 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f0af0099030 con 0x7f0afc0af240 2024-09-16T07:36:54.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.460+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0afc15b960 con 0x7f0adc0738e0 2024-09-16T07:36:54.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.464+0000 7f0af8c00640 1 -- 172.21.15.114:0/3314104091 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252483 (secure 0 0 0) 0x7f0afc15b960 con 0x7f0adc0738e0 2024-09-16T07:36:54.465 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:54.467 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:36:54.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0adc0738e0 msgr2=0x7f0adc075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0adc0738e0 0x7f0adc075da0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80af000 tx=0x7f0ae80a7040 comp rx=0 tx=0).stop 2024-09-16T07:36:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc0af240 msgr2=0x7f0afc1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc0af240 0x7f0afc1552e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f0af000e940 tx=0x7f0af000ee00 comp rx=0 tx=0).stop 2024-09-16T07:36:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 shutdown_connections 2024-09-16T07:36:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0afc15f4f0 0x7f0afc0b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f0adc0738e0 0x7f0adc075da0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f0afc15f110 0x7f0afc154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 --2- 172.21.15.114:0/3314104091 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0afc0af240 0x7f0afc1552e0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:54.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 >> 172.21.15.114:0/3314104091 conn(0x7f0afc073490 msgr2=0x7f0afc0c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:54.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 shutdown_connections 2024-09-16T07:36:54.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:54.468+0000 7f0b02600640 1 -- 172.21.15.114:0/3314104091 wait complete. 2024-09-16T07:36:54.485 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-16T07:36:54.427409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266984,"kb_used_data":17448,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707736,"statfs":{"total":773094113280,"available":772820721664,"internally_reserved":0,"allocated":17866752,"data_stored":8509220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.660252"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801473+0000","last_change":"2024-09-16T07:36:48.829421+0000","last_active":"2024-09-16T07:36:49.801473+0000","last_peered":"2024-09-16T07:36:49.801473+0000","last_clean":"2024-09-16T07:36:49.801473+0000","last_became_active":"2024-09-16T07:36:48.823453+0000","last_became_peered":"2024-09-16T07:36:48.823453+0000","last_unstale":"2024-09-16T07:36:49.801473+0000","last_undegraded":"2024-09-16T07:36:49.801473+0000","last_fullsized":"2024-09-16T07:36:49.801473+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:34:41.005144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193671+0000","last_change":"2024-09-16T07:36:48.799466+0000","last_active":"2024-09-16T07:36:50.193671+0000","last_peered":"2024-09-16T07:36:50.193671+0000","last_clean":"2024-09-16T07:36:50.193671+0000","last_became_active":"2024-09-16T07:36:48.799129+0000","last_became_peered":"2024-09-16T07:36:48.799129+0000","last_unstale":"2024-09-16T07:36:50.193671+0000","last_undegraded":"2024-09-16T07:36:50.193671+0000","last_fullsized":"2024-09-16T07:36:50.193671+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:53:51.545171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198658+0000","last_change":"2024-09-16T07:36:48.795116+0000","last_active":"2024-09-16T07:36:50.198658+0000","last_peered":"2024-09-16T07:36:50.198658+0000","last_clean":"2024-09-16T07:36:50.198658+0000","last_became_active":"2024-09-16T07:36:48.794817+0000","last_became_peered":"2024-09-16T07:36:48.794817+0000","last_unstale":"2024-09-16T07:36:50.198658+0000","last_undegraded":"2024-09-16T07:36:50.198658+0000","last_fullsized":"2024-09-16T07:36:50.198658+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:53.647093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811174+0000","last_change":"2024-09-16T07:36:48.802086+0000","last_active":"2024-09-16T07:36:49.811174+0000","last_peered":"2024-09-16T07:36:49.811174+0000","last_clean":"2024-09-16T07:36:49.811174+0000","last_became_active":"2024-09-16T07:36:48.801810+0000","last_became_peered":"2024-09-16T07:36:48.801810+0000","last_unstale":"2024-09-16T07:36:49.811174+0000","last_undegraded":"2024-09-16T07:36:49.811174+0000","last_fullsized":"2024-09-16T07:36:49.811174+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:37:09.666461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198799+0000","last_change":"2024-09-16T07:36:48.810226+0000","last_active":"2024-09-16T07:36:50.198799+0000","last_peered":"2024-09-16T07:36:50.198799+0000","last_clean":"2024-09-16T07:36:50.198799+0000","last_became_active":"2024-09-16T07:36:48.805804+0000","last_became_peered":"2024-09-16T07:36:48.805804+0000","last_unstale":"2024-09-16T07:36:50.198799+0000","last_undegraded":"2024-09-16T07:36:50.198799+0000","last_fullsized":"2024-09-16T07:36:50.198799+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:28.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198209+0000","last_change":"2024-09-16T07:36:48.808429+0000","last_active":"2024-09-16T07:36:50.198209+0000","last_peered":"2024-09-16T07:36:50.198209+0000","last_clean":"2024-09-16T07:36:50.198209+0000","last_became_active":"2024-09-16T07:36:48.800319+0000","last_became_peered":"2024-09-16T07:36:48.800319+0000","last_unstale":"2024-09-16T07:36:50.198209+0000","last_undegraded":"2024-09-16T07:36:50.198209+0000","last_fullsized":"2024-09-16T07:36:50.198209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:11.055324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800765+0000","last_change":"2024-09-16T07:36:48.816371+0000","last_active":"2024-09-16T07:36:49.800765+0000","last_peered":"2024-09-16T07:36:49.800765+0000","last_clean":"2024-09-16T07:36:49.800765+0000","last_became_active":"2024-09-16T07:36:48.815839+0000","last_became_peered":"2024-09-16T07:36:48.815839+0000","last_unstale":"2024-09-16T07:36:49.800765+0000","last_undegraded":"2024-09-16T07:36:49.800765+0000","last_fullsized":"2024-09-16T07:36:49.800765+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:20.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197515+0000","last_change":"2024-09-16T07:36:48.816468+0000","last_active":"2024-09-16T07:36:50.197515+0000","last_peered":"2024-09-16T07:36:50.197515+0000","last_clean":"2024-09-16T07:36:50.197515+0000","last_became_active":"2024-09-16T07:36:48.816044+0000","last_became_peered":"2024-09-16T07:36:48.816044+0000","last_unstale":"2024-09-16T07:36:50.197515+0000","last_undegraded":"2024-09-16T07:36:50.197515+0000","last_fullsized":"2024-09-16T07:36:50.197515+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:54.245374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193926+0000","last_change":"2024-09-16T07:36:48.792483+0000","last_active":"2024-09-16T07:36:50.193926+0000","last_peered":"2024-09-16T07:36:50.193926+0000","last_clean":"2024-09-16T07:36:50.193926+0000","last_became_active":"2024-09-16T07:36:48.792121+0000","last_became_peered":"2024-09-16T07:36:48.792121+0000","last_unstale":"2024-09-16T07:36:50.193926+0000","last_undegraded":"2024-09-16T07:36:50.193926+0000","last_fullsized":"2024-09-16T07:36:50.193926+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:35.975989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198553+0000","last_change":"2024-09-16T07:36:48.830868+0000","last_active":"2024-09-16T07:36:50.198553+0000","last_peered":"2024-09-16T07:36:50.198553+0000","last_clean":"2024-09-16T07:36:50.198553+0000","last_became_active":"2024-09-16T07:36:48.830609+0000","last_became_peered":"2024-09-16T07:36:48.830609+0000","last_unstale":"2024-09-16T07:36:50.198553+0000","last_undegraded":"2024-09-16T07:36:50.198553+0000","last_fullsized":"2024-09-16T07:36:50.198553+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:45.723877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198851+0000","last_change":"2024-09-16T07:36:48.806213+0000","last_active":"2024-09-16T07:36:50.198851+0000","last_peered":"2024-09-16T07:36:50.198851+0000","last_clean":"2024-09-16T07:36:50.198851+0000","last_became_active":"2024-09-16T07:36:48.804706+0000","last_became_peered":"2024-09-16T07:36:48.804706+0000","last_unstale":"2024-09-16T07:36:50.198851+0000","last_undegraded":"2024-09-16T07:36:50.198851+0000","last_fullsized":"2024-09-16T07:36:50.198851+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:35:54.026060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796794+0000","last_change":"2024-09-16T07:36:48.805753+0000","last_active":"2024-09-16T07:36:49.796794+0000","last_peered":"2024-09-16T07:36:49.796794+0000","last_clean":"2024-09-16T07:36:49.796794+0000","last_became_active":"2024-09-16T07:36:48.805468+0000","last_became_peered":"2024-09-16T07:36:48.805468+0000","last_unstale":"2024-09-16T07:36:49.796794+0000","last_undegraded":"2024-09-16T07:36:49.796794+0000","last_fullsized":"2024-09-16T07:36:49.796794+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:31.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796980+0000","last_change":"2024-09-16T07:36:48.803791+0000","last_active":"2024-09-16T07:36:49.796980+0000","last_peered":"2024-09-16T07:36:49.796980+0000","last_clean":"2024-09-16T07:36:49.796980+0000","last_became_active":"2024-09-16T07:36:48.803538+0000","last_became_peered":"2024-09-16T07:36:48.803538+0000","last_unstale":"2024-09-16T07:36:49.796980+0000","last_undegraded":"2024-09-16T07:36:49.796980+0000","last_fullsized":"2024-09-16T07:36:49.796980+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:44.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800896+0000","last_change":"2024-09-16T07:36:48.814148+0000","last_active":"2024-09-16T07:36:49.800896+0000","last_peered":"2024-09-16T07:36:49.800896+0000","last_clean":"2024-09-16T07:36:49.800896+0000","last_became_active":"2024-09-16T07:36:48.813898+0000","last_became_peered":"2024-09-16T07:36:48.813898+0000","last_unstale":"2024-09-16T07:36:49.800896+0000","last_undegraded":"2024-09-16T07:36:49.800896+0000","last_fullsized":"2024-09-16T07:36:49.800896+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:43.606926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800875+0000","last_change":"2024-09-16T07:36:48.830997+0000","last_active":"2024-09-16T07:36:49.800875+0000","last_peered":"2024-09-16T07:36:49.800875+0000","last_clean":"2024-09-16T07:36:49.800875+0000","last_became_active":"2024-09-16T07:36:48.830731+0000","last_became_peered":"2024-09-16T07:36:48.830731+0000","last_unstale":"2024-09-16T07:36:49.800875+0000","last_undegraded":"2024-09-16T07:36:49.800875+0000","last_fullsized":"2024-09-16T07:36:49.800875+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:32.479838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198088+0000","last_change":"2024-09-16T07:36:48.801968+0000","last_active":"2024-09-16T07:36:50.198088+0000","last_peered":"2024-09-16T07:36:50.198088+0000","last_clean":"2024-09-16T07:36:50.198088+0000","last_became_active":"2024-09-16T07:36:48.801693+0000","last_became_peered":"2024-09-16T07:36:48.801693+0000","last_unstale":"2024-09-16T07:36:50.198088+0000","last_undegraded":"2024-09-16T07:36:50.198088+0000","last_fullsized":"2024-09-16T07:36:50.198088+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:03.857575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801511+0000","last_change":"2024-09-16T07:36:48.823886+0000","last_active":"2024-09-16T07:36:49.801511+0000","last_peered":"2024-09-16T07:36:49.801511+0000","last_clean":"2024-09-16T07:36:49.801511+0000","last_became_active":"2024-09-16T07:36:48.823161+0000","last_became_peered":"2024-09-16T07:36:48.823161+0000","last_unstale":"2024-09-16T07:36:49.801511+0000","last_undegraded":"2024-09-16T07:36:49.801511+0000","last_fullsized":"2024-09-16T07:36:49.801511+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:38:57.570406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198631+0000","last_change":"2024-09-16T07:36:48.806728+0000","last_active":"2024-09-16T07:36:50.198631+0000","last_peered":"2024-09-16T07:36:50.198631+0000","last_clean":"2024-09-16T07:36:50.198631+0000","last_became_active":"2024-09-16T07:36:48.806466+0000","last_became_peered":"2024-09-16T07:36:48.806466+0000","last_unstale":"2024-09-16T07:36:50.198631+0000","last_undegraded":"2024-09-16T07:36:50.198631+0000","last_fullsized":"2024-09-16T07:36:50.198631+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:32.695515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198780+0000","last_change":"2024-09-16T07:36:48.830946+0000","last_active":"2024-09-16T07:36:50.198780+0000","last_peered":"2024-09-16T07:36:50.198780+0000","last_clean":"2024-09-16T07:36:50.198780+0000","last_became_active":"2024-09-16T07:36:48.830679+0000","last_became_peered":"2024-09-16T07:36:48.830679+0000","last_unstale":"2024-09-16T07:36:50.198780+0000","last_undegraded":"2024-09-16T07:36:50.198780+0000","last_fullsized":"2024-09-16T07:36:50.198780+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:20.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197797+0000","last_change":"2024-09-16T07:36:48.797640+0000","last_active":"2024-09-16T07:36:50.197797+0000","last_peered":"2024-09-16T07:36:50.197797+0000","last_clean":"2024-09-16T07:36:50.197797+0000","last_became_active":"2024-09-16T07:36:48.797333+0000","last_became_peered":"2024-09-16T07:36:48.797333+0000","last_unstale":"2024-09-16T07:36:50.197797+0000","last_undegraded":"2024-09-16T07:36:50.197797+0000","last_fullsized":"2024-09-16T07:36:50.197797+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:52.977604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811668+0000","last_change":"2024-09-16T07:36:48.805376+0000","last_active":"2024-09-16T07:36:49.811668+0000","last_peered":"2024-09-16T07:36:49.811668+0000","last_clean":"2024-09-16T07:36:49.811668+0000","last_became_active":"2024-09-16T07:36:48.804929+0000","last_became_peered":"2024-09-16T07:36:48.804929+0000","last_unstale":"2024-09-16T07:36:49.811668+0000","last_undegraded":"2024-09-16T07:36:49.811668+0000","last_fullsized":"2024-09-16T07:36:49.811668+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:16.522413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797536+0000","last_change":"2024-09-16T07:36:48.804430+0000","last_active":"2024-09-16T07:36:49.797536+0000","last_peered":"2024-09-16T07:36:49.797536+0000","last_clean":"2024-09-16T07:36:49.797536+0000","last_became_active":"2024-09-16T07:36:48.804037+0000","last_became_peered":"2024-09-16T07:36:48.804037+0000","last_unstale":"2024-09-16T07:36:49.797536+0000","last_undegraded":"2024-09-16T07:36:49.797536+0000","last_fullsized":"2024-09-16T07:36:49.797536+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:31.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797664+0000","last_change":"2024-09-16T07:36:48.818563+0000","last_active":"2024-09-16T07:36:49.797664+0000","last_peered":"2024-09-16T07:36:49.797664+0000","last_clean":"2024-09-16T07:36:49.797664+0000","last_became_active":"2024-09-16T07:36:48.818151+0000","last_became_peered":"2024-09-16T07:36:48.818151+0000","last_unstale":"2024-09-16T07:36:49.797664+0000","last_undegraded":"2024-09-16T07:36:49.797664+0000","last_fullsized":"2024-09-16T07:36:49.797664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:23:01.412879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811101+0000","last_change":"2024-09-16T07:36:48.798481+0000","last_active":"2024-09-16T07:36:49.811101+0000","last_peered":"2024-09-16T07:36:49.811101+0000","last_clean":"2024-09-16T07:36:49.811101+0000","last_became_active":"2024-09-16T07:36:48.798196+0000","last_became_peered":"2024-09-16T07:36:48.798196+0000","last_unstale":"2024-09-16T07:36:49.811101+0000","last_undegraded":"2024-09-16T07:36:49.811101+0000","last_fullsized":"2024-09-16T07:36:49.811101+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:59.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193690+0000","last_change":"2024-09-16T07:36:48.795845+0000","last_active":"2024-09-16T07:36:50.193690+0000","last_peered":"2024-09-16T07:36:50.193690+0000","last_clean":"2024-09-16T07:36:50.193690+0000","last_became_active":"2024-09-16T07:36:48.795538+0000","last_became_peered":"2024-09-16T07:36:48.795538+0000","last_unstale":"2024-09-16T07:36:50.193690+0000","last_undegraded":"2024-09-16T07:36:50.193690+0000","last_fullsized":"2024-09-16T07:36:50.193690+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:27.188831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801399+0000","last_change":"2024-09-16T07:36:48.823468+0000","last_active":"2024-09-16T07:36:49.801399+0000","last_peered":"2024-09-16T07:36:49.801399+0000","last_clean":"2024-09-16T07:36:49.801399+0000","last_became_active":"2024-09-16T07:36:48.823018+0000","last_became_peered":"2024-09-16T07:36:48.823018+0000","last_unstale":"2024-09-16T07:36:49.801399+0000","last_undegraded":"2024-09-16T07:36:49.801399+0000","last_fullsized":"2024-09-16T07:36:49.801399+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:03:18.260095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796683+0000","last_change":"2024-09-16T07:36:48.805965+0000","last_active":"2024-09-16T07:36:49.796683+0000","last_peered":"2024-09-16T07:36:49.796683+0000","last_clean":"2024-09-16T07:36:49.796683+0000","last_became_active":"2024-09-16T07:36:48.805641+0000","last_became_peered":"2024-09-16T07:36:48.805641+0000","last_unstale":"2024-09-16T07:36:49.796683+0000","last_undegraded":"2024-09-16T07:36:49.796683+0000","last_fullsized":"2024-09-16T07:36:49.796683+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:55.626935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198042+0000","last_change":"2024-09-16T07:36:48.799389+0000","last_active":"2024-09-16T07:36:50.198042+0000","last_peered":"2024-09-16T07:36:50.198042+0000","last_clean":"2024-09-16T07:36:50.198042+0000","last_became_active":"2024-09-16T07:36:48.798781+0000","last_became_peered":"2024-09-16T07:36:48.798781+0000","last_unstale":"2024-09-16T07:36:50.198042+0000","last_undegraded":"2024-09-16T07:36:50.198042+0000","last_fullsized":"2024-09-16T07:36:50.198042+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:54:21.547085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796601+0000","last_change":"2024-09-16T07:36:48.815812+0000","last_active":"2024-09-16T07:36:49.796601+0000","last_peered":"2024-09-16T07:36:49.796601+0000","last_clean":"2024-09-16T07:36:49.796601+0000","last_became_active":"2024-09-16T07:36:48.814362+0000","last_became_peered":"2024-09-16T07:36:48.814362+0000","last_unstale":"2024-09-16T07:36:49.796601+0000","last_undegraded":"2024-09-16T07:36:49.796601+0000","last_fullsized":"2024-09-16T07:36:49.796601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:14.995215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193596+0000","last_change":"2024-09-16T07:36:48.813891+0000","last_active":"2024-09-16T07:36:50.193596+0000","last_peered":"2024-09-16T07:36:50.193596+0000","last_clean":"2024-09-16T07:36:50.193596+0000","last_became_active":"2024-09-16T07:36:48.813654+0000","last_became_peered":"2024-09-16T07:36:48.813654+0000","last_unstale":"2024-09-16T07:36:50.193596+0000","last_undegraded":"2024-09-16T07:36:50.193596+0000","last_fullsized":"2024-09-16T07:36:50.193596+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:25:19.404817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198117+0000","last_change":"2024-09-16T07:36:48.796020+0000","last_active":"2024-09-16T07:36:50.198117+0000","last_peered":"2024-09-16T07:36:50.198117+0000","last_clean":"2024-09-16T07:36:50.198117+0000","last_became_active":"2024-09-16T07:36:48.795587+0000","last_became_peered":"2024-09-16T07:36:48.795587+0000","last_unstale":"2024-09-16T07:36:50.198117+0000","last_undegraded":"2024-09-16T07:36:50.198117+0000","last_fullsized":"2024-09-16T07:36:50.198117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:29:18.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800726+0000","last_change":"2024-09-16T07:36:48.828133+0000","last_active":"2024-09-16T07:36:49.800726+0000","last_peered":"2024-09-16T07:36:49.800726+0000","last_clean":"2024-09-16T07:36:49.800726+0000","last_became_active":"2024-09-16T07:36:48.822019+0000","last_became_peered":"2024-09-16T07:36:48.822019+0000","last_unstale":"2024-09-16T07:36:49.800726+0000","last_undegraded":"2024-09-16T07:36:49.800726+0000","last_fullsized":"2024-09-16T07:36:49.800726+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:32.695515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193599+0000","last_change":"2024-09-16T07:36:48.798015+0000","last_active":"2024-09-16T07:36:50.193599+0000","last_peered":"2024-09-16T07:36:50.193599+0000","last_clean":"2024-09-16T07:36:50.193599+0000","last_became_active":"2024-09-16T07:36:48.797385+0000","last_became_peered":"2024-09-16T07:36:48.797385+0000","last_unstale":"2024-09-16T07:36:50.193599+0000","last_undegraded":"2024-09-16T07:36:50.193599+0000","last_fullsized":"2024-09-16T07:36:50.193599+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:57.635997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"164'4","reported_seq":19,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797081+0000","last_change":"2024-09-16T07:36:47.783864+0000","last_active":"2024-09-16T07:36:49.797081+0000","last_peered":"2024-09-16T07:36:49.797081+0000","last_clean":"2024-09-16T07:36:49.797081+0000","last_became_active":"2024-09-16T07:36:47.783569+0000","last_became_peered":"2024-09-16T07:36:47.783569+0000","last_unstale":"2024-09-16T07:36:49.797081+0000","last_undegraded":"2024-09-16T07:36:49.797081+0000","last_fullsized":"2024-09-16T07:36:49.797081+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:24:05.734638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797934+0000","last_change":"2024-09-16T07:36:48.801887+0000","last_active":"2024-09-16T07:36:49.797934+0000","last_peered":"2024-09-16T07:36:49.797934+0000","last_clean":"2024-09-16T07:36:49.797934+0000","last_became_active":"2024-09-16T07:36:48.801478+0000","last_became_peered":"2024-09-16T07:36:48.801478+0000","last_unstale":"2024-09-16T07:36:49.797934+0000","last_undegraded":"2024-09-16T07:36:49.797934+0000","last_fullsized":"2024-09-16T07:36:49.797934+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:54.245374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193888+0000","last_change":"2024-09-16T07:36:47.785063+0000","last_active":"2024-09-16T07:36:50.193888+0000","last_peered":"2024-09-16T07:36:50.193888+0000","last_clean":"2024-09-16T07:36:50.193888+0000","last_became_active":"2024-09-16T07:36:47.784686+0000","last_became_peered":"2024-09-16T07:36:47.784686+0000","last_unstale":"2024-09-16T07:36:50.193888+0000","last_undegraded":"2024-09-16T07:36:50.193888+0000","last_fullsized":"2024-09-16T07:36:50.193888+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:46.015963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801240+0000","last_change":"2024-09-16T07:36:48.818522+0000","last_active":"2024-09-16T07:36:49.801240+0000","last_peered":"2024-09-16T07:36:49.801240+0000","last_clean":"2024-09-16T07:36:49.801240+0000","last_became_active":"2024-09-16T07:36:48.818260+0000","last_became_peered":"2024-09-16T07:36:48.818260+0000","last_unstale":"2024-09-16T07:36:49.801240+0000","last_undegraded":"2024-09-16T07:36:49.801240+0000","last_fullsized":"2024-09-16T07:36:49.801240+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:54:05.669517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198987+0000","last_change":"2024-09-16T07:36:47.789633+0000","last_active":"2024-09-16T07:36:50.198987+0000","last_peered":"2024-09-16T07:36:50.198987+0000","last_clean":"2024-09-16T07:36:50.198987+0000","last_became_active":"2024-09-16T07:36:47.789328+0000","last_became_peered":"2024-09-16T07:36:47.789328+0000","last_unstale":"2024-09-16T07:36:50.198987+0000","last_undegraded":"2024-09-16T07:36:50.198987+0000","last_fullsized":"2024-09-16T07:36:50.198987+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:23:44.589287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198394+0000","last_change":"2024-09-16T07:36:48.811280+0000","last_active":"2024-09-16T07:36:50.198394+0000","last_peered":"2024-09-16T07:36:50.198394+0000","last_clean":"2024-09-16T07:36:50.198394+0000","last_became_active":"2024-09-16T07:36:48.810730+0000","last_became_peered":"2024-09-16T07:36:48.810730+0000","last_unstale":"2024-09-16T07:36:50.198394+0000","last_undegraded":"2024-09-16T07:36:50.198394+0000","last_fullsized":"2024-09-16T07:36:50.198394+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:34.965007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811721+0000","last_change":"2024-09-16T07:36:47.794481+0000","last_active":"2024-09-16T07:36:49.811721+0000","last_peered":"2024-09-16T07:36:49.811721+0000","last_clean":"2024-09-16T07:36:49.811721+0000","last_became_active":"2024-09-16T07:36:47.794271+0000","last_became_peered":"2024-09-16T07:36:47.794271+0000","last_unstale":"2024-09-16T07:36:49.811721+0000","last_undegraded":"2024-09-16T07:36:49.811721+0000","last_fullsized":"2024-09-16T07:36:49.811721+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:50:23.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811859+0000","last_change":"2024-09-16T07:36:48.802676+0000","last_active":"2024-09-16T07:36:49.811859+0000","last_peered":"2024-09-16T07:36:49.811859+0000","last_clean":"2024-09-16T07:36:49.811859+0000","last_became_active":"2024-09-16T07:36:48.802253+0000","last_became_peered":"2024-09-16T07:36:48.802253+0000","last_unstale":"2024-09-16T07:36:49.811859+0000","last_undegraded":"2024-09-16T07:36:49.811859+0000","last_fullsized":"2024-09-16T07:36:49.811859+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:06.099426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198542+0000","last_change":"2024-09-16T07:36:47.786771+0000","last_active":"2024-09-16T07:36:50.198542+0000","last_peered":"2024-09-16T07:36:50.198542+0000","last_clean":"2024-09-16T07:36:50.198542+0000","last_became_active":"2024-09-16T07:36:47.786344+0000","last_became_peered":"2024-09-16T07:36:47.786344+0000","last_unstale":"2024-09-16T07:36:50.198542+0000","last_undegraded":"2024-09-16T07:36:50.198542+0000","last_fullsized":"2024-09-16T07:36:50.198542+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:59:10.270593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197510+0000","last_change":"2024-09-16T07:36:48.807750+0000","last_active":"2024-09-16T07:36:50.197510+0000","last_peered":"2024-09-16T07:36:50.197510+0000","last_clean":"2024-09-16T07:36:50.197510+0000","last_became_active":"2024-09-16T07:36:48.807430+0000","last_became_peered":"2024-09-16T07:36:48.807430+0000","last_unstale":"2024-09-16T07:36:50.197510+0000","last_undegraded":"2024-09-16T07:36:50.197510+0000","last_fullsized":"2024-09-16T07:36:50.197510+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:50.567384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197407+0000","last_change":"2024-09-16T07:36:47.792142+0000","last_active":"2024-09-16T07:36:50.197407+0000","last_peered":"2024-09-16T07:36:50.197407+0000","last_clean":"2024-09-16T07:36:50.197407+0000","last_became_active":"2024-09-16T07:36:47.791887+0000","last_became_peered":"2024-09-16T07:36:47.791887+0000","last_unstale":"2024-09-16T07:36:50.197407+0000","last_undegraded":"2024-09-16T07:36:50.197407+0000","last_fullsized":"2024-09-16T07:36:50.197407+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:45.485702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811174+0000","last_change":"2024-09-16T07:36:48.798192+0000","last_active":"2024-09-16T07:36:49.811174+0000","last_peered":"2024-09-16T07:36:49.811174+0000","last_clean":"2024-09-16T07:36:49.811174+0000","last_became_active":"2024-09-16T07:36:48.797909+0000","last_became_peered":"2024-09-16T07:36:48.797909+0000","last_unstale":"2024-09-16T07:36:49.811174+0000","last_undegraded":"2024-09-16T07:36:49.811174+0000","last_fullsized":"2024-09-16T07:36:49.811174+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:39.808514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797256+0000","last_change":"2024-09-16T07:36:47.775955+0000","last_active":"2024-09-16T07:36:49.797256+0000","last_peered":"2024-09-16T07:36:49.797256+0000","last_clean":"2024-09-16T07:36:49.797256+0000","last_became_active":"2024-09-16T07:36:47.774675+0000","last_became_peered":"2024-09-16T07:36:47.774675+0000","last_unstale":"2024-09-16T07:36:49.797256+0000","last_undegraded":"2024-09-16T07:36:49.797256+0000","last_fullsized":"2024-09-16T07:36:49.797256+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:57.366206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811389+0000","last_change":"2024-09-16T07:36:48.800317+0000","last_active":"2024-09-16T07:36:49.811389+0000","last_peered":"2024-09-16T07:36:49.811389+0000","last_clean":"2024-09-16T07:36:49.811389+0000","last_became_active":"2024-09-16T07:36:48.799792+0000","last_became_peered":"2024-09-16T07:36:48.799792+0000","last_unstale":"2024-09-16T07:36:49.811389+0000","last_undegraded":"2024-09-16T07:36:49.811389+0000","last_fullsized":"2024-09-16T07:36:49.811389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:25.486448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197829+0000","last_change":"2024-09-16T07:36:47.790849+0000","last_active":"2024-09-16T07:36:50.197829+0000","last_peered":"2024-09-16T07:36:50.197829+0000","last_clean":"2024-09-16T07:36:50.197829+0000","last_became_active":"2024-09-16T07:36:47.790581+0000","last_became_peered":"2024-09-16T07:36:47.790581+0000","last_unstale":"2024-09-16T07:36:50.197829+0000","last_undegraded":"2024-09-16T07:36:50.197829+0000","last_fullsized":"2024-09-16T07:36:50.197829+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:26.181531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198265+0000","last_change":"2024-09-16T07:36:48.808012+0000","last_active":"2024-09-16T07:36:50.198265+0000","last_peered":"2024-09-16T07:36:50.198265+0000","last_clean":"2024-09-16T07:36:50.198265+0000","last_became_active":"2024-09-16T07:36:48.807738+0000","last_became_peered":"2024-09-16T07:36:48.807738+0000","last_unstale":"2024-09-16T07:36:50.198265+0000","last_undegraded":"2024-09-16T07:36:50.198265+0000","last_fullsized":"2024-09-16T07:36:50.198265+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:47:44.617494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.798115+0000","last_change":"2024-09-16T07:36:47.776292+0000","last_active":"2024-09-16T07:36:49.798115+0000","last_peered":"2024-09-16T07:36:49.798115+0000","last_clean":"2024-09-16T07:36:49.798115+0000","last_became_active":"2024-09-16T07:36:47.775815+0000","last_became_peered":"2024-09-16T07:36:47.775815+0000","last_unstale":"2024-09-16T07:36:49.798115+0000","last_undegraded":"2024-09-16T07:36:49.798115+0000","last_fullsized":"2024-09-16T07:36:49.798115+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:09.806024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811440+0000","last_change":"2024-09-16T07:36:48.803044+0000","last_active":"2024-09-16T07:36:49.811440+0000","last_peered":"2024-09-16T07:36:49.811440+0000","last_clean":"2024-09-16T07:36:49.811440+0000","last_became_active":"2024-09-16T07:36:48.802752+0000","last_became_peered":"2024-09-16T07:36:48.802752+0000","last_unstale":"2024-09-16T07:36:49.811440+0000","last_undegraded":"2024-09-16T07:36:49.811440+0000","last_fullsized":"2024-09-16T07:36:49.811440+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:21.367856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"164'3","reported_seq":18,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198783+0000","last_change":"2024-09-16T07:36:47.794548+0000","last_active":"2024-09-16T07:36:50.198783+0000","last_peered":"2024-09-16T07:36:50.198783+0000","last_clean":"2024-09-16T07:36:50.198783+0000","last_became_active":"2024-09-16T07:36:47.793042+0000","last_became_peered":"2024-09-16T07:36:47.793042+0000","last_unstale":"2024-09-16T07:36:50.198783+0000","last_undegraded":"2024-09-16T07:36:50.198783+0000","last_fullsized":"2024-09-16T07:36:50.198783+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:49:23.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801205+0000","last_change":"2024-09-16T07:36:48.828855+0000","last_active":"2024-09-16T07:36:49.801205+0000","last_peered":"2024-09-16T07:36:49.801205+0000","last_clean":"2024-09-16T07:36:49.801205+0000","last_became_active":"2024-09-16T07:36:48.828573+0000","last_became_peered":"2024-09-16T07:36:48.828573+0000","last_unstale":"2024-09-16T07:36:49.801205+0000","last_undegraded":"2024-09-16T07:36:49.801205+0000","last_fullsized":"2024-09-16T07:36:49.801205+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:02.595294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"164'6","reported_seq":21,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811596+0000","last_change":"2024-09-16T07:36:47.789226+0000","last_active":"2024-09-16T07:36:49.811596+0000","last_peered":"2024-09-16T07:36:49.811596+0000","last_clean":"2024-09-16T07:36:49.811596+0000","last_became_active":"2024-09-16T07:36:47.788766+0000","last_became_peered":"2024-09-16T07:36:47.788766+0000","last_unstale":"2024-09-16T07:36:49.811596+0000","last_undegraded":"2024-09-16T07:36:49.811596+0000","last_fullsized":"2024-09-16T07:36:49.811596+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:48.345176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198403+0000","last_change":"2024-09-16T07:36:48.801444+0000","last_active":"2024-09-16T07:36:50.198403+0000","last_peered":"2024-09-16T07:36:50.198403+0000","last_clean":"2024-09-16T07:36:50.198403+0000","last_became_active":"2024-09-16T07:36:48.800004+0000","last_became_peered":"2024-09-16T07:36:48.800004+0000","last_unstale":"2024-09-16T07:36:50.198403+0000","last_undegraded":"2024-09-16T07:36:50.198403+0000","last_fullsized":"2024-09-16T07:36:50.198403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:58:32.913691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797478+0000","last_change":"2024-09-16T07:36:47.781350+0000","last_active":"2024-09-16T07:36:49.797478+0000","last_peered":"2024-09-16T07:36:49.797478+0000","last_clean":"2024-09-16T07:36:49.797478+0000","last_became_active":"2024-09-16T07:36:47.781033+0000","last_became_peered":"2024-09-16T07:36:47.781033+0000","last_unstale":"2024-09-16T07:36:49.797478+0000","last_undegraded":"2024-09-16T07:36:49.797478+0000","last_fullsized":"2024-09-16T07:36:49.797478+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:02:25.050644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198481+0000","last_change":"2024-09-16T07:36:48.795731+0000","last_active":"2024-09-16T07:36:50.198481+0000","last_peered":"2024-09-16T07:36:50.198481+0000","last_clean":"2024-09-16T07:36:50.198481+0000","last_became_active":"2024-09-16T07:36:48.795456+0000","last_became_peered":"2024-09-16T07:36:48.795456+0000","last_unstale":"2024-09-16T07:36:50.198481+0000","last_undegraded":"2024-09-16T07:36:50.198481+0000","last_fullsized":"2024-09-16T07:36:50.198481+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:25:36.244981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797535+0000","last_change":"2024-09-16T07:36:47.781137+0000","last_active":"2024-09-16T07:36:49.797535+0000","last_peered":"2024-09-16T07:36:49.797535+0000","last_clean":"2024-09-16T07:36:49.797535+0000","last_became_active":"2024-09-16T07:36:47.780684+0000","last_became_peered":"2024-09-16T07:36:47.780684+0000","last_unstale":"2024-09-16T07:36:49.797535+0000","last_undegraded":"2024-09-16T07:36:49.797535+0000","last_fullsized":"2024-09-16T07:36:49.797535+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:25:18.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197499+0000","last_change":"2024-09-16T07:36:48.803217+0000","last_active":"2024-09-16T07:36:50.197499+0000","last_peered":"2024-09-16T07:36:50.197499+0000","last_clean":"2024-09-16T07:36:50.197499+0000","last_became_active":"2024-09-16T07:36:48.802870+0000","last_became_peered":"2024-09-16T07:36:48.802870+0000","last_unstale":"2024-09-16T07:36:50.197499+0000","last_undegraded":"2024-09-16T07:36:50.197499+0000","last_fullsized":"2024-09-16T07:36:50.197499+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:11.035878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198253+0000","last_change":"2024-09-16T07:36:47.786759+0000","last_active":"2024-09-16T07:36:50.198253+0000","last_peered":"2024-09-16T07:36:50.198253+0000","last_clean":"2024-09-16T07:36:50.198253+0000","last_became_active":"2024-09-16T07:36:47.786477+0000","last_became_peered":"2024-09-16T07:36:47.786477+0000","last_unstale":"2024-09-16T07:36:50.198253+0000","last_undegraded":"2024-09-16T07:36:50.198253+0000","last_fullsized":"2024-09-16T07:36:50.198253+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:37:08.659162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800979+0000","last_change":"2024-09-16T07:36:48.814820+0000","last_active":"2024-09-16T07:36:49.800979+0000","last_peered":"2024-09-16T07:36:49.800979+0000","last_clean":"2024-09-16T07:36:49.800979+0000","last_became_active":"2024-09-16T07:36:48.814538+0000","last_became_peered":"2024-09-16T07:36:48.814538+0000","last_unstale":"2024-09-16T07:36:49.800979+0000","last_undegraded":"2024-09-16T07:36:49.800979+0000","last_fullsized":"2024-09-16T07:36:49.800979+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:04.254027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"164'8","reported_seq":23,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197863+0000","last_change":"2024-09-16T07:36:47.788463+0000","last_active":"2024-09-16T07:36:50.197863+0000","last_peered":"2024-09-16T07:36:50.197863+0000","last_clean":"2024-09-16T07:36:50.197863+0000","last_became_active":"2024-09-16T07:36:47.788206+0000","last_became_peered":"2024-09-16T07:36:47.788206+0000","last_unstale":"2024-09-16T07:36:50.197863+0000","last_undegraded":"2024-09-16T07:36:50.197863+0000","last_fullsized":"2024-09-16T07:36:50.197863+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:40.672903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193842+0000","last_change":"2024-09-16T07:36:48.797705+0000","last_active":"2024-09-16T07:36:50.193842+0000","last_peered":"2024-09-16T07:36:50.193842+0000","last_clean":"2024-09-16T07:36:50.193842+0000","last_became_active":"2024-09-16T07:36:48.797080+0000","last_became_peered":"2024-09-16T07:36:48.797080+0000","last_unstale":"2024-09-16T07:36:50.193842+0000","last_undegraded":"2024-09-16T07:36:50.193842+0000","last_fullsized":"2024-09-16T07:36:50.193842+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:30.860052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197928+0000","last_change":"2024-09-16T07:36:47.799092+0000","last_active":"2024-09-16T07:36:50.197928+0000","last_peered":"2024-09-16T07:36:50.197928+0000","last_clean":"2024-09-16T07:36:50.197928+0000","last_became_active":"2024-09-16T07:36:47.798679+0000","last_became_peered":"2024-09-16T07:36:47.798679+0000","last_unstale":"2024-09-16T07:36:50.197928+0000","last_undegraded":"2024-09-16T07:36:50.197928+0000","last_fullsized":"2024-09-16T07:36:50.197928+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:53:50.537871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193712+0000","last_change":"2024-09-16T07:36:48.794934+0000","last_active":"2024-09-16T07:36:50.193712+0000","last_peered":"2024-09-16T07:36:50.193712+0000","last_clean":"2024-09-16T07:36:50.193712+0000","last_became_active":"2024-09-16T07:36:48.794665+0000","last_became_peered":"2024-09-16T07:36:48.794665+0000","last_unstale":"2024-09-16T07:36:50.193712+0000","last_undegraded":"2024-09-16T07:36:50.193712+0000","last_fullsized":"2024-09-16T07:36:50.193712+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:59:11.277893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193952+0000","last_change":"2024-09-16T07:36:47.781253+0000","last_active":"2024-09-16T07:36:50.193952+0000","last_peered":"2024-09-16T07:36:50.193952+0000","last_clean":"2024-09-16T07:36:50.193952+0000","last_became_active":"2024-09-16T07:36:47.780968+0000","last_became_peered":"2024-09-16T07:36:47.780968+0000","last_unstale":"2024-09-16T07:36:50.193952+0000","last_undegraded":"2024-09-16T07:36:50.193952+0000","last_fullsized":"2024-09-16T07:36:50.193952+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:22.531416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198164+0000","last_change":"2024-09-16T07:36:48.799670+0000","last_active":"2024-09-16T07:36:50.198164+0000","last_peered":"2024-09-16T07:36:50.198164+0000","last_clean":"2024-09-16T07:36:50.198164+0000","last_became_active":"2024-09-16T07:36:48.799120+0000","last_became_peered":"2024-09-16T07:36:48.799120+0000","last_unstale":"2024-09-16T07:36:50.198164+0000","last_undegraded":"2024-09-16T07:36:50.198164+0000","last_fullsized":"2024-09-16T07:36:50.198164+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:49:11.482977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198892+0000","last_change":"2024-09-16T07:36:47.792016+0000","last_active":"2024-09-16T07:36:50.198892+0000","last_peered":"2024-09-16T07:36:50.198892+0000","last_clean":"2024-09-16T07:36:50.198892+0000","last_became_active":"2024-09-16T07:36:47.791765+0000","last_became_peered":"2024-09-16T07:36:47.791765+0000","last_unstale":"2024-09-16T07:36:50.198892+0000","last_undegraded":"2024-09-16T07:36:50.198892+0000","last_fullsized":"2024-09-16T07:36:50.198892+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:56.232368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198545+0000","last_change":"2024-09-16T07:36:48.801727+0000","last_active":"2024-09-16T07:36:50.198545+0000","last_peered":"2024-09-16T07:36:50.198545+0000","last_clean":"2024-09-16T07:36:50.198545+0000","last_became_active":"2024-09-16T07:36:48.800556+0000","last_became_peered":"2024-09-16T07:36:48.800556+0000","last_unstale":"2024-09-16T07:36:50.198545+0000","last_undegraded":"2024-09-16T07:36:50.198545+0000","last_fullsized":"2024-09-16T07:36:50.198545+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:24.750967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198183+0000","last_change":"2024-09-16T07:36:47.789887+0000","last_active":"2024-09-16T07:36:50.198183+0000","last_peered":"2024-09-16T07:36:50.198183+0000","last_clean":"2024-09-16T07:36:50.198183+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:50.198183+0000","last_undegraded":"2024-09-16T07:36:50.198183+0000","last_fullsized":"2024-09-16T07:36:50.198183+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:27.585444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198908+0000","last_change":"2024-09-16T07:36:48.820154+0000","last_active":"2024-09-16T07:36:50.198908+0000","last_peered":"2024-09-16T07:36:50.198908+0000","last_clean":"2024-09-16T07:36:50.198908+0000","last_became_active":"2024-09-16T07:36:48.819500+0000","last_became_peered":"2024-09-16T07:36:48.819500+0000","last_unstale":"2024-09-16T07:36:50.198908+0000","last_undegraded":"2024-09-16T07:36:50.198908+0000","last_fullsized":"2024-09-16T07:36:50.198908+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:32.479838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198466+0000","last_change":"2024-09-16T07:36:47.788288+0000","last_active":"2024-09-16T07:36:50.198466+0000","last_peered":"2024-09-16T07:36:50.198466+0000","last_clean":"2024-09-16T07:36:50.198466+0000","last_became_active":"2024-09-16T07:36:47.788033+0000","last_became_peered":"2024-09-16T07:36:47.788033+0000","last_unstale":"2024-09-16T07:36:50.198466+0000","last_undegraded":"2024-09-16T07:36:50.198466+0000","last_fullsized":"2024-09-16T07:36:50.198466+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:58.517467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197961+0000","last_change":"2024-09-16T07:36:48.805684+0000","last_active":"2024-09-16T07:36:50.197961+0000","last_peered":"2024-09-16T07:36:50.197961+0000","last_clean":"2024-09-16T07:36:50.197961+0000","last_became_active":"2024-09-16T07:36:48.802161+0000","last_became_peered":"2024-09-16T07:36:48.802161+0000","last_unstale":"2024-09-16T07:36:50.197961+0000","last_undegraded":"2024-09-16T07:36:50.197961+0000","last_fullsized":"2024-09-16T07:36:50.197961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:02:28.733434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801256+0000","last_change":"2024-09-16T07:36:47.788687+0000","last_active":"2024-09-16T07:36:49.801256+0000","last_peered":"2024-09-16T07:36:49.801256+0000","last_clean":"2024-09-16T07:36:49.801256+0000","last_became_active":"2024-09-16T07:36:47.788264+0000","last_became_peered":"2024-09-16T07:36:47.788264+0000","last_unstale":"2024-09-16T07:36:49.801256+0000","last_undegraded":"2024-09-16T07:36:49.801256+0000","last_fullsized":"2024-09-16T07:36:49.801256+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:58.126602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193414+0000","last_change":"2024-09-16T07:36:48.798294+0000","last_active":"2024-09-16T07:36:50.193414+0000","last_peered":"2024-09-16T07:36:50.193414+0000","last_clean":"2024-09-16T07:36:50.193414+0000","last_became_active":"2024-09-16T07:36:48.797786+0000","last_became_peered":"2024-09-16T07:36:48.797786+0000","last_unstale":"2024-09-16T07:36:50.193414+0000","last_undegraded":"2024-09-16T07:36:50.193414+0000","last_fullsized":"2024-09-16T07:36:50.193414+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:10.805150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801047+0000","last_change":"2024-09-16T07:36:47.788394+0000","last_active":"2024-09-16T07:36:49.801047+0000","last_peered":"2024-09-16T07:36:49.801047+0000","last_clean":"2024-09-16T07:36:49.801047+0000","last_became_active":"2024-09-16T07:36:47.788042+0000","last_became_peered":"2024-09-16T07:36:47.788042+0000","last_unstale":"2024-09-16T07:36:49.801047+0000","last_undegraded":"2024-09-16T07:36:49.801047+0000","last_fullsized":"2024-09-16T07:36:49.801047+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:20.360557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797938+0000","last_change":"2024-09-16T07:36:48.801835+0000","last_active":"2024-09-16T07:36:49.797938+0000","last_peered":"2024-09-16T07:36:49.797938+0000","last_clean":"2024-09-16T07:36:49.797938+0000","last_became_active":"2024-09-16T07:36:48.801521+0000","last_became_peered":"2024-09-16T07:36:48.801521+0000","last_unstale":"2024-09-16T07:36:49.797938+0000","last_undegraded":"2024-09-16T07:36:49.797938+0000","last_fullsized":"2024-09-16T07:36:49.797938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:50.567384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197729+0000","last_change":"2024-09-16T07:36:47.795994+0000","last_active":"2024-09-16T07:36:50.197729+0000","last_peered":"2024-09-16T07:36:50.197729+0000","last_clean":"2024-09-16T07:36:50.197729+0000","last_became_active":"2024-09-16T07:36:47.795685+0000","last_became_peered":"2024-09-16T07:36:47.795685+0000","last_unstale":"2024-09-16T07:36:50.197729+0000","last_undegraded":"2024-09-16T07:36:50.197729+0000","last_fullsized":"2024-09-16T07:36:50.197729+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:36.446332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796676+0000","last_change":"2024-09-16T07:36:48.808919+0000","last_active":"2024-09-16T07:36:49.796676+0000","last_peered":"2024-09-16T07:36:49.796676+0000","last_clean":"2024-09-16T07:36:49.796676+0000","last_became_active":"2024-09-16T07:36:48.808738+0000","last_became_peered":"2024-09-16T07:36:48.808738+0000","last_unstale":"2024-09-16T07:36:49.796676+0000","last_undegraded":"2024-09-16T07:36:49.796676+0000","last_fullsized":"2024-09-16T07:36:49.796676+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:35.725875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198400+0000","last_change":"2024-09-16T07:36:47.786354+0000","last_active":"2024-09-16T07:36:50.198400+0000","last_peered":"2024-09-16T07:36:50.198400+0000","last_clean":"2024-09-16T07:36:50.198400+0000","last_became_active":"2024-09-16T07:36:47.786079+0000","last_became_peered":"2024-09-16T07:36:47.786079+0000","last_unstale":"2024-09-16T07:36:50.198400+0000","last_undegraded":"2024-09-16T07:36:50.198400+0000","last_fullsized":"2024-09-16T07:36:50.198400+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:27.025972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801624+0000","last_change":"2024-09-16T07:36:48.829416+0000","last_active":"2024-09-16T07:36:49.801624+0000","last_peered":"2024-09-16T07:36:49.801624+0000","last_clean":"2024-09-16T07:36:49.801624+0000","last_became_active":"2024-09-16T07:36:48.823616+0000","last_became_peered":"2024-09-16T07:36:48.823616+0000","last_unstale":"2024-09-16T07:36:49.801624+0000","last_undegraded":"2024-09-16T07:36:49.801624+0000","last_fullsized":"2024-09-16T07:36:49.801624+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:55.395274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"165'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811487+0000","last_change":"2024-09-16T07:36:47.787281+0000","last_active":"2024-09-16T07:36:49.811487+0000","last_peered":"2024-09-16T07:36:49.811487+0000","last_clean":"2024-09-16T07:36:49.811487+0000","last_became_active":"2024-09-16T07:36:47.786935+0000","last_became_peered":"2024-09-16T07:36:47.786935+0000","last_unstale":"2024-09-16T07:36:49.811487+0000","last_undegraded":"2024-09-16T07:36:49.811487+0000","last_fullsized":"2024-09-16T07:36:49.811487+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:54.958923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193625+0000","last_change":"2024-09-16T07:36:48.808071+0000","last_active":"2024-09-16T07:36:50.193625+0000","last_peered":"2024-09-16T07:36:50.193625+0000","last_clean":"2024-09-16T07:36:50.193625+0000","last_became_active":"2024-09-16T07:36:48.807730+0000","last_became_peered":"2024-09-16T07:36:48.807730+0000","last_unstale":"2024-09-16T07:36:50.193625+0000","last_undegraded":"2024-09-16T07:36:50.193625+0000","last_fullsized":"2024-09-16T07:36:50.193625+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:46.493002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197742+0000","last_change":"2024-09-16T07:36:47.793515+0000","last_active":"2024-09-16T07:36:50.197742+0000","last_peered":"2024-09-16T07:36:50.197742+0000","last_clean":"2024-09-16T07:36:50.197742+0000","last_became_active":"2024-09-16T07:36:47.793043+0000","last_became_peered":"2024-09-16T07:36:47.793043+0000","last_unstale":"2024-09-16T07:36:50.197742+0000","last_undegraded":"2024-09-16T07:36:50.197742+0000","last_fullsized":"2024-09-16T07:36:50.197742+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:56.628698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797904+0000","last_change":"2024-09-16T07:36:48.819828+0000","last_active":"2024-09-16T07:36:49.797904+0000","last_peered":"2024-09-16T07:36:49.797904+0000","last_clean":"2024-09-16T07:36:49.797904+0000","last_became_active":"2024-09-16T07:36:48.819545+0000","last_became_peered":"2024-09-16T07:36:48.819545+0000","last_unstale":"2024-09-16T07:36:49.797904+0000","last_undegraded":"2024-09-16T07:36:49.797904+0000","last_fullsized":"2024-09-16T07:36:49.797904+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:06:35.264228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198273+0000","last_change":"2024-09-16T07:36:47.785322+0000","last_active":"2024-09-16T07:36:50.198273+0000","last_peered":"2024-09-16T07:36:50.198273+0000","last_clean":"2024-09-16T07:36:50.198273+0000","last_became_active":"2024-09-16T07:36:47.785024+0000","last_became_peered":"2024-09-16T07:36:47.785024+0000","last_unstale":"2024-09-16T07:36:50.198273+0000","last_undegraded":"2024-09-16T07:36:50.198273+0000","last_fullsized":"2024-09-16T07:36:50.198273+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:26.702715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801110+0000","last_change":"2024-09-16T07:36:48.819492+0000","last_active":"2024-09-16T07:36:49.801110+0000","last_peered":"2024-09-16T07:36:49.801110+0000","last_clean":"2024-09-16T07:36:49.801110+0000","last_became_active":"2024-09-16T07:36:48.819219+0000","last_became_peered":"2024-09-16T07:36:48.819219+0000","last_unstale":"2024-09-16T07:36:49.801110+0000","last_undegraded":"2024-09-16T07:36:49.801110+0000","last_fullsized":"2024-09-16T07:36:49.801110+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:28.489708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811840+0000","last_change":"2024-09-16T07:36:47.795318+0000","last_active":"2024-09-16T07:36:49.811840+0000","last_peered":"2024-09-16T07:36:49.811840+0000","last_clean":"2024-09-16T07:36:49.811840+0000","last_became_active":"2024-09-16T07:36:47.795051+0000","last_became_peered":"2024-09-16T07:36:47.795051+0000","last_unstale":"2024-09-16T07:36:49.811840+0000","last_undegraded":"2024-09-16T07:36:49.811840+0000","last_fullsized":"2024-09-16T07:36:49.811840+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:19:42.213531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796650+0000","last_change":"2024-09-16T07:36:48.797907+0000","last_active":"2024-09-16T07:36:49.796650+0000","last_peered":"2024-09-16T07:36:49.796650+0000","last_clean":"2024-09-16T07:36:49.796650+0000","last_became_active":"2024-09-16T07:36:48.797632+0000","last_became_peered":"2024-09-16T07:36:48.797632+0000","last_unstale":"2024-09-16T07:36:49.796650+0000","last_undegraded":"2024-09-16T07:36:49.796650+0000","last_fullsized":"2024-09-16T07:36:49.796650+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:11:08.178370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198641+0000","last_change":"2024-09-16T07:36:47.795227+0000","last_active":"2024-09-16T07:36:50.198641+0000","last_peered":"2024-09-16T07:36:50.198641+0000","last_clean":"2024-09-16T07:36:50.198641+0000","last_became_active":"2024-09-16T07:36:47.794955+0000","last_became_peered":"2024-09-16T07:36:47.794955+0000","last_unstale":"2024-09-16T07:36:50.198641+0000","last_undegraded":"2024-09-16T07:36:50.198641+0000","last_fullsized":"2024-09-16T07:36:50.198641+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:29.852752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197713+0000","last_change":"2024-09-16T07:36:48.797821+0000","last_active":"2024-09-16T07:36:50.197713+0000","last_peered":"2024-09-16T07:36:50.197713+0000","last_clean":"2024-09-16T07:36:50.197713+0000","last_became_active":"2024-09-16T07:36:48.797429+0000","last_became_peered":"2024-09-16T07:36:48.797429+0000","last_unstale":"2024-09-16T07:36:50.197713+0000","last_undegraded":"2024-09-16T07:36:50.197713+0000","last_fullsized":"2024-09-16T07:36:50.197713+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:56:41.533080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797914+0000","last_change":"2024-09-16T07:36:47.781443+0000","last_active":"2024-09-16T07:36:49.797914+0000","last_peered":"2024-09-16T07:36:49.797914+0000","last_clean":"2024-09-16T07:36:49.797914+0000","last_became_active":"2024-09-16T07:36:47.781151+0000","last_became_peered":"2024-09-16T07:36:47.781151+0000","last_unstale":"2024-09-16T07:36:49.797914+0000","last_undegraded":"2024-09-16T07:36:49.797914+0000","last_fullsized":"2024-09-16T07:36:49.797914+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:07:00.668387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193489+0000","last_change":"2024-09-16T07:36:48.792468+0000","last_active":"2024-09-16T07:36:50.193489+0000","last_peered":"2024-09-16T07:36:50.193489+0000","last_clean":"2024-09-16T07:36:50.193489+0000","last_became_active":"2024-09-16T07:36:48.792172+0000","last_became_peered":"2024-09-16T07:36:48.792172+0000","last_unstale":"2024-09-16T07:36:50.193489+0000","last_undegraded":"2024-09-16T07:36:50.193489+0000","last_fullsized":"2024-09-16T07:36:50.193489+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:44.889378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796379+0000","last_change":"2024-09-16T07:36:47.782624+0000","last_active":"2024-09-16T07:36:49.796379+0000","last_peered":"2024-09-16T07:36:49.796379+0000","last_clean":"2024-09-16T07:36:49.796379+0000","last_became_active":"2024-09-16T07:36:47.782288+0000","last_became_peered":"2024-09-16T07:36:47.782288+0000","last_unstale":"2024-09-16T07:36:49.796379+0000","last_undegraded":"2024-09-16T07:36:49.796379+0000","last_fullsized":"2024-09-16T07:36:49.796379+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:50:42.775969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801034+0000","last_change":"2024-09-16T07:36:48.829227+0000","last_active":"2024-09-16T07:36:49.801034+0000","last_peered":"2024-09-16T07:36:49.801034+0000","last_clean":"2024-09-16T07:36:49.801034+0000","last_became_active":"2024-09-16T07:36:48.828925+0000","last_became_peered":"2024-09-16T07:36:48.828925+0000","last_unstale":"2024-09-16T07:36:49.801034+0000","last_undegraded":"2024-09-16T07:36:49.801034+0000","last_fullsized":"2024-09-16T07:36:49.801034+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:31.594806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796830+0000","last_change":"2024-09-16T07:36:47.789860+0000","last_active":"2024-09-16T07:36:49.796830+0000","last_peered":"2024-09-16T07:36:49.796830+0000","last_clean":"2024-09-16T07:36:49.796830+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:49.796830+0000","last_undegraded":"2024-09-16T07:36:49.796830+0000","last_fullsized":"2024-09-16T07:36:49.796830+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:17.517901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":403,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811176+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:36:49.811176+0000","last_peered":"2024-09-16T07:36:49.811176+0000","last_clean":"2024-09-16T07:36:49.811176+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:36:49.811176+0000","last_undegraded":"2024-09-16T07:36:49.811176+0000","last_fullsized":"2024-09-16T07:36:49.811176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509548,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2682880,"data_stored":1507438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2080768,"data_stored":916040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509547,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2080768,"data_stored":916040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509547,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":917174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509547,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2088960,"data_stored":915640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542252,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2076672,"data_stored":915458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":915514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509548,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":2674688,"data_stored":1505916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:36:57.494 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:36:57.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 -- 172.21.15.114:0/1163400805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe08004810 msgr2=0x7efe08004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:57.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 --2- 172.21.15.114:0/1163400805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe08004810 0x7efe08004c90 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7efe0c006fc0 tx=0x7efe0c01ceb0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe23400640 1 -- 172.21.15.114:0/1163400805 reap_dead start 2024-09-16T07:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 -- 172.21.15.114:0/1163400805 shutdown_connections 2024-09-16T07:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 -- 172.21.15.114:0/1163400805 >> 172.21.15.114:0/1163400805 conn(0x7efe240d1e30 msgr2=0x7efe240d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 -- 172.21.15.114:0/1163400805 shutdown_connections 2024-09-16T07:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 -- 172.21.15.114:0/1163400805 wait complete. 2024-09-16T07:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 Processor -- start 2024-09-16T07:36:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 -- start start 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.652+0000 7efe29600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe08004810 0x7efe240c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe241f82e0 0x7efe2415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe2415cc50 0x7efe24158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efe241679e0 con 0x7efe2415cc50 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efe24167860 con 0x7efe08004810 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efe24167b60 con 0x7efe241f82e0 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe2415cc50 0x7efe24158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe22a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe08004810 0x7efe240c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe2415cc50 0x7efe24158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55544/0 (socket says 172.21.15.114:55544) 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 -- 172.21.15.114:0/3902856782 learned_addr learned my addr 172.21.15.114:0/3902856782 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe1a000640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe241f82e0 0x7efe2415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 -- 172.21.15.114:0/3902856782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe241f82e0 msgr2=0x7efe2415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe241f82e0 0x7efe2415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 -- 172.21.15.114:0/3902856782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe08004810 msgr2=0x7efe240c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe08004810 0x7efe240c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 -- 172.21.15.114:0/3902856782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe24071f50 con 0x7efe2415cc50 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe23400640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe2415cc50 0x7efe24158670 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7efe240af470 tx=0x7efe1c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe1b400640 1 -- 172.21.15.114:0/3902856782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c003d90 con 0x7efe2415cc50 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe1b400640 1 -- 172.21.15.114:0/3902856782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe1c01a070 con 0x7efe2415cc50 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe1b400640 1 -- 172.21.15.114:0/3902856782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00ec50 con 0x7efe2415cc50 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe241f87e0 con 0x7efe2415cc50 2024-09-16T07:36:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2415af60 con 0x7efe2415cc50 2024-09-16T07:36:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe240b14c0 con 0x7efe2415cc50 2024-09-16T07:36:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.656+0000 7efe1b400640 1 -- 172.21.15.114:0/3902856782 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7efe1c00c070 con 0x7efe2415cc50 2024-09-16T07:36:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.660+0000 7efe1b400640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe00073910 0x7efe00075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.660+0000 7efe1b400640 1 -- 172.21.15.114:0/3902856782 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7efe1c092c10 con 0x7efe2415cc50 2024-09-16T07:36:57.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.660+0000 7efe22a00640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe00073910 0x7efe00075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.660+0000 7efe22a00640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe00073910 0x7efe00075dd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efe24071bd0 tx=0x7efe14006db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.664+0000 7efe1b400640 1 -- 172.21.15.114:0/3902856782 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efe1c05f0a0 con 0x7efe2415cc50 2024-09-16T07:36:57.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.828+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe240cff90 con 0x7efe00073910 2024-09-16T07:36:57.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.832+0000 7efe1b400640 1 -- 172.21.15.114:0/3902856782 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252483 (secure 0 0 0) 0x7efe240cff90 con 0x7efe00073910 2024-09-16T07:36:57.829 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:57.830 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe00073910 msgr2=0x7efe00075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe00073910 0x7efe00075dd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efe24071bd0 tx=0x7efe14006db0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe2415cc50 msgr2=0x7efe24158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe2415cc50 0x7efe24158670 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7efe240af470 tx=0x7efe1c010da0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 shutdown_connections 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe2415cc50 0x7efe24158670 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efe00073910 0x7efe00075dd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efe241f82e0 0x7efe2415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 --2- 172.21.15.114:0/3902856782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efe08004810 0x7efe240c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 >> 172.21.15.114:0/3902856782 conn(0x7efe240d1e30 msgr2=0x7efe240cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 shutdown_connections 2024-09-16T07:36:57.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:57.836+0000 7efe29600640 1 -- 172.21.15.114:0/3902856782 wait complete. 2024-09-16T07:36:57.850 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-16T07:36:56.427977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266984,"kb_used_data":17448,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707736,"statfs":{"total":773094113280,"available":772820721664,"internally_reserved":0,"allocated":17866752,"data_stored":8509220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001793"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801473+0000","last_change":"2024-09-16T07:36:48.829421+0000","last_active":"2024-09-16T07:36:49.801473+0000","last_peered":"2024-09-16T07:36:49.801473+0000","last_clean":"2024-09-16T07:36:49.801473+0000","last_became_active":"2024-09-16T07:36:48.823453+0000","last_became_peered":"2024-09-16T07:36:48.823453+0000","last_unstale":"2024-09-16T07:36:49.801473+0000","last_undegraded":"2024-09-16T07:36:49.801473+0000","last_fullsized":"2024-09-16T07:36:49.801473+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:34:41.005144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193671+0000","last_change":"2024-09-16T07:36:48.799466+0000","last_active":"2024-09-16T07:36:50.193671+0000","last_peered":"2024-09-16T07:36:50.193671+0000","last_clean":"2024-09-16T07:36:50.193671+0000","last_became_active":"2024-09-16T07:36:48.799129+0000","last_became_peered":"2024-09-16T07:36:48.799129+0000","last_unstale":"2024-09-16T07:36:50.193671+0000","last_undegraded":"2024-09-16T07:36:50.193671+0000","last_fullsized":"2024-09-16T07:36:50.193671+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:53:51.545171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198658+0000","last_change":"2024-09-16T07:36:48.795116+0000","last_active":"2024-09-16T07:36:50.198658+0000","last_peered":"2024-09-16T07:36:50.198658+0000","last_clean":"2024-09-16T07:36:50.198658+0000","last_became_active":"2024-09-16T07:36:48.794817+0000","last_became_peered":"2024-09-16T07:36:48.794817+0000","last_unstale":"2024-09-16T07:36:50.198658+0000","last_undegraded":"2024-09-16T07:36:50.198658+0000","last_fullsized":"2024-09-16T07:36:50.198658+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:53.647093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811174+0000","last_change":"2024-09-16T07:36:48.802086+0000","last_active":"2024-09-16T07:36:49.811174+0000","last_peered":"2024-09-16T07:36:49.811174+0000","last_clean":"2024-09-16T07:36:49.811174+0000","last_became_active":"2024-09-16T07:36:48.801810+0000","last_became_peered":"2024-09-16T07:36:48.801810+0000","last_unstale":"2024-09-16T07:36:49.811174+0000","last_undegraded":"2024-09-16T07:36:49.811174+0000","last_fullsized":"2024-09-16T07:36:49.811174+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:37:09.666461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198799+0000","last_change":"2024-09-16T07:36:48.810226+0000","last_active":"2024-09-16T07:36:50.198799+0000","last_peered":"2024-09-16T07:36:50.198799+0000","last_clean":"2024-09-16T07:36:50.198799+0000","last_became_active":"2024-09-16T07:36:48.805804+0000","last_became_peered":"2024-09-16T07:36:48.805804+0000","last_unstale":"2024-09-16T07:36:50.198799+0000","last_undegraded":"2024-09-16T07:36:50.198799+0000","last_fullsized":"2024-09-16T07:36:50.198799+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:28.406029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198209+0000","last_change":"2024-09-16T07:36:48.808429+0000","last_active":"2024-09-16T07:36:50.198209+0000","last_peered":"2024-09-16T07:36:50.198209+0000","last_clean":"2024-09-16T07:36:50.198209+0000","last_became_active":"2024-09-16T07:36:48.800319+0000","last_became_peered":"2024-09-16T07:36:48.800319+0000","last_unstale":"2024-09-16T07:36:50.198209+0000","last_undegraded":"2024-09-16T07:36:50.198209+0000","last_fullsized":"2024-09-16T07:36:50.198209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:11.055324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800765+0000","last_change":"2024-09-16T07:36:48.816371+0000","last_active":"2024-09-16T07:36:49.800765+0000","last_peered":"2024-09-16T07:36:49.800765+0000","last_clean":"2024-09-16T07:36:49.800765+0000","last_became_active":"2024-09-16T07:36:48.815839+0000","last_became_peered":"2024-09-16T07:36:48.815839+0000","last_unstale":"2024-09-16T07:36:49.800765+0000","last_undegraded":"2024-09-16T07:36:49.800765+0000","last_fullsized":"2024-09-16T07:36:49.800765+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:20.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197515+0000","last_change":"2024-09-16T07:36:48.816468+0000","last_active":"2024-09-16T07:36:50.197515+0000","last_peered":"2024-09-16T07:36:50.197515+0000","last_clean":"2024-09-16T07:36:50.197515+0000","last_became_active":"2024-09-16T07:36:48.816044+0000","last_became_peered":"2024-09-16T07:36:48.816044+0000","last_unstale":"2024-09-16T07:36:50.197515+0000","last_undegraded":"2024-09-16T07:36:50.197515+0000","last_fullsized":"2024-09-16T07:36:50.197515+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:54.245374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193926+0000","last_change":"2024-09-16T07:36:48.792483+0000","last_active":"2024-09-16T07:36:50.193926+0000","last_peered":"2024-09-16T07:36:50.193926+0000","last_clean":"2024-09-16T07:36:50.193926+0000","last_became_active":"2024-09-16T07:36:48.792121+0000","last_became_peered":"2024-09-16T07:36:48.792121+0000","last_unstale":"2024-09-16T07:36:50.193926+0000","last_undegraded":"2024-09-16T07:36:50.193926+0000","last_fullsized":"2024-09-16T07:36:50.193926+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:35.975989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198553+0000","last_change":"2024-09-16T07:36:48.830868+0000","last_active":"2024-09-16T07:36:50.198553+0000","last_peered":"2024-09-16T07:36:50.198553+0000","last_clean":"2024-09-16T07:36:50.198553+0000","last_became_active":"2024-09-16T07:36:48.830609+0000","last_became_peered":"2024-09-16T07:36:48.830609+0000","last_unstale":"2024-09-16T07:36:50.198553+0000","last_undegraded":"2024-09-16T07:36:50.198553+0000","last_fullsized":"2024-09-16T07:36:50.198553+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:45.723877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198851+0000","last_change":"2024-09-16T07:36:48.806213+0000","last_active":"2024-09-16T07:36:50.198851+0000","last_peered":"2024-09-16T07:36:50.198851+0000","last_clean":"2024-09-16T07:36:50.198851+0000","last_became_active":"2024-09-16T07:36:48.804706+0000","last_became_peered":"2024-09-16T07:36:48.804706+0000","last_unstale":"2024-09-16T07:36:50.198851+0000","last_undegraded":"2024-09-16T07:36:50.198851+0000","last_fullsized":"2024-09-16T07:36:50.198851+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:35:54.026060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796794+0000","last_change":"2024-09-16T07:36:48.805753+0000","last_active":"2024-09-16T07:36:49.796794+0000","last_peered":"2024-09-16T07:36:49.796794+0000","last_clean":"2024-09-16T07:36:49.796794+0000","last_became_active":"2024-09-16T07:36:48.805468+0000","last_became_peered":"2024-09-16T07:36:48.805468+0000","last_unstale":"2024-09-16T07:36:49.796794+0000","last_undegraded":"2024-09-16T07:36:49.796794+0000","last_fullsized":"2024-09-16T07:36:49.796794+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:31.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796980+0000","last_change":"2024-09-16T07:36:48.803791+0000","last_active":"2024-09-16T07:36:49.796980+0000","last_peered":"2024-09-16T07:36:49.796980+0000","last_clean":"2024-09-16T07:36:49.796980+0000","last_became_active":"2024-09-16T07:36:48.803538+0000","last_became_peered":"2024-09-16T07:36:48.803538+0000","last_unstale":"2024-09-16T07:36:49.796980+0000","last_undegraded":"2024-09-16T07:36:49.796980+0000","last_fullsized":"2024-09-16T07:36:49.796980+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:44.863483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800896+0000","last_change":"2024-09-16T07:36:48.814148+0000","last_active":"2024-09-16T07:36:49.800896+0000","last_peered":"2024-09-16T07:36:49.800896+0000","last_clean":"2024-09-16T07:36:49.800896+0000","last_became_active":"2024-09-16T07:36:48.813898+0000","last_became_peered":"2024-09-16T07:36:48.813898+0000","last_unstale":"2024-09-16T07:36:49.800896+0000","last_undegraded":"2024-09-16T07:36:49.800896+0000","last_fullsized":"2024-09-16T07:36:49.800896+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:43.606926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800875+0000","last_change":"2024-09-16T07:36:48.830997+0000","last_active":"2024-09-16T07:36:49.800875+0000","last_peered":"2024-09-16T07:36:49.800875+0000","last_clean":"2024-09-16T07:36:49.800875+0000","last_became_active":"2024-09-16T07:36:48.830731+0000","last_became_peered":"2024-09-16T07:36:48.830731+0000","last_unstale":"2024-09-16T07:36:49.800875+0000","last_undegraded":"2024-09-16T07:36:49.800875+0000","last_fullsized":"2024-09-16T07:36:49.800875+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:32.479838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198088+0000","last_change":"2024-09-16T07:36:48.801968+0000","last_active":"2024-09-16T07:36:50.198088+0000","last_peered":"2024-09-16T07:36:50.198088+0000","last_clean":"2024-09-16T07:36:50.198088+0000","last_became_active":"2024-09-16T07:36:48.801693+0000","last_became_peered":"2024-09-16T07:36:48.801693+0000","last_unstale":"2024-09-16T07:36:50.198088+0000","last_undegraded":"2024-09-16T07:36:50.198088+0000","last_fullsized":"2024-09-16T07:36:50.198088+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:03.857575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801511+0000","last_change":"2024-09-16T07:36:48.823886+0000","last_active":"2024-09-16T07:36:49.801511+0000","last_peered":"2024-09-16T07:36:49.801511+0000","last_clean":"2024-09-16T07:36:49.801511+0000","last_became_active":"2024-09-16T07:36:48.823161+0000","last_became_peered":"2024-09-16T07:36:48.823161+0000","last_unstale":"2024-09-16T07:36:49.801511+0000","last_undegraded":"2024-09-16T07:36:49.801511+0000","last_fullsized":"2024-09-16T07:36:49.801511+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:38:57.570406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198631+0000","last_change":"2024-09-16T07:36:48.806728+0000","last_active":"2024-09-16T07:36:50.198631+0000","last_peered":"2024-09-16T07:36:50.198631+0000","last_clean":"2024-09-16T07:36:50.198631+0000","last_became_active":"2024-09-16T07:36:48.806466+0000","last_became_peered":"2024-09-16T07:36:48.806466+0000","last_unstale":"2024-09-16T07:36:50.198631+0000","last_undegraded":"2024-09-16T07:36:50.198631+0000","last_fullsized":"2024-09-16T07:36:50.198631+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:32.695515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198780+0000","last_change":"2024-09-16T07:36:48.830946+0000","last_active":"2024-09-16T07:36:50.198780+0000","last_peered":"2024-09-16T07:36:50.198780+0000","last_clean":"2024-09-16T07:36:50.198780+0000","last_became_active":"2024-09-16T07:36:48.830679+0000","last_became_peered":"2024-09-16T07:36:48.830679+0000","last_unstale":"2024-09-16T07:36:50.198780+0000","last_undegraded":"2024-09-16T07:36:50.198780+0000","last_fullsized":"2024-09-16T07:36:50.198780+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:30:20.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197797+0000","last_change":"2024-09-16T07:36:48.797640+0000","last_active":"2024-09-16T07:36:50.197797+0000","last_peered":"2024-09-16T07:36:50.197797+0000","last_clean":"2024-09-16T07:36:50.197797+0000","last_became_active":"2024-09-16T07:36:48.797333+0000","last_became_peered":"2024-09-16T07:36:48.797333+0000","last_unstale":"2024-09-16T07:36:50.197797+0000","last_undegraded":"2024-09-16T07:36:50.197797+0000","last_fullsized":"2024-09-16T07:36:50.197797+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:52.977604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811668+0000","last_change":"2024-09-16T07:36:48.805376+0000","last_active":"2024-09-16T07:36:49.811668+0000","last_peered":"2024-09-16T07:36:49.811668+0000","last_clean":"2024-09-16T07:36:49.811668+0000","last_became_active":"2024-09-16T07:36:48.804929+0000","last_became_peered":"2024-09-16T07:36:48.804929+0000","last_unstale":"2024-09-16T07:36:49.811668+0000","last_undegraded":"2024-09-16T07:36:49.811668+0000","last_fullsized":"2024-09-16T07:36:49.811668+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:16.522413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797536+0000","last_change":"2024-09-16T07:36:48.804430+0000","last_active":"2024-09-16T07:36:49.797536+0000","last_peered":"2024-09-16T07:36:49.797536+0000","last_clean":"2024-09-16T07:36:49.797536+0000","last_became_active":"2024-09-16T07:36:48.804037+0000","last_became_peered":"2024-09-16T07:36:48.804037+0000","last_unstale":"2024-09-16T07:36:49.797536+0000","last_undegraded":"2024-09-16T07:36:49.797536+0000","last_fullsized":"2024-09-16T07:36:49.797536+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:31.500528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797664+0000","last_change":"2024-09-16T07:36:48.818563+0000","last_active":"2024-09-16T07:36:49.797664+0000","last_peered":"2024-09-16T07:36:49.797664+0000","last_clean":"2024-09-16T07:36:49.797664+0000","last_became_active":"2024-09-16T07:36:48.818151+0000","last_became_peered":"2024-09-16T07:36:48.818151+0000","last_unstale":"2024-09-16T07:36:49.797664+0000","last_undegraded":"2024-09-16T07:36:49.797664+0000","last_fullsized":"2024-09-16T07:36:49.797664+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:23:01.412879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811101+0000","last_change":"2024-09-16T07:36:48.798481+0000","last_active":"2024-09-16T07:36:49.811101+0000","last_peered":"2024-09-16T07:36:49.811101+0000","last_clean":"2024-09-16T07:36:49.811101+0000","last_became_active":"2024-09-16T07:36:48.798196+0000","last_became_peered":"2024-09-16T07:36:48.798196+0000","last_unstale":"2024-09-16T07:36:49.811101+0000","last_undegraded":"2024-09-16T07:36:49.811101+0000","last_fullsized":"2024-09-16T07:36:49.811101+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:59.524767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193690+0000","last_change":"2024-09-16T07:36:48.795845+0000","last_active":"2024-09-16T07:36:50.193690+0000","last_peered":"2024-09-16T07:36:50.193690+0000","last_clean":"2024-09-16T07:36:50.193690+0000","last_became_active":"2024-09-16T07:36:48.795538+0000","last_became_peered":"2024-09-16T07:36:48.795538+0000","last_unstale":"2024-09-16T07:36:50.193690+0000","last_undegraded":"2024-09-16T07:36:50.193690+0000","last_fullsized":"2024-09-16T07:36:50.193690+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:27.188831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801399+0000","last_change":"2024-09-16T07:36:48.823468+0000","last_active":"2024-09-16T07:36:49.801399+0000","last_peered":"2024-09-16T07:36:49.801399+0000","last_clean":"2024-09-16T07:36:49.801399+0000","last_became_active":"2024-09-16T07:36:48.823018+0000","last_became_peered":"2024-09-16T07:36:48.823018+0000","last_unstale":"2024-09-16T07:36:49.801399+0000","last_undegraded":"2024-09-16T07:36:49.801399+0000","last_fullsized":"2024-09-16T07:36:49.801399+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:03:18.260095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796683+0000","last_change":"2024-09-16T07:36:48.805965+0000","last_active":"2024-09-16T07:36:49.796683+0000","last_peered":"2024-09-16T07:36:49.796683+0000","last_clean":"2024-09-16T07:36:49.796683+0000","last_became_active":"2024-09-16T07:36:48.805641+0000","last_became_peered":"2024-09-16T07:36:48.805641+0000","last_unstale":"2024-09-16T07:36:49.796683+0000","last_undegraded":"2024-09-16T07:36:49.796683+0000","last_fullsized":"2024-09-16T07:36:49.796683+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:07:55.626935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198042+0000","last_change":"2024-09-16T07:36:48.799389+0000","last_active":"2024-09-16T07:36:50.198042+0000","last_peered":"2024-09-16T07:36:50.198042+0000","last_clean":"2024-09-16T07:36:50.198042+0000","last_became_active":"2024-09-16T07:36:48.798781+0000","last_became_peered":"2024-09-16T07:36:48.798781+0000","last_unstale":"2024-09-16T07:36:50.198042+0000","last_undegraded":"2024-09-16T07:36:50.198042+0000","last_fullsized":"2024-09-16T07:36:50.198042+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:54:21.547085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796601+0000","last_change":"2024-09-16T07:36:48.815812+0000","last_active":"2024-09-16T07:36:49.796601+0000","last_peered":"2024-09-16T07:36:49.796601+0000","last_clean":"2024-09-16T07:36:49.796601+0000","last_became_active":"2024-09-16T07:36:48.814362+0000","last_became_peered":"2024-09-16T07:36:48.814362+0000","last_unstale":"2024-09-16T07:36:49.796601+0000","last_undegraded":"2024-09-16T07:36:49.796601+0000","last_fullsized":"2024-09-16T07:36:49.796601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:14.995215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193596+0000","last_change":"2024-09-16T07:36:48.813891+0000","last_active":"2024-09-16T07:36:50.193596+0000","last_peered":"2024-09-16T07:36:50.193596+0000","last_clean":"2024-09-16T07:36:50.193596+0000","last_became_active":"2024-09-16T07:36:48.813654+0000","last_became_peered":"2024-09-16T07:36:48.813654+0000","last_unstale":"2024-09-16T07:36:50.193596+0000","last_undegraded":"2024-09-16T07:36:50.193596+0000","last_fullsized":"2024-09-16T07:36:50.193596+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:25:19.404817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198117+0000","last_change":"2024-09-16T07:36:48.796020+0000","last_active":"2024-09-16T07:36:50.198117+0000","last_peered":"2024-09-16T07:36:50.198117+0000","last_clean":"2024-09-16T07:36:50.198117+0000","last_became_active":"2024-09-16T07:36:48.795587+0000","last_became_peered":"2024-09-16T07:36:48.795587+0000","last_unstale":"2024-09-16T07:36:50.198117+0000","last_undegraded":"2024-09-16T07:36:50.198117+0000","last_fullsized":"2024-09-16T07:36:50.198117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:29:18.272857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800726+0000","last_change":"2024-09-16T07:36:48.828133+0000","last_active":"2024-09-16T07:36:49.800726+0000","last_peered":"2024-09-16T07:36:49.800726+0000","last_clean":"2024-09-16T07:36:49.800726+0000","last_became_active":"2024-09-16T07:36:48.822019+0000","last_became_peered":"2024-09-16T07:36:48.822019+0000","last_unstale":"2024-09-16T07:36:49.800726+0000","last_undegraded":"2024-09-16T07:36:49.800726+0000","last_fullsized":"2024-09-16T07:36:49.800726+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:32.695515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193599+0000","last_change":"2024-09-16T07:36:48.798015+0000","last_active":"2024-09-16T07:36:50.193599+0000","last_peered":"2024-09-16T07:36:50.193599+0000","last_clean":"2024-09-16T07:36:50.193599+0000","last_became_active":"2024-09-16T07:36:48.797385+0000","last_became_peered":"2024-09-16T07:36:48.797385+0000","last_unstale":"2024-09-16T07:36:50.193599+0000","last_undegraded":"2024-09-16T07:36:50.193599+0000","last_fullsized":"2024-09-16T07:36:50.193599+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:57.635997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"164'4","reported_seq":19,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797081+0000","last_change":"2024-09-16T07:36:47.783864+0000","last_active":"2024-09-16T07:36:49.797081+0000","last_peered":"2024-09-16T07:36:49.797081+0000","last_clean":"2024-09-16T07:36:49.797081+0000","last_became_active":"2024-09-16T07:36:47.783569+0000","last_became_peered":"2024-09-16T07:36:47.783569+0000","last_unstale":"2024-09-16T07:36:49.797081+0000","last_undegraded":"2024-09-16T07:36:49.797081+0000","last_fullsized":"2024-09-16T07:36:49.797081+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:24:05.734638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797934+0000","last_change":"2024-09-16T07:36:48.801887+0000","last_active":"2024-09-16T07:36:49.797934+0000","last_peered":"2024-09-16T07:36:49.797934+0000","last_clean":"2024-09-16T07:36:49.797934+0000","last_became_active":"2024-09-16T07:36:48.801478+0000","last_became_peered":"2024-09-16T07:36:48.801478+0000","last_unstale":"2024-09-16T07:36:49.797934+0000","last_undegraded":"2024-09-16T07:36:49.797934+0000","last_fullsized":"2024-09-16T07:36:49.797934+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:53:54.245374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193888+0000","last_change":"2024-09-16T07:36:47.785063+0000","last_active":"2024-09-16T07:36:50.193888+0000","last_peered":"2024-09-16T07:36:50.193888+0000","last_clean":"2024-09-16T07:36:50.193888+0000","last_became_active":"2024-09-16T07:36:47.784686+0000","last_became_peered":"2024-09-16T07:36:47.784686+0000","last_unstale":"2024-09-16T07:36:50.193888+0000","last_undegraded":"2024-09-16T07:36:50.193888+0000","last_fullsized":"2024-09-16T07:36:50.193888+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:46.015963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801240+0000","last_change":"2024-09-16T07:36:48.818522+0000","last_active":"2024-09-16T07:36:49.801240+0000","last_peered":"2024-09-16T07:36:49.801240+0000","last_clean":"2024-09-16T07:36:49.801240+0000","last_became_active":"2024-09-16T07:36:48.818260+0000","last_became_peered":"2024-09-16T07:36:48.818260+0000","last_unstale":"2024-09-16T07:36:49.801240+0000","last_undegraded":"2024-09-16T07:36:49.801240+0000","last_fullsized":"2024-09-16T07:36:49.801240+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:54:05.669517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198987+0000","last_change":"2024-09-16T07:36:47.789633+0000","last_active":"2024-09-16T07:36:50.198987+0000","last_peered":"2024-09-16T07:36:50.198987+0000","last_clean":"2024-09-16T07:36:50.198987+0000","last_became_active":"2024-09-16T07:36:47.789328+0000","last_became_peered":"2024-09-16T07:36:47.789328+0000","last_unstale":"2024-09-16T07:36:50.198987+0000","last_undegraded":"2024-09-16T07:36:50.198987+0000","last_fullsized":"2024-09-16T07:36:50.198987+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:23:44.589287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198394+0000","last_change":"2024-09-16T07:36:48.811280+0000","last_active":"2024-09-16T07:36:50.198394+0000","last_peered":"2024-09-16T07:36:50.198394+0000","last_clean":"2024-09-16T07:36:50.198394+0000","last_became_active":"2024-09-16T07:36:48.810730+0000","last_became_peered":"2024-09-16T07:36:48.810730+0000","last_unstale":"2024-09-16T07:36:50.198394+0000","last_undegraded":"2024-09-16T07:36:50.198394+0000","last_fullsized":"2024-09-16T07:36:50.198394+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:43:34.965007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811721+0000","last_change":"2024-09-16T07:36:47.794481+0000","last_active":"2024-09-16T07:36:49.811721+0000","last_peered":"2024-09-16T07:36:49.811721+0000","last_clean":"2024-09-16T07:36:49.811721+0000","last_became_active":"2024-09-16T07:36:47.794271+0000","last_became_peered":"2024-09-16T07:36:47.794271+0000","last_unstale":"2024-09-16T07:36:49.811721+0000","last_undegraded":"2024-09-16T07:36:49.811721+0000","last_fullsized":"2024-09-16T07:36:49.811721+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:50:23.614350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811859+0000","last_change":"2024-09-16T07:36:48.802676+0000","last_active":"2024-09-16T07:36:49.811859+0000","last_peered":"2024-09-16T07:36:49.811859+0000","last_clean":"2024-09-16T07:36:49.811859+0000","last_became_active":"2024-09-16T07:36:48.802253+0000","last_became_peered":"2024-09-16T07:36:48.802253+0000","last_unstale":"2024-09-16T07:36:49.811859+0000","last_undegraded":"2024-09-16T07:36:49.811859+0000","last_fullsized":"2024-09-16T07:36:49.811859+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:06.099426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198542+0000","last_change":"2024-09-16T07:36:47.786771+0000","last_active":"2024-09-16T07:36:50.198542+0000","last_peered":"2024-09-16T07:36:50.198542+0000","last_clean":"2024-09-16T07:36:50.198542+0000","last_became_active":"2024-09-16T07:36:47.786344+0000","last_became_peered":"2024-09-16T07:36:47.786344+0000","last_unstale":"2024-09-16T07:36:50.198542+0000","last_undegraded":"2024-09-16T07:36:50.198542+0000","last_fullsized":"2024-09-16T07:36:50.198542+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:59:10.270593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197510+0000","last_change":"2024-09-16T07:36:48.807750+0000","last_active":"2024-09-16T07:36:50.197510+0000","last_peered":"2024-09-16T07:36:50.197510+0000","last_clean":"2024-09-16T07:36:50.197510+0000","last_became_active":"2024-09-16T07:36:48.807430+0000","last_became_peered":"2024-09-16T07:36:48.807430+0000","last_unstale":"2024-09-16T07:36:50.197510+0000","last_undegraded":"2024-09-16T07:36:50.197510+0000","last_fullsized":"2024-09-16T07:36:50.197510+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:50.567384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197407+0000","last_change":"2024-09-16T07:36:47.792142+0000","last_active":"2024-09-16T07:36:50.197407+0000","last_peered":"2024-09-16T07:36:50.197407+0000","last_clean":"2024-09-16T07:36:50.197407+0000","last_became_active":"2024-09-16T07:36:47.791887+0000","last_became_peered":"2024-09-16T07:36:47.791887+0000","last_unstale":"2024-09-16T07:36:50.197407+0000","last_undegraded":"2024-09-16T07:36:50.197407+0000","last_fullsized":"2024-09-16T07:36:50.197407+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:45.485702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811174+0000","last_change":"2024-09-16T07:36:48.798192+0000","last_active":"2024-09-16T07:36:49.811174+0000","last_peered":"2024-09-16T07:36:49.811174+0000","last_clean":"2024-09-16T07:36:49.811174+0000","last_became_active":"2024-09-16T07:36:48.797909+0000","last_became_peered":"2024-09-16T07:36:48.797909+0000","last_unstale":"2024-09-16T07:36:49.811174+0000","last_undegraded":"2024-09-16T07:36:49.811174+0000","last_fullsized":"2024-09-16T07:36:49.811174+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:39.808514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797256+0000","last_change":"2024-09-16T07:36:47.775955+0000","last_active":"2024-09-16T07:36:49.797256+0000","last_peered":"2024-09-16T07:36:49.797256+0000","last_clean":"2024-09-16T07:36:49.797256+0000","last_became_active":"2024-09-16T07:36:47.774675+0000","last_became_peered":"2024-09-16T07:36:47.774675+0000","last_unstale":"2024-09-16T07:36:49.797256+0000","last_undegraded":"2024-09-16T07:36:49.797256+0000","last_fullsized":"2024-09-16T07:36:49.797256+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:57.366206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811389+0000","last_change":"2024-09-16T07:36:48.800317+0000","last_active":"2024-09-16T07:36:49.811389+0000","last_peered":"2024-09-16T07:36:49.811389+0000","last_clean":"2024-09-16T07:36:49.811389+0000","last_became_active":"2024-09-16T07:36:48.799792+0000","last_became_peered":"2024-09-16T07:36:48.799792+0000","last_unstale":"2024-09-16T07:36:49.811389+0000","last_undegraded":"2024-09-16T07:36:49.811389+0000","last_fullsized":"2024-09-16T07:36:49.811389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:25.486448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197829+0000","last_change":"2024-09-16T07:36:47.790849+0000","last_active":"2024-09-16T07:36:50.197829+0000","last_peered":"2024-09-16T07:36:50.197829+0000","last_clean":"2024-09-16T07:36:50.197829+0000","last_became_active":"2024-09-16T07:36:47.790581+0000","last_became_peered":"2024-09-16T07:36:47.790581+0000","last_unstale":"2024-09-16T07:36:50.197829+0000","last_undegraded":"2024-09-16T07:36:50.197829+0000","last_fullsized":"2024-09-16T07:36:50.197829+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:26.181531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198265+0000","last_change":"2024-09-16T07:36:48.808012+0000","last_active":"2024-09-16T07:36:50.198265+0000","last_peered":"2024-09-16T07:36:50.198265+0000","last_clean":"2024-09-16T07:36:50.198265+0000","last_became_active":"2024-09-16T07:36:48.807738+0000","last_became_peered":"2024-09-16T07:36:48.807738+0000","last_unstale":"2024-09-16T07:36:50.198265+0000","last_undegraded":"2024-09-16T07:36:50.198265+0000","last_fullsized":"2024-09-16T07:36:50.198265+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:47:44.617494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.798115+0000","last_change":"2024-09-16T07:36:47.776292+0000","last_active":"2024-09-16T07:36:49.798115+0000","last_peered":"2024-09-16T07:36:49.798115+0000","last_clean":"2024-09-16T07:36:49.798115+0000","last_became_active":"2024-09-16T07:36:47.775815+0000","last_became_peered":"2024-09-16T07:36:47.775815+0000","last_unstale":"2024-09-16T07:36:49.798115+0000","last_undegraded":"2024-09-16T07:36:49.798115+0000","last_fullsized":"2024-09-16T07:36:49.798115+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:09.806024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811440+0000","last_change":"2024-09-16T07:36:48.803044+0000","last_active":"2024-09-16T07:36:49.811440+0000","last_peered":"2024-09-16T07:36:49.811440+0000","last_clean":"2024-09-16T07:36:49.811440+0000","last_became_active":"2024-09-16T07:36:48.802752+0000","last_became_peered":"2024-09-16T07:36:48.802752+0000","last_unstale":"2024-09-16T07:36:49.811440+0000","last_undegraded":"2024-09-16T07:36:49.811440+0000","last_fullsized":"2024-09-16T07:36:49.811440+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:21.367856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"164'3","reported_seq":18,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198783+0000","last_change":"2024-09-16T07:36:47.794548+0000","last_active":"2024-09-16T07:36:50.198783+0000","last_peered":"2024-09-16T07:36:50.198783+0000","last_clean":"2024-09-16T07:36:50.198783+0000","last_became_active":"2024-09-16T07:36:47.793042+0000","last_became_peered":"2024-09-16T07:36:47.793042+0000","last_unstale":"2024-09-16T07:36:50.198783+0000","last_undegraded":"2024-09-16T07:36:50.198783+0000","last_fullsized":"2024-09-16T07:36:50.198783+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:49:23.961458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801205+0000","last_change":"2024-09-16T07:36:48.828855+0000","last_active":"2024-09-16T07:36:49.801205+0000","last_peered":"2024-09-16T07:36:49.801205+0000","last_clean":"2024-09-16T07:36:49.801205+0000","last_became_active":"2024-09-16T07:36:48.828573+0000","last_became_peered":"2024-09-16T07:36:48.828573+0000","last_unstale":"2024-09-16T07:36:49.801205+0000","last_undegraded":"2024-09-16T07:36:49.801205+0000","last_fullsized":"2024-09-16T07:36:49.801205+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:02.595294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"164'6","reported_seq":21,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811596+0000","last_change":"2024-09-16T07:36:47.789226+0000","last_active":"2024-09-16T07:36:49.811596+0000","last_peered":"2024-09-16T07:36:49.811596+0000","last_clean":"2024-09-16T07:36:49.811596+0000","last_became_active":"2024-09-16T07:36:47.788766+0000","last_became_peered":"2024-09-16T07:36:47.788766+0000","last_unstale":"2024-09-16T07:36:49.811596+0000","last_undegraded":"2024-09-16T07:36:49.811596+0000","last_fullsized":"2024-09-16T07:36:49.811596+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:48.345176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198403+0000","last_change":"2024-09-16T07:36:48.801444+0000","last_active":"2024-09-16T07:36:50.198403+0000","last_peered":"2024-09-16T07:36:50.198403+0000","last_clean":"2024-09-16T07:36:50.198403+0000","last_became_active":"2024-09-16T07:36:48.800004+0000","last_became_peered":"2024-09-16T07:36:48.800004+0000","last_unstale":"2024-09-16T07:36:50.198403+0000","last_undegraded":"2024-09-16T07:36:50.198403+0000","last_fullsized":"2024-09-16T07:36:50.198403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:58:32.913691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797478+0000","last_change":"2024-09-16T07:36:47.781350+0000","last_active":"2024-09-16T07:36:49.797478+0000","last_peered":"2024-09-16T07:36:49.797478+0000","last_clean":"2024-09-16T07:36:49.797478+0000","last_became_active":"2024-09-16T07:36:47.781033+0000","last_became_peered":"2024-09-16T07:36:47.781033+0000","last_unstale":"2024-09-16T07:36:49.797478+0000","last_undegraded":"2024-09-16T07:36:49.797478+0000","last_fullsized":"2024-09-16T07:36:49.797478+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:02:25.050644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198481+0000","last_change":"2024-09-16T07:36:48.795731+0000","last_active":"2024-09-16T07:36:50.198481+0000","last_peered":"2024-09-16T07:36:50.198481+0000","last_clean":"2024-09-16T07:36:50.198481+0000","last_became_active":"2024-09-16T07:36:48.795456+0000","last_became_peered":"2024-09-16T07:36:48.795456+0000","last_unstale":"2024-09-16T07:36:50.198481+0000","last_undegraded":"2024-09-16T07:36:50.198481+0000","last_fullsized":"2024-09-16T07:36:50.198481+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:25:36.244981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797535+0000","last_change":"2024-09-16T07:36:47.781137+0000","last_active":"2024-09-16T07:36:49.797535+0000","last_peered":"2024-09-16T07:36:49.797535+0000","last_clean":"2024-09-16T07:36:49.797535+0000","last_became_active":"2024-09-16T07:36:47.780684+0000","last_became_peered":"2024-09-16T07:36:47.780684+0000","last_unstale":"2024-09-16T07:36:49.797535+0000","last_undegraded":"2024-09-16T07:36:49.797535+0000","last_fullsized":"2024-09-16T07:36:49.797535+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:25:18.397517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197499+0000","last_change":"2024-09-16T07:36:48.803217+0000","last_active":"2024-09-16T07:36:50.197499+0000","last_peered":"2024-09-16T07:36:50.197499+0000","last_clean":"2024-09-16T07:36:50.197499+0000","last_became_active":"2024-09-16T07:36:48.802870+0000","last_became_peered":"2024-09-16T07:36:48.802870+0000","last_unstale":"2024-09-16T07:36:50.197499+0000","last_undegraded":"2024-09-16T07:36:50.197499+0000","last_fullsized":"2024-09-16T07:36:50.197499+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:02:11.035878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198253+0000","last_change":"2024-09-16T07:36:47.786759+0000","last_active":"2024-09-16T07:36:50.198253+0000","last_peered":"2024-09-16T07:36:50.198253+0000","last_clean":"2024-09-16T07:36:50.198253+0000","last_became_active":"2024-09-16T07:36:47.786477+0000","last_became_peered":"2024-09-16T07:36:47.786477+0000","last_unstale":"2024-09-16T07:36:50.198253+0000","last_undegraded":"2024-09-16T07:36:50.198253+0000","last_fullsized":"2024-09-16T07:36:50.198253+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:37:08.659162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.800979+0000","last_change":"2024-09-16T07:36:48.814820+0000","last_active":"2024-09-16T07:36:49.800979+0000","last_peered":"2024-09-16T07:36:49.800979+0000","last_clean":"2024-09-16T07:36:49.800979+0000","last_became_active":"2024-09-16T07:36:48.814538+0000","last_became_peered":"2024-09-16T07:36:48.814538+0000","last_unstale":"2024-09-16T07:36:49.800979+0000","last_undegraded":"2024-09-16T07:36:49.800979+0000","last_fullsized":"2024-09-16T07:36:49.800979+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:04.254027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"164'8","reported_seq":23,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197863+0000","last_change":"2024-09-16T07:36:47.788463+0000","last_active":"2024-09-16T07:36:50.197863+0000","last_peered":"2024-09-16T07:36:50.197863+0000","last_clean":"2024-09-16T07:36:50.197863+0000","last_became_active":"2024-09-16T07:36:47.788206+0000","last_became_peered":"2024-09-16T07:36:47.788206+0000","last_unstale":"2024-09-16T07:36:50.197863+0000","last_undegraded":"2024-09-16T07:36:50.197863+0000","last_fullsized":"2024-09-16T07:36:50.197863+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:40.672903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193842+0000","last_change":"2024-09-16T07:36:48.797705+0000","last_active":"2024-09-16T07:36:50.193842+0000","last_peered":"2024-09-16T07:36:50.193842+0000","last_clean":"2024-09-16T07:36:50.193842+0000","last_became_active":"2024-09-16T07:36:48.797080+0000","last_became_peered":"2024-09-16T07:36:48.797080+0000","last_unstale":"2024-09-16T07:36:50.193842+0000","last_undegraded":"2024-09-16T07:36:50.193842+0000","last_fullsized":"2024-09-16T07:36:50.193842+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:30.860052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197928+0000","last_change":"2024-09-16T07:36:47.799092+0000","last_active":"2024-09-16T07:36:50.197928+0000","last_peered":"2024-09-16T07:36:50.197928+0000","last_clean":"2024-09-16T07:36:50.197928+0000","last_became_active":"2024-09-16T07:36:47.798679+0000","last_became_peered":"2024-09-16T07:36:47.798679+0000","last_unstale":"2024-09-16T07:36:50.197928+0000","last_undegraded":"2024-09-16T07:36:50.197928+0000","last_fullsized":"2024-09-16T07:36:50.197928+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:53:50.537871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193712+0000","last_change":"2024-09-16T07:36:48.794934+0000","last_active":"2024-09-16T07:36:50.193712+0000","last_peered":"2024-09-16T07:36:50.193712+0000","last_clean":"2024-09-16T07:36:50.193712+0000","last_became_active":"2024-09-16T07:36:48.794665+0000","last_became_peered":"2024-09-16T07:36:48.794665+0000","last_unstale":"2024-09-16T07:36:50.193712+0000","last_undegraded":"2024-09-16T07:36:50.193712+0000","last_fullsized":"2024-09-16T07:36:50.193712+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:59:11.277893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193952+0000","last_change":"2024-09-16T07:36:47.781253+0000","last_active":"2024-09-16T07:36:50.193952+0000","last_peered":"2024-09-16T07:36:50.193952+0000","last_clean":"2024-09-16T07:36:50.193952+0000","last_became_active":"2024-09-16T07:36:47.780968+0000","last_became_peered":"2024-09-16T07:36:47.780968+0000","last_unstale":"2024-09-16T07:36:50.193952+0000","last_undegraded":"2024-09-16T07:36:50.193952+0000","last_fullsized":"2024-09-16T07:36:50.193952+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:22.531416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198164+0000","last_change":"2024-09-16T07:36:48.799670+0000","last_active":"2024-09-16T07:36:50.198164+0000","last_peered":"2024-09-16T07:36:50.198164+0000","last_clean":"2024-09-16T07:36:50.198164+0000","last_became_active":"2024-09-16T07:36:48.799120+0000","last_became_peered":"2024-09-16T07:36:48.799120+0000","last_unstale":"2024-09-16T07:36:50.198164+0000","last_undegraded":"2024-09-16T07:36:50.198164+0000","last_fullsized":"2024-09-16T07:36:50.198164+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:49:11.482977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198892+0000","last_change":"2024-09-16T07:36:47.792016+0000","last_active":"2024-09-16T07:36:50.198892+0000","last_peered":"2024-09-16T07:36:50.198892+0000","last_clean":"2024-09-16T07:36:50.198892+0000","last_became_active":"2024-09-16T07:36:47.791765+0000","last_became_peered":"2024-09-16T07:36:47.791765+0000","last_unstale":"2024-09-16T07:36:50.198892+0000","last_undegraded":"2024-09-16T07:36:50.198892+0000","last_fullsized":"2024-09-16T07:36:50.198892+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:56.232368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198545+0000","last_change":"2024-09-16T07:36:48.801727+0000","last_active":"2024-09-16T07:36:50.198545+0000","last_peered":"2024-09-16T07:36:50.198545+0000","last_clean":"2024-09-16T07:36:50.198545+0000","last_became_active":"2024-09-16T07:36:48.800556+0000","last_became_peered":"2024-09-16T07:36:48.800556+0000","last_unstale":"2024-09-16T07:36:50.198545+0000","last_undegraded":"2024-09-16T07:36:50.198545+0000","last_fullsized":"2024-09-16T07:36:50.198545+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:24.750967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198183+0000","last_change":"2024-09-16T07:36:47.789887+0000","last_active":"2024-09-16T07:36:50.198183+0000","last_peered":"2024-09-16T07:36:50.198183+0000","last_clean":"2024-09-16T07:36:50.198183+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:50.198183+0000","last_undegraded":"2024-09-16T07:36:50.198183+0000","last_fullsized":"2024-09-16T07:36:50.198183+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:27.585444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198908+0000","last_change":"2024-09-16T07:36:48.820154+0000","last_active":"2024-09-16T07:36:50.198908+0000","last_peered":"2024-09-16T07:36:50.198908+0000","last_clean":"2024-09-16T07:36:50.198908+0000","last_became_active":"2024-09-16T07:36:48.819500+0000","last_became_peered":"2024-09-16T07:36:48.819500+0000","last_unstale":"2024-09-16T07:36:50.198908+0000","last_undegraded":"2024-09-16T07:36:50.198908+0000","last_fullsized":"2024-09-16T07:36:50.198908+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:32.479838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198466+0000","last_change":"2024-09-16T07:36:47.788288+0000","last_active":"2024-09-16T07:36:50.198466+0000","last_peered":"2024-09-16T07:36:50.198466+0000","last_clean":"2024-09-16T07:36:50.198466+0000","last_became_active":"2024-09-16T07:36:47.788033+0000","last_became_peered":"2024-09-16T07:36:47.788033+0000","last_unstale":"2024-09-16T07:36:50.198466+0000","last_undegraded":"2024-09-16T07:36:50.198466+0000","last_fullsized":"2024-09-16T07:36:50.198466+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:58.517467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197961+0000","last_change":"2024-09-16T07:36:48.805684+0000","last_active":"2024-09-16T07:36:50.197961+0000","last_peered":"2024-09-16T07:36:50.197961+0000","last_clean":"2024-09-16T07:36:50.197961+0000","last_became_active":"2024-09-16T07:36:48.802161+0000","last_became_peered":"2024-09-16T07:36:48.802161+0000","last_unstale":"2024-09-16T07:36:50.197961+0000","last_undegraded":"2024-09-16T07:36:50.197961+0000","last_fullsized":"2024-09-16T07:36:50.197961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:02:28.733434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801256+0000","last_change":"2024-09-16T07:36:47.788687+0000","last_active":"2024-09-16T07:36:49.801256+0000","last_peered":"2024-09-16T07:36:49.801256+0000","last_clean":"2024-09-16T07:36:49.801256+0000","last_became_active":"2024-09-16T07:36:47.788264+0000","last_became_peered":"2024-09-16T07:36:47.788264+0000","last_unstale":"2024-09-16T07:36:49.801256+0000","last_undegraded":"2024-09-16T07:36:49.801256+0000","last_fullsized":"2024-09-16T07:36:49.801256+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:58.126602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193414+0000","last_change":"2024-09-16T07:36:48.798294+0000","last_active":"2024-09-16T07:36:50.193414+0000","last_peered":"2024-09-16T07:36:50.193414+0000","last_clean":"2024-09-16T07:36:50.193414+0000","last_became_active":"2024-09-16T07:36:48.797786+0000","last_became_peered":"2024-09-16T07:36:48.797786+0000","last_unstale":"2024-09-16T07:36:50.193414+0000","last_undegraded":"2024-09-16T07:36:50.193414+0000","last_fullsized":"2024-09-16T07:36:50.193414+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:10.805150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801047+0000","last_change":"2024-09-16T07:36:47.788394+0000","last_active":"2024-09-16T07:36:49.801047+0000","last_peered":"2024-09-16T07:36:49.801047+0000","last_clean":"2024-09-16T07:36:49.801047+0000","last_became_active":"2024-09-16T07:36:47.788042+0000","last_became_peered":"2024-09-16T07:36:47.788042+0000","last_unstale":"2024-09-16T07:36:49.801047+0000","last_undegraded":"2024-09-16T07:36:49.801047+0000","last_fullsized":"2024-09-16T07:36:49.801047+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:20.360557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797938+0000","last_change":"2024-09-16T07:36:48.801835+0000","last_active":"2024-09-16T07:36:49.797938+0000","last_peered":"2024-09-16T07:36:49.797938+0000","last_clean":"2024-09-16T07:36:49.797938+0000","last_became_active":"2024-09-16T07:36:48.801521+0000","last_became_peered":"2024-09-16T07:36:48.801521+0000","last_unstale":"2024-09-16T07:36:49.797938+0000","last_undegraded":"2024-09-16T07:36:49.797938+0000","last_fullsized":"2024-09-16T07:36:49.797938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:50.567384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197729+0000","last_change":"2024-09-16T07:36:47.795994+0000","last_active":"2024-09-16T07:36:50.197729+0000","last_peered":"2024-09-16T07:36:50.197729+0000","last_clean":"2024-09-16T07:36:50.197729+0000","last_became_active":"2024-09-16T07:36:47.795685+0000","last_became_peered":"2024-09-16T07:36:47.795685+0000","last_unstale":"2024-09-16T07:36:50.197729+0000","last_undegraded":"2024-09-16T07:36:50.197729+0000","last_fullsized":"2024-09-16T07:36:50.197729+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:36.446332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796676+0000","last_change":"2024-09-16T07:36:48.808919+0000","last_active":"2024-09-16T07:36:49.796676+0000","last_peered":"2024-09-16T07:36:49.796676+0000","last_clean":"2024-09-16T07:36:49.796676+0000","last_became_active":"2024-09-16T07:36:48.808738+0000","last_became_peered":"2024-09-16T07:36:48.808738+0000","last_unstale":"2024-09-16T07:36:49.796676+0000","last_undegraded":"2024-09-16T07:36:49.796676+0000","last_fullsized":"2024-09-16T07:36:49.796676+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:35.725875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198400+0000","last_change":"2024-09-16T07:36:47.786354+0000","last_active":"2024-09-16T07:36:50.198400+0000","last_peered":"2024-09-16T07:36:50.198400+0000","last_clean":"2024-09-16T07:36:50.198400+0000","last_became_active":"2024-09-16T07:36:47.786079+0000","last_became_peered":"2024-09-16T07:36:47.786079+0000","last_unstale":"2024-09-16T07:36:50.198400+0000","last_undegraded":"2024-09-16T07:36:50.198400+0000","last_fullsized":"2024-09-16T07:36:50.198400+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:27.025972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801624+0000","last_change":"2024-09-16T07:36:48.829416+0000","last_active":"2024-09-16T07:36:49.801624+0000","last_peered":"2024-09-16T07:36:49.801624+0000","last_clean":"2024-09-16T07:36:49.801624+0000","last_became_active":"2024-09-16T07:36:48.823616+0000","last_became_peered":"2024-09-16T07:36:48.823616+0000","last_unstale":"2024-09-16T07:36:49.801624+0000","last_undegraded":"2024-09-16T07:36:49.801624+0000","last_fullsized":"2024-09-16T07:36:49.801624+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:55.395274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"165'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811487+0000","last_change":"2024-09-16T07:36:47.787281+0000","last_active":"2024-09-16T07:36:49.811487+0000","last_peered":"2024-09-16T07:36:49.811487+0000","last_clean":"2024-09-16T07:36:49.811487+0000","last_became_active":"2024-09-16T07:36:47.786935+0000","last_became_peered":"2024-09-16T07:36:47.786935+0000","last_unstale":"2024-09-16T07:36:49.811487+0000","last_undegraded":"2024-09-16T07:36:49.811487+0000","last_fullsized":"2024-09-16T07:36:49.811487+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:54.958923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193625+0000","last_change":"2024-09-16T07:36:48.808071+0000","last_active":"2024-09-16T07:36:50.193625+0000","last_peered":"2024-09-16T07:36:50.193625+0000","last_clean":"2024-09-16T07:36:50.193625+0000","last_became_active":"2024-09-16T07:36:48.807730+0000","last_became_peered":"2024-09-16T07:36:48.807730+0000","last_unstale":"2024-09-16T07:36:50.193625+0000","last_undegraded":"2024-09-16T07:36:50.193625+0000","last_fullsized":"2024-09-16T07:36:50.193625+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:46.493002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197742+0000","last_change":"2024-09-16T07:36:47.793515+0000","last_active":"2024-09-16T07:36:50.197742+0000","last_peered":"2024-09-16T07:36:50.197742+0000","last_clean":"2024-09-16T07:36:50.197742+0000","last_became_active":"2024-09-16T07:36:47.793043+0000","last_became_peered":"2024-09-16T07:36:47.793043+0000","last_unstale":"2024-09-16T07:36:50.197742+0000","last_undegraded":"2024-09-16T07:36:50.197742+0000","last_fullsized":"2024-09-16T07:36:50.197742+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:56.628698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797904+0000","last_change":"2024-09-16T07:36:48.819828+0000","last_active":"2024-09-16T07:36:49.797904+0000","last_peered":"2024-09-16T07:36:49.797904+0000","last_clean":"2024-09-16T07:36:49.797904+0000","last_became_active":"2024-09-16T07:36:48.819545+0000","last_became_peered":"2024-09-16T07:36:48.819545+0000","last_unstale":"2024-09-16T07:36:49.797904+0000","last_undegraded":"2024-09-16T07:36:49.797904+0000","last_fullsized":"2024-09-16T07:36:49.797904+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:06:35.264228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198273+0000","last_change":"2024-09-16T07:36:47.785322+0000","last_active":"2024-09-16T07:36:50.198273+0000","last_peered":"2024-09-16T07:36:50.198273+0000","last_clean":"2024-09-16T07:36:50.198273+0000","last_became_active":"2024-09-16T07:36:47.785024+0000","last_became_peered":"2024-09-16T07:36:47.785024+0000","last_unstale":"2024-09-16T07:36:50.198273+0000","last_undegraded":"2024-09-16T07:36:50.198273+0000","last_fullsized":"2024-09-16T07:36:50.198273+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:26.702715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801110+0000","last_change":"2024-09-16T07:36:48.819492+0000","last_active":"2024-09-16T07:36:49.801110+0000","last_peered":"2024-09-16T07:36:49.801110+0000","last_clean":"2024-09-16T07:36:49.801110+0000","last_became_active":"2024-09-16T07:36:48.819219+0000","last_became_peered":"2024-09-16T07:36:48.819219+0000","last_unstale":"2024-09-16T07:36:49.801110+0000","last_undegraded":"2024-09-16T07:36:49.801110+0000","last_fullsized":"2024-09-16T07:36:49.801110+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:28.489708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811840+0000","last_change":"2024-09-16T07:36:47.795318+0000","last_active":"2024-09-16T07:36:49.811840+0000","last_peered":"2024-09-16T07:36:49.811840+0000","last_clean":"2024-09-16T07:36:49.811840+0000","last_became_active":"2024-09-16T07:36:47.795051+0000","last_became_peered":"2024-09-16T07:36:47.795051+0000","last_unstale":"2024-09-16T07:36:49.811840+0000","last_undegraded":"2024-09-16T07:36:49.811840+0000","last_fullsized":"2024-09-16T07:36:49.811840+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:19:42.213531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796650+0000","last_change":"2024-09-16T07:36:48.797907+0000","last_active":"2024-09-16T07:36:49.796650+0000","last_peered":"2024-09-16T07:36:49.796650+0000","last_clean":"2024-09-16T07:36:49.796650+0000","last_became_active":"2024-09-16T07:36:48.797632+0000","last_became_peered":"2024-09-16T07:36:48.797632+0000","last_unstale":"2024-09-16T07:36:49.796650+0000","last_undegraded":"2024-09-16T07:36:49.796650+0000","last_fullsized":"2024-09-16T07:36:49.796650+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:11:08.178370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.198641+0000","last_change":"2024-09-16T07:36:47.795227+0000","last_active":"2024-09-16T07:36:50.198641+0000","last_peered":"2024-09-16T07:36:50.198641+0000","last_clean":"2024-09-16T07:36:50.198641+0000","last_became_active":"2024-09-16T07:36:47.794955+0000","last_became_peered":"2024-09-16T07:36:47.794955+0000","last_unstale":"2024-09-16T07:36:50.198641+0000","last_undegraded":"2024-09-16T07:36:50.198641+0000","last_fullsized":"2024-09-16T07:36:50.198641+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:29.852752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.197713+0000","last_change":"2024-09-16T07:36:48.797821+0000","last_active":"2024-09-16T07:36:50.197713+0000","last_peered":"2024-09-16T07:36:50.197713+0000","last_clean":"2024-09-16T07:36:50.197713+0000","last_became_active":"2024-09-16T07:36:48.797429+0000","last_became_peered":"2024-09-16T07:36:48.797429+0000","last_unstale":"2024-09-16T07:36:50.197713+0000","last_undegraded":"2024-09-16T07:36:50.197713+0000","last_fullsized":"2024-09-16T07:36:50.197713+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:56:41.533080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.797914+0000","last_change":"2024-09-16T07:36:47.781443+0000","last_active":"2024-09-16T07:36:49.797914+0000","last_peered":"2024-09-16T07:36:49.797914+0000","last_clean":"2024-09-16T07:36:49.797914+0000","last_became_active":"2024-09-16T07:36:47.781151+0000","last_became_peered":"2024-09-16T07:36:47.781151+0000","last_unstale":"2024-09-16T07:36:49.797914+0000","last_undegraded":"2024-09-16T07:36:49.797914+0000","last_fullsized":"2024-09-16T07:36:49.797914+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:07:00.668387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:50.193489+0000","last_change":"2024-09-16T07:36:48.792468+0000","last_active":"2024-09-16T07:36:50.193489+0000","last_peered":"2024-09-16T07:36:50.193489+0000","last_clean":"2024-09-16T07:36:50.193489+0000","last_became_active":"2024-09-16T07:36:48.792172+0000","last_became_peered":"2024-09-16T07:36:48.792172+0000","last_unstale":"2024-09-16T07:36:50.193489+0000","last_undegraded":"2024-09-16T07:36:50.193489+0000","last_fullsized":"2024-09-16T07:36:50.193489+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:26:44.889378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796379+0000","last_change":"2024-09-16T07:36:47.782624+0000","last_active":"2024-09-16T07:36:49.796379+0000","last_peered":"2024-09-16T07:36:49.796379+0000","last_clean":"2024-09-16T07:36:49.796379+0000","last_became_active":"2024-09-16T07:36:47.782288+0000","last_became_peered":"2024-09-16T07:36:47.782288+0000","last_unstale":"2024-09-16T07:36:49.796379+0000","last_undegraded":"2024-09-16T07:36:49.796379+0000","last_fullsized":"2024-09-16T07:36:49.796379+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:50:42.775969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.801034+0000","last_change":"2024-09-16T07:36:48.829227+0000","last_active":"2024-09-16T07:36:49.801034+0000","last_peered":"2024-09-16T07:36:49.801034+0000","last_clean":"2024-09-16T07:36:49.801034+0000","last_became_active":"2024-09-16T07:36:48.828925+0000","last_became_peered":"2024-09-16T07:36:48.828925+0000","last_unstale":"2024-09-16T07:36:49.801034+0000","last_undegraded":"2024-09-16T07:36:49.801034+0000","last_fullsized":"2024-09-16T07:36:49.801034+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:47.760771+0000","last_clean_scrub_stamp":"2024-09-16T07:36:47.760771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:31.594806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.796830+0000","last_change":"2024-09-16T07:36:47.789860+0000","last_active":"2024-09-16T07:36:49.796830+0000","last_peered":"2024-09-16T07:36:49.796830+0000","last_clean":"2024-09-16T07:36:49.796830+0000","last_became_active":"2024-09-16T07:36:47.789595+0000","last_became_peered":"2024-09-16T07:36:47.789595+0000","last_unstale":"2024-09-16T07:36:49.796830+0000","last_undegraded":"2024-09-16T07:36:49.796830+0000","last_fullsized":"2024-09-16T07:36:49.796830+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:36:46.753472+0000","last_clean_scrub_stamp":"2024-09-16T07:36:46.753472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:17.517901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":403,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-16T07:36:49.811176+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:36:49.811176+0000","last_peered":"2024-09-16T07:36:49.811176+0000","last_clean":"2024-09-16T07:36:49.811176+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:36:49.811176+0000","last_undegraded":"2024-09-16T07:36:49.811176+0000","last_fullsized":"2024-09-16T07:36:49.811176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509548,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2682880,"data_stored":1507438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2080768,"data_stored":916040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509547,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2080768,"data_stored":916040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509547,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":917174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509547,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2088960,"data_stored":915640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542252,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2076672,"data_stored":915458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":915514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509548,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":2674688,"data_stored":1505916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:36:57.854 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:36:57.854 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T07:36:58.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 -- 172.21.15.114:0/589197936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0b4a50 msgr2=0x7f6a0c0ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 --2- 172.21.15.114:0/589197936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0b4a50 0x7f6a0c0ce810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400ad90 tx=0x7f6a0401dc20 comp rx=0 tx=0).stop 2024-09-16T07:36:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 -- 172.21.15.114:0/589197936 shutdown_connections 2024-09-16T07:36:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 --2- 172.21.15.114:0/589197936 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0b4a50 0x7f6a0c0ce810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 --2- 172.21.15.114:0/589197936 >> v2:172.21.15.149:3300/0 conn(0x7f6a0c15db50 0x7f6a0c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 -- 172.21.15.114:0/589197936 >> 172.21.15.114:0/589197936 conn(0x7f6a0c0b18f0 msgr2=0x7f6a0c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 -- 172.21.15.114:0/589197936 shutdown_connections 2024-09-16T07:36:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 -- 172.21.15.114:0/589197936 wait complete. 2024-09-16T07:36:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 Processor -- start 2024-09-16T07:36:58.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.048+0000 7f6a14400640 1 -- start start 2024-09-16T07:36:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a0c0b4a50 0x7f6a0c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0cd100 0x7f6a0c164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0c15db50 0x7f6a0c15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c167120 con 0x7f6a0c15db50 2024-09-16T07:36:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c0cf550 con 0x7f6a0c0b4a50 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0c1672a0 con 0x7f6a0c0cd100 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a12400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0c15db50 0x7f6a0c15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a11a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a0c0b4a50 0x7f6a0c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a11a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a0c0b4a50 0x7f6a0c14c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.114:34060/0 (socket says 172.21.15.114:34060) 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a11a00640 1 -- 172.21.15.114:0/1003907102 learned_addr learned my addr 172.21.15.114:0/1003907102 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a11000640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0cd100 0x7f6a0c164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a12400640 1 -- 172.21.15.114:0/1003907102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0cd100 msgr2=0x7f6a0c164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a12400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0cd100 0x7f6a0c164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a12400640 1 -- 172.21.15.114:0/1003907102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a0c0b4a50 msgr2=0x7f6a0c14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a12400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a0c0b4a50 0x7f6a0c14c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a12400640 1 -- 172.21.15.114:0/1003907102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c1634e0 con 0x7f6a0c15db50 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a12400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0c15db50 0x7f6a0c15ba40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f6a040ad000 tx=0x7f6a0400a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a09600640 1 -- 172.21.15.114:0/1003907102 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040bb020 con 0x7f6a0c15db50 2024-09-16T07:36:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a09600640 1 -- 172.21.15.114:0/1003907102 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a04004d40 con 0x7f6a0c15db50 2024-09-16T07:36:58.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a09600640 1 -- 172.21.15.114:0/1003907102 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a040b3040 con 0x7f6a0c15db50 2024-09-16T07:36:58.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c163780 con 0x7f6a0c15db50 2024-09-16T07:36:58.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c163d40 con 0x7f6a0c15db50 2024-09-16T07:36:58.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c069410 con 0x7f6a0c15db50 2024-09-16T07:36:58.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.052+0000 7f6a09600640 1 -- 172.21.15.114:0/1003907102 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f6a04004260 con 0x7f6a0c15db50 2024-09-16T07:36:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.056+0000 7f6a09600640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69ec0738e0 0x7f69ec075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.056+0000 7f6a09600640 1 -- 172.21.15.114:0/1003907102 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f6a0412cdb0 con 0x7f6a0c15db50 2024-09-16T07:36:58.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.056+0000 7f6a11a00640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69ec0738e0 0x7f69ec075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.056+0000 7f6a11a00640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69ec0738e0 0x7f69ec075da0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009680 tx=0x7f6a000091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:58.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.060+0000 7f6a09600640 1 -- 172.21.15.114:0/1003907102 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6a040c5060 con 0x7f6a0c15db50 2024-09-16T07:36:58.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.284+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6a0c0b16d0 con 0x7f6a0c15db50 2024-09-16T07:36:58.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a09600640 1 -- 172.21.15.114:0/1003907102 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) ==== 190+0+147 (secure 0 0 0) 0x7f6a040a7e20 con 0x7f6a0c15db50 2024-09-16T07:36:58.281 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-16T07:36:58.281 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDY3edmIyGgCxAAdTC5KyUzrFz9pB/pjNBUHA== 2024-09-16T07:36:58.281 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2024-09-16T07:36:58.281 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2024-09-16T07:36:58.281 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T07:36:58.282 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-16T07:36:58.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69ec0738e0 msgr2=0x7f69ec075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69ec0738e0 0x7f69ec075da0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009680 tx=0x7f6a000091e0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0c15db50 msgr2=0x7f6a0c15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0c15db50 0x7f6a0c15ba40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f6a040ad000 tx=0x7f6a0400a440 comp rx=0 tx=0).stop 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 shutdown_connections 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a0c15db50 0x7f6a0c15ba40 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f69ec0738e0 0x7f69ec075da0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a0c0cd100 0x7f6a0c164820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 --2- 172.21.15.114:0/1003907102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a0c0b4a50 0x7f6a0c14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 >> 172.21.15.114:0/1003907102 conn(0x7f6a0c0b18f0 msgr2=0x7f6a0c156940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 shutdown_connections 2024-09-16T07:36:58.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.288+0000 7f6a14400640 1 -- 172.21.15.114:0/1003907102 wait complete. 2024-09-16T07:36:58.304 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:36:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 -- 172.21.15.114:0/3180491072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c15f490 msgr2=0x7f236c0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 --2- 172.21.15.114:0/3180491072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c15f490 0x7f236c0b14c0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f235c009bc0 tx=0x7f235c01cae0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 -- 172.21.15.114:0/3180491072 shutdown_connections 2024-09-16T07:36:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 --2- 172.21.15.114:0/3180491072 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c15f490 0x7f236c0b14c0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 -- 172.21.15.114:0/3180491072 >> 172.21.15.114:0/3180491072 conn(0x7f236c0d1e30 msgr2=0x7f236c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 -- 172.21.15.114:0/3180491072 shutdown_connections 2024-09-16T07:36:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 -- 172.21.15.114:0/3180491072 wait complete. 2024-09-16T07:36:58.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 Processor -- start 2024-09-16T07:36:58.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.452+0000 7f2371200640 1 -- start start 2024-09-16T07:36:58.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f236c0afca0 0x7f236c150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c0b2e80 0x7f236c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f236c15f490 0x7f236c15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f236c0b2290 con 0x7f236c0b2e80 2024-09-16T07:36:58.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f236c0b2110 con 0x7f236c0afca0 2024-09-16T07:36:58.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f236c16a4a0 con 0x7f236c15f490 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c0b2e80 0x7f236c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c0b2e80 0x7f236c15bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55582/0 (socket says 172.21.15.114:55582) 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 -- 172.21.15.114:0/4000561880 learned_addr learned my addr 172.21.15.114:0/4000561880 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2369e00640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f236c0afca0 0x7f236c150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f236a800640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f236c15f490 0x7f236c15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 -- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f236c15f490 msgr2=0x7f236c15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f236c15f490 0x7f236c15c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 -- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f236c0afca0 msgr2=0x7f236c150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f236c0afca0 0x7f236c150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 -- 172.21.15.114:0/4000561880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c0b55a0 con 0x7f236c0b2e80 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2361400640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c0b2e80 0x7f236c15bbc0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f235400c500 tx=0x7f235400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:58.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2362a00640 1 -- 172.21.15.114:0/4000561880 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354017070 con 0x7f236c0b2e80 2024-09-16T07:36:58.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2362a00640 1 -- 172.21.15.114:0/4000561880 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23540053c0 con 0x7f236c0b2e80 2024-09-16T07:36:58.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2362a00640 1 -- 172.21.15.114:0/4000561880 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354003860 con 0x7f236c0b2e80 2024-09-16T07:36:58.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c0b4d00 con 0x7f236c0b2e80 2024-09-16T07:36:58.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c0b52c0 con 0x7f236c0b2e80 2024-09-16T07:36:58.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c0b00d0 con 0x7f236c0b2e80 2024-09-16T07:36:58.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.456+0000 7f2362a00640 1 -- 172.21.15.114:0/4000561880 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f235401a070 con 0x7f236c0b2e80 2024-09-16T07:36:58.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.460+0000 7f2362a00640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23480738e0 0x7f2348075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:58.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.460+0000 7f2362a00640 1 -- 172.21.15.114:0/4000561880 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f2354091ca0 con 0x7f236c0b2e80 2024-09-16T07:36:58.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.460+0000 7f2369e00640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23480738e0 0x7f2348075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:58.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.460+0000 7f2369e00640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23480738e0 0x7f2348075da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f235c0af000 tx=0x7f235c01b320 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:58.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.464+0000 7f2362a00640 1 -- 172.21.15.114:0/4000561880 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f235405e050 con 0x7f236c0b2e80 2024-09-16T07:36:58.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.660+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f236c0b1ef0 con 0x7f236c0b2e80 2024-09-16T07:36:58.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2362a00640 1 -- 172.21.15.114:0/4000561880 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5239 (secure 0 0 0) 0x7f2354062a80 con 0x7f236c0b2e80 2024-09-16T07:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:36:58.657 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":123,"btime":"2024-09-16T07:36:51:820962+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3201169795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3201169795},{"type":"v1","addr":"172.21.15.149:6801","nonce":3201169795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/64911771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":64911771},{"type":"v1","addr":"172.21.15.149:6835","nonce":64911771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9168,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3812839687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3812839687},{"type":"v1","addr":"172.21.15.114:6834","nonce":3812839687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:48.170239+0000","modified":"2024-09-16T07:36:51.212927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9171":{"gid":9171,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/2790565513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2790565513},{"type":"v1","addr":"172.21.15.114:6835","nonce":2790565513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9171,"qdb_cluster":[9171]},"id":13}]} 2024-09-16T07:36:58.658 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 123 2024-09-16T07:36:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23480738e0 msgr2=0x7f2348075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23480738e0 0x7f2348075da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f235c0af000 tx=0x7f235c01b320 comp rx=0 tx=0).stop 2024-09-16T07:36:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c0b2e80 msgr2=0x7f236c15bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c0b2e80 0x7f236c15bbc0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f235400c500 tx=0x7f235400c9c0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 shutdown_connections 2024-09-16T07:36:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f23480738e0 0x7f2348075da0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f236c15f490 0x7f236c15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f236c0b2e80 0x7f236c15bbc0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 --2- 172.21.15.114:0/4000561880 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f236c0afca0 0x7f236c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 >> 172.21.15.114:0/4000561880 conn(0x7f236c0d1e30 msgr2=0x7f236c159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 shutdown_connections 2024-09-16T07:36:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:58.664+0000 7f2371200640 1 -- 172.21.15.114:0/4000561880 wait complete. 2024-09-16T07:36:59.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 123, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T07:36:48.170239+0000', 'modified': '2024-09-16T07:36:51.212927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9171}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9171': {'gid': 9171, 'name': 'c', 'rank': 0, 'incarnation': 119, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.114:6835/2790565513', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6833', 'nonce': 2790565513}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 2790565513}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9171, 'qdb_cluster': [9171]} 2024-09-16T07:36:59.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T07:36:59.083 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T07:36:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 -- 172.21.15.114:0/4068719951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40d28e0 msgr2=0x7fa4a40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 --2- 172.21.15.114:0/4068719951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40d28e0 0x7fa4a40cebb0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40745d0 tx=0x7fa49c01ccf0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 -- 172.21.15.114:0/4068719951 shutdown_connections 2024-09-16T07:36:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 --2- 172.21.15.114:0/4068719951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40d28e0 0x7fa4a40cebb0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 --2- 172.21.15.114:0/4068719951 >> v2:172.21.15.149:3300/0 conn(0x7fa4a415bea0 0x7fa4a40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 -- 172.21.15.114:0/4068719951 >> 172.21.15.114:0/4068719951 conn(0x7fa4a40d1dc0 msgr2=0x7fa4a40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 -- 172.21.15.114:0/4068719951 shutdown_connections 2024-09-16T07:36:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 -- 172.21.15.114:0/4068719951 wait complete. 2024-09-16T07:36:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 Processor -- start 2024-09-16T07:36:59.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.232+0000 7fa4a9000640 1 -- start start 2024-09-16T07:36:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40cdb30 0x7fa4a41fbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a40d28e0 0x7fa4a4144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a415bea0 0x7fa4a40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a4168fc0 con 0x7fa4a40cdb30 2024-09-16T07:36:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a4168e40 con 0x7fa4a415bea0 2024-09-16T07:36:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a4169140 con 0x7fa4a40d28e0 2024-09-16T07:36:59.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40cdb30 0x7fa4a41fbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40cdb30 0x7fa4a41fbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55600/0 (socket says 172.21.15.114:55600) 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 -- 172.21.15.114:0/3021573165 learned_addr learned my addr 172.21.15.114:0/3021573165 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1400640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a40d28e0 0x7fa4a4144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a2800640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a415bea0 0x7fa4a40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 -- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a40d28e0 msgr2=0x7fa4a4144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a40d28e0 0x7fa4a4144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 -- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a415bea0 msgr2=0x7fa4a40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a415bea0 0x7fa4a40cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 -- 172.21.15.114:0/3021573165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a41fc140 con 0x7fa4a40cdb30 2024-09-16T07:36:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40cdb30 0x7fa4a41fbc00 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa4940058d0 tx=0x7fa49400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa49a000640 1 -- 172.21.15.114:0/3021573165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494017070 con 0x7fa4a40cdb30 2024-09-16T07:36:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa49a000640 1 -- 172.21.15.114:0/3021573165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa494009d20 con 0x7fa4a40cdb30 2024-09-16T07:36:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a41f8010 con 0x7fa4a40cdb30 2024-09-16T07:36:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa49a000640 1 -- 172.21.15.114:0/3021573165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940106c0 con 0x7fa4a40cdb30 2024-09-16T07:36:59.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.236+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a41f88b0 con 0x7fa4a40cdb30 2024-09-16T07:36:59.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa49a000640 1 -- 172.21.15.114:0/3021573165 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fa49401a070 con 0x7fa4a40cdb30 2024-09-16T07:36:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa49a000640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4840738e0 0x7fa484075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 Processor -- start 2024-09-16T07:36:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa49a000640 1 -- 172.21.15.114:0/3021573165 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fa494092a30 con 0x7fa4a40cdb30 2024-09-16T07:36:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 -- start start 2024-09-16T07:36:59.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a1400640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4840738e0 0x7fa484075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a1400640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4840738e0 0x7fa484075da0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40cc370 tx=0x7fa490009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 0x5628b1b0fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b102f0 0x5628b1ac38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1ac3e10 0x5628b1ac41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5628b19e43f0 con 0x5628b1ac3e10 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5628b1921b20 con 0x5628b1b102f0 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5628b1910f50 con 0x5628b1b0f9d0 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1ac3e10 0x5628b1ac41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 0x5628b1b0fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1ac3e10 0x5628b1ac41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55608/0 (socket says 172.21.15.114:55608) 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 -- 172.21.15.114:0/1353904332 learned_addr learned my addr 172.21.15.114:0/1353904332 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a1400640 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b102f0 0x5628b1ac38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 -- 172.21.15.114:0/1353904332 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 msgr2=0x5628b1b0fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 0x5628b1b0fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 -- 172.21.15.114:0/1353904332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b102f0 msgr2=0x5628b1ac38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b102f0 0x5628b1ac38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.240+0000 7fa4a2800640 1 -- 172.21.15.114:0/1353904332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b18d8590 con 0x5628b1ac3e10 2024-09-16T07:36:59.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a2800640 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1ac3e10 0x5628b1ac41f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009bd0 tx=0x7fa49c019a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d509dc0da077ef6a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa48ea00640 1 -- 172.21.15.114:0/1353904332 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0b2040 con 0x5628b1ac3e10 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa48ea00640 1 -- 172.21.15.114:0/1353904332 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa49c0a5cd0 con 0x5628b1ac3e10 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa48ea00640 1 -- 172.21.15.114:0/1353904332 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c004cb0 con 0x5628b1ac3e10 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- 172.21.15.114:0/1353904332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1ac3e10 msgr2=0x5628b1ac41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1ac3e10 0x5628b1ac41f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009bd0 tx=0x7fa49c019a90 comp rx=0 tx=0).stop 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- 172.21.15.114:0/1353904332 shutdown_connections 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1ac3e10 0x5628b1ac41f0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b102f0 0x5628b1ac38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 --2- 172.21.15.114:0/1353904332 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 0x5628b1b0fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- 172.21.15.114:0/1353904332 >> 172.21.15.114:0/1353904332 conn(0x5628b19ad130 msgr2=0x5628b1af2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- 172.21.15.114:0/1353904332 shutdown_connections 2024-09-16T07:36:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- 172.21.15.114:0/1353904332 wait complete. 2024-09-16T07:36:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- start start 2024-09-16T07:36:59.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 Processor -- start 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1af06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b0f9d0 0x5628b1af0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b102f0 0x5628b1af13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5628b18ab5d0 con 0x5628b1b0f9d0 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5628b1914d60 con 0x5628b1ac3e10 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5628b18b7500 con 0x5628b1b102f0 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4ac442000 10 client.0 _ll_register_callbacks cb 0x5628b18bb810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:36:59.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b0f9d0 0x5628b1af0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b0f9d0 0x5628b1af0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55610/0 (socket says 172.21.15.114:55610) 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 -- 172.21.15.114:0/3630219514 learned_addr learned my addr 172.21.15.114:0/3630219514 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a2800640 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b102f0 0x5628b1af13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1af06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 -- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b102f0 msgr2=0x5628b1af13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b102f0 0x5628b1af13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 -- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 msgr2=0x5628b1af06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1af06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.244+0000 7fa4a1400640 1 -- 172.21.15.114:0/3630219514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b18af170 con 0x5628b1b0f9d0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4a1400640 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b0f9d0 0x5628b1af0e70 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa490014700 tx=0x7fa490000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf8b14f78a1ad12 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 1 -- 172.21.15.114:0/3630219514 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490025020 con 0x5628b1b0f9d0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5628b18a90f0 con 0x5628b1b0f9d0 2024-09-16T07:36:59.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 1 -- 172.21.15.114:0/3630219514 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fa490013680 con 0x5628b1b0f9d0 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 1 -- 172.21.15.114:0/3630219514 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7fa49002f050 con 0x5628b1b0f9d0 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 10 client.9330 fetch_fsmap learned FSMap version 123 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x5628b1995ef0 con 0x5628b1b0f9d0 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 1 -- 172.21.15.114:0/3630219514 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5628b18a90f0 con 0x5628b1b0f9d0 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 1 -- 172.21.15.114:0/3630219514 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7fa490032020 con 0x5628b1b0f9d0 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 10 client.9330 fetch_fsmap finished waiting for FSMap version 123 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 10 client.9330 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 20 client.9330 populate_metadata read hostname 'smithi114' 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1af20f0 0x5628b1b21c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 4 client.9330 mds_command: new command op to 9171 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 --> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628b1923a70 con 0x5628b1af20f0 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1af20f0 0x5628b1b21c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1af20f0 0x5628b1b21c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb6d1ee4448382c server_cookie=62fc076514a47ff9 in_seq=0 out_seq=0 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 10 client.9330 ms_handle_connect on v2:172.21.15.114:6833/2790565513 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 1 -- 172.21.15.114:0/3630219514 <== mds.0 v2:172.21.15.114:6833/2790565513 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628b1923a70 con 0x5628b1af20f0 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 10 client.9330 handle_command_reply: tid=0 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 client.9330 shutdown 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b0f9d0 msgr2=0x5628b1af0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b0f9d0 0x5628b1af0e70 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa490014700 tx=0x7fa490000ee0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 shutdown_connections 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1af20f0 0x5628b1b21c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b102f0 0x5628b1af13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b0f9d0 0x5628b1af0e70 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3630219514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1af06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 >> 172.21.15.114:0/3630219514 conn(0x5628b19ad130 msgr2=0x5628b1ac2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa483400640 0 client.9330 ms_handle_reset on v2:172.21.15.114:6833/2790565513 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 shutdown_connections 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 1 -- 172.21.15.114:0/3630219514 wait complete. 2024-09-16T07:36:59.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.248+0000 7fa4ac442000 20 client.9330 trim_cache size 0 max 16384 2024-09-16T07:36:59.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 Processor -- start 2024-09-16T07:36:59.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 -- start start 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1b81dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 0x5628b1b82310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b82850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a42041e0 con 0x5628b1b102f0 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a40b27e0 con 0x5628b1ac3e10 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a41480f0 con 0x5628b1b0f9d0 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b82850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b82850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55620/0 (socket says 172.21.15.114:55620) 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 -- 172.21.15.114:0/3204573130 learned_addr learned my addr 172.21.15.114:0/3204573130 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 -- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 msgr2=0x5628b1b82310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 0x5628b1b82310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 -- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 msgr2=0x5628b1b81dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1b81dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1b81dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 -- 172.21.15.114:0/3204573130 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b196cd90 con 0x5628b1b102f0 2024-09-16T07:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1b81dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.268+0000 7fa4a2800640 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b82850 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fa49c019900 tx=0x7fa49c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1161cb3614ec03 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa48e000640 1 -- 172.21.15.114:0/3204573130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0b2070 con 0x5628b1b102f0 2024-09-16T07:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa48e000640 1 -- 172.21.15.114:0/3204573130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa49c004c50 con 0x5628b1b102f0 2024-09-16T07:36:59.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa48e000640 1 -- 172.21.15.114:0/3204573130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c003980 con 0x5628b1b102f0 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- 172.21.15.114:0/3204573130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 msgr2=0x5628b1b82850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b82850 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fa49c019900 tx=0x7fa49c0095c0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- 172.21.15.114:0/3204573130 shutdown_connections 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b82850 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1b0f9d0 0x5628b1b82310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 --2- 172.21.15.114:0/3204573130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1ac3e10 0x5628b1b81dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- 172.21.15.114:0/3204573130 >> 172.21.15.114:0/3204573130 conn(0x5628b19ad130 msgr2=0x5628b1acba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- 172.21.15.114:0/3204573130 shutdown_connections 2024-09-16T07:36:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- 172.21.15.114:0/3204573130 wait complete. 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- start start 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 Processor -- start 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1ac3e10 0x5628b1b85c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b0f9d0 0x5628b1b86140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x5628b1b26ce0 con 0x5628b1b102f0 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5628b1919390 con 0x5628b1b0f9d0 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x5628b19208f0 con 0x5628b1ac3e10 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4ac442000 10 client.0 _ll_register_callbacks cb 0x7fa490001dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1ac3e10 0x5628b1b85c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a1400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b0f9d0 0x5628b1b86140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a1e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1ac3e10 0x5628b1b85c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:39150/0 (socket says 172.21.15.114:39150) 2024-09-16T07:36:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a1e00640 1 -- 172.21.15.114:0/2366438603 learned_addr learned my addr 172.21.15.114:0/2366438603 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b86680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55626/0 (socket says 172.21.15.114:55626) 2024-09-16T07:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 -- 172.21.15.114:0/2366438603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1ac3e10 msgr2=0x5628b1b85c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1ac3e10 0x5628b1b85c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 -- 172.21.15.114:0/2366438603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b0f9d0 msgr2=0x5628b1b86140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T07:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b0f9d0 0x5628b1b86140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 -- 172.21.15.114:0/2366438603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b18d7a90 con 0x5628b1b102f0 2024-09-16T07:36:59.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1ac3e10 0x5628b1b85c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:36:59.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa4a2800640 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b86680 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x5628b1993f40 tx=0x7fa49c003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcf8cc113088453 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.272+0000 7fa483400640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 1 -- 172.21.15.114:0/2366438603 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0b2040 con 0x5628b1b102f0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 1 -- 172.21.15.114:0/2366438603 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fa49c0b9b10 con 0x5628b1b102f0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa49c004c50 con 0x5628b1b102f0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 1 -- 172.21.15.114:0/2366438603 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7fa49c0cf050 con 0x5628b1b102f0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 10 client.9336 fetch_fsmap learned FSMap version 123 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x5628b18b6050 con 0x5628b1b102f0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 1 -- 172.21.15.114:0/2366438603 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa49c004c50 con 0x5628b1b102f0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 1 -- 172.21.15.114:0/2366438603 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7fa49c0d2020 con 0x5628b1b102f0 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 10 client.9336 fetch_fsmap finished waiting for FSMap version 123 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 10 client.9336 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 20 client.9336 populate_metadata read hostname 'smithi114' 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1b243c0 0x5628b1b247a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 4 client.9336 mds_command: new command op to 9171 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 --> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] -- command(tid 0: {"prefix": "status"}) -- 0x5628b191f520 con 0x5628b1b243c0 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1b243c0 0x5628b1b247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 10 client.9336 ms_handle_connect on v2:172.21.15.114:6833/2790565513 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a1e00640 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1b243c0 0x5628b1b247a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=182d7bcdc3808e00 server_cookie=cad2955b63505f7c in_seq=0 out_seq=0 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 1 -- 172.21.15.114:0/2366438603 <== mds.0 v2:172.21.15.114:6833/2790565513 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x5628b191f520 con 0x5628b1b243c0 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 10 client.9336 handle_command_reply: tid=0 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 client.9336 shutdown 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 msgr2=0x5628b1b86680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b86680 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x5628b1993f40 tx=0x7fa49c003e90 comp rx=0 tx=0).stop 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 shutdown_connections 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:6833/2790565513,v1:172.21.15.114:6835/2790565513] conn(0x5628b1b243c0 0x5628b1b247a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5628b1b102f0 0x5628b1b86680 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5628b1b0f9d0 0x5628b1b86140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 --2- 172.21.15.114:0/2366438603 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x5628b1ac3e10 0x5628b1b85c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa483400640 0 client.9336 ms_handle_reset on v2:172.21.15.114:6833/2790565513 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 >> 172.21.15.114:0/2366438603 conn(0x5628b19ad130 msgr2=0x5628b1b0e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 shutdown_connections 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 1 -- 172.21.15.114:0/2366438603 wait complete. 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4ac442000 20 client.9336 trim_cache size 0 max 16384 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264", 2024-09-16T07:36:59.275 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 9171, 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.47660348, 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 123, 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 165, 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 165, 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 15.01609745 2024-09-16T07:36:59.276 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4840738e0 msgr2=0x7fa484075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4840738e0 0x7fa484075da0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40cc370 tx=0x7fa490009040 comp rx=0 tx=0).stop 2024-09-16T07:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40cdb30 msgr2=0x7fa4a41fbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40cdb30 0x7fa4a41fbc00 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fa4940058d0 tx=0x7fa49400dde0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 shutdown_connections 2024-09-16T07:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4a415bea0 0x7fa4a40cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fa4840738e0 0x7fa484075da0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa4a40d28e0 0x7fa4a4144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 --2- 172.21.15.114:0/3021573165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a40cdb30 0x7fa4a41fbc00 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 >> 172.21.15.114:0/3021573165 conn(0x7fa4a40d1dc0 msgr2=0x7fa4a40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 shutdown_connections 2024-09-16T07:36:59.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.276+0000 7fa4a9000640 1 -- 172.21.15.114:0/3021573165 wait complete. 2024-09-16T07:36:59.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:36:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.436+0000 7f906f200640 1 -- 172.21.15.114:0/1978795969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680cdb30 msgr2=0x7f90680aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.436+0000 7f906f200640 1 --2- 172.21.15.114:0/1978795969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680cdb30 0x7f90680aeef0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f90680cc3a0 tx=0x7f906001cb80 comp rx=0 tx=0).stop 2024-09-16T07:36:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- 172.21.15.114:0/1978795969 shutdown_connections 2024-09-16T07:36:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 --2- 172.21.15.114:0/1978795969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680cdb30 0x7f90680aeef0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 --2- 172.21.15.114:0/1978795969 >> v2:172.21.15.149:3300/0 conn(0x7f90680ced80 0x7f90680ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- 172.21.15.114:0/1978795969 >> 172.21.15.114:0/1978795969 conn(0x7f90680d1dc0 msgr2=0x7f90680d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- 172.21.15.114:0/1978795969 shutdown_connections 2024-09-16T07:36:59.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- 172.21.15.114:0/1978795969 wait complete. 2024-09-16T07:36:59.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 Processor -- start 2024-09-16T07:36:59.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- start start 2024-09-16T07:36:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90680cdb30 0x7f90680b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680ced80 0x7f906809f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906815bea0 0x7f906814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f90681692f0 con 0x7f90680ced80 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9068169170 con 0x7f906815bea0 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906f200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9068169470 con 0x7f90680cdb30 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680ced80 0x7f906809f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680ced80 0x7f906809f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55658/0 (socket says 172.21.15.114:55658) 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 -- 172.21.15.114:0/436513293 learned_addr learned my addr 172.21.15.114:0/436513293 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906d200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906815bea0 0x7f906814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067e00640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90680cdb30 0x7f90680b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 -- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90680cdb30 msgr2=0x7f90680b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90680cdb30 0x7f90680b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 -- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906815bea0 msgr2=0x7f906814e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906815bea0 0x7f906814e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f9067400640 1 -- 172.21.15.114:0/436513293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90680b1470 con 0x7f90680ced80 2024-09-16T07:36:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.440+0000 7f906d200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906815bea0 0x7f906814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:36:59.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f9067400640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680ced80 0x7f906809f5d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f905400c970 tx=0x7f905400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f905fe00640 1 -- 172.21.15.114:0/436513293 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054007c70 con 0x7f90680ced80 2024-09-16T07:36:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f905fe00640 1 -- 172.21.15.114:0/436513293 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f905400f450 con 0x7f90680ced80 2024-09-16T07:36:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90680b1750 con 0x7f90680ced80 2024-09-16T07:36:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f905fe00640 1 -- 172.21.15.114:0/436513293 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905400f8a0 con 0x7f90680ced80 2024-09-16T07:36:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90680b1d10 con 0x7f90680ced80 2024-09-16T07:36:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90680ce670 con 0x7f90680ced80 2024-09-16T07:36:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f905fe00640 1 -- 172.21.15.114:0/436513293 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f905400fa40 con 0x7f90680ced80 2024-09-16T07:36:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f905fe00640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9048073910 0x7f9048075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:36:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f905fe00640 1 -- 172.21.15.114:0/436513293 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f9054093210 con 0x7f90680ced80 2024-09-16T07:36:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.444+0000 7f9067e00640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9048073910 0x7f9048075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:36:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.448+0000 7f9067e00640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9048073910 0x7f9048075dd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f90580015f0 tx=0x7f9058009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:36:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.448+0000 7f905fe00640 1 -- 172.21.15.114:0/436513293 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9054014030 con 0x7f90680ced80 2024-09-16T07:36:59.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.652+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f90680b5b60 con 0x7f90680ced80 2024-09-16T07:36:59.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.652+0000 7f905fe00640 1 -- 172.21.15.114:0/436513293 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v123) ==== 53+0+73 (secure 0 0 0) 0x7f905405fc90 con 0x7f90680ced80 2024-09-16T07:36:59.648 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9048073910 msgr2=0x7f9048075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9048073910 0x7f9048075dd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f90580015f0 tx=0x7f9058009040 comp rx=0 tx=0).stop 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680ced80 msgr2=0x7f906809f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680ced80 0x7f906809f5d0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f905400c970 tx=0x7f905400ce30 comp rx=0 tx=0).stop 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 shutdown_connections 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f906815bea0 0x7f906814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90680ced80 0x7f906809f5d0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9048073910 0x7f9048075dd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 --2- 172.21.15.114:0/436513293 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f90680cdb30 0x7f90680b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:36:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 >> 172.21.15.114:0/436513293 conn(0x7f90680d1dc0 msgr2=0x7f90680b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:36:59.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 shutdown_connections 2024-09-16T07:36:59.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59.656+0000 7f906f200640 1 -- 172.21.15.114:0/436513293 wait complete. 2024-09-16T07:36:59.669 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:36:59.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:36:59.669 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T07:36:59.669 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T07:36:59.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T07:36:59.669 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:36:59.669 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:36:59.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:36:59.670 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:36:59.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:59.670 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T07:36:59.679 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T07:36:59.680 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41921sec preferred_lft 41921sec 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:c6:39:90:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:36:59.681 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:36:59.682 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:36:59.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:59.683 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:36:59.741 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T07:36:59.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:59.744 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:36:59.797 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:36:59.798 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:36:59.798 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T07:36:59.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:36:59.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:36:59.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:36:59.798 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T07:36:59.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:36:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:36:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:36:59.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:59.933 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:36:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:36:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:36:59.944 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:36:59.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:36:59.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T07:37:00.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:37:00.008 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T07:37:00.060 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T07:37:00.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:37:00.061 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:37:00.116 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:37:00.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:00.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:37:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:37:00.203 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:37:00.204 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:37:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:37:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:37:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:37:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:37:00.219 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:37:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T07:37:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T07:37:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T07:37:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:37:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:37:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:37:00.229 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:37:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:37:00.233 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:37:00.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:00.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T07:37:00.301 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:37:00.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:37:00.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:37:00.413 INFO:teuthology.orchestra.run.smithi114.stdout:client8629 2024-09-16T07:37:00.413 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:37:00.413 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:00.422 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 -- 172.21.15.114:0/1753256687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 msgr2=0x7f7330068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 --2- 172.21.15.114:0/1753256687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 0x7f7330068c00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7318005fd0 tx=0x7f731801c820 comp rx=0 tx=0).stop 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 -- 172.21.15.114:0/1753256687 shutdown_connections 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 --2- 172.21.15.114:0/1753256687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73300b4270 0x7f73300af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 --2- 172.21.15.114:0/1753256687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 0x7f7330068c00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 -- 172.21.15.114:0/1753256687 >> 172.21.15.114:0/1753256687 conn(0x7f73300b2240 msgr2=0x7f73300b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 -- 172.21.15.114:0/1753256687 shutdown_connections 2024-09-16T07:37:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 -- 172.21.15.114:0/1753256687 wait complete. 2024-09-16T07:37:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 Processor -- start 2024-09-16T07:37:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.616+0000 7f7336200640 1 -- start start 2024-09-16T07:37:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73300b4270 0x7f7330152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 0x7f73301547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f733015bde0 0x7f73300ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7330168f90 con 0x7f733015bde0 2024-09-16T07:37:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7330168e10 con 0x7f73300d0af0 2024-09-16T07:37:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7330169110 con 0x7f73300b4270 2024-09-16T07:37:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f733015bde0 0x7f73300ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f733015bde0 0x7f73300ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55668/0 (socket says 172.21.15.114:55668) 2024-09-16T07:37:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 -- 172.21.15.114:0/1322621662 learned_addr learned my addr 172.21.15.114:0/1322621662 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7326a00640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 0x7f73301547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:00.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732f400640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73300b4270 0x7f7330152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 -- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73300b4270 msgr2=0x7f7330152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73300b4270 0x7f7330152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 -- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 msgr2=0x7f73301547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 0x7f73301547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 -- 172.21.15.114:0/1322621662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7330154d00 con 0x7f733015bde0 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f732fe00640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f733015bde0 0x7f73300ce080 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f732800efd0 tx=0x7f732800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7327e00640 1 -- 172.21.15.114:0/1322621662 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328003b80 con 0x7f733015bde0 2024-09-16T07:37:00.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7327e00640 1 -- 172.21.15.114:0/1322621662 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7328003d20 con 0x7f733015bde0 2024-09-16T07:37:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f733014f630 con 0x7f733015bde0 2024-09-16T07:37:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7327e00640 1 -- 172.21.15.114:0/1322621662 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328004280 con 0x7f733015bde0 2024-09-16T07:37:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f733014fbf0 con 0x7f733015bde0 2024-09-16T07:37:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.620+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73300af900 con 0x7f733015bde0 2024-09-16T07:37:00.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.624+0000 7f7327e00640 1 -- 172.21.15.114:0/1322621662 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f7328004420 con 0x7f733015bde0 2024-09-16T07:37:00.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.624+0000 7f7327e00640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f730c0738e0 0x7f730c075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:00.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.624+0000 7f7327e00640 1 -- 172.21.15.114:0/1322621662 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f7328093640 con 0x7f733015bde0 2024-09-16T07:37:00.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.624+0000 7f732f400640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f730c0738e0 0x7f730c075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:00.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.624+0000 7f732f400640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f730c0738e0 0x7f730c075da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7320001870 tx=0x7f7320001380 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:00.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.628+0000 7f7327e00640 1 -- 172.21.15.114:0/1322621662 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f732805f9f0 con 0x7f733015bde0 2024-09-16T07:37:00.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.832+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7330152400 con 0x7f733015bde0 2024-09-16T07:37:00.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.832+0000 7f7327e00640 1 -- 172.21.15.114:0/1322621662 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v123) ==== 53+0+73 (secure 0 0 0) 0x7f7328064420 con 0x7f733015bde0 2024-09-16T07:37:00.826 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T07:37:00.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.832+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f730c0738e0 msgr2=0x7f730c075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:00.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.832+0000 7f7336200640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f730c0738e0 0x7f730c075da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7320001870 tx=0x7f7320001380 comp rx=0 tx=0).stop 2024-09-16T07:37:00.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.832+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f733015bde0 msgr2=0x7f73300ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:00.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.832+0000 7f7336200640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f733015bde0 0x7f73300ce080 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f732800efd0 tx=0x7f732800c6a0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 shutdown_connections 2024-09-16T07:37:00.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f733015bde0 0x7f73300ce080 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73300d0af0 0x7f73301547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f730c0738e0 0x7f730c075da0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 --2- 172.21.15.114:0/1322621662 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73300b4270 0x7f7330152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:00.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 >> 172.21.15.114:0/1322621662 conn(0x7f73300b2240 msgr2=0x7f73300d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:00.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 shutdown_connections 2024-09-16T07:37:00.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:00.836+0000 7f7336200640 1 -- 172.21.15.114:0/1322621662 wait complete. 2024-09-16T07:37:00.847 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T07:37:00.847 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T07:37:00.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2024-09-16T07:37:00.848 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T07:37:00.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T07:37:00.848 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T07:37:00.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T07:37:00.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T07:37:00.848 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:37:00.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:00.848 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2024-09-16T07:37:00.858 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T07:37:00.858 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T07:37:00.858 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T07:37:00.858 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f0 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: altname enp7s0f1 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2024-09-16T07:37:00.859 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 41929sec preferred_lft 41929sec 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ec4:7aff:fe88:7d57/64 scope link 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 02:42:3f:89:05:5f brd ff:ff:ff:ff:ff:ff 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-16T07:37:00.860 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-16T07:37:00.861 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2024-09-16T07:37:00.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:00.862 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T07:37:00.925 INFO:teuthology.orchestra.run.smithi149.stdout:1 2024-09-16T07:37:00.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:00.928 DEBUG:teuthology.orchestra.run.smithi149:> route 2024-09-16T07:37:00.987 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-16T07:37:00.988 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T07:37:00.989 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T07:37:00.989 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2024-09-16T07:37:00.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T07:37:00.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T07:37:00.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T07:37:00.989 DEBUG:teuthology.orchestra.run.smithi149:> ') 2024-09-16T07:37:01.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:37:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T07:37:01.124 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:37:01.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:01.131 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:37:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:37:01.141 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:37:01.141 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:37:01.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:01.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2024-09-16T07:37:01.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:37:01.202 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T07:37:01.258 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T07:37:01.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T07:37:01.258 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:37:01.314 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T07:37:01.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:01.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:37:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:37:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:37:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:37:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:37:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:37:01.421 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:37:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:37:01.422 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.149:3300,172.21.15.149:3301" 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790" 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2024-09-16T07:37:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264" will pass to kernel 2024-09-16T07:37:01.436 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T07:37:01.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:01.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T07:37:01.455 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T07:37:01.546 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:37:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:37:01.550 INFO:teuthology.orchestra.run.smithi149.stderr:2024-09-16T07:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:37:01.556 INFO:teuthology.orchestra.run.smithi149.stdout:client9351 2024-09-16T07:37:01.556 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:37:01.556 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:01.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T07:37:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 -- 172.21.15.114:0/667542885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc15e740 msgr2=0x7f4bcc15ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/667542885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc15e740 0x7f4bcc15ebf0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009900 tx=0x7f4bc401c850 comp rx=0 tx=0).stop 2024-09-16T07:37:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 -- 172.21.15.114:0/667542885 shutdown_connections 2024-09-16T07:37:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/667542885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc15e740 0x7f4bcc15ebf0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/667542885 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bcc15e360 0x7f4bcc0adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 -- 172.21.15.114:0/667542885 >> 172.21.15.114:0/667542885 conn(0x7f4bcc0cfbc0 msgr2=0x7f4bcc0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 -- 172.21.15.114:0/667542885 shutdown_connections 2024-09-16T07:37:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 -- 172.21.15.114:0/667542885 wait complete. 2024-09-16T07:37:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 Processor -- start 2024-09-16T07:37:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.768+0000 7f4bd1a00640 1 -- start start 2024-09-16T07:37:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc0aef60 0x7f4bcc142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bcc15e360 0x7f4bcc153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bcc15e740 0x7f4bcc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc1680b0 con 0x7f4bcc0aef60 2024-09-16T07:37:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc167f30 con 0x7f4bcc15e740 2024-09-16T07:37:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc168230 con 0x7f4bcc15e360 2024-09-16T07:37:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc0aef60 0x7f4bcc142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc0aef60 0x7f4bcc142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55682/0 (socket says 172.21.15.114:55682) 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 -- 172.21.15.114:0/4126175955 learned_addr learned my addr 172.21.15.114:0/4126175955 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bc2000640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bcc15e360 0x7f4bcc153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcb400640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bcc15e740 0x7f4bcc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 -- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bcc15e360 msgr2=0x7f4bcc153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bcc15e360 0x7f4bcc153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 -- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bcc15e740 msgr2=0x7f4bcc153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bcc15e740 0x7f4bcc153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 -- 172.21.15.114:0/4126175955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc1fc4e0 con 0x7f4bcc0aef60 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bcaa00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc0aef60 0x7f4bcc142df0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009fd0 tx=0x7f4bbc00c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bc3400640 1 -- 172.21.15.114:0/4126175955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc011470 con 0x7f4bcc0aef60 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bc3400640 1 -- 172.21.15.114:0/4126175955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bbc011700 con 0x7f4bcc0aef60 2024-09-16T07:37:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bc3400640 1 -- 172.21.15.114:0/4126175955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc011b30 con 0x7f4bcc0aef60 2024-09-16T07:37:01.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc0b37d0 con 0x7f4bcc0aef60 2024-09-16T07:37:01.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc0b3d90 con 0x7f4bcc0aef60 2024-09-16T07:37:01.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bcc069410 con 0x7f4bcc0aef60 2024-09-16T07:37:01.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.772+0000 7f4bc3400640 1 -- 172.21.15.114:0/4126175955 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f4bbc011cd0 con 0x7f4bcc0aef60 2024-09-16T07:37:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.776+0000 7f4bc3400640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ba80738e0 0x7f4ba8075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.776+0000 7f4bc3400640 1 -- 172.21.15.114:0/4126175955 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f4bbc093480 con 0x7f4bcc0aef60 2024-09-16T07:37:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.776+0000 7f4bc2000640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ba80738e0 0x7f4ba8075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:01.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.776+0000 7f4bc2000640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ba80738e0 0x7f4ba8075da0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc06fe00 tx=0x7f4bb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:01.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.780+0000 7f4bc3400640 1 -- 172.21.15.114:0/4126175955 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4bbc016030 con 0x7f4bcc0aef60 2024-09-16T07:37:01.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:01.984+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4bcc15ebf0 con 0x7f4bcc0aef60 2024-09-16T07:37:02.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bc3400640 1 -- 172.21.15.114:0/4126175955 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v124) ==== 136+0+0 (secure 0 0 0) 0x7f4bbc05f8b0 con 0x7f4bcc0aef60 2024-09-16T07:37:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ba80738e0 msgr2=0x7f4ba8075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ba80738e0 0x7f4ba8075da0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc06fe00 tx=0x7f4bb4009040 comp rx=0 tx=0).stop 2024-09-16T07:37:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc0aef60 msgr2=0x7f4bcc142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc0aef60 0x7f4bcc142df0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009fd0 tx=0x7f4bbc00c270 comp rx=0 tx=0).stop 2024-09-16T07:37:02.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 shutdown_connections 2024-09-16T07:37:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4bcc15e740 0x7f4bcc153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4ba80738e0 0x7f4ba8075da0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4bcc15e360 0x7f4bcc153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 --2- 172.21.15.114:0/4126175955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4bcc0aef60 0x7f4bcc142df0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 >> 172.21.15.114:0/4126175955 conn(0x7f4bcc0cfbc0 msgr2=0x7f4bcc14b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 shutdown_connections 2024-09-16T07:37:02.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.308+0000 7f4bd1a00640 1 -- 172.21.15.114:0/4126175955 wait complete. 2024-09-16T07:37:02.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T07:37:02.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.472+0000 7f7d15000640 1 -- 172.21.15.114:0/3963048591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf4004810 msgr2=0x7f7cf4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.472+0000 7f7d15000640 1 --2- 172.21.15.114:0/3963048591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cf4004810 0x7f7cf4004c90 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc001830 tx=0x7f7cfc01c8a0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.472+0000 7f7d0e800640 1 -- 172.21.15.114:0/3963048591 reap_dead start 2024-09-16T07:37:02.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.472+0000 7f7d15000640 1 -- 172.21.15.114:0/3963048591 shutdown_connections 2024-09-16T07:37:02.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.472+0000 7f7d15000640 1 -- 172.21.15.114:0/3963048591 >> 172.21.15.114:0/3963048591 conn(0x7f7d100b18f0 msgr2=0x7f7d100b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:02.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.472+0000 7f7d15000640 1 -- 172.21.15.114:0/3963048591 shutdown_connections 2024-09-16T07:37:02.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.472+0000 7f7d15000640 1 -- 172.21.15.114:0/3963048591 wait complete. 2024-09-16T07:37:02.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 Processor -- start 2024-09-16T07:37:02.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 -- start start 2024-09-16T07:37:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cf4004810 0x7f7d101431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d100b0d40 0x7f7d100acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d101fc8d0 0x7f7d1015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7d100b4d60 con 0x7f7d101fc8d0 2024-09-16T07:37:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d100b4be0 con 0x7f7cf4004810 2024-09-16T07:37:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d101667f0 con 0x7f7d100b0d40 2024-09-16T07:37:02.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d101fc8d0 0x7f7d1015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d101fc8d0 0x7f7d1015da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55710/0 (socket says 172.21.15.114:55710) 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0de00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cf4004810 0x7f7d101431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 -- 172.21.15.114:0/2550974799 learned_addr learned my addr 172.21.15.114:0/2550974799 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0d400640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d100b0d40 0x7f7d100acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 -- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d100b0d40 msgr2=0x7f7d100acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d100b0d40 0x7f7d100acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 -- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cf4004810 msgr2=0x7f7d101431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cf4004810 0x7f7d101431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 -- 172.21.15.114:0/2550974799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d10143710 con 0x7f7d101fc8d0 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0de00640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cf4004810 0x7f7d101431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d0e800640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d101fc8d0 0x7f7d1015da40 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f7d10072500 tx=0x7f7d080039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d06000640 1 -- 172.21.15.114:0/2550974799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08015020 con 0x7f7d101fc8d0 2024-09-16T07:37:02.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d06000640 1 -- 172.21.15.114:0/2550974799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d08011630 con 0x7f7d101fc8d0 2024-09-16T07:37:02.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d06000640 1 -- 172.21.15.114:0/2550974799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00007550 con 0x7f7d101fc8d0 2024-09-16T07:37:02.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d100ad280 con 0x7f7d101fc8d0 2024-09-16T07:37:02.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d101fbdf0 con 0x7f7d101fc8d0 2024-09-16T07:37:02.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.476+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d10069410 con 0x7f7d101fc8d0 2024-09-16T07:37:02.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.480+0000 7f7d06000640 1 -- 172.21.15.114:0/2550974799 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f7d08018020 con 0x7f7d101fc8d0 2024-09-16T07:37:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.480+0000 7f7d06000640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7cf00738e0 0x7f7cf0075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.480+0000 7f7d06000640 1 -- 172.21.15.114:0/2550974799 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f7d080930b0 con 0x7f7d101fc8d0 2024-09-16T07:37:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.480+0000 7f7d0de00640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7cf00738e0 0x7f7cf0075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.480+0000 7f7d0de00640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7cf00738e0 0x7f7cf0075da0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7d100aef70 tx=0x7f7d0000c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:02.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.484+0000 7f7d06000640 1 -- 172.21.15.114:0/2550974799 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7d0801f020 con 0x7f7d101fc8d0 2024-09-16T07:37:02.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.672+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7d100ad800 con 0x7f7cf00738e0 2024-09-16T07:37:02.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d06000640 1 -- 172.21.15.114:0/2550974799 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7d100ad800 con 0x7f7cf00738e0 2024-09-16T07:37:02.669 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-16T07:37:02.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-16T07:37:02.670 INFO:teuthology.orchestra.run.smithi114.stdout: "name": "cephfs" 2024-09-16T07:37:02.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-16T07:37:02.670 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7cf00738e0 msgr2=0x7f7cf0075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7cf00738e0 0x7f7cf0075da0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7d100aef70 tx=0x7f7d0000c040 comp rx=0 tx=0).stop 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d101fc8d0 msgr2=0x7f7d1015da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d101fc8d0 0x7f7d1015da40 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f7d10072500 tx=0x7f7d080039d0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 shutdown_connections 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d101fc8d0 0x7f7d1015da40 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7cf00738e0 0x7f7cf0075da0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d100b0d40 0x7f7d100acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 --2- 172.21.15.114:0/2550974799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7cf4004810 0x7f7d101431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 >> 172.21.15.114:0/2550974799 conn(0x7f7d100b18f0 msgr2=0x7f7d101ee330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 shutdown_connections 2024-09-16T07:37:02.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.676+0000 7f7d15000640 1 -- 172.21.15.114:0/2550974799 wait complete. 2024-09-16T07:37:02.691 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T07:37:02.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- 172.21.15.114:0/288166586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a00004d50 msgr2=0x7f8a000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 --2- 172.21.15.114:0/288166586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a00004d50 0x7f8a000051d0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009ee0 tx=0x7f8a1001d5f0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1de00640 1 -- 172.21.15.114:0/288166586 reap_dead start 2024-09-16T07:37:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- 172.21.15.114:0/288166586 shutdown_connections 2024-09-16T07:37:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- 172.21.15.114:0/288166586 >> 172.21.15.114:0/288166586 conn(0x7f8a1809aa10 msgr2=0x7f8a1809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- 172.21.15.114:0/288166586 shutdown_connections 2024-09-16T07:37:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- 172.21.15.114:0/288166586 wait complete. 2024-09-16T07:37:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 Processor -- start 2024-09-16T07:37:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- start start 2024-09-16T07:37:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a00004d50 0x7f8a1815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a181590f0 0x7f8a1815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1815c7e0 0x7f8a181441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18164b80 con 0x7f8a181590f0 2024-09-16T07:37:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18164a00 con 0x7f8a1815c7e0 2024-09-16T07:37:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1e800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f8a18164d00 con 0x7f8a00004d50 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a181590f0 0x7f8a1815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a181590f0 0x7f8a1815c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55720/0 (socket says 172.21.15.114:55720) 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 -- 172.21.15.114:0/2454168251 learned_addr learned my addr 172.21.15.114:0/2454168251 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1d400640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a00004d50 0x7f8a1815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1de00640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1815c7e0 0x7f8a181441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 -- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a00004d50 msgr2=0x7f8a1815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a00004d50 0x7f8a1815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 -- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1815c7e0 msgr2=0x7f8a181441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1815c7e0 0x7f8a181441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 -- 172.21.15.114:0/2454168251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a181595b0 con 0x7f8a181590f0 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1de00640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1815c7e0 0x7f8a181441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.844+0000 7f8a1ca00640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a181590f0 0x7f8a1815c2a0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f8a04001170 tx=0x7f8a04012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a15600640 1 -- 172.21.15.114:0/2454168251 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04010ae0 con 0x7f8a181590f0 2024-09-16T07:37:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a15600640 1 -- 172.21.15.114:0/2454168251 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a04017030 con 0x7f8a181590f0 2024-09-16T07:37:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a15600640 1 -- 172.21.15.114:0/2454168251 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04013450 con 0x7f8a181590f0 2024-09-16T07:37:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a18159890 con 0x7f8a181590f0 2024-09-16T07:37:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a18159e50 con 0x7f8a181590f0 2024-09-16T07:37:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1815cbf0 con 0x7f8a181590f0 2024-09-16T07:37:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a15600640 1 -- 172.21.15.114:0/2454168251 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f8a040135f0 con 0x7f8a181590f0 2024-09-16T07:37:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a15600640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89f80738e0 0x7f89f8075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a15600640 1 -- 172.21.15.114:0/2454168251 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f8a040966d0 con 0x7f8a181590f0 2024-09-16T07:37:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.848+0000 7f8a1d400640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89f80738e0 0x7f89f8075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:02.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.852+0000 7f8a1d400640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89f80738e0 0x7f89f8075da0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c000c10 tx=0x7f8a0c006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:02.852+0000 7f8a15600640 1 -- 172.21.15.114:0/2454168251 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f8a1815cbf0 con 0x7f8a181590f0 2024-09-16T07:37:03.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8a180d1bb0 con 0x7f8a181590f0 2024-09-16T07:37:03.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a15600640 1 -- 172.21.15.114:0/2454168251 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f8a04063150 con 0x7f8a181590f0 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89f80738e0 msgr2=0x7f89f8075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89f80738e0 0x7f89f8075da0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c000c10 tx=0x7f8a0c006b20 comp rx=0 tx=0).stop 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a181590f0 msgr2=0x7f8a1815c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a181590f0 0x7f8a1815c2a0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f8a04001170 tx=0x7f8a04012b20 comp rx=0 tx=0).stop 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 shutdown_connections 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8a1815c7e0 0x7f8a181441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a181590f0 0x7f8a1815c2a0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f89f80738e0 0x7f89f8075da0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 --2- 172.21.15.114:0/2454168251 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8a00004d50 0x7f8a1815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 >> 172.21.15.114:0/2454168251 conn(0x7f8a1809aa10 msgr2=0x7f8a1815b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 shutdown_connections 2024-09-16T07:37:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.020+0000 7f8a1e800640 1 -- 172.21.15.114:0/2454168251 wait complete. 2024-09-16T07:37:03.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:03.036 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp39540/subvol34720) 2024-09-16T07:37:03.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:03.063 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-16T07:37:03.118 INFO:teuthology.orchestra.run.smithi114.stdout:cephfs_data 2024-09-16T07:37:03.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:03.118 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp39540/subvol34720) 2024-09-16T07:37:03.184 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:37:03.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp39540/subvol34720/.meta 2024-09-16T07:37:03.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol34720 subvol_grp39540 2024-09-16T07:37:03.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 -- 172.21.15.114:0/2401983429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740d02e0 msgr2=0x7f30740d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 --2- 172.21.15.114:0/2401983429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740d02e0 0x7f30740d0720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f305c009bc0 tx=0x7f305c01cb70 comp rx=0 tx=0).stop 2024-09-16T07:37:03.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 -- 172.21.15.114:0/2401983429 shutdown_connections 2024-09-16T07:37:03.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 --2- 172.21.15.114:0/2401983429 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740d02e0 0x7f30740d0720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 --2- 172.21.15.114:0/2401983429 >> v2:172.21.15.149:3300/0 conn(0x7f30740cff00 0x7f30740d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 -- 172.21.15.114:0/2401983429 >> 172.21.15.114:0/2401983429 conn(0x7f30740d1da0 msgr2=0x7f30740d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:03.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 -- 172.21.15.114:0/2401983429 shutdown_connections 2024-09-16T07:37:03.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.452+0000 7f3073200640 1 -- 172.21.15.114:0/2401983429 wait complete. 2024-09-16T07:37:03.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 Processor -- start 2024-09-16T07:37:03.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 -- start start 2024-09-16T07:37:03.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740cff00 0x7f30740b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30740d02e0 0x7f30740c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f307415eff0 0x7f30740cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30741690a0 con 0x7f30740d02e0 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3074168f20 con 0x7f307415eff0 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3074169220 con 0x7f30740cff00 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30740d02e0 0x7f30740c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30740d02e0 0x7f30740c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55726/0 (socket says 172.21.15.114:55726) 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 -- 172.21.15.114:0/2669416206 learned_addr learned my addr 172.21.15.114:0/2669416206 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3071e00640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740cff00 0x7f30740b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3072800640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f307415eff0 0x7f30740cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 -- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740cff00 msgr2=0x7f30740b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740cff00 0x7f30740b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 -- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f307415eff0 msgr2=0x7f30740cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f307415eff0 0x7f30740cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 -- 172.21.15.114:0/2669416206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30740ca190 con 0x7f30740d02e0 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3072800640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f307415eff0 0x7f30740cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3069400640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30740d02e0 0x7f30740c7f10 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f305c009b10 tx=0x7f305c005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f306aa00640 1 -- 172.21.15.114:0/2669416206 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0b2040 con 0x7f30740d02e0 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f306aa00640 1 -- 172.21.15.114:0/2669416206 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f305c004a50 con 0x7f30740d02e0 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f306aa00640 1 -- 172.21.15.114:0/2669416206 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c004040 con 0x7f30740d02e0 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3074152b70 con 0x7f30740d02e0 2024-09-16T07:37:03.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.456+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30740ca710 con 0x7f30740d02e0 2024-09-16T07:37:03.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.460+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30740d28c0 con 0x7f30740d02e0 2024-09-16T07:37:03.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.460+0000 7f306aa00640 1 -- 172.21.15.114:0/2669416206 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f305c0041e0 con 0x7f30740d02e0 2024-09-16T07:37:03.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.460+0000 7f306aa00640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f30500738e0 0x7f3050075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.460+0000 7f306aa00640 1 -- 172.21.15.114:0/2669416206 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f305c12c860 con 0x7f30740d02e0 2024-09-16T07:37:03.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.460+0000 7f3071e00640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f30500738e0 0x7f3050075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:03.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.460+0000 7f3071e00640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f30500738e0 0x7f3050075da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3064009600 tx=0x7f30640091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:03.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.464+0000 7f306aa00640 1 -- 172.21.15.114:0/2669416206 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f305c016790 con 0x7f30740d02e0 2024-09-16T07:37:03.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.656+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol34720", "group_name": "subvol_grp39540", "target": ["mon-mgr", ""]}) -- 0x7f307415c040 con 0x7f30500738e0 2024-09-16T07:37:03.657 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:03.664+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:03.657 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:03.664+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:03.657 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:03.664+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:03.657 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:03.664+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:03.657 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:03.664+0000 7f4e12e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:03.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f306aa00640 1 -- 172.21.15.114:0/2669416206 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f307415c040 con 0x7f30500738e0 2024-09-16T07:37:03.693 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp39540/subvol34720 2024-09-16T07:37:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f30500738e0 msgr2=0x7f3050075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f30500738e0 0x7f3050075da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3064009600 tx=0x7f30640091e0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30740d02e0 msgr2=0x7f30740c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30740d02e0 0x7f30740c7f10 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f305c009b10 tx=0x7f305c005aa0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 shutdown_connections 2024-09-16T07:37:03.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f307415eff0 0x7f30740cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30740d02e0 0x7f30740c7f10 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f30500738e0 0x7f3050075da0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 --2- 172.21.15.114:0/2669416206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30740cff00 0x7f30740b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 >> 172.21.15.114:0/2669416206 conn(0x7f30740d1da0 msgr2=0x7f3074153ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 shutdown_connections 2024-09-16T07:37:03.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.700+0000 7f3073200640 1 -- 172.21.15.114:0/2669416206 wait complete. 2024-09-16T07:37:03.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol34720 subvol_grp39540 2024-09-16T07:37:03.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 -- 172.21.15.114:0/2773738455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec15be10 msgr2=0x7fb3ec0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2773738455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec15be10 0x7fb3ec0ce700 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009900 tx=0x7fb3dc01c8e0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 -- 172.21.15.114:0/2773738455 shutdown_connections 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2773738455 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ec0b0b60 0x7fb3ec0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2773738455 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec15be10 0x7fb3ec0ce700 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 -- 172.21.15.114:0/2773738455 >> 172.21.15.114:0/2773738455 conn(0x7fb3ec0d1da0 msgr2=0x7fb3ec0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 -- 172.21.15.114:0/2773738455 shutdown_connections 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.868+0000 7fb3f2800640 1 -- 172.21.15.114:0/2773738455 wait complete. 2024-09-16T07:37:03.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 Processor -- start 2024-09-16T07:37:03.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 -- start start 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec0b0b60 0x7fb3ec0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ec15be10 0x7fb3ec0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ec15c1f0 0x7fb3ec0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec169040 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec168ec0 con 0x7fb3ec15be10 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ec1691c0 con 0x7fb3ec15c1f0 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec0b0b60 0x7fb3ec0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec0b0b60 0x7fb3ec0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55768/0 (socket says 172.21.15.114:55768) 2024-09-16T07:37:03.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 -- 172.21.15.114:0/2440656415 learned_addr learned my addr 172.21.15.114:0/2440656415 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 -- 172.21.15.114:0/2440656415 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ec15c1f0 msgr2=0x7fb3ec0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ec15c1f0 0x7fb3ec0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 -- 172.21.15.114:0/2440656415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ec15be10 msgr2=0x7fb3ec0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:03.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ec15be10 0x7fb3ec0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 -- 172.21.15.114:0/2440656415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec1668a0 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3eb400640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec0b0b60 0x7fb3ec0b2760 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b0040 tx=0x7fb3dc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3e3e00640 1 -- 172.21.15.114:0/2440656415 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0bb070 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3e3e00640 1 -- 172.21.15.114:0/2440656415 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3dc005070 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ec166b80 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3e3e00640 1 -- 172.21.15.114:0/2440656415 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b2040 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ec0ca1a0 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.872+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ec0ccbd0 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.876+0000 7fb3e3e00640 1 -- 172.21.15.114:0/2440656415 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fb3dc0be070 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.876+0000 7fb3e3e00640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3c8073910 0x7fb3c8075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.876+0000 7fb3e3e00640 1 -- 172.21.15.114:0/2440656415 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fb3dc12c100 con 0x7fb3ec0b0b60 2024-09-16T07:37:03.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.876+0000 7fb3e2a00640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3c8073910 0x7fb3c8075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:03.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.876+0000 7fb3e2a00640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3c8073910 0x7fb3c8075dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000f70 tx=0x7fb3d40079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:03.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:03.880+0000 7fb3e3e00640 1 -- 172.21.15.114:0/2440656415 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb3dc0164d0 con 0x7fb3ec0b0b60 2024-09-16T07:37:04.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.072+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol34720", "group_name": "subvol_grp39540", "target": ["mon-mgr", ""]}) -- 0x7fb3ec070350 con 0x7fb3c8073910 2024-09-16T07:37:04.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.076+0000 7fb3e3e00640 1 -- 172.21.15.114:0/2440656415 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb3ec070350 con 0x7fb3c8073910 2024-09-16T07:37:04.073 INFO:teuthology.orchestra.run.smithi114.stdout:/volumes/subvol_grp39540/subvol34720 2024-09-16T07:37:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3c8073910 msgr2=0x7fb3c8075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3c8073910 0x7fb3c8075dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000f70 tx=0x7fb3d40079c0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec0b0b60 msgr2=0x7fb3ec0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec0b0b60 0x7fb3ec0b2760 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b0040 tx=0x7fb3dc004040 comp rx=0 tx=0).stop 2024-09-16T07:37:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 shutdown_connections 2024-09-16T07:37:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3c8073910 0x7fb3c8075dd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ec15c1f0 0x7fb3ec0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ec15be10 0x7fb3ec0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 --2- 172.21.15.114:0/2440656415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ec0b0b60 0x7fb3ec0b2760 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 >> 172.21.15.114:0/2440656415 conn(0x7fb3ec0d1da0 msgr2=0x7fb3ec151a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:04.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 shutdown_connections 2024-09-16T07:37:04.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.080+0000 7fb3f2800640 1 -- 172.21.15.114:0/2440656415 wait complete. 2024-09-16T07:37:04.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:04.095 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/8ae2882df6f712dcad24f86bf722efe7.meta) 2024-09-16T07:37:04.262 INFO:teuthology.orchestra.run.smithi114.stdout:[GLOBAL] 2024-09-16T07:37:04.262 INFO:teuthology.orchestra.run.smithi114.stdout:version = 1 2024-09-16T07:37:04.263 INFO:teuthology.orchestra.run.smithi114.stdout:type = subvolume 2024-09-16T07:37:04.263 INFO:teuthology.orchestra.run.smithi114.stdout:path = /volumes/subvol_grp39540/subvol34720 2024-09-16T07:37:04.263 INFO:teuthology.orchestra.run.smithi114.stdout:state = complete 2024-09-16T07:37:04.263 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:04.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol34720 subvol_grp39540 2024-09-16T07:37:04.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- 172.21.15.114:0/1472946987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a80b0b60 msgr2=0x7f42a80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 --2- 172.21.15.114:0/1472946987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a80b0b60 0x7f42a80ccbd0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f42a8073e00 tx=0x7f42a001f580 comp rx=0 tx=0).stop 2024-09-16T07:37:04.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- 172.21.15.114:0/1472946987 shutdown_connections 2024-09-16T07:37:04.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 --2- 172.21.15.114:0/1472946987 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a80b0b60 0x7f42a80ccbd0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 --2- 172.21.15.114:0/1472946987 >> v2:172.21.15.149:3300/0 conn(0x7f42a815be10 0x7f42a80ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- 172.21.15.114:0/1472946987 >> 172.21.15.114:0/1472946987 conn(0x7f42a80d1da0 msgr2=0x7f42a80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:04.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- 172.21.15.114:0/1472946987 shutdown_connections 2024-09-16T07:37:04.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- 172.21.15.114:0/1472946987 wait complete. 2024-09-16T07:37:04.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 Processor -- start 2024-09-16T07:37:04.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- start start 2024-09-16T07:37:04.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a80b0b60 0x7f42a80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a815be10 0x7f42a814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a815c1f0 0x7f42a80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80cd290 con 0x7f42a815be10 2024-09-16T07:37:04.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80cd110 con 0x7f42a80b0b60 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.420+0000 7f42acc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f42a80cd410 con 0x7f42a815c1f0 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a815be10 0x7f42a814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a815be10 0x7f42a814c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53964/0 (socket says 172.21.15.114:53964) 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 -- 172.21.15.114:0/554327217 learned_addr learned my addr 172.21.15.114:0/554327217 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5e00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a80b0b60 0x7f42a80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a6800640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a815c1f0 0x7f42a80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 -- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a815c1f0 msgr2=0x7f42a80b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a815c1f0 0x7f42a80b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 -- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a80b0b60 msgr2=0x7f42a80c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a80b0b60 0x7f42a80c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 -- 172.21.15.114:0/554327217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a814d2b0 con 0x7f42a815be10 2024-09-16T07:37:04.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42a5400640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a815be10 0x7f42a814c4f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f429400c420 tx=0x7f429400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:04.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f429e000640 1 -- 172.21.15.114:0/554327217 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294017070 con 0x7f42a815be10 2024-09-16T07:37:04.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f429e000640 1 -- 172.21.15.114:0/554327217 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42940053c0 con 0x7f42a815be10 2024-09-16T07:37:04.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f429e000640 1 -- 172.21.15.114:0/554327217 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294003860 con 0x7f42a815be10 2024-09-16T07:37:04.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a81f82d0 con 0x7f42a815be10 2024-09-16T07:37:04.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a81f8890 con 0x7f42a815be10 2024-09-16T07:37:04.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a81f8a90 con 0x7f42a815be10 2024-09-16T07:37:04.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.424+0000 7f429e000640 1 -- 172.21.15.114:0/554327217 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f429401a070 con 0x7f42a815be10 2024-09-16T07:37:04.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.428+0000 7f429e000640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4288073910 0x7f4288075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.428+0000 7f429e000640 1 -- 172.21.15.114:0/554327217 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f4294091bc0 con 0x7f42a815be10 2024-09-16T07:37:04.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.428+0000 7f42a5e00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4288073910 0x7f4288075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.428+0000 7f42a5e00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4288073910 0x7f4288075dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f429800bc00 tx=0x7f429800b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.432+0000 7f429e000640 1 -- 172.21.15.114:0/554327217 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f42a81f8a90 con 0x7f42a815be10 2024-09-16T07:37:04.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.624+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol34720", "group_name": "subvol_grp39540", "target": ["mon-mgr", ""]}) -- 0x7f42a80ccbd0 con 0x7f4288073910 2024-09-16T07:37:04.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.648+0000 7f429e000640 1 -- 172.21.15.114:0/554327217 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f42a80ccbd0 con 0x7f4288073910 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4288073910 msgr2=0x7f4288075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4288073910 0x7f4288075dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f429800bc00 tx=0x7f429800b390 comp rx=0 tx=0).stop 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a815be10 msgr2=0x7f42a814c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a815be10 0x7f42a814c4f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f429400c420 tx=0x7f429400c8e0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 shutdown_connections 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4288073910 0x7f4288075dd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f42a815c1f0 0x7f42a80b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42a815be10 0x7f42a814c4f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 --2- 172.21.15.114:0/554327217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f42a80b0b60 0x7f42a80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 >> 172.21.15.114:0/554327217 conn(0x7f42a80d1da0 msgr2=0x7f42a8071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 shutdown_connections 2024-09-16T07:37:04.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.652+0000 7f42acc00640 1 -- 172.21.15.114:0/554327217 wait complete. 2024-09-16T07:37:04.649 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.656+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.649 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.656+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.650 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.656+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.650 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.656+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.650 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.656+0000 7f4e14c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.667 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.672+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.667 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.672+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.667 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.672+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.667 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.672+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.667 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-16T07:37:04.672+0000 7f4e16000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T07:37:04.671 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T07:37:04.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T07:37:04.743 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-09-16T07:37:04.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T07:37:04.751 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp39540 2024-09-16T07:37:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.904+0000 7f44c1600640 1 -- 172.21.15.114:0/375526430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 msgr2=0x7f44a0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.904+0000 7f44c1600640 1 --2- 172.21.15.114:0/375526430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 0x7f44a0003e30 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009ee0 tx=0x7f44ac01d630 comp rx=0 tx=0).stop 2024-09-16T07:37:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.904+0000 7f44bb400640 1 -- 172.21.15.114:0/375526430 reap_dead start 2024-09-16T07:37:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- 172.21.15.114:0/375526430 shutdown_connections 2024-09-16T07:37:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- 172.21.15.114:0/375526430 >> 172.21.15.114:0/375526430 conn(0x7f44bc0d1dd0 msgr2=0x7f44bc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- 172.21.15.114:0/375526430 shutdown_connections 2024-09-16T07:37:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- 172.21.15.114:0/375526430 wait complete. 2024-09-16T07:37:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 Processor -- start 2024-09-16T07:37:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- start start 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 0x7f44bc1f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc0c58d0 0x7f44bc0c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44bc0b70f0 0x7f44bc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc166d20 con 0x7f44a0003a10 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc0b1430 con 0x7f44bc0c58d0 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44c1600640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f44bc166ea0 con 0x7f44bc0b70f0 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 0x7f44bc1f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 0x7f44bc1f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54028/0 (socket says 172.21.15.114:54028) 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 -- 172.21.15.114:0/3482552644 learned_addr learned my addr 172.21.15.114:0/3482552644 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44bb400640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44bc0b70f0 0x7f44bc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44ba000640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc0c58d0 0x7f44bc0c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 -- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44bc0b70f0 msgr2=0x7f44bc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44bc0b70f0 0x7f44bc0cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 -- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc0c58d0 msgr2=0x7f44bc0c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc0c58d0 0x7f44bc0c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 -- 172.21.15.114:0/3482552644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc0c5e20 con 0x7f44a0003a10 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44bb400640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44bc0b70f0 0x7f44bc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44ba000640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc0c58d0 0x7f44bc0c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.908+0000 7f44baa00640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 0x7f44bc1f9720 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0ae040 tx=0x7f44ac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44b2a00640 1 -- 172.21.15.114:0/3482552644 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac003b80 con 0x7f44a0003a10 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44b2a00640 1 -- 172.21.15.114:0/3482552644 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44ac003e10 con 0x7f44a0003a10 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44bc0c6100 con 0x7f44a0003a10 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44b2a00640 1 -- 172.21.15.114:0/3482552644 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac004270 con 0x7f44a0003a10 2024-09-16T07:37:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44bc0c66c0 con 0x7f44a0003a10 2024-09-16T07:37:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44bc0d0690 con 0x7f44a0003a10 2024-09-16T07:37:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44b2a00640 1 -- 172.21.15.114:0/3482552644 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f44ac004410 con 0x7f44a0003a10 2024-09-16T07:37:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44b2a00640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f449c0738e0 0x7f449c075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44b2a00640 1 -- 172.21.15.114:0/3482552644 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f44ac12ec20 con 0x7f44a0003a10 2024-09-16T07:37:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.912+0000 7f44ba000640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f449c0738e0 0x7f449c075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.916+0000 7f44ba000640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f449c0738e0 0x7f449c075da0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f44bc156590 tx=0x7f44a8000f20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:04.916+0000 7f44b2a00640 1 -- 172.21.15.114:0/3482552644 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f44ac0cd080 con 0x7f44a0003a10 2024-09-16T07:37:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.108+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp39540", "target": ["mon-mgr", ""]}) -- 0x7f44bc0ceae0 con 0x7f449c0738e0 2024-09-16T07:37:05.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44b2a00640 1 -- 172.21.15.114:0/3482552644 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f44bc0ceae0 con 0x7f449c0738e0 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f449c0738e0 msgr2=0x7f449c075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f449c0738e0 0x7f449c075da0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f44bc156590 tx=0x7f44a8000f20 comp rx=0 tx=0).stop 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 msgr2=0x7f44bc1f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 0x7f44bc1f9720 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0ae040 tx=0x7f44ac009b30 comp rx=0 tx=0).stop 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 shutdown_connections 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f449c0738e0 0x7f449c075da0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44bc0b70f0 0x7f44bc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44bc0c58d0 0x7f44bc0c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 --2- 172.21.15.114:0/3482552644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f44a0003a10 0x7f44bc1f9720 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 >> 172.21.15.114:0/3482552644 conn(0x7f44bc0d1dd0 msgr2=0x7f44bc0b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:05.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 shutdown_connections 2024-09-16T07:37:05.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.112+0000 7f44c1600640 1 -- 172.21.15.114:0/3482552644 wait complete. 2024-09-16T07:37:05.126 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T07:37:05.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:37:05.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T07:37:05.317 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T07:37:05.318 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:37:05.318 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:37:05.318 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:05.326 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:37:05.326 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:05.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:37:05.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.572+0000 7fb50ae00640 1 -- 172.21.15.114:0/4132324952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 msgr2=0x7fb4e8004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:05.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.572+0000 7fb50ae00640 1 --2- 172.21.15.114:0/4132324952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 0x7fb4e8004020 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b90 tx=0x7fb4f401d270 comp rx=0 tx=0).stop 2024-09-16T07:37:05.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.572+0000 7fb508e00640 1 -- 172.21.15.114:0/4132324952 reap_dead start 2024-09-16T07:37:05.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.572+0000 7fb50ae00640 1 -- 172.21.15.114:0/4132324952 shutdown_connections 2024-09-16T07:37:05.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.572+0000 7fb50ae00640 1 -- 172.21.15.114:0/4132324952 >> 172.21.15.114:0/4132324952 conn(0x7fb5040b2240 msgr2=0x7fb5040b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:05.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.572+0000 7fb50ae00640 1 -- 172.21.15.114:0/4132324952 shutdown_connections 2024-09-16T07:37:05.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.572+0000 7fb50ae00640 1 -- 172.21.15.114:0/4132324952 wait complete. 2024-09-16T07:37:05.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 Processor -- start 2024-09-16T07:37:05.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 -- start start 2024-09-16T07:37:05.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 0x7fb504165a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:05.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5040c54b0 0x7fb50414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb504149120 0x7fb5040b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb50416a770 con 0x7fb4e8003c20 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb50416a5f0 con 0x7fb5040c54b0 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb50416a8f0 con 0x7fb504149120 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 0x7fb504165a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 0x7fb504165a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54042/0 (socket says 172.21.15.114:54042) 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 -- 172.21.15.114:0/3084764446 learned_addr learned my addr 172.21.15.114:0/3084764446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503400640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5040c54b0 0x7fb50414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb508e00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb504149120 0x7fb5040b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 -- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb504149120 msgr2=0x7fb5040b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:05.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb504149120 0x7fb5040b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 -- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5040c54b0 msgr2=0x7fb50414c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5040c54b0 0x7fb50414c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 -- 172.21.15.114:0/3084764446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5040c5c20 con 0x7fb4e8003c20 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb503e00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 0x7fb504165a30 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b90 tx=0x7fb4f4005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb4fbe00640 1 -- 172.21.15.114:0/3084764446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40b1040 con 0x7fb4e8003c20 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb4fbe00640 1 -- 172.21.15.114:0/3084764446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4f40ac400 con 0x7fb4e8003c20 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50414fd60 con 0x7fb4e8003c20 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb4fbe00640 1 -- 172.21.15.114:0/3084764446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4004290 con 0x7fb4e8003c20 2024-09-16T07:37:05.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.576+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb504164f50 con 0x7fb4e8003c20 2024-09-16T07:37:05.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.580+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50406cc20 con 0x7fb4e8003c20 2024-09-16T07:37:05.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.580+0000 7fb4fbe00640 1 -- 172.21.15.114:0/3084764446 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7fb4f40bd020 con 0x7fb4e8003c20 2024-09-16T07:37:05.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.580+0000 7fb4fbe00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb4e40738e0 0x7fb4e4075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.580+0000 7fb4fbe00640 1 -- 172.21.15.114:0/3084764446 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fb4f412f6a0 con 0x7fb4e8003c20 2024-09-16T07:37:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.580+0000 7fb503400640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb4e40738e0 0x7fb4e4075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:05.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.580+0000 7fb503400640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb4e40738e0 0x7fb4e4075da0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb504150120 tx=0x7fb4f0006e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:05.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.584+0000 7fb4fbe00640 1 -- 172.21.15.114:0/3084764446 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb4f40c4020 con 0x7fb4e8003c20 2024-09-16T07:37:05.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb50406ae10 con 0x7fb4e8003c20 2024-09-16T07:37:05.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb4fbe00640 1 -- 172.21.15.114:0/3084764446 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v165) ==== 80+0+0 (secure 0 0 0) 0x7fb50406ae10 con 0x7fb4e8003c20 2024-09-16T07:37:05.761 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:37:05.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb4e40738e0 msgr2=0x7fb4e4075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb4e40738e0 0x7fb4e4075da0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb504150120 tx=0x7fb4f0006e30 comp rx=0 tx=0).stop 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 msgr2=0x7fb504165a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 0x7fb504165a30 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b90 tx=0x7fb4f4005590 comp rx=0 tx=0).stop 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 shutdown_connections 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb4e40738e0 0x7fb4e4075da0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb504149120 0x7fb5040b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5040c54b0 0x7fb50414c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 --2- 172.21.15.114:0/3084764446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e8003c20 0x7fb504165a30 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 >> 172.21.15.114:0/3084764446 conn(0x7fb5040b2240 msgr2=0x7fb5040737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 shutdown_connections 2024-09-16T07:37:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:05.764+0000 7fb50ae00640 1 -- 172.21.15.114:0/3084764446 wait complete. 2024-09-16T07:37:05.779 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T07:37:05.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:05.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T07:37:05.830 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:37:05.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:05.830 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T07:37:05.849 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:37:05.849 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:37:05.849 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:05.861 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:37:05.861 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:05.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T07:37:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 -- 172.21.15.114:0/3874629225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 msgr2=0x7f4f1c0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 --2- 172.21.15.114:0/3874629225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 0x7f4f1c0b14c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009840 tx=0x7f4f0c01c6d0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 -- 172.21.15.114:0/3874629225 shutdown_connections 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 --2- 172.21.15.114:0/3874629225 >> v2:172.21.15.149:3300/0 conn(0x7f4f1c0b2e80 0x7f4f1c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 --2- 172.21.15.114:0/3874629225 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 0x7f4f1c0b14c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 -- 172.21.15.114:0/3874629225 >> 172.21.15.114:0/3874629225 conn(0x7f4f1c0d1e30 msgr2=0x7f4f1c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 -- 172.21.15.114:0/3874629225 shutdown_connections 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 -- 172.21.15.114:0/3874629225 wait complete. 2024-09-16T07:37:06.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 Processor -- start 2024-09-16T07:37:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 -- start start 2024-09-16T07:37:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.064+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1c0b1f40 0x7f4f1c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f1c0b2e80 0x7f4f1c15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 0x7f4f1c06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c168e90 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c15f9e0 con 0x7f4f1c0b2e80 2024-09-16T07:37:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1c169010 con 0x7f4f1c15f490 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1c0b1f40 0x7f4f1c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1c0b1f40 0x7f4f1c1569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54050/0 (socket says 172.21.15.114:54050) 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 -- 172.21.15.114:0/1306393888 learned_addr learned my addr 172.21.15.114:0/1306393888 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1b400640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f1c0b2e80 0x7f4f1c15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f20a00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 0x7f4f1c06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 -- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 msgr2=0x7f4f1c06f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 0x7f4f1c06f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 -- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f1c0b2e80 msgr2=0x7f4f1c15e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f1c0b2e80 0x7f4f1c15e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 -- 172.21.15.114:0/1306393888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c157090 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f1be00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1c0b1f40 0x7f4f1c1569d0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009790 tx=0x7f4f0c0a65c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:06.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f13e00640 1 -- 172.21.15.114:0/1306393888 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0bc020 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f13e00640 1 -- 172.21.15.114:0/1306393888 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f0c0a6de0 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f13e00640 1 -- 172.21.15.114:0/1306393888 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c004260 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1c1fb250 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1c1fb810 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1c0cfda0 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.068+0000 7f4f13e00640 1 -- 172.21.15.114:0/1306393888 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 29) ==== 97998+0+0 (secure 0 0 0) 0x7f4f0c0a67b0 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.072+0000 7f4f13e00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4efc0738e0 0x7f4efc075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.072+0000 7f4f13e00640 1 -- 172.21.15.114:0/1306393888 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f4f0c12cd30 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.072+0000 7f4f1b400640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4efc0738e0 0x7f4efc075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.072+0000 7f4f1b400640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4efc0738e0 0x7f4efc075da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009600 tx=0x7f4f080091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:06.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.076+0000 7f4f13e00640 1 -- 172.21.15.114:0/1306393888 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f4f0c0c6060 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.252+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4f1c0cd410 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.252+0000 7f4f13e00640 1 -- 172.21.15.114:0/1306393888 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v165) ==== 80+0+0 (secure 0 0 0) 0x7f4f0c016410 con 0x7f4f1c0b1f40 2024-09-16T07:37:06.247 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-16T07:37:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4efc0738e0 msgr2=0x7f4efc075da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4efc0738e0 0x7f4efc075da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009600 tx=0x7f4f080091e0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1c0b1f40 msgr2=0x7f4f1c1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1c0b1f40 0x7f4f1c1569d0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009790 tx=0x7f4f0c0a65c0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 shutdown_connections 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4efc0738e0 0x7f4efc075da0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4f1c15f490 0x7f4f1c06f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f1c0b2e80 0x7f4f1c15e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 --2- 172.21.15.114:0/1306393888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f1c0b1f40 0x7f4f1c1569d0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 >> 172.21.15.114:0/1306393888 conn(0x7f4f1c0d1e30 msgr2=0x7f4f1c0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:06.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 shutdown_connections 2024-09-16T07:37:06.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.256+0000 7f4f22a00640 1 -- 172.21.15.114:0/1306393888 wait complete. 2024-09-16T07:37:06.269 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T07:37:06.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:06.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T07:37:06.297 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:37:06.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:06.298 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T07:37:06.355 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:37:06.355 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:37:06.355 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:06.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:37:06.365 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T07:37:06.365 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:37:06.365 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:06.410 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:37:06.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:37:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.556+0000 7fdc6a000640 1 -- 172.21.15.114:0/3422562157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 msgr2=0x7fdc4c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.556+0000 7fdc6a000640 1 --2- 172.21.15.114:0/3422562157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 0x7fdc4c003e30 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009b60 tx=0x7fdc5801d2b0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.556+0000 7fdc69600640 1 -- 172.21.15.114:0/3422562157 reap_dead start 2024-09-16T07:37:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.556+0000 7fdc6a000640 1 -- 172.21.15.114:0/3422562157 shutdown_connections 2024-09-16T07:37:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.556+0000 7fdc6a000640 1 -- 172.21.15.114:0/3422562157 >> 172.21.15.114:0/3422562157 conn(0x7fdc6409aa10 msgr2=0x7fdc6409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.556+0000 7fdc6a000640 1 -- 172.21.15.114:0/3422562157 shutdown_connections 2024-09-16T07:37:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.556+0000 7fdc6a000640 1 -- 172.21.15.114:0/3422562157 wait complete. 2024-09-16T07:37:06.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 Processor -- start 2024-09-16T07:37:06.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 -- start start 2024-09-16T07:37:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 0x7fdc641fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc640ccf90 0x7fdc640cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc6415f7a0 0x7fdc6415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdc64166f00 con 0x7fdc4c003a10 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdc64166d80 con 0x7fdc640ccf90 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdc64167080 con 0x7fdc6415f7a0 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 0x7fdc641fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 0x7fdc641fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54072/0 (socket says 172.21.15.114:54072) 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 -- 172.21.15.114:0/607367961 learned_addr learned my addr 172.21.15.114:0/607367961 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc63e00640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc640ccf90 0x7fdc640cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc69600640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc6415f7a0 0x7fdc6415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 -- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc6415f7a0 msgr2=0x7fdc6415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc6415f7a0 0x7fdc6415fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 -- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc640ccf90 msgr2=0x7fdc640cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc640ccf90 0x7fdc640cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 -- 172.21.15.114:0/607367961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc641fb7f0 con 0x7fdc4c003a10 2024-09-16T07:37:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc68c00640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 0x7fdc641fb2b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdc5801d0e0 tx=0x7fdc580055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc60c00640 1 -- 172.21.15.114:0/607367961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc580b1040 con 0x7fdc4c003a10 2024-09-16T07:37:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc60c00640 1 -- 172.21.15.114:0/607367961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc580bb070 con 0x7fdc4c003a10 2024-09-16T07:37:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc64161900 con 0x7fdc4c003a10 2024-09-16T07:37:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc60c00640 1 -- 172.21.15.114:0/607367961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58004290 con 0x7fdc4c003a10 2024-09-16T07:37:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.560+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc64161ec0 con 0x7fdc4c003a10 2024-09-16T07:37:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.564+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc640cd950 con 0x7fdc4c003a10 2024-09-16T07:37:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.564+0000 7fdc60c00640 1 -- 172.21.15.114:0/607367961 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fdc580046d0 con 0x7fdc4c003a10 2024-09-16T07:37:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.564+0000 7fdc60c00640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdc44073a90 0x7fdc44075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.564+0000 7fdc60c00640 1 -- 172.21.15.114:0/607367961 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fdc5812d840 con 0x7fdc4c003a10 2024-09-16T07:37:06.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.564+0000 7fdc63e00640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdc44073a90 0x7fdc44075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.564+0000 7fdc63e00640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdc44073a90 0x7fdc44075f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc6409fd00 tx=0x7fdc500091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.568+0000 7fdc60c00640 1 -- 172.21.15.114:0/607367961 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdc58016fc0 con 0x7fdc4c003a10 2024-09-16T07:37:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.772+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc64071a50 con 0x7fdc4c003a10 2024-09-16T07:37:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.772+0000 7fdc60c00640 1 -- 172.21.15.114:0/607367961 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+5239 (secure 0 0 0) 0x7fdc580f9c30 con 0x7fdc4c003a10 2024-09-16T07:37:06.767 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:06.768 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":124,"btime":"2024-09-16T07:37:02:299800+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3201169795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3201169795},{"type":"v1","addr":"172.21.15.149:6801","nonce":3201169795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/64911771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":64911771},{"type":"v1","addr":"172.21.15.149:6835","nonce":64911771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9168,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3812839687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3812839687},{"type":"v1","addr":"172.21.15.114:6834","nonce":3812839687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:48.170239+0000","modified":"2024-09-16T07:36:51.212927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9171":{"gid":9171,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/2790565513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2790565513},{"type":"v1","addr":"172.21.15.114:6835","nonce":2790565513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9171,"qdb_cluster":[9171]},"id":13}]} 2024-09-16T07:37:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 124 2024-09-16T07:37:06.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdc44073a90 msgr2=0x7fdc44075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdc44073a90 0x7fdc44075f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc6409fd00 tx=0x7fdc500091e0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 msgr2=0x7fdc641fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 0x7fdc641fb2b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdc5801d0e0 tx=0x7fdc580055d0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 shutdown_connections 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdc44073a90 0x7fdc44075f50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdc6415f7a0 0x7fdc6415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc640ccf90 0x7fdc640cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 --2- 172.21.15.114:0/607367961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc4c003a10 0x7fdc641fb2b0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 >> 172.21.15.114:0/607367961 conn(0x7fdc6409aa10 msgr2=0x7fdc64071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 shutdown_connections 2024-09-16T07:37:06.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.776+0000 7fdc6a000640 1 -- 172.21.15.114:0/607367961 wait complete. 2024-09-16T07:37:06.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 -- 172.21.15.114:0/3104293818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040d28e0 msgr2=0x7fb4040cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 --2- 172.21.15.114:0/3104293818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040d28e0 0x7fb4040cebb0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009bc0 tx=0x7fb3fc01cba0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 -- 172.21.15.114:0/3104293818 shutdown_connections 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 --2- 172.21.15.114:0/3104293818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040d28e0 0x7fb4040cebb0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 --2- 172.21.15.114:0/3104293818 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb40415bea0 0x7fb4040ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 -- 172.21.15.114:0/3104293818 >> 172.21.15.114:0/3104293818 conn(0x7fb4040d1dc0 msgr2=0x7fb4040d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 -- 172.21.15.114:0/3104293818 shutdown_connections 2024-09-16T07:37:06.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 -- 172.21.15.114:0/3104293818 wait complete. 2024-09-16T07:37:06.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 Processor -- start 2024-09-16T07:37:06.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.936+0000 7fb40a200640 1 -- start start 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cdb30 0x7fb4040c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4040d28e0 0x7fb4041f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415bea0 0x7fb4041fac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb404168f70 con 0x7fb4040cdb30 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb404168df0 con 0x7fb40415bea0 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb4041690f0 con 0x7fb4040d28e0 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cdb30 0x7fb4040c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cdb30 0x7fb4040c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54084/0 (socket says 172.21.15.114:54084) 2024-09-16T07:37:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 -- 172.21.15.114:0/2633419026 learned_addr learned my addr 172.21.15.114:0/2633419026 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:06.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb402a00640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4040d28e0 0x7fb4041f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403e00640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415bea0 0x7fb4041fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 -- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4040d28e0 msgr2=0x7fb4041f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4040d28e0 0x7fb4041f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 -- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415bea0 msgr2=0x7fb4041fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:06.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415bea0 0x7fb4041fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:06.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 -- 172.21.15.114:0/2633419026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4041fb5e0 con 0x7fb4040cdb30 2024-09-16T07:37:06.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb403400640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cdb30 0x7fb4040c7e60 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400e7a0 tx=0x7fb3f400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:06.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb3fb400640 1 -- 172.21.15.114:0/2633419026 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400ccc0 con 0x7fb4040cdb30 2024-09-16T07:37:06.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb3fb400640 1 -- 172.21.15.114:0/2633419026 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3f4010430 con 0x7fb4040cdb30 2024-09-16T07:37:06.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb3fb400640 1 -- 172.21.15.114:0/2633419026 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4010860 con 0x7fb4040cdb30 2024-09-16T07:37:06.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4041fb8c0 con 0x7fb4040cdb30 2024-09-16T07:37:06.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4041f8560 con 0x7fb4040cdb30 2024-09-16T07:37:06.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.940+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4040cc9d0 con 0x7fb4040cdb30 2024-09-16T07:37:06.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.944+0000 7fb3fb400640 1 -- 172.21.15.114:0/2633419026 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fb3f4010a00 con 0x7fb4040cdb30 2024-09-16T07:37:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.944+0000 7fb3fb400640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3e4073a90 0x7fb3e4075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.944+0000 7fb3fb400640 1 -- 172.21.15.114:0/2633419026 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fb3f4093220 con 0x7fb4040cdb30 2024-09-16T07:37:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.944+0000 7fb402a00640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3e4073a90 0x7fb3e4075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.944+0000 7fb402a00640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3e4073a90 0x7fb3e4075f50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb404153d60 tx=0x7fb3f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:06.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:06.948+0000 7fb3fb400640 1 -- 172.21.15.114:0/2633419026 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb3f405fec0 con 0x7fb4040cdb30 2024-09-16T07:37:07.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4040b0980 con 0x7fb4040cdb30 2024-09-16T07:37:07.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb3fb400640 1 -- 172.21.15.114:0/2633419026 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+5239 (secure 0 0 0) 0x7fb3f405f7c0 con 0x7fb4040cdb30 2024-09-16T07:37:07.141 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:07.142 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":124,"btime":"2024-09-16T07:37:02:299800+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3201169795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3201169795},{"type":"v1","addr":"172.21.15.149:6801","nonce":3201169795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/64911771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":64911771},{"type":"v1","addr":"172.21.15.149:6835","nonce":64911771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9168,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3812839687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3812839687},{"type":"v1","addr":"172.21.15.114:6834","nonce":3812839687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:48.170239+0000","modified":"2024-09-16T07:36:51.212927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9171":{"gid":9171,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/2790565513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2790565513},{"type":"v1","addr":"172.21.15.114:6835","nonce":2790565513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9171,"qdb_cluster":[9171]},"id":13}]} 2024-09-16T07:37:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 124 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3e4073a90 msgr2=0x7fb3e4075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3e4073a90 0x7fb3e4075f50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb404153d60 tx=0x7fb3f0009040 comp rx=0 tx=0).stop 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cdb30 msgr2=0x7fb4040c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cdb30 0x7fb4040c7e60 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400e7a0 tx=0x7fb3f400ec60 comp rx=0 tx=0).stop 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 shutdown_connections 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb40415bea0 0x7fb4041fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb3e4073a90 0x7fb3e4075f50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb4040d28e0 0x7fb4041f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 --2- 172.21.15.114:0/2633419026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4040cdb30 0x7fb4040c7e60 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 >> 172.21.15.114:0/2633419026 conn(0x7fb4040d1dc0 msgr2=0x7fb4040d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 shutdown_connections 2024-09-16T07:37:07.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.148+0000 7fb40a200640 1 -- 172.21.15.114:0/2633419026 wait complete. 2024-09-16T07:37:07.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:37:07.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 -- 172.21.15.114:0/277489800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac15f000 msgr2=0x7fb3ac0d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 --2- 172.21.15.114:0/277489800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac15f000 0x7fb3ac0d01b0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009840 tx=0x7fb39c01c790 comp rx=0 tx=0).stop 2024-09-16T07:37:07.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 -- 172.21.15.114:0/277489800 shutdown_connections 2024-09-16T07:37:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 --2- 172.21.15.114:0/277489800 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ac0b2590 0x7fb3ac0b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 --2- 172.21.15.114:0/277489800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac15f000 0x7fb3ac0d01b0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 -- 172.21.15.114:0/277489800 >> 172.21.15.114:0/277489800 conn(0x7fb3ac09aa10 msgr2=0x7fb3ac09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:07.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 -- 172.21.15.114:0/277489800 shutdown_connections 2024-09-16T07:37:07.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 -- 172.21.15.114:0/277489800 wait complete. 2024-09-16T07:37:07.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 Processor -- start 2024-09-16T07:37:07.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.308+0000 7fb3abe00640 1 -- start start 2024-09-16T07:37:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ac0b2590 0x7fb3ac1528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0cefb0 0x7fb3ac0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ac15f000 0x7fb3ac0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac168f00 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac168d80 con 0x7fb3ac15f000 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ac169080 con 0x7fb3ac0b2590 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0cefb0 0x7fb3ac0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0cefb0 0x7fb3ac0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54090/0 (socket says 172.21.15.114:54090) 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 -- 172.21.15.114:0/2102880434 learned_addr learned my addr 172.21.15.114:0/2102880434 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aaa00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ac0b2590 0x7fb3ac1528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3ab400640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ac15f000 0x7fb3ac0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 -- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ac0b2590 msgr2=0x7fb3ac1528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ac0b2590 0x7fb3ac1528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 -- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ac15f000 msgr2=0x7fb3ac0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ac15f000 0x7fb3ac0cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 -- 172.21.15.114:0/2102880434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac152de0 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3ab400640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ac15f000 0x7fb3ac0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:37:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aaa00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ac0b2590 0x7fb3ac1528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:37:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3aa000640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0cefb0 0x7fb3ac0cd140 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fb39800c450 tx=0x7fb39800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3a3400640 1 -- 172.21.15.114:0/2102880434 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398016020 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3a3400640 1 -- 172.21.15.114:0/2102880434 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb398012920 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac154fe0 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3a3400640 1 -- 172.21.15.114:0/2102880434 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398012d70 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac155620 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.312+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ac0b29e0 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.316+0000 7fb3a3400640 1 -- 172.21.15.114:0/2102880434 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fb398019020 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.316+0000 7fb3a3400640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb38c073a90 0x7fb38c075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.316+0000 7fb3a3400640 1 -- 172.21.15.114:0/2102880434 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fb398092740 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.316+0000 7fb3aaa00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb38c073a90 0x7fb38c075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.316+0000 7fb3aaa00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb38c073a90 0x7fb38c075f50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0ae000 tx=0x7fb39c01afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.320+0000 7fb3a3400640 1 -- 172.21.15.114:0/2102880434 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb398020030 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.488+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3ac09b130 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3a3400640 1 -- 172.21.15.114:0/2102880434 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16835 (secure 0 0 0) 0x7fb3ac0cf400 con 0x7fb3ac0cefb0 2024-09-16T07:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:07.486 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":165,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:49.795356+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:45.857532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:47.134690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb38c073a90 msgr2=0x7fb38c075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb38c073a90 0x7fb38c075f50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0ae000 tx=0x7fb39c01afd0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0cefb0 msgr2=0x7fb3ac0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0cefb0 0x7fb3ac0cd140 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fb39800c450 tx=0x7fb39800c910 comp rx=0 tx=0).stop 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 shutdown_connections 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3ac15f000 0x7fb3ac0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb3ac0cefb0 0x7fb3ac0cd140 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb38c073a90 0x7fb38c075f50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 --2- 172.21.15.114:0/2102880434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3ac0b2590 0x7fb3ac1528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 >> 172.21.15.114:0/2102880434 conn(0x7fb3ac09aa10 msgr2=0x7fb3ac0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 shutdown_connections 2024-09-16T07:37:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.492+0000 7fb3abe00640 1 -- 172.21.15.114:0/2102880434 wait complete. 2024-09-16T07:37:07.509 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:37:07.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:37:07.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 -- 172.21.15.114:0/865162572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500cdb30 msgr2=0x7f6a500cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 --2- 172.21.15.114:0/865162572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500cdb30 0x7f6a500cebb0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f6a500cdf50 tx=0x7f6a3c01c8c0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 -- 172.21.15.114:0/865162572 shutdown_connections 2024-09-16T07:37:07.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 --2- 172.21.15.114:0/865162572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500cdb30 0x7f6a500cebb0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 --2- 172.21.15.114:0/865162572 >> v2:172.21.15.149:3300/0 conn(0x7f6a500d28e0 0x7f6a500cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 --2- 172.21.15.114:0/865162572 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a5015bea0 0x7f6a500ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 -- 172.21.15.114:0/865162572 >> 172.21.15.114:0/865162572 conn(0x7f6a500d1dc0 msgr2=0x7f6a500d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:07.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 -- 172.21.15.114:0/865162572 shutdown_connections 2024-09-16T07:37:07.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 -- 172.21.15.114:0/865162572 wait complete. 2024-09-16T07:37:07.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 Processor -- start 2024-09-16T07:37:07.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.656+0000 7f6a57c00640 1 -- start start 2024-09-16T07:37:07.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a500cdb30 0x7f6a50152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500d28e0 0x7f6a50070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5015bea0 0x7f6a500714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6a500af0a0 con 0x7f6a500d28e0 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a500aef20 con 0x7f6a5015bea0 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6a500af220 con 0x7f6a500cdb30 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500d28e0 0x7f6a50070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500d28e0 0x7f6a50070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54104/0 (socket says 172.21.15.114:54104) 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 -- 172.21.15.114:0/930959294 learned_addr learned my addr 172.21.15.114:0/930959294 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a55c00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5015bea0 0x7f6a500714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a55200640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a500cdb30 0x7f6a50152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 -- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a500cdb30 msgr2=0x7f6a50152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a500cdb30 0x7f6a50152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 -- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5015bea0 msgr2=0x7f6a500714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5015bea0 0x7f6a500714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 -- 172.21.15.114:0/930959294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a50153690 con 0x7f6a500d28e0 2024-09-16T07:37:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4fe00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500d28e0 0x7f6a50070fa0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0b0040 tx=0x7f6a3c0a6f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4cc00640 1 -- 172.21.15.114:0/930959294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0b2040 con 0x7f6a500d28e0 2024-09-16T07:37:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4cc00640 1 -- 172.21.15.114:0/930959294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a3c0044a0 con 0x7f6a500d28e0 2024-09-16T07:37:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a500cbd30 con 0x7f6a500d28e0 2024-09-16T07:37:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4cc00640 1 -- 172.21.15.114:0/930959294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0052d0 con 0x7f6a500d28e0 2024-09-16T07:37:07.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a500b2cf0 con 0x7f6a500d28e0 2024-09-16T07:37:07.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a500cc9d0 con 0x7f6a500d28e0 2024-09-16T07:37:07.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.660+0000 7f6a4cc00640 1 -- 172.21.15.114:0/930959294 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f6a3c005470 con 0x7f6a500d28e0 2024-09-16T07:37:07.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.664+0000 7f6a4cc00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a30073a90 0x7f6a30075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:07.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.664+0000 7f6a4cc00640 1 -- 172.21.15.114:0/930959294 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f6a3c12c490 con 0x7f6a500d28e0 2024-09-16T07:37:07.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.664+0000 7f6a55200640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a30073a90 0x7f6a30075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:07.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.664+0000 7f6a55200640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a30073a90 0x7f6a30075f50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a44004630 tx=0x7f6a4400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:07.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.668+0000 7f6a4cc00640 1 -- 172.21.15.114:0/930959294 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6a50153690 con 0x7f6a500d28e0 2024-09-16T07:37:07.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a500b6140 con 0x7f6a500d28e0 2024-09-16T07:37:07.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a4cc00640 1 -- 172.21.15.114:0/930959294 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+5239 (secure 0 0 0) 0x7f6a3c0164b0 con 0x7f6a500d28e0 2024-09-16T07:37:07.867 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:07.867 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":124,"btime":"2024-09-16T07:37:02:299800+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3201169795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3201169795},{"type":"v1","addr":"172.21.15.149:6801","nonce":3201169795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/64911771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":64911771},{"type":"v1","addr":"172.21.15.149:6835","nonce":64911771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9168,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3812839687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3812839687},{"type":"v1","addr":"172.21.15.114:6834","nonce":3812839687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:48.170239+0000","modified":"2024-09-16T07:36:51.212927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9171":{"gid":9171,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/2790565513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2790565513},{"type":"v1","addr":"172.21.15.114:6835","nonce":2790565513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9171,"qdb_cluster":[9171]},"id":13}]} 2024-09-16T07:37:07.867 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 124 2024-09-16T07:37:07.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a30073a90 msgr2=0x7f6a30075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a30073a90 0x7f6a30075f50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a44004630 tx=0x7f6a4400b2e0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500d28e0 msgr2=0x7f6a50070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:07.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500d28e0 0x7f6a50070fa0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0b0040 tx=0x7f6a3c0a6f60 comp rx=0 tx=0).stop 2024-09-16T07:37:07.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 shutdown_connections 2024-09-16T07:37:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a5015bea0 0x7f6a500714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6a500d28e0 0x7f6a50070fa0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6a30073a90 0x7f6a30075f50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 --2- 172.21.15.114:0/930959294 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6a500cdb30 0x7f6a50152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 >> 172.21.15.114:0/930959294 conn(0x7f6a500d1dc0 msgr2=0x7f6a500d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.872+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 shutdown_connections 2024-09-16T07:37:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:07.876+0000 7f6a57c00640 1 -- 172.21.15.114:0/930959294 wait complete. 2024-09-16T07:37:07.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:37:08.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.032+0000 7efd0c800640 1 -- 172.21.15.114:0/2491534803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0406e7a0 msgr2=0x7efd0406ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.032+0000 7efd0c800640 1 --2- 172.21.15.114:0/2491534803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0406e7a0 0x7efd0406ec50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd00009bf0 tx=0x7efd0001f390 comp rx=0 tx=0).stop 2024-09-16T07:37:08.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.032+0000 7efd0c800640 1 -- 172.21.15.114:0/2491534803 shutdown_connections 2024-09-16T07:37:08.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.032+0000 7efd0c800640 1 --2- 172.21.15.114:0/2491534803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0406e7a0 0x7efd0406ec50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.032+0000 7efd0c800640 1 --2- 172.21.15.114:0/2491534803 >> v2:172.21.15.149:3300/0 conn(0x7efd0415c3e0 0x7efd0415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.032+0000 7efd0c800640 1 -- 172.21.15.114:0/2491534803 >> 172.21.15.114:0/2491534803 conn(0x7efd040b18f0 msgr2=0x7efd040b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:08.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 -- 172.21.15.114:0/2491534803 shutdown_connections 2024-09-16T07:37:08.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 -- 172.21.15.114:0/2491534803 wait complete. 2024-09-16T07:37:08.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 Processor -- start 2024-09-16T07:37:08.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 -- start start 2024-09-16T07:37:08.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd0406e7a0 0x7efd0415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0415bfa0 0x7efd041f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0415c3e0 0x7efd041f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efd0406f310 con 0x7efd0415c3e0 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd0406f190 con 0x7efd0406e7a0 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0c800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7efd0406f490 con 0x7efd0415bfa0 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0415c3e0 0x7efd041f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0415c3e0 0x7efd041f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54110/0 (socket says 172.21.15.114:54110) 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 -- 172.21.15.114:0/530157469 learned_addr learned my addr 172.21.15.114:0/530157469 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd09e00640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd0406e7a0 0x7efd0415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd09400640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0415bfa0 0x7efd041f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 -- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0415bfa0 msgr2=0x7efd041f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0415bfa0 0x7efd041f7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 -- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd0406e7a0 msgr2=0x7efd0415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd0406e7a0 0x7efd0415dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 -- 172.21.15.114:0/530157469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0415e620 con 0x7efd0415c3e0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.036+0000 7efd0a800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0415c3e0 0x7efd041f81f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7efd0001cfc0 tx=0x7efd00009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efcfe000640 1 -- 172.21.15.114:0/530157469 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd000b4040 con 0x7efd0415c3e0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efcfe000640 1 -- 172.21.15.114:0/530157469 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd00004b40 con 0x7efd0415c3e0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0415e900 con 0x7efd0415c3e0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efcfe000640 1 -- 172.21.15.114:0/530157469 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd000af8a0 con 0x7efd0415c3e0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0415eec0 con 0x7efd0415c3e0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0406ec50 con 0x7efd0415c3e0 2024-09-16T07:37:08.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efcfe000640 1 -- 172.21.15.114:0/530157469 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7efd000c1020 con 0x7efd0415c3e0 2024-09-16T07:37:08.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efcfe000640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efce8073ac0 0x7efce8075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efcfe000640 1 -- 172.21.15.114:0/530157469 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7efd00130490 con 0x7efd0415c3e0 2024-09-16T07:37:08.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.040+0000 7efd09e00640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efce8073ac0 0x7efce8075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.044+0000 7efd09e00640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efce8073ac0 0x7efce8075f80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009600 tx=0x7efcf80091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:08.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.044+0000 7efcfe000640 1 -- 172.21.15.114:0/530157469 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7efd00018ef0 con 0x7efd0415c3e0 2024-09-16T07:37:08.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd0415f230 con 0x7efd0415c3e0 2024-09-16T07:37:08.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efcfe000640 1 -- 172.21.15.114:0/530157469 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) ==== 95+0+5239 (secure 0 0 0) 0x7efd000fc800 con 0x7efd0415c3e0 2024-09-16T07:37:08.242 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:08.242 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":124,"btime":"2024-09-16T07:37:02:299800+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3201169795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3201169795},{"type":"v1","addr":"172.21.15.149:6801","nonce":3201169795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/64911771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":64911771},{"type":"v1","addr":"172.21.15.149:6835","nonce":64911771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9168,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3812839687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3812839687},{"type":"v1","addr":"172.21.15.114:6834","nonce":3812839687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T07:36:48.170239+0000","modified":"2024-09-16T07:36:51.212927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9171":{"gid":9171,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.114:6835/2790565513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2790565513},{"type":"v1","addr":"172.21.15.114:6835","nonce":2790565513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9171,"qdb_cluster":[9171]},"id":13}]} 2024-09-16T07:37:08.242 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 124 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efce8073ac0 msgr2=0x7efce8075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efce8073ac0 0x7efce8075f80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009600 tx=0x7efcf80091e0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0415c3e0 msgr2=0x7efd041f81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0415c3e0 0x7efd041f81f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7efd0001cfc0 tx=0x7efd00009300 comp rx=0 tx=0).stop 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 shutdown_connections 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0415c3e0 0x7efd041f81f0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7efce8073ac0 0x7efce8075f80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7efd0415bfa0 0x7efd041f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 --2- 172.21.15.114:0/530157469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd0406e7a0 0x7efd0415dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 >> 172.21.15.114:0/530157469 conn(0x7efd040b18f0 msgr2=0x7efd041577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 shutdown_connections 2024-09-16T07:37:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.248+0000 7efd0c800640 1 -- 172.21.15.114:0/530157469 wait complete. 2024-09-16T07:37:08.264 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:37:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- 172.21.15.114:0/1412832038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 msgr2=0x7f27600ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 --2- 172.21.15.114:0/1412832038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 0x7f27600ce670 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2750009840 tx=0x7f275001c820 comp rx=0 tx=0).stop 2024-09-16T07:37:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- 172.21.15.114:0/1412832038 shutdown_connections 2024-09-16T07:37:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 --2- 172.21.15.114:0/1412832038 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27600d28e0 0x7f27600cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 --2- 172.21.15.114:0/1412832038 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 0x7f27600ce670 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- 172.21.15.114:0/1412832038 >> 172.21.15.114:0/1412832038 conn(0x7f27600d1dc0 msgr2=0x7f27600d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- 172.21.15.114:0/1412832038 shutdown_connections 2024-09-16T07:37:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- 172.21.15.114:0/1412832038 wait complete. 2024-09-16T07:37:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 Processor -- start 2024-09-16T07:37:08.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- start start 2024-09-16T07:37:08.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27600cdb30 0x7f2760156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27600d28e0 0x7f2760166080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 0x7f276006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2760168fc0 con 0x7f27600cdb30 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2760168e40 con 0x7f276015bea0 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.412+0000 7f2767000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f2760169140 con 0x7f27600d28e0 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27600cdb30 0x7f2760156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27600cdb30 0x7f2760156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54112/0 (socket says 172.21.15.114:54112) 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 -- 172.21.15.114:0/1127107021 learned_addr learned my addr 172.21.15.114:0/1127107021 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2765000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 0x7f276006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275f400640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27600d28e0 0x7f2760166080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 -- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27600d28e0 msgr2=0x7f2760166080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27600d28e0 0x7f2760166080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 -- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 msgr2=0x7f276006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 0x7f276006dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 -- 172.21.15.114:0/1127107021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27600c74a0 con 0x7f27600cdb30 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2765000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 0x7f276006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f275fe00640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27600cdb30 0x7f2760156b70 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f2750009790 tx=0x7f2750005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2757e00640 1 -- 172.21.15.114:0/1127107021 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500b2040 con 0x7f27600cdb30 2024-09-16T07:37:08.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2757e00640 1 -- 172.21.15.114:0/1127107021 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27500043e0 con 0x7f27600cdb30 2024-09-16T07:37:08.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27600c7720 con 0x7f27600cdb30 2024-09-16T07:37:08.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2757e00640 1 -- 172.21.15.114:0/1127107021 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27500052d0 con 0x7f27600cdb30 2024-09-16T07:37:08.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27600c79e0 con 0x7f27600cdb30 2024-09-16T07:37:08.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27600cc9d0 con 0x7f27600cdb30 2024-09-16T07:37:08.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.416+0000 7f2757e00640 1 -- 172.21.15.114:0/1127107021 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f27500a5770 con 0x7f27600cdb30 2024-09-16T07:37:08.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.420+0000 7f2757e00640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2740073ac0 0x7f2740075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.420+0000 7f2757e00640 1 -- 172.21.15.114:0/1127107021 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7f275012c7d0 con 0x7f27600cdb30 2024-09-16T07:37:08.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.420+0000 7f275f400640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2740073ac0 0x7f2740075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.420+0000 7f275f400640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2740073ac0 0x7f2740075f80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f276015bc10 tx=0x7f274c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:08.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.424+0000 7f2757e00640 1 -- 172.21.15.114:0/1127107021 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f27500bd060 con 0x7f27600cdb30 2024-09-16T07:37:08.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.592+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f276006add0 con 0x7f27600cdb30 2024-09-16T07:37:08.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.592+0000 7f2757e00640 1 -- 172.21.15.114:0/1127107021 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16835 (secure 0 0 0) 0x7f27600c74a0 con 0x7f27600cdb30 2024-09-16T07:37:08.587 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:08.587 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":165,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:36:49.795356+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-16T07:36:45.857532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-16T07:36:47.134690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:37:08.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2740073ac0 msgr2=0x7f2740075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2740073ac0 0x7f2740075f80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f276015bc10 tx=0x7f274c009040 comp rx=0 tx=0).stop 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27600cdb30 msgr2=0x7f2760156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27600cdb30 0x7f2760156b70 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f2750009790 tx=0x7f2750005d90 comp rx=0 tx=0).stop 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 shutdown_connections 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f276015bea0 0x7f276006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f2740073ac0 0x7f2740075f80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27600d28e0 0x7f2760166080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 --2- 172.21.15.114:0/1127107021 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27600cdb30 0x7f2760156b70 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 >> 172.21.15.114:0/1127107021 conn(0x7f27600d1dc0 msgr2=0x7f27600b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 shutdown_connections 2024-09-16T07:37:08.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.596+0000 7f2767000640 1 -- 172.21.15.114:0/1127107021 wait complete. 2024-09-16T07:37:08.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 -- 172.21.15.114:0/1392922390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8480d01b0 msgr2=0x7fd8480cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 --2- 172.21.15.114:0/1392922390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8480d01b0 0x7fd8480cefb0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fd830009900 tx=0x7fd83001c850 comp rx=0 tx=0).stop 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 -- 172.21.15.114:0/1392922390 shutdown_connections 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 --2- 172.21.15.114:0/1392922390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8480b2590 0x7fd8480b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 --2- 172.21.15.114:0/1392922390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8480d01b0 0x7fd8480cefb0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 -- 172.21.15.114:0/1392922390 >> 172.21.15.114:0/1392922390 conn(0x7fd84809aa10 msgr2=0x7fd84809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 -- 172.21.15.114:0/1392922390 shutdown_connections 2024-09-16T07:37:08.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.756+0000 7fd84d800640 1 -- 172.21.15.114:0/1392922390 wait complete. 2024-09-16T07:37:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 Processor -- start 2024-09-16T07:37:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 -- start start 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8480b2590 0x7fd848148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8480d01b0 0x7fd8480c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd84815f000 0x7fd8480c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd848168f00 con 0x7fd84815f000 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd848168d80 con 0x7fd8480b2590 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd848169080 con 0x7fd8480d01b0 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd84815f000 0x7fd8480c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd84815f000 0x7fd8480c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54126/0 (socket says 172.21.15.114:54126) 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 -- 172.21.15.114:0/3768820480 learned_addr learned my addr 172.21.15.114:0/3768820480 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd847e00640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8480b2590 0x7fd848148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd83f400640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8480d01b0 0x7fd8480c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 -- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8480d01b0 msgr2=0x7fd8480c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8480d01b0 0x7fd8480c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 -- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8480b2590 msgr2=0x7fd848148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8480b2590 0x7fd848148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 -- 172.21.15.114:0/3768820480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8480c7240 con 0x7fd84815f000 2024-09-16T07:37:08.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84ce00640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd84815f000 0x7fd8480c6bc0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e8c0 tx=0x7fd84000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd844c00640 1 -- 172.21.15.114:0/3768820480 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84000ccc0 con 0x7fd84815f000 2024-09-16T07:37:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd844c00640 1 -- 172.21.15.114:0/3768820480 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd84000ce60 con 0x7fd84815f000 2024-09-16T07:37:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd844c00640 1 -- 172.21.15.114:0/3768820480 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840005280 con 0x7fd84815f000 2024-09-16T07:37:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8481f8ee0 con 0x7fd84815f000 2024-09-16T07:37:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8481f94a0 con 0x7fd84815f000 2024-09-16T07:37:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.760+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8480b29e0 con 0x7fd84815f000 2024-09-16T07:37:08.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.764+0000 7fd844c00640 1 -- 172.21.15.114:0/3768820480 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fd840005420 con 0x7fd84815f000 2024-09-16T07:37:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.764+0000 7fd844c00640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd824073a90 0x7fd824075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.764+0000 7fd844c00640 1 -- 172.21.15.114:0/3768820480 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5737+0+0 (secure 0 0 0) 0x7fd8400931a0 con 0x7fd84815f000 2024-09-16T07:37:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.764+0000 7fd847e00640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd824073a90 0x7fd824075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:08.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.764+0000 7fd847e00640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd824073a90 0x7fd824075f50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd848155f40 tx=0x7fd838009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:08.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.768+0000 7fd844c00640 1 -- 172.21.15.114:0/3768820480 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd8480c7240 con 0x7fd84815f000 2024-09-16T07:37:08.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.968+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd848071660 con 0x7fd84815f000 2024-09-16T07:37:08.964 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-16T07:37:08.968+0000 7f5f58800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T07:37:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.972+0000 7fd844c00640 1 -- 172.21.15.114:0/3768820480 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v125) ==== 161+0+0 (secure 0 0 0) 0x7fd84005f7f0 con 0x7fd84815f000 2024-09-16T07:37:08.966 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T07:37:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd824073a90 msgr2=0x7fd824075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd824073a90 0x7fd824075f50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd848155f40 tx=0x7fd838009040 comp rx=0 tx=0).stop 2024-09-16T07:37:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd84815f000 msgr2=0x7fd8480c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:08.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd84815f000 0x7fd8480c6bc0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e8c0 tx=0x7fd84000ed80 comp rx=0 tx=0).stop 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 shutdown_connections 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd84815f000 0x7fd8480c6bc0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd824073a90 0x7fd824075f50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd8480d01b0 0x7fd8480c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 --2- 172.21.15.114:0/3768820480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8480b2590 0x7fd848148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 >> 172.21.15.114:0/3768820480 conn(0x7fd84809aa10 msgr2=0x7fd8480ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 shutdown_connections 2024-09-16T07:37:08.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:08.976+0000 7fd84d800640 1 -- 172.21.15.114:0/3768820480 wait complete. 2024-09-16T07:37:08.989 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T07:37:09.033 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 -- 172.21.15.114:0/4045521930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d29b0 msgr2=0x7f5bf80b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 --2- 172.21.15.114:0/4045521930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d29b0 0x7f5bf80b1cf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5be0009840 tx=0x7f5be001f010 comp rx=0 tx=0).stop 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 -- 172.21.15.114:0/4045521930 shutdown_connections 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 --2- 172.21.15.114:0/4045521930 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5bf80d04d0 0x7f5bf80af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 --2- 172.21.15.114:0/4045521930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d29b0 0x7f5bf80b1cf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 -- 172.21.15.114:0/4045521930 >> 172.21.15.114:0/4045521930 conn(0x7f5bf80d1e90 msgr2=0x7f5bf80d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 -- 172.21.15.114:0/4045521930 shutdown_connections 2024-09-16T07:37:09.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.144+0000 7f5bfd200640 1 -- 172.21.15.114:0/4045521930 wait complete. 2024-09-16T07:37:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 Processor -- start 2024-09-16T07:37:09.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 -- start start 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5bf80d00f0 0x7f5bf806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d04d0 0x7f5bf815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf80d29b0 0x7f5bf815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf80b0ed0 con 0x7f5bf80d29b0 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf80b0d50 con 0x7f5bf80d04d0 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf80af740 con 0x7f5bf80d00f0 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf80d29b0 0x7f5bf815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:09.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf80d29b0 0x7f5bf815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54152/0 (socket says 172.21.15.114:54152) 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 -- 172.21.15.114:0/2357736672 learned_addr learned my addr 172.21.15.114:0/2357736672 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bed400640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d04d0 0x7f5bf815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf5e00640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5bf80d00f0 0x7f5bf806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 -- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5bf80d00f0 msgr2=0x7f5bf806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5bf80d00f0 0x7f5bf806f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 -- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d04d0 msgr2=0x7f5bf815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d04d0 0x7f5bf815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 -- 172.21.15.114:0/2357736672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf806cff0 con 0x7f5bf80d29b0 2024-09-16T07:37:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bf6800640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf80d29b0 0x7f5bf815ccc0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000eb20 tx=0x7f5bf000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5beea00640 1 -- 172.21.15.114:0/2357736672 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004b30 con 0x7f5bf80d29b0 2024-09-16T07:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5beea00640 1 -- 172.21.15.114:0/2357736672 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bf0004cf0 con 0x7f5bf80d29b0 2024-09-16T07:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5beea00640 1 -- 172.21.15.114:0/2357736672 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0005280 con 0x7f5bf80d29b0 2024-09-16T07:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf80cfa40 con 0x7f5bf80d29b0 2024-09-16T07:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81f8700 con 0x7f5bf80d29b0 2024-09-16T07:37:09.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.148+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf80af200 con 0x7f5bf80d29b0 2024-09-16T07:37:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.152+0000 7f5beea00640 1 -- 172.21.15.114:0/2357736672 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f5bf0005420 con 0x7f5bf80d29b0 2024-09-16T07:37:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.152+0000 7f5beea00640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5bd4073a90 0x7f5bd4075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:09.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.152+0000 7f5beea00640 1 -- 172.21.15.114:0/2357736672 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5823+0+0 (secure 0 0 0) 0x7f5bf0093480 con 0x7f5bf80d29b0 2024-09-16T07:37:09.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.152+0000 7f5bf5e00640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5bd4073a90 0x7f5bd4075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:09.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.152+0000 7f5bf5e00640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5bd4073a90 0x7f5bd4075f50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000f70 tx=0x7f5be8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.156+0000 7f5beea00640 1 -- 172.21.15.114:0/2357736672 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5bf005fa50 con 0x7f5bf80d29b0 2024-09-16T07:37:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.360+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5bf815b6f0 con 0x7f5bf80d29b0 2024-09-16T07:37:09.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.972+0000 7f5beea00640 1 -- 172.21.15.114:0/2357736672 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v126) ==== 104+0+0 (secure 0 0 0) 0x7f5bf0064480 con 0x7f5bf80d29b0 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5bd4073a90 msgr2=0x7f5bd4075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5bd4073a90 0x7f5bd4075f50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5be8000f70 tx=0x7f5be8009040 comp rx=0 tx=0).stop 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf80d29b0 msgr2=0x7f5bf815ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf80d29b0 0x7f5bf815ccc0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000eb20 tx=0x7f5bf000c2d0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 shutdown_connections 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf80d29b0 0x7f5bf815ccc0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5bf80d04d0 0x7f5bf815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5bd4073a90 0x7f5bd4075f50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 --2- 172.21.15.114:0/2357736672 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5bf80d00f0 0x7f5bf806f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 >> 172.21.15.114:0/2357736672 conn(0x7f5bf80d1e90 msgr2=0x7f5bf8072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 shutdown_connections 2024-09-16T07:37:09.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:09.976+0000 7f5bfd200640 1 -- 172.21.15.114:0/2357736672 wait complete. 2024-09-16T07:37:09.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T07:37:10.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.188+0000 7f575c400640 1 -- 172.21.15.114:0/2006389722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f573c005920 msgr2=0x7f573c005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.188+0000 7f575c400640 1 --2- 172.21.15.114:0/2006389722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f573c005920 0x7f573c005da0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f5740006f90 tx=0x7f574001f610 comp rx=0 tx=0).stop 2024-09-16T07:37:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.188+0000 7f575c400640 1 -- 172.21.15.114:0/2006389722 shutdown_connections 2024-09-16T07:37:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.188+0000 7f575c400640 1 --2- 172.21.15.114:0/2006389722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f573c005920 0x7f573c005da0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.188+0000 7f575c400640 1 -- 172.21.15.114:0/2006389722 >> 172.21.15.114:0/2006389722 conn(0x7f57540cfbc0 msgr2=0x7f57540cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.188+0000 7f575c400640 1 -- 172.21.15.114:0/2006389722 shutdown_connections 2024-09-16T07:37:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.188+0000 7f575c400640 1 -- 172.21.15.114:0/2006389722 wait complete. 2024-09-16T07:37:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 Processor -- start 2024-09-16T07:37:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 -- start start 2024-09-16T07:37:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573c005920 0x7f57540b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f575406feb0 0x7f57541599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5754153050 0x7f57541534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f57540cfa40 con 0x7f5754153050 2024-09-16T07:37:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f57540cf8c0 con 0x7f573c005920 2024-09-16T07:37:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f57540cdac0 con 0x7f575406feb0 2024-09-16T07:37:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5754153050 0x7f57541534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5754153050 0x7f57541534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54168/0 (socket says 172.21.15.114:54168) 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 -- 172.21.15.114:0/2305961891 learned_addr learned my addr 172.21.15.114:0/2305961891 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f5759a00640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573c005920 0x7f57540b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f5759000640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f575406feb0 0x7f57541599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 -- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f575406feb0 msgr2=0x7f57541599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f575406feb0 0x7f57541599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 -- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573c005920 msgr2=0x7f57540b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573c005920 0x7f57540b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 -- 172.21.15.114:0/2305961891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57540b58f0 con 0x7f5754153050 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f5759a00640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573c005920 0x7f57540b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575a400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5754153050 0x7f57541534d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f57540768c0 tx=0x7f574c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f5751600640 1 -- 172.21.15.114:0/2305961891 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c004230 con 0x7f5754153050 2024-09-16T07:37:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f5751600640 1 -- 172.21.15.114:0/2305961891 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f574c016070 con 0x7f5754153050 2024-09-16T07:37:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57541f4ee0 con 0x7f5754153050 2024-09-16T07:37:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f5751600640 1 -- 172.21.15.114:0/2305961891 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00f860 con 0x7f5754153050 2024-09-16T07:37:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57541f5480 con 0x7f5754153050 2024-09-16T07:37:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.192+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5754069410 con 0x7f5754153050 2024-09-16T07:37:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.196+0000 7f5751600640 1 -- 172.21.15.114:0/2305961891 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f574c018070 con 0x7f5754153050 2024-09-16T07:37:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.196+0000 7f5751600640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5734073a90 0x7f5734075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.196+0000 7f5751600640 1 -- 172.21.15.114:0/2305961891 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5823+0+0 (secure 0 0 0) 0x7f574c093180 con 0x7f5754153050 2024-09-16T07:37:10.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.196+0000 7f5759a00640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5734073a90 0x7f5734075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:10.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.196+0000 7f5759a00640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5734073a90 0x7f5734075f50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f57541f8410 tx=0x7f5748006f30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:10.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.200+0000 7f5751600640 1 -- 172.21.15.114:0/2305961891 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f574c05fbc0 con 0x7f5754153050 2024-09-16T07:37:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:10.368+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f57540ce020 con 0x7f5754153050 2024-09-16T07:37:11.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f5751600640 1 -- 172.21.15.114:0/2305961891 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v167) ==== 181+0+0 (secure 0 0 0) 0x7f574c05f4c0 con 0x7f5754153050 2024-09-16T07:37:11.357 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5734073a90 msgr2=0x7f5734075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5734073a90 0x7f5734075f50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f57541f8410 tx=0x7f5748006f30 comp rx=0 tx=0).stop 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5754153050 msgr2=0x7f57541534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5754153050 0x7f57541534d0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f57540768c0 tx=0x7f574c011b10 comp rx=0 tx=0).stop 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 shutdown_connections 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5754153050 0x7f57541534d0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5734073a90 0x7f5734075f50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f575406feb0 0x7f57541599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 --2- 172.21.15.114:0/2305961891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f573c005920 0x7f57540b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 >> 172.21.15.114:0/2305961891 conn(0x7f57540cfbc0 msgr2=0x7f57540afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 shutdown_connections 2024-09-16T07:37:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.364+0000 7f575c400640 1 -- 172.21.15.114:0/2305961891 wait complete. 2024-09-16T07:37:11.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T07:37:11.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 -- 172.21.15.114:0/103101287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50680b0b60 msgr2=0x7f50680ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:11.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 --2- 172.21.15.114:0/103101287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50680b0b60 0x7f50680ccbd0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f50680746b0 tx=0x7f506001f0b0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 -- 172.21.15.114:0/103101287 shutdown_connections 2024-09-16T07:37:11.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 --2- 172.21.15.114:0/103101287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50680b0b60 0x7f50680ccbd0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 --2- 172.21.15.114:0/103101287 >> v2:172.21.15.149:3300/0 conn(0x7f506815c1f0 0x7f50680cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 -- 172.21.15.114:0/103101287 >> 172.21.15.114:0/103101287 conn(0x7f50680d1da0 msgr2=0x7f50680d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:11.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 -- 172.21.15.114:0/103101287 shutdown_connections 2024-09-16T07:37:11.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 -- 172.21.15.114:0/103101287 wait complete. 2024-09-16T07:37:11.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 Processor -- start 2024-09-16T07:37:11.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.540+0000 7f506cc00640 1 -- start start 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50680b0b60 0x7f5068151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f506815be10 0x7f50680afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f506815c1f0 0x7f50680b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50680cd4a0 con 0x7f506815c1f0 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50680cd320 con 0x7f506815be10 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f50680cd620 con 0x7f50680b0b60 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f506815c1f0 0x7f50680b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f506815c1f0 0x7f50680b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54180/0 (socket says 172.21.15.114:54180) 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 -- 172.21.15.114:0/2967628478 learned_addr learned my addr 172.21.15.114:0/2967628478 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5065e00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50680b0b60 0x7f5068151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5065400640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f506815be10 0x7f50680afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 -- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50680b0b60 msgr2=0x7f5068151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50680b0b60 0x7f5068151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 -- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f506815be10 msgr2=0x7f50680afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f506815be10 0x7f50680afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 -- 172.21.15.114:0/2967628478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5068151860 con 0x7f506815c1f0 2024-09-16T07:37:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f5066800640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f506815c1f0 0x7f50680b00f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f5060009850 tx=0x7f50600a8d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f505e000640 1 -- 172.21.15.114:0/2967628478 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50600b5040 con 0x7f506815c1f0 2024-09-16T07:37:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f505e000640 1 -- 172.21.15.114:0/2967628478 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50600053e0 con 0x7f506815c1f0 2024-09-16T07:37:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f505e000640 1 -- 172.21.15.114:0/2967628478 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50600046d0 con 0x7f506815c1f0 2024-09-16T07:37:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506815e9e0 con 0x7f506815c1f0 2024-09-16T07:37:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506815efa0 con 0x7f506815c1f0 2024-09-16T07:37:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.544+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50680cdb80 con 0x7f506815c1f0 2024-09-16T07:37:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.548+0000 7f505e000640 1 -- 172.21.15.114:0/2967628478 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f50600c1060 con 0x7f506815c1f0 2024-09-16T07:37:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.548+0000 7f505e000640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5048073a90 0x7f5048075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.548+0000 7f505e000640 1 -- 172.21.15.114:0/2967628478 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5385+0+0 (secure 0 0 0) 0x7f506012f8b0 con 0x7f506815c1f0 2024-09-16T07:37:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.548+0000 7f5065e00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5048073a90 0x7f5048075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.548+0000 7f5065e00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5048073a90 0x7f5048075f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f50680cfc20 tx=0x7f5058003dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:11.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.552+0000 7f505e000640 1 -- 172.21.15.114:0/2967628478 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5060018c10 con 0x7f506815c1f0 2024-09-16T07:37:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:11.728+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5068070350 con 0x7f506815c1f0 2024-09-16T07:37:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.364+0000 7f505e000640 1 -- 172.21.15.114:0/2967628478 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v168) ==== 169+0+0 (secure 0 0 0) 0x7f50600fbca0 con 0x7f506815c1f0 2024-09-16T07:37:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-16T07:37:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5048073a90 msgr2=0x7f5048075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5048073a90 0x7f5048075f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f50680cfc20 tx=0x7f5058003dd0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f506815c1f0 msgr2=0x7f50680b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f506815c1f0 0x7f50680b00f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f5060009850 tx=0x7f50600a8d70 comp rx=0 tx=0).stop 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 shutdown_connections 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f506815c1f0 0x7f50680b00f0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f506815be10 0x7f50680afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5048073a90 0x7f5048075f50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 --2- 172.21.15.114:0/2967628478 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f50680b0b60 0x7f5068151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 >> 172.21.15.114:0/2967628478 conn(0x7f50680d1da0 msgr2=0x7f50680ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 shutdown_connections 2024-09-16T07:37:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.368+0000 7f506cc00640 1 -- 172.21.15.114:0/2967628478 wait complete. 2024-09-16T07:37:12.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- 172.21.15.114:0/2261882749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 msgr2=0x7f30b00cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 --2- 172.21.15.114:0/2261882749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b00cea20 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f30b0073d80 tx=0x7f30a801cba0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- 172.21.15.114:0/2261882749 shutdown_connections 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 --2- 172.21.15.114:0/2261882749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b00cea20 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 --2- 172.21.15.114:0/2261882749 >> v2:172.21.15.149:3300/0 conn(0x7f30b015be80 0x7f30b00ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- 172.21.15.114:0/2261882749 >> 172.21.15.114:0/2261882749 conn(0x7f30b00d1da0 msgr2=0x7f30b00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- 172.21.15.114:0/2261882749 shutdown_connections 2024-09-16T07:37:12.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- 172.21.15.114:0/2261882749 wait complete. 2024-09-16T07:37:12.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 Processor -- start 2024-09-16T07:37:12.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- start start 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30b00d28c0 0x7f30b006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30b015be80 0x7f30b006eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0168c60 con 0x7f30b00cd8c0 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f30b00b66e0 con 0x7f30b00d28c0 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30b4a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0168de0 con 0x7f30b015be80 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30ade00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30ade00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b0154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54200/0 (socket says 172.21.15.114:54200) 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.536+0000 7f30ade00640 1 -- 172.21.15.114:0/445174629 learned_addr learned my addr 172.21.15.114:0/445174629 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30ae800640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30b015be80 0x7f30b006eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30a7e00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30b00d28c0 0x7f30b006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30ade00640 1 -- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30b015be80 msgr2=0x7f30b006eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30ade00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30b015be80 0x7f30b006eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30ade00640 1 -- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30b00d28c0 msgr2=0x7f30b006eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30ade00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30b00d28c0 0x7f30b006eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30ade00640 1 -- 172.21.15.114:0/445174629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b01f7f20 con 0x7f30b00cd8c0 2024-09-16T07:37:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30ade00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b0154ea0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f30a000b410 tx=0x7f30a000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30a6000640 1 -- 172.21.15.114:0/445174629 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0015020 con 0x7f30b00cd8c0 2024-09-16T07:37:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30a6000640 1 -- 172.21.15.114:0/445174629 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30a0011920 con 0x7f30b00cd8c0 2024-09-16T07:37:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b01f8200 con 0x7f30b00cd8c0 2024-09-16T07:37:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30a6000640 1 -- 172.21.15.114:0/445174629 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0011d70 con 0x7f30b00cd8c0 2024-09-16T07:37:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b01f87c0 con 0x7f30b00cd8c0 2024-09-16T07:37:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b00b53f0 con 0x7f30b00cd8c0 2024-09-16T07:37:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30a6000640 1 -- 172.21.15.114:0/445174629 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f30a0018020 con 0x7f30b00cd8c0 2024-09-16T07:37:12.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.540+0000 7f30a6000640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f308c073a90 0x7f308c075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.544+0000 7f30a6000640 1 -- 172.21.15.114:0/445174629 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f30a00929b0 con 0x7f30b00cd8c0 2024-09-16T07:37:12.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.544+0000 7f30a7e00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f308c073a90 0x7f308c075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.544+0000 7f30a7e00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f308c073a90 0x7f308c075f50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30b015b9c0 tx=0x7f3098009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.544+0000 7f30a6000640 1 -- 172.21.15.114:0/445174629 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f30a001f020 con 0x7f30b00cd8c0 2024-09-16T07:37:12.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.712+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f30b015cbb0 con 0x7f30b00cd8c0 2024-09-16T07:37:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.716+0000 7f30a6000640 1 -- 172.21.15.114:0/445174629 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v49) ==== 71+0+0 (secure 0 0 0) 0x7f30a005f3f0 con 0x7f30b00cd8c0 2024-09-16T07:37:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f308c073a90 msgr2=0x7f308c075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f308c073a90 0x7f308c075f50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30b015b9c0 tx=0x7f3098009040 comp rx=0 tx=0).stop 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 msgr2=0x7f30b0154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b0154ea0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f30a000b410 tx=0x7f30a000b8d0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 shutdown_connections 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f308c073a90 0x7f308c075f50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f30b015be80 0x7f30b006eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f30b00d28c0 0x7f30b006eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 --2- 172.21.15.114:0/445174629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30b00cd8c0 0x7f30b0154ea0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 >> 172.21.15.114:0/445174629 conn(0x7f30b00d1da0 msgr2=0x7f30b006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 shutdown_connections 2024-09-16T07:37:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.720+0000 7f30b4a00640 1 -- 172.21.15.114:0/445174629 wait complete. 2024-09-16T07:37:12.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 -- 172.21.15.114:0/663866349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe015bea0 msgr2=0x7f3fe00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 --2- 172.21.15.114:0/663866349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe015bea0 0x7f3fe00ce670 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00cc3a0 tx=0x7f3fd401c830 comp rx=0 tx=0).stop 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 -- 172.21.15.114:0/663866349 shutdown_connections 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 --2- 172.21.15.114:0/663866349 >> v2:172.21.15.149:3300/0 conn(0x7f3fe00d28e0 0x7f3fe00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 --2- 172.21.15.114:0/663866349 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe015bea0 0x7f3fe00ce670 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 -- 172.21.15.114:0/663866349 >> 172.21.15.114:0/663866349 conn(0x7f3fe00d1dc0 msgr2=0x7f3fe00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 -- 172.21.15.114:0/663866349 shutdown_connections 2024-09-16T07:37:12.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 -- 172.21.15.114:0/663866349 wait complete. 2024-09-16T07:37:12.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 Processor -- start 2024-09-16T07:37:12.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.888+0000 7f3fe8200640 1 -- start start 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fe00cdb30 0x7f3fe0159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe00d28e0 0x7f3fe00cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe015bea0 0x7f3fe009eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0168fc0 con 0x7f3fe00d28e0 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0168e40 con 0x7f3fe015bea0 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe0169140 con 0x7f3fe00cdb30 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fe00cdb30 0x7f3fe0159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe00d28e0 0x7f3fe00cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fe00cdb30 0x7f3fe0159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:43020/0 (socket says 172.21.15.114:43020) 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe5800640 1 -- 172.21.15.114:0/82167722 learned_addr learned my addr 172.21.15.114:0/82167722 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:12.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe6200640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe015bea0 0x7f3fe009eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe4e00640 1 -- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fe00cdb30 msgr2=0x7f3fe0159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe4e00640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fe00cdb30 0x7f3fe0159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe4e00640 1 -- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe015bea0 msgr2=0x7f3fe009eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe4e00640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe015bea0 0x7f3fe009eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe4e00640 1 -- 172.21.15.114:0/82167722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe00b2e90 con 0x7f3fe00d28e0 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe5800640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fe00cdb30 0x7f3fe0159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe4e00640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe00d28e0 0x7f3fe00cb2c0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c390 tx=0x7f3fcc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fdd600640 1 -- 172.21.15.114:0/82167722 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc017070 con 0x7f3fe00d28e0 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fdd600640 1 -- 172.21.15.114:0/82167722 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fcc0053c0 con 0x7f3fe00d28e0 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fdd600640 1 -- 172.21.15.114:0/82167722 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc003840 con 0x7f3fe00d28e0 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe00b3130 con 0x7f3fe00d28e0 2024-09-16T07:37:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe00b36f0 con 0x7f3fe00d28e0 2024-09-16T07:37:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.892+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe00cc9d0 con 0x7f3fe00d28e0 2024-09-16T07:37:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.896+0000 7f3fdd600640 1 -- 172.21.15.114:0/82167722 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f3fcc01a070 con 0x7f3fe00d28e0 2024-09-16T07:37:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.896+0000 7f3fdd600640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3fc0073a90 0x7f3fc0075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.896+0000 7f3fdd600640 1 -- 172.21.15.114:0/82167722 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f3fcc091dc0 con 0x7f3fe00d28e0 2024-09-16T07:37:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.896+0000 7f3fe5800640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3fc0073a90 0x7f3fc0075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:12.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.896+0000 7f3fe5800640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3fc0073a90 0x7f3fc0075f50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009230 tx=0x7f3fd401b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:12.900+0000 7f3fdd600640 1 -- 172.21.15.114:0/82167722 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f3fcc05e130 con 0x7f3fe00d28e0 2024-09-16T07:37:13.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.128+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f3fe0071a80 con 0x7f3fe00d28e0 2024-09-16T07:37:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.376+0000 7f3fdd600640 1 -- 172.21.15.114:0/82167722 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v499) ==== 163+0+0 (secure 0 0 0) 0x7f3fcc062b60 con 0x7f3fe00d28e0 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3fc0073a90 msgr2=0x7f3fc0075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3fc0073a90 0x7f3fc0075f50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009230 tx=0x7f3fd401b070 comp rx=0 tx=0).stop 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe00d28e0 msgr2=0x7f3fe00cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe00d28e0 0x7f3fe00cb2c0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c390 tx=0x7f3fcc00c850 comp rx=0 tx=0).stop 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 shutdown_connections 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3fe015bea0 0x7f3fe009eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fe00d28e0 0x7f3fe00cb2c0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f3fc0073a90 0x7f3fc0075f50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 --2- 172.21.15.114:0/82167722 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3fe00cdb30 0x7f3fe0159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 >> 172.21.15.114:0/82167722 conn(0x7f3fe00d1dc0 msgr2=0x7f3fe00b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 shutdown_connections 2024-09-16T07:37:13.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:13.380+0000 7f3fe8200640 1 -- 172.21.15.114:0/82167722 wait complete. 2024-09-16T07:37:13.395 INFO:tasks.cephfs_test_runner:Validate unparseable text .meta file on legacy subvol root doesn't break the system ... ok 2024-09-16T07:37:13.395 INFO:tasks.cephfs_test_runner: 2024-09-16T07:37:13.395 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-16T07:37:13.396 INFO:tasks.cephfs_test_runner:Ran 11 tests in 505.911s 2024-09-16T07:37:13.396 INFO:tasks.cephfs_test_runner: 2024-09-16T07:37:13.396 INFO:tasks.cephfs_test_runner:OK 2024-09-16T07:37:13.396 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-16T07:37:13.405 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-16T07:37:13.412 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-16T07:37:13.412 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:37:13.413 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:13.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:37:13.422 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T07:37:13.422 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:13.472 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3354 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T07:37:13.472 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:37:13.472 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:13.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:37:13.482 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-09-16T07:37:13.482 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T07:37:13.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=8105004k,nr_inodes=2026251,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6309 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=1625932k,nr_inodes=406483,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=1625936k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T07:37:13.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:13.535 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:37:13.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T07:37:13.544 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T07:37:13.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:13.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T07:37:13.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:13.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T07:37:14.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:14.098 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-16T07:37:14.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:14.255 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T07:37:14.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:14.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-16T07:37:14.796 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-09-16T07:37:14.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:37:14.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:14.798 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:37:14.808 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T07:37:14.808 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T07:37:14.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:14.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T07:37:14.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:14.875 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T07:37:15.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:15.289 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-16T07:37:15.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:15.433 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2024-09-16T07:37:15.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T07:37:15.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2024-09-16T07:37:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2024-09-16T07:37:15.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:37:15.908 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T07:37:15.921 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:37:15.922 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:37:16.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.080+0000 7fc080400640 1 -- 172.21.15.114:0/1244738267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc060004d50 msgr2=0x7fc0600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.080+0000 7fc080400640 1 --2- 172.21.15.114:0/1244738267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc060004d50 0x7fc0600051d0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fc07000c640 tx=0x7fc07001fa60 comp rx=0 tx=0).stop 2024-09-16T07:37:16.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.080+0000 7fc07e400640 1 -- 172.21.15.114:0/1244738267 reap_dead start 2024-09-16T07:37:16.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.080+0000 7fc080400640 1 -- 172.21.15.114:0/1244738267 shutdown_connections 2024-09-16T07:37:16.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.080+0000 7fc080400640 1 -- 172.21.15.114:0/1244738267 >> 172.21.15.114:0/1244738267 conn(0x7fc0780b18f0 msgr2=0x7fc0780b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:16.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.080+0000 7fc080400640 1 -- 172.21.15.114:0/1244738267 shutdown_connections 2024-09-16T07:37:16.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.080+0000 7fc080400640 1 -- 172.21.15.114:0/1244738267 wait complete. 2024-09-16T07:37:16.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 Processor -- start 2024-09-16T07:37:16.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 -- start start 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc060004d50 0x7fc078156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0780cc9a0 0x7fc078153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07814a0b0 0x7fc078153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc07806fb40 con 0x7fc0780cc9a0 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc07806f9c0 con 0x7fc07814a0b0 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc0780b4340 con 0x7fc060004d50 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0780cc9a0 0x7fc078153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc060004d50 0x7fc078156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0780cc9a0 0x7fc078153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50610/0 (socket says 172.21.15.114:50610) 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07da00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc060004d50 0x7fc078156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.114:47172/0 (socket says 172.21.15.114:47172) 2024-09-16T07:37:16.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 -- 172.21.15.114:0/3761082169 learned_addr learned my addr 172.21.15.114:0/3761082169 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07e400640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07814a0b0 0x7fc078153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 -- 172.21.15.114:0/3761082169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc060004d50 msgr2=0x7fc078156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc060004d50 0x7fc078156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 -- 172.21.15.114:0/3761082169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07814a0b0 msgr2=0x7fc078153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07814a0b0 0x7fc078153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 -- 172.21.15.114:0/3761082169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0781f7d20 con 0x7fc0780cc9a0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc07d000640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0780cc9a0 0x7fc078153850 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fc064003fa0 tx=0x7fc06400ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc075600640 1 -- 172.21.15.114:0/3761082169 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064010920 con 0x7fc0780cc9a0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc075600640 1 -- 172.21.15.114:0/3761082169 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc064015070 con 0x7fc0780cc9a0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc075600640 1 -- 172.21.15.114:0/3761082169 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064010d40 con 0x7fc0780cc9a0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0781f8000 con 0x7fc0780cc9a0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0781f85c0 con 0x7fc0780cc9a0 2024-09-16T07:37:16.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.084+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc078069410 con 0x7fc0780cc9a0 2024-09-16T07:37:16.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.088+0000 7fc075600640 1 -- 172.21.15.114:0/3761082169 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fc06401a470 con 0x7fc0780cc9a0 2024-09-16T07:37:16.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.088+0000 7fc075600640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc058073ac0 0x7fc058075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.088+0000 7fc075600640 1 -- 172.21.15.114:0/3761082169 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fc0640930a0 con 0x7fc0780cc9a0 2024-09-16T07:37:16.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.088+0000 7fc07da00640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc058073ac0 0x7fc058075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.088+0000 7fc07da00640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc058073ac0 0x7fc058075f80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc06c005fd0 tx=0x7fc06c00b260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:16.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.092+0000 7fc075600640 1 -- 172.21.15.114:0/3761082169 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc06405f6f0 con 0x7fc0780cc9a0 2024-09-16T07:37:16.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0780cd5d0 con 0x7fc058073ac0 2024-09-16T07:37:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc075600640 1 -- 172.21.15.114:0/3761082169 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13503 (secure 0 0 0) 0x7fc0780cd5d0 con 0x7fc058073ac0 2024-09-16T07:37:16.250 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc058073ac0 msgr2=0x7fc058075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc058073ac0 0x7fc058075f80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc06c005fd0 tx=0x7fc06c00b260 comp rx=0 tx=0).stop 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0780cc9a0 msgr2=0x7fc078153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0780cc9a0 0x7fc078153850 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fc064003fa0 tx=0x7fc06400ba60 comp rx=0 tx=0).stop 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 shutdown_connections 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc07814a0b0 0x7fc078153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0780cc9a0 0x7fc078153850 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc058073ac0 0x7fc058075f80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 --2- 172.21.15.114:0/3761082169 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc060004d50 0x7fc078156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.256+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 >> 172.21.15.114:0/3761082169 conn(0x7fc0780b18f0 msgr2=0x7fc0780b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.260+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 shutdown_connections 2024-09-16T07:37:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.260+0000 7fc080400640 1 -- 172.21.15.114:0/3761082169 wait complete. 2024-09-16T07:37:16.273 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-16T07:37:14.431717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":267180,"kb_used_data":17656,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707540,"statfs":{"total":773094113280,"available":772820520960,"internally_reserved":0,"allocated":18079744,"data_stored":8618299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54232,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-5,"num_read_kb":-5,"num_write":-82,"num_write_kb":-86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001346"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":409,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T07:37:12.370957+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:37:12.370957+0000","last_peered":"2024-09-16T07:37:12.370957+0000","last_clean":"2024-09-16T07:37:12.370957+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:37:12.370957+0000","last_undegraded":"2024-09-16T07:37:12.370957+0000","last_fullsized":"2024-09-16T07:37:12.370957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509552,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33844,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337996,"statfs":{"total":96636764160,"available":96602107904,"internally_reserved":0,"allocated":2715648,"data_stored":1523559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33264,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509552,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1517966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:37:16.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:37:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.420+0000 7ffa41c00640 1 -- 172.21.15.114:0/3504460500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa20004810 msgr2=0x7ffa20004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.420+0000 7ffa41c00640 1 --2- 172.21.15.114:0/3504460500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa20004810 0x7ffa20004c90 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7ffa280016f0 tx=0x7ffa2801c750 comp rx=0 tx=0).stop 2024-09-16T07:37:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.420+0000 7ffa41c00640 1 -- 172.21.15.114:0/3504460500 shutdown_connections 2024-09-16T07:37:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.420+0000 7ffa41c00640 1 --2- 172.21.15.114:0/3504460500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa20004810 0x7ffa20004c90 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.420+0000 7ffa41c00640 1 -- 172.21.15.114:0/3504460500 >> 172.21.15.114:0/3504460500 conn(0x7ffa3c0d0c90 msgr2=0x7ffa3c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.420+0000 7ffa41c00640 1 -- 172.21.15.114:0/3504460500 shutdown_connections 2024-09-16T07:37:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.420+0000 7ffa41c00640 1 -- 172.21.15.114:0/3504460500 wait complete. 2024-09-16T07:37:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 Processor -- start 2024-09-16T07:37:16.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 -- start start 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa20004810 0x7ffa3c1f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa3c1f5740 0x7ffa3c0a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3c0b2e90 0x7ffa3c071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c0d0350 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c0d01d0 con 0x7ffa20004810 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3c1f7950 con 0x7ffa3c1f5740 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3c0b2e90 0x7ffa3c071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3aa00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa20004810 0x7ffa3c1f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3a000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa3c1f5740 0x7ffa3c0a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3c0b2e90 0x7ffa3c071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50624/0 (socket says 172.21.15.114:50624) 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 -- 172.21.15.114:0/1840244739 learned_addr learned my addr 172.21.15.114:0/1840244739 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 -- 172.21.15.114:0/1840244739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa3c1f5740 msgr2=0x7ffa3c0a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa3c1f5740 0x7ffa3c0a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 -- 172.21.15.114:0/1840244739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa20004810 msgr2=0x7ffa3c1f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa20004810 0x7ffa3c1f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 -- 172.21.15.114:0/1840244739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c0b13c0 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa3b400640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3c0b2e90 0x7ffa3c071790 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0cb120 tx=0x7ffa340129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa32a00640 1 -- 172.21.15.114:0/1840244739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34013860 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa32a00640 1 -- 172.21.15.114:0/1840244739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa34013a20 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa32a00640 1 -- 172.21.15.114:0/1840244739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa34010480 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c0a11a0 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.424+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c0b1630 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.428+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c073f90 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.428+0000 7ffa32a00640 1 -- 172.21.15.114:0/1840244739 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7ffa34010620 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.428+0000 7ffa32a00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffa1c073ac0 0x7ffa1c075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.428+0000 7ffa32a00640 1 -- 172.21.15.114:0/1840244739 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7ffa340966e0 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.428+0000 7ffa3aa00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffa1c073ac0 0x7ffa1c075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.432+0000 7ffa3aa00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffa1c073ac0 0x7ffa1c075f80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c052940 tx=0x7ffa2c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.432+0000 7ffa32a00640 1 -- 172.21.15.114:0/1840244739 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7ffa34062b10 con 0x7ffa3c0b2e90 2024-09-16T07:37:16.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa3c158670 con 0x7ffa1c073ac0 2024-09-16T07:37:16.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa32a00640 1 -- 172.21.15.114:0/1840244739 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13503 (secure 0 0 0) 0x7ffa2c0244d0 con 0x7ffa1c073ac0 2024-09-16T07:37:16.594 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:16.594 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:37:16.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffa1c073ac0 msgr2=0x7ffa1c075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffa1c073ac0 0x7ffa1c075f80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c052940 tx=0x7ffa2c0091e0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3c0b2e90 msgr2=0x7ffa3c071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3c0b2e90 0x7ffa3c071790 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0cb120 tx=0x7ffa340129e0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 shutdown_connections 2024-09-16T07:37:16.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa3c0b2e90 0x7ffa3c071790 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ffa1c073ac0 0x7ffa1c075f80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa3c1f5740 0x7ffa3c0a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 --2- 172.21.15.114:0/1840244739 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa20004810 0x7ffa3c1f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 >> 172.21.15.114:0/1840244739 conn(0x7ffa3c0d0c90 msgr2=0x7ffa3c15a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:16.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 shutdown_connections 2024-09-16T07:37:16.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.600+0000 7ffa41c00640 1 -- 172.21.15.114:0/1840244739 wait complete. 2024-09-16T07:37:16.615 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-16T07:37:16.432029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":267180,"kb_used_data":17656,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707540,"statfs":{"total":773094113280,"available":772820520960,"internally_reserved":0,"allocated":18079744,"data_stored":8618299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54232,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-5,"num_read_kb":-5,"num_write":-82,"num_write_kb":-86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.454698"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":409,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T07:37:12.370957+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:37:12.370957+0000","last_peered":"2024-09-16T07:37:12.370957+0000","last_clean":"2024-09-16T07:37:12.370957+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:37:12.370957+0000","last_undegraded":"2024-09-16T07:37:12.370957+0000","last_fullsized":"2024-09-16T07:37:12.370957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509552,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33844,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337996,"statfs":{"total":96636764160,"available":96602107904,"internally_reserved":0,"allocated":2715648,"data_stored":1523559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33264,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509552,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1517966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:37:16.616 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:37:16.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:37:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- 172.21.15.114:0/1051862581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 msgr2=0x7fe45c0b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 --2- 172.21.15.114:0/1051862581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c0b2bf0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0b4930 tx=0x7fe44c01c770 comp rx=0 tx=0).stop 2024-09-16T07:37:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- 172.21.15.114:0/1051862581 shutdown_connections 2024-09-16T07:37:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 --2- 172.21.15.114:0/1051862581 >> v2:172.21.15.149:3300/0 conn(0x7fe45c0cc2a0 0x7fe45c0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 --2- 172.21.15.114:0/1051862581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c0b2bf0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- 172.21.15.114:0/1051862581 >> 172.21.15.114:0/1051862581 conn(0x7fe45c0b18f0 msgr2=0x7fe45c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- 172.21.15.114:0/1051862581 shutdown_connections 2024-09-16T07:37:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- 172.21.15.114:0/1051862581 wait complete. 2024-09-16T07:37:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 Processor -- start 2024-09-16T07:37:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- start start 2024-09-16T07:37:16.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe45c0b4cf0 0x7fe45c09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe45c0afac0 0x7fe45c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c168300 con 0x7fe45c15e260 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c168180 con 0x7fe45c0b4cf0 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe463000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fe45c168480 con 0x7fe45c0afac0 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c14d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50644/0 (socket says 172.21.15.114:50644) 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 -- 172.21.15.114:0/1906476508 learned_addr learned my addr 172.21.15.114:0/1906476508 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe45be00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe45c0b4cf0 0x7fe45c09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe461000640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe45c0afac0 0x7fe45c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 -- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe45c0afac0 msgr2=0x7fe45c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe45c0afac0 0x7fe45c0cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 -- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe45c0b4cf0 msgr2=0x7fe45c09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe45c0b4cf0 0x7fe45c09aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe453e00640 1 -- 172.21.15.114:0/1906476508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c1fb600 con 0x7fe45c15e260 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.764+0000 7fe45be00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe45c0b4cf0 0x7fe45c09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe453e00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c14d590 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fe44400d950 tx=0x7fe44400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe458c00640 1 -- 172.21.15.114:0/1906476508 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444017070 con 0x7fe45c15e260 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe458c00640 1 -- 172.21.15.114:0/1906476508 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe444009d20 con 0x7fe45c15e260 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45c1fb8e0 con 0x7fe45c15e260 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe458c00640 1 -- 172.21.15.114:0/1906476508 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444004280 con 0x7fe45c15e260 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe45c1fbea0 con 0x7fe45c15e260 2024-09-16T07:37:16.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45c069410 con 0x7fe45c15e260 2024-09-16T07:37:16.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe458c00640 1 -- 172.21.15.114:0/1906476508 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fe444005020 con 0x7fe45c15e260 2024-09-16T07:37:16.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.768+0000 7fe458c00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe438073a90 0x7fe438075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:16.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.772+0000 7fe458c00640 1 -- 172.21.15.114:0/1906476508 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fe444092d60 con 0x7fe45c15e260 2024-09-16T07:37:16.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.772+0000 7fe45be00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe438073a90 0x7fe438075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:16.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.772+0000 7fe45be00640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe438073a90 0x7fe438075f50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0af000 tx=0x7fe44c01afb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.776+0000 7fe458c00640 1 -- 172.21.15.114:0/1906476508 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fe444020020 con 0x7fe45c15e260 2024-09-16T07:37:16.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.940+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe45c1fb3b0 con 0x7fe438073a90 2024-09-16T07:37:16.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.940+0000 7fe458c00640 1 -- 172.21.15.114:0/1906476508 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13503 (secure 0 0 0) 0x7fe45c1fb3b0 con 0x7fe438073a90 2024-09-16T07:37:16.934 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:16.935 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe438073a90 msgr2=0x7fe438075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe438073a90 0x7fe438075f50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0af000 tx=0x7fe44c01afb0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 msgr2=0x7fe45c14d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c14d590 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fe44400d950 tx=0x7fe44400de10 comp rx=0 tx=0).stop 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 shutdown_connections 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fe438073a90 0x7fe438075f50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fe45c0afac0 0x7fe45c0cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45c15e260 0x7fe45c14d590 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 --2- 172.21.15.114:0/1906476508 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe45c0b4cf0 0x7fe45c09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:16.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 >> 172.21.15.114:0/1906476508 conn(0x7fe45c0b18f0 msgr2=0x7fe45c1649d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:16.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 shutdown_connections 2024-09-16T07:37:16.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:16.944+0000 7fe463000640 1 -- 172.21.15.114:0/1906476508 wait complete. 2024-09-16T07:37:16.956 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-16T07:37:16.432029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":267180,"kb_used_data":17656,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707540,"statfs":{"total":773094113280,"available":772820520960,"internally_reserved":0,"allocated":18079744,"data_stored":8618299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54232,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-5,"num_read_kb":-5,"num_write":-82,"num_write_kb":-86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.454698"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":409,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T07:37:12.370957+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:37:12.370957+0000","last_peered":"2024-09-16T07:37:12.370957+0000","last_clean":"2024-09-16T07:37:12.370957+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:37:12.370957+0000","last_undegraded":"2024-09-16T07:37:12.370957+0000","last_fullsized":"2024-09-16T07:37:12.370957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509552,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33844,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337996,"statfs":{"total":96636764160,"available":96602107904,"internally_reserved":0,"allocated":2715648,"data_stored":1523559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33264,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509551,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33248,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2105344,"data_stored":927598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509552,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1517966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:37:16.957 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:37:17.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.104+0000 7fdecf000640 1 -- 172.21.15.114:0/2952025794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec80cdb30 msgr2=0x7fdec80af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:17.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.104+0000 7fdecf000640 1 --2- 172.21.15.114:0/2952025794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec80cdb30 0x7fdec80af0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009bf0 tx=0x7fdec001cbe0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.104+0000 7fdecf000640 1 -- 172.21.15.114:0/2952025794 shutdown_connections 2024-09-16T07:37:17.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.104+0000 7fdecf000640 1 --2- 172.21.15.114:0/2952025794 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec80cdb30 0x7fdec80af0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.104+0000 7fdecf000640 1 -- 172.21.15.114:0/2952025794 >> 172.21.15.114:0/2952025794 conn(0x7fdec80d1dc0 msgr2=0x7fdec80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:17.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.104+0000 7fdecf000640 1 -- 172.21.15.114:0/2952025794 shutdown_connections 2024-09-16T07:37:17.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.104+0000 7fdecf000640 1 -- 172.21.15.114:0/2952025794 wait complete. 2024-09-16T07:37:17.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 Processor -- start 2024-09-16T07:37:17.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 -- start start 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdec80cdb30 0x7fdec81542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec80ced80 0x7fdec81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec815bea0 0x7fdec80b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdec816a8f0 con 0x7fdec80ced80 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdec816a770 con 0x7fdec80cdb30 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fdec816aa70 con 0x7fdec815bea0 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec80ced80 0x7fdec81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:17.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec80ced80 0x7fdec81583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50650/0 (socket says 172.21.15.114:50650) 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 -- 172.21.15.114:0/3393247570 learned_addr learned my addr 172.21.15.114:0/3393247570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7e00640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdec80cdb30 0x7fdec81542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecd000640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec815bea0 0x7fdec80b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 -- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec815bea0 msgr2=0x7fdec80b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec815bea0 0x7fdec80b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 -- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdec80cdb30 msgr2=0x7fdec81542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdec80cdb30 0x7fdec81542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 -- 172.21.15.114:0/3393247570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec8158900 con 0x7fdec80ced80 2024-09-16T07:37:17.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdec7400640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec80ced80 0x7fdec81583c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c490 tx=0x7fdeb400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:17.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdebfe00640 1 -- 172.21.15.114:0/3393247570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4016020 con 0x7fdec80ced80 2024-09-16T07:37:17.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdebfe00640 1 -- 172.21.15.114:0/3393247570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeb4012940 con 0x7fdec80ced80 2024-09-16T07:37:17.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec806f5a0 con 0x7fdec80ced80 2024-09-16T07:37:17.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdebfe00640 1 -- 172.21.15.114:0/3393247570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4012d90 con 0x7fdec80ced80 2024-09-16T07:37:17.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.108+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec806e8e0 con 0x7fdec80ced80 2024-09-16T07:37:17.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.112+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec806fac0 con 0x7fdec80ced80 2024-09-16T07:37:17.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.112+0000 7fdebfe00640 1 -- 172.21.15.114:0/3393247570 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fdeb4019020 con 0x7fdec80ced80 2024-09-16T07:37:17.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.112+0000 7fdebfe00640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdea8073a90 0x7fdea8075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:17.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.112+0000 7fdebfe00640 1 -- 172.21.15.114:0/3393247570 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fdeb4092970 con 0x7fdec80ced80 2024-09-16T07:37:17.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.112+0000 7fdec7e00640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdea8073a90 0x7fdea8075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:17.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.112+0000 7fdec7e00640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdea8073a90 0x7fdea8075f50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8000c10 tx=0x7fdeb8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:17.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.116+0000 7fdebfe00640 1 -- 172.21.15.114:0/3393247570 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fdec806fac0 con 0x7fdec80ced80 2024-09-16T07:37:17.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.284+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdec8072540 con 0x7fdec80ced80 2024-09-16T07:37:17.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.284+0000 7fdebfe00640 1 -- 172.21.15.114:0/3393247570 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+13136 (secure 0 0 0) 0x7fdeb4020020 con 0x7fdec80ced80 2024-09-16T07:37:17.280 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:17.280 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":168,"fsid":"c2ac6e78-bdc4-48e2-bd14-fc3b8bf1d264","created":"2024-09-16T07:27:55.716512+0000","modified":"2024-09-16T07:37:12.364452+0000","last_up_change":"2024-09-16T07:28:09.967295+0000","last_in_change":"2024-09-16T07:27:59.427807+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:28:11.019635+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2880b670-b794-44d2-a093-a6bb1fb302c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6809","nonce":1983213765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6811","nonce":1983213765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6815","nonce":1983213765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":1983213765},{"type":"v1","addr":"172.21.15.114:6813","nonce":1983213765}]},"public_addr":"172.21.15.114:6809/1983213765","cluster_addr":"172.21.15.114:6811/1983213765","heartbeat_back_addr":"172.21.15.114:6815/1983213765","heartbeat_front_addr":"172.21.15.114:6813/1983213765","state":["exists","up"]},{"osd":1,"uuid":"d2cd9d03-5dff-48f7-945e-3608aabf9e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6817","nonce":2092597227}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6819","nonce":2092597227}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6823","nonce":2092597227}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2092597227},{"type":"v1","addr":"172.21.15.114:6821","nonce":2092597227}]},"public_addr":"172.21.15.114:6817/2092597227","cluster_addr":"172.21.15.114:6819/2092597227","heartbeat_back_addr":"172.21.15.114:6823/2092597227","heartbeat_front_addr":"172.21.15.114:6821/2092597227","state":["exists","up"]},{"osd":2,"uuid":"d51d2492-9ac7-4c22-bf2e-86ae787c87aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6801","nonce":667480582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6803","nonce":667480582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6807","nonce":667480582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":667480582},{"type":"v1","addr":"172.21.15.114:6805","nonce":667480582}]},"public_addr":"172.21.15.114:6801/667480582","cluster_addr":"172.21.15.114:6803/667480582","heartbeat_back_addr":"172.21.15.114:6807/667480582","heartbeat_front_addr":"172.21.15.114:6805/667480582","state":["exists","up"]},{"osd":3,"uuid":"cd275489-3f01-4bb2-82df-f578dca217ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6825","nonce":4272931554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6827","nonce":4272931554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6831","nonce":4272931554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":4272931554},{"type":"v1","addr":"172.21.15.114:6829","nonce":4272931554}]},"public_addr":"172.21.15.114:6825/4272931554","cluster_addr":"172.21.15.114:6827/4272931554","heartbeat_back_addr":"172.21.15.114:6831/4272931554","heartbeat_front_addr":"172.21.15.114:6829/4272931554","state":["exists","up"]},{"osd":4,"uuid":"5f588931-d5de-48ef-9830-7ae234100023","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6811","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6813","nonce":263951499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6815","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6817","nonce":263951499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6823","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6825","nonce":263951499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6819","nonce":263951499},{"type":"v1","addr":"172.21.15.149:6821","nonce":263951499}]},"public_addr":"172.21.15.149:6813/263951499","cluster_addr":"172.21.15.149:6817/263951499","heartbeat_back_addr":"172.21.15.149:6825/263951499","heartbeat_front_addr":"172.21.15.149:6821/263951499","state":["exists","up"]},{"osd":5,"uuid":"65d74ded-7c7f-4b19-a592-1a3722364c54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6803","nonce":2815936045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6805","nonce":2815936045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6809","nonce":2815936045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2815936045},{"type":"v1","addr":"172.21.15.149:6807","nonce":2815936045}]},"public_addr":"172.21.15.149:6803/2815936045","cluster_addr":"172.21.15.149:6805/2815936045","heartbeat_back_addr":"172.21.15.149:6809/2815936045","heartbeat_front_addr":"172.21.15.149:6807/2815936045","state":["exists","up"]},{"osd":6,"uuid":"122fe90e-b355-49fd-9a88-dd335ff28bc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6827","nonce":1750215732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6829","nonce":1750215732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6833","nonce":1750215732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":1750215732},{"type":"v1","addr":"172.21.15.149:6831","nonce":1750215732}]},"public_addr":"172.21.15.149:6827/1750215732","cluster_addr":"172.21.15.149:6829/1750215732","heartbeat_back_addr":"172.21.15.149:6833/1750215732","heartbeat_front_addr":"172.21.15.149:6831/1750215732","state":["exists","up"]},{"osd":7,"uuid":"ebd4b3ee-e9f3-4414-a0c4-10c864b2ff6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6812","nonce":1130358838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6816","nonce":1130358838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6824","nonce":1130358838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":1130358838},{"type":"v1","addr":"172.21.15.149:6820","nonce":1130358838}]},"public_addr":"172.21.15.149:6812/1130358838","cluster_addr":"172.21.15.149:6816/1130358838","heartbeat_back_addr":"172.21.15.149:6824/1130358838","heartbeat_front_addr":"172.21.15.149:6820/1130358838","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.406812+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.657114+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.115633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.910415+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.444487+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.606994+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.434187+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T07:28:06.738591+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/2790565513":"2024-09-17T07:37:08.971940+0000","172.21.15.114:6833/2790565513":"2024-09-17T07:37:08.971940+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdea8073a90 msgr2=0x7fdea8075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdea8073a90 0x7fdea8075f50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8000c10 tx=0x7fdeb8009040 comp rx=0 tx=0).stop 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec80ced80 msgr2=0x7fdec81583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec80ced80 0x7fdec81583c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400c490 tx=0x7fdeb400c950 comp rx=0 tx=0).stop 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 shutdown_connections 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fdea8073a90 0x7fdea8075f50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdec815bea0 0x7fdec80b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdec80ced80 0x7fdec81583c0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 --2- 172.21.15.114:0/3393247570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdec80cdb30 0x7fdec81542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 >> 172.21.15.114:0/3393247570 conn(0x7fdec80d1dc0 msgr2=0x7fdec80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:17.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 shutdown_connections 2024-09-16T07:37:17.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:17.288+0000 7fdecf000640 1 -- 172.21.15.114:0/3393247570 wait complete. 2024-09-16T07:37:18.302 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T07:37:18.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:18.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 -- 172.21.15.114:0/1177076999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00cff00 msgr2=0x7f74f00d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 --2- 172.21.15.114:0/1177076999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00cff00 0x7f74f00d28c0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f74f00738a0 tx=0x7f74e401c8b0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 -- 172.21.15.114:0/1177076999 shutdown_connections 2024-09-16T07:37:18.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 --2- 172.21.15.114:0/1177076999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74f015f700 0x7f74f00d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 --2- 172.21.15.114:0/1177076999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00cff00 0x7f74f00d28c0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 -- 172.21.15.114:0/1177076999 >> 172.21.15.114:0/1177076999 conn(0x7f74f00d1da0 msgr2=0x7f74f00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:18.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 -- 172.21.15.114:0/1177076999 shutdown_connections 2024-09-16T07:37:18.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 -- 172.21.15.114:0/1177076999 wait complete. 2024-09-16T07:37:18.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 Processor -- start 2024-09-16T07:37:18.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.464+0000 7f74f7000640 1 -- start start 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f00cff00 0x7f74f0141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00d02e0 0x7f74f00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74f015f700 0x7f74f00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00b0ce0 con 0x7f74f00d02e0 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74f00b0b60 con 0x7f74f00cff00 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f74f0168bf0 con 0x7f74f015f700 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00d02e0 0x7f74f00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00d02e0 0x7f74f00cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50670/0 (socket says 172.21.15.114:50670) 2024-09-16T07:37:18.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 -- 172.21.15.114:0/1597036295 learned_addr learned my addr 172.21.15.114:0/1597036295 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5c00640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f00cff00 0x7f74f0141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f6600640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74f015f700 0x7f74f00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 -- 172.21.15.114:0/1597036295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74f015f700 msgr2=0x7f74f00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f74f015f700 0x7f74f00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 -- 172.21.15.114:0/1597036295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f00cff00 msgr2=0x7f74f0141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74f00cff00 0x7f74f0141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 -- 172.21.15.114:0/1597036295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f0141690 con 0x7f74f00d02e0 2024-09-16T07:37:18.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f5200640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00d02e0 0x7f74f00cce70 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00c490 tx=0x7f74dc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc017070 con 0x7f74f00d02e0 2024-09-16T07:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74dc003600 con 0x7f74f00d02e0 2024-09-16T07:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f00b7b00 con 0x7f74f00d02e0 2024-09-16T07:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc003a90 con 0x7f74f00d02e0 2024-09-16T07:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f00b7260 con 0x7f74f00d02e0 2024-09-16T07:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.468+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74f00d28c0 con 0x7f74f00d02e0 2024-09-16T07:37:18.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f74dc01a070 con 0x7f74f00d02e0 2024-09-16T07:37:18.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74ed600640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f74d0073a90 0x7f74d0075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f74dc0924b0 con 0x7f74f00d02e0 2024-09-16T07:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74f5c00640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f74d0073a90 0x7f74d0075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74ed600640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f74d0079950 0x7f74d007bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 --> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74d007c440 con 0x7f74d0079950 2024-09-16T07:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f74dc095120 con 0x7f74f00d02e0 2024-09-16T07:37:18.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74f6600640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f74d0079950 0x7f74d007bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74f5c00640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f74d0073a90 0x7f74d0075f50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f74e40af000 tx=0x7f74e401b0f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74f6600640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f74d0079950 0x7f74d007bd70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.472+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== osd.0 v2:172.21.15.114:6808/1983213765 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74d007c440 con 0x7f74d0079950 2024-09-16T07:37:18.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 --> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f74f0070ab0 con 0x7f74d0079950 2024-09-16T07:37:18.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74ed600640 1 -- 172.21.15.114:0/1597036295 <== osd.0 v2:172.21.15.114:6808/1983213765 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f74f0070ab0 con 0x7f74d0079950 2024-09-16T07:37:18.481 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:18.481 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:18.481 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:18.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f74d0079950 msgr2=0x7f74d007bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6808/1983213765,v1:172.21.15.114:6809/1983213765] conn(0x7f74d0079950 0x7f74d007bd70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f74d0073a90 msgr2=0x7f74d0075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f74d0073a90 0x7f74d0075f50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f74e40af000 tx=0x7f74e401b0f0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00d02e0 msgr2=0x7f74f00cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 --2- 172.21.15.114:0/1597036295 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f74f00d02e0 0x7f74f00cce70 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00c490 tx=0x7f74dc001e80 comp rx=0 tx=0).stop 2024-09-16T07:37:18.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f6600640 1 -- 172.21.15.114:0/1597036295 reap_dead start 2024-09-16T07:37:18.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 shutdown_connections 2024-09-16T07:37:18.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 >> 172.21.15.114:0/1597036295 conn(0x7f74f00d1da0 msgr2=0x7f74f0156600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:18.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 shutdown_connections 2024-09-16T07:37:18.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.488+0000 7f74f7000640 1 -- 172.21.15.114:0/1597036295 wait complete. 2024-09-16T07:37:18.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T07:37:18.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.648+0000 7f11c6800640 1 -- 172.21.15.114:0/585244213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11a8004810 msgr2=0x7f11a8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.648+0000 7f11c6800640 1 --2- 172.21.15.114:0/585244213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11a8004810 0x7f11a8004c90 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f11ac00bbe0 tx=0x7f11ac01ce00 comp rx=0 tx=0).stop 2024-09-16T07:37:18.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- 172.21.15.114:0/585244213 shutdown_connections 2024-09-16T07:37:18.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 --2- 172.21.15.114:0/585244213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11a8004810 0x7f11a8004c90 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- 172.21.15.114:0/585244213 >> 172.21.15.114:0/585244213 conn(0x7f11c009aa10 msgr2=0x7f11c009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:18.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- 172.21.15.114:0/585244213 shutdown_connections 2024-09-16T07:37:18.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- 172.21.15.114:0/585244213 wait complete. 2024-09-16T07:37:18.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 Processor -- start 2024-09-16T07:37:18.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- start start 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8004810 0x7f11c0148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11c01f9690 0x7f11c0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c01f5ce0 0x7f11c01f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00b2e90 con 0x7f11c01f5ce0 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00b2d10 con 0x7f11a8004810 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c6800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f11c00d19d0 con 0x7f11c01f9690 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c01f5ce0 0x7f11c01f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c01f5ce0 0x7f11c01f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50692/0 (socket says 172.21.15.114:50692) 2024-09-16T07:37:18.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 -- 172.21.15.114:0/2896133059 learned_addr learned my addr 172.21.15.114:0/2896133059 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5400640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8004810 0x7f11c0148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c4a00640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11c01f9690 0x7f11c0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 -- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11c01f9690 msgr2=0x7f11c0070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11c01f9690 0x7f11c0070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 -- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8004810 msgr2=0x7f11c0148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8004810 0x7f11c0148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 -- 172.21.15.114:0/2896133059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c01f9b10 con 0x7f11c01f5ce0 2024-09-16T07:37:18.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11c5e00640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c01f5ce0 0x7f11c01f6160 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f11c00d0050 tx=0x7f11b8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.652+0000 7f11bd600640 1 -- 172.21.15.114:0/2896133059 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b800fa80 con 0x7f11c01f5ce0 2024-09-16T07:37:18.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11bd600640 1 -- 172.21.15.114:0/2896133059 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11b800fc20 con 0x7f11c01f5ce0 2024-09-16T07:37:18.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11bd600640 1 -- 172.21.15.114:0/2896133059 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8011430 con 0x7f11c01f5ce0 2024-09-16T07:37:18.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c0149120 con 0x7f11c01f5ce0 2024-09-16T07:37:18.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01496e0 con 0x7f11c01f5ce0 2024-09-16T07:37:18.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c00d1f30 con 0x7f11c01f5ce0 2024-09-16T07:37:18.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11bd600640 1 -- 172.21.15.114:0/2896133059 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f11b80117e0 con 0x7f11c01f5ce0 2024-09-16T07:37:18.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11bd600640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f11a0073ac0 0x7f11a0075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11bd600640 1 -- 172.21.15.114:0/2896133059 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f11b8093180 con 0x7f11c01f5ce0 2024-09-16T07:37:18.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.656+0000 7f11c5400640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f11a0073ac0 0x7f11a0075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.660+0000 7f11c5400640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f11a0073ac0 0x7f11a0075f80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f11b4000c10 tx=0x7f11b4006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.660+0000 7f11bd600640 1 -- 172.21.15.114:0/2896133059 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f11b805f7d0 con 0x7f11c01f5ce0 2024-09-16T07:37:18.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f11c015e480 con 0x7f11a0073ac0 2024-09-16T07:37:18.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11bd600640 1 -- 172.21.15.114:0/2896133059 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f11c015e480 con 0x7f11a0073ac0 2024-09-16T07:37:18.822 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T07:37:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f11a0073ac0 msgr2=0x7f11a0075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f11a0073ac0 0x7f11a0075f80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f11b4000c10 tx=0x7f11b4006b80 comp rx=0 tx=0).stop 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c01f5ce0 msgr2=0x7f11c01f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c01f5ce0 0x7f11c01f6160 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f11c00d0050 tx=0x7f11b8006720 comp rx=0 tx=0).stop 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 shutdown_connections 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11c01f5ce0 0x7f11c01f6160 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f11a0073ac0 0x7f11a0075f80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f11c01f9690 0x7f11c0070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 --2- 172.21.15.114:0/2896133059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8004810 0x7f11c0148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.828+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 >> 172.21.15.114:0/2896133059 conn(0x7f11c009aa10 msgr2=0x7f11c0072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.832+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 shutdown_connections 2024-09-16T07:37:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.832+0000 7f11c6800640 1 -- 172.21.15.114:0/2896133059 wait complete. 2024-09-16T07:37:18.844 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T07:37:18.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:18.948 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:18.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:18.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 -- 172.21.15.114:0/2505887011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 msgr2=0x7faaf00ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 --2- 172.21.15.114:0/2505887011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 0x7faaf00ce700 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7faae0009840 tx=0x7faae001f010 comp rx=0 tx=0).stop 2024-09-16T07:37:18.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 -- 172.21.15.114:0/2505887011 shutdown_connections 2024-09-16T07:37:18.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 --2- 172.21.15.114:0/2505887011 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 0x7faaf00ce700 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 -- 172.21.15.114:0/2505887011 >> 172.21.15.114:0/2505887011 conn(0x7faaf00d1da0 msgr2=0x7faaf00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:18.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 -- 172.21.15.114:0/2505887011 shutdown_connections 2024-09-16T07:37:18.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 -- 172.21.15.114:0/2505887011 wait complete. 2024-09-16T07:37:18.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 Processor -- start 2024-09-16T07:37:18.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:18.996+0000 7faaf6a00640 1 -- start start 2024-09-16T07:37:18.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaf00b0b60 0x7faaf0148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 0x7faaf00c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaf015c1f0 0x7faaf014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7faaf00cd670 con 0x7faaf015be10 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faaf00cd4f0 con 0x7faaf00b0b60 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7faaf00cd7f0 con 0x7faaf015c1f0 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 0x7faaf00c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 0x7faaf00c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50722/0 (socket says 172.21.15.114:50722) 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 -- 172.21.15.114:0/2140877872 learned_addr learned my addr 172.21.15.114:0/2140877872 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaefe00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaf00b0b60 0x7faaf0148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf4a00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaf015c1f0 0x7faaf014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 -- 172.21.15.114:0/2140877872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaf015c1f0 msgr2=0x7faaf014ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faaf015c1f0 0x7faaf014ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 -- 172.21.15.114:0/2140877872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaf00b0b60 msgr2=0x7faaf0148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faaf00b0b60 0x7faaf0148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 -- 172.21.15.114:0/2140877872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf00c93b0 con 0x7faaf015be10 2024-09-16T07:37:18.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faae7e00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 0x7faaf00c8e70 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7faad800c3c0 tx=0x7faad800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8017070 con 0x7faaf015be10 2024-09-16T07:37:18.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad80053c0 con 0x7faaf015be10 2024-09-16T07:37:18.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8003860 con 0x7faaf015be10 2024-09-16T07:37:18.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf00cb710 con 0x7faaf015be10 2024-09-16T07:37:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf00cbcd0 con 0x7faaf015be10 2024-09-16T07:37:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faaf00cdca0 con 0x7faaf015be10 2024-09-16T07:37:18.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.000+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7faad801a070 con 0x7faaf015be10 2024-09-16T07:37:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaecc00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faacc073ac0 0x7faacc075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7faad8091fc0 con 0x7faaf015be10 2024-09-16T07:37:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaefe00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faacc073ac0 0x7faacc075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaecc00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7faacc079980 0x7faacc07bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:18.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 --> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faacc07c470 con 0x7faacc079980 2024-09-16T07:37:18.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7faad8094cb0 con 0x7faaf015be10 2024-09-16T07:37:18.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaf4a00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7faacc079980 0x7faacc07bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:18.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaefe00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faacc073ac0 0x7faacc075f80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faae00b2000 tx=0x7faae001d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaf4a00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7faacc079980 0x7faacc07bda0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:18.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.004+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== osd.1 v2:172.21.15.114:6816/2092597227 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faacc07c470 con 0x7faacc079980 2024-09-16T07:37:19.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.016+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 --> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faaf0070350 con 0x7faacc079980 2024-09-16T07:37:19.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.016+0000 7faaecc00640 1 -- 172.21.15.114:0/2140877872 <== osd.1 v2:172.21.15.114:6816/2092597227 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faaf0070350 con 0x7faacc079980 2024-09-16T07:37:19.012 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:19.012 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:19.013 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7faacc079980 msgr2=0x7faacc07bda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6816/2092597227,v1:172.21.15.114:6817/2092597227] conn(0x7faacc079980 0x7faacc07bda0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faacc073ac0 msgr2=0x7faacc075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7faacc073ac0 0x7faacc075f80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faae00b2000 tx=0x7faae001d850 comp rx=0 tx=0).stop 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 msgr2=0x7faaf00c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 --2- 172.21.15.114:0/2140877872 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faaf015be10 0x7faaf00c8e70 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7faad800c3c0 tx=0x7faad800c880 comp rx=0 tx=0).stop 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf4a00640 1 -- 172.21.15.114:0/2140877872 reap_dead start 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 shutdown_connections 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 >> 172.21.15.114:0/2140877872 conn(0x7faaf00d1da0 msgr2=0x7faaf0071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 shutdown_connections 2024-09-16T07:37:19.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.020+0000 7faaf6a00640 1 -- 172.21.15.114:0/2140877872 wait complete. 2024-09-16T07:37:19.031 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T07:37:19.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 -- 172.21.15.114:0/1222476118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 msgr2=0x7f9b6006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 --2- 172.21.15.114:0/1222476118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b6006ec80 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009c80 tx=0x7f9b5801cc80 comp rx=0 tx=0).stop 2024-09-16T07:37:19.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 -- 172.21.15.114:0/1222476118 shutdown_connections 2024-09-16T07:37:19.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 --2- 172.21.15.114:0/1222476118 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b6006ec80 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 --2- 172.21.15.114:0/1222476118 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b6015df50 0x7f9b6006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 -- 172.21.15.114:0/1222476118 >> 172.21.15.114:0/1222476118 conn(0x7f9b600d1dc0 msgr2=0x7f9b600d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:19.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 -- 172.21.15.114:0/1222476118 shutdown_connections 2024-09-16T07:37:19.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 -- 172.21.15.114:0/1222476118 wait complete. 2024-09-16T07:37:19.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 Processor -- start 2024-09-16T07:37:19.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.224+0000 7f9b66400640 1 -- start start 2024-09-16T07:37:19.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b60157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b6015df50 0x7f9b6015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b6015e330 0x7f9b6015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9b600d0790 con 0x7f9b600b11d0 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9b600d0610 con 0x7f9b6015df50 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9b600d0910 con 0x7f9b6015e330 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b60157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b60157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50736/0 (socket says 172.21.15.114:50736) 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 -- 172.21.15.114:0/1611273076 learned_addr learned my addr 172.21.15.114:0/1611273076 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5ea00640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b6015df50 0x7f9b6015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5fe00640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b6015e330 0x7f9b6015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 -- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b6015e330 msgr2=0x7f9b6015c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b6015e330 0x7f9b6015c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 -- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b6015df50 msgr2=0x7f9b6015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b6015df50 0x7f9b6015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 -- 172.21.15.114:0/1611273076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b601f8110 con 0x7f9b600b11d0 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b5f400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b60157120 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000ea40 tx=0x7f9b5000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b57400640 1 -- 172.21.15.114:0/1611273076 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5000ce40 con 0x7f9b600b11d0 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b57400640 1 -- 172.21.15.114:0/1611273076 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b50004020 con 0x7f9b600b11d0 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b6009dea0 con 0x7f9b600b11d0 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b57400640 1 -- 172.21.15.114:0/1611273076 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b50004470 con 0x7f9b600b11d0 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b6009db00 con 0x7f9b600b11d0 2024-09-16T07:37:19.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.228+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b600afcd0 con 0x7f9b600b11d0 2024-09-16T07:37:19.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.232+0000 7f9b57400640 1 -- 172.21.15.114:0/1611273076 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f9b50003600 con 0x7f9b600b11d0 2024-09-16T07:37:19.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.232+0000 7f9b57400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9b40073a90 0x7f9b40075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.232+0000 7f9b57400640 1 -- 172.21.15.114:0/1611273076 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f9b500930b0 con 0x7f9b600b11d0 2024-09-16T07:37:19.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.232+0000 7f9b5ea00640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9b40073a90 0x7f9b40075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.232+0000 7f9b5ea00640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9b40073a90 0x7f9b40075f50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9b600732c0 tx=0x7f9b4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:19.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.236+0000 7f9b57400640 1 -- 172.21.15.114:0/1611273076 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f9b5005f700 con 0x7f9b600b11d0 2024-09-16T07:37:19.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9b60070bd0 con 0x7f9b40073a90 2024-09-16T07:37:19.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b57400640 1 -- 172.21.15.114:0/1611273076 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9b60070bd0 con 0x7f9b40073a90 2024-09-16T07:37:19.398 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T07:37:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9b40073a90 msgr2=0x7f9b40075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9b40073a90 0x7f9b40075f50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9b600732c0 tx=0x7f9b4c009040 comp rx=0 tx=0).stop 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 msgr2=0x7f9b60157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b60157120 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000ea40 tx=0x7f9b5000ef00 comp rx=0 tx=0).stop 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 shutdown_connections 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9b40073a90 0x7f9b40075f50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b6015e330 0x7f9b6015c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b6015df50 0x7f9b6015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 --2- 172.21.15.114:0/1611273076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b600b11d0 0x7f9b60157120 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 >> 172.21.15.114:0/1611273076 conn(0x7f9b600d1dc0 msgr2=0x7f9b600b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 shutdown_connections 2024-09-16T07:37:19.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.404+0000 7f9b66400640 1 -- 172.21.15.114:0/1611273076 wait complete. 2024-09-16T07:37:19.419 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T07:37:19.419 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:19.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.572+0000 7f9b13a00640 1 -- 172.21.15.114:0/4055174332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af0005240 msgr2=0x7f9af000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.572+0000 7f9b13a00640 1 --2- 172.21.15.114:0/4055174332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af0005240 0x7f9af000b9d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009ee0 tx=0x7f9b0401d370 comp rx=0 tx=0).stop 2024-09-16T07:37:19.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.572+0000 7f9b13a00640 1 -- 172.21.15.114:0/4055174332 shutdown_connections 2024-09-16T07:37:19.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.572+0000 7f9b13a00640 1 --2- 172.21.15.114:0/4055174332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af0005240 0x7f9af000b9d0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.572+0000 7f9b13a00640 1 -- 172.21.15.114:0/4055174332 >> 172.21.15.114:0/4055174332 conn(0x7f9b0c0d1dc0 msgr2=0x7f9b0c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:19.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.572+0000 7f9b13a00640 1 -- 172.21.15.114:0/4055174332 shutdown_connections 2024-09-16T07:37:19.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.572+0000 7f9b13a00640 1 -- 172.21.15.114:0/4055174332 wait complete. 2024-09-16T07:37:19.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 Processor -- start 2024-09-16T07:37:19.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 -- start start 2024-09-16T07:37:19.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9af0005240 0x7f9b0c0b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b0c0b4c80 0x7f9b0c153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b0c15b2b0 0x7f9b0c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c15f880 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0b33a0 con 0x7f9af0005240 2024-09-16T07:37:19.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c0cfc30 con 0x7f9b0c0b4c80 2024-09-16T07:37:19.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b0c15b2b0 0x7f9b0c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b0c15b2b0 0x7f9b0c15b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50754/0 (socket says 172.21.15.114:50754) 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 -- 172.21.15.114:0/762374030 learned_addr learned my addr 172.21.15.114:0/762374030 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11000640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9af0005240 0x7f9b0c0b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b03e00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b0c0b4c80 0x7f9b0c153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 -- 172.21.15.114:0/762374030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b0c0b4c80 msgr2=0x7f9b0c153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9b0c0b4c80 0x7f9b0c153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 -- 172.21.15.114:0/762374030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9af0005240 msgr2=0x7f9b0c0b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9af0005240 0x7f9b0c0b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 -- 172.21.15.114:0/762374030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c15eb70 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b11a00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b0c15b2b0 0x7f9b0c15b730 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009e00 tx=0x7f9b04004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:19.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b040bd070 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b04003d30 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b040a9070 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c0b6e30 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c156110 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.576+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b0c0d00f0 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f9b040c0070 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b09600640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9ae8073ac0 0x7f9ae8075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f9b0412d300 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b11000640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9ae8073ac0 0x7f9ae8075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b09600640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7f9ae8079980 0x7f9ae807bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 --> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b040aeec0 con 0x7f9ae8079980 2024-09-16T07:37:19.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f9b0412fb60 con 0x7f9b0c15b2b0 2024-09-16T07:37:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b03e00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7f9ae8079980 0x7f9ae807bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b11000640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9ae8073ac0 0x7f9ae8075f80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006b00 tx=0x7f9afc001e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:19.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b03e00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7f9ae8079980 0x7f9ae807bda0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:19.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.580+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== osd.2 v2:172.21.15.114:6800/667480582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b040aeec0 con 0x7f9ae8079980 2024-09-16T07:37:19.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 --> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9b0c15e800 con 0x7f9ae8079980 2024-09-16T07:37:19.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b09600640 1 -- 172.21.15.114:0/762374030 <== osd.2 v2:172.21.15.114:6800/667480582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9b0c15e800 con 0x7f9ae8079980 2024-09-16T07:37:19.589 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:19.589 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:19.589 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:19.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7f9ae8079980 msgr2=0x7f9ae807bda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6800/667480582,v1:172.21.15.114:6801/667480582] conn(0x7f9ae8079980 0x7f9ae807bda0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9ae8073ac0 msgr2=0x7f9ae8075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9ae8073ac0 0x7f9ae8075f80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006b00 tx=0x7f9afc001e10 comp rx=0 tx=0).stop 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b0c15b2b0 msgr2=0x7f9b0c15b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 --2- 172.21.15.114:0/762374030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b0c15b2b0 0x7f9b0c15b730 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009e00 tx=0x7f9b04004680 comp rx=0 tx=0).stop 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b11a00640 1 -- 172.21.15.114:0/762374030 reap_dead start 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 shutdown_connections 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 >> 172.21.15.114:0/762374030 conn(0x7f9b0c0d1dc0 msgr2=0x7f9b0c15c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 shutdown_connections 2024-09-16T07:37:19.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.596+0000 7f9b13a00640 1 -- 172.21.15.114:0/762374030 wait complete. 2024-09-16T07:37:19.608 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 -- 172.21.15.114:0/1380164908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e015ade0 msgr2=0x7fc3e00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/1380164908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e015ade0 0x7fc3e00cebf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d001c8e0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 -- 172.21.15.114:0/1380164908 shutdown_connections 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/1380164908 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3e006e810 0x7fc3e00cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/1380164908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e015ade0 0x7fc3e00cebf0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 -- 172.21.15.114:0/1380164908 >> 172.21.15.114:0/1380164908 conn(0x7fc3e00b18f0 msgr2=0x7fc3e00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 -- 172.21.15.114:0/1380164908 shutdown_connections 2024-09-16T07:37:19.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.756+0000 7fc3e5a00640 1 -- 172.21.15.114:0/1380164908 wait complete. 2024-09-16T07:37:19.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 Processor -- start 2024-09-16T07:37:19.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 -- start start 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3e006e810 0x7fc3e0150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e00b4bd0 0x7fc3e00adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3e015ade0 0x7fc3e00ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0168140 con 0x7fc3e015ade0 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0167fc0 con 0x7fc3e00b4bd0 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e01682c0 con 0x7fc3e006e810 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3e015ade0 0x7fc3e00ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3e015ade0 0x7fc3e00ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50768/0 (socket says 172.21.15.114:50768) 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 -- 172.21.15.114:0/3316884070 learned_addr learned my addr 172.21.15.114:0/3316884070 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3dea00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3e006e810 0x7fc3e0150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3d7e00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e00b4bd0 0x7fc3e00adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 -- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3e006e810 msgr2=0x7fc3e0150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3e006e810 0x7fc3e0150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 -- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e00b4bd0 msgr2=0x7fc3e00adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e00b4bd0 0x7fc3e00adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 -- 172.21.15.114:0/3316884070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e013fc60 con 0x7fc3e015ade0 2024-09-16T07:37:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3df400640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3e015ade0 0x7fc3e00ae170 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c7c0 tx=0x7fc3d800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3d6a00640 1 -- 172.21.15.114:0/3316884070 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8003b80 con 0x7fc3e015ade0 2024-09-16T07:37:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3d6a00640 1 -- 172.21.15.114:0/3316884070 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3d8003d20 con 0x7fc3e015ade0 2024-09-16T07:37:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3d6a00640 1 -- 172.21.15.114:0/3316884070 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800aab0 con 0x7fc3e015ade0 2024-09-16T07:37:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e014efc0 con 0x7fc3e015ade0 2024-09-16T07:37:19.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.760+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e014f580 con 0x7fc3e015ade0 2024-09-16T07:37:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.764+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e0069410 con 0x7fc3e015ade0 2024-09-16T07:37:19.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.764+0000 7fc3d6a00640 1 -- 172.21.15.114:0/3316884070 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fc3d800ac50 con 0x7fc3e015ade0 2024-09-16T07:37:19.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.764+0000 7fc3d6a00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc3bc073a90 0x7fc3bc075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:19.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.764+0000 7fc3d6a00640 1 -- 172.21.15.114:0/3316884070 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fc3d8092710 con 0x7fc3e015ade0 2024-09-16T07:37:19.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.764+0000 7fc3dea00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc3bc073a90 0x7fc3bc075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:19.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.764+0000 7fc3dea00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc3bc073a90 0x7fc3bc075f50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00af000 tx=0x7fc3d001b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:19.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.768+0000 7fc3d6a00640 1 -- 172.21.15.114:0/3316884070 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fc3d805eb60 con 0x7fc3e015ade0 2024-09-16T07:37:19.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.936+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc3e00b3480 con 0x7fc3bc073a90 2024-09-16T07:37:19.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.936+0000 7fc3d6a00640 1 -- 172.21.15.114:0/3316884070 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc3e00b3480 con 0x7fc3bc073a90 2024-09-16T07:37:19.932 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc3bc073a90 msgr2=0x7fc3bc075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc3bc073a90 0x7fc3bc075f50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00af000 tx=0x7fc3d001b120 comp rx=0 tx=0).stop 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3e015ade0 msgr2=0x7fc3e00ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3e015ade0 0x7fc3e00ae170 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c7c0 tx=0x7fc3d800cc80 comp rx=0 tx=0).stop 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 shutdown_connections 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3e015ade0 0x7fc3e00ae170 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e00b4bd0 0x7fc3e00adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fc3bc073a90 0x7fc3bc075f50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 --2- 172.21.15.114:0/3316884070 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc3e006e810 0x7fc3e0150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 >> 172.21.15.114:0/3316884070 conn(0x7fc3e00b18f0 msgr2=0x7fc3e00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 shutdown_connections 2024-09-16T07:37:19.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:19.940+0000 7fc3e5a00640 1 -- 172.21.15.114:0/3316884070 wait complete. 2024-09-16T07:37:19.954 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T07:37:19.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:20.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 -- 172.21.15.114:0/767490967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 msgr2=0x7f4cc00d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 --2- 172.21.15.114:0/767490967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 0x7f4cc00d28c0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009900 tx=0x7f4cb001c8b0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 -- 172.21.15.114:0/767490967 shutdown_connections 2024-09-16T07:37:20.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 --2- 172.21.15.114:0/767490967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc00d02e0 0x7f4cc00d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 --2- 172.21.15.114:0/767490967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 0x7f4cc00d28c0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 -- 172.21.15.114:0/767490967 >> 172.21.15.114:0/767490967 conn(0x7f4cc00d1da0 msgr2=0x7f4cc00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 -- 172.21.15.114:0/767490967 shutdown_connections 2024-09-16T07:37:20.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 -- 172.21.15.114:0/767490967 wait complete. 2024-09-16T07:37:20.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 Processor -- start 2024-09-16T07:37:20.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.108+0000 7f4cbfe00640 1 -- start start 2024-09-16T07:37:20.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 0x7f4cc01522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc00d02e0 0x7f4cc0150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc015eff0 0x7f4cc01488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc0169140 con 0x7f4cc00cff00 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc0168fc0 con 0x7f4cc015eff0 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc01692c0 con 0x7f4cc00d02e0 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 0x7f4cc01522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 0x7f4cc01522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50786/0 (socket says 172.21.15.114:50786) 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 -- 172.21.15.114:0/4011887473 learned_addr learned my addr 172.21.15.114:0/4011887473 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbf400640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc015eff0 0x7f4cc01488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cb6000640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc00d02e0 0x7f4cc0150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 -- 172.21.15.114:0/4011887473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc00d02e0 msgr2=0x7f4cc0150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4cc00d02e0 0x7f4cc0150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 -- 172.21.15.114:0/4011887473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc015eff0 msgr2=0x7f4cc01488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4cc015eff0 0x7f4cc01488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 -- 172.21.15.114:0/4011887473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc01fb300 con 0x7f4cc00cff00 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbea00640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 0x7f4cc01522a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009850 tx=0x7f4cb0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00b2040 con 0x7f4cc00cff00 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb0005070 con 0x7f4cc00cff00 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00054a0 con 0x7f4cc00cff00 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc01fc080 con 0x7f4cc00cff00 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc01fb880 con 0x7f4cc00cff00 2024-09-16T07:37:20.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cc00d28c0 con 0x7f4cc00cff00 2024-09-16T07:37:20.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.112+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f4cb00046d0 con 0x7f4cc00cff00 2024-09-16T07:37:20.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb7400640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c9c073a90 0x7f4c9c075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f4cb012c330 con 0x7f4cc00cff00 2024-09-16T07:37:20.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb6000640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c9c073a90 0x7f4c9c075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb7400640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f4c9c079950 0x7f4c9c07bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 --> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c9c07c440 con 0x7f4c9c079950 2024-09-16T07:37:20.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f4cb012ec20 con 0x7f4cc00cff00 2024-09-16T07:37:20.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cbf400640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f4c9c079950 0x7f4c9c07bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb6000640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c9c073a90 0x7f4c9c075f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80058d0 tx=0x7f4ca8005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cbf400640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f4c9c079950 0x7f4c9c07bd70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.116+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== osd.3 v2:172.21.15.114:6824/4272931554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c9c07c440 con 0x7f4c9c079950 2024-09-16T07:37:20.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.128+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 --> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4cc00cf6b0 con 0x7f4c9c079950 2024-09-16T07:37:20.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.128+0000 7f4cb7400640 1 -- 172.21.15.114:0/4011887473 <== osd.3 v2:172.21.15.114:6824/4272931554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4cc00cf6b0 con 0x7f4c9c079950 2024-09-16T07:37:20.124 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:20.124 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:20.124 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:20.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.128+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f4c9c079950 msgr2=0x7f4c9c07bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.128+0000 7f4cbfe00640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6824/4272931554,v1:172.21.15.114:6825/4272931554] conn(0x7f4c9c079950 0x7f4c9c07bd70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c9c073a90 msgr2=0x7f4c9c075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f4c9c073a90 0x7f4c9c075f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80058d0 tx=0x7f4ca8005860 comp rx=0 tx=0).stop 2024-09-16T07:37:20.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 msgr2=0x7f4cc01522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 --2- 172.21.15.114:0/4011887473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4cc00cff00 0x7f4cc01522a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009850 tx=0x7f4cb0004040 comp rx=0 tx=0).stop 2024-09-16T07:37:20.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbf400640 1 -- 172.21.15.114:0/4011887473 reap_dead start 2024-09-16T07:37:20.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 shutdown_connections 2024-09-16T07:37:20.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 >> 172.21.15.114:0/4011887473 conn(0x7f4cc00d1da0 msgr2=0x7f4cc006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 shutdown_connections 2024-09-16T07:37:20.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.132+0000 7f4cbfe00640 1 -- 172.21.15.114:0/4011887473 wait complete. 2024-09-16T07:37:20.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- 172.21.15.114:0/4103368955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c15f490 msgr2=0x7f1a0c0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 --2- 172.21.15.114:0/4103368955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c15f490 0x7f1a0c0b14c0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c074950 tx=0x7f19fc01c740 comp rx=0 tx=0).stop 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- 172.21.15.114:0/4103368955 shutdown_connections 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 --2- 172.21.15.114:0/4103368955 >> v2:172.21.15.149:3300/0 conn(0x7f1a0c0afca0 0x7f1a0c0b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 --2- 172.21.15.114:0/4103368955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c15f490 0x7f1a0c0b14c0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- 172.21.15.114:0/4103368955 >> 172.21.15.114:0/4103368955 conn(0x7f1a0c0d1e30 msgr2=0x7f1a0c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- 172.21.15.114:0/4103368955 shutdown_connections 2024-09-16T07:37:20.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- 172.21.15.114:0/4103368955 wait complete. 2024-09-16T07:37:20.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 Processor -- start 2024-09-16T07:37:20.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- start start 2024-09-16T07:37:20.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a0c0afca0 0x7f1a0c153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c0b2e80 0x7f1a0c1fb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a0c15f490 0x7f1a0c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c168e00 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c168c80 con 0x7f1a0c15f490 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.292+0000 7f1a13a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c168f80 con 0x7f1a0c0afca0 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c0b2e80 0x7f1a0c1fb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c0b2e80 0x7f1a0c1fb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50798/0 (socket says 172.21.15.114:50798) 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 -- 172.21.15.114:0/811255138 learned_addr learned my addr 172.21.15.114:0/811255138 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a11000640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a0c0afca0 0x7f1a0c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a11a00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a0c15f490 0x7f1a0c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 -- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a0c0afca0 msgr2=0x7f1a0c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a0c0afca0 0x7f1a0c153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 -- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a0c15f490 msgr2=0x7f1a0c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a0c15f490 0x7f1a0c157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 -- 172.21.15.114:0/811255138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c1fac50 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a0be00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c0b2e80 0x7f1a0c1fb410 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c4c0 tx=0x7f19f800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a08c00640 1 -- 172.21.15.114:0/811255138 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8016020 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a08c00640 1 -- 172.21.15.114:0/811255138 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19f8012940 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c06f800 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a08c00640 1 -- 172.21.15.114:0/811255138 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8012d90 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c1fb950 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c0b00d0 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.296+0000 7f1a08c00640 1 -- 172.21.15.114:0/811255138 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f19f8019020 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.300+0000 7f1a08c00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f19ec073ac0 0x7f19ec075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.300+0000 7f1a08c00640 1 -- 172.21.15.114:0/811255138 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f19f8092980 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.300+0000 7f1a11000640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f19ec073ac0 0x7f19ec075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.300+0000 7f1a11000640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f19ec073ac0 0x7f19ec075f80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0af000 tx=0x7f19fc01af80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.304+0000 7f1a08c00640 1 -- 172.21.15.114:0/811255138 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f19f8020020 con 0x7f1a0c0b2e80 2024-09-16T07:37:20.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.468+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f1a0c06fd20 con 0x7f19ec073ac0 2024-09-16T07:37:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.468+0000 7f1a08c00640 1 -- 172.21.15.114:0/811255138 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a0c06fd20 con 0x7f19ec073ac0 2024-09-16T07:37:20.464 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f19ec073ac0 msgr2=0x7f19ec075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f19ec073ac0 0x7f19ec075f80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0af000 tx=0x7f19fc01af80 comp rx=0 tx=0).stop 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c0b2e80 msgr2=0x7f1a0c1fb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c0b2e80 0x7f1a0c1fb410 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c4c0 tx=0x7f19f800c980 comp rx=0 tx=0).stop 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 shutdown_connections 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a0c15f490 0x7f1a0c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a0c0b2e80 0x7f1a0c1fb410 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f19ec073ac0 0x7f19ec075f80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 --2- 172.21.15.114:0/811255138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a0c0afca0 0x7f1a0c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 >> 172.21.15.114:0/811255138 conn(0x7f1a0c0d1e30 msgr2=0x7f1a0c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 shutdown_connections 2024-09-16T07:37:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.472+0000 7f1a13a00640 1 -- 172.21.15.114:0/811255138 wait complete. 2024-09-16T07:37:20.485 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T07:37:20.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:20.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- 172.21.15.114:0/650554094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b00cf950 msgr2=0x7f98b00d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 --2- 172.21.15.114:0/650554094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b00cf950 0x7f98b00d1280 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f989c009840 tx=0x7f989c01c820 comp rx=0 tx=0).stop 2024-09-16T07:37:20.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- 172.21.15.114:0/650554094 shutdown_connections 2024-09-16T07:37:20.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 --2- 172.21.15.114:0/650554094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b00cf950 0x7f98b00d1280 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 --2- 172.21.15.114:0/650554094 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98b015dff0 0x7f98b00d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- 172.21.15.114:0/650554094 >> 172.21.15.114:0/650554094 conn(0x7f98b00d3f10 msgr2=0x7f98b00d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- 172.21.15.114:0/650554094 shutdown_connections 2024-09-16T07:37:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- 172.21.15.114:0/650554094 wait complete. 2024-09-16T07:37:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 Processor -- start 2024-09-16T07:37:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- start start 2024-09-16T07:37:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98b00cf950 0x7f98b00b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98b00d24d0 0x7f98b015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b015dff0 0x7f98b00b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f98b016b840 con 0x7f98b015dff0 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f98b016b6c0 con 0x7f98b00d24d0 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b5800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f98b016b9c0 con 0x7f98b00cf950 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b015dff0 0x7f98b00b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b015dff0 0x7f98b00b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50804/0 (socket says 172.21.15.114:50804) 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 -- 172.21.15.114:0/1683026893 learned_addr learned my addr 172.21.15.114:0/1683026893 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98afe00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98b00cf950 0x7f98b00b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98af400640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98b00d24d0 0x7f98b015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 -- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98b00cf950 msgr2=0x7f98b00b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98b00cf950 0x7f98b00b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 -- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98b00d24d0 msgr2=0x7f98b015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98b00d24d0 0x7f98b015a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.640+0000 7f98b4e00640 1 -- 172.21.15.114:0/1683026893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b00b6f90 con 0x7f98b015dff0 2024-09-16T07:37:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98b4e00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b015dff0 0x7f98b00b10c0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f98a800cbf0 tx=0x7f98a800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8016020 con 0x7f98b015dff0 2024-09-16T07:37:20.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98a800ab00 con 0x7f98b015dff0 2024-09-16T07:37:20.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b00b7270 con 0x7f98b015dff0 2024-09-16T07:37:20.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8012420 con 0x7f98b015dff0 2024-09-16T07:37:20.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b00b1ec0 con 0x7f98b015dff0 2024-09-16T07:37:20.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98b00b6d40 con 0x7f98b015dff0 2024-09-16T07:37:20.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f98a8019020 con 0x7f98b015dff0 2024-09-16T07:37:20.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9890073a90 0x7f9890075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f98a8093180 con 0x7f98b015dff0 2024-09-16T07:37:20.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98afe00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9890073a90 0x7f9890075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f9890079950 0x7f989007bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 --> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98a801ae70 con 0x7f9890079950 2024-09-16T07:37:20.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.644+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f98a8095a60 con 0x7f98b015dff0 2024-09-16T07:37:20.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.648+0000 7f98af400640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f9890079950 0x7f989007bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.648+0000 7f98afe00640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9890073a90 0x7f9890075f50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f98a000bb50 tx=0x7f98a000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.648+0000 7f98af400640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f9890079950 0x7f989007bd70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.648+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== osd.4 v2:172.21.15.149:6811/263951499 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98a801ae70 con 0x7f9890079950 2024-09-16T07:37:20.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.660+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 --> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f98b00b17d0 con 0x7f9890079950 2024-09-16T07:37:20.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.660+0000 7f98a7e00640 1 -- 172.21.15.114:0/1683026893 <== osd.4 v2:172.21.15.149:6811/263951499 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f98b00b17d0 con 0x7f9890079950 2024-09-16T07:37:20.656 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:20.657 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:20.657 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.660+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f9890079950 msgr2=0x7f989007bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.660+0000 7f98b5800640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.149:6811/263951499,v1:172.21.15.149:6813/263951499] conn(0x7f9890079950 0x7f989007bd70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9890073a90 msgr2=0x7f9890075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f9890073a90 0x7f9890075f50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f98a000bb50 tx=0x7f98a000b2e0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b015dff0 msgr2=0x7f98b00b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 --2- 172.21.15.114:0/1683026893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f98b015dff0 0x7f98b00b10c0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f98a800cbf0 tx=0x7f98a800cce0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b4e00640 1 -- 172.21.15.114:0/1683026893 reap_dead start 2024-09-16T07:37:20.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 shutdown_connections 2024-09-16T07:37:20.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 >> 172.21.15.114:0/1683026893 conn(0x7f98b00d3f10 msgr2=0x7f98b00d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 shutdown_connections 2024-09-16T07:37:20.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.664+0000 7f98b5800640 1 -- 172.21.15.114:0/1683026893 wait complete. 2024-09-16T07:37:20.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- 172.21.15.114:0/560256749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 msgr2=0x7fd0a40ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 --2- 172.21.15.114:0/560256749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 0x7fd0a40ae9b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009840 tx=0x7fd08c01c820 comp rx=0 tx=0).stop 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- 172.21.15.114:0/560256749 shutdown_connections 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 --2- 172.21.15.114:0/560256749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0a40cdb30 0x7fd0a40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 --2- 172.21.15.114:0/560256749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 0x7fd0a40ae9b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- 172.21.15.114:0/560256749 >> 172.21.15.114:0/560256749 conn(0x7fd0a40d1dc0 msgr2=0x7fd0a40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- 172.21.15.114:0/560256749 shutdown_connections 2024-09-16T07:37:20.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- 172.21.15.114:0/560256749 wait complete. 2024-09-16T07:37:20.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 Processor -- start 2024-09-16T07:37:20.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- start start 2024-09-16T07:37:20.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0a40cdb30 0x7fd0a406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 0x7fd0a41fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0a415bea0 0x7fd0a40c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a4169340 con 0x7fd0a415bea0 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a41691c0 con 0x7fd0a40ced80 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.824+0000 7fd0aa000640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a41694c0 con 0x7fd0a40cdb30 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0a415bea0 0x7fd0a40c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0a415bea0 0x7fd0a40c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50816/0 (socket says 172.21.15.114:50816) 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 -- 172.21.15.114:0/2316234475 learned_addr learned my addr 172.21.15.114:0/2316234475 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3400640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0a40cdb30 0x7fd0a406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd09aa00640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 0x7fd0a41fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 -- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0a40cdb30 msgr2=0x7fd0a406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0a40cdb30 0x7fd0a406fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 -- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 msgr2=0x7fd0a41fb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 0x7fd0a41fb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 -- 172.21.15.114:0/2316234475 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a41fbe80 con 0x7fd0a415bea0 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3400640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0a40cdb30 0x7fd0a406fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd09aa00640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 0x7fd0a41fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0a3e00640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0a415bea0 0x7fd0a40c7c20 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00eb20 tx=0x7fd09c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd09be00640 1 -- 172.21.15.114:0/2316234475 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c004b30 con 0x7fd0a415bea0 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd09be00640 1 -- 172.21.15.114:0/2316234475 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd09c004cf0 con 0x7fd0a415bea0 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd09be00640 1 -- 172.21.15.114:0/2316234475 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c005280 con 0x7fd0a415bea0 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a41560d0 con 0x7fd0a415bea0 2024-09-16T07:37:20.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a40b1610 con 0x7fd0a415bea0 2024-09-16T07:37:20.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a41566b0 con 0x7fd0a415bea0 2024-09-16T07:37:20.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.828+0000 7fd09be00640 1 -- 172.21.15.114:0/2316234475 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fd09c005420 con 0x7fd0a415bea0 2024-09-16T07:37:20.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.832+0000 7fd09be00640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd080073a90 0x7fd080075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:20.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.832+0000 7fd09be00640 1 -- 172.21.15.114:0/2316234475 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fd09c0935e0 con 0x7fd0a415bea0 2024-09-16T07:37:20.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.832+0000 7fd0a3400640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd080073a90 0x7fd080075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:20.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.832+0000 7fd0a3400640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd080073a90 0x7fd080075f50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd094001630 tx=0x7fd094009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:20.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:20.836+0000 7fd09be00640 1 -- 172.21.15.114:0/2316234475 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fd0a41fbe80 con 0x7fd0a415bea0 2024-09-16T07:37:20.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.000+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd0a40ce670 con 0x7fd080073a90 2024-09-16T07:37:20.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.000+0000 7fd09be00640 1 -- 172.21.15.114:0/2316234475 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd0a40ce670 con 0x7fd080073a90 2024-09-16T07:37:20.995 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T07:37:20.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd080073a90 msgr2=0x7fd080075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd080073a90 0x7fd080075f50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd094001630 tx=0x7fd094009040 comp rx=0 tx=0).stop 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0a415bea0 msgr2=0x7fd0a40c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0a415bea0 0x7fd0a40c7c20 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00eb20 tx=0x7fd09c00c2d0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 shutdown_connections 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd0a415bea0 0x7fd0a40c7c20 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a40ced80 0x7fd0a41fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd080073a90 0x7fd080075f50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 --2- 172.21.15.114:0/2316234475 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd0a40cdb30 0x7fd0a406fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 >> 172.21.15.114:0/2316234475 conn(0x7fd0a40d1dc0 msgr2=0x7fd0a40b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 shutdown_connections 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.004+0000 7fd0aa000640 1 -- 172.21.15.114:0/2316234475 wait complete. 2024-09-16T07:37:21.016 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T07:37:21.016 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:21.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 -- 172.21.15.114:0/1537129626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6340d28e0 msgr2=0x7fd6340d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 --2- 172.21.15.114:0/1537129626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6340d28e0 0x7fd6340d0340 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd620009840 tx=0x7fd62001c5c0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 -- 172.21.15.114:0/1537129626 shutdown_connections 2024-09-16T07:37:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 --2- 172.21.15.114:0/1537129626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6340d28e0 0x7fd6340d0340 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 -- 172.21.15.114:0/1537129626 >> 172.21.15.114:0/1537129626 conn(0x7fd6340d1dc0 msgr2=0x7fd6340d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 -- 172.21.15.114:0/1537129626 shutdown_connections 2024-09-16T07:37:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 -- 172.21.15.114:0/1537129626 wait complete. 2024-09-16T07:37:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 Processor -- start 2024-09-16T07:37:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.168+0000 7fd638a00640 1 -- start start 2024-09-16T07:37:21.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340af850 0x7fd634154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340d28e0 0x7fd63414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415f390 0x7fd6340ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd634169eb0 con 0x7fd6340af850 2024-09-16T07:37:21.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd634169d30 con 0x7fd63415f390 2024-09-16T07:37:21.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fd63416a030 con 0x7fd6340d28e0 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340af850 0x7fd634154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340af850 0x7fd634154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50820/0 (socket says 172.21.15.114:50820) 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 -- 172.21.15.114:0/2243731510 learned_addr learned my addr 172.21.15.114:0/2243731510 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631400640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340d28e0 0x7fd63414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd632800640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415f390 0x7fd6340ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 -- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340d28e0 msgr2=0x7fd63414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340d28e0 0x7fd63414eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 -- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415f390 msgr2=0x7fd6340ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd63415f390 0x7fd6340ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 -- 172.21.15.114:0/2243731510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63406df70 con 0x7fd6340af850 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631400640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6340d28e0 0x7fd63414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd631e00640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340af850 0x7fd634154ce0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c6b0 tx=0x7fd62400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624017070 con 0x7fd6340af850 2024-09-16T07:37:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd624005380 con 0x7fd6340af850 2024-09-16T07:37:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62400a8a0 con 0x7fd6340af850 2024-09-16T07:37:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd634155370 con 0x7fd6340af850 2024-09-16T07:37:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd634155930 con 0x7fd6340af850 2024-09-16T07:37:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd63406e380 con 0x7fd6340af850 2024-09-16T07:37:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.172+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fd62401a070 con 0x7fd6340af850 2024-09-16T07:37:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd62a000640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd614073a90 0x7fd614075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fd624092580 con 0x7fd6340af850 2024-09-16T07:37:21.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd631400640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd614073a90 0x7fd614075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd62a000640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fd614079950 0x7fd61407bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 --> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd624015e70 con 0x7fd614079950 2024-09-16T07:37:21.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7fd624095280 con 0x7fd6340af850 2024-09-16T07:37:21.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd632800640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fd614079950 0x7fd61407bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd631400640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd614073a90 0x7fd614075f50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ae000 tx=0x7fd62001ae00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd632800640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fd614079950 0x7fd61407bd70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.176+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== osd.5 v2:172.21.15.149:6802/2815936045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd624015e70 con 0x7fd614079950 2024-09-16T07:37:21.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.188+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 --> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6340afc30 con 0x7fd614079950 2024-09-16T07:37:21.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd62a000640 1 -- 172.21.15.114:0/2243731510 <== osd.5 v2:172.21.15.149:6802/2815936045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6340afc30 con 0x7fd614079950 2024-09-16T07:37:21.185 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:21.185 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:21.185 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:21.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fd614079950 msgr2=0x7fd61407bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.149:6802/2815936045,v1:172.21.15.149:6803/2815936045] conn(0x7fd614079950 0x7fd61407bd70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd614073a90 msgr2=0x7fd614075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fd614073a90 0x7fd614075f50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ae000 tx=0x7fd62001ae00 comp rx=0 tx=0).stop 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340af850 msgr2=0x7fd634154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 --2- 172.21.15.114:0/2243731510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6340af850 0x7fd634154ce0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c6b0 tx=0x7fd62400cb70 comp rx=0 tx=0).stop 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd632800640 1 -- 172.21.15.114:0/2243731510 reap_dead start 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 shutdown_connections 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 >> 172.21.15.114:0/2243731510 conn(0x7fd6340d1dc0 msgr2=0x7fd6340d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 shutdown_connections 2024-09-16T07:37:21.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.192+0000 7fd638a00640 1 -- 172.21.15.114:0/2243731510 wait complete. 2024-09-16T07:37:21.203 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- 172.21.15.114:0/2698683086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c0b4bd0 msgr2=0x7f7d9c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 --2- 172.21.15.114:0/2698683086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0cf130 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009bc0 tx=0x7f7d9401cac0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- 172.21.15.114:0/2698683086 shutdown_connections 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 --2- 172.21.15.114:0/2698683086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0cf130 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 --2- 172.21.15.114:0/2698683086 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d9c15ade0 0x7f7d9c0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- 172.21.15.114:0/2698683086 >> 172.21.15.114:0/2698683086 conn(0x7f7d9c0b18f0 msgr2=0x7f7d9c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- 172.21.15.114:0/2698683086 shutdown_connections 2024-09-16T07:37:21.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- 172.21.15.114:0/2698683086 wait complete. 2024-09-16T07:37:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 Processor -- start 2024-09-16T07:37:21.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- start start 2024-09-16T07:37:21.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c06e810 0x7f7d9c0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d9c15ade0 0x7f7d9c1fac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c1680e0 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c167f60 con 0x7f7d9c06e810 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.352+0000 7f7da4200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9c168260 con 0x7f7d9c15ade0 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50824/0 (socket says 172.21.15.114:50824) 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 -- 172.21.15.114:0/3076271617 learned_addr learned my addr 172.21.15.114:0/3076271617 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da1800640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c06e810 0x7f7d9c0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da2200640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d9c15ade0 0x7f7d9c1fac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 -- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d9c15ade0 msgr2=0x7f7d9c1fac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d9c15ade0 0x7f7d9c1fac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 -- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c06e810 msgr2=0x7f7d9c0b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c06e810 0x7f7d9c0b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 -- 172.21.15.114:0/3076271617 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c073780 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da0e00640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0b0ed0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800c560 tx=0x7f7d8800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7d99600640 1 -- 172.21.15.114:0/3076271617 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88016020 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7d99600640 1 -- 172.21.15.114:0/3076271617 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d88012920 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9c073a60 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7d99600640 1 -- 172.21.15.114:0/3076271617 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88012db0 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9c0acee0 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9c069410 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.356+0000 7f7d99600640 1 -- 172.21.15.114:0/3076271617 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f7d88019020 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.360+0000 7f7d99600640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7d7c073a90 0x7f7d7c075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.360+0000 7f7d99600640 1 -- 172.21.15.114:0/3076271617 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f7d880928f0 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.360+0000 7f7da1800640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7d7c073a90 0x7f7d7c075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.360+0000 7f7da1800640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7d7c073a90 0x7f7d7c075f50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c1faba0 tx=0x7f7d900091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.364+0000 7f7d99600640 1 -- 172.21.15.114:0/3076271617 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f7d88020030 con 0x7f7d9c0b4bd0 2024-09-16T07:37:21.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f7d9c073f80 con 0x7f7d7c073a90 2024-09-16T07:37:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7d99600640 1 -- 172.21.15.114:0/3076271617 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7d9c073f80 con 0x7f7d7c073a90 2024-09-16T07:37:21.525 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T07:37:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7d7c073a90 msgr2=0x7f7d7c075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7d7c073a90 0x7f7d7c075f50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c1faba0 tx=0x7f7d900091e0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9c0b4bd0 msgr2=0x7f7d9c0b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0b0ed0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800c560 tx=0x7f7d8800ca20 comp rx=0 tx=0).stop 2024-09-16T07:37:21.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 shutdown_connections 2024-09-16T07:37:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f7d7c073a90 0x7f7d7c075f50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7d9c15ade0 0x7f7d9c1fac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d9c0b4bd0 0x7f7d9c0b0ed0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 --2- 172.21.15.114:0/3076271617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d9c06e810 0x7f7d9c0b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 >> 172.21.15.114:0/3076271617 conn(0x7f7d9c0b18f0 msgr2=0x7f7d9c157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 shutdown_connections 2024-09-16T07:37:21.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.532+0000 7f7da4200640 1 -- 172.21.15.114:0/3076271617 wait complete. 2024-09-16T07:37:21.546 INFO:tasks.ceph:Scrubbing osd.6 2024-09-16T07:37:21.546 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- 172.21.15.114:0/379918883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 msgr2=0x7ff6fc15ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 --2- 172.21.15.114:0/379918883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 0x7ff6fc15ebf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009840 tx=0x7ff6f401c790 comp rx=0 tx=0).stop 2024-09-16T07:37:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- 172.21.15.114:0/379918883 shutdown_connections 2024-09-16T07:37:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 --2- 172.21.15.114:0/379918883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 0x7ff6fc15ebf0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 --2- 172.21.15.114:0/379918883 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6fc15e360 0x7ff6fc0adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- 172.21.15.114:0/379918883 >> 172.21.15.114:0/379918883 conn(0x7ff6fc0cfbc0 msgr2=0x7ff6fc0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:21.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- 172.21.15.114:0/379918883 shutdown_connections 2024-09-16T07:37:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- 172.21.15.114:0/379918883 wait complete. 2024-09-16T07:37:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 Processor -- start 2024-09-16T07:37:21.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- start start 2024-09-16T07:37:21.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6fc0aef60 0x7ff6fc14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6fc15e360 0x7ff6fc09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 0x7ff6fc09af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1680b0 con 0x7ff6fc0aef60 2024-09-16T07:37:21.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc167f30 con 0x7ff6fc15e740 2024-09-16T07:37:21.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff702a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7ff6fc168230 con 0x7ff6fc15e360 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6fc0aef60 0x7ff6fc14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6fc0aef60 0x7ff6fc14b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50826/0 (socket says 172.21.15.114:50826) 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 -- 172.21.15.114:0/3191120955 learned_addr learned my addr 172.21.15.114:0/3191120955 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fb400640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6fc15e360 0x7ff6fc09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff700a00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 0x7ff6fc09af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 -- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6fc15e360 msgr2=0x7ff6fc09aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6fc15e360 0x7ff6fc09aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 -- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 msgr2=0x7ff6fc09af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 0x7ff6fc09af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fbe00640 1 -- 172.21.15.114:0/3191120955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc09d800 con 0x7ff6fc0aef60 2024-09-16T07:37:21.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff6fb400640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff6fc15e360 0x7ff6fc09aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:21.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.700+0000 7ff700a00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6fc15e740 0x7ff6fc09af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:21.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6fbe00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6fc0aef60 0x7ff6fc14b230 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00eba0 tx=0x7ff6ec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00eea0 con 0x7ff6fc0aef60 2024-09-16T07:37:21.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6ec004d50 con 0x7ff6fc0aef60 2024-09-16T07:37:21.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc1555d0 con 0x7ff6fc0aef60 2024-09-16T07:37:21.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005280 con 0x7ff6fc0aef60 2024-09-16T07:37:21.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc155b90 con 0x7ff6fc0aef60 2024-09-16T07:37:21.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6fc15ebf0 con 0x7ff6fc0aef60 2024-09-16T07:37:21.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7ff6ec005420 con 0x7ff6fc0aef60 2024-09-16T07:37:21.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6dc073a90 0x7ff6dc075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7ff6ec093be0 con 0x7ff6fc0aef60 2024-09-16T07:37:21.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6fb400640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6dc073a90 0x7ff6dc075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7ff6dc079950 0x7ff6dc07bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 --> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc07c440 con 0x7ff6dc079950 2024-09-16T07:37:21.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.704+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec0968e0 con 0x7ff6fc0aef60 2024-09-16T07:37:21.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.708+0000 7ff700a00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7ff6dc079950 0x7ff6dc07bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.708+0000 7ff6fb400640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6dc073a90 0x7ff6dc075f50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0b1370 tx=0x7ff6e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.708+0000 7ff700a00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7ff6dc079950 0x7ff6dc07bd70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.708+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== osd.6 v2:172.21.15.149:6826/1750215732 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc07c440 con 0x7ff6dc079950 2024-09-16T07:37:21.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 --> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff6fc0d0850 con 0x7ff6dc079950 2024-09-16T07:37:21.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff6f3e00640 1 -- 172.21.15.114:0/3191120955 <== osd.6 v2:172.21.15.149:6826/1750215732 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff6fc0d0850 con 0x7ff6dc079950 2024-09-16T07:37:21.716 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:21.716 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:21.716 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7ff6dc079950 msgr2=0x7ff6dc07bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.149:6826/1750215732,v1:172.21.15.149:6827/1750215732] conn(0x7ff6dc079950 0x7ff6dc07bd70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6dc073a90 msgr2=0x7ff6dc075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7ff6dc073a90 0x7ff6dc075f50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0b1370 tx=0x7ff6e8009040 comp rx=0 tx=0).stop 2024-09-16T07:37:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6fc0aef60 msgr2=0x7ff6fc14b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 --2- 172.21.15.114:0/3191120955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6fc0aef60 0x7ff6fc14b230 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00eba0 tx=0x7ff6ec00c6a0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff700a00640 1 -- 172.21.15.114:0/3191120955 reap_dead start 2024-09-16T07:37:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.720+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 shutdown_connections 2024-09-16T07:37:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.724+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 >> 172.21.15.114:0/3191120955 conn(0x7ff6fc0cfbc0 msgr2=0x7ff6fc164c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.724+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 shutdown_connections 2024-09-16T07:37:21.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.724+0000 7ff702a00640 1 -- 172.21.15.114:0/3191120955 wait complete. 2024-09-16T07:37:21.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-16T07:37:21.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.880+0000 7f7822c00640 1 -- 172.21.15.114:0/1649379554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c06d7c0 msgr2=0x7f781c070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.880+0000 7f7822c00640 1 --2- 172.21.15.114:0/1649379554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c06d7c0 0x7f781c070780 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f7814009bc0 tx=0x7f781401cb10 comp rx=0 tx=0).stop 2024-09-16T07:37:21.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- 172.21.15.114:0/1649379554 shutdown_connections 2024-09-16T07:37:21.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 --2- 172.21.15.114:0/1649379554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c06d7c0 0x7f781c070780 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- 172.21.15.114:0/1649379554 >> 172.21.15.114:0/1649379554 conn(0x7f781c0b2240 msgr2=0x7f781c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:21.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- 172.21.15.114:0/1649379554 shutdown_connections 2024-09-16T07:37:21.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- 172.21.15.114:0/1649379554 wait complete. 2024-09-16T07:37:21.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 Processor -- start 2024-09-16T07:37:21.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- start start 2024-09-16T07:37:21.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f781c06d330 0x7f781c14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f781c06d7c0 0x7f781c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c15e1c0 0x7f781c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f781c16c5f0 con 0x7f781c15e1c0 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f781c16c470 con 0x7f781c06d330 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7822c00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f781c16c770 con 0x7f781c06d7c0 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c15e1c0 0x7f781c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c15e1c0 0x7f781c0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50844/0 (socket says 172.21.15.114:50844) 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 -- 172.21.15.114:0/1645008956 learned_addr learned my addr 172.21.15.114:0/1645008956 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7813400640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f781c06d7c0 0x7f781c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f781be00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f781c06d330 0x7f781c14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 -- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f781c06d7c0 msgr2=0x7f781c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f781c06d7c0 0x7f781c154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 -- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f781c06d330 msgr2=0x7f781c14ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f781c06d330 0x7f781c14ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:21.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 -- 172.21.15.114:0/1645008956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781c154ac0 con 0x7f781c15e1c0 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f781be00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f781c06d330 0x7f781c14ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7820c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c15e1c0 0x7f781c0b45d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f78140b0040 tx=0x7f7814005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7818c00640 1 -- 172.21.15.114:0/1645008956 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78140b2040 con 0x7f781c15e1c0 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.884+0000 7f7818c00640 1 -- 172.21.15.114:0/1645008956 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78140bb070 con 0x7f781c15e1c0 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f7818c00640 1 -- 172.21.15.114:0/1645008956 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78140045b0 con 0x7f781c15e1c0 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781c14f040 con 0x7f781c15e1c0 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781c1531d0 con 0x7f781c15e1c0 2024-09-16T07:37:21.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781c070780 con 0x7f781c15e1c0 2024-09-16T07:37:21.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f7818c00640 1 -- 172.21.15.114:0/1645008956 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f78140a5a70 con 0x7f781c15e1c0 2024-09-16T07:37:21.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f7818c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f77f8073ac0 0x7f77f8075f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:21.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f7818c00640 1 -- 172.21.15.114:0/1645008956 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f781412d490 con 0x7f781c15e1c0 2024-09-16T07:37:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.888+0000 7f781be00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f77f8073ac0 0x7f77f8075f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:21.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.892+0000 7f781be00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f77f8073ac0 0x7f77f8075f80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f780c00a850 tx=0x7f780c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:21.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:21.892+0000 7f7818c00640 1 -- 172.21.15.114:0/1645008956 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f781c154ac0 con 0x7f781c15e1c0 2024-09-16T07:37:22.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.076+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f781c152ca0 con 0x7f77f8073ac0 2024-09-16T07:37:22.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.076+0000 7f7818c00640 1 -- 172.21.15.114:0/1645008956 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f781c152ca0 con 0x7f77f8073ac0 2024-09-16T07:37:22.071 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 6 to deep-scrub 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f77f8073ac0 msgr2=0x7f77f8075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f77f8073ac0 0x7f77f8075f80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f780c00a850 tx=0x7f780c008040 comp rx=0 tx=0).stop 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c15e1c0 msgr2=0x7f781c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c15e1c0 0x7f781c0b45d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f78140b0040 tx=0x7f7814005b00 comp rx=0 tx=0).stop 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 shutdown_connections 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f781c15e1c0 0x7f781c0b45d0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f77f8073ac0 0x7f77f8075f80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f781c06d7c0 0x7f781c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 --2- 172.21.15.114:0/1645008956 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f781c06d330 0x7f781c14ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 >> 172.21.15.114:0/1645008956 conn(0x7f781c0b2240 msgr2=0x7f781c161a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 shutdown_connections 2024-09-16T07:37:22.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.080+0000 7f7822c00640 1 -- 172.21.15.114:0/1645008956 wait complete. 2024-09-16T07:37:22.093 INFO:tasks.ceph:Scrubbing osd.7 2024-09-16T07:37:22.093 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 -- 172.21.15.114:0/1975548677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c0b0b60 msgr2=0x7f421c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 --2- 172.21.15.114:0/1975548677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c0b0b60 0x7f421c0ccbd0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f4214009c80 tx=0x7f421401f5a0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 -- 172.21.15.114:0/1975548677 shutdown_connections 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 --2- 172.21.15.114:0/1975548677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c0b0b60 0x7f421c0ccbd0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 --2- 172.21.15.114:0/1975548677 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f421c15c1f0 0x7f421c0cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 -- 172.21.15.114:0/1975548677 >> 172.21.15.114:0/1975548677 conn(0x7f421c0d1da0 msgr2=0x7f421c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 -- 172.21.15.114:0/1975548677 shutdown_connections 2024-09-16T07:37:22.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.244+0000 7f4220a00640 1 -- 172.21.15.114:0/1975548677 wait complete. 2024-09-16T07:37:22.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 Processor -- start 2024-09-16T07:37:22.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 -- start start 2024-09-16T07:37:22.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f421c0b0b60 0x7f421c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f421c15be10 0x7f421c156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c15c1f0 0x7f421c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f421c0cd4a0 con 0x7f421c15c1f0 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f421c0cd320 con 0x7f421c0b0b60 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f421c0cd620 con 0x7f421c15be10 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c15c1f0 0x7f421c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c15c1f0 0x7f421c0b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50858/0 (socket says 172.21.15.114:50858) 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 -- 172.21.15.114:0/2234464059 learned_addr learned my addr 172.21.15.114:0/2234464059 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4219e00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f421c0b0b60 0x7f421c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4211400640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f421c15be10 0x7f421c156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 -- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f421c15be10 msgr2=0x7f421c156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f421c15be10 0x7f421c156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 -- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f421c0b0b60 msgr2=0x7f421c15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f421c0b0b60 0x7f421c15ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 -- 172.21.15.114:0/2234464059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c157120 con 0x7f421c15c1f0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f421a800640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c15c1f0 0x7f421c0b5a70 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4214009bd0 tx=0x7f42140af410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214004e60 con 0x7f421c15c1f0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42140be030 con 0x7f421c15c1f0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42140afae0 con 0x7f421c15c1f0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421c0b64c0 con 0x7f421c15c1f0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421c0b6a80 con 0x7f421c15c1f0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.248+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f421c0cdb10 con 0x7f421c15c1f0 2024-09-16T07:37:22.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f42140afc80 con 0x7f421c15c1f0 2024-09-16T07:37:22.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4212a00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f41f8073a90 0x7f41f8075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f42141317d0 con 0x7f421c15c1f0 2024-09-16T07:37:22.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4219e00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f41f8073a90 0x7f41f8075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4212a00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f41f8079950 0x7f41f807bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 --> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4214009030 con 0x7f41f8079950 2024-09-16T07:37:22.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f4214134140 con 0x7f421c15c1f0 2024-09-16T07:37:22.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4211400640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f41f8079950 0x7f41f807bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4219e00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f41f8073a90 0x7f41f8075f50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f420c007fd0 tx=0x7f420c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:22.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.252+0000 7f4211400640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f41f8079950 0x7f41f807bd70 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:22.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.256+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== osd.7 v2:172.21.15.149:6810/1130358838 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4214009030 con 0x7f41f8079950 2024-09-16T07:37:22.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 --> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f421c070350 con 0x7f41f8079950 2024-09-16T07:37:22.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4212a00640 1 -- 172.21.15.114:0/2234464059 <== osd.7 v2:172.21.15.149:6810/1130358838 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f421c070350 con 0x7f41f8079950 2024-09-16T07:37:22.262 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T07:37:22.262 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T07:37:22.262 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T07:37:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f41f8079950 msgr2=0x7f41f807bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.149:6810/1130358838,v1:172.21.15.149:6812/1130358838] conn(0x7f41f8079950 0x7f41f807bd70 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f41f8073a90 msgr2=0x7f41f8075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f41f8073a90 0x7f41f8075f50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f420c007fd0 tx=0x7f420c009040 comp rx=0 tx=0).stop 2024-09-16T07:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c15c1f0 msgr2=0x7f421c0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 --2- 172.21.15.114:0/2234464059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f421c15c1f0 0x7f421c0b5a70 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4214009bd0 tx=0x7f42140af410 comp rx=0 tx=0).stop 2024-09-16T07:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f421a800640 1 -- 172.21.15.114:0/2234464059 reap_dead start 2024-09-16T07:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 shutdown_connections 2024-09-16T07:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 >> 172.21.15.114:0/2234464059 conn(0x7f421c0d1da0 msgr2=0x7f421c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 shutdown_connections 2024-09-16T07:37:22.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.268+0000 7f4220a00640 1 -- 172.21.15.114:0/2234464059 wait complete. 2024-09-16T07:37:22.280 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-16T07:37:22.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 -- 172.21.15.114:0/1118235419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c840b2e80 msgr2=0x7f6c840b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 --2- 172.21.15.114:0/1118235419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c840b2e80 0x7f6c840b1a00 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009900 tx=0x7f6c7001c790 comp rx=0 tx=0).stop 2024-09-16T07:37:22.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 -- 172.21.15.114:0/1118235419 shutdown_connections 2024-09-16T07:37:22.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 --2- 172.21.15.114:0/1118235419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c840b2e80 0x7f6c840b1a00 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 --2- 172.21.15.114:0/1118235419 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c8415f490 0x7f6c840b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 -- 172.21.15.114:0/1118235419 >> 172.21.15.114:0/1118235419 conn(0x7f6c840d1e30 msgr2=0x7f6c840d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:22.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 -- 172.21.15.114:0/1118235419 shutdown_connections 2024-09-16T07:37:22.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 -- 172.21.15.114:0/1118235419 wait complete. 2024-09-16T07:37:22.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.428+0000 7f6c89e00640 1 Processor -- start 2024-09-16T07:37:22.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 -- start start 2024-09-16T07:37:22.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1f40 0x7f6c841fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c840b2e80 0x7f6c8414de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c8415f490 0x7f6c8406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84168e90 con 0x7f6c8415f490 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8415f9e0 con 0x7f6c840b1f40 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f6c84169010 con 0x7f6c840b2e80 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c8415f490 0x7f6c8406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c8415f490 0x7f6c8406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50888/0 (socket says 172.21.15.114:50888) 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 -- 172.21.15.114:0/3188838138 learned_addr learned my addr 172.21.15.114:0/3188838138 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c82a00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1f40 0x7f6c841fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c82000640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c840b2e80 0x7f6c8414de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 -- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c840b2e80 msgr2=0x7f6c8414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c840b2e80 0x7f6c8414de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 -- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1f40 msgr2=0x7f6c841fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1f40 0x7f6c841fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 -- 172.21.15.114:0/3188838138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c841f7bc0 con 0x7f6c8415f490 2024-09-16T07:37:22.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c83400640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c8415f490 0x7f6c8406f610 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c780 tx=0x7f6c7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:22.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c7b400640 1 -- 172.21.15.114:0/3188838138 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c004b70 con 0x7f6c8415f490 2024-09-16T07:37:22.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c7b400640 1 -- 172.21.15.114:0/3188838138 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c7c004e00 con 0x7f6c8415f490 2024-09-16T07:37:22.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c841f7ea0 con 0x7f6c8415f490 2024-09-16T07:37:22.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c7b400640 1 -- 172.21.15.114:0/3188838138 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00aab0 con 0x7f6c8415f490 2024-09-16T07:37:22.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c841f8460 con 0x7f6c8415f490 2024-09-16T07:37:22.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.432+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c840cfda0 con 0x7f6c8415f490 2024-09-16T07:37:22.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.436+0000 7f6c7b400640 1 -- 172.21.15.114:0/3188838138 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f6c7c00ac50 con 0x7f6c8415f490 2024-09-16T07:37:22.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.436+0000 7f6c7b400640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6c64073a90 0x7f6c64075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.436+0000 7f6c7b400640 1 -- 172.21.15.114:0/3188838138 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f6c7c092dc0 con 0x7f6c8415f490 2024-09-16T07:37:22.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.436+0000 7f6c82a00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6c64073a90 0x7f6c64075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.436+0000 7f6c82a00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6c64073a90 0x7f6c64075f50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c74005fd0 tx=0x7f6c74005d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:22.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.440+0000 7f6c7b400640 1 -- 172.21.15.114:0/3188838138 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f6c7c020070 con 0x7f6c8415f490 2024-09-16T07:37:22.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.608+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6c840cf5b0 con 0x7f6c64073a90 2024-09-16T07:37:22.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c7b400640 1 -- 172.21.15.114:0/3188838138 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6c840cf5b0 con 0x7f6c64073a90 2024-09-16T07:37:22.605 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 7 to deep-scrub 2024-09-16T07:37:22.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6c64073a90 msgr2=0x7f6c64075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6c64073a90 0x7f6c64075f50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c74005fd0 tx=0x7f6c74005d10 comp rx=0 tx=0).stop 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c8415f490 msgr2=0x7f6c8406f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c8415f490 0x7f6c8406f610 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c780 tx=0x7f6c7c00cc40 comp rx=0 tx=0).stop 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 shutdown_connections 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c8415f490 0x7f6c8406f610 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f6c64073a90 0x7f6c64075f50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6c840b2e80 0x7f6c8414de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 --2- 172.21.15.114:0/3188838138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1f40 0x7f6c841fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 >> 172.21.15.114:0/3188838138 conn(0x7f6c840d1e30 msgr2=0x7f6c840ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 shutdown_connections 2024-09-16T07:37:22.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.612+0000 7f6c89e00640 1 -- 172.21.15.114:0/3188838138 wait complete. 2024-09-16T07:37:22.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:37:22.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 -- 172.21.15.114:0/1175155396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 msgr2=0x7fb0740b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 --2- 172.21.15.114:0/1175155396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0740b2bf0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fb064009840 tx=0x7fb06401c790 comp rx=0 tx=0).stop 2024-09-16T07:37:22.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 -- 172.21.15.114:0/1175155396 shutdown_connections 2024-09-16T07:37:22.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 --2- 172.21.15.114:0/1175155396 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0740b4cf0 0x7fb0740b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 --2- 172.21.15.114:0/1175155396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0740b2bf0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 -- 172.21.15.114:0/1175155396 >> 172.21.15.114:0/1175155396 conn(0x7fb0740b18f0 msgr2=0x7fb0740b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:22.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 -- 172.21.15.114:0/1175155396 shutdown_connections 2024-09-16T07:37:22.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.772+0000 7fb07a200640 1 -- 172.21.15.114:0/1175155396 wait complete. 2024-09-16T07:37:22.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 Processor -- start 2024-09-16T07:37:22.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 -- start start 2024-09-16T07:37:22.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0740b4cf0 0x7fb0741fc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0741545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb074154b10 0x7fb074156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb074168350 con 0x7fb07415e260 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb0741681d0 con 0x7fb074154b10 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fb0741684d0 con 0x7fb0740b4cf0 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0741545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0741545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50898/0 (socket says 172.21.15.114:50898) 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 -- 172.21.15.114:0/3915644306 learned_addr learned my addr 172.21.15.114:0/3915644306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb073400640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0740b4cf0 0x7fb0741fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb073e00640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb074154b10 0x7fb074156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 -- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0740b4cf0 msgr2=0x7fb0741fc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0740b4cf0 0x7fb0741fc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 -- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb074154b10 msgr2=0x7fb074156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb074154b10 0x7fb074156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 -- 172.21.15.114:0/3915644306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0741fc770 con 0x7fb07415e260 2024-09-16T07:37:22.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06aa00640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0741545d0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00c430 tx=0x7fb05c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:22.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06be00640 1 -- 172.21.15.114:0/3915644306 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011790 con 0x7fb07415e260 2024-09-16T07:37:22.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06be00640 1 -- 172.21.15.114:0/3915644306 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb05c017070 con 0x7fb07415e260 2024-09-16T07:37:22.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb06be00640 1 -- 172.21.15.114:0/3915644306 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c011cc0 con 0x7fb07415e260 2024-09-16T07:37:22.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb074157310 con 0x7fb07415e260 2024-09-16T07:37:22.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.776+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0741578d0 con 0x7fb07415e260 2024-09-16T07:37:22.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.780+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb074069410 con 0x7fb07415e260 2024-09-16T07:37:22.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.780+0000 7fb06be00640 1 -- 172.21.15.114:0/3915644306 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fb05c01c460 con 0x7fb07415e260 2024-09-16T07:37:22.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.780+0000 7fb06be00640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb050073a90 0x7fb050075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:22.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.780+0000 7fb06be00640 1 -- 172.21.15.114:0/3915644306 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fb05c092830 con 0x7fb07415e260 2024-09-16T07:37:22.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.780+0000 7fb073400640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb050073a90 0x7fb050075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:22.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.780+0000 7fb073400640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb050073a90 0x7fb050075f50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0640af000 tx=0x7fb06401afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:22.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.784+0000 7fb06be00640 1 -- 172.21.15.114:0/3915644306 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fb05c05f270 con 0x7fb07415e260 2024-09-16T07:37:22.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.948+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb074154f20 con 0x7fb050073a90 2024-09-16T07:37:22.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.948+0000 7fb06be00640 1 -- 172.21.15.114:0/3915644306 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13411 (secure 0 0 0) 0x7fb074154f20 con 0x7fb050073a90 2024-09-16T07:37:22.944 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:22.944 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:37:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb050073a90 msgr2=0x7fb050075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb050073a90 0x7fb050075f50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb0640af000 tx=0x7fb06401afd0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 msgr2=0x7fb0741545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0741545d0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00c430 tx=0x7fb05c00c8f0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 shutdown_connections 2024-09-16T07:37:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb074154b10 0x7fb074156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb07415e260 0x7fb0741545d0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fb050073a90 0x7fb050075f50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 --2- 172.21.15.114:0/3915644306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0740b4cf0 0x7fb0741fc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:22.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 >> 172.21.15.114:0/3915644306 conn(0x7fb0740b18f0 msgr2=0x7fb0741651a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:22.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 shutdown_connections 2024-09-16T07:37:22.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:22.952+0000 7fb07a200640 1 -- 172.21.15.114:0/3915644306 wait complete. 2024-09-16T07:37:22.966 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-16T07:37:22.432967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":267244,"kb_used_data":17736,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707476,"statfs":{"total":773094113280,"available":772820455424,"internally_reserved":0,"allocated":18161664,"data_stored":8646264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.065910"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":409,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T07:37:12.370957+0000","last_change":"2024-09-16T07:28:12.546075+0000","last_active":"2024-09-16T07:37:12.370957+0000","last_peered":"2024-09-16T07:37:12.370957+0000","last_clean":"2024-09-16T07:37:12.370957+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:37:12.370957+0000","last_undegraded":"2024-09-16T07:37:12.370957+0000","last_fullsized":"2024-09-16T07:37:12.370957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:28:11.384260+0000","last_clean_scrub_stamp":"2024-09-16T07:28:11.384260+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:16:35.607401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33844,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337996,"statfs":{"total":96636764160,"available":96602107904,"internally_reserved":0,"allocated":2715648,"data_stored":1523559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33264,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33836,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338004,"statfs":{"total":96636764160,"available":96602116096,"internally_reserved":0,"allocated":2715648,"data_stored":1523559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:37:22.969 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:28:11.384260+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=28, tm_sec=11, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=37, tm_sec=17, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:37:22.970 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T07:37:42.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:37:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 -- 172.21.15.114:0/1911263201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 msgr2=0x7f5b3c0b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 --2- 172.21.15.114:0/1911263201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c0b4710 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0d1d70 tx=0x7f5b3401d300 comp rx=0 tx=0).stop 2024-09-16T07:37:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 -- 172.21.15.114:0/1911263201 shutdown_connections 2024-09-16T07:37:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 --2- 172.21.15.114:0/1911263201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c0b4710 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 --2- 172.21.15.114:0/1911263201 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c15cc90 0x7f5b3c06cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 --2- 172.21.15.114:0/1911263201 >> v2:172.21.15.149:3300/0 conn(0x7f5b3c1563e0 0x7f5b3c15d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 -- 172.21.15.114:0/1911263201 >> 172.21.15.114:0/1911263201 conn(0x7f5b3c06dd30 msgr2=0x7f5b3c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 -- 172.21.15.114:0/1911263201 shutdown_connections 2024-09-16T07:37:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 -- 172.21.15.114:0/1911263201 wait complete. 2024-09-16T07:37:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 Processor -- start 2024-09-16T07:37:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.128+0000 7f5b40a00640 1 -- start start 2024-09-16T07:37:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c1563e0 0x7f5b3c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c15cc90 0x7f5b3c14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c0af9b0 con 0x7f5b3c06d160 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3c0af830 con 0x7f5b3c15cc90 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3c0afb30 con 0x7f5b3c1563e0 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c14f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45598/0 (socket says 172.21.15.114:45598) 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 -- 172.21.15.114:0/3128960392 learned_addr learned my addr 172.21.15.114:0/3128960392 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b31400640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c1563e0 0x7f5b3c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b3a800640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c15cc90 0x7f5b3c14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 -- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c1563e0 msgr2=0x7f5b3c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c1563e0 0x7f5b3c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 -- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c15cc90 msgr2=0x7f5b3c14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c15cc90 0x7f5b3c14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 -- 172.21.15.114:0/3128960392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c157290 con 0x7f5b3c06d160 2024-09-16T07:37:43.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b39e00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c14f710 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00d770 tx=0x7f5b2c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:43.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b32a00640 1 -- 172.21.15.114:0/3128960392 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c017070 con 0x7f5b3c06d160 2024-09-16T07:37:43.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b32a00640 1 -- 172.21.15.114:0/3128960392 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b2c009d20 con 0x7f5b3c06d160 2024-09-16T07:37:43.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b32a00640 1 -- 172.21.15.114:0/3128960392 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0106c0 con 0x7f5b3c06d160 2024-09-16T07:37:43.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3c074250 con 0x7f5b3c06d160 2024-09-16T07:37:43.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b3c070a60 con 0x7f5b3c06d160 2024-09-16T07:37:43.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.132+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b3c15d3d0 con 0x7f5b3c06d160 2024-09-16T07:37:43.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.136+0000 7f5b32a00640 1 -- 172.21.15.114:0/3128960392 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7f5b2c01a070 con 0x7f5b3c06d160 2024-09-16T07:37:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.136+0000 7f5b32a00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b18073a90 0x7f5b18075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.136+0000 7f5b32a00640 1 -- 172.21.15.114:0/3128960392 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7f5b2c092af0 con 0x7f5b3c06d160 2024-09-16T07:37:43.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.136+0000 7f5b31400640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b18073a90 0x7f5b18075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.136+0000 7f5b31400640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b18073a90 0x7f5b18075f50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c09e8a0 tx=0x7f5b240095e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:43.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.140+0000 7f5b32a00640 1 -- 172.21.15.114:0/3128960392 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7f5b2c05ef40 con 0x7f5b3c06d160 2024-09-16T07:37:43.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 --> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b3c074000 con 0x7f5b18073a90 2024-09-16T07:37:43.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b32a00640 1 -- 172.21.15.114:0/3128960392 <== mgr.4106 v2:172.21.15.114:6836/1096280363 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13370 (secure 0 0 0) 0x7f5b3c074000 con 0x7f5b18073a90 2024-09-16T07:37:43.297 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:43.298 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-16T07:37:43.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b18073a90 msgr2=0x7f5b18075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b18073a90 0x7f5b18075f50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c09e8a0 tx=0x7f5b240095e0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 msgr2=0x7f5b3c14f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c14f710 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00d770 tx=0x7f5b2c00dc30 comp rx=0 tx=0).stop 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 shutdown_connections 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5b3c15cc90 0x7f5b3c14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7f5b18073a90 0x7f5b18075f50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5b3c1563e0 0x7f5b3c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 --2- 172.21.15.114:0/3128960392 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c06d160 0x7f5b3c14f710 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 >> 172.21.15.114:0/3128960392 conn(0x7f5b3c06dd30 msgr2=0x7f5b3c15d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 shutdown_connections 2024-09-16T07:37:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.304+0000 7f5b40a00640 1 -- 172.21.15.114:0/3128960392 wait complete. 2024-09-16T07:37:43.319 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-09-16T07:37:42.437193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":267236,"kb_used_data":17736,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754707484,"statfs":{"total":773094113280,"available":772820463616,"internally_reserved":0,"allocated":18161664,"data_stored":8646264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002757"},"pg_stats":[{"pgid":"1.0","version":"168'81","reported_seq":419,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T07:37:22.679899+0000","last_change":"2024-09-16T07:37:22.679899+0000","last_active":"2024-09-16T07:37:22.679899+0000","last_peered":"2024-09-16T07:37:22.679899+0000","last_clean":"2024-09-16T07:37:22.679899+0000","last_became_active":"2024-09-16T07:28:12.545120+0000","last_became_peered":"2024-09-16T07:28:12.545120+0000","last_unstale":"2024-09-16T07:37:22.679899+0000","last_undegraded":"2024-09-16T07:37:22.679899+0000","last_fullsized":"2024-09-16T07:37:22.679899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"168'81","last_scrub_stamp":"2024-09-16T07:37:22.679794+0000","last_deep_scrub":"168'81","last_deep_scrub_stamp":"2024-09-16T07:37:22.679794+0000","last_clean_scrub_stamp":"2024-09-16T07:37:22.679794+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:30.399846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33836,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338004,"statfs":{"total":96636764160,"available":96602116096,"internally_reserved":0,"allocated":2715648,"data_stored":1523559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33264,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":933191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33836,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338004,"statfs":{"total":96636764160,"available":96602116096,"internally_reserved":0,"allocated":2715648,"data_stored":1523559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:37:43.320 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- 172.21.15.114:0/766816921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 msgr2=0x7fced00d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 --2- 172.21.15.114:0/766816921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced00d1bb0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fced00cf780 tx=0x7fceb801c800 comp rx=0 tx=0).stop 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- 172.21.15.114:0/766816921 shutdown_connections 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 --2- 172.21.15.114:0/766816921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced00d1bb0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 --2- 172.21.15.114:0/766816921 >> v2:172.21.15.149:3300/0 conn(0x7fced015bd40 0x7fced00d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- 172.21.15.114:0/766816921 >> 172.21.15.114:0/766816921 conn(0x7fced009aa10 msgr2=0x7fced009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- 172.21.15.114:0/766816921 shutdown_connections 2024-09-16T07:37:43.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- 172.21.15.114:0/766816921 wait complete. 2024-09-16T07:37:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 Processor -- start 2024-09-16T07:37:43.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- start start 2024-09-16T07:37:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced0154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fced00d20f0 0x7fced01fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced015bd40 0x7fced015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fced0168db0 con 0x7fced00b0d10 2024-09-16T07:37:43.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fced0168c30 con 0x7fced015bd40 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecfe00640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fced0168f30 con 0x7fced00d20f0 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.468+0000 7fcecea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced0154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced0154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45618/0 (socket says 172.21.15.114:45618) 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 -- 172.21.15.114:0/3986503697 learned_addr learned my addr 172.21.15.114:0/3986503697 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcec6000640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fced00d20f0 0x7fced01fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecf400640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced015bd40 0x7fced015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 -- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fced00d20f0 msgr2=0x7fced01fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fced00d20f0 0x7fced01fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 -- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced015bd40 msgr2=0x7fced015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced015bd40 0x7fced015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 -- 172.21.15.114:0/3986503697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced0154f60 con 0x7fced00b0d10 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecf400640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced015bd40 0x7fced015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T07:37:43.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecea00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced0154a20 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fcec000e7d0 tx=0x7fcec000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec000ccc0 con 0x7fced00b0d10 2024-09-16T07:37:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcec0010430 con 0x7fced00b0d10 2024-09-16T07:37:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0010860 con 0x7fced00b0d10 2024-09-16T07:37:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced006ecd0 con 0x7fced00b0d10 2024-09-16T07:37:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced006f290 con 0x7fced00b0d10 2024-09-16T07:37:43.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced00d1bb0 con 0x7fced00b0d10 2024-09-16T07:37:43.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.472+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fcec0010a00 con 0x7fced00b0d10 2024-09-16T07:37:43.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.476+0000 7fcec7400640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fceac073a90 0x7fceac075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.476+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fcec0093210 con 0x7fced00b0d10 2024-09-16T07:37:43.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.476+0000 7fcec6000640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fceac073a90 0x7fceac075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.476+0000 7fcec6000640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fceac073a90 0x7fceac075f50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fceb80af000 tx=0x7fceb801b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:43.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.480+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fcec005feb0 con 0x7fced00b0d10 2024-09-16T07:37:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.648+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fced00cc220 con 0x7fced00b0d10 2024-09-16T07:37:43.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.652+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7fcec005f7b0 con 0x7fced00b0d10 2024-09-16T07:37:43.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.652+0000 7fcec7400640 1 -- 172.21.15.114:0/3986503697 <== mon.0 v2:172.21.15.114:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fcec009b080 con 0x7fced00b0d10 2024-09-16T07:37:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fceac073a90 msgr2=0x7fceac075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fceac073a90 0x7fceac075f50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fceb80af000 tx=0x7fceb801b040 comp rx=0 tx=0).stop 2024-09-16T07:37:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 msgr2=0x7fced0154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced0154a20 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fcec000e7d0 tx=0x7fcec000ec90 comp rx=0 tx=0).stop 2024-09-16T07:37:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 shutdown_connections 2024-09-16T07:37:43.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fced015bd40 0x7fced015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fceac073a90 0x7fceac075f50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fced00d20f0 0x7fced01fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 --2- 172.21.15.114:0/3986503697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fced00b0d10 0x7fced0154a20 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 >> 172.21.15.114:0/3986503697 conn(0x7fced009aa10 msgr2=0x7fced00b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 shutdown_connections 2024-09-16T07:37:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.656+0000 7fcecfe00640 1 -- 172.21.15.114:0/3986503697 wait complete. 2024-09-16T07:37:43.669 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T07:37:43.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 -- 172.21.15.114:0/2361415622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8406cc20 msgr2=0x7fea840737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 --2- 172.21.15.114:0/2361415622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8406cc20 0x7fea840737c0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fea74009900 tx=0x7fea7401c8b0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 -- 172.21.15.114:0/2361415622 shutdown_connections 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 --2- 172.21.15.114:0/2361415622 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea8415c1c0 0x7fea8406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 --2- 172.21.15.114:0/2361415622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8406cc20 0x7fea840737c0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 -- 172.21.15.114:0/2361415622 >> 172.21.15.114:0/2361415622 conn(0x7fea840d0c90 msgr2=0x7fea840d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 -- 172.21.15.114:0/2361415622 shutdown_connections 2024-09-16T07:37:43.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 -- 172.21.15.114:0/2361415622 wait complete. 2024-09-16T07:37:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 Processor -- start 2024-09-16T07:37:43.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.815+0000 7fea8a800640 1 -- start start 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea8406cc20 0x7fea841fc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea8415c1c0 0x7fea840d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8415f7b0 0x7fea841f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fea841694e0 con 0x7fea8415f7b0 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fea84169360 con 0x7fea8415c1c0 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 -- 0x7fea84169660 con 0x7fea8406cc20 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8415f7b0 0x7fea841f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8415f7b0 0x7fea841f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45630/0 (socket says 172.21.15.114:45630) 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83400640 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea8406cc20 0x7fea841fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 -- 172.21.15.114:0/2833003999 learned_addr learned my addr 172.21.15.114:0/2833003999 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T07:37:43.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea82a00640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea8415c1c0 0x7fea840d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 -- 172.21.15.114:0/2833003999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea8406cc20 msgr2=0x7fea841fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea8406cc20 0x7fea841fc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 -- 172.21.15.114:0/2833003999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea8415c1c0 msgr2=0x7fea840d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea8415c1c0 0x7fea840d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 -- 172.21.15.114:0/2833003999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea841fc860 con 0x7fea8415f7b0 2024-09-16T07:37:43.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea83e00640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8415f7b0 0x7fea841f7890 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00b9c0 tx=0x7fea7c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea7b400640 1 -- 172.21.15.114:0/2833003999 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c019070 con 0x7fea8415f7b0 2024-09-16T07:37:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea7b400640 1 -- 172.21.15.114:0/2833003999 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fea7c00cba0 con 0x7fea8415f7b0 2024-09-16T07:37:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea840ce970 con 0x7fea8415f7b0 2024-09-16T07:37:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea7b400640 1 -- 172.21.15.114:0/2833003999 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c014440 con 0x7fea8415f7b0 2024-09-16T07:37:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea840cbe40 con 0x7fea8415f7b0 2024-09-16T07:37:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.819+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea840737c0 con 0x7fea8415f7b0 2024-09-16T07:37:43.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.823+0000 7fea7b400640 1 -- 172.21.15.114:0/2833003999 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 98151+0+0 (secure 0 0 0) 0x7fea7c01c070 con 0x7fea8415f7b0 2024-09-16T07:37:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.823+0000 7fea7b400640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea64073a90 0x7fea64075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T07:37:43.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.823+0000 7fea7b400640 1 -- 172.21.15.114:0/2833003999 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4971+0+0 (secure 0 0 0) 0x7fea7c0926d0 con 0x7fea8415f7b0 2024-09-16T07:37:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.823+0000 7fea83400640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea64073a90 0x7fea64075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T07:37:43.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.823+0000 7fea83400640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea64073a90 0x7fea64075f50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fea740af000 tx=0x7fea74019650 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T07:37:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:43.827+0000 7fea7b400640 1 -- 172.21.15.114:0/2833003999 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188574 (secure 0 0 0) 0x7fea7c05eac0 con 0x7fea8415f7b0 2024-09-16T07:37:44.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.027+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea8415f080 con 0x7fea8415f7b0 2024-09-16T07:37:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.027+0000 7fea7b400640 1 -- 172.21.15.114:0/2833003999 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) ==== 95+0+3922 (secure 0 0 0) 0x7fea7c0634f0 con 0x7fea8415f7b0 2024-09-16T07:37:44.024 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T07:37:44.024 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":126,"btime":"2024-09-16T07:37:09:974357+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6801/3201169795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":3201169795},{"type":"v1","addr":"172.21.15.149:6801","nonce":3201169795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":8506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/64911771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":64911771},{"type":"v1","addr":"172.21.15.149:6835","nonce":64911771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9168,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6834/3812839687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":3812839687},{"type":"v1","addr":"172.21.15.114:6834","nonce":3812839687}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117},{"gid":9480,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/2936832479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6833","nonce":2936832479},{"type":"v1","addr":"172.21.15.114:6835","nonce":2936832479}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":126}],"filesystems":[]} 2024-09-16T07:37:44.024 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 126 2024-09-16T07:37:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea64073a90 msgr2=0x7fea64075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea64073a90 0x7fea64075f50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fea740af000 tx=0x7fea74019650 comp rx=0 tx=0).stop 2024-09-16T07:37:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8415f7b0 msgr2=0x7fea841f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T07:37:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8415f7b0 0x7fea841f7890 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00b9c0 tx=0x7fea7c00be80 comp rx=0 tx=0).stop 2024-09-16T07:37:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 shutdown_connections 2024-09-16T07:37:44.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea8415f7b0 0x7fea841f7890 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fea8415c1c0 0x7fea840d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.114:6836/1096280363,v1:172.21.15.114:6837/1096280363] conn(0x7fea64073a90 0x7fea64075f50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 --2- 172.21.15.114:0/2833003999 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fea8406cc20 0x7fea841fc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T07:37:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 >> 172.21.15.114:0/2833003999 conn(0x7fea840d0c90 msgr2=0x7fea840c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T07:37:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 shutdown_connections 2024-09-16T07:37:44.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T07:37:44.031+0000 7fea8a800640 1 -- 172.21.15.114:0/2833003999 wait complete. 2024-09-16T07:37:44.046 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-16T07:37:44.046 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T07:37:44.046 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T07:37:44.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.058 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T07:37:44.058 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T07:37:44.058 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.111 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T07:37:44.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T07:37:44.111 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.125 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T07:37:44.125 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T07:37:44.125 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.177 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T07:37:44.178 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T07:37:44.178 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:37:44.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.257 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:37:44.257 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T07:37:44.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.327 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T07:37:44.328 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:37:44.328 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.428 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:37:44.428 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T07:37:44.428 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.494 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T07:37:44.494 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T07:37:44.494 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:44.574 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T07:37:44.575 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T07:37:44.575 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:47.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-16T07:37:49.033 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:49.036 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:50.677 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T07:37:50.677 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-16T07:37:50.677 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:50.757 INFO:tasks.ceph.osd.6:Stopped 2024-09-16T07:37:50.757 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-16T07:37:50.757 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:50.852 INFO:tasks.ceph.osd.7:Stopped 2024-09-16T07:37:50.853 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T07:37:50.854 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-16T07:37:50.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:50.924 INFO:tasks.ceph.mgr.y:Stopped 2024-09-16T07:37:50.924 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T07:37:50.924 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:50.982 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T07:37:50.982 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T07:37:50.982 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T07:37:50.983 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:51.001 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T07:37:51.002 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T07:37:51.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:51.017 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T07:37:51.018 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T07:37:51.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:37:51.078 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T07:37:51.078 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T07:37:51.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-16T07:37:51.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:37:51.119 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T07:37:51.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:37:51.366 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T07:37:51.546 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:37:51.546 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T07:37:51.750 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:37:51.750 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T07:37:51.921 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:37:51.922 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T07:37:52.180 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:37:52.181 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T07:37:52.387 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:37:52.387 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-16T07:37:52.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-16T07:37:52.572 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:37:52.572 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-16T07:37:52.780 INFO:tasks.ceph:Archiving mon data... 2024-09-16T07:37:52.781 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/data/mon.a.tgz 2024-09-16T07:37:52.781 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-09-16T07:37:52.790 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.6ktGbN1DdP 2024-09-16T07:37:52.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.6ktGbN1DdP 2024-09-16T07:37:53.037 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.6ktGbN1DdP 2024-09-16T07:37:53.115 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.6ktGbN1DdP is 1MB 2024-09-16T07:37:53.186 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.6ktGbN1DdP 2024-09-16T07:37:53.195 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/data/mon.b.tgz 2024-09-16T07:37:53.195 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-16T07:37:53.204 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.PE6NlwGbOG 2024-09-16T07:37:53.204 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.PE6NlwGbOG 2024-09-16T07:37:53.461 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.PE6NlwGbOG 2024-09-16T07:37:53.537 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.PE6NlwGbOG is 1MB 2024-09-16T07:37:53.616 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.PE6NlwGbOG 2024-09-16T07:37:53.626 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/data/mon.c.tgz 2024-09-16T07:37:53.626 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-09-16T07:37:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.cBD0rSDS87 2024-09-16T07:37:53.677 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.cBD0rSDS87 2024-09-16T07:37:53.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.cBD0rSDS87 2024-09-16T07:37:54.005 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.cBD0rSDS87 is 1MB 2024-09-16T07:37:54.077 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.cBD0rSDS87 2024-09-16T07:37:54.085 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T07:37:54.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T07:37:54.088 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T07:37:54.160 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T07:37:54.193 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T07:37:54.193 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T07:37:54.195 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/remote/smithi114/crash 2024-09-16T07:37:54.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T07:37:54.224 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/remote/smithi149/crash 2024-09-16T07:37:54.224 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T07:37:54.259 INFO:tasks.ceph:Shutting down logrotate 2024-09-16T07:37:54.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:54.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:54.353 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:54.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T07:37:54.415 INFO:tasks.ceph:Compressing logs... 2024-09-16T07:37:54.416 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T07:37:54.419 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T07:37:54.444 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49656.log 2024-09-16T07:37:54.445 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39489.log 2024-09-16T07:37:54.446 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.49656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35457.log 2024-09-16T07:37:54.446 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49656.log.gz 2024-09-16T07:37:54.447 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2024-09-16T07:37:54.447 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39489.log.gz 2024-09-16T07:37:54.448 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51504.log 2024-09-16T07:37:54.448 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35457.log.gz 2024-09-16T07:37:54.449 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50292.log 2024-09-16T07:37:54.449 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz 2024-09-16T07:37:54.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.51504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2024-09-16T07:37:54.450 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51504.log.gz 2024-09-16T07:37:54.450 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50292.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.50292.log.gz 2024-09-16T07:37:54.451 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52209.log 2024-09-16T07:37:54.451 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29101.log 2024-09-16T07:37:54.452 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2024-09-16T07:37:54.452 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35441.log 2024-09-16T07:37:54.452 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52209.log.gz 2024-09-16T07:37:54.453 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35923.log 2024-09-16T07:37:54.453 INFO:teuthology.orchestra.run.smithi114.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29101.log.gz 2024-09-16T07:37:54.454 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38866.log 2024-09-16T07:37:54.454 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35441.log.gz 2024-09-16T07:37:54.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54259.log 2024-09-16T07:37:54.455 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35923.log.gz 2024-09-16T07:37:54.456 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55163.log 2024-09-16T07:37:54.456 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38866.log.gz 2024-09-16T07:37:54.457 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37406.log 2024-09-16T07:37:54.457 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54259.log.gz 2024-09-16T07:37:54.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55163.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55163.log.gz 2024-09-16T07:37:54.458 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49040.log 2024-09-16T07:37:54.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42829.log 2024-09-16T07:37:54.459 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37406.log.gz 2024-09-16T07:37:54.459 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39405.log 2024-09-16T07:37:54.459 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49040.log.gz 2024-09-16T07:37:54.460 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2024-09-16T07:37:54.460 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42829.log.gz 2024-09-16T07:37:54.461 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41878.log 2024-09-16T07:37:54.462 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39405.log.gz 2024-09-16T07:37:54.463 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38631.log 2024-09-16T07:37:54.464 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2024-09-16T07:37:54.464 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-09-16T07:37:54.464 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41878.log.gz 2024-09-16T07:37:54.464 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51108.log 2024-09-16T07:37:54.464 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38631.log.gz 2024-09-16T07:37:54.466 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38358.log 2024-09-16T07:37:54.466 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-09-16T07:37:54.466 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37436.log 2024-09-16T07:37:54.467 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51108.log.gz 2024-09-16T07:37:54.467 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2024-09-16T07:37:54.467 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38358.log.gz 2024-09-16T07:37:54.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52826.log 2024-09-16T07:37:54.468 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37436.log.gz 2024-09-16T07:37:54.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35641.log 2024-09-16T07:37:54.468 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz 2024-09-16T07:37:54.469 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52826.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-16T07:37:54.469 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52826.log.gz 2024-09-16T07:37:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43400.log 2024-09-16T07:37:54.470 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35641.log.gz 2024-09-16T07:37:54.470 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47198.log 2024-09-16T07:37:54.471 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29026.log 2024-09-16T07:37:54.471 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43400.log.gz 2024-09-16T07:37:54.472 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53796.log 87.7% 2024-09-16T07:37:54.472 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47198.log.gz 2024-09-16T07:37:54.473 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39184.log 2024-09-16T07:37:54.473 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29026.log.gz 2024-09-16T07:37:54.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51381.log 2024-09-16T07:37:54.474 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53796.log.gz 2024-09-16T07:37:54.475 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41344.log 2024-09-16T07:37:54.475 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39184.log.gz 2024-09-16T07:37:54.476 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51329.log 2024-09-16T07:37:54.476 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51381.log.gz 2024-09-16T07:37:54.477 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39132.log 2024-09-16T07:37:54.477 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41344.log.gz 2024-09-16T07:37:54.477 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38410.log 2024-09-16T07:37:54.478 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2024-09-16T07:37:54.478 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40800.log 2024-09-16T07:37:54.479 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39132.log.gz 2024-09-16T07:37:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38410.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38410.log.gz 2024-09-16T07:37:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55290.log 2024-09-16T07:37:54.480 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54311.log 2024-09-16T07:37:54.480 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40800.log.gz 2024-09-16T07:37:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36573.log 2024-09-16T07:37:54.481 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55290.log.gz 2024-09-16T07:37:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45695.log 2024-09-16T07:37:54.482 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54311.log.gz 2024-09-16T07:37:54.483 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36573.log: gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.52605.log -- replaced with /var/log/ceph/ceph-client.admin.36573.log.gz 2024-09-16T07:37:54.483 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:54.483 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.45695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38599.log 2024-09-16T07:37:54.484 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45695.log.gz 2024-09-16T07:37:54.484 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53361.log 2024-09-16T07:37:54.484 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52605.log.gz 2024-09-16T07:37:54.485 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52640.log 2024-09-16T07:37:54.485 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38599.log.gz 2024-09-16T07:37:54.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35039.log 2024-09-16T07:37:54.486 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53361.log.gz 2024-09-16T07:37:54.487 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55394.log 2024-09-16T07:37:54.487 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52640.log.gz 2024-09-16T07:37:54.488 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34859.log 2024-09-16T07:37:54.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35247.log 2024-09-16T07:37:54.489 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35039.log.gz 2024-09-16T07:37:54.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43589.log 2024-09-16T07:37:54.489 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55394.log.gz 2024-09-16T07:37:54.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54071.log 2024-09-16T07:37:54.492 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35247.log.gz 2024-09-16T07:37:54.492 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43589.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43589.log.gz /var/log/ceph/ceph-client.admin.51634.log 2024-09-16T07:37:54.493 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:54.493 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54909.log 2024-09-16T07:37:54.493 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54071.log.gz 2024-09-16T07:37:54.496 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36150.log 2024-09-16T07:37:54.496 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.34859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34859.log.gz 2024-09-16T07:37:54.496 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35289.log 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.36150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36040.log 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36150.log.gz 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35013.log 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35289.log.gz 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.36040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36040.log.gz 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35818.log 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35013.log.gz 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36155.log 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35818.log.gz 2024-09-16T07:37:54.497 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34617.log 2024-09-16T07:37:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.36155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36155.log.gz 2024-09-16T07:37:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29023.log 2024-09-16T07:37:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.34617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34617.log.gz 2024-09-16T07:37:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-16T07:37:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.29023.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-16T07:37:54.498 INFO:teuthology.orchestra.run.smithi149.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29023.log.gz 2024-09-16T07:37:54.498 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35929.log 2024-09-16T07:37:54.506 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35138.log 2024-09-16T07:37:54.506 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35929.log.gz 2024-09-16T07:37:54.506 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36045.log 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35590.log 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35138.log.gz 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.36045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36045.log.gz 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35590.log.gz 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34724.log 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34864.log 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.3.34724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34724.log.gz 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29078.log 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35143.log 2024-09-16T07:37:54.507 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.34864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34864.log.gz 2024-09-16T07:37:54.508 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.29078.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29078.log.gz 2024-09-16T07:37:54.508 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35813.log 2024-09-16T07:37:54.508 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35924.log 2024-09-16T07:37:54.508 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35143.log.gz 2024-09-16T07:37:54.508 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35813.log.gz 2024-09-16T07:37:54.508 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28975.log 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29102.log 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35924.log.gz 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28975.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28975.log.gz 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35457.log 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29047.log 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.29102.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29102.log.gz 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35457.log.gz 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29047.log: /var/log/ceph/ceph-client.1.35698.log 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29047.log.gz 2024-09-16T07:37:54.518 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T07:37:54.519 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35698.log.gz 2024-09-16T07:37:54.519 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34719.log 2024-09-16T07:37:54.519 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-16T07:37:54.519 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.3.34719.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.3.34719.log.gz -5 2024-09-16T07:37:54.519 INFO:teuthology.orchestra.run.smithi149.stderr: --verbose -- /var/log/ceph/ceph-client.1.35703.log 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52398.log 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51634.log.gz 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36697.log 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54909.log.gz 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28914.log 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52398.log.gz 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36697.log.gz 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36723.log 0.0% 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28914.log.gz 2024-09-16T07:37:54.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38436.log 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36723.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.36723.log.gz -- 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.44575.log 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42716.log 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38436.log.gz 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50817.log 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42716.log.gz 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38287.log 87.6% 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50817.log.gz 2024-09-16T07:37:54.522 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51839.log 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54610.log 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38287.log.gz 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38922.log 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51839.log.gz 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54610.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54610.log.gz 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40546.log 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34987.log 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38922.log.gz 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40546.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40546.log.gz 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54363.log 2024-09-16T07:37:54.523 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34987.log.gz 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35244.log 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54363.log.gz 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36879.log 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35244.log.gz 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47767.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50562.log 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36879.log.gz 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54207.log 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50562.log.gz 2024-09-16T07:37:54.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43348.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36547.log 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54207.log.gz 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36547.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36547.log.gz 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40233.log 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35975.log 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40233.log: gzip -5 87.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.40233.log.gz -- 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.50510.log 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47094.log 2024-09-16T07:37:54.525 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35975.log.gz 2024-09-16T07:37:54.526 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50510.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50510.log.gz 2024-09-16T07:37:54.526 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44495.log 2024-09-16T07:37:54.526 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45292.log 2024-09-16T07:37:54.526 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47094.log.gz 2024-09-16T07:37:54.529 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.35703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35585.log 2024-09-16T07:37:54.529 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35703.log.gz 2024-09-16T07:37:54.529 INFO:teuthology.orchestra.run.smithi149.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35284.log 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35585.log.gz 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35008.log 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35284.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.1.35284.log.gz --verbose 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr: -- /var/log/ceph/ceph.audit.log 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35008.log.gz 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29126.log 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.29126.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29126.log.gz 2024-09-16T07:37:54.530 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-16T07:37:54.535 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-16T07:37:54.535 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T07:37:54.535 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35452.log 2024-09-16T07:37:54.535 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.35452.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-16T07:37:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44495.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.44495.log.gz 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50374.log 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48140.log 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45292.log.gz 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50374.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.50374.log.gz 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.49904.log 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48140.log.gz 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49904.log: gzip -5 --verbose 84.8% -- -- replaced with /var/log/ceph/ceph-client.admin.49904.log.gz /var/log/ceph/ceph-client.admin.40748.log 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44029.log 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40748.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40748.log.gz 2024-09-16T07:37:54.537 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52008.log 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44029.log.gz 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46642.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40878.log 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49528.log 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52008.log.gz 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40878.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40878.log.gz 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.54543.log 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44867.log 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49528.log.gz 2024-09-16T07:37:54.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.54543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54543.log.gz 2024-09-16T07:37:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36521.log 2024-09-16T07:37:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52157.log 2024-09-16T07:37:54.539 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44867.log.gz 2024-09-16T07:37:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36521.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36521.log.gz 2024-09-16T07:37:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54008.log 2024-09-16T07:37:54.539 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52157.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.52157.log.gz --verbose 2024-09-16T07:37:54.539 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.44471.log 2024-09-16T07:37:54.541 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-mon.b.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35452.log.gz 2024-09-16T07:37:54.541 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-16T07:37:54.541 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34635.log 2024-09-16T07:37:54.543 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 87.2% 2024-09-16T07:37:54.543 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54008.log.gz 2024-09-16T07:37:54.543 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48416.log 2024-09-16T07:37:54.543 INFO:teuthology.orchestra.run.smithi114.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.44471.log.gz 2024-09-16T07:37:54.543 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49929.log 87.9% 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49294.log 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49929.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48416.log.gz 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 85.3% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49929.log.gz /var/log/ceph/ceph-client.admin.47501.log 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35243.log 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49294.log.gz 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40416.log 2024-09-16T07:37:54.544 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2024-09-16T07:37:54.546 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28999.log 2024-09-16T07:37:54.546 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.1.34635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28951.log 2024-09-16T07:37:54.546 INFO:teuthology.orchestra.run.smithi149.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34635.log.gz 2024-09-16T07:37:54.546 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28999.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28999.log.gz 2024-09-16T07:37:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35243.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35243.log.gz 2024-09-16T07:37:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39789.log 2024-09-16T07:37:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55238.log 2024-09-16T07:37:54.547 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40416.log.gz 2024-09-16T07:37:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39789.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39789.log.gz 2024-09-16T07:37:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55578.log 2024-09-16T07:37:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42282.log 2024-09-16T07:37:54.548 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55238.log.gz 2024-09-16T07:37:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55760.log 2024-09-16T07:37:54.549 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55578.log.gz 2024-09-16T07:37:54.549 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46074.log 2024-09-16T07:37:54.549 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42282.log.gz 2024-09-16T07:37:54.550 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55760.log: gzip -5 87.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.55760.log.gz -- 2024-09-16T07:37:54.550 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.41800.log 2024-09-16T07:37:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29512.log 2024-09-16T07:37:54.551 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46074.log.gz 2024-09-16T07:37:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41800.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41800.log.gz 2024-09-16T07:37:54.552 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45920.log 2024-09-16T07:37:54.553 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45463.log 2024-09-16T07:37:54.553 INFO:teuthology.orchestra.run.smithi114.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29512.log.gz 2024-09-16T07:37:54.554 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39728.log 2024-09-16T07:37:54.554 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/ceph-client.admin.28951.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28951.log.gz 2024-09-16T07:37:54.555 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45920.log.gz 2024-09-16T07:37:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45463.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45463.log.gz -5 2024-09-16T07:37:54.555 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35949.log 2024-09-16T07:37:54.555 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40627.log 2024-09-16T07:37:54.556 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39728.log.gz 2024-09-16T07:37:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35949.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35949.log.gz 2024-09-16T07:37:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52521.log 2024-09-16T07:37:54.557 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2024-09-16T07:37:54.562 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40627.log.gz 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52521.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52521.log.gz 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48102.log 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50029.log 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gz 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35664.log 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48102.log.gz 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.50029.log.gz 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35664.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35664.log.gz 2024-09-16T07:37:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28924.log 2024-09-16T07:37:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50217.log 2024-09-16T07:37:54.564 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2024-09-16T07:37:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28924.log: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.28924.log.gz 2024-09-16T07:37:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37956.log 2024-09-16T07:37:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2024-09-16T07:37:54.565 INFO:teuthology.orchestra.run.smithi114.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50217.log.gz 2024-09-16T07:37:54.566 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2024-09-16T07:37:54.566 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37956.log.gz 2024-09-16T07:37:54.567 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53185.log 2024-09-16T07:37:54.568 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2024-09-16T07:37:54.568 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43621.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2024-09-16T07:37:54.568 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50242.log 2024-09-16T07:37:54.569 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29092.log 2024-09-16T07:37:54.570 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53185.log.gz 2024-09-16T07:37:54.570 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50242.log: gzip 85.2% -- replaced with /var/log/ceph/ceph-client.admin.50242.log.gz 2024-09-16T07:37:54.570 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.36206.log 2024-09-16T07:37:54.571 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45763.log 2024-09-16T07:37:54.571 INFO:teuthology.orchestra.run.smithi114.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29092.log.gz 2024-09-16T07:37:54.572 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.36206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36206.log.gz 2024-09-16T07:37:54.572 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2024-09-16T07:37:54.573 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52722.log 2024-09-16T07:37:54.573 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45763.log.gz 2024-09-16T07:37:54.574 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38235.log 2024-09-16T07:37:54.574 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2024-09-16T07:37:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52722.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52722.log.gz 2024-09-16T07:37:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42690.log 2024-09-16T07:37:54.576 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2024-09-16T07:37:54.576 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38235.log.gz 2024-09-16T07:37:54.577 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42690.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42690.log.gz 2024-09-16T07:37:54.577 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2024-09-16T07:37:54.578 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49674.log 2024-09-16T07:37:54.578 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2024-09-16T07:37:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45083.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz /var/log/ceph/ceph-client.admin.53862.log 2024-09-16T07:37:54.579 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42365.log 2024-09-16T07:37:54.580 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49674.log.gz 2024-09-16T07:37:54.581 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37291.log 2024-09-16T07:37:54.581 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53862.log.gz 2024-09-16T07:37:54.582 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39078.log 2024-09-16T07:37:54.582 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42365.log.gz 2024-09-16T07:37:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37291.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.49954.log 2024-09-16T07:37:54.583 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37291.log.gz 2024-09-16T07:37:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51760.log 2024-09-16T07:37:54.584 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39078.log.gz 2024-09-16T07:37:54.585 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45024.log 2024-09-16T07:37:54.585 INFO:teuthology.orchestra.run.smithi114.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.49954.log.gz 2024-09-16T07:37:54.586 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2024-09-16T07:37:54.586 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51760.log.gz 2024-09-16T07:37:54.587 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38722.log 2024-09-16T07:37:54.587 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45024.log.gz 2024-09-16T07:37:54.588 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38011.log 2024-09-16T07:37:54.588 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gz 2024-09-16T07:37:54.589 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-09-16T07:37:54.589 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38722.log.gz 2024-09-16T07:37:54.590 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37488.log 2024-09-16T07:37:54.590 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38011.log.gz 2024-09-16T07:37:54.591 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43925.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2024-09-16T07:37:54.591 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45179.log 2024-09-16T07:37:54.592 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39158.log 2024-09-16T07:37:54.592 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37488.log.gz 2024-09-16T07:37:54.593 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45179.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45179.log.gz 2024-09-16T07:37:54.593 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36931.log 2024-09-16T07:37:54.594 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2024-09-16T07:37:54.594 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39158.log.gz 2024-09-16T07:37:54.595 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36931.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36931.log.gz 2024-09-16T07:37:54.595 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52261.log 2024-09-16T07:37:54.596 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2024-09-16T07:37:54.596 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2024-09-16T07:37:54.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52261.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.52261.log.gz 2024-09-16T07:37:54.597 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.40718.log 2024-09-16T07:37:54.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46453.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T07:37:54.598 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 2024-09-16T07:37:54.598 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49320.log 87.8% 2024-09-16T07:37:54.599 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40718.log.gz 2024-09-16T07:37:54.599 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46125.log 2024-09-16T07:37:54.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29032.log 2024-09-16T07:37:54.601 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49320.log.gz 2024-09-16T07:37:54.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54558.log 2024-09-16T07:37:54.602 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46125.log.gz 2024-09-16T07:37:54.603 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54415.log 2024-09-16T07:37:54.603 INFO:teuthology.orchestra.run.smithi114.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29032.log.gz 2024-09-16T07:37:54.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51225.log 2024-09-16T07:37:54.604 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54558.log.gz 2024-09-16T07:37:54.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42649.log 2024-09-16T07:37:54.605 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54415.log.gz 2024-09-16T07:37:54.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51225.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51225.log.gz 2024-09-16T07:37:54.606 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44133.log 2024-09-16T07:37:54.607 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.0.42649.log: --verbose -- /var/log/ceph/ceph-client.admin.43110.log 2024-09-16T07:37:54.607 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42649.log.gz 2024-09-16T07:37:54.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45489.log 2024-09-16T07:37:54.608 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44133.log.gz 2024-09-16T07:37:54.609 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43110.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43110.log.gz 2024-09-16T07:37:54.609 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49726.log 2024-09-16T07:37:54.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2024-09-16T07:37:54.610 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45489.log.gz 2024-09-16T07:37:54.611 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2024-09-16T07:37:54.611 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49726.log.gz 2024-09-16T07:37:54.612 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35430.log 2024-09-16T07:37:54.612 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2024-09-16T07:37:54.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55448.log 2024-09-16T07:37:54.613 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2024-09-16T07:37:54.614 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39519.log 2024-09-16T07:37:54.615 INFO:teuthology.orchestra.run.smithi114.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35430.log.gz 2024-09-16T07:37:54.615 INFO:teuthology.orchestra.run.smithi149.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-16T07:37:54.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49151.log 2024-09-16T07:37:54.616 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55448.log.gz 2024-09-16T07:37:54.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46415.log 2024-09-16T07:37:54.617 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39519.log.gz 2024-09-16T07:37:54.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53413.log 2024-09-16T07:37:54.618 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49151.log.gz 2024-09-16T07:37:54.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36905.log 2024-09-16T07:37:54.619 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46415.log.gz 2024-09-16T07:37:54.620 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53413.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53413.log.gz 2024-09-16T07:37:54.620 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39463.log 2024-09-16T07:37:54.621 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2024-09-16T07:37:54.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36905.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36905.log.gz 2024-09-16T07:37:54.622 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39463.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39463.log.gz 2024-09-16T07:37:54.622 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36989.log 2024-09-16T07:37:54.623 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.50054.log: --verbose -- /var/log/ceph/ceph-client.admin.42547.log 2024-09-16T07:37:54.623 INFO:teuthology.orchestra.run.smithi114.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2024-09-16T07:37:54.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36989.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36989.log.gz 2024-09-16T07:37:54.624 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51550.log 2024-09-16T07:37:54.625 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42547.log: -- /var/log/ceph/ceph-client.admin.52235.log 2024-09-16T07:37:54.626 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51550.log: 87.5% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51550.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42547.log.gz 2024-09-16T07:37:54.626 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:54.626 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37920.log 2024-09-16T07:37:54.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46893.log 2024-09-16T07:37:54.627 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52235.log.gz 2024-09-16T07:37:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37920.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37920.log.gz 2024-09-16T07:37:54.628 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44659.log 2024-09-16T07:37:54.629 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46893.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T07:37:54.629 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46893.log.gz 2024-09-16T07:37:54.630 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44659.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44659.log.gz 2024-09-16T07:37:54.630 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46945.log 2024-09-16T07:37:54.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38209.log 2024-09-16T07:37:54.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46508.log 2024-09-16T07:37:54.632 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46945.log.gz 2024-09-16T07:37:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38209.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38209.log.gz 2024-09-16T07:37:54.633 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48552.log 2024-09-16T07:37:54.634 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.46508.log: --verbose -- /var/log/ceph/ceph-client.admin.35453.log 2024-09-16T07:37:54.635 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz 2024-09-16T07:37:54.635 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48218.log 2024-09-16T07:37:54.635 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48552.log.gz 2024-09-16T07:37:54.636 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35453.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35453.log.gz 2024-09-16T07:37:54.636 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34961.log 2024-09-16T07:37:54.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2024-09-16T07:37:54.638 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48218.log.gz 2024-09-16T07:37:54.638 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37263.log 2024-09-16T07:37:54.638 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34961.log.gz 2024-09-16T07:37:54.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51277.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2024-09-16T07:37:54.639 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46763.log 2024-09-16T07:37:54.640 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41982.log 2024-09-16T07:37:54.641 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37263.log.gz 2024-09-16T07:37:54.641 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54491.log 2024-09-16T07:37:54.641 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46763.log.gz 2024-09-16T07:37:54.642 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41982.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.41982.log.gz 2024-09-16T07:37:54.642 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55630.log 2024-09-16T07:37:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45690.log 2024-09-16T07:37:54.644 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54491.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54491.log.gz 2024-09-16T07:37:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41162.log 2024-09-16T07:37:54.645 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55630.log.gz 2024-09-16T07:37:54.646 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.45690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45690.log.gz 2024-09-16T07:37:54.646 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38157.log 2024-09-16T07:37:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.41162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39575.log 2024-09-16T07:37:54.647 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41162.log.gz 2024-09-16T07:37:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55604.log 2024-09-16T07:37:54.649 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38157.log.gz 2024-09-16T07:37:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42772.log 2024-09-16T07:37:54.650 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39575.log.gz 2024-09-16T07:37:54.650 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44763.log 2024-09-16T07:37:54.652 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55604.log.gz 2024-09-16T07:37:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54441.log 2024-09-16T07:37:54.652 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42772.log.gz 2024-09-16T07:37:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44763.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44763.log.gz 2024-09-16T07:37:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50843.log 2024-09-16T07:37:54.653 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37211.log 2024-09-16T07:37:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50843.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54441.log.gz 2024-09-16T07:37:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39307.log 2024-09-16T07:37:54.656 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50843.log.gz 2024-09-16T07:37:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43738.log 2024-09-16T07:37:54.657 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37211.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37211.log.gz 2024-09-16T07:37:54.657 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.39307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39307.log.gz 2024-09-16T07:37:54.657 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50791.log 2024-09-16T07:37:54.658 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48806.log 2024-09-16T07:37:54.658 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43738.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43738.log.gz 2024-09-16T07:37:54.659 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44284.log 2024-09-16T07:37:54.659 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50791.log.gz 2024-09-16T07:37:54.659 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34671.log 2024-09-16T07:37:54.660 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48806.log.gz 2024-09-16T07:37:54.661 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.44284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44284.log.gz 2024-09-16T07:37:54.661 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34697.log 2024-09-16T07:37:54.662 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47331.log 2024-09-16T07:37:54.662 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34671.log: /var/log/ceph/ceph-client.admin.34697.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34671.log.gz 2024-09-16T07:37:54.663 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51672.log 2024-09-16T07:37:54.663 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34697.log.gz 2024-09-16T07:37:54.664 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41177.log 2024-09-16T07:37:54.664 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2024-09-16T07:37:54.665 INFO:teuthology.orchestra.run.smithi149.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T07:37:54.665 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42334.log 2024-09-16T07:37:54.666 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51672.log.gz 2024-09-16T07:37:54.666 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37462.log 2024-09-16T07:37:54.666 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41177.log.gz 2024-09-16T07:37:54.667 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2024-09-16T07:37:54.668 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42334.log.gz 2024-09-16T07:37:54.669 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51903.log 2024-09-16T07:37:54.669 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37462.log.gz 2024-09-16T07:37:54.669 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52954.log 2024-09-16T07:37:54.670 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2024-09-16T07:37:54.671 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2024-09-16T07:37:54.671 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51903.log.gz 2024-09-16T07:37:54.672 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35249.log 2024-09-16T07:37:54.672 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52954.log.gz 2024-09-16T07:37:54.673 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47583.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz 2024-09-16T07:37:54.673 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2024-09-16T07:37:54.674 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48040.log 2024-09-16T07:37:54.675 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35249.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35249.log.gz 2024-09-16T07:37:54.675 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50685.log 2024-09-16T07:37:54.675 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-09-16T07:37:54.676 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41289.log 2024-09-16T07:37:54.677 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48040.log.gz 2024-09-16T07:37:54.677 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50685.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50685.log.gz 2024-09-16T07:37:54.677 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2024-09-16T07:37:54.678 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38040.log 2024-09-16T07:37:54.679 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41289.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41289.log.gz 2024-09-16T07:37:54.679 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44971.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2024-09-16T07:37:54.679 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.44737.log 2024-09-16T07:37:54.680 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28948.log 2024-09-16T07:37:54.681 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38040.log.gz 2024-09-16T07:37:54.681 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29050.log 2024-09-16T07:37:54.681 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-09-16T07:37:54.682 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.28948.log: -- /var/log/ceph/ceph-client.admin.52339.log 2024-09-16T07:37:54.682 INFO:teuthology.orchestra.run.smithi114.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.28948.log.gz 2024-09-16T07:37:54.683 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29050.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29050.log.gz 2024-09-16T07:37:54.683 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36607.log 2024-09-16T07:37:54.684 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43712.log 2024-09-16T07:37:54.685 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52339.log: /var/log/ceph/ceph-client.admin.36607.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52339.log.gz 2024-09-16T07:37:54.686 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36607.log.gz 2024-09-16T07:37:54.686 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40572.log 2024-09-16T07:37:54.686 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35195.log 2024-09-16T07:37:54.687 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43712.log.gz 2024-09-16T07:37:54.687 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40572.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40572.log.gz 2024-09-16T07:37:54.687 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2024-09-16T07:37:54.688 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.35195.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38462.log 2024-09-16T07:37:54.689 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35195.log.gz 2024-09-16T07:37:54.689 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43821.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2024-09-16T07:37:54.690 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51143.log 2024-09-16T07:37:54.690 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53008.log 2024-09-16T07:37:54.691 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2024-09-16T07:37:54.691 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51143.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51143.log.gz 2024-09-16T07:37:54.691 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51602.log 2024-09-16T07:37:54.692 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.53008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54337.log 2024-09-16T07:37:54.692 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53008.log.gz 2024-09-16T07:37:54.693 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51602.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51602.log.gz 2024-09-16T07:37:54.693 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39758.log 2024-09-16T07:37:54.694 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54337.log: -- /var/log/ceph/ceph-client.admin.51080.log 2024-09-16T07:37:54.695 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54337.log.gz 2024-09-16T07:37:54.695 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39758.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39758.log.gz 2024-09-16T07:37:54.695 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53927.log 2024-09-16T07:37:54.696 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37697.log 2024-09-16T07:37:54.697 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51080.log.gz 2024-09-16T07:37:54.697 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53927.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53927.log.gz 2024-09-16T07:37:54.697 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39104.log 2024-09-16T07:37:54.698 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.37697.log: --verbose -- /var/log/ceph/ceph-client.admin.39000.log 2024-09-16T07:37:54.699 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37697.log.gz 2024-09-16T07:37:54.699 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39104.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39104.log.gz 2024-09-16T07:37:54.700 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38696.log 2024-09-16T07:37:54.700 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.39000.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37982.log 2024-09-16T07:37:54.701 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39000.log.gz 2024-09-16T07:37:54.701 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38696.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38696.log.gz 2024-09-16T07:37:54.701 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2024-09-16T07:37:54.702 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39851.log 2024-09-16T07:37:54.703 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37982.log: /var/log/ceph/ceph-client.admin.38805.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37982.log.gz 2024-09-16T07:37:54.703 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 2024-09-16T07:37:54.703 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45789.log 2024-09-16T07:37:54.704 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2024-09-16T07:37:54.705 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39851.log.gz 2024-09-16T07:37:54.705 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40481.log 2024-09-16T07:37:54.705 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45789.log.gz 2024-09-16T07:37:54.706 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42664.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-09-16T07:37:54.706 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45437.log 2024-09-16T07:37:54.707 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.40481.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-09-16T07:37:54.708 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40481.log.gz 2024-09-16T07:37:54.709 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53491.log 2024-09-16T07:37:54.709 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45437.log.gz 2024-09-16T07:37:54.709 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2024-09-16T07:37:54.710 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-09-16T07:37:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54710.log 2024-09-16T07:37:54.711 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53491.log.gz 2024-09-16T07:37:54.712 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36248.log 2024-09-16T07:37:54.712 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz 2024-09-16T07:37:54.713 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41852.log 2024-09-16T07:37:54.713 INFO:teuthology.orchestra.run.smithi114.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.54710.log.gz 2024-09-16T07:37:54.713 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54389.log 2024-09-16T07:37:54.714 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36248.log.gz 2024-09-16T07:37:54.715 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41852.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41852.log.gz 2024-09-16T07:37:54.715 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47715.log 2024-09-16T07:37:54.715 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28873.log 2024-09-16T07:37:54.717 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54389.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54389.log.gz 2024-09-16T07:37:54.717 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47715.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47715.log.gz 2024-09-16T07:37:54.717 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44711.log 2024-09-16T07:37:54.717 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.28873.log: --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2024-09-16T07:37:54.718 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28873.log.gz 2024-09-16T07:37:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44711.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44711.log.gz 2024-09-16T07:37:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47146.log 2024-09-16T07:37:54.719 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48500.log 2024-09-16T07:37:54.720 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47475.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2024-09-16T07:37:54.721 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47819.log 2024-09-16T07:37:54.721 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47146.log.gz 2024-09-16T07:37:54.722 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40286.log 2024-09-16T07:37:54.722 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48500.log.gz 2024-09-16T07:37:54.722 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2024-09-16T07:37:54.723 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47819.log.gz 2024-09-16T07:37:54.724 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55787.log 2024-09-16T07:37:54.724 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40286.log.gz 2024-09-16T07:37:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40162.log 2024-09-16T07:37:54.725 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2024-09-16T07:37:54.725 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37354.log 2024-09-16T07:37:54.726 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55787.log.gz 2024-09-16T07:37:54.727 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2024-09-16T07:37:54.727 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40162.log.gz 2024-09-16T07:37:54.728 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37354.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.37354.log.gz 2024-09-16T07:37:54.728 INFO:teuthology.orchestra.run.smithi114.stderr: /var/log/ceph/ceph-client.admin.55500.log 2024-09-16T07:37:54.729 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5/var/log/ceph/ceph-client.admin.43136.log: --verbose -- /var/log/ceph/ceph-client.admin.53267.log 2024-09-16T07:37:54.729 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2024-09-16T07:37:54.730 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35650.log 2024-09-16T07:37:54.730 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55500.log.gz 2024-09-16T07:37:54.731 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53267.log: gzip -5 --verbose 87.0% -- -- replaced with /var/log/ceph/ceph-client.admin.53267.log.gz /var/log/ceph/ceph-client.admin.40692.log 2024-09-16T07:37:54.731 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:54.732 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47042.log 2024-09-16T07:37:54.732 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35650.log.gz 2024-09-16T07:37:54.734 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55656.log 2024-09-16T07:37:54.734 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40692.log.gz 2024-09-16T07:37:54.734 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47042.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47042.log.gz -5 2024-09-16T07:37:54.734 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52774.log 2024-09-16T07:37:54.735 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35169.log 2024-09-16T07:37:54.736 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55656.log.gz 2024-09-16T07:37:54.737 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52774.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T07:37:54.737 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52774.log.gz 2024-09-16T07:37:54.737 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35169.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35169.log.gz 2024-09-16T07:37:54.737 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54935.log 2024-09-16T07:37:54.738 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53979.log 2024-09-16T07:37:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42391.log 2024-09-16T07:37:54.740 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54935.log.gz 2024-09-16T07:37:54.741 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52365.log 2024-09-16T07:37:54.741 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53979.log.gz 2024-09-16T07:37:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42391.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42391.log.gz 2024-09-16T07:37:54.742 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53334.log 2024-09-16T07:37:54.744 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43899.log 2024-09-16T07:37:54.744 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52365.log.gz 2024-09-16T07:37:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40598.log 2024-09-16T07:37:54.745 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53334.log.gz 2024-09-16T07:37:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43899.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43899.log.gz 2024-09-16T07:37:54.747 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40598.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40598.log.gz 2024-09-16T07:37:54.747 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44685.log 2024-09-16T07:37:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46534.log 2024-09-16T07:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49829.log 2024-09-16T07:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44685.log.gz 2024-09-16T07:37:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46534.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46534.log.gz 2024-09-16T07:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49829.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.49829.log.gz 2024-09-16T07:37:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45327.log 2024-09-16T07:37:54.753 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2024-09-16T07:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40774.log 2024-09-16T07:37:54.755 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45327.log.gz 2024-09-16T07:37:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47527.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2024-09-16T07:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40774.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40774.log.gz 2024-09-16T07:37:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53588.log 2024-09-16T07:37:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48474.log 2024-09-16T07:37:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44841.log 2024-09-16T07:37:54.760 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53588.log.gz 2024-09-16T07:37:54.761 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48474.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48474.log.gz 2024-09-16T07:37:54.762 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44841.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44841.log.gz 2024-09-16T07:37:54.762 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40136.log 2024-09-16T07:37:54.763 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54233.log 2024-09-16T07:37:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40136.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40136.log.gz 2024-09-16T07:37:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36087.log 2024-09-16T07:37:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52086.log 2024-09-16T07:37:54.766 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54233.log.gz 2024-09-16T07:37:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36087.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49186.log 2024-09-16T07:37:54.768 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36087.log.gz 2024-09-16T07:37:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52086.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52086.log.gz 2024-09-16T07:37:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45205.log 2024-09-16T07:37:54.769 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49186.log.gz 2024-09-16T07:37:54.770 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45593.log 2024-09-16T07:37:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54987.log 2024-09-16T07:37:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45205.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45205.log.gz 2024-09-16T07:37:54.772 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36363.log 2024-09-16T07:37:54.773 INFO:teuthology.orchestra.run.smithi114.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45593.log.gz 2024-09-16T07:37:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54987.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54987.log.gz 2024-09-16T07:37:54.778 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36363.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36363.log.gz 2024-09-16T07:37:54.778 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53718.log 2024-09-16T07:37:54.778 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54672.log 2024-09-16T07:37:54.778 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35665.log 2024-09-16T07:37:54.778 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53718.log.gz 2024-09-16T07:37:54.778 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44289.log 2024-09-16T07:37:54.778 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54672.log.gz 2024-09-16T07:37:54.779 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40006.log 2024-09-16T07:37:54.779 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35665.log.gz 2024-09-16T07:37:54.780 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.44289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44289.log.gz 2024-09-16T07:37:54.781 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53640.log 2024-09-16T07:37:54.781 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40006.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40006.log.gz 2024-09-16T07:37:54.782 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47068.log 2024-09-16T07:37:54.783 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35640.log 2024-09-16T07:37:54.783 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53640.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53640.log.gz 2024-09-16T07:37:54.784 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47068.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47068.log.gz 2024-09-16T07:37:54.784 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44187.log 2024-09-16T07:37:54.785 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35640.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35640.log.gz 2024-09-16T07:37:54.786 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50869.log 2024-09-16T07:37:54.787 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42165.log 2024-09-16T07:37:54.788 INFO:teuthology.orchestra.run.smithi114.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44187.log.gz 2024-09-16T07:37:54.788 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50869.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50869.log.gz 2024-09-16T07:37:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42165.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42165.log.gz 2024-09-16T07:37:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35143.log 2024-09-16T07:37:54.790 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55110.log 2024-09-16T07:37:54.792 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54739.log 2024-09-16T07:37:54.792 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35143.log.gz 2024-09-16T07:37:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55110.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55110.log.gz 2024-09-16T07:37:54.794 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54739.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54739.log.gz 2024-09-16T07:37:54.794 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53517.log 2024-09-16T07:37:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55264.log 2024-09-16T07:37:54.797 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53692.log 2024-09-16T07:37:54.797 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53517.log.gz 2024-09-16T07:37:54.797 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55264.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55264.log.gz 2024-09-16T07:37:54.799 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53692.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53692.log.gz 2024-09-16T07:37:54.799 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50713.log 2024-09-16T07:37:54.800 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40110.log 2024-09-16T07:37:54.802 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38261.log 2024-09-16T07:37:54.802 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50713.log.gz 2024-09-16T07:37:54.802 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40110.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40110.log.gz 2024-09-16T07:37:54.804 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38261.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38261.log.gz 2024-09-16T07:37:54.804 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40904.log 2024-09-16T07:37:54.805 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38840.log 2024-09-16T07:37:54.807 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36224.log 2024-09-16T07:37:54.807 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40904.log.gz 2024-09-16T07:37:54.807 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38840.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38840.log.gz 2024-09-16T07:37:54.809 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.36224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36224.log.gz 2024-09-16T07:37:54.809 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42469.log 2024-09-16T07:37:54.810 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46048.log 2024-09-16T07:37:54.811 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43225.log 2024-09-16T07:37:54.812 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42469.log.gz 2024-09-16T07:37:54.812 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46048.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2024-09-16T07:37:54.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43225.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43225.log.gz 2024-09-16T07:37:54.814 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51872.log 2024-09-16T07:37:54.815 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51407.log 2024-09-16T07:37:54.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49554.log 2024-09-16T07:37:54.817 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51872.log.gz 2024-09-16T07:37:54.818 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51407.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51407.log.gz 2024-09-16T07:37:54.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49554.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49554.log.gz 2024-09-16T07:37:54.820 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38131.log 2024-09-16T07:37:54.820 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2024-09-16T07:37:54.822 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36001.log 2024-09-16T07:37:54.822 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38131.log.gz 2024-09-16T07:37:54.823 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46841.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2024-09-16T07:37:54.824 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36001.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36001.log.gz 2024-09-16T07:37:54.825 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51251.log 2024-09-16T07:37:54.825 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47942.log 2024-09-16T07:37:54.827 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49700.log 2024-09-16T07:37:54.827 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51251.log.gz 2024-09-16T07:37:54.827 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.47942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47942.log.gz 2024-09-16T07:37:54.829 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49700.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49700.log.gz 2024-09-16T07:37:54.829 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52547.log 2024-09-16T07:37:54.830 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45379.log 2024-09-16T07:37:54.832 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37541.log 2024-09-16T07:37:54.832 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52547.log.gz 2024-09-16T07:37:54.833 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45379.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45379.log.gz 2024-09-16T07:37:54.834 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37541.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37541.log.gz 2024-09-16T07:37:54.834 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T07:37:54.835 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53075.log 2024-09-16T07:37:54.837 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2024-09-16T07:37:54.838 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53075.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53075.log.gz 2024-09-16T07:37:54.839 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48192.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2024-09-16T07:37:54.840 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38974.log 2024-09-16T07:37:54.841 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54792.log 2024-09-16T07:37:54.842 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38974.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38974.log.gz 2024-09-16T07:37:54.843 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54792.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54792.log.gz 2024-09-16T07:37:54.844 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39052.log 2024-09-16T07:37:54.845 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40982.log 2024-09-16T07:37:54.846 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39052.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39052.log.gz 2024-09-16T07:37:54.847 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40982.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40982.log.gz 2024-09-16T07:37:54.848 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53303.log 2024-09-16T07:37:54.849 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44055.log 2024-09-16T07:37:54.851 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53303.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53303.log.gz 2024-09-16T07:37:54.851 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44055.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44055.log.gz 2024-09-16T07:37:54.852 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45567.log 2024-09-16T07:37:54.853 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45828.log 2024-09-16T07:37:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45567.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45567.log.gz 2024-09-16T07:37:54.855 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45828.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gz 2024-09-16T07:37:54.856 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45234.log 2024-09-16T07:37:54.857 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2024-09-16T07:37:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45234.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45234.log.gz 2024-09-16T07:37:54.859 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54155.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 2024-09-16T07:37:54.860 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46482.log 2024-09-16T07:37:54.861 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42644.log 2024-09-16T07:37:54.863 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46482.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46482.log.gz 2024-09-16T07:37:54.864 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.42644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42644.log.gz 2024-09-16T07:37:54.864 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52666.log 2024-09-16T07:37:54.865 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40084.log 2024-09-16T07:37:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52666.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52666.log.gz 2024-09-16T07:37:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40084.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2024-09-16T07:37:54.868 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48014.log 2024-09-16T07:37:54.870 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53147.log 2024-09-16T07:37:54.871 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48014.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48014.log.gz 2024-09-16T07:37:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53147.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53147.log.gz 2024-09-16T07:37:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54825.log 2024-09-16T07:37:54.874 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55342.log 2024-09-16T07:37:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54825.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54825.log.gz 2024-09-16T07:37:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55342.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55342.log.gz 2024-09-16T07:37:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40956.log 2024-09-16T07:37:54.878 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42087.log 2024-09-16T07:37:54.879 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40956.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40956.log.gz 2024-09-16T07:37:54.880 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2024-09-16T07:37:54.881 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42087.log.gz 2024-09-16T07:37:54.881 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38384.log 2024-09-16T07:37:54.883 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44356.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2024-09-16T07:37:54.884 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38384.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38384.log.gz 2024-09-16T07:37:54.884 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51956.log 2024-09-16T07:37:54.886 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49604.log 2024-09-16T07:37:54.887 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51956.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51956.log.gz 2024-09-16T07:37:54.888 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49604.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49604.log.gz 2024-09-16T07:37:54.888 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37185.log 2024-09-16T07:37:54.890 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34805.log 2024-09-16T07:37:54.891 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37185.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37185.log.gz 2024-09-16T07:37:54.892 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34805.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34805.log.gz 2024-09-16T07:37:54.893 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41487.log 2024-09-16T07:37:54.894 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 2024-09-16T07:37:54.895 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41487.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2024-09-16T07:37:54.896 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42803.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-09-16T07:37:54.897 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41034.log 2024-09-16T07:37:54.898 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2024-09-16T07:37:54.899 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41034.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41034.log.gz 2024-09-16T07:37:54.901 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2024-09-16T07:37:54.901 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40032.log 2024-09-16T07:37:54.902 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2024-09-16T07:37:54.904 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40032.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40032.log.gz 2024-09-16T07:37:54.904 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41229.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-16T07:37:54.905 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2024-09-16T07:37:54.905 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-09-16T07:37:54.906 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36801.log 2024-09-16T07:37:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48354.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2024-09-16T07:37:54.907 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48300.log 2024-09-16T07:37:54.909 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42742.log 2024-09-16T07:37:54.909 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36801.log.gz 2024-09-16T07:37:54.909 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48300.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48300.log.gz 2024-09-16T07:37:54.910 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39635.log 2024-09-16T07:37:54.910 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42742.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42742.log.gz 2024-09-16T07:37:54.911 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49752.log 2024-09-16T07:37:54.912 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38104.log 2024-09-16T07:37:54.913 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39635.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39635.log.gz 2024-09-16T07:37:54.913 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-16T07:37:54.914 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49752.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49752.log.gz 2024-09-16T07:37:54.914 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41703.log 2024-09-16T07:37:54.914 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38104.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38104.log.gz 2024-09-16T07:37:54.915 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34883.log 2024-09-16T07:37:54.916 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46705.log 2024-09-16T07:37:54.916 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41703.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41703.log.gz 2024-09-16T07:37:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34883.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34883.log.gz 2024-09-16T07:37:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37825.log 2024-09-16T07:37:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46705.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46705.log.gz 2024-09-16T07:37:54.919 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2024-09-16T07:37:54.920 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2024-09-16T07:37:54.920 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.37825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37825.log.gz 2024-09-16T07:37:54.921 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50902.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2024-09-16T07:37:54.921 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44382.log 2024-09-16T07:37:54.922 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43873.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2024-09-16T07:37:54.923 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43686.log 2024-09-16T07:37:54.924 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44382.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44382.log.gz 2024-09-16T07:37:54.924 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40826.log 2024-09-16T07:37:54.925 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49346.log 2024-09-16T07:37:54.925 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43686.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43686.log.gz 2024-09-16T07:37:54.926 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40826.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40826.log.gz 2024-09-16T07:37:54.926 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52878.log 2024-09-16T07:37:54.927 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49346.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49346.log.gz 2024-09-16T07:37:54.928 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54961.log 2024-09-16T07:37:54.929 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45711.log 2024-09-16T07:37:54.929 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52878.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52878.log.gz 2024-09-16T07:37:54.930 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54961.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54961.log.gz 2024-09-16T07:37:54.930 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2024-09-16T07:37:54.931 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45711.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45711.log.gz 2024-09-16T07:37:54.931 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52430.log 2024-09-16T07:37:54.933 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47120.log 2024-09-16T07:37:54.933 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2024-09-16T07:37:54.934 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52430.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52430.log.gz 2024-09-16T07:37:54.934 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2024-09-16T07:37:54.935 INFO:teuthology.orchestra.run.smithi149.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-16T07:37:54.935 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47120.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47120.log.gz 2024-09-16T07:37:54.935 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2024-09-16T07:37:54.936 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37237.log 2024-09-16T07:37:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48380.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gz 2024-09-16T07:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45050.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2024-09-16T07:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43251.log 2024-09-16T07:37:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37237.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37237.log.gz 2024-09-16T07:37:54.939 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51731.log 2024-09-16T07:37:54.940 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37567.log 2024-09-16T07:37:54.941 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43251.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43251.log.gz 2024-09-16T07:37:54.942 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51731.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51731.log.gz 2024-09-16T07:37:54.942 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51509.log 2024-09-16T07:37:54.942 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37567.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37567.log.gz 2024-09-16T07:37:54.943 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35897.log 2024-09-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39980.log 2024-09-16T07:37:54.944 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.51509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51509.log.gz 2024-09-16T07:37:54.945 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35897.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35897.log.gz 2024-09-16T07:37:54.946 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T07:37:54.946 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39980.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39980.log.gz 2024-09-16T07:37:54.947 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39819.log 2024-09-16T07:37:54.948 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53003.log 2024-09-16T07:37:54.949 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.39819.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39819.log.gz 2024-09-16T07:37:54.950 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40449.log 2024-09-16T07:37:54.950 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.53003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53003.log.gz 2024-09-16T07:37:54.951 INFO:teuthology.orchestra.run.smithi114.stderr: 86.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2024-09-16T07:37:54.951 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T07:37:54.952 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40449.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40449.log.gz 2024-09-16T07:37:54.952 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40657.log 2024-09-16T07:37:54.954 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48858.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz -5 2024-09-16T07:37:54.954 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48326.log 2024-09-16T07:37:54.955 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.40657.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-09-16T07:37:54.955 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40657.log.gz 2024-09-16T07:37:54.956 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37820.log 2024-09-16T07:37:54.957 INFO:teuthology.orchestra.run.smithi114.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.48326.log.gz 2024-09-16T07:37:54.957 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46154.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-09-16T07:37:54.957 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2024-09-16T07:37:54.958 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.37820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37820.log.gz 2024-09-16T07:37:54.958 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40364.log 2024-09-16T07:37:54.959 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47962.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2024-09-16T07:37:54.960 INFO:teuthology.orchestra.run.smithi114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39026.log 2024-09-16T07:37:54.961 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29368.log 2024-09-16T07:37:54.961 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40364.log.gz 2024-09-16T07:37:54.961 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39026.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39026.log.gz 2024-09-16T07:37:54.962 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2024-09-16T07:37:54.963 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29368.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29368.log.gz 2024-09-16T07:37:54.963 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36339.log 2024-09-16T07:37:54.964 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41518.log 2024-09-16T07:37:54.965 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2024-09-16T07:37:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.2.36339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36339.log.gz 2024-09-16T07:37:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41451.log 2024-09-16T07:37:54.966 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41518.log.gz 2024-09-16T07:37:54.967 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35117.log 2024-09-16T07:37:54.968 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50614.log 2024-09-16T07:37:54.968 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41451.log.gz 2024-09-16T07:37:54.969 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49121.log 2024-09-16T07:37:54.970 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35117.log.gz 2024-09-16T07:37:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50614.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50614.log.gz 2024-09-16T07:37:54.970 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2024-09-16T07:37:54.971 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50317.log 2024-09-16T07:37:54.971 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49121.log.gz 2024-09-16T07:37:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54636.log 2024-09-16T07:37:54.973 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2024-09-16T07:37:54.973 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50317.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.50317.log.gz 2024-09-16T07:37:54.974 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48657.log 2024-09-16T07:37:54.975 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29422.log 2024-09-16T07:37:54.976 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54636.log.gz 2024-09-16T07:37:54.976 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29072.log 2024-09-16T07:37:54.976 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48657.log.gz 2024-09-16T07:37:54.977 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29422.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29422.log.gz 2024-09-16T07:37:54.977 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37079.log 2024-09-16T07:37:54.979 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29091.log 2024-09-16T07:37:54.979 INFO:teuthology.orchestra.run.smithi114.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29072.log.gz 2024-09-16T07:37:54.979 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51355.log 2024-09-16T07:37:54.979 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37079.log.gz 2024-09-16T07:37:54.981 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29091.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29091.log.gz 2024-09-16T07:37:54.981 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37159.log 2024-09-16T07:37:54.982 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51355.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51355.log.gz 2024-09-16T07:37:54.982 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52183.log 2024-09-16T07:37:54.983 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41255.log 2024-09-16T07:37:54.984 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37159.log.gz 2024-09-16T07:37:54.985 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-09-16T07:37:54.985 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52183.log.gz 2024-09-16T07:37:54.986 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2024-09-16T07:37:54.986 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41255.log.gz 2024-09-16T07:37:54.987 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37319.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-09-16T07:37:54.987 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50432.log 2024-09-16T07:37:54.989 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54584.log 2024-09-16T07:37:54.989 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2024-09-16T07:37:54.989 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2024-09-16T07:37:54.989 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50432.log.gz 2024-09-16T07:37:54.990 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54584.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54584.log.gz 2024-09-16T07:37:54.990 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47412.log 2024-09-16T07:37:54.991 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43162.log 2024-09-16T07:37:54.992 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2024-09-16T07:37:54.993 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47412.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.47412.log.gz --verbose 2024-09-16T07:37:54.993 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.admin.51169.log 2024-09-16T07:37:54.994 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43162.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43162.log.gz 2024-09-16T07:37:54.994 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47358.log 2024-09-16T07:37:54.996 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51026.log 2024-09-16T07:37:54.996 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51169.log.gz 2024-09-16T07:37:54.996 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47793.log 2024-09-16T07:37:54.996 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47358.log.gz 2024-09-16T07:37:54.997 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51026.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51026.log.gz 2024-09-16T07:37:54.998 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50267.log 2024-09-16T07:37:54.999 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55013.log 2024-09-16T07:37:54.999 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47793.log.gz 2024-09-16T07:37:55.000 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37593.log 2024-09-16T07:37:55.000 INFO:teuthology.orchestra.run.smithi114.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50267.log.gz 2024-09-16T07:37:55.001 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55013.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55013.log.gz 2024-09-16T07:37:55.001 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39327.log 2024-09-16T07:37:55.002 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42219.log 2024-09-16T07:37:55.002 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37593.log.gz 2024-09-16T07:37:55.004 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45972.log 2024-09-16T07:37:55.004 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39327.log.gz 2024-09-16T07:37:55.004 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42219.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42219.log.gz 2024-09-16T07:37:55.004 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2024-09-16T07:37:55.005 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36334.log 2024-09-16T07:37:55.006 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45972.log.gz 2024-09-16T07:37:55.007 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52852.log 2024-09-16T07:37:55.007 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2024-09-16T07:37:55.008 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.2.36334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36334.log.gz 2024-09-16T07:37:55.008 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50458.log 2024-09-16T07:37:55.009 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41110.log 2024-09-16T07:37:55.009 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52852.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52852.log.gz 2024-09-16T07:37:55.010 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39545.log 2024-09-16T07:37:55.011 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50458.log.gz 2024-09-16T07:37:55.011 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41110.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41110.log.gz 2024-09-16T07:37:55.011 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49242.log 2024-09-16T07:37:55.013 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55316.log 2024-09-16T07:37:55.013 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39545.log.gz 2024-09-16T07:37:55.014 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41157.log 2024-09-16T07:37:55.014 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49242.log.gz 2024-09-16T07:37:55.015 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55316.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55316.log.gz 2024-09-16T07:37:55.015 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41930.log 2024-09-16T07:37:55.016 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.41157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37380.log 2024-09-16T07:37:55.018 INFO:teuthology.orchestra.run.smithi114.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41157.log.gz 2024-09-16T07:37:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41930.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41930.log.gz 2024-09-16T07:37:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29119.log 2024-09-16T07:37:55.018 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37380.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37380.log.gz 2024-09-16T07:37:55.019 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47947.log 2024-09-16T07:37:55.020 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54856.log 2024-09-16T07:37:55.021 INFO:teuthology.orchestra.run.smithi114.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29119.log.gz 2024-09-16T07:37:55.021 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.47947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47947.log.gz 2024-09-16T07:37:55.021 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47609.log 2024-09-16T07:37:55.022 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35235.log 2024-09-16T07:37:55.023 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54856.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54856.log.gz 2024-09-16T07:37:55.024 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2024-09-16T07:37:55.024 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47609.log.gz 2024-09-16T07:37:55.024 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35235.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35235.log.gz 2024-09-16T07:37:55.025 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42015.log 2024-09-16T07:37:55.026 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-09-16T07:37:55.026 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2024-09-16T07:37:55.027 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39605.log 2024-09-16T07:37:55.027 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42015.log.gz 2024-09-16T07:37:55.028 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50536.log 2024-09-16T07:37:55.028 INFO:teuthology.orchestra.run.smithi114.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-09-16T07:37:55.029 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44003.log 2024-09-16T07:37:55.029 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39605.log.gz 2024-09-16T07:37:55.030 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50536.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50536.log.gz 2024-09-16T07:37:55.031 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49268.log 2024-09-16T07:37:55.031 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44003.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44003.log.gz 2024-09-16T07:37:55.032 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47440.log 2024-09-16T07:37:55.033 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47741.log 2024-09-16T07:37:55.033 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49268.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49268.log.gz 2024-09-16T07:37:55.034 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39666.log 2024-09-16T07:37:55.034 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47440.log.gz 2024-09-16T07:37:55.035 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47741.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47741.log.gz 2024-09-16T07:37:55.035 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39913.log 2024-09-16T07:37:55.036 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53023.log 2024-09-16T07:37:55.036 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39666.log.gz 2024-09-16T07:37:55.038 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53614.log 2024-09-16T07:37:55.038 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39913.log.gz 2024-09-16T07:37:55.038 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53023.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53023.log.gz 2024-09-16T07:37:55.039 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53543.log 2024-09-16T07:37:55.040 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52800.log 2024-09-16T07:37:55.040 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53614.log.gz 2024-09-16T07:37:55.041 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40390.log 2024-09-16T07:37:55.041 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53543.log.gz 2024-09-16T07:37:55.042 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52800.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52800.log.gz 2024-09-16T07:37:55.042 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51930.log 2024-09-16T07:37:55.043 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41318.log 2024-09-16T07:37:55.043 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40390.log.gz 2024-09-16T07:37:55.045 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47172.log 2024-09-16T07:37:55.045 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51930.log.gz 2024-09-16T07:37:55.045 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41318.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41318.log.gz 2024-09-16T07:37:55.046 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38514.log 2024-09-16T07:37:55.047 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45515.log 2024-09-16T07:37:55.047 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47172.log.gz 2024-09-16T07:37:55.048 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38514.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38514.log.gz 2024-09-16T07:37:55.049 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2024-09-16T07:37:55.049 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45515.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45515.log.gz 2024-09-16T07:37:55.050 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35236.log 2024-09-16T07:37:55.051 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53387.log 2024-09-16T07:37:55.052 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54181.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gz/var/log/ceph/ceph-client.admin.35236.log: 2024-09-16T07:37:55.052 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35236.log.gz 2024-09-16T07:37:55.052 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45998.log 2024-09-16T07:37:55.053 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53387.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53387.log.gz 2024-09-16T07:37:55.054 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39433.log 2024-09-16T07:37:55.054 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36853.log 2024-09-16T07:37:55.055 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45998.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45998.log.gz 2024-09-16T07:37:55.056 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49398.log 2024-09-16T07:37:55.056 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39433.log.gz 2024-09-16T07:37:55.057 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36853.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36853.log.gz 2024-09-16T07:37:55.057 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39379.log 2024-09-16T07:37:55.058 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52904.log 2024-09-16T07:37:55.058 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49398.log.gz 2024-09-16T07:37:55.059 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29118.log 2024-09-16T07:37:55.059 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39379.log.gz 2024-09-16T07:37:55.060 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43530.log 2024-09-16T07:37:55.061 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52904.log: /var/log/ceph/ceph-client.admin.29118.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52904.log.gz 2024-09-16T07:37:55.062 INFO:teuthology.orchestra.run.smithi114.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29118.log.gz 2024-09-16T07:37:55.062 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43277.log 2024-09-16T07:37:55.063 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43530.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43530.log.gz 2024-09-16T07:37:55.063 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52313.log 2024-09-16T07:37:55.065 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43478.log 2024-09-16T07:37:55.065 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43277.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43277.log.gz 2024-09-16T07:37:55.066 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53101.log 2024-09-16T07:37:55.066 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52313.log.gz 2024-09-16T07:37:55.066 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43478.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43478.log.gz 2024-09-16T07:37:55.067 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55734.log 2024-09-16T07:37:55.068 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37514.log 2024-09-16T07:37:55.068 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53101.log.gz 2024-09-16T07:37:55.069 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2024-09-16T07:37:55.069 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55734.log.gz 2024-09-16T07:37:55.070 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37514.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37514.log.gz 2024-09-16T07:37:55.070 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35452.log 2024-09-16T07:37:55.071 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34723.log 2024-09-16T07:37:55.071 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2024-09-16T07:37:55.072 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49854.log 2024-09-16T07:37:55.073 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35452.log.gz 2024-09-16T07:37:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34723.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34723.log.gz 2024-09-16T07:37:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50954.log 2024-09-16T07:37:55.075 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36469.log 2024-09-16T07:37:55.075 INFO:teuthology.orchestra.run.smithi114.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49854.log.gz 2024-09-16T07:37:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50954.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50954.log.gz 2024-09-16T07:37:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53465.log 2024-09-16T07:37:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36469.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36469.log.gz 2024-09-16T07:37:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36495.log 2024-09-16T07:37:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29090.log 2024-09-16T07:37:55.079 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53465.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53465.log.gz 2024-09-16T07:37:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41597.log 2024-09-16T07:37:55.080 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36495.log.gz 2024-09-16T07:37:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38948.log 2024-09-16T07:37:55.081 INFO:teuthology.orchestra.run.smithi114.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29090.log.gz 2024-09-16T07:37:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50588.log 2024-09-16T07:37:55.082 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41597.log.gz 2024-09-16T07:37:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38948.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38948.log.gz 2024-09-16T07:37:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35091.log 2024-09-16T07:37:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50588.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50588.log.gz 2024-09-16T07:37:55.085 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43504.log 2024-09-16T07:37:55.086 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44789.log 2024-09-16T07:37:55.086 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35091.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35091.log.gz 2024-09-16T07:37:55.087 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43504.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T07:37:55.087 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43504.log.gz 2024-09-16T07:37:55.088 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44789.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44789.log.gz 2024-09-16T07:37:55.088 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49804.log 2024-09-16T07:37:55.089 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-16T07:37:55.091 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49804.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.49804.log.gz 2024-09-16T07:37:55.091 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46210.log 2024-09-16T07:37:55.094 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.46210.log: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T07:37:55.094 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46210.log.gz 2024-09-16T07:37:55.095 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2024-09-16T07:37:55.095 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-09-16T07:37:55.097 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42139.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2024-09-16T07:37:55.097 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34570.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-09-16T07:37:55.098 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38540.log 2024-09-16T07:37:55.099 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-16T07:37:55.101 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38540.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38540.log.gz 2024-09-16T07:37:55.104 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43767.log 2024-09-16T07:37:55.105 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2024-09-16T07:37:55.106 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43767.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43767.log.gz 2024-09-16T07:37:55.107 INFO:teuthology.orchestra.run.smithi149.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-16T07:37:55.109 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41729.log 2024-09-16T07:37:55.110 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36443.log 2024-09-16T07:37:55.110 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2024-09-16T07:37:55.112 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41729.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41729.log.gz 2024-09-16T07:37:55.118 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45411.log 2024-09-16T07:37:55.118 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53439.log 2024-09-16T07:37:55.119 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36443.log.gz 2024-09-16T07:37:55.122 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53439.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53439.log.gz 2024-09-16T07:37:55.125 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45411.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45411.log.gz 2024-09-16T07:37:55.126 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42247.log 2024-09-16T07:37:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48975.log 2024-09-16T07:37:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2024-09-16T07:37:55.129 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42247.log.gz 2024-09-16T07:37:55.129 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48975.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48975.log.gz 2024-09-16T07:37:55.138 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55189.log 2024-09-16T07:37:55.138 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43951.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz 2024-09-16T07:37:55.142 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38748.log 2024-09-16T07:37:55.142 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55189.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55189.log.gz 2024-09-16T07:37:55.146 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44815.log 2024-09-16T07:37:55.146 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38748.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38748.log.gz 2024-09-16T07:37:55.150 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-09-16T07:37:55.150 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44815.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44815.log.gz 2024-09-16T07:37:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45353.log 2024-09-16T07:37:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50079.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-09-16T07:37:55.158 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52112.log 2024-09-16T07:37:55.158 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45353.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45353.log.gz 2024-09-16T07:37:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55837.log 2024-09-16T07:37:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41545.log 2024-09-16T07:37:55.161 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52112.log.gz 2024-09-16T07:37:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55837.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55837.log.gz 2024-09-16T07:37:55.163 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41545.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41545.log.gz 2024-09-16T07:37:55.164 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36957.log 2024-09-16T07:37:55.167 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36957.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36957.log.gz 2024-09-16T07:37:55.167 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2024-09-16T07:37:55.171 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55422.log 2024-09-16T07:37:55.171 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37105.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2024-09-16T07:37:55.172 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50004.log 2024-09-16T07:37:55.173 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55422.log.gz 2024-09-16T07:37:55.177 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34909.log 2024-09-16T07:37:55.181 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50004.log: /var/log/ceph/ceph-client.admin.34909.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34909.log.gz 2024-09-16T07:37:55.182 INFO:teuthology.orchestra.run.smithi114.stderr: 84.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53770.log 2024-09-16T07:37:55.182 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50004.log.gz 2024-09-16T07:37:55.184 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50405.log 2024-09-16T07:37:55.184 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53770.log.gz 2024-09-16T07:37:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50405.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50405.log.gz 2024-09-16T07:37:55.189 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37840.log 2024-09-16T07:37:55.191 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37840.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37840.log.gz 2024-09-16T07:37:55.191 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47895.log 2024-09-16T07:37:55.194 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47895.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47895.log.gz 2024-09-16T07:37:55.194 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44919.log 2024-09-16T07:37:55.197 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44919.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44919.log.gz 2024-09-16T07:37:55.197 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39312.log 2024-09-16T07:37:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.39312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39312.log.gz 2024-09-16T07:37:55.200 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41008.log 2024-09-16T07:37:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41008.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41008.log.gz 2024-09-16T07:37:55.203 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54883.log 2024-09-16T07:37:55.206 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53744.log 2024-09-16T07:37:55.206 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54883.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54883.log.gz 2024-09-16T07:37:55.209 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53744.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53744.log.gz 2024-09-16T07:37:55.209 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48754.log 2024-09-16T07:37:55.215 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48754.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48754.log.gz 2024-09-16T07:37:55.215 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44997.log 2024-09-16T07:37:55.215 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44997.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44997.log.gz 2024-09-16T07:37:55.215 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2024-09-16T07:37:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55811.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-09-16T07:37:55.218 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37053.log 2024-09-16T07:37:55.221 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54285.log 2024-09-16T07:37:55.221 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37053.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37053.log.gz 2024-09-16T07:37:55.224 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54285.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54285.log.gz 2024-09-16T07:37:55.224 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39210.log 2024-09-16T07:37:55.224 INFO:teuthology.orchestra.run.smithi149.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-16T07:37:55.227 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39210.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39210.log.gz 2024-09-16T07:37:55.227 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49212.log 2024-09-16T07:37:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49212.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49212.log.gz 2024-09-16T07:37:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36667.log 2024-09-16T07:37:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36667.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2024-09-16T07:37:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37868.log 2024-09-16T07:37:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37868.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37868.log.gz 2024-09-16T07:37:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46180.log 2024-09-16T07:37:55.237 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46388.log 2024-09-16T07:37:55.239 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46180.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46180.log.gz 2024-09-16T07:37:55.242 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46388.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46388.log.gz 2024-09-16T07:37:55.242 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49502.log 2024-09-16T07:37:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49502.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49502.log.gz 2024-09-16T07:37:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47557.log 2024-09-16T07:37:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47557.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47557.log.gz 2024-09-16T07:37:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2024-09-16T07:37:55.251 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48943.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2024-09-16T07:37:55.251 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38073.log 2024-09-16T07:37:55.254 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47687.log 2024-09-16T07:37:55.254 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38073.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38073.log.gz 2024-09-16T07:37:55.257 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47687.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47687.log.gz 2024-09-16T07:37:55.257 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42521.log 2024-09-16T07:37:55.259 INFO:teuthology.orchestra.run.smithi149.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-16T07:37:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42521.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42521.log.gz 2024-09-16T07:37:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51052.log 2024-09-16T07:37:55.262 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51052.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2024-09-16T07:37:55.262 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-09-16T07:37:55.265 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49424.log 2024-09-16T07:37:55.265 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47661.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-09-16T07:37:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49424.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49424.log.gz 2024-09-16T07:37:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-09-16T07:37:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47845.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-09-16T07:37:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48884.log 2024-09-16T07:37:55.274 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48884.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48884.log.gz 2024-09-16T07:37:55.274 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44408.log 2024-09-16T07:37:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44408.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.44408.log.gz 2024-09-16T07:37:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-09-16T07:37:55.280 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48604.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-09-16T07:37:55.280 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40338.log 2024-09-16T07:37:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40338.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40338.log.gz 2024-09-16T07:37:55.283 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53953.log 2024-09-16T07:37:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50739.log 2024-09-16T07:37:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53953.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53953.log.gz 2024-09-16T07:37:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36749.log 2024-09-16T07:37:55.289 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50739.log.gz 2024-09-16T07:37:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36749.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36749.log.gz 2024-09-16T07:37:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48447.log 2024-09-16T07:37:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44432.log 2024-09-16T07:37:55.295 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48447.log.gz 2024-09-16T07:37:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2024-09-16T07:37:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44432.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44432.log.gz 2024-09-16T07:37:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.50141.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47988.log 2024-09-16T07:37:55.301 INFO:teuthology.orchestra.run.smithi114.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2024-09-16T07:37:55.304 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48910.log 2024-09-16T07:37:55.304 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47988.log.gz 2024-09-16T07:37:55.306 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55682.log 2024-09-16T07:37:55.310 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55682.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55682.log.gz 2024-09-16T07:37:55.310 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48910.log.gz 2024-09-16T07:37:55.311 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24049.log 2024-09-16T07:37:55.312 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53217.log 2024-09-16T07:37:55.313 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.tmp-client.admin.24049.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24049.log.gz 2024-09-16T07:37:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53217.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53217.log.gz 2024-09-16T07:37:55.316 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38777.log 2024-09-16T07:37:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38777.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38777.log.gz 2024-09-16T07:37:55.319 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52748.log 2024-09-16T07:37:55.322 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52748.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52748.log.gz 2024-09-16T07:37:55.322 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38183.log 2024-09-16T07:37:55.324 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48832.log 2024-09-16T07:37:55.325 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38183.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38183.log.gz 2024-09-16T07:37:55.326 INFO:teuthology.orchestra.run.smithi149.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-16T07:37:55.327 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48832.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gz 2024-09-16T07:37:55.328 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43188.log 2024-09-16T07:37:55.329 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-09-16T07:37:55.329 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m0.861s 2024-09-16T07:37:55.329 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m3.729s 2024-09-16T07:37:55.329 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m0.325s 2024-09-16T07:37:55.331 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43188.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43188.log.gz 2024-09-16T07:37:55.331 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28936.log 2024-09-16T07:37:55.333 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28936.log.gz 2024-09-16T07:37:55.333 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39353.log 2024-09-16T07:37:55.336 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39353.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39353.log.gz 2024-09-16T07:37:55.337 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35013.log 2024-09-16T07:37:55.339 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35013.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35013.log.gz 2024-09-16T07:37:55.339 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43977.log 2024-09-16T07:37:55.344 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42885.log 2024-09-16T07:37:55.344 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43977.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43977.log.gz 2024-09-16T07:37:55.344 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43374.log 2024-09-16T07:37:55.345 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42885.log.gz 2024-09-16T07:37:55.347 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43374.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43374.log.gz 2024-09-16T07:37:55.348 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35652.log 2024-09-16T07:37:55.350 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52495.log 2024-09-16T07:37:55.351 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35652.log.gz 2024-09-16T07:37:55.353 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29106.log 2024-09-16T07:37:55.355 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52495.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52495.log.gz 2024-09-16T07:37:55.357 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29106.log: /var/log/ceph/ceph-client.admin.49092.log 2024-09-16T07:37:55.358 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29106.log.gz 2024-09-16T07:37:55.360 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.49092.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50104.log 2024-09-16T07:37:55.363 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50104.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50104.log.gz 2024-09-16T07:37:55.364 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49092.log.gz 2024-09-16T07:37:55.364 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44330.log 2024-09-16T07:37:55.367 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44330.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44330.log.gz 2024-09-16T07:37:55.367 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2024-09-16T07:37:55.370 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49476.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2024-09-16T07:37:55.370 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50166.log 2024-09-16T07:37:55.372 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41571.log 2024-09-16T07:37:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50166.log: /var/log/ceph/ceph-client.admin.41571.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.50166.log.gz 2024-09-16T07:37:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52034.log 2024-09-16T07:37:55.380 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41571.log.gz 2024-09-16T07:37:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52034.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52034.log.gz 2024-09-16T07:37:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48166.log 2024-09-16T07:37:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48166.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48166.log.gz 2024-09-16T07:37:55.380 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37671.log 2024-09-16T07:37:55.382 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37671.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37671.log.gz 2024-09-16T07:37:55.382 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51000.log 2024-09-16T07:37:55.385 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-09-16T07:37:55.386 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51000.log.gz 2024-09-16T07:37:55.387 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51698.log 2024-09-16T07:37:55.389 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34831.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-09-16T07:37:55.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2024-09-16T07:37:55.392 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51698.log.gz 2024-09-16T07:37:55.393 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2024-09-16T07:37:55.397 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52692.log: /var/log/ceph/ceph-client.admin.46990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40852.log 2024-09-16T07:37:55.398 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41623.log 2024-09-16T07:37:55.398 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40852.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2024-09-16T07:37:55.399 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40852.log.gz 2024-09-16T07:37:55.401 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42308.log 2024-09-16T07:37:55.403 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41623.log.gz 2024-09-16T07:37:55.403 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46815.log 2024-09-16T07:37:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42308.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42308.log.gz 2024-09-16T07:37:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46815.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46815.log.gz 2024-09-16T07:37:55.406 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50765.log 2024-09-16T07:37:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50765.log.gz 2024-09-16T07:37:55.409 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36417.log 2024-09-16T07:37:55.411 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42113.log 2024-09-16T07:37:55.413 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36417.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36417.log.gz 2024-09-16T07:37:55.413 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41373.log 2024-09-16T07:37:55.414 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42113.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42113.log.gz 2024-09-16T07:37:55.416 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41373.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41373.log.gz 2024-09-16T07:37:55.416 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41399.log 2024-09-16T07:37:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41399.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41399.log.gz 2024-09-16T07:37:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41203.log 2024-09-16T07:37:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41203.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41203.log.gz 2024-09-16T07:37:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45541.log 2024-09-16T07:37:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45541.log.gz 2024-09-16T07:37:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49979.log 2024-09-16T07:37:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49979.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.49979.log.gz 2024-09-16T07:37:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36027.log 2024-09-16T07:37:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36027.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.36027.log.gz 2024-09-16T07:37:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44633.log 2024-09-16T07:37:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37894.log 2024-09-16T07:37:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44633.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44633.log.gz 2024-09-16T07:37:55.437 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37894.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37894.log.gz 2024-09-16T07:37:55.437 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54538.log 2024-09-16T07:37:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.54538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54538.log.gz 2024-09-16T07:37:55.440 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39260.log 2024-09-16T07:37:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39260.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39260.log.gz 2024-09-16T07:37:55.443 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44893.log 2024-09-16T07:37:55.448 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40930.log 2024-09-16T07:37:55.448 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44893.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44893.log.gz 2024-09-16T07:37:55.448 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-09-16T07:37:55.449 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40930.log.gz 2024-09-16T07:37:55.450 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46789.log 2024-09-16T07:37:55.452 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34779.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-09-16T07:37:55.453 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52577.log 2024-09-16T07:37:55.455 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46789.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46789.log.gz 2024-09-16T07:37:55.456 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55065.log 2024-09-16T07:37:55.458 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52577.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52577.log.gz 2024-09-16T07:37:55.460 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39698.log 2024-09-16T07:37:55.462 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55065.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55065.log.gz 2024-09-16T07:37:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55474.log 2024-09-16T07:37:55.468 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55474.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55474.log.gz 2024-09-16T07:37:55.468 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39698.log.gz 2024-09-16T07:37:55.468 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50342.log 2024-09-16T07:37:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50342.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50342.log.gz 2024-09-16T07:37:55.471 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2024-09-16T07:37:55.474 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47384.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2024-09-16T07:37:55.474 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35871.log 2024-09-16T07:37:55.477 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35871.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35871.log.gz 2024-09-16T07:37:55.477 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54036.log 2024-09-16T07:37:55.480 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35440.log 2024-09-16T07:37:55.482 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54036.log: /var/log/ceph/ceph-client.admin.35440.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35440.log.gz 2024-09-16T07:37:55.482 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54036.log.gz 2024-09-16T07:37:55.483 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36389.log 2024-09-16T07:37:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36389.log: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T07:37:55.486 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36389.log.gz 2024-09-16T07:37:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42191.log 2024-09-16T07:37:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40312.log 2024-09-16T07:37:55.489 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42191.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42191.log.gz 2024-09-16T07:37:55.490 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40312.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40312.log.gz 2024-09-16T07:37:55.490 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53666.log 2024-09-16T07:37:55.491 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47285.log 2024-09-16T07:37:55.493 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53666.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53666.log.gz 2024-09-16T07:37:55.494 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47285.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47285.log.gz 2024-09-16T07:37:55.494 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46669.log 2024-09-16T07:37:55.496 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35845.log 2024-09-16T07:37:55.497 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46669.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46669.log.gz 2024-09-16T07:37:55.498 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35845.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35845.log.gz 2024-09-16T07:37:55.498 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2024-09-16T07:37:55.500 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40207.log 2024-09-16T07:37:55.501 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45894.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2024-09-16T07:37:55.502 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40207.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40207.log.gz 2024-09-16T07:37:55.502 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34857.log 2024-09-16T07:37:55.504 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2024-09-16T07:37:55.505 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34857.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34857.log.gz 2024-09-16T07:37:55.506 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43795.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2024-09-16T07:37:55.507 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42443.log 2024-09-16T07:37:55.508 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49651.log 2024-09-16T07:37:55.509 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42443.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42443.log.gz 2024-09-16T07:37:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.49651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49651.log.gz 2024-09-16T07:37:55.510 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41651.log 2024-09-16T07:37:55.512 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51195.log 2024-09-16T07:37:55.513 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41651.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41651.log.gz 2024-09-16T07:37:55.514 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51195.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51195.log.gz 2024-09-16T07:37:55.515 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50192.log 2024-09-16T07:37:55.516 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2024-09-16T07:37:55.517 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50192.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.50192.log.gz 2024-09-16T07:37:55.518 INFO:teuthology.orchestra.run.smithi114.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T07:37:55.518 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51524.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2024-09-16T07:37:55.518 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53830.log 2024-09-16T07:37:55.520 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55552.log 2024-09-16T07:37:55.521 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38488.log 2024-09-16T07:37:55.521 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53830.log.gz 2024-09-16T07:37:55.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55552.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55552.log.gz 2024-09-16T07:37:55.523 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38488.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38488.log.gz 2024-09-16T07:37:55.524 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-09-16T07:37:55.525 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51457.log 2024-09-16T07:37:55.527 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-09-16T07:37:55.527 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-09-16T07:37:55.528 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38566.log 2024-09-16T07:37:55.528 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51457.log.gz 2024-09-16T07:37:55.529 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43556.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-09-16T07:37:55.529 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49066.log 2024-09-16T07:37:55.530 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38566.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38566.log.gz 2024-09-16T07:37:55.530 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50659.log 2024-09-16T07:37:55.531 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51303.log 2024-09-16T07:37:55.532 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49066.log.gz 2024-09-16T07:37:55.533 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50659.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50659.log.gz 2024-09-16T07:37:55.534 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51303.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51303.log.gz 2024-09-16T07:37:55.534 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49372.log 2024-09-16T07:37:55.535 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39943.log 2024-09-16T07:37:55.537 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55137.log 2024-09-16T07:37:55.537 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49372.log.gz 2024-09-16T07:37:55.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36775.log 2024-09-16T07:37:55.538 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39943.log.gz 2024-09-16T07:37:55.539 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55137.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55137.log.gz 2024-09-16T07:37:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51576.log 2024-09-16T07:37:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36775.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36775.log.gz 2024-09-16T07:37:55.540 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39883.log 2024-09-16T07:37:55.542 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-09-16T07:37:55.542 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51576.log.gz 2024-09-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.39883.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39883.log.gz 2024-09-16T07:37:55.544 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40058.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2024-09-16T07:37:55.545 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52287.log 2024-09-16T07:37:55.546 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-09-16T07:37:55.547 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41425.log 2024-09-16T07:37:55.547 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52287.log.gz 2024-09-16T07:37:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46562.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-09-16T07:37:55.549 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41425.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41425.log.gz 2024-09-16T07:37:55.550 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44304.log 2024-09-16T07:37:55.551 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35065.log 2024-09-16T07:37:55.552 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48630.log 2024-09-16T07:37:55.553 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44304.log.gz 2024-09-16T07:37:55.554 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35065.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35065.log.gz 2024-09-16T07:37:55.555 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48630.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48630.log.gz 2024-09-16T07:37:55.555 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2024-09-16T07:37:55.556 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54099.log 2024-09-16T07:37:55.557 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55708.log 2024-09-16T07:37:55.558 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2024-09-16T07:37:55.559 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2024-09-16T07:37:55.559 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54099.log.gz 2024-09-16T07:37:55.560 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55708.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55708.log.gz 2024-09-16T07:37:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36827.log 2024-09-16T07:37:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43452.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2024-09-16T07:37:55.561 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34935.log 2024-09-16T07:37:55.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48526.log 2024-09-16T07:37:55.563 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36827.log.gz 2024-09-16T07:37:55.565 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34935.log.gz 2024-09-16T07:37:55.565 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48526.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48526.log.gz 2024-09-16T07:37:55.566 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48702.log 2024-09-16T07:37:55.567 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41060.log 2024-09-16T07:37:55.568 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35447.log 2024-09-16T07:37:55.568 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48702.log.gz 2024-09-16T07:37:55.570 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41060.log: 91.2%/var/log/ceph/ceph-client.admin.35447.log: -- replaced with /var/log/ceph/ceph-client.admin.41060.log.gz 2024-09-16T07:37:55.570 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35447.log.gz 2024-09-16T07:37:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2024-09-16T07:37:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49879.log 2024-09-16T07:37:55.573 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28960.log 2024-09-16T07:37:55.573 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2024-09-16T07:37:55.574 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49450.log 2024-09-16T07:37:55.575 INFO:teuthology.orchestra.run.smithi114.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.49879.log.gz 2024-09-16T07:37:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28960.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28960.log.gz 2024-09-16T07:37:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35656.log 2024-09-16T07:37:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49450.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49450.log.gz 2024-09-16T07:37:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37645.log 2024-09-16T07:37:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35656.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35656.log.gz 2024-09-16T07:37:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42495.log 2024-09-16T07:37:55.580 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36638.log 2024-09-16T07:37:55.581 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37645.log.gz 2024-09-16T07:37:55.582 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54125.log 2024-09-16T07:37:55.582 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42495.log.gz 2024-09-16T07:37:55.583 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.36638.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36638.log.gz 2024-09-16T07:37:55.583 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52060.log 2024-09-16T07:37:55.584 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.54125.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54125.log.gz 2024-09-16T07:37:55.585 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35232.log 2024-09-16T07:37:55.586 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.52060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35657.log 2024-09-16T07:37:55.586 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52060.log.gz 2024-09-16T07:37:55.587 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35232.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35232.log.gz 2024-09-16T07:37:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2024-09-16T07:37:55.588 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35657.log.gz 2024-09-16T07:37:55.589 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37773.log 2024-09-16T07:37:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2024-09-16T07:37:55.591 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2024-09-16T07:37:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38892.log 2024-09-16T07:37:55.591 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37773.log.gz 2024-09-16T07:37:55.593 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45868.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2024-09-16T07:37:55.593 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40260.log 2024-09-16T07:37:55.594 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.38892.log: gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.38892.log.gz /var/log/ceph/ceph-client.admin.34603.log 2024-09-16T07:37:55.594 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51982.log 2024-09-16T07:37:55.595 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40260.log.gz 2024-09-16T07:37:55.597 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34603.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34603.log.gz 2024-09-16T07:37:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51982.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51982.log.gz 2024-09-16T07:37:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29120.log 2024-09-16T07:37:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50484.log 2024-09-16T07:37:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.29120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35435.log 2024-09-16T07:37:55.601 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29120.log.gz 2024-09-16T07:37:55.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50484.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50484.log.gz 2024-09-16T07:37:55.602 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55526.log 2024-09-16T07:37:55.603 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35435.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35435.log.gz 2024-09-16T07:37:55.603 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34187.log 2024-09-16T07:37:55.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37723.log 2024-09-16T07:37:55.605 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55526.log.gz 2024-09-16T07:37:55.606 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.34187.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34187.log.gz 2024-09-16T07:37:55.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37723.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37723.log.gz 2024-09-16T07:37:55.608 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44519.log 2024-09-16T07:37:55.609 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53049.log 2024-09-16T07:37:55.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46736.log 2024-09-16T07:37:55.610 INFO:teuthology.orchestra.run.smithi114.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44519.log.gz 2024-09-16T07:37:55.611 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.53049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49779.log 2024-09-16T07:37:55.612 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53049.log.gz 2024-09-16T07:37:55.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46736.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46736.log.gz 2024-09-16T07:37:55.613 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2024-09-16T07:37:55.614 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51810.log 2024-09-16T07:37:55.615 INFO:teuthology.orchestra.run.smithi114.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.49779.log.gz 2024-09-16T07:37:55.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37619.log 2024-09-16T07:37:55.616 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2024-09-16T07:37:55.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51810.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51810.log.gz 2024-09-16T07:37:55.618 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.37619.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37619.log.gz 2024-09-16T07:37:55.618 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55368.log 2024-09-16T07:37:55.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.55368.log: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T07:37:55.621 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55368.log.gz 2024-09-16T07:37:55.680 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-16T07:37:55.687 INFO:teuthology.orchestra.run.smithi114.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T07:37:55.707 INFO:teuthology.orchestra.run.smithi114.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T07:37:56.052 INFO:teuthology.orchestra.run.smithi114.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-16T07:37:56.054 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T07:37:56.054 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m1.631s 2024-09-16T07:37:56.054 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m6.999s 2024-09-16T07:37:56.054 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m1.718s 2024-09-16T07:37:56.055 INFO:tasks.ceph:Archiving logs... 2024-09-16T07:37:56.055 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/remote/smithi114/log 2024-09-16T07:37:56.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T07:37:57.340 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/remote/smithi149/log 2024-09-16T07:37:57.340 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T07:37:57.778 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T07:37:57.788 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T07:37:57.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T07:37:57.792 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T07:37:57.867 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T07:37:57.877 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T07:37:57.877 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:37:57.880 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:37:57.893 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T07:37:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-09-16T07:37:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:*hv01.front.sepi 67.205.162.81 3 u 13 64 377 0.068 -7.585 2.552 2024-09-16T07:37:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:+hv02.front.sepi 63.231.80.2 3 u 20 64 377 0.092 +1.960 1.988 2024-09-16T07:37:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.093 -2.984 3.330 2024-09-16T07:37:57.893 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-16T07:37:57.896 INFO:teuthology.orchestra.run.smithi149.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T07:37:57.896 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================== 2024-09-16T07:37:57.896 INFO:teuthology.orchestra.run.smithi149.stdout:*hv01.front.sepi 67.205.162.81 3 u 17 64 377 0.074 -3.046 0.921 2024-09-16T07:37:57.896 INFO:teuthology.orchestra.run.smithi149.stdout:+hv02.front.sepi 63.231.80.2 3 u 18 64 377 0.104 +2.941 1.162 2024-09-16T07:37:57.896 INFO:teuthology.orchestra.run.smithi149.stdout:+hv03.front.sepi 74.6.168.72 3 u 15 64 377 0.079 -1.466 1.726 2024-09-16T07:37:57.896 INFO:teuthology.orchestra.run.smithi149.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-16T07:37:57.897 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T07:37:57.906 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T07:37:57.907 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T07:37:57.915 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T07:37:57.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T07:37:57.931 INFO:teuthology.task.internal:Duration was 1310.418837 seconds 2024-09-16T07:37:57.931 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T07:37:57.939 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T07:37:57.940 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T07:37:57.943 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T07:37:58.043 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T07:37:58.043 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T07:37:58.043 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T07:37:58.065 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-09-16T07:37:58.065 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T07:37:58.085 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T07:37:58.086 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T07:37:58.115 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T07:37:58.173 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T07:37:58.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T07:37:58.202 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T07:37:58.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T07:37:58.301 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T07:37:58.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T07:37:58.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T07:37:58.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T07:37:58.352 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:37:58.366 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:37:58.380 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-09-16T07:37:58.401 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-09-16T07:37:58.420 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:37:58.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:37:58.450 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:37:58.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:37:58.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T07:37:58.478 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T07:37:58.479 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/remote/smithi114 2024-09-16T07:37:58.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T07:37:58.517 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/khiremat-2024-09-16_07:02:54-fs:volumes-wip-athakkar-testing-2024-09-15-1936-distro-default-smithi/7906855/remote/smithi149 2024-09-16T07:37:58.518 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T07:37:58.543 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T07:37:58.543 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T07:37:58.558 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T07:37:58.592 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T07:37:58.604 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T07:37:58.604 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T07:37:58.614 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T07:37:58.615 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T07:37:58.618 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T07:37:58.623 INFO:teuthology.orchestra.run.smithi114.stdout: 658142 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 07:37 /home/ubuntu/cephtest 2024-09-16T07:37:58.637 INFO:teuthology.orchestra.run.smithi149.stdout: 658143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 07:37 /home/ubuntu/cephtest 2024-09-16T07:37:58.639 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T07:37:58.746 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T07:37:58.787 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} duration: 1310.418836593628 flavor: default owner: scheduled_khiremat@teuthology success: true 2024-09-16T07:37:58.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:37:58.883 INFO:teuthology.run:pass